FE metadata replay failure

[sfwang218]

Steps to reproduce the behavior (Required)

1. CREATE TABLE

CREATE TABLE `test`.`test_01`(
    `id` bigint COMMENT '',
    `partition` date COMMENT ''
) ENGINE = OLAP 
DUPLICATE KEY(`id`) COMMENT '' 
PARTITION BY date_trunc('day', `partition`)
DISTRIBUTED BY HASH(`id`) BUCKETS 3;

2. When Follower FE replay the journal, it well throw a exception

ERROR (replayer|99) [GlobalStateMgr$5.runOneCycle():2210] replayer thread catch an exception when replay journal 307699037.
com.starrocks.journal.JournalException: fail to read journal entity key=307699037, data=<DatabaseEntry offset="0" size="12963" data="50 200 0 0 50 157 123 34 100 34 58 34 104 100 112 95 116 101 117 95 100 112 100 95 115 116 97 114 114 111 99 107 115 100 98 34 44 34 116 34 58 123 34 99 108 97 122 122 34 58 34 79 108 97 112 84 97 98 108 101 34 44 34 99 108 117 115 116 101 114 73 100 34 58 49 57 54 50 54 51 52 55 55 49 44 34 115 116 97 116 101 34 58 34 78 79 82 77 65 76  ... 12863 bytes not shown "/>
at com.starrocks.journal.bdbje.BDBJournalCursor.deserializeData(BDBJournalCursor.java:254) ~[starrocks-fe.jar:?]
at com.starrocks.journal.bdbje.BDBJournalCursor.next(BDBJournalCursor.java:292) ~[starrocks-fe.jar:?]
at com.starrocks.server.GlobalStateMgr.replayJournalInner(GlobalStateMgr.java:2336) ~[starrocks-fe.jar:?]
at com.starrocks.server.GlobalStateMgr$5.runOneCycle(GlobalStateMgr.java:2201) ~[starrocks-fe.jar:?]
at com.starrocks.common.util.Daemon.run(Daemon.java:107) ~[starrocks-fe.jar:?]
at com.starrocks.server.GlobalStateMgr$5.run(GlobalStateMgr.java:2266) ~[starrocks-fe.jar:?]
Caused by: com.starrocks.sql.parser.ParsingException: Getting syntax error at line 1, column 10. Detail message: Unexpected input '(', the most similar input is {<EOF>}.
at com.starrocks.sql.parser.ErrorHandler.syntaxError(ErrorHandler.java:40) ~[starrocks-fe.jar:?]
at org.antlr.v4.runtime.ProxyErrorListener.syntaxError(ProxyErrorListener.java:41) ~[antlr4-runtime-4.9.2.jar:4.9.2]
at org.antlr.v4.runtime.Parser.notifyErrorListeners(Parser.java:544) ~[antlr4-runtime-4.9.2.jar:4.9.2]
at com.starrocks.sql.parser.SqlParser$1.reportInputMismatch(SqlParser.java:203) ~[starrocks-fe.jar:?]
at org.antlr.v4.runtime.DefaultErrorStrategy.reportError(DefaultErrorStrategy.java:139) ~[antlr4-runtime-4.9.2.jar:4.9.2]
at com.starrocks.sql.parser.StarRocksParser.expressionSingleton(StarRocksParser.java:36327) ~[starrocks-fe.jar:?]
at com.starrocks.sql.parser.SqlParser.parseSqlToExpr(SqlParser.java:150) ~[starrocks-fe.jar:?]
at com.starrocks.catalog.ExpressionRangePartitionInfo.gsonPostProcess(ExpressionRangePartitionInfo.java:86) ~[starrocks-fe.jar:?]
at com.starrocks.persist.gson.GsonUtils$ProcessHookTypeAdapterFactory$1.read(GsonUtils.java:662) ~[starrocks-fe.jar:?]
at com.google.gson.TypeAdapter.fromJsonTree(TypeAdapter.java:285) ~[spark-dpp-1.0.0.jar:?]
at com.starrocks.persist.gson.RuntimeTypeAdapterFactory$1.read(RuntimeTypeAdapterFactory.java:386) ~[starrocks-fe.jar:?]
at com.google.gson.TypeAdapter$1.read(TypeAdapter.java:199) ~[spark-dpp-1.0.0.jar:?]
at com.google.gson.internal.bind.ReflectiveTypeAdapterFactory$1.read(ReflectiveTypeAdapterFactory.java:131) ~[spark-dpp-1.0.0.jar:?]
at com.google.gson.internal.bind.ReflectiveTypeAdapterFactory$Adapter.read(ReflectiveTypeAdapterFactory.java:222) ~[spark-dpp-1.0.0.jar:?]
at com.starrocks.persist.gson.GsonUtils$ProcessHookTypeAdapterFactory$1.read(GsonUtils.java:660) ~[starrocks-fe.jar:?]
at com.google.gson.TypeAdapter.fromJsonTree(TypeAdapter.java:285) ~[spark-dpp-1.0.0.jar:?]
at com.starrocks.persist.gson.RuntimeTypeAdapterFactory$1.read(RuntimeTypeAdapterFactory.java:386) ~[starrocks-fe.jar:?]
at com.google.gson.TypeAdapter$1.read(TypeAdapter.java:199) ~[spark-dpp-1.0.0.jar:?]
at com.google.gson.internal.bind.ReflectiveTypeAdapterFactory$1.read(ReflectiveTypeAdapterFactory.java:131) ~[spark-dpp-1.0.0.jar:?]
at com.google.gson.internal.bind.ReflectiveTypeAdapterFactory$Adapter.read(ReflectiveTypeAdapterFactory.java:222) ~[spark-dpp-1.0.0.jar:?]
at com.starrocks.persist.gson.GsonUtils$ProcessHookTypeAdapterFactory$1.read(GsonUtils.java:660) ~[starrocks-fe.jar:?]
at com.google.gson.Gson.fromJson(Gson.java:963) ~[spark-dpp-1.0.0.jar:?]
at com.google.gson.Gson.fromJson(Gson.java:928) ~[spark-dpp-1.0.0.jar:?]
at com.google.gson.Gson.fromJson(Gson.java:877) ~[spark-dpp-1.0.0.jar:?]
at com.google.gson.Gson.fromJson(Gson.java:848) ~[spark-dpp-1.0.0.jar:?]
at com.starrocks.journal.JournalEntity.readFields(JournalEntity.java:260) ~[starrocks-fe.jar:?]
at com.starrocks.journal.bdbje.BDBJournalCursor.deserializeData(BDBJournalCursor.java:248) ~[starrocks-fe.jar:?]
... 5 more

Expected behavior (Required)

Follower FE replay the journal normally

Real behavior (Required)

Throw a exception like above

StarRocks version (Required)

3.1.11

[kevincai]

@sfwang218 wondering if this is specific to v3.1 release or the same applies to main and v3.2/v3.3 release.

[sfwang218]

@sfwang218 wondering if this is specific to v3.1 release or the same applies to main and v3.2/v3.3 release.

This issue also exists in the v3.2, but it should no longer exists in the v3.3 and main branches.