drainer 角色无法启动 table not exist

为提高效率,提问时请提供以下信息,问题描述清晰可优先响应。

  • 【TiDB 版本】:v3.0.4
  • 【问题描述】:drainer 角色无法启动

[2020/08/14 23:18:25.949 +08:00] [INFO] [load.go:241] [“refresh table info”] [schema=保密] [table=保密]
[2020/08/14 23:18:25.950 +08:00] [INFO] [load.go:241] [“refresh table info”] [schema=保密] [table=保密]
[2020/08/14 23:18:25.950 +08:00] [INFO] [load.go:241] [“refresh table info”] [schema=保密] [table=保密]
[2020/08/14 23:18:25.970 +08:00] [INFO] [load.go:241] [“refresh table info”] [schema=保密] [table=保密]
[2020/08/14 23:18:25.971 +08:00] [INFO] [load.go:241] [“refresh table info”] [schema=保密] [table=保密]
[2020/08/14 23:18:25.972 +08:00] [INFO] [load.go:241] [“refresh table info”] [schema=保密] [table=保密]
[2020/08/14 23:18:25.973 +08:00] [INFO] [load.go:241] [“refresh table info”] [schema=保密] [table=users]
[2020/08/14 23:18:25.974 +08:00] [INFO] [load.go:241] [“refresh table info”] [schema=保密] [table=保密]
[2020/08/14 23:18:25.974 +08:00] [INFO] [load.go:241] [“refresh table info”] [schema=保密] [table=保密]
[2020/08/14 23:18:25.975 +08:00] [INFO] [load.go:241] [“refresh table info”] [schema=保密] [table=保密]
[2020/08/14 23:18:25.976 +08:00] [INFO] [load.go:241] [“refresh table info”] [schema=保密] [table=保密]
[2020/08/14 23:18:25.977 +08:00] [INFO] [load.go:241] [“refresh table info”] [schema=保密] [table=保密]
[2020/08/14 23:18:25.978 +08:00] [INFO] [load.go:241] [“refresh table info”] [schema=保密] [table=保密]
[2020/08/14 23:18:26.021 +08:00] [INFO] [collector.go:284] [“get ddl job”] [job=“ID:3532, Type:modify table charset and collate, State:synced, SchemaState:public, SchemaID:215, TableID:3514, RowCount:0, ArgLen:0, start time: 2020-08-08 15:20:58.96 +0800 HKT, Err:, ErrCount:0, SnapshotVersion:0”]
[2020/08/14 23:18:26.021 +08:00] [INFO] [syncer.go:400] [“add ddl item to syncer, you can add this commit ts to ignore-txn-commit-ts to skip this ddl if needed”] [sql=“ALTER TABLE backmessage\r\ DEFAULT CHARACTER SET=utf8mb4”] [“commit ts”=418610219466096702]
[2020/08/14 23:18:26.038 +08:00] [INFO] [load.go:241] [“refresh table info”] [schema=bigdata] [table=backmessage]
[2020/08/14 23:18:26.039 +08:00] [INFO] [load.go:435] [“Run()… in Loader quit”]
[2020/08/14 23:18:26.039 +08:00] [INFO] [load.go:715] [“txnManager has been closed”]
[2020/08/14 23:18:26.039 +08:00] [INFO] [load.go:659] [“run()… in txnManager quit”]
[2020/08/14 23:18:26.039 +08:00] [INFO] [mysql.go:117] [“Successes chan quit”]
[2020/08/14 23:18:26.039 +08:00] [ERROR] [syncer.go:416] [“Failed to close syncer”] [error=“table not exist”] [errorVerbose=“table not exist\ngithub.com/pingcap/tidb-binlog/pkg/loader.init.ializers\ \t/home/jenkins/workspace/release_tidb_3.0/go/src/github.com/pingcap/tidb-binlog/pkg/loader/util.go:28\ runtime.main\ \t/usr/local/go/src/runtime/proc.go:188\ runtime.goexit\ \t/usr/local/go/src/runtime/asm_amd64.s:1337”]
[2020/08/14 23:18:26.039 +08:00] [INFO] [syncer.go:251] [“write save point”] [ts=418609373894410296]
[2020/08/14 23:18:26.041 +08:00] [INFO] [syncer.go:243] [“handleSuccess quit”]
[2020/08/14 23:18:26.041 +08:00] [ERROR] [server.go:270] [“syncer exited abnormal”] [error=“add to dsyncer failed: table not exist”] [errorVerbose=“table not exist\ngithub.com/pingcap/tidb-binlog/pkg/loader.init.ializers\ \t/home/jenkins/workspace/release_tidb_3.0/go/src/github.com/pingcap/tidb-binlog/pkg/loader/util.go:28\ runtime.main\ \t/usr/local/go/src/runtime/proc.go:188\ runtime.goexit\ \t/usr/local/go/src/runtime/asm_amd64.s:1337\ add to dsyncer failed”]
[2020/08/14 23:18:26.041 +08:00] [INFO] [util.go:66] [Exit] [name=syncer]
[2020/08/14 23:18:26.041 +08:00] [INFO] [server.go:406] [“begin to close drainer server”]
[2020/08/14 23:18:26.043 +08:00] [INFO] [server.go:371] [“has already update status”] [id=cs-tidb003:8249]
[2020/08/14 23:18:26.043 +08:00] [INFO] [server.go:410] [“commit status done”]
[2020/08/14 23:18:26.043 +08:00] [INFO] [collector.go:130] [“publishBinlogs quit”]
[2020/08/14 23:18:26.043 +08:00] [INFO] [pump.go:72] [“pump is closing”] [id=cs-tidb003:8250]
[2020/08/14 23:18:26.043 +08:00] [WARN] [merge.go:284] [“can’t read binlog from pump”] [“source id”=cs-tidb003:8250]
[2020/08/14 23:18:26.043 +08:00] [INFO] [util.go:66] [Exit] [name=heartbeat]
[2020/08/14 23:18:26.043 +08:00] [INFO] [pump.go:72] [“pump is closing”] [id=cs-tidb004:8250]
[2020/08/14 23:18:26.043 +08:00] [INFO] [util.go:66] [Exit] [name=collect]
[2020/08/14 23:18:26.043 +08:00] [INFO] [main.go:73] [“drainer exit”]
若提问为性能优化、故障排查类问题,请下载脚本运行。终端输出的打印结果,请务必全选并复制粘贴上传。

麻烦检查一下 drainer 的消费配置,是否有同步的表但实际不存在的问题。

已经解决了。第一层:mysql (5.7 和8.x版本 都有) 第二层:otter 第三层:tidb 第四层:mysql binlog(5.7.因为缺少8.x的字符集造成的)。已经对 第四层 mysql 升级到8.x 问题解决。

:+1:

此话题已在最后回复的 1 分钟后被自动关闭。不再允许新回复。