ticdc同步数据报错

为提高效率,请提供以下信息,问题描述清晰能够更快得到解决:

【TiDB 版本】
4.0.8

ticdc版本:4.0.12

【问题描述】
cdc cli changefeed query -s --pd=‘http://XXXX:2381’ --changefeed-id app-task
{
“state”: “stopped”,
“tso”: 425179444919926926,
“checkpoint”: “2021-05-25 16:21:05.936”,
“error”: {
“addr”: “10.1.40.81:8300”,
“code”: “CDC:ErrProcessorUnknown”,
“message”: “[CDC:ErrMySQLTxnError]Error 1105: can not be duplicated row, due to old row not found. handle 27898785 not found”
}
}
cdc日志里报如下错误:
[2021/05/25 16:43:25.089 +08:00] [WARN] [mysql.go:854] [“execute DMLs with error, retry later”] [error=“[CDC:ErrMySQLTxnError]sql: database is closed”] [errorVerbose=“[CDC:ErrMySQLTxnError]sql: database is closed
github.com/pingcap/errors.AddStack
\tgithub.com/pingcap/errors@v0.11.5-0.20201126102027-b0a155152ca3/errors.go:174
github.com/pingcap/errors.(*Error).GenWithStackByCause
\tgithub.com/pingcap/errors@v0.11.5-0.20201126102027-b0a155152ca3/normalize.go:279
github.com/pingcap/ticdc/pkg/errors.WrapError
\tgithub.com/pingcap/ticdc@/pkg/errors/helper.go:28
github.com/pingcap/ticdc/cdc/sink.(*mysqlSink).execDMLWithMaxRetries.func2.3
\tgithub.com/pingcap/ticdc@/cdc/sink/mysql.go:868
github.com/pingcap/ticdc/cdc/sink.(*Statistics).RecordBatchExecution
\tgithub.com/pingcap/ticdc@/cdc/sink/statistics.go:99
github.com/pingcap/ticdc/cdc/sink.(*mysqlSink).execDMLWithMaxRetries.func2
\tgithub.com/pingcap/ticdc@/cdc/sink/mysql.go:865
github.com/pingcap/ticdc/pkg/retry.Run.func1
\tgithub.com/pingcap/ticdc@/pkg/retry/retry.go:32
github.com/cenkalti/backoff.RetryNotify
\tgithub.com/cenkalti/backoff@v2.2.1+incompatible/retry.go:37
github.com/cenkalti/backoff.Retry
\tgithub.com/cenkalti/backoff@v2.2.1+incompatible/retry.go:24
github.com/pingcap/ticdc/pkg/retry.Run
\tgithub.com/pingcap/ticdc@/pkg/retry/retry.go:31
github.com/pingcap/ticdc/cdc/sink.(*mysqlSink).execDMLWithMaxRetries
\tgithub.com/pingcap/ticdc@/cdc/sink/mysql.go:857
github.com/pingcap/ticdc/cdc/sink.(*mysqlSink).execDMLs
\tgithub.com/pingcap/ticdc@/cdc/sink/mysql.go:1016
github.com/pingcap/ticdc/cdc/sink.(*mysqlSinkWorker).run.func3
\tgithub.com/pingcap/ticdc@/cdc/sink/mysql.go:790
github.com/pingcap/ticdc/cdc/sink.(*mysqlSinkWorker).run
\tgithub.com/pingcap/ticdc@/cdc/sink/mysql.go:828
github.com/pingcap/ticdc/cdc/sink.(*mysqlSink).createSinkWorkers.func1
\tgithub.com/pingcap/ticdc@/cdc/sink/mysql.go:635
runtime.goexit
\truntime/asm_amd64.s:1357”]
[2021/05/25 16:43:25.089 +08:00] [ERROR] [mysql.go:1023] [“execute DMLs failed”] [err=“[CDC:ErrMySQLTxnError]sql: database is closed”] [ts=“[425179444933033986,425179444933034061,425179444933034167,425179444946141267,425179444946141451,425179444946141496,425179444946141567,425179444946141634,425179444959248532,425179444972355629,425179444985462804,425179444998569994,425179445024784466,425179445024784635,425179445037891666,425179445037891840,425179445050998878,425179445050998954,425179445064106024,425179445064106129,425179445064106202,425179445077213265,425179445090320451,425179445090320591,425179445103689841,425179445116534786,425179445116534913,425179445129642049,425179445129642124,425179445129642203,425179445142749201,425179445142749267,425179445142749375,425179445155856398,425179445155856491,425179445155856553,425179445168963746,425179445182070871,425179445195178054,425179445208285215,425179445208285327,425179445221392445,425179445234499604,425179445234499661,425179445247606818,425179445260714016,425179445260714091,425179445260714153,425179445273821236,425179445273821341,425179445300035603,425179445313142839,425179445313142893,425179445326250030,425179445326250102,425179445326250201,425179445339357253,425179445339357309,425179445339357406,425179445352464437,425179445365571586,425179445365571698,425179445378678856,425179445378678956,425179445391786118,425179445404893273,425179445404893362,425179445404893469,425179445418000482,425179445431107586,425179445431107667,425179445444214804,425179445444214890,425179445457322021,425179445457322130,425179445457322212,425179445470429290,425179445470429372,425179445483536488,425179445483536556,425179445496643649,425179445496643729,425179445509750787,425179445509750863,425179445509750953,425179445522858026,425179445522858111,425179445522858231,425179445535965355,425179445549072496,425179445562179619,425179445562179710,425179445562179835,425179445575286858,425179445575286990,425179445575287042,425179445588393990,425179445588394115,425179445588394193,425179445601501250,425179445601501321,425179445601501397,425179445614608424,425179445614608492,425179445614608585,425179445627715594,425179445627715660,425179445627715757,425179445640822829,425179445640822915,425179445653930021,425179445653930065,425179445653930151,425179445667037276,425179445680144395,425179445680144500,425179445693251633,425179445693251720,425179445706358864,425179445706358942,425179445719466088,425179445719466168,425179445732573228,425179445732573291,425179445732573391,425179445745680472,425179445771894816,425179445785002015,425179445785002058,425179445798109233,425179445798109301,425179445798109360,425179445798109440,425179445811216455,425179445811216530,425179445824323645,425179445837430797,425179445837430867,425179445850538015,425179445850538097,425179445863645215,425179445863645288,425179445876752389,425179445876752442,425179445876752509,425179445889859594,425179445889859665,425179445902966813,425179445902966884,425179445916074002,425179445916074089,425179445929181215,425179445929181340,425179445942288418,425179445942288520,425179445955395640,425179445955395760,425179445968502869,425179445981610041,425179445981610161,425179445994717236,425179445994717344,425179446007824411,425179446007824490,425179446007824591,425179446020931643,425179446020931708,425179446020931753,425179446034038815,425179446034038913,425179446047146024,425179446047146110,425179446060253224,425179446060253318,425179446073360413,425179446073360532,425179446086467671,425179446112682048,425179446125789283,425179446138896462,425179446138896567,425179446152003737,425179446165110830,425179446165110897,425179446178218016,425179446178218098,425179446191325221,425179446204432406,425179446204432522,425179446217539670,425179446217539795,425179446230646801,425179446243754056,425179446256861273,425179446269968421,425179446269968521,425179446283075610,425179446283075718,425179446296182800,425179446296182880,425179446309290019,425179446309290126,425179446322397236,425179446322397317,425179446335504422,425179446335504494,425179446335504557,425179446335504645]”]
附件是tidb的日志
logs.zip (7.7 MB)

  1. 请问下游是什么? mysql kafka ?
  2. 看报错 “execute DMLs with error, retry later”] [error="[CDC:ErrMySQLTxnError]sql: database is closed"
    是不是下游关闭了?

下游是tidb,下游是正常的

上游有 cdc send failed的错误:

下游请问如何确认是正常的? 能否看看组件日志,比如 tidb.log ,tikv.log 在那个时间段是否有异常?