tidb版本:5.4.1,ticdc版本5.4.1
通过ticdc 将tidb的数据同步到另一套tidb
通过insert into table select * from table_a limit 50000;的方式测试ticdc的同步速度,
报错
“error”: {
“addr”: “10.101.22.89:8300”,
“code”: “CDC:ErrProcessorUnknown”,
“message”: “[CDC:ErrReachMaxTry]reach maximum try: 8: [CDC:ErrMySQLTxnError]MySQL txn error: Error 1105: context canceled”
},
cdc 报错日志:
[2022/09/14 08:38:29.202 +00:00] [WARN] [mysql.go:537] [“execute DMLs with error, retry later”] [error="[CDC:ErrMySQLTxnError]MySQL txn error: Error 1105: context canceled"] [errorVerbose="[CDC:ErrMySQLTxnError]MySQL txn error: Error 1105: context canceled\ngithub.com/pingcap/errors.AddStack\
\tgithub.com/pingcap/errors@v0.11.5-0.20211224045212-9687c2b0f87c/errors.go:174\
github.com/pingcap/errors.(*Error).GenWithStackByArgs\
\tgithub.com/pingcap/errors@v0.11.5-0.20211224045212-9687c2b0f87c/normalize.go:164\
github.com/pingcap/tiflow/pkg/errors.WrapError\
\tgithub.com/pingcap/tiflow/pkg/errors/helper.go:30\
github.com/pingcap/tiflow/cdc/sink.(*mysqlSink).execDMLWithMaxRetries.func1.3\
\tgithub.com/pingcap/tiflow/cdc/sink/mysql.go:602\
github.com/pingcap/tiflow/cdc/sink.(*Statistics).RecordBatchExecution\
\tgithub.com/pingcap/tiflow/cdc/sink/statistics.go:111\
github.com/pingcap/tiflow/cdc/sink.(*mysqlSink).execDMLWithMaxRetries.func1\
\tgithub.com/pingcap/tiflow/cdc/sink/mysql.go:574\
github.com/pingcap/tiflow/pkg/retry.run\
\tgithub.com/pingcap/tiflow/pkg/retry/retry_with_opt.go:54\
github.com/pingcap/tiflow/pkg/retry.Do\
\tgithub.com/pingcap/tiflow/pkg/retry/retry_with_opt.go:32\
github.com/pingcap/tiflow/cdc/sink.(*mysqlSink).execDMLWithMaxRetries\
\tgithub.com/pingcap/tiflow/cdc/sink/mysql.go:566\
github.com/pingcap/tiflow/cdc/sink.(*mysqlSink).execDMLs\
\tgithub.com/pingcap/tiflow/cdc/sink/mysql.go:736\
github.com/pingcap/tiflow/cdc/sink.(*mysqlSinkWorker).run.func3\
\tgithub.com/pingcap/tiflow/cdc/sink/mysql_worker.go:114\
github.com/pingcap/tiflow/cdc/sink.(*mysqlSinkWorker).run\
\tgithub.com/pingcap/tiflow/cdc/sink/mysql_worker.go:134\
github.com/pingcap/tiflow/cdc/sink.(*mysqlSink).createSinkWorkers.func1\
\tgithub.com/pingcap/tiflow/cdc/sink/mysql.go:382\
runtime.goexit\
\truntime/asm_amd64.s:1371"]
[2022/09/14 08:39:22.245 +00:00] [WARN] [etcd_worker.go:414] [“Etcd transaction took too long”] [duration=1.608856534s]
[2022/09/14 08:41:13.697 +00:00] [WARN] [etcd_worker.go:414] [“Etcd transaction took too long”] [duration=1.512278782s]
已将参数设置成:
performance.txn-total-size-limit: 5048576000