【 TiDB 使用环境`】生产
【 TiDB 版本】v4.0.9
【遇到的问题】cdc同步一段时间之后中断
【复现路径】重新恢复任务
【问题现象及影响】
cdc同步一段时间之后中断了。报其中一个节点连接失败。下游也是ticdc,
CDC:ErrProcessorUnknown
[
{
“id”: “cdc-replica-task”,
“summary”: {
“state”: “stopped”,
“tso”: 433096939742167046,
“checkpoint”: “2022-05-10 06:01:51.785”,
“error”: {
“addr”: “172.16.0.57:8300”,
“code”: “CDC:ErrProcessorUnknown”,
“message”: “[CDC:ErrMySQLTxnError]invalid connection”
}
}
}
]
可以看到报错的节点是172.16.0.57:8300,在这个节点中可以看到报错
[ERROR] [server.go:120] [“run server”] [error=“[CDC:ErrMySQLConnectionError]driver: bad connection
github.com/pingcap/errors.AddStack
\tgithub.com/pingcap/errors@v0.11.5-0.20201029093017-5a7df2af2ac7/errors.go:174
github.com/pingcap/errors.(*Error).GenWithStackByCause
\tgithub.com/pingcap/errors@v0.11.5-0.20201029093017-5a7df2af2ac7/normalize.go:279
github.com/pingcap/ticdc/pkg/errors.WrapError
\tgithub.com/pingcap/ticdc@/pkg/errors/helper.go:28
github.com/pingcap/ticdc/cdc/sink.(*mysqlSink).Close
\tgithub.com/pingcap/ticdc@/cdc/sink/mysql.go:766
github.com/pingcap/ticdc/cdc.(*processor).stop
\tgithub.com/pingcap/ticdc@/cdc/processor.go:1213
github.com/pingcap/ticdc/cdc.(*Capture).handleTaskEvent
\tgithub.com/pingcap/ticdc@/cdc/capture.go:231
github.com/pingcap/ticdc/cdc.(*Capture).Run
\tgithub.com/pingcap/ticdc@/cdc/capture.go:175
github.com/pingcap/ticdc/cdc.(*Server).run.func2
\tgithub.com/pingcap/ticdc@/cdc/server.go:338
golang.org/x/sync/errgroup.(*Group).Go.func1
\tgolang.org/x/sync@v0.0.0-20200625203802-6e8e738ad208/errgroup/errgroup.go:57
runtime.goexit
\truntime/asm_amd64.s:1357”]
cdc.log (81.2 MB)