【 TiDB 使用环境】生产环境
【 TiDB 版本】
V7.1.0
【复现路径】
生产做了交换分区的操作,ticdc同步报错
【遇到的问题：问题现象及影响】
【资源配置】
源端做ddl,ticdc有问题导致任务失败,有报错,.
grafana的页面报错的指标,目前看不到,因为任务1已经删除,
grafana的页面显示任务xxxx-to-odsmysql-task1有失败,另外一个test任务是很久之前删除的,也还有显示.
cdc 日志:
[2023/09/14 12:31:17.512 +08:00] [ERROR] [processor.go:1015] ["processor sub-component fails"] [namespace=default] [changefeed=xxxx-to-odsmysql-task1] [name=ddlHandler] [error="[CDC:ErrSnapshotTableNotFound]table 341 not
found in schema snapshot"] [errorVerbose="[CDC:ErrSnapshotTableNotFound]table 341 not found in schema snapshot\ngithub.com/pingcap/errors.AddStack\n\tgithub.com/pingcap/errors@v0.11.5-0.20221009092201-b66cddb77c32/errors.go
:174\ngithub.com/pingcap/errors.(*Error).GenWithStackByArgs\n\tgithub.com/pingcap/errors@v0.11.5-0.20221009092201-b66cddb77c32/normalize.go:164\ngithub.com/pingcap/tiflow/cdc/entry/schema.(*snapshot).getSourceTable\n\tgithub
.com/pingcap/tiflow/cdc/entry/schema/snapshot.go:933\ngithub.com/pingcap/tiflow/cdc/entry/schema.(*snapshot).exchangePartition\n\tgithub.com/pingcap/tiflow/cdc/entry/schema/snapshot.go:957\ngithub.com/pingcap/tiflow/cdc/entr
y/schema.(*Snapshot).DoHandleDDL\n\tgithub.com/pingcap/tiflow/cdc/entry/schema/snapshot.go:468\ngithub.com/pingcap/tiflow/cdc/entry/schema.(*Snapshot).HandleDDL\n\tgithub.com/pingcap/tiflow/cdc/entry/schema/snapshot.go:382\n
github.com/pingcap/tiflow/cdc/entry.(*schemaStorageImpl).HandleDDLJob\n\tgithub.com/pingcap/tiflow/cdc/entry/schema_storage.go:207\ngithub.com/pingcap/tiflow/cdc/puller.(*ddlJobPullerImpl).handleJob\n\tgithub.com/pingcap/tif
low/cdc/puller/ddl_puller.go:405\ngithub.com/pingcap/tiflow/cdc/puller.(*ddlJobPullerImpl).Run.func2\n\tgithub.com/pingcap/tiflow/cdc/puller/ddl_puller.go:123\ngolang.org/x/sync/errgroup.(*Group).Go.func1\n\tgolang.org/x/syn
c@v0.1.0/errgroup/errgroup.go:75\nruntime.goexit\n\truntime/asm_amd64.s:1598"]
但是报错的altert告警没有发出来,
后续几个小时后,新增其他任务xxxx-to-odsmysql-task1-track,告警有正常显示延迟.
想咨询有大神知道,
1.为什么这种xxxx-to-odsmysql-task1任务有报错的没有发出来?
2.这种失败的能用什么指标显示,有没有模板,这个grafana有,怎么能用这个指标发下失败的这种告警?
3.以前这种test任务已经删除的,怎么还能看到?