cdc过滤后无法正常创建表

组件版本:5.0.3
使用cdc同步到下游mysql,
tidb数据导出–>导入mysql–开启cdc同步, 这些步骤正常
问题:
今天我删除表后重建,发现下游mysql 删除表后没有重建,有配置过滤规则,检查过索引有配置,请问这要怎么排查?
cdc日志中提示:
[“this table is not eligible to replicate”] [tableName=rec_cf_user_book] [tableID=36203]
[“this table is not eligible to replicate”] [tableName=rec_user_group_hot_books] [tableID=36210]
[“this table is not eligible to replicate”] [tableName=rec_group_user] [tableID=36215]
过滤规则:
case-sensitive = true
[filter]
rules = [‘read.rec*’]

status
Starting component cdc: /root/.tiup/components/cdc/v5.0.3/cdc cli changefeed query --pd=http://10.10.10.198:2379 --changefeed-id=f3e41177-e072-4bb3-8ef9-d55f23ec34af
{
“info”: {
“sink-uri”: “mysql://xxxxxxxxxx@xxxxxxxx:3306/”,
“opts”: {
“_changefeed_id”: “f3e41177-e072-4bb3-8ef9-d55f23ec34af”
},
“create-time”: “2021-07-19T14:16:20.613236934+08:00”,
“start-ts”: 426421577771909143,
“target-ts”: 0,
“admin-job-type”: 2,
“sort-engine”: “unified”,
“config”: {
“case-sensitive”: true,
“enable-old-value”: true,
“force-replicate”: false,
“check-gc-safe-point”: true,
“filter”: {
“rules”: [
“read.rec*”
],
“ignore-txn-start-ts”: null
},
“mounter”: {
“worker-num”: 16
},
“sink”: {
“dispatchers”: null,
“protocol”: “default”
},
“cyclic-replication”: {
“enable”: false,
“replica-id”: 0,
“filter-replica-ids”: null,
“id-buckets”: 0,
“sync-ddl”: false
},
“scheduler”: {
“type”: “table-number”,
“polling-time”: -1
}
},
“state”: “normal”,
“history”: [],
“error”: null,
“sync-point-enabled”: false,
“sync-point-interval”: 600000000000,
“creator-version”: “v5.0.3”
},
“status”: {
“resolved-ts”: 426442578062213149,
“checkpoint-ts”: 426442578062213149,
“admin-job-type”: 0
},
“count”: 0,
“task-status”: [
{
“capture-id”: “ccc2a5e2-7039-484f-8989-7b8ac4efa3b3”,
“status”: {
“tables”: {},
“operation”: null,
“admin-job-type”: 0
}
},
{
“capture-id”: “27b3c93f-e463-43b2-8ab2-30dde9ce8c5f”,
“status”: {
“tables”: {},
“operation”: null,
“admin-job-type”: 0
}
},
{
“capture-id”: “68ae1d50-9d47-47b7-9249-4ca03dec9233”,
“status”: {
“tables”: {},
“operation”: null,
“admin-job-type”: 0
}
}
]
}

3 个赞

方便把完整的 cdc 配置发一下不

1 个赞

tiup cdc cli changefeed create --pd=http://10.10.10.198:2379 --sink-uri=“mysql://******@******/” --start-ts=“426421577771909143” --sort-engine=“unified” --config task.yaml

task.yaml
case-sensitive = true
[filter]
rules = [‘read.rec*’]

3 个赞

确认一下:这些表都是 read 库下面的对吧。而你的问题是 以前同样的配置,这些表是同步的,而现在突然不同步了?

1 个赞

能发一下,cdc 日志不(最好内容多一点)

1 个赞

解决了,是因为建表的时候是分步骤执行的,因为第一步没有建立索引导致的

1 个赞

:smile:好的解决了就好

1 个赞

急~在线等~~!!!!!在导入400w条数据后,cdc数据就不再同步 哥 这个帮我看下 咋整 着急中

1 个赞

11111​:ok_hand:

此话题已在最后回复的 1 分钟后被自动关闭。不再允许新回复。