为cdc增加下游的时候出现下面的错误

🪐 TiDB 技术问题
,
1

【 TiDB 使用环境】centos7
【 TiDB 版本】v5.1.0
【复现路径】为cdc增加下游的时候出现下面的错误
【遇到的问题：问题现象及影响】

使用

./cdc cli changefeed create --pd http://10.206.0.7:2383 --sink-uri mysql://root:123456@127.0.0.1:3306/

为cdc增加下游，但是查看list的时候显示出现错误，上游是v5.1.0的tidb，下游是 5.7.43 MySQL Community Server

image
image1456×335 9.63 KB

2

TiDB 和 TiDB 之间的同步用 ticdc

3

同步工具的选择看这个同步工具的选择 - #5，来自 小龙虾爱大龙虾

4

报错信息文字版可否复制一下？
localglobalconfig, 配置文件参数都正确么？

5

是的 我看了一下 我的同步是tidb->mysql，我选择的工具是ticdc应该可以的，但是不知道为什么会出错呢

6 
[2023/12/27 13:58:15.141 +08:00] [INFO] [middleware.go:48] [/api/v2/changefeeds] [status=201] [method=POST] [path=/api/v2/changefeeds] [query=] [ip=127.0.0.1] [user-agent=Go-http-client/1.1] [client-version=v6.5.0-master] [] [duration=56.791379ms]
[2023/12/27 13:58:15.142 +08:00] [INFO] [reactor_state.go:122] ["new upstream is add"] [upstream=7316941140801532415] [info="{\"id\":7316941140801532415,\"pd-endpoints\":\"http://10.206.0.7:2383\",\"key-path\":\"\",\"cert-path\":\"\",\"ca-path\":\"\",\"cert-allowed-cn\":null}"]
[2023/12/27 13:58:15.142 +08:00] [INFO] [reactor_state.go:122] ["new upstream is add"] [upstream=7316941140801532415] [info="{\"id\":7316941140801532415,\"pd-endpoints\":\"http://10.206.0.7:2383\",\"key-path\":\"\",\"cert-path\":\"\",\"ca-path\":\"\",\"cert-allowed-cn\":null}"]
[2023/12/27 13:58:15.214 +08:00] [ERROR] [changefeed.go:220] ["an error occurred in Owner"] [namespace=default] [changefeed=e8781b94-7db0-4bac-bad0-ff8edb4b52be] [error="[CDC:ErrPDEtcdAPIError]etcd api call error: rpc error: code = Unimplemented desc = unknown method LoadGlobalConfig for service pdpb.PD"] [errorVerbose="[CDC:ErrPDEtcdAPIError]etcd api call error: rpc error: code = Unimplemented desc = unknown method LoadGlobalConfig for service pdpb.PD\ngithub.com/pingcap/errors.AddStack\n\tgithub.com/pingcap/errors@v0.11.5-0.20220729040631-518f63d66278/errors.go:174\ngithub.com/pingcap/errors.(*Error).GenWithStackByArgs\n\tgithub.com/pingcap/errors@v0.11.5-0.20220729040631-518f63d66278/normalize.go:164\ngithub.com/pingcap/tiflow/pkg/errors.WrapError\n\tgithub.com/pingcap/tiflow/pkg/errors/helper.go:34\ngithub.com/pingcap/tiflow/pkg/pdutil.GetSourceID\n\tgithub.com/pingcap/tiflow/pkg/pdutil/utils.go:37\ngithub.com/pingcap/tiflow/cdc/owner.(*changefeed).initialize\n\tgithub.com/pingcap/tiflow/cdc/owner/changefeed.go:511\ngithub.com/pingcap/tiflow/cdc/owner.(*changefeed).tick\n\tgithub.com/pingcap/tiflow/cdc/owner/changefeed.go:273\ngithub.com/pingcap/tiflow/cdc/owner.(*changefeed).Tick\n\tgithub.com/pingcap/tiflow/cdc/owner/changefeed.go:200\ngithub.com/pingcap/tiflow/cdc/owner.(*ownerImpl).Tick\n\tgithub.com/pingcap/tiflow/cdc/owner/owner.go:222\ngithub.com/pingcap/tiflow/pkg/orchestrator.(*EtcdWorker).Run\n\tgithub.com/pingcap/tiflow/pkg/orchestrator/etcd_worker.go:290\ngithub.com/pingcap/tiflow/cdc/capture.(*captureImpl).runEtcdWorker\n\tgithub.com/pingcap/tiflow/cdc/capture/capture.go:516\ngithub.com/pingcap/tiflow/cdc/capture.(*captureImpl).campaignOwner\n\tgithub.com/pingcap/tiflow/cdc/capture/capture.go:479\ngithub.com/pingcap/tiflow/cdc/capture.(*captureImpl).run.func2\n\tgithub.com/pingcap/tiflow/cdc/capture/capture.go:344\ngolang.org/x/sync/errgroup.(*Group).Go.func1\n\tgolang.org/x/sync@v0.1.0/errgroup/errgroup.go:75\nruntime.goexit\n\truntime/asm_amd64.s:1598"]
[2023/12/27 13:58:15.214 +08:00] [INFO] [changefeed.go:638] ["changefeed closed"] [namespace=default] [changefeed=e8781b94-7db0-4bac-bad0-ff8edb4b52be] [status="{\"resolved-ts\":446603380665090054,\"checkpoint-ts\":446603380665090054,\"admin-job-type\":0}"] [info="{\"upstream-id\":7316941140801532415,\"namespace\":\"default\",\"changefeed-id\":\"e8781b94-7db0-4bac-bad0-ff8edb4b52be\",\"sink-uri\":\"mysql://root:xxxxx@127.0.0.1:3306/\",\"create-time\":\"2023-12-27T13:58:15.139204992+08:00\",\"start-ts\":446603380665090054,\"target-ts\":0,\"admin-job-type\":0,\"sort-engine\":\"unified\",\"sort-dir\":\"\",\"config\":{\"memory-quota\":268435456,\"case-sensitive\":true,\"enable-old-value\":true,\"force-replicate\":false,\"check-gc-safe-point\":true,\"enable-sync-point\":false,\"bdr-mode\":false,\"sync-point-interval\":600000000000,\"sync-point-retention\":86400000000000,\"filter\":{\"rules\":[\"*.*\"],\"ignore-txn-start-ts\":null,\"event-filters\":null},\"mounter\":{\"worker-num\":16},\"sink\":{\"transaction-atomicity\":\"\",\"protocol\":\"\",\"dispatchers\":null,\"csv\":{\"delimiter\":\",\",\"quote\":\"\\\"\",\"null\":\"\\\\N\",\"include-commit-ts\":false},\"column-selectors\":null,\"schema-registry\":\"\",\"encoder-concurrency\":16,\"terminator\":\"\\r\\n\",\"date-separator\":\"none\",\"enable-partition-separator\":false},\"consistent\":{\"level\":\"none\",\"max-log-size\":64,\"flush-interval\":2000,\"storage\":\"\"}},\"state\":\"normal\",\"error\":null,\"creator-version\":\"v6.5.0-master\"}"] [isRemoved=false]
[2023/12/27 13:58:15.216 +08:00] [INFO] [processor.go:1199] ["processor closing ..."] [namespace=default] [changefeed=e8781b94-7db0-4bac-bad0-ff8edb4b52be]
[2023/12/27 13:58:15.216 +08:00] [INFO] [processor.go:1315] ["processor closed"] [namespace=default] [changefeed=e8781b94-7db0-4bac-bad0-ff8edb4b52be]
[2023/12/27 13:58:25.951 +08:00] [INFO] [feed_state_manager.go:494] ["changefeed restart backoff interval is changed"] [namespace=default] [changefeed=e8781b94-7db0-4bac-bad0-ff8edb4b52be] [oldInterval=10.733519339s] [newInterval=18.335635975s]
[2023/12/27 13:58:25.966 +08:00] [ERROR] [changefeed.go:220] ["an error occurred in Owner"] [namespace=default] [changefeed=e8781b94-7db0-4bac-bad0-ff8edb4b52be] [error="[CDC:ErrPDEtcdAPIError]etcd api call error: rpc error: code = Unimplemented desc = unknown method LoadGlobalConfig for service pdpb.PD"] [errorVerbose="[CDC:ErrPDEtcdAPIError]etcd api call error: rpc error: code = Unimplemented desc = unknown method LoadGlobalConfig for service pdpb.PD\ngithub.com/pingcap/errors.AddStack\n\tgithub.com/pingcap/errors@v0.11.5-0.20220729040631-518f63d66278/errors.go:174\ngithub.com/pingcap/errors.(*Error).GenWithStackByArgs\n\tgithub.com/pingcap/errors@v0.11.5-0.20220729040631-518f63d66278/normalize.go:164\ngithub.com/pingcap/tiflow/pkg/errors.WrapError\n\tgithub.com/pingcap/tiflow/pkg/errors/helper.go:34\ngithub.com/pingcap/tiflow/pkg/pdutil.GetSourceID\n\tgithub.com/pingcap/tiflow/pkg/pdutil/utils.go:37\ngithub.com/pingcap/tiflow/cdc/owner.(*changefeed).initialize\n\tgithub.com/pingcap/tiflow/cdc/owner/changefeed.go:511\ngithub.com/pingcap/tiflow/cdc/owner.(*changefeed).tick\n\tgithub.com/pingcap/tiflow/cdc/owner/changefeed.go:273\ngithub.com/pingcap/tiflow/cdc/owner.(*changefeed).Tick\n\tgithub.com/pingcap/tiflow/cdc/owner/changefeed.go:200\ngithub.com/pingcap/tiflow/cdc/owner.(*ownerImpl).Tick\n\tgithub.com/pingcap/tiflow/cdc/owner/owner.go:222\ngithub.com/pingcap/tiflow/pkg/orchestrator.(*EtcdWorker).Run\n\tgithub.com/pingcap/tiflow/pkg/orchestrator/etcd_worker.go:290\ngithub.com/pingcap/tiflow/cdc/capture.(*captureImpl).runEtcdWorker\n\tgithub.com/pingcap/tiflow/cdc/capture/capture.go:516\ngithub.com/pingcap/tiflow/cdc/capture.(*captureImpl).campaignOwner\n\tgithub.com/pingcap/tiflow/cdc/capture/capture.go:479\ngithub.com/pingcap/tiflow/cdc/capture.(*captureImpl).run.func2\n\tgithub.com/pingcap/tiflow/cdc/capture/capture.go:344\ngolang.org/x/sync/errgroup.(*Group).Go.func1\n\tgolang.org/x/sync@v0.1.0/errgroup/errgroup.go:75\nruntime.goexit\n\truntime/asm_amd64.s:1598"]
[2023/12/27 13:58:25.966 +08:00] [INFO] [changefeed.go:638] ["changefeed closed"] [namespace=default] [changefeed=e8781b94-7db0-4bac-bad0-ff8edb4b52be] [status="{\"resolved-ts\":446603380665090054,\"checkpoint-ts\":446603380665090054,\"admin-job-type\":1}"] [info="{\"upstream-id\":7316941140801532415,\"namespace\":\"default\",\"changefeed-id\":\"e8781b94-7db0-4bac-bad0-ff8edb4b52be\",\"sink-uri\":\"mysql://root:xxxxx@127.0.0.1:3306/\",\"create-time\":\"2023-12-27T13:58:15.139204992+08:00\",\"start-ts\":446603380665090054,\"target-ts\":0,\"admin-job-type\":1,\"sort-engine\":\"unified\",\"sort-dir\":\"\",\"config\":{\"memory-quota\":268435456,\"case-sensitive\":true,\"enable-old-value\":true,\"force-replicate\":false,\"check-gc-safe-point\":true,\"enable-sync-point\":false,\"bdr-mode\":false,\"sync-point-interval\":600000000000,\"sync-point-retention\":86400000000000,\"filter\":{\"rules\":[\"*.*\"],\"ignore-txn-start-ts\":null,\"event-filters\":null},\"mounter\":{\"worker-num\":16},\"sink\":{\"transaction-atomicity\":\"\",\"protocol\":\"\",\"dispatchers\":null,\"csv\":{\"delimiter\":\",\",\"quote\":\"\\\"\",\"null\":\"\\\\N\",\"include-commit-ts\":false},\"column-selectors\":null,\"schema-registry\":\"\",\"encoder-concurrency\":16,\"terminator\":\"\\r\\n\",\"date-separator\":\"none\",\"enable-partition-separator\":false},\"consistent\":{\"level\":\"none\",\"max-log-size\":64,\"flush-interval\":2000,\"storage\":\"\"}},\"state\":\"error\",\"error\":{\"addr\":\"127.0.0.1:8300\",\"code\":\"CDC:ErrPDEtcdAPIError\",\"message\":\"[CDC:ErrPDEtcdAPIError]etcd api call error: rpc error: code = Unimplemented desc = unknown method LoadGlobalConfig for service pdpb.PD\"},\"creator-version\":\"v6.5.0-master\"}"] [isRemoved=false]
[2023/12/27 13:58:44.352 +08:00] [INFO] [feed_state_manager.go:494] ["changefeed restart backoff interval is changed"] [namespace=default] [changefeed=e8781b94-7db0-4bac-bad0-ff8edb4b52be] [oldInterval=18.335635975s] [newInterval=39.68487017s]
[2023/12/27 13:58:44.363 +08:00] [ERROR] [changefeed.go:220] ["an error occurred in Owner"] [namespace=default] [changefeed=e8781b94-7db0-4bac-bad0-ff8edb4b52be] [error="[CDC:ErrPDEtcdAPIError]etcd api call error: rpc error: code = Unimplemented desc = unknown method LoadGlobalConfig for service pdpb.PD"] [errorVerbose="[CDC:ErrPDEtcdAPIError]etcd api call error: rpc error: code = Unimplemented desc = unknown method LoadGlobalConfig for service pdpb.PD\ngithub.com/pingcap/errors.AddStack\n\tgithub.com/pingcap/errors@v0.11.5-0.20220729040631-518f63d66278/errors.go:174\ngithub.com/pingcap/errors.(*Error).GenWithStackByArgs\n\tgithub.com/pingcap/errors@v0.11.5-0.20220729040631-518f63d66278/normalize.go:164\ngithub.com/pingcap/tiflow/pkg/errors.WrapError\n\tgithub.com/pingcap/tiflow/pkg/errors/helper.go:34\ngithub.com/pingcap/tiflow/pkg/pdutil.GetSourceID\n\tgithub.com/pingcap/tiflow/pkg/pdutil/utils.go:37\ngithub.com/pingcap/tiflow/cdc/owner.(*changefeed).initialize\n\tgithub.com/pingcap/tiflow/cdc/owner/changefeed.go:511\ngithub.com/pingcap/tiflow/cdc/owner.(*changefeed).tick\n\tgithub.com/pingcap/tiflow/cdc/owner/changefeed.go:273\ngithub.com/pingcap/tiflow/cdc/owner.(*changefeed).Tick\n\tgithub.com/pingcap/tiflow/cdc/owner/changefeed.go:200\ngithub.com/pingcap/tiflow/cdc/owner.(*ownerImpl).Tick\n\tgithub.com/pingcap/tiflow/cdc/owner/owner.go:222\ngithub.com/pingcap/tiflow/pkg/orchestrator.(*EtcdWorker).Run\n\tgithub.com/pingcap/tiflow/pkg/orchestrator/etcd_worker.go:290\ngithub.com/pingcap/tiflow/cdc/capture.(*captureImpl).runEtcdWorker\n\tgithub.com/pingcap/tiflow/cdc/capture/capture.go:516\ngithub.com/pingcap/tiflow/cdc/capture.(*captureImpl).campaignOwner\n\tgithub.com/pingcap/tiflow/cdc/capture/capture.go:479\ngithub.com/pingcap/tiflow/cdc/capture.(*captureImpl).run.func2\n\tgithub.com/pingcap/tiflow/cdc/capture/capture.go:344\ngolang.org/x/sync/errgroup.(*Group).Go.func1\n\tgolang.org/x/sync@v0.1.0/errgroup/errgroup.go:75\nruntime.goexit\n\truntime/asm_amd64.s:1598"]
[2023/12/27 13:58:44.363 +08:00] [INFO] [changefeed.go:638] ["changefeed closed"] [namespace=default] [changefeed=e8781b94-7db0-4bac-bad0-ff8edb4b52be] [status="{\"resolved-ts\":446603380665090054,\"checkpoint-ts\":446603380665090054,\"admin-job-type\":1}"] [info="{\"upstream-id\":7316941140801532415,\"namespace\":\"default\",\"changefeed-id\":\"e8781b94-7db0-4bac-bad0-ff8edb4b52be\",\"sink-uri\":\"mysql://root:xxxxx@127.0.0.1:3306/\",\"create-time\":\"2023-12-27T13:58:15.139204992+08:00\",\"start-ts\":446603380665090054,\"target-ts\":0,\"admin-job-type\":1,\"sort-engine\":\"unified\",\"sort-dir\":\"\",\"config\":{\"memory-quota\":268435456,\"case-sensitive\":true,\"enable-old-value\":true,\"force-replicate\":false,\"check-gc-safe-point\":true,\"enable-sync-point\":false,\"bdr-mode\":false,\"sync-point-interval\":600000000000,\"sync-point-retention\":86400000000000,\"filter\":{\"rules\":[\"*.*\"],\"ignore-txn-start-ts\":null,\"event-filters\":null},\"mounter\":{\"worker-num\":16},\"sink\":{\"transaction-atomicity\":\"\",\"protocol\":\"\",\"dispatchers\":null,\"csv\":{\"delimiter\":\",\",\"quote\":\"\\\"\",\"null\":\"\\\\N\",\"include-commit-ts\":false},\"column-selectors\":null,\"schema-registry\":\"\",\"encoder-concurrency\":16,\"terminator\":\"\\r\\n\",\"date-separator\":\"none\",\"enable-partition-separator\":false},\"consistent\":{\"level\":\"none\",\"max-log-size\":64,\"flush-interval\":2000,\"storage\":\"\"}},\"state\":\"error\",\"error\":{\"addr\":\"127.0.0.1:8300\",\"code\":\"CDC:ErrPDEtcdAPIError\",\"message\":\"[CDC:ErrPDEtcdAPIError]etcd api call error: rpc error: code = Unimplemented desc = unknown method LoadGlobalConfig for service pdpb.PD\"},\"creator-version\":\"v6.5.0-master\"}"] [isRemoved=false]
[2023/12/27 13:59:17.006 +08:00] [INFO] [middleware.go:48] [/api/v2/status] [status=200] [method=GET] [path=/api/v2/status] [query=] [ip=127.0.0.1] [user-agent=Go-http-client/1.1] [client-version=v6.5.0-master] [] [duration=30.948µs]
[2023/12/27 13:59:17.101 +08:00] [INFO] [middleware.go:48] [/api/v1/changefeeds] [status=200] [method=GET] [path=/api/v1/changefeeds] [query="state=all"] [ip=127.0.0.1] [user-agent=Go-http-client/1.1] [client-version=v6.5.0-master] [] [duration=95.245279ms]
[2023/12/27 13:59:24.051 +08:00] [INFO] [feed_state_manager.go:494] ["changefeed restart backoff interval is changed"] [namespace=default] [changefeed=e8781b94-7db0-4bac-bad0-ff8edb4b52be] [oldInterval=39.68487017s] [newInterval=1m18.846134795s]
[2023/12/27 13:59:24.065 +08:00] [ERROR] [changefeed.go:220] ["an error occurred in Owner"] [namespace=default] [changefeed=e8781b94-7db0-4bac-bad0-ff8edb4b52be] [error="[CDC:ErrPDEtcdAPIError]etcd api call error: rpc error: code = Unimplemented desc = unknown method LoadGlobalConfig for service pdpb.PD"] [errorVerbose="[CDC:ErrPDEtcdAPIError]etcd api call error: rpc error: code = Unimplemented desc = unknown method LoadGlobalConfig for service pdpb.PD\ngithub.com/pingcap/errors.AddStack\n\tgithub.com/pingcap/errors@v0.11.5-0.20220729040631-518f63d66278/errors.go:174\ngithub.com/pingcap/errors.(*Error).GenWithStackByArgs\n\tgithub.com/pingcap/errors@v0.11.5-0.20220729040631-518f63d66278/normalize.go:164\ngithub.com/pingcap/tiflow/pkg/errors.WrapError\n\tgithub.com/pingcap/tiflow/pkg/errors/helper.go:34\ngithub.com/pingcap/tiflow/pkg/pdutil.GetSourceID\n\tgithub.com/pingcap/tiflow/pkg/pdutil/utils.go:37\ngithub.com/pingcap/tiflow/cdc/owner.(*changefeed).initialize\n\tgithub.com/pingcap/tiflow/cdc/owner/changefeed.go:511\ngithub.com/pingcap/tiflow/cdc/owner.(*changefeed).tick\n\tgithub.com/pingcap/tiflow/cdc/owner/changefeed.go:273\ngithub.com/pingcap/tiflow/cdc/owner.(*changefeed).Tick\n\tgithub.com/pingcap/tiflow/cdc/owner/changefeed.go:200\ngithub.com/pingcap/tiflow/cdc/owner.(*ownerImpl).Tick\n\tgithub.com/pingcap/tiflow/cdc/owner/owner.go:222\ngithub.com/pingcap/tiflow/pkg/orchestrator.(*EtcdWorker).Run\n\tgithub.com/pingcap/tiflow/pkg/orchestrator/etcd_worker.go:290\ngithub.com/pingcap/tiflow/cdc/capture.(*captureImpl).runEtcdWorker\n\tgithub.com/pingcap/tiflow/cdc/capture/capture.go:516\ngithub.com/pingcap/tiflow/cdc/capture.(*captureImpl).campaignOwner\n\tgithub.com/pingcap/tiflow/cdc/capture/capture.go:479\ngithub.com/pingcap/tiflow/cdc/capture.(*captureImpl).run.func2\n\tgithub.com/pingcap/tiflow/cdc/capture/capture.go:344\ngolang.org/x/sync/errgroup.(*Group).Go.func1\n\tgolang.org/x/sync@v0.1.0/errgroup/errgroup.go:75\nruntime.goexit\n\truntime/asm_amd64.s:1598"]
[2023/12/27 13:59:24.065 +08:00] [INFO] [changefeed.go:638] ["changefeed closed"] [namespace=default] [changefeed=e8781b94-7db0-4bac-bad0-ff8edb4b52be] [status="{\"resolved-ts\":446603380665090054,\"checkpoint-ts\":446603380665090054,\"admin-job-type\":1}"] [info="{\"upstream-id\":7316941140801532415,\"namespace\":\"default\",\"changefeed-id\":\"e8781b94-7db0-4bac-bad0-ff8edb4b52be\",\"sink-uri\":\"mysql://root:xxxxx@127.0.0.1:3306/\",\"create-time\":\"2023-12-27T13:58:15.139204992+08:00\",\"start-ts\":446603380665090054,\"target-ts\":0,\"admin-job-type\":1,\"sort-engine\":\"unified\",\"sort-dir\":\"\",\"config\":{\"memory-quota\":268435456,\"case-sensitive\":true,\"enable-old-value\":true,\"force-replicate\":false,\"check-gc-safe-point\":true,\"enable-sync-point\":false,\"bdr-mode\":false,\"sync-point-interval\":600000000000,\"sync-point-retention\":86400000000000,\"filter\":{\"rules\":[\"*.*\"],\"ignore-txn-start-ts\":null,\"event-filters\":null},\"mounter\":{\"worker-num\":16},\"sink\":{\"transaction-atomicity\":\"\",\"protocol\":\"\",\"dispatchers\":null,\"csv\":{\"delimiter\":\",\",\"quote\":\"\\\"\",\"null\":\"\\\\N\",\"include-commit-ts\":false},\"column-selectors\":null,\"schema-registry\":\"\",\"encoder-concurrency\":16,\"terminator\":\"\\r\\n\",\"date-separator\":\"none\",\"enable-partition-separator\":false},\"consistent\":{\"level\":\"none\",\"max-log-size\":64,\"flush-interval\":2000,\"storage\":\"\"}},\"state\":\"error\",\"error\":{\"addr\":\"127.0.0.1:8300\",\"code\":\"CDC:ErrPDEtcdAPIError\",\"message\":\"[CDC:ErrPDEtcdAPIError]etcd api call error: rpc error: code = Unimplemented desc = unknown method LoadGlobalConfig for service pdpb.PD\"},\"creator-version\":\"v6.5.0-master\"}"] [isRemoved=false]
[2023/12/27 14:00:42.951 +08:00] [INFO] [feed_state_manager.go:494] ["changefeed restart backoff interval is changed"] [namespace=default] [changefeed=e8781b94-7db0-4bac-bad0-ff8edb4b52be] [oldInterval=1m18.846134795s] [newInterval=2m43.021985507s]
[2023/12/27 14:00:42.968 +08:00] [ERROR] [changefeed.go:220] ["an error occurred in Owner"] [namespace=default] [changefeed=e8781b94-7db0-4bac-bad0-ff8edb4b52be] [error="[CDC:ErrPDEtcdAPIError]etcd api call error: rpc error: code = Unimplemented desc = unknown method LoadGlobalConfig for service pdpb.PD"] [errorVerbose="[CDC:ErrPDEtcdAPIError]etcd api call error: rpc error: code = Unimplemented desc = unknown method LoadGlobalConfig for service pdpb.PD\ngithub.com/pingcap/errors.AddStack\n\tgithub.com/pingcap/errors@v0.11.5-0.20220729040631-518f63d66278/errors.go:174\ngithub.com/pingcap/errors.(*Error).GenWithStackByArgs\n\tgithub.com/pingcap/errors@v0.11.5-0.20220729040631-518f63d66278/normalize.go:164\ngithub.com/pingcap/tiflow/pkg/errors.WrapError\n\tgithub.com/pingcap/tiflow/pkg/errors/helper.go:34\ngithub.com/pingcap/tiflow/pkg/pdutil.GetSourceID\n\tgithub.com/pingcap/tiflow/pkg/pdutil/utils.go:37\ngithub.com/pingcap/tiflow/cdc/owner.(*changefeed).initialize\n\tgithub.com/pingcap/tiflow/cdc/owner/changefeed.go:511\ngithub.com/pingcap/tiflow/cdc/owner.(*changefeed).tick\n\tgithub.com/pingcap/tiflow/cdc/owner/changefeed.go:273\ngithub.com/pingcap/tiflow/cdc/owner.(*changefeed).Tick\n\tgithub.com/pingcap/tiflow/cdc/owner/changefeed.go:200\ngithub.com/pingcap/tiflow/cdc/owner.(*ownerImpl).Tick\n\tgithub.com/pingcap/tiflow/cdc/owner/owner.go:222\ngithub.com/pingcap/tiflow/pkg/orchestrator.(*EtcdWorker).Run\n\tgithub.com/pingcap/tiflow/pkg/orchestrator/etcd_worker.go:290\ngithub.com/pingcap/tiflow/cdc/capture.(*captureImpl).runEtcdWorker\n\tgithub.com/pingcap/tiflow/cdc/capture/capture.go:516\ngithub.com/pingcap/tiflow/cdc/capture.(*captureImpl).campaignOwner\n\tgithub.com/pingcap/tiflow/cdc/capture/capture.go:479\ngithub.com/pingcap/tiflow/cdc/capture.(*captureImpl).run.func2\n\tgithub.com/pingcap/tiflow/cdc/capture/capture.go:344\ngolang.org/x/sync/errgroup.(*Group).Go.func1\n\tgolang.org/x/sync@v0.1.0/errgroup/errgroup.go:75\nruntime.goexit\n\truntime/asm_amd64.s:1598"]
[2023/12/27 14:00:42.968 +08:00] [INFO] [changefeed.go:638] ["changefeed closed"] [namespace=default] [changefeed=e8781b94-7db0-4bac-bad0-ff8edb4b52be] [status="{\"resolved-ts\":446603380665090054,\"checkpoint-ts\":446603380665090054,\"admin-job-type\":1}"] [info="{\"upstream-id\":7316941140801532415,\"namespace\":\"default\",\"changefeed-id\":\"e8781b94-7db0-4bac-bad0-ff8edb4b52be\",\"sink-uri\":\"mysql://root:xxxxx@127.0.0.1:3306/\",\"create-time\":\"2023-12-27T13:58:15.139204992+08:00\",\"start-ts\":446603380665090054,\"target-ts\":0,\"admin-job-type\":1,\"sort-engine\":\"unified\",\"sort-dir\":\"\",\"config\":{\"memory-quota\":268435456,\"case-sensitive\":true,\"enable-old-value\":true,\"force-replicate\":false,\"check-gc-safe-point\":true,\"enable-sync-point\":false,\"bdr-mode\":false,\"sync-point-interval\":600000000000,\"sync-point-retention\":86400000000000,\"filter\":{\"rules\":[\"*.*\"],\"ignore-txn-start-ts\":null,\"event-filters\":null},\"mounter\":{\"worker-num\":16},\"sink\":{\"transaction-atomicity\":\"\",\"protocol\":\"\",\"dispatchers\":null,\"csv\":{\"delimiter\":\",\",\"quote\":\"\\\"\",\"null\":\"\\\\N\",\"include-commit-ts\":false},\"column-selectors\":null,\"schema-registry\":\"\",\"encoder-concurrency\":16,\"terminator\":\"\\r\\n\",\"date-separator\":\"none\",\"enable-partition-separator\":false},\"consistent\":{\"level\":\"none\",\"max-log-size\":64,\"flush-interval\":2000,\"storage\":\"\"}},\"state\":\"error\",\"error\":{\"addr\":\"127.0.0.1:8300\",\"code\":\"CDC:ErrPDEtcdAPIError\",\"message\":\"[CDC:ErrPDEtcdAPIError]etcd api call error: rpc error: code = Unimplemented desc = unknown method LoadGlobalConfig for service pdpb.PD\"},\"creator-version\":\"v6.5.0-master\"}"] [isRemoved=false]

tmp.log里面报错是这样的，那个LoadGlobalConfig我没找到呢

7

我发现我创建上游的时候tmp.log里面就已经出现了下面的报错了 :dizzy_face:

[2023/12/27 13:55:11.898 +08:00] [INFO] [helper.go:54] ["init log"] [file=/tmp/cdc_data/tmp.log] [level=info]
[2023/12/27 13:55:11.898 +08:00] [INFO] [version.go:47] ["Welcome to Change Data Capture (CDC)"] [release-version=v6.5.0-master] [git-hash=82446cd9bd8a2feb52a7a3f403039620aaec9618] [git-branch=master] [utc-build-time="2023-08-12 17:20:07"] [go-version="go version go1.20.6 linux/amd64"] [failpoint-build=false]
[2023/12/27 13:55:11.898 +08:00] [INFO] [helper.go:99] ["using proxy config"] [http_proxy=127.0.0.1:7890] [https_proxy=127.0.0.1:7890] [no_proxy="localhost, 127.0.0.1"]
[2023/12/27 13:55:11.898 +08:00] [INFO] [server.go:130] ["CDC server created"] [pd="[http://10.206.0.7:2383]"] [config="{\"addr\":\"127.0.0.1:8300\",\"advertise-addr\":\"127.0.0.1:8300\",\"log-file\":\"/tmp/cdc_data/tmp.log\",\"log-level\":\"info\",\"log\":{\"file\":{\"max-size\":300000,\"max-days\":0,\"max-backups\":0},\"error-output\":\"stderr\"},\"data-dir\":\"/tmp/cdc_data\",\"gc-ttl\":86400,\"tz\":\"System\",\"capture-session-ttl\":10,\"owner-flush-interval\":50000000,\"processor-flush-interval\":50000000,\"sorter\":{\"num-concurrent-worker\":4,\"chunk-size-limit\":134217728,\"max-memory-percentage\":10,\"max-memory-consumption\":17179869184,\"num-workerpool-goroutine\":16,\"sort-dir\":\"/tmp/sorter\"},\"security\":{\"ca-path\":\"\",\"cert-path\":\"\",\"key-path\":\"\",\"cert-allowed-cn\":null},\"per-table-memory-quota\":10485760,\"kv-client\":{\"worker-concurrent\":8,\"worker-pool-size\":0,\"region-scan-limit\":40,\"region-retry-duration\":60000000000},\"debug\":{\"table-actor\":{\"event-batch-size\":32},\"enable-pull-based-sink\":true,\"enable-db-sorter\":true,\"db\":{\"count\":8,\"concurrency\":128,\"max-open-files\":10000,\"block-size\":65536,\"writer-buffer-size\":8388608,\"compression\":\"snappy\",\"write-l0-pause-trigger\":2147483647,\"compaction-l0-trigger\":160,\"compaction-deletion-threshold\":10485760,\"compaction-period\":1800,\"iterator-max-alive-duration\":10000,\"iterator-slow-read-duration\":256},\"enable-new-scheduler\":true,\"messages\":{\"client-max-batch-interval\":10000000,\"client-max-batch-size\":8388608,\"client-max-batch-count\":128,\"client-retry-rate-limit\":1,\"server-max-pending-message-count\":102400,\"server-ack-interval\":100000000,\"server-worker-pool-size\":4,\"max-recv-msg-size\":268435456},\"scheduler\":{\"heartbeat-tick\":2,\"collect-stats-tick\":200,\"max-task-concurrency\":10,\"check-balance-interval\":60000000000,\"add-table-batch-size\":50,\"region-per-span\":0},\"enable-new-sink\":true},\"cluster-id\":\"default\"}"]
[2023/12/27 13:55:11.900 +08:00] [INFO] [server.go:457] ["/tmp/cdc_data is set as data-dir (80GB available), sort-dir=/tmp/cdc_data/tmp/sorter. It is recommended that the disk for data-dir at least have 500GB available space"]
[2023/12/27 13:55:11.901 +08:00] [INFO] [server.go:300] ["http server is running"] [addr=127.0.0.1:8300]
[2023/12/27 13:55:11.901 +08:00] [INFO] [client.go:405] ["[pd] create pd client with endpoints"] [pd-address="[http://10.206.0.7:2383]"]
[2023/12/27 13:55:11.903 +08:00] [INFO] [base_client.go:360] ["[pd] update member urls"] [old-urls="[http://10.206.0.7:2383]"] [new-urls="[http://10.206.0.12:2383,http://10.206.0.14:2383,http://10.206.0.7:2383]"]
[2023/12/27 13:55:11.903 +08:00] [INFO] [base_client.go:378] ["[pd] switch leader"] [new-leader=http://10.206.0.7:2383] [old-leader=]
[2023/12/27 13:55:11.903 +08:00] [INFO] [base_client.go:105] ["[pd] init cluster id"] [cluster-id=7316941140801532415]
[2023/12/27 13:55:11.905 +08:00] [INFO] [client.go:698] ["[pd] tso dispatcher created"] [dc-location=global]
[2023/12/27 13:55:11.906 +08:00] [INFO] [client.go:405] ["[pd] create pd client with endpoints"] [pd-address="[http://10.206.0.7:2383]"]
[2023/12/27 13:55:11.908 +08:00] [INFO] [base_client.go:360] ["[pd] update member urls"] [old-urls="[http://10.206.0.7:2383]"] [new-urls="[http://10.206.0.12:2383,http://10.206.0.14:2383,http://10.206.0.7:2383]"]
[2023/12/27 13:55:11.908 +08:00] [INFO] [base_client.go:378] ["[pd] switch leader"] [new-leader=http://10.206.0.7:2383] [old-leader=]
[2023/12/27 13:55:11.908 +08:00] [INFO] [base_client.go:105] ["[pd] init cluster id"] [cluster-id=7316941140801532415]
[2023/12/27 13:55:11.908 +08:00] [INFO] [client.go:698] ["[pd] tso dispatcher created"] [dc-location=global]
[2023/12/27 13:55:11.909 +08:00] [INFO] [client.go:405] ["[pd] create pd client with endpoints"] [pd-address="[10.206.0.7:2383]"]
[2023/12/27 13:55:11.911 +08:00] [INFO] [base_client.go:360] ["[pd] update member urls"] [old-urls="[http://10.206.0.7:2383]"] [new-urls="[http://10.206.0.12:2383,http://10.206.0.14:2383,http://10.206.0.7:2383]"]
[2023/12/27 13:55:11.911 +08:00] [INFO] [base_client.go:378] ["[pd] switch leader"] [new-leader=http://10.206.0.7:2383] [old-leader=]
[2023/12/27 13:55:11.911 +08:00] [INFO] [base_client.go:105] ["[pd] init cluster id"] [cluster-id=7316941140801532415]
[2023/12/27 13:55:11.911 +08:00] [INFO] [client.go:698] ["[pd] tso dispatcher created"] [dc-location=global]
[2023/12/27 13:55:11.913 +08:00] [ERROR] [api_client.go:119] ["Fail to add meta region label to PD"] [error="[404] 404 page not found\n"] [errorVerbose="[404] 404 page not found\n\ngithub.com/pingcap/tiflow/pkg/httputil.(*Client).DoRequest\n\tgithub.com/pingcap/tiflow/pkg/httputil/httputil.go:122\ngithub.com/pingcap/tiflow/pkg/pdutil.(*pdAPIClient).patchMetaLabel\n\tgithub.com/pingcap/tiflow/pkg/pdutil/api_client.go:180\ngithub.com/pingcap/tiflow/pkg/pdutil.(*pdAPIClient).UpdateMetaLabel.func1\n\tgithub.com/pingcap/tiflow/pkg/pdutil/api_client.go:117\ngithub.com/pingcap/tiflow/pkg/retry.run\n\tgithub.com/pingcap/tiflow/pkg/retry/retry_with_opt.go:57\ngithub.com/pingcap/tiflow/pkg/retry.Do\n\tgithub.com/pingcap/tiflow/pkg/retry/retry_with_opt.go:34\ngithub.com/pingcap/tiflow/pkg/pdutil.(*pdAPIClient).UpdateMetaLabel\n\tgithub.com/pingcap/tiflow/pkg/pdutil/api_client.go:113\ngithub.com/pingcap/tiflow/pkg/upstream.initUpstream\n\tgithub.com/pingcap/tiflow/pkg/upstream/upstream.go:191\ngithub.com/pingcap/tiflow/pkg/upstream.(*Manager).AddDefaultUpstream\n\tgithub.com/pingcap/tiflow/pkg/upstream/manager.go:92\ngithub.com/pingcap/tiflow/cdc/capture.(*captureImpl).reset\n\tgithub.com/pingcap/tiflow/cdc/capture/capture.go:237\ngithub.com/pingcap/tiflow/cdc/capture.(*captureImpl).Run\n\tgithub.com/pingcap/tiflow/cdc/capture/capture.go:297\ngithub.com/pingcap/tiflow/cdc/server.(*server).run.func1\n\tgithub.com/pingcap/tiflow/cdc/server/server.go:356\ngolang.org/x/sync/errgroup.(*Group).Go.func1\n\tgolang.org/x/sync@v0.1.0/errgroup/errgroup.go:75\nruntime.goexit\n\truntime/asm_amd64.s:1598"]
[2023/12/27 13:55:11.928 +08:00] [ERROR] [api_client.go:119] ["Fail to add meta region label to PD"] [error="[404] 404 page not found\n"] [errorVerbose="[404] 404 page not found\n\ngithub.com/pingcap/tiflow/pkg/httputil.(*Client).DoRequest\n\tgithub.com/pingcap/tiflow/pkg/httputil/httputil.go:122\ngithub.com/pingcap/tiflow/pkg/pdutil.(*pdAPIClient).patchMetaLabel\n\tgithub.com/pingcap/tiflow/pkg/pdutil/api_client.go:180\ngithub.com/pingcap/tiflow/pkg/pdutil.(*pdAPIClient).UpdateMetaLabel.func1\n\tgithub.com/pingcap/tiflow/pkg/pdutil/api_client.go:117\ngithub.com/pingcap/tiflow/pkg/retry.run\n\tgithub.com/pingcap/tiflow/pkg/retry/retry_with_opt.go:57\ngithub.com/pingcap/tiflow/pkg/retry.Do\n\tgithub.com/pingcap/tiflow/pkg/retry/retry_with_opt.go:34\ngithub.com/pingcap/tiflow/pkg/pdutil.(*pdAPIClient).UpdateMetaLabel\n\tgithub.com/pingcap/tiflow/pkg/pdutil/api_client.go:113\ngithub.com/pingcap/tiflow/pkg/upstream.initUpstream\n\tgithub.com/pingcap/tiflow/pkg/upstream/upstream.go:191\ngithub.com/pingcap/tiflow/pkg/upstream.(*Manager).AddDefaultUpstream\n\tgithub.com/pingcap/tiflow/pkg/upstream/manager.go:92\ngithub.com/pingcap/tiflow/cdc/capture.(*captureImpl).reset\n\tgithub.com/pingcap/tiflow/cdc/capture/capture.go:237\ngithub.com/pingcap/tiflow/cdc/capture.(*captureImpl).Run\n\tgithub.com/pingcap/tiflow/cdc/capture/capture.go:297\ngithub.com/pingcap/tiflow/cdc/server.(*server).run.func1\n\tgithub.com/pingcap/tiflow/cdc/server/server.go:356\ngolang.org/x/sync/errgroup.(*Group).Go.func1\n\tgolang.org/x/sync@v0.1.0/errgroup/errgroup.go:75\nruntime.goexit\n\truntime/asm_amd64.s:1598"]
[2023/12/27 13:55:11.995 +08:00] [ERROR] [api_client.go:119] ["Fail to add meta region label to PD"] [error="[404] 404 page not found\n"] [errorVerbose="[404] 404 page not found\n\ngithub.com/pingcap/tiflow/pkg/httputil.(*Client).DoRequest\n\tgithub.com/pingcap/tiflow/pkg/httputil/httputil.go:122\ngithub.com/pingcap/tiflow/pkg/pdutil.(*pdAPIClient).patchMetaLabel\n\tgithub.com/pingcap/tiflow/pkg/pdutil/api_client.go:180\ngithub.com/pingcap/tiflow/pkg/pdutil.(*pdAPIClient).UpdateMetaLabel.func1\n\tgithub.com/pingcap/tiflow/pkg/pdutil/api_client.go:117\ngithub.com/pingcap/tiflow/pkg/retry.run\n\tgithub.com/pingcap/tiflow/pkg/retry/retry_with_opt.go:57\ngithub.com/pingcap/tiflow/pkg/retry.Do\n\tgithub.com/pingcap/tiflow/pkg/retry/retry_with_opt.go:34\ngithub.com/pingcap/tiflow/pkg/pdutil.(*pdAPIClient).UpdateMetaLabel\n\tgithub.com/pingcap/tiflow/pkg/pdutil/api_client.go:113\ngithub.com/pingcap/tiflow/pkg/upstream.initUpstream\n\tgithub.com/pingcap/tiflow/pkg/upstream/upstream.go:191\ngithub.com/pingcap/tiflow/pkg/upstream.(*Manager).AddDefaultUpstream\n\tgithub.com/pingcap/tiflow/pkg/upstream/manager.go:92\ngithub.com/pingcap/tiflow/cdc/capture.(*captureImpl).reset\n\tgithub.com/pingcap/tiflow/cdc/capture/capture.go:237\ngithub.com/pingcap/tiflow/cdc/capture.(*captureImpl).Run\n\tgithub.com/pingcap/tiflow/cdc/capture/capture.go:297\ngithub.com/pingcap/tiflow/cdc/server.(*server).run.func1\n\tgithub.com/pingcap/tiflow/cdc/server/server.go:356\ngolang.org/x/sync/errgroup.(*Group).Go.func1\n\tgolang.org/x/sync@v0.1.0/errgroup/errgroup.go:75\nruntime.goexit\n\truntime/asm_amd64.s:1598"]
[2023/12/27 13:55:11.995 +08:00] [WARN] [upstream.go:193] ["Fail to verify region label rule"] [error="[CDC:ErrReachMaxTry]reach maximum try: 3, error: [404] 404 page not found\n: [404] 404 page not found\n"] [upstreamID=7316941140801532415] [upstreamEndpoints="[http://10.206.0.7:2383]"]
[2023/12/27 13:55:11.995 +08:00] [INFO] [upstream.go:210] ["upstream initialize successfully"] [upstreamID=7316941140801532415]
[2023/12/27 13:55:11.995 +08:00] [INFO] [manager.go:98] ["default upstream is added"] [id=7316941140801532415]
8

端口是不是搞错了，我看别人是2379呢：
专栏 - TiDB TiCDC使用实践 | TiDB 社区

9

image
image937×556 39.2 KB

不是呢，我部署的时候设的端口就是2383 :thinking:

10 
[ERROR] [api_client.go:119] ["Fail to add meta region label to PD"] [error="[404] 404 page not found\n"] [errorVerbose="[404] 404 page not found

你这是内网环境么？开代理了？

11

您好 我curl了一下 是可以连外网的

image
image1340×516 57.3 KB

12

需要确保节点内的网络和端口是可以直连的，如果有转发，可能会有点问题了

13

检查PD是否正常

14

看display，应该TiCDC是单独使用的，那用的TiCDC版本是哪个？和v5.1.0适配么？

15

display的结果显示PD是正常的。 :yum:

16

这里为什么是127的地址呢？
image

17

看执行命令，应该是从TiDB集群同步到本地mysql数据库，cdc应该也是在本地。

18

image
image937×556 39.2 KB

楼主发的截图也不是单机部署，不知道什么情况

19

:thinking:这和是不是单机部署没关系吧。看楼主的title，应该是从教学环境同步数据到本地环境。

20

基本是网络连通性的问题，可以测试下（telnet ip port）客户端和服务端 端口之间的连通性。