【 TiDB 使用环境】生产环境
【 TiDB 版本】V5.4.0
【复现路径】kafka版本从v2.0.0升级到v3.0.0
【遇到的问题:问题现象及影响】
kafka版本从v2.0.0升级到v3.0.0后,ticdc重新创建kafka任务时,报错:[CDC:ErrKafkaNewSaramaProducer]new sarama producer: [CDC:ErrKafkaNewSaramaProducer]new sarama producer: EOF
tiup cdc cli changefeed create --pd=http://10.3.x.196:2379 --sink-uri=“kafka://172.17.xx.106:9092,172.17.xx.107:9092,172.17.xx.108:9092/charge?protocol=canal-json&replication-factor=3” --changefeed-id=“kafka-to-tianjin-pro-01” --config=“./kafka-to-tianjin-pro-01.toml” --start-ts=‘439291916880707592’ tiup is checking updates for component cdc …
Starting component cdc
: /root/.tiup/components/cdc/v5.4.0/cdc /root/.tiup/components/cdc/v5.4.0/cdc cli changefeed create --pd=http://10.3.x.196:2379 --sink-uri=kafka://172.17.xx.106:9092,172.17.xx.107:9092,172.17.xx.108:9092/charge?protocol=canal-json&replication-factor=3 --changefeed-id=kafka-to-tianjin-pro-01 --config=./kafka-to-tianjin-pro-01.toml --start-ts=439291916880707592
[2023/02/08 14:46:28.116 +08:00] [WARN] [cli_changefeed_create.go:207] [“Attempting to replicate without old value enabled. CDC will enable old value and continue.”] [protocol=canal-json]
Error: [CDC:ErrKafkaNewSaramaProducer]new sarama producer: [CDC:ErrKafkaNewSaramaProducer]new sarama producer: EOF
Usage:
cdc cli changefeed create [flags]
Flags:
-c, --changefeed-id string Replication task (changefeed) ID
–config string Path of the configuration file
–cyclic-filter-replica-ids uints (Experimental) Cyclic replication filter replica ID of changefeed (default [])
–cyclic-replica-id uint (Experimental) Cyclic replication replica ID of changefeed
–cyclic-sync-ddl (Experimental) Cyclic replication sync DDL of changefeed (default true)
–disable-gc-check Disable GC safe point check
-h, --help help for create
–no-confirm Don’t ask user whether to ignore ineligible table
–opts key=value Extra options, in the key=value format
–sink-uri string sink uri
–sort-engine string sort engine used for data sort (default “unified”)
–start-ts uint Start ts of changefeed
–sync-interval duration (Experimental) Set the interval for syncpoint in replication(default 10min) (default 10m0s)
–sync-point (Experimental) Set and Record syncpoint in replication(default off)
–target-ts uint Target ts of changefeed
–tz string timezone used when checking sink uri (changefeed timezone is determined by cdc server) (default “SYSTEM”)
Global Flags:
–ca string CA certificate path for TLS connection
–cert string Certificate path for TLS connection
-i, --interact Run cdc cli with readline
–key string Private key path for TLS connection
–log-level string log level (etc: debug|info|warn|error) (default “warn”)
–pd string PD address, use ‘,’ to separate multiple PDs (default “http://127.0.0.1:2379”)
[CDC:ErrKafkaNewSaramaProducer]new sarama producer: [CDC:ErrKafkaNewSaramaProducer]new sarama producer: EOF
【资源配置】
【附件:截图/日志/监控】
之前,kafka版本为v2.0.0时,一切正常。kafka升级v3.0.0版本后,就不行了。大佬们,帮忙给诊断一下,谢谢!