tidb通过 drainer写数据到kafka不成功

【 TiDB 使用环境】生产环境
【 TiDB 版本】4.0.0
【复现路径】做过哪些操作出现的问题
【遇到的问题:问题现象及影响】
【资源配置】
【附件:截图/日志/监控】

drainer配置
image
tidb数据发生变更后,数据没有写入kafka
Client background metadata update:kafka: no specific topics to update metadata

根据提供的信息,可能是以下原因导致数据没有写入kafka:

  1. Kafka的topic没有正确配置或者没有创建。请确保已经正确创建了Kafka的topic,并且在Drainer的配置文件中正确配置了topic的名称。

  2. Drainer的配置文件中的Kafka地址不正确。请确保在Drainer的配置文件中正确配置了Kafka的地址。

  3. Kafka的版本不兼容。请确保Drainer使用的Kafka版本与Kafka集群的版本兼容。

  4. Kafka集群中的某些节点不可用。请检查Kafka集群中的所有节点是否都正常运行。

  5. Drainer的日志中可能会提供更多有关问题的信息。请查看Drainer的日志,以获取更多有关问题的信息。

另外,根据提供的信息,可能是由于没有指定要更新的特定主题而导致的“Client background metadata update:kafka: no specific topics to update metadata”错误。请确保在Drainer的配置文件中正确指定了要更新的主题名称。

如果以上方法都无法解决问题,请提供更多详细信息,以便更好地帮助您解决问题。

[2023/05/31 16:56:17.980 +08:00] [INFO] [broker.go:168] [“[sarama] Failed to connect to broker localhost:9092: dial tcp [::1]:9092: connect: connection refused\n”]
[2023/05/31 16:56:17.980 +08:00] [INFO] [async_producer.go:971] [“[sarama] producer/broker/0 state change to [closing] because dial tcp [::1]:9092: connect: connection refused\n”]
[2023/05/31 16:56:17.980 +08:00] [INFO] [async_producer.go:578] [“[sarama] producer/leader/test/0 state change to [retrying-75]\n”]
[2023/05/31 16:56:17.980 +08:00] [INFO] [async_producer.go:588] [“[sarama] producer/leader/test/0 abandoning broker 0\n”]
[2023/05/31 16:56:17.980 +08:00] [INFO] [async_producer.go:717] [“[sarama] producer/broker/0 input chan closed\n”]
[2023/05/31 16:56:17.980 +08:00] [INFO] [async_producer.go:801] [“[sarama] producer/broker/0 shut down\n”]
[2023/05/31 16:56:18.480 +08:00] [INFO] [client.go:772] [“[sarama] client/metadata fetching metadata for [test] from broker 192.168.10.44:9092\n”]
[2023/05/31 16:56:18.482 +08:00] [INFO] [async_producer.go:711] [“[sarama] producer/broker/0 starting up\n”]
[2023/05/31 16:56:18.483 +08:00] [INFO] [async_producer.go:727] [“[sarama] producer/broker/0 state change to [open] on test/0\n”]
[2023/05/31 16:56:18.483 +08:00] [INFO] [async_producer.go:570] [“[sarama] producer/leader/test/0 selected broker 0\n”]
[2023/05/31 16:56:18.483 +08:00] [INFO] [async_producer.go:594] [“[sarama] producer/leader/test/0 state change to [flushing-75]\n”]
[2023/05/31 16:56:18.483 +08:00] [INFO] [async_producer.go:616] [“[sarama] producer/leader/test/0 state change to [normal]\n”]
[2023/05/31 16:56:18.483 +08:00] [INFO] [broker.go:168] [“[sarama] Failed to connect to broker localhost:9092: dial tcp [::1]:9092: connect: connection refused\n”]
[2023/05/31 16:56:18.484 +08:00] [INFO] [async_producer.go:971] [“[sarama] producer/broker/0 state change to [closing] because dial tcp [::1]:9092: connect: connection refused\n”]
[2023/05/31 16:56:18.484 +08:00] [INFO] [async_producer.go:578] [“[sarama] producer/leader/test/0 state change to [retrying-76]\n”]
[2023/05/31 16:56:18.484 +08:00] [INFO] [async_producer.go:588] [“[sarama] producer/leader/test/0 abandoning broker 0\n”]
[2023/05/31 16:56:18.484 +08:00] [INFO] [async_producer.go:717] [“[sarama] producer/broker/0 input chan closed\n”]
[2023/05/31 16:56:18.484 +08:00] [INFO] [async_producer.go:801] [“[sarama] producer/broker/0 shut down\n”]

代码片段_TIDB - 使用 TiDB Binlog 将日志同步至下游 Kafka 中 没有开启binlog

此话题已在最后回复的 60 天后被自动关闭。不再允许新回复。