【概述】 场景 + 问题概述
TiCDC新增任务:将新增数据写入pulsar
配置如下:
tiup cdc cli changefeed create
–pd=http://192.168.56.103:2379
–sink-uri=“pulsar://192.168.56.103:6650/ticdc_incrementdata_pvuv?connectionTimeout=10s&disableBatching=false”
–changefeed-id=“ticdc-pulsar”
在linux命令行能看到ticdc将新增数据写入pulsar主题如下:
key:[M{“ts”:431542952384266243,“scm”:“samp_db”,“tbl”:“pageviews_day”,“rid”:3,“t”:1}], properties:[protocol=0, schema=samp_db, table=pageviews_day, ts=431542952384266243, type=1], content:�{“u”:{“daytime”:{“t”:15,“h”:true,“f”:26,“v”:“2022-12-30”},“pv”:{“t”:3,“f”:65,“v”:99},“uv”:{“t”:3,“f”:65,“v”:6}},“p”:{“daytime”:{“t”:15,“h”:true,“f”:26,“v”:“2022-12-30”},“pv”:{“t”:3,“f”:65,“v”:98},“uv”:{“t”:3,“f”:65,“v”:6}}}
但是用idea代码消费这个主题只能拿到content:后面的部分,拿不到key部分的数据
代码如下:
Consumer consumer = pulsarClient.newConsumer()
.topic(“persistent://public/default/ticdc_incrementdata_pvuv”)
.subscriptionName(“my-subscription”)
.subscribe();
�{“u”:{“daytime”:{“t”:15,“h”:true,“f”:26,“v”:“2022-12-30”},“pv”:{“t”:3,“f”:65,“v”:98},“uv”:{“t”:3,“f”:65,“v”:6}},“p”:{“daytime”:{“t”:15,“h”:true,“f”:26,“v”:“2022-12-30”},“pv”:{“t”:3,“f”:65,“v”:97},“uv”:{“t”:3,“f”:65,“v”:6}}}
不知道原因
【TiDB 版本】
v5.3