https://github.com/pingcap/dm/issues/1845
我在github看到有人遇到同样的问题,不知道是不是这个原因造成的,帮忙看下,怎么修改
[2021/12/21 17:13:43.461 +08:00] [INFO] [syncer.go:1699] [“deadline exceeded when fetching binlog event”] [task=test-mysql-8] [unit=“binlog replication”]
[2021/12/21 17:13:43.461 +08:00] [ERROR] [streamer_controller.go:259] [“meet error when get binlog event”] [task=test-mysql-8] [unit=“binlog replication”] [error=“io.CopyN failed. err read tcp 10.10.10.247:54864->xxx.xxx.xxx.xxx:3306: i/o timeout, copied 13582336, expected 16777215: connection was bad”] [errorVerbose=“connection was bad\ngithub.com/go-mysql-org/go-mysql/mysql.init\
\t/nfs/cache/mod/github.com/go-mysql-org/go-mysql@v1.1.3-0.20210705101833-83965e516929/mysql/error.go:10\
runtime.doInit\
\t/usr/local/go/src/runtime/proc.go:6309\
runtime.doInit\
\t/usr/local/go/src/runtime/proc.go:6286\
runtime.doInit\
\t/usr/local/go/src/runtime/proc.go:6286\
runtime.doInit\
\t/usr/local/go/src/runtime/proc.go:6286\
runtime.main\
\t/usr/local/go/src/runtime/proc.go:208\
runtime.goexit\
\t/usr/local/go/src/runtime/asm_amd64.s:1371\
io.CopyN failed. err read tcp 10.10.10.247:54864->xxx.xxx.xxx.xxx:3306: i/o timeout, copied 13582336, expected 16777215\ngithub.com/go-mysql-org/go-mysql/packet.(*Conn).ReadPacketTo\
\t/nfs/cache/mod/github.com/go-mysql-org/go-mysql@v1.1.3-0.20210705101833-83965e516929/packet/conn.go:151\ngithub.com/go-mysql-org/go-mysql/packet.(*Conn).ReadPacketReuseMem\
\t/nfs/cache/mod/github.com/go-mysql-org/go-mysql@v1.1.3-0.20210705101833-83965e516929/packet/conn.go:98\ngithub.com/go-mysql-org/go-mysql/packet.(*Conn).ReadPacket\
\t/nfs/cache/mod/github.com/go-mysql-org/go-mysql@v1.1.3-0.20210705101833-83965e516929/packet/conn.go:90\ngithub.com/go-mysql-org/go-mysql/replication.(*BinlogSyncer).onStream\
\t/nfs/cache/mod/github.com/go-mysql-org/go-mysql@v1.1.3-0.20210705101833-83965e516929/replication/binlogsyncer.go:662\
runtime.goexit\
\t/usr/local/go/src/runtime/asm_amd64.s:1371”]
[2021/12/21 17:13:43.461 +08:00] [ERROR] [syncer.go:1712] [“fail to fetch binlog”] [task=test-mysql-8] [unit=“binlog replication”] [error=“io.CopyN failed. err read tcp 10.10.10.247:54864->xxx.xxx.xxx.xxx:3306: i/o timeout, copied 13582336, expected 16777215: connection was bad”]
[2021/12/21 17:13:43.462 +08:00] [INFO] [syncer.go:1119] [“flushed checkpoint”] [task=test-mysql-8] [unit=“binlog replication”] [checkpoint=“position: (mysql-bin.000002, 196486313), gtid-set: (flushed position: (mysql-bin.000002, 196486313), gtid-set: )”]
[2021/12/21 17:13:43.462 +08:00] [INFO] [syncer.go:1127] [“after last flushing checkpoint, DM has ignored row changes by expression filter”] [task=test-mysql-8] [unit=“binlog replication”] [“number of filtered insert”=0] [“number of filtered update”=0] [“number of filtered delete”=0]
[2021/12/21 17:13:43.462 +08:00] [INFO] [syncer.go:1602] [“flush checkpoints when exit task”] [task=test-mysql-8] [unit=“binlog replication”]
[2021/12/21 17:13:43.468 +08:00] [ERROR] [syncer.go:2901] [“fail to get master status”] [task=test-mysql-8] [unit=“binlog replication”] [error="[code=10001:class=database:scope=not-set:level=high], Message: database driver error, RawCause: context canceled, Workaround: Please check the database connection and the database config in configuration file."]
[2021/12/21 17:13:43.468 +08:00] [INFO] [syncer.go:2912] [“binlog replication status”] [task=test-mysql-8] [unit=“binlog replication”] [total_events=343623] [total_tps=5727] [tps=0] [master_position="(, 0)"] [master_gtid=NULL] [checkpoint=“position: (mysql-bin.000002, 196486313), gtid-set: (flushed position: (mysql-bin.000002, 196486313), gtid-set: )”]
[2021/12/21 17:13:43.468 +08:00] [INFO] [syncer.go:2854] [“print status routine exits”] [task=test-mysql-8] [unit=“binlog replication”] [error=“context canceled”]
[2021/12/21 17:13:44.304 +08:00] [INFO] [subtask.go:292] [“unit process returned”] [subtask=test-mysql-8] [unit=Sync] [stage=Paused] [status="{“totalEvents”:343623,“totalTps”:5727,“syncerBinlog”:"(mysql-bin.000002, 196486313)",“binlogType”:“remote”}"]
[2021/12/21 17:13:44.304 +08:00] [ERROR] [subtask.go:311] [“unit process error”] [subtask=test-mysql-8] [unit=Sync] [“error information”="{“ErrCode”:36069,“ErrClass”:“sync-unit”,“ErrScope”:“upstream”,“ErrLevel”:“high”,“Message”:“get binlog event error: io.CopyN failed. err read tcp 10.10.10.247:54864-\u003exxx.xxx.xxx.xxx:3306: i/o timeout, copied 13582336, expected 16777215: connection was bad”,“Workaround”:“Please check if the binlog file could be parsed by mysqlbinlog
.”}"]
[2021/12/21 17:13:46.148 +08:00] [WARN] [task_checker.go:393] [“backoff skip auto resume task”] [component=“task checker”] [task=test-mysql-8] [latestResumeTime=2021/12/21 17:12:41.149 +08:00] [duration=5m0s]
【 TiDB 使用环境】
【概述】 场景 + 问题概述
【备份和数据迁移策略逻辑】
【背景】 做过哪些操作
【现象】 业务和数据库现象
【问题】 当前遇到的问题
【业务影响】
【TiDB 版本】
有些信息反馈不完整,请补充一下。
dm版本:2.0.3、mysql: 8.0.22、tidb: 5.0.3
问题: 使用DM增量同步mysql8 数据异常报错
可以看下我这个帖子:dm同步 worker 中异常报错 i/o timeout
这个 sop 参考一下看看
此话题已在最后回复的 1 分钟后被自动关闭。不再允许新回复。