为提高效率,提问时请提供以下信息,问题描述清晰可优先响应。
- 【TiDB 版本】:v4.0.5
- 【DM 版本】:v1.0.6
- 【问题描述】:
使用DM同步mysql5.7的数据到tidb, 经常报Region is unavailable, 然后中断同步。数据量不多,才40G, 写入的TPS也很低,才几十。
over view的监控如下, tomestone是我下线的5个tiflash, 因为join查询太慢了,都是返回tikv timeout, 不走tiflash, join查询走tikv是正常的
dm-work错误日志:
[2020/09/11 11:23:30.155 +08:00] [WARN] [syncer.go:626] [“something wrong with rollback global checkpoint”] [task=posbill_pro] [u
nit=“binlog replication”] [“previous position”=“(mysql-bin|000001.000047, 534433696)”] [“current position”=“(mysql-bin|000001.000
047, 530622622)”]
[2020/09/11 11:23:30.155 +08:00] [INFO] [subtask.go:266] [“unit process returned”] [subtask=posbill_pro] [unit=Sync] [stage=Pause
d] [status=“{"totalEvents":602447,"totalTps":20005,"recentTps":318,"masterBinlog":"(mysql-bin.000047, 534449467)","mas
terBinlogGtid":"9bc13467-10c0-11ea-8000-4cd98f7a2c00:1-3","syncerBinlog":"(mysql-bin|000001.000047, 530622622)"}”]
[2020/09/11 11:23:30.155 +08:00] [ERROR] [subtask.go:285] [“unit process error”] [subtask=posbill_pro] [unit=Sync] [“error inform
ation”=“{"Type":1,"msg":"execute statement failed: commit: Error 9005: Region is unavailable","error":{"ErrCode":10006,
"ErrClass":1,"ErrLevel":3,"Message":"execute statement failed: commit: Error 9005: Region is unavailable","RawCause":"
Error 9005: Region is unavailable"}}”]
[2020/09/11 11:23:30.155 +08:00] [ERROR] [subtask.go:285] [“unit process error”] [subtask=posbill_pro] [unit=Sync] [“error inform
ation”=“{"Type":1,"msg":"execute statement failed: commit: Error 9005: Region is unavailable","error":{"ErrCode":10006,
"ErrClass":1,"ErrLevel":3,"Message":"execute statement failed: commit: Error 9005: Region is unavailable","RawCause":"
Error 9005: Region is unavailable"}}”]
[2020/09/11 11:23:30.155 +08:00] [ERROR] [subtask.go:285] [“unit process error”] [subtask=posbill_pro] [unit=Sync] [“error inform
ation”=“{"Type":1,"msg":"execute statement failed: commit: Error 9005: Region is unavailable","error":{"ErrCode":10006,
"ErrClass":1,"ErrLevel":3,"Message":"execute statement failed: commit: Error 9005: Region is unavailable","RawCause":"
Error 9005: Region is unavailable"}}”]
[2020/09/11 11:23:30.155 +08:00] [ERROR] [subtask.go:285] [“unit process error”] [subtask=posbill_pro] [unit=Sync] [“error inform
ation”=“{"Type":1,"msg":"execute statement failed: commit: Error 9005: Region is unavailable","error":{"ErrCode":10006,
"ErrClass":1,"ErrLevel":3,"Message":"execute statement failed: commit: Error 9005: Region is unavailable","RawCause":"
Error 9005: Region is unavailable"}}”]
[2020/09/11 11:23:33.736 +08:00] [WARN] [task_checker.go:358] [“backoff skip auto resume task”] [component=“task checker”] [task=
posbill_pro] [latestResumeTime=2020/09/11 11:22:48.736 +08:00] [duration=5m0s]
[2020/09/11 11:23:38.736 +08:00] [WARN] [task_checker.go:358] [“backoff skip auto resume task”] [component=“task checker”] [task=
posbill_pro] [latestResumeTime=2020/09/11 11:22:48.736 +08:00] [duration=5m0s]
[2020/09/11 11:23:38.747 +08:00] [INFO] [relay.go:568] [“flush meta finished”] [component=“relay log”] [meta="master-uuid = 9bc13
467-10c0-11ea-8000-4cd98f7a2c00.000001, relay-binlog = (mysql-bin.000047, 534450771), relay-binlog-gtid = "]
[2020/09/11 11:23:43.736 +08:00] [WARN] [task_checker.go:358] [“backoff skip auto resume task”] [component=“task checker”] [task=
posbill_pro] [latestResumeTime=2020/09/11 11:22:48.736 +08:00] [duration=5m0s]
(END)