dm同步数据卡在load阶段

🪐 TiDB 技术问题 备份&数据迁移
1

为提高效率，提问时请提供以下信息，问题描述清晰可优先响应。

  • 【TiDB 版本】：4.0
  • 【问题描述】： [2020/05/21 16:12:12.645 +08:00] [INFO] [loader.go:1111] [“start to create schema”] [task=test] [unit=load] [“schema file”=./dumped_data.test/user_center_data_sz-schema-create.sql] [2020/05/21 16:12:15.275 +08:00] [INFO] [relay.go:568] [“flush meta finished”] [component=“relay log”] [meta=“master-uuid = d54489bd-206a-11ea-b9e2-001a4a16014b.000001, relay-binlog = (mysql-bin.000150, 38386737), relay-binlog-gtid = a2ffc533-b91a-11e9-bcac-1866daea8e90:1-15,d54489bd-206a-11ea-b9e2-001a4a16014b:1-53531,f64f75a3-46dd-ee16-6095-849e0f747c96:1-283286488”] [2020/05/21 16:12:17.636 +08:00] [INFO] [status.go:75] [“progress status of load”] [task=test] [unit=load] [finished_bytes=0] [total_bytes=91487223140] [total_file_count=1877] [progress=“0.00 %”] [2020/05/21 16:12:22.636 +08:00] [INFO] [status.go:75] [“progress status of load”] [task=test] [unit=load] [finished_bytes=0] [total_bytes=91487223140] [total_file_count=1877] [progress=“0.00 %”] [2020/05/21 16:12:27.636 +08:00] [INFO] [status.go:75] [“progress status of load”] [task=test] [unit=load] [finished_bytes=0] [total_bytes=91487223140] [total_file_count=1877] [progress=“0.00 %”] [2020/05/21 16:12:32.636 +08:00] [INFO] [status.go:75] [“progress status of load”] [task=test] [unit=load] [finished_bytes=0] [total_bytes=91487223140] [total_file_count=1877] [progress=“0.00 %”]

query-status 查看状态runing 阶段load 已经12小时了 progress还是一直在0.00%

2

你好。麻烦提供下以下信息：

  1. 完整的 query-status {task-name} 的信息。
  2. 这个同步任务所在的 dm-worker 信息。
  3. 这个同步任务下游 TiDB 的日志信息。
3

1。» query-status test { “result”: true, “msg”: “”, “workers”: [ { “result”: true, “worker”: “10.3.5.121:8262”, “msg”: “”, “subTaskStatus”: [ { “name”: “test”, “stage”: “Running”, “unit”: “Load”, “result”: null, “unresolvedDDLLockID”: “”, “load”: { “finishedBytes”: “0”, “totalBytes”: “43112661273”, “progress”: “0.00 %”, “metaBinlog”: “(mysql-bin.000342, 688729670)” } } ], “relayStatus”: { “masterBinlog”: “(mysql-bin.000352, 48353969)”, “masterBinlogGtid”: “3b21a61a-a047-11e8-bec6-7cd30a58cb10:1-837393623,ba18c924-a046-11e8-9167-7cd30a53b644:1-29777269”, “relaySubDir”: “ba18c924-a046-11e8-9167-7cd30a53b644.000001”, “relayBinlog”: “(mysql-bin.000352, 48353969)”, “relayBinlogGtid”: “3b21a61a-a047-11e8-bec6-7cd30a58cb10:1-837393623,ba18c924-a046-11e8-9167-7cd30a53b644:1-29777269”, “relayCatchUpMaster”: true, “stage”: “Running”, “result”: null }, “sourceID”: “mysql-replica-01” }, { “result”: true, “worker”: “10.3.5.122:8262”, “msg”: “”, “subTaskStatus”: [ { “name”: “test”, “stage”: “Running”, “unit”: “Load”, “result”: null, “unresolvedDDLLockID”: “”, “load”: { “finishedBytes”: “0”, “totalBytes”: “91487223140”, “progress”: “0.00 %”, “metaBinlog”: “(mysql-bin.000150, 21524710)” } } ], “relayStatus”: { “masterBinlog”: “(mysql-bin.000150, 728401351)”, “masterBinlogGtid”: “d54489bd-206a-11ea-b9e2-001a4a16014b:1-121536,f64f75a3-46dd-ee16-6095-849e0f747c96:1-284268712,a2ffc533-b91a-11e9-bcac-1866daea8e90:1-15”, “relaySubDir”: “d54489bd-206a-11ea-b9e2-001a4a16014b.000001”, “relayBinlog”: “(mysql-bin.000150, 728401351)”, “relayBinlogGtid”: “a2ffc533-b91a-11e9-bcac-1866daea8e90:1-15,d54489bd-206a-11ea-b9e2-001a4a16014b:1-121536,f64f75a3-46dd-ee16-6095-849e0f747c96:1-284268712”, “relayCatchUpMaster”: true, “stage”: “Running”, “result”: null }, “sourceID”: “mysql-replica-02” } ] }

4

dm-worker.rar (261.2 KB) 2。

5
  1. tidb.rar (125.1 KB)
6

请问下 DM 这边使用的是什么版本。另外方便在 dm-worker 的配置加上 log-level = "debug" ,然后 dm-worker 再看看会不会卡住，如果卡住的话麻烦给下 debug 的日志再看看。

7

parse cmd flags err: flag provided but not defined: -v[tidb@idc-xhy-srv03 dm-ansible]$ ./dmctl/dmctl -V Release Version: v1.0.5 Git Commit Hash: a8e9f53f91e29756b09a22cdc37a6a6efcdfe55b Git Branch: release-1.0 UTC Build Time: 2020-04-27 06:56:31 Go Version: go version go1.13 linux/amd64

我需要尝试重启任务吗

8

修改日志级别之后重启 dm-worker ，然后再启动 task 看看。