DM增量同步慢，积压

AskTUG水军头目 · 2021 年9 月 10 日 00:09

为提高效率，请提供以下信息，问题描述清晰能够更快得到解决：
【 TiDB 使用环境】
非业务生产系统，zabbix监控数据库

【概述】场景 + 问题概述
目前在做替换zabbix mariadb数据库的测试，全量同步导入后，用dm做增量导入，感觉追不上mariadb binlog的增加速度
【备份和数据迁移策略逻辑】
dumping全量导出，tidb-lightning全量导入，增量使用dm同步
【背景】做过哪些操作

【现象】业务和数据库现象

【问题】当前遇到的问题
使用dm的 query-status ，查看secondsBehindMaster 越来越大
【业务影响】
目前只影响数据迁移
【TiDB 版本】
4.0.14
【附件】
[tidb@esbprddb ~]$ tiup dmctl --master-addr 192.168.0.207:8261 query-status task-zabbix1
Starting component dmctl: /home/tidb/.tiup/components/dmctl/v2.0.6/dmctl/dmctl --master-addr 192.168.0.207:8261 query-status task-zabbix1
{
“result”: true,
“msg”: “”,
“sources”: [
{
“result”: true,
“msg”: “”,
“sourceStatus”: {
“source”: “mysql-02”,
“worker”: “dm-192.168.0.217-8262”,
“result”: null,
“relayStatus”: null
},
“subTaskStatus”: [
{
“name”: “task-zabbix1”,
“stage”: “Running”,
“unit”: “Sync”,
“result”: null,
“unresolvedDDLLockID”: “”,
“sync”: {
“totalEvents”: “36287919”,
“totalTps”: “25732”,
“recentTps”: “266”,
“masterBinlog”: “(mysql-bin.000010, 31387250)”,
“masterBinlogGtid”: “0-2-1736599”,
“syncerBinlog”: “(mysql-bin.000009, 503420399)”,
“syncerBinlogGtid”: “”,
“blockingDDLs”: [
],
“unresolvedGroups”: [
],
“synced”: false,
“binlogType”: “remote”,
“secondsBehindMaster”: “12143”
}
}
]
}
]
}

[tidb@esbprddb ~]$ tiup cluster display tidb-zabbix
Starting component cluster: /home/tidb/.tiup/components/cluster/v1.5.6/tiup-cluster display tidb-zabbix
Cluster type: tidb
Cluster name: tidb-zabbix
Cluster version: v4.0.14
Deploy user: tidb
SSH type: builtin
Dashboard URL: http://192.168.0.207:14279/dashboard
ID Role Host Ports OS/Arch Status Data Dir Deploy Dir

192.168.0.207:9794 alertmanager 192.168.0.207 9794/9795 linux/x86_64 Up /data/tidb-data/alertmanager-9794 /data/tidb-deploy/alertmanager-9794
192.168.0.216:13545 grafana 192.168.0.216 13545 linux/x86_64 Up - /data/tidb-deploy/grafana-13545
192.168.0.207:14279 pd 192.168.0.207 14279/14289 linux/x86_64 Up|UI /data/tidb-data/pd-14279 /data/tidb-deploy/pd-14279
192.168.0.216:14279 pd 192.168.0.216 14279/14289 linux/x86_64 Up /data/tidb-data/pd-14279 /data/tidb-deploy/pd-14279
192.168.0.217:14279 pd 192.168.0.217 14279/14289 linux/x86_64 Up|L /data/tidb-data/pd-14279 /data/tidb-deploy/pd-14279
192.168.0.217:19597 prometheus 192.168.0.217 19597 linux/x86_64 Up /data/tidb-data/prometheus-19597 /data/tidb-deploy/prometheus-19597
192.168.0.207:4643 tidb 192.168.0.207 4643/14583 linux/x86_64 Up - /data/tidb-deploy/tidb-4643
192.168.0.216:4643 tidb 192.168.0.216 4643/14583 linux/x86_64 Up - /data/tidb-deploy/tidb-4643
192.168.0.217:4643 tidb 192.168.0.217 4643/14583 linux/x86_64 Up - /data/tidb-deploy/tidb-4643
192.168.0.207:43641 tikv 192.168.0.207 43641/43644 linux/x86_64 Up /data/tidb-data/tikv-43641 /data/tidb-deploy/tikv-43641
192.168.0.216:43641 tikv 192.168.0.216 43641/43644 linux/x86_64 Up /data/tidb-data/tikv-43641 /data/tidb-deploy/tikv-43641
192.168.0.217:43641 tikv 192.168.0.217 43641/43644 linux/x86_64 Up /data/tidb-data/tikv-43641 /data/tidb-deploy/tikv-43641
Total nodes: 12