为提高效率,提问时请提供以下信息,问题描述清晰可优先响应。
- 【TiDB 版本】:3.0.6
- 【问题描述】:使用 DM-Ansible 部署 DM 集群; 按文档是操作的执行到这一步的时候提示这些
看起来是配置文件不正,请提供一下配置文件及更多日志信息
好的,非常感谢
改过吗?现在应该正常了,现在执行结果还报错吗
执行结果还是报错
现在OK 了。谢谢
谢谢!
这是哪里的问题。是我哪里配置错了吗。上下游数据需要分配权限吗?
query-status + task 任务名,看下详细的报错内容或者看下 dm-worker 的日志也可以。有提供详细报错。
1.query-status + 任务名,上述截图中你这边后面跟的是配置文件,用法是错误的。请参考官方文档操作
https://pingcap.com/docs-cn/stable/reference/tools/data-migration/query-status/#dm-查询状态
2.报错显示该 deliveryapp 任务已存在,猜测是上面重复进行 start-task 导致。启动 task 任务后,如果 task 没有 stop,注意不要重复执行 start-task 的操作。启动后,如果有报错,需要根据报错情况对应解决问题。
将任务停止,重新启动测试一下。
日志在提供多一些,是同步上游 test_db 下的 test_table 表吗 ?检查下 用户是否有相关权限。
https://pingcap.com/docs-cn/stable/how-to/migrate/from-mysql/#mydumper--loader-全量导入数据最佳实践
是同步上游mariadb 的数据库到下游的TIDB数据库里,用户是否有相关权限 这个是在哪里设置。是要到上下游的数据库里么。
[2019/12/04 13:16:27.671 +08:00] [INFO] [server.go:410] [request=QueryWorkerConfig] [payload=]
[2019/12/04 13:16:27.701 +08:00] [INFO] [server.go:150] [request=StartSubTask] [payload=“task:“is-sharding = false
online-ddl-scheme = ””
case-sensitive = false
name = “deliveryapp”
mode = “all”
source-id = “mysql-replica-01”
server-id = 0
flavor = ""
meta-schema = “dm_meta”
remove-meta = false
disable-heartbeat = true
heartbeat-update-interval = 1
heartbeat-report-interval = 10
enable-heartbeat = false
timezone = ""
binlog-type = “local”
relay-dir = ""
route-rules = []
filter-rules = []
mapping-rule = []
mydumper-path = "./bin/mydumper"
threads = 4
chunk-filesize = 64
skip-tz-utc = true
extra-args = "-B test_db -T test_table"
pool-size = 16
dir = "./dumped_data.deliveryapp"
meta-file = ""
worker-count = 16
batch = 100
max-retry = 0
auto-fix-gtid = false
enable-gtid = false
disable-detect = false
safe-mode = false
enable-ansi-quotes = false
log-level = ""
log-file = ""
log-rotate = ""
pprof-addr = ""
status-addr = ""
[from]
host = “192.168.90.226”
port = 3306
user = “root”
password = “01eQHeFcyGPI5o6ympX6TkDvL0p0yw5IgROq”
max-allowed-packet = 67108864
[to]
host = “192.168.90.229”
port = 4000
user = “root”
password = “zypOdn+blMoJ5fu2V9yp9UDuv2/sfKPVSzZy2a9yRQH4GVgxIcE=”
max-allowed-packet = 67108864
[black-white-list]
[[black-white-list.do-tables]]
db-name = “deliveryapp”
tbl-name = “delivery_dtl”
" “]
[2019/12/04 13:16:27.705 +08:00] [INFO] [worker.go:313] [“operate subtask”] [component=“worker controller”] [operation=Start] [task=deliveryapp]
[2019/12/04 13:16:27.705 +08:00] [INFO] [server.go:227] [request=QueryTaskOperation] [payload=“name:“deliveryapp” logID:62 “]
[2019/12/04 13:16:28.677 +08:00] [INFO] [worker.go:792] [“start to execute operation”] [component=“worker controller”] [oplog=”{“id”:62,“task”:{“op”:4,“name”:“deliveryapp”,“task”:“aXMtc2hhcmRpbmcgPSBmYWxzZQpvbmxpbmUtZGRsLXNjaGVtZSA9ICIiCmNhc2Utc2Vuc2l0aXZlID0gZmFsc2UKbmFtZSA9ICJkZWxpdmVyeWFwcCIKbW9kZSA9ICJhbGwiCnNvdXJjZS1pZCA9ICJteXNxbC1yZXBsaWNhLTAxIgpzZXJ2ZXItaWQgPSAxMDEKZmxhdm9yID0gIm15c3FsIgptZXRhLXNjaGVtYSA9ICJkbV9tZXRhIgpyZW1vdmUtbWV0YSA9IGZhbHNlCmRpc2FibGUtaGVhcnRiZWF0ID0gdHJ1ZQpoZWFydGJlYXQtdXBkYXRlLWludGVydmFsID0gMQpoZWFydGJlYXQtcmVwb3J0LWludGVydmFsID0gMTAKZW5hYmxlLWhlYXJ0YmVhdCA9IGZhbHNlCnRpbWV6b25lID0gIiIKYmlubG9nLXR5cGUgPSAibG9jYWwiCnJlbGF5LWRpciA9ICIvaG9tZS90aWRiL2RlcGxveS9yZWxheV9sb2ciCnJvdXRlLXJ1bGVzID0gW10KZmlsdGVyLXJ1bGVzID0gW10KbWFwcGluZy1ydWxlID0gW10KbXlkdW1wZXItcGF0aCA9ICIuL2Jpbi9teWR1bXBlciIKdGhyZWFkcyA9IDQKY2h1bmstZmlsZXNpemUgPSA2NApza2lwLXR6LXV0YyA9IHRydWUKZXh0cmEtYXJncyA9ICItQiB0ZXN0X2RiIC1UIHRlc3RfdGFibGUiCnBvb2wtc2l6ZSA9IDE2CmRpciA9ICIuL2R1bXBlZF9kYXRhLmRlbGl2ZXJ5YXBwIgptZXRhLWZpbGUgPSAiIgp3b3JrZXItY291bnQgPSAxNgpiYXRjaCA9IDEwMAptYXgtcmV0cnkgPSAwCmF1dG8tZml4LWd0aWQgPSBmYWxzZQplbmFibGUtZ3RpZCA9IGZhbHNlCmRpc2FibGUtZGV0ZWN0ID0gZmFsc2UKc2FmZS1tb2RlID0gZmFsc2UKZW5hYmxlLWFuc2ktcXVvdGVzID0gZmFsc2UKbG9nLWxldmVsID0gImluZm8iCmxvZy1maWxlID0gIi9ob21lL3RpZGIvZGVwbG95L2xvZy9kbS13b3JrZXIubG9nIgpsb2ctcm90YXRlID0gIiIKcHByb2YtYWRkciA9ICIiCnN0YXR1cy1hZGRyID0gIiIKCltmcm9tXQogIGhvc3QgPSAiMTkyLjE2OC45MC4yMjYiCiAgcG9ydCA9IDMzMDYKICB1c2VyID0gInJvb3QiCiAgcGFzc3dvcmQgPSAiMDFlUUhlRmN5R1BJNW82eW1wWDZUa0R2TDBwMHl3NUlnUk9xIgogIG1heC1hbGxvd2VkLXBhY2tldCA9IDY3MTA4ODY0CgpbdG9dCiAgaG9zdCA9ICIxOTIuMTY4LjkwLjIyOSIKICBwb3J0ID0gNDAwMAogIHVzZXIgPSAicm9vdCIKICBwYXNzd29yZCA9ICJ6eXBPZG4rYmxNb0o1ZnUyVjl5cDlVRHV2Mi9zZktQVlN6WnkyYTl5UlFINEdWZ3hJY0U9IgogIG1heC1hbGxvd2VkLXBhY2tldCA9IDY3MTA4ODY0CgpbYmxhY2std2hpdGUtbGlzdF0KCiAgW1tibGFjay13aGl0ZS1saXN0LmRvLXRhYmxlc11dCiAgICBkYi1uYW1lID0gImRlbGl2ZXJ5YXBwIgogICAgdGJsLW5hbWUgPSAiZGVsaXZlcnlfZHRsIgo=”},“ts”:1575436587704760423}”]
[2019/12/04 13:16:28.681 +08:00] [INFO] [worker.go:829] [“started sub task”] [component=“worker controller”] [config=”{“is-sharding”:false,“online-ddl-scheme”:"",“case-sensitive”:false,“name”:“deliveryapp”,“mode”:“all”,“ignore-checking-items”:null,“source-id”:“mysql-replica-01”,“server-id”:101,“flavor”:“mysql”,“meta-schema”:“dm_meta”,“remove-meta”:false,“disable-heartbeat”:true,“heartbeat-update-interval”:1,“heartbeat-report-interval”:10,“enable-heartbeat”:false,“meta”:null,“Timezone”:"",“binlog-type”:“local”,“relay-dir”:"/home/tidb/deploy/relay_log",“from”:{“host”:“192.168.90.226”,“port”:3306,“user”:“root”,“max-allowed-packet”:67108864},“to”:{“host”:“192.168.90.229”,“port”:4000,“user”:“root”,“max-allowed-packet”:67108864},“route-rules”:[],“filter-rules”:[],“mapping-rule”:[],“black-white-list”:{“do-tables”:[{“db-name”:“deliveryapp”,“tbl-name”:“delivery_dtl”}],“do-dbs”:null,“ignore-tables”:null,“ignore-dbs”:null},“mydumper-path”:"./bin/mydumper",“threads”:4,“chunk-filesize”:64,“skip-tz-utc”:true,“extra-args”:"-B test_db -T test_table",“pool-size”:16,“dir”:"./dumped_data.deliveryapp",“meta-file”:"",“worker-count”:16,“batch”:100,“max-retry”:0,“auto-fix-gtid”:false,“enable-gtid”:false,“disable-detect”:false,“safe-mode”:false,“enable-ansi-quotes”:false,“log-level”:“info”,“log-file”:"/home/tidb/deploy/log/dm-worker.log",“log-rotate”:"",“pprof-addr”:"",“status-addr”:"",“config-file”:""}"]
[2019/12/04 13:16:28.682 +08:00] [WARN] [syncer.go:2474] [“use system default time location”] [task=deliveryapp] [unit=“binlog replication”]
[2019/12/04 13:16:28.682 +08:00] [INFO] [syncer.go:2476] [“use timezone”] [task=deliveryapp] [unit=“binlog replication”] [location=Local]
[2019/12/04 13:16:28.682 +08:00] [INFO] [mydumper.go:276] [“create mydumper”] [task=deliveryapp] [unit=dump] [argument="[–host,192.168.90.226,–port,3306,–user,root,–outputdir,./dumped_data.deliveryapp,–logfile,/dev/stderr,–verbose,3,–threads,4,–chunk-filesize,64,–skip-tz-utc,-B,test_db,-T,test_table]"]
[2019/12/04 13:16:28.707 +08:00] [INFO] [server.go:227] [request=QueryTaskOperation] [payload=“name:“deliveryapp” logID:62 “]
[2019/12/04 13:16:28.770 +08:00] [INFO] [checkpoint.go:472] [“create checkpoint schema”] [task=deliveryapp] [unit=“binlog replication”] [component=“remote checkpoint”] [statement=“CREATE SCHEMA IF NOT EXISTS dm_meta
“]
[2019/12/04 13:16:28.772 +08:00] [INFO] [checkpoint.go:491] [“create checkpoint table”] [task=deliveryapp] [unit=“binlog replication”] [component=“remote checkpoint”] [statement=“CREATE TABLE IF NOT EXISTS dm_meta
.deliveryapp_syncer_checkpoint
(
id VARCHAR(32) NOT NULL,
cp_schema VARCHAR(128) NOT NULL,
cp_table VARCHAR(128) NOT NULL,
binlog_name VARCHAR(128),
binlog_pos INT UNSIGNED,
is_global BOOLEAN,
create_time timestamp NOT NULL DEFAULT CURRENT_TIMESTAMP,
update_time timestamp NOT NULL DEFAULT CURRENT_TIMESTAMP ON UPDATE CURRENT_TIMESTAMP,
UNIQUE KEY uk_id_schema_table (id, cp_schema, cp_table)
)”]
[2019/12/04 13:16:28.776 +08:00] [INFO] [relay.go:89] [“current earliest active relay log”] [task=deliveryapp] [unit=“binlog replication”] [“active relay log”=.000001/master-bin.000014]
[2019/12/04 13:16:28.779 +08:00] [INFO] [subtask.go:191] [“start to run”] [subtask=deliveryapp] [unit=Dump]
[2019/12/04 13:16:28.779 +08:00] [INFO] [worker.go:883] [“end to execute operation”] [component=“worker controller”] [“oplog ID”=62] []
[2019/12/04 13:16:28.863 +08:00] [INFO] [mydumper.go:158] [“Server version reported as: 5.5.5-10.3.10-MariaDB-log”] [task=deliveryapp] [unit=dump]
[2019/12/04 13:16:28.863 +08:00] [INFO] [mydumper.go:158] [“Selecting database: test_db”] [task=deliveryapp] [unit=dump]
[2019/12/04 13:16:28.863 +08:00] [INFO] [mydumper.go:158] [“Connected to a MySQL server”] [task=deliveryapp] [unit=dump]
[2019/12/04 13:16:28.865 +08:00] [INFO] [mydumper.go:158] [“Started dump at: 2019-12-04 13:16:28”] [task=deliveryapp] [unit=dump]
[2019/12/04 13:16:28.866 +08:00] [INFO] [mydumper.go:158] [“Written master status”] [task=deliveryapp] [unit=dump]
[2019/12/04 13:16:28.866 +08:00] [INFO] [mydumper.go:158] [“Multisource slave detected.”] [task=deliveryapp] [unit=dump]
[2019/12/04 13:16:28.867 +08:00] [INFO] [mydumper.go:158] [“Thread 1 connected using MySQL connection ID 144145”] [task=deliveryapp] [unit=dump]
[2019/12/04 13:16:28.869 +08:00] [INFO] [mydumper.go:158] [“Thread 2 connected using MySQL connection ID 144146”] [task=deliveryapp] [unit=dump]
[2019/12/04 13:16:28.871 +08:00] [INFO] [mydumper.go:158] [“Thread 3 connected using MySQL connection ID 144147”] [task=deliveryapp] [unit=dump]
[2019/12/04 13:16:28.872 +08:00] [INFO] [mydumper.go:158] [“Thread 4 connected using MySQL connection ID 144148”] [task=deliveryapp] [unit=dump]
[2019/12/04 13:16:28.874 +08:00] [ERROR] [mydumper.go:164] [“Error: DB: test_db - Could not execute query: No database selected”] [task=deliveryapp] [unit=dump]
[2019/12/04 13:16:28.874 +08:00] [ERROR] [mydumper.go:164] [“Error dumping create database (test_db): Unknown database ‘test_db’”] [task=deliveryapp] [unit=dump]
[2019/12/04 13:16:28.874 +08:00] [INFO] [mydumper.go:158] [“Non-InnoDB dump complete, unlocking tables”] [task=deliveryapp] [unit=dump]
[2019/12/04 13:16:28.874 +08:00] [INFO] [mydumper.go:158] [“Thread 3 shutting down”] [task=deliveryapp] [unit=dump]
[2019/12/04 13:16:28.874 +08:00] [INFO] [mydumper.go:158] [“Thread 1 shutting down”] [task=deliveryapp] [unit=dump]
[2019/12/04 13:16:28.874 +08:00] [INFO] [mydumper.go:158] [“Thread 4 shutting down”] [task=deliveryapp] [unit=dump]
[2019/12/04 13:16:28.874 +08:00] [INFO] [mydumper.go:158] [“Thread 2 shutting down”] [task=deliveryapp] [unit=dump]
[2019/12/04 13:16:28.874 +08:00] [INFO] [mydumper.go:158] [“Finished dump at: 2019-12-04 13:16:28”] [task=deliveryapp] [unit=dump]
[2019/12/04 13:16:28.875 +08:00] [INFO] [mydumper.go:114] [“dump data finished”] [task=deliveryapp] [unit=dump] [“cost time”=95.053563ms]
[2019/12/04 13:16:28.875 +08:00] [INFO] [subtask.go:233] [“unit process returned”] [subtask=deliveryapp] [unit=Dump] [stage=Paused] [status={}]
[2019/12/04 13:16:28.875 +08:00] [ERROR] [subtask.go:252] [“unit process error”] [subtask=deliveryapp] [unit=Dump] [“error information”=”{“msg”:”[code=32001:class=dump-unit:scope=internal:level=high] mydumper runs with error: exit status 1.
”}”]
[2019/12/04 13:16:29.677 +08:00] [WARN] [task_checker.go:354] [“backoff skip auto resume task”] [component=“task checker”] [task=deliveryapp] [latestResumeTime=2019/12/04 13:16:29.677 +08:00] [duration=1s]
[2019/12/04 13:16:29.709 +08:00] [INFO] [server.go:227] [request=QueryTaskOperation] [payload=“name:“deliveryapp” logID:62 “]
[2019/12/04 13:16:32.556 +08:00] [INFO] [server.go:250] [request=QueryStatus] [payload=“name:“deliveryapp” “]
[2019/12/04 13:16:34.677 +08:00] [INFO] [worker.go:313] [“operate subtask”] [component=“worker controller”] [operation=AutoResume] [task=deliveryapp]
[2019/12/04 13:16:34.677 +08:00] [INFO] [task_checker.go:365] [“dispatch auto resume task”] [component=“task checker”] [task=deliveryapp] [opLogID=63]
[2019/12/04 13:16:34.677 +08:00] [INFO] [purger.go:243] [“checking whether needing to purge relay log files”] [component=“relay purger”]
[2019/12/04 13:16:35.677 +08:00] [INFO] [worker.go:792] [“start to execute operation”] [component=“worker controller”] [oplog=”{“id”:63,“task”:{“op”:6,“name”:“deliveryapp”},“ts”:1575436594677387292}”]
[2019/12/04 13:16:35.677 +08:00] [INFO] [worker.go:879] [“auto_resume sub task”] [component=“worker controller”] [task=deliveryapp]
[2019/12/04 13:16:35.677 +08:00] [INFO] [subtask.go:430] [“resume with unit”] [subtask=deliveryapp] [unit=Dump]
[2019/12/04 13:16:35.677 +08:00] [INFO] [worker.go:883] [“end to execute operation”] [component=“worker controller”] [“oplog ID”=63] []
[2019/12/04 13:16:35.839 +08:00] [INFO] [mydumper.go:158] [“Server version reported as: 5.5.5-10.3.10-MariaDB-log”] [task=deliveryapp] [unit=dump]
[2019/12/04 13:16:35.839 +08:00] [INFO] [mydumper.go:158] [“Selecting database: test_db”] [task=deliveryapp] [unit=dump]
[2019/12/04 13:16:35.840 +08:00] [INFO] [mydumper.go:158] [“Connected to a MySQL server”] [task=deliveryapp] [unit=dump]
[2019/12/04 13:16:35.841 +08:00] [INFO] [mydumper.go:158] [“Started dump at: 2019-12-04 13:16:35”] [task=deliveryapp] [unit=dump]
[2019/12/04 13:16:35.842 +08:00] [INFO] [mydumper.go:158] [“Written master status”] [task=deliveryapp] [unit=dump]
[2019/12/04 13:16:35.842 +08:00] [INFO] [mydumper.go:158] [“Multisource slave detected.”] [task=deliveryapp] [unit=dump]
[2019/12/04 13:16:35.843 +08:00] [INFO] [mydumper.go:158] [“Thread 1 connected using MySQL connection ID 144152”] [task=deliveryapp] [unit=dump]
[2019/12/04 13:16:35.849 +08:00] [INFO] [mydumper.go:158] [“Thread 2 connected using MySQL connection ID 144153”] [task=deliveryapp] [unit=dump]
[2019/12/04 13:16:35.851 +08:00] [INFO] [mydumper.go:158] [“Thread 3 connected using MySQL connection ID 144154”] [task=deliveryapp] [unit=dump]
[2019/12/04 13:16:35.852 +08:00] [INFO] [mydumper.go:158] [“Thread 4 connected using MySQL connection ID 144155”] [task=deliveryapp] [unit=dump]
[2019/12/04 13:16:35.854 +08:00] [ERROR] [mydumper.go:164] [“Error: DB: test_db - Could not execute query: No database selected”] [task=deliveryapp] [unit=dump]
[2019/12/04 13:16:35.854 +08:00] [ERROR] [mydumper.go:164] [“Error dumping create database (test_db): Unknown database ‘test_db’”] [task=deliveryapp] [unit=dump]
[2019/12/04 13:16:35.854 +08:00] [INFO] [mydumper.go:158] [“Non-InnoDB dump complete, unlocking tables”] [task=deliveryapp] [unit=dump]
[2019/12/04 13:16:35.854 +08:00] [INFO] [mydumper.go:158] [“Thread 1 shutting down”] [task=deliveryapp] [unit=dump]
[2019/12/04 13:16:35.854 +08:00] [INFO] [mydumper.go:158] [“Thread 2 shutting down”] [task=deliveryapp] [unit=dump]
[2019/12/04 13:16:35.855 +08:00] [INFO] [mydumper.go:158] [“Thread 3 shutting down”] [task=deliveryapp] [unit=dump]
[2019/12/04 13:16:35.855 +08:00] [INFO] [mydumper.go:158] [“Thread 4 shutting down”] [task=deliveryapp] [unit=dump]
[2019/12/04 13:16:35.855 +08:00] [INFO] [mydumper.go:158] [“Finished dump at: 2019-12-04 13:16:35”] [task=deliveryapp] [unit=dump]
[2019/12/04 13:16:35.855 +08:00] [INFO] [mydumper.go:114] [“dump data finished”] [task=deliveryapp] [unit=dump] [“cost time”=171.760925ms]
[2019/12/04 13:16:35.855 +08:00] [INFO] [subtask.go:233] [“unit process returned”] [subtask=deliveryapp] [unit=Dump] [stage=Paused] [status={}]
[2019/12/04 13:16:35.855 +08:00] [ERROR] [subtask.go:252] [“unit process error”] [subtask=deliveryapp] [unit=Dump] [“error information”=”{“msg”:”[code=32001:class=dump-unit:scope=internal:level=high] mydumper runs with error: exit status 1.
"}"]
[2019/12/04 13:16:39.678 +08:00] [INFO] [worker.go:313] [“operate subtask”] [component=“worker controller”] [operation=AutoResume] [task=deliveryapp]
[2019/12/04 13:16:39.678 +08:00] [INFO] [worker.go:792] [“start to execute operation”] [component=“worker controller”] [oplog="{“id”:64,“task”:{“op”:6,“name”:“deliveryapp”},“ts”:1575436599677730226}"]
[2019/12/04 13:16:39.678 +08:00] [INFO] [task_checker.go:365] [“dispatch auto resume task”] [component=“task checker”] [task=deliveryapp] [opLogID=64]
[2019/12/04 13:16:39.678 +08:00] [INFO] [worker.go:879] [“auto_resume sub task”] [component=“worker controller”] [task=deliveryapp]
[2019/12/04 13:16:39.678 +08:00] [INFO] [subtask.go:430] [“resume with unit”] [subtask=deliveryapp] [unit=Dump]
[2019/12/04 13:16:39.678 +08:00] [INFO] [worker.go:883] [“end to execute operation”] [component=“worker controller”] [“oplog ID”=64] []
[2019/12/04 13:16:39.691 +08:00] [INFO] [mydumper.go:158] [“Server version reported as: 5.5.5-10.3.10-MariaDB-log”] [task=deliveryapp] [unit=dump]
[2019/12/04 13:16:39.691 +08:00] [INFO] [mydumper.go:158] [“Selecting database: test_db”] [task=deliveryapp] [unit=dump]
[2019/12/04 13:16:39.691 +08:00] [INFO] [mydumper.go:158] [“Connected to a MySQL server”] [task=deliveryapp] [unit=dump]
[2019/12/04 13:16:39.694 +08:00] [INFO] [mydumper.go:158] [“Started dump at: 2019-12-04 13:16:39”] [task=deliveryapp] [unit=dump]
[2019/12/04 13:16:39.694 +08:00] [INFO] [mydumper.go:158] [“Written master status”] [task=deliveryapp] [unit=dump]
[2019/12/04 13:16:39.695 +08:00] [INFO] [mydumper.go:158] [“Multisource slave detected.”] [task=deliveryapp] [unit=dump]
[2019/12/04 13:16:39.697 +08:00] [INFO] [mydumper.go:158] [“Thread 1 connected using MySQL connection ID 144157”] [task=deliveryapp] [unit=dump]
[2019/12/04 13:16:39.700 +08:00] [INFO] [mydumper.go:158] [“Thread 2 connected using MySQL connection ID 144158”] [task=deliveryapp] [unit=dump]
[2019/12/04 13:16:39.707 +08:00] [INFO] [mydumper.go:158] [“Thread 3 connected using MySQL connection ID 144159”] [task=deliveryapp] [unit=dump]
[2019/12/04 13:16:39.710 +08:00] [INFO] [mydumper.go:158] [“Thread 4 connected using MySQL connection ID 144160”] [task=deliveryapp] [unit=dump]
[2019/12/04 13:16:39.711 +08:00] [ERROR] [mydumper.go:164] [“Error: DB: test_db - Could not execute query: No database selected”] [task=deliveryapp] [unit=dump]
[2019/12/04 13:16:39.711 +08:00] [ERROR] [mydumper.go:164] [“Error dumping create database (test_db): Unknown database ‘test_db’”] [task=deliveryapp] [unit=dump]
[2019/12/04 13:16:39.711 +08:00] [INFO] [mydumper.go:158] [“Non-InnoDB dump complete, unlocking tables”] [task=deliveryapp] [unit=dump]
[2019/12/04 13:16:39.712 +08:00] [INFO] [mydumper.go:158] [“Thread 2 shutting down”] [task=deliveryapp] [unit=dump]
[2019/12/04 13:16:39.712 +08:00] [INFO] [mydumper.go:158] [“Thread 1 shutting down”] [task=deliveryapp] [unit=dump]
[2019/12/04 13:16:39.712 +08:00] [INFO] [mydumper.go:158] [“Thread 3 shutting down”] [task=deliveryapp] [unit=dump]
[2019/12/04 13:16:39.712 +08:00] [INFO] [mydumper.go:158] [“Thread 4 shutting down”] [task=deliveryapp] [unit=dump]
[2019/12/04 13:16:39.713 +08:00] [INFO] [mydumper.go:158] [“Finished dump at: 2019-12-04 13:16:39”] [task=deliveryapp] [unit=dump]
[2019/12/04 13:16:39.713 +08:00] [INFO] [mydumper.go:114] [“dump data finished”] [task=deliveryapp] [unit=dump] [“cost time”=34.255932ms]
[2019/12/04 13:16:39.713 +08:00] [INFO] [subtask.go:233] [“unit process returned”] [subtask=deliveryapp] [unit=Dump] [stage=Paused] [status={}]
[2019/12/04 13:16:39.713 +08:00] [ERROR] [subtask.go:252] [“unit process error”] [subtask=deliveryapp] [unit=Dump] [“error information”="{“msg”:"[code=32001:class=dump-unit:scope=internal:level=high] mydumper runs with error: exit status 1.
"}"]
检查下 上游数据库是否存在 test_db 库,上面的报错就是 dump 失败的原因。
另外补充下,mydumper 的参数是上面 task 配置中 extra-args 中配置有 test_db 库,可以对应修改下,指定需要 dump 的数据库以及表。
在 dm-worker 中配置的上游数据库的账号密码,需要确保有对应的权限。