DM查询任务状态时有个出错

[code=32001:class=dump-unit:scope=internal:level=high] mydumper runs with error: exit status 1. option parsing failed: Invalid byte sequence in conversion input, try --help

请参考帖子先查下,多谢

系统中有中文的表名,task.yaml中需要怎么配置?

如果存在表名为中文,在DM中该如何配置?(整个库导入到TiDB)

我配置成这样还是这个错误

1.请问你的 tidb 和 dm 版本是多少? 2. 麻烦上传 dm-worker 日志,多谢。

TiDB 4.0
DM 1.0.5
dm-worker.log (354.5 KB)

日志中有句:“Tables needed to dump are not given, now we will start to generate table list that mydumper needs to dump through black-white list from given fromDB”

你好,

此日志信息为 task 中 mydumper 模块没有 table list,所以通过黑白名单进行配置,预期。

请反馈下 query-status 完整文本信息。看下同步状态,对于中文表名,线上规范不建议这样做,建议更改,尝试通过 mydumper -x 匹配看是否能解决,可以单独写 mydumper 的备份语句进行测试,否则只能修改表名来进行同步。

改成这个配置后报了另外一个错误:
%E9%85%8D%E7%BD%AE2

报错内容:[code=10005:class=database:scope=downstream:level=high] current pos (mysql-bin|000001.006838, 677292659): query statement failed: SHOW COLUMNS FROM kiddo.kid_follow_feed: Error 1146: Table ‘kiddo.kid_follow_feed’ doesn’t exist
github.com/pingcap/dm/pkg/terror.(*Error).Delegate
\t/home/jenkins/agent/workspace/build_dm_master/go/src/github.com/pingcap/dm/pkg/terror/terror.go:267
github.com/pingcap/dm/pkg/conn.(*BaseConn).QuerySQL
\t/home/jenkins/agent/workspace/build_dm_master/go/src/github.com/pingcap/dm/pkg/conn/baseconn.go:110
github.com/pingcap/dm/syncer.(*DBConn).querySQL.func2
\t/home/jenkins/agent/workspace/build_dm_master/go/src/github.com/pingcap/dm/syncer/db.go:204
github.com/pingcap/dm/pkg/retry.(*FiniteRetryStrategy).Apply
\t/home/jenkins/agent/workspace/build_dm_master/go/src/github.com/pingcap/dm/pkg/retry/strategy.go:71
github.com/pingcap/dm/pkg/conn.(*BaseConn).ApplyRetryStrategy
\t/home/jenkins/agent/workspace/build_dm_master/go/src/github.com/pingcap/dm/pkg/conn/baseconn.go:216
github.com/pingcap/dm/syncer.(*DBConn).querySQL
\t/home/jenkins/agent/workspace/build_dm_master/go/src/github.com/pingcap/dm/syncer/db.go:199
github.com/pingcap/dm/syncer.getTableColumns
\t/home/jenkins/agent/workspace/build_dm_master/go/src/github.com/pingcap/dm/syncer/db.go:395
github.com/pingcap/dm/syncer.(*Syncer).getTableFromDB
\t/home/jenkins/agent/workspace/build_dm_master/go/src/github.com/pingcap/dm/syncer/syncer.go:666
github.com/pingcap/dm/syncer.(*Syncer).getTable
\t/home/jenkins/agent/workspace/build_dm_master/go/src/github.com/pingcap/dm/syncer/syncer.go:691
github.com/pingcap/dm/syncer.(*Syncer).handleRowsEvent
\t/home/jenkins/agent/workspace/build_dm_master/go/src/github.com/pingcap/dm/syncer/syncer.go:1487
github.com/pingcap/dm/syncer.(*Syncer).Run
\t/home/jenkins/agent/workspace/build_dm_master/go/src/github.com/pingcap/dm/syncer/syncer.go:1334
github.com/pingcap/dm/syncer.(*Syncer).Process
\t/home/jenkins/agent/workspace/build_dm_master/go/src/github.com/pingcap/dm/syncer/syncer.go:599
github.com/pingcap/dm/syncer.(*Syncer).Resume
\t/home/jenkins/agent/workspace/build_dm_master/go/src/github.com/pingcap/dm/syncer/syncer.go:2361
runtime.goexit
\t/usr/local/go/src/runtime/asm_amd64.s:1357

出错日志截图,好像mydumper很快就结束了(这个不正常,MySQL数据库有200多G的数据文件)

我看了一下mydumper输出的文件,kiddo-schema-create.sql中只有一句:CREATE DATABASE kiddo /*!40100 DEFAULT CHARACTER SET utf8mb4 COLLATE utf8mb4_unicode_ci */;

metadata内容为: Started dump at: 2020-06-10 15:54:50 SHOW MASTER STATUS: Log: mysql-bin.006838 Pos: 677292386 GTID:

Finished dump at: 2020-06-10 15:54:50

把task.yaml中的extra-args改为"–regex ‘^(kiddo\.)’ --no-locks"就正常了~~开始导了,看看后面还会出什么问题~
%E9%85%8D%E7%BD%AE3

:clap:

此话题已在最后回复的 1 分钟后被自动关闭。不再允许新回复。