lightning 导入数据 失败 DB Lightning has detected tables with illegal checkpoints

[2020/06/24 09:08:06.965 +08:00] [ERROR] [restore.go:270] [“run failed”] [step=2] [error=“TiDB Lightning has detected tabl
es with illegal checkpoints; please remove these checkpoints first”]
[2020/06/24 09:08:06.965 +08:00] [ERROR] [restore.go:276] [“the whole procedure failed”] [takeTime=28.699741ms] [error=“Ti
DB Lightning has detected tables with illegal checkpoints; please remove these checkpoints first”]
[2020/06/24 09:08:06.965 +08:00] [ERROR] [main.go:78] [“tidb lightning encountered error stack info”] [error=“TiDB Lightni
ng has detected tables with illegal checkpoints; please remove these checkpoints first”] [errorVerbose=“TiDB Lightning has
detected tables with illegal checkpoints; please remove these checkpoints first\ngithub.com/pingcap/tidb-lightning/lightn
ing/restore.(*RestoreController).restoreTables\ \t/home/jenkins/agent/workspace/build_lightning_master/go/src/github.com/p
ingcap/tidb-lightning/lightning/restore/restore.go:687\ngithub.com/pingcap/tidb-lightning/lightning/restore.(*RestoreContr
oller).Run\ \t/home/jenkins/agent/workspace/build_lightning_master/go/src/github.com/pingcap/tidb-lightning/lightning/rest
ore/restore.go:260\ngithub.com/pingcap/tidb-lightning/lightning.(*Lightning).run\ \t/home/jenkins/agent/workspace/build_li
ghtning_master/go/src/github.com/pingcap/tidb-lightning/lightning/lightning.go:221\ngithub.com/pingcap/tidb-lightning/ligh
tning.(*Lightning).RunOnce\ \t/home/jenkins/agent/workspace/build_lightning_master/go/src/github.com/pingcap/tidb-lightnin
g/lightning/lightning.go:146\ main.main\ \t/home/jenkins/agent/workspace/build_lightning_master/go/src/github.com/pingcap/
tidb-lightning/cmd/tidb-lightning/main.go:75\ runtime.main\ \t/usr/local/go/src/runtime/proc.go:203\ runtime.goexit\ \t/us
r/local/go/src/runtime/asm_amd64.s:1357”]
[2020/06/24 09:08:06.965 +08:00] [ERROR] [main.go:79] [“tidb lightning encountered error”] [error=“TiDB Lightning has dete
cted tables with illegal checkpoints; please remove these checkpoints first”]

  1. tidb 和 lightning 版本是多少?
  2. 麻烦上传配置文件信息和导入命令

版本都是4.0.0
配置文件:# 转换数据的并发数,默认为逻辑 CPU 数量,不需要配置。

混合部署的情况下可以配置为逻辑 CPU 的 75% 大小。

region-concurrency =

日志

level = “info”
file = “tidb-lightning.log”

[tikv-importer]

tikv-importer 的监听地址,需改成 tikv-importer 服务器的实际地址。

addr = “10.77.80.223:8287”
backend = “tidb”
on-duplicate = “replace” # 或者 “error”、“ignore”

[mydumper]

Mydumper 源数据目录。

data-source-dir = “/opt”

[tidb]

目标集群的信息。tidb-server 的监听地址,填一个即可。

host = “10.77.80.223”
port = 4000
user = “root”
password = “”

表架构信息在从 TiDB 的“状态端口”获取。

status-port = 10080
pd-addr = “10.77.80.223:2379”

导入命令nohup ./tidb-lightning -config tidb-lightning.toml > nohup.out & 运行的脚本

这个报错看起来不是第一次导入的报错,可以先按照文档清空 checkpoint https://pingcap.com/docs-cn/stable/tidb-lightning/tidb-lightning-checkpoints/#断点续传的控制,然后再启动 lightning 试试。

还是同样的报错,:joy:

从上面的配置中,没有看到 checkpoint 相关的设置,这个可以发一下吗?另外询问下,要导入数据的规模大概是多少?

可以贴一下你运行的清楚 checkpoint 命令吗? 以及 checkpoint 相关配置

这个问题解决了没有啊?:joy:小白在学习,也是在这一步报同样的错误,就一张几十行数据的表,也是报这样的错误。

这个问题后来怎么处理的,也遇到了

这个帖子看下呢 tidb-lightning 导入报错