dm 由于超时失败，无法启动

🪐 TiDB 技术问题 备份&数据迁移
1

按照文档操作后
dm-master 和 dm-worker 无法启动
image
执行tiup dm start
错误内容是
Error: failed to start dm-master: dm-master xxx.xxxx.xxx:8261 failed to start: timed out waiting for port 8261 to be started after 1m0s, please check the log of the instance: timed out waiting for port 8261 to be started after 1m0s

2

给下 xxx.xxxx.xxx:8261 dm-master.log 的信息，我们看下。

PS：下次截图请给出完整一些。

3

dm-master.log 最后阶段的日志如下
[2020/11/25 16:43:06.812 +08:00] [INFO] [config.go:407] [“Set log level of etcd to warn, if you want to log more message about etcd, change log-level to debug in master configuration file”]
[2020/11/25 16:43:06.812 +08:00] [INFO] [server.go:150] [“config after join prepared”] [config="{“log-level”:“info”,“log-file”:"/home/tidb/dm/deploy/dm-master-8261/log/dm-master.log",“log-format”:“text”,“log-rotate”:"",“rpc-timeout”:“30s”,“rpc-rate-limit”:10,“rpc-rate-burst”:40,“master-addr”:“0.0.0.0:8261”,“advertise-addr”:“106.75.63.211:8261”,“config-file”:“conf/dm-master.toml”,“name”:“dm-106.75.63.211-8261”,“data-dir”:"/home/tidb/dm/data/dm-master-8261",“peer-urls”:“http://106.75.63.211:8291”,“advertise-peer-urls”:“http://106.75.63.211:8291”,“initial-cluster”:“dm-106.75.63.211-8261=http://106.75.63.211:8291”,“initial-cluster-state”:“new”,“join”:"",“debug”:false,“v1-sources-path”:"",“ssl-ca”:"",“ssl-cert”:"",“ssl-key”:"",“cert-allowed-cn”:null}"]
[2020/11/25 16:43:06.812 +08:00] [ERROR] [main.go:69] [“fail to start dm-master”] [error="[code=38038:class=dm-master:scope=internal:level=high], Message: fail to start embed etcd, RawCause: listen tcp 106.75.63.211:8291: bind: cannot assign requested address"] [errorVerbose="[code=38038:class=dm-master:scope=internal:level=high], Message: fail to start embed etcd, RawCause: listen tcp 106.75.63.211:8291: bind: cannot assign requested address\ngithub.com/pingcap/dm/pkg/terror.(*Error).Delegate\ \t/home/jenkins/agent/workspace/uild_dm_multi_branch_release-2.0/go/src/github.com/pingcap/dm/pkg/terror/terror.go:309\ngithub.com/pingcap/dm/dm/master.startEtcd\ \t/home/jenkins/agent/workspace/uild_dm_multi_branch_release-2.0/go/src/github.com/pingcap/dm/dm/master/etcd.go:56\ github.com/pingcap/dm/dm/master.(*Server).Start\ \t/home/jenkins/agent/workspace/uild_dm_multi_branch_release-2.0/go/src/github.com/pingcap/dm/dm/master/server.go:200\ main.main\ \t/home/jenkins/agent/workspace/uild_dm_multi_branch_release-2.0/go/src/github.com/pingcap/dm/cmd/dm-master/main.go:67\ runtime.main\ \t/usr/local/go/src/runtime/proc.go:203\ runtime.goexit\ \t/usr/local/go/src/runtime/asm_amd64.s:1357"]
[2020/11/25 16:43:22.063 +08:00] [INFO] [printer.go:54] [“Welcome to dm-master”] [“Release Version”=v2.0.0] [“Git Commit Hash”=e6ca256257fbe6e744892841537a16eb84469116] [“Git Branch”=release-2.0] [“UTC Build Time”=“2020-10-30 07:44:03”] [“Go Version”=“go version go1.13 linux/amd64”]
[2020/11/25 16:43:22.063 +08:00] [INFO] [main.go:61] [“dm-master config”="{“log-level”:“info”,“log-file”:"/home/tidb/dm/deploy/dm-master-8261/log/dm-master.log",“log-format”:“text”,“log-rotate”:"",“rpc-timeout”:“30s”,“rpc-rate-limit”:10,“rpc-rate-burst”:40,“master-addr”:“0.0.0.0:8261”,“advertise-addr”:“106.75.63.211:8261”,“config-file”:“conf/dm-master.toml”,“name”:“dm-106.75.63.211-8261”,“data-dir”:"/home/tidb/dm/data/dm-master-8261",“peer-urls”:“http://106.75.63.211:8291”,“advertise-peer-urls”:“http://106.75.63.211:8291”,“initial-cluster”:“dm-106.75.63.211-8261=http://106.75.63.211:8291”,“initial-cluster-state”:“new”,“join”:"",“debug”:false,“v1-sources-path”:"",“ssl-ca”:"",“ssl-cert”:"",“ssl-key”:"",“cert-allowed-cn”:null}"]
[2020/11/25 16:43:22.063 +08:00] [INFO] [config.go:407] [“Set log level of etcd to warn, if you want to log more message about etcd, change log-level to debug in master configuration file”]
[2020/11/25 16:43:22.063 +08:00] [INFO] [server.go:150] [“config after join prepared”] [config="{“log-level”:“info”,“log-file”:"/home/tidb/dm/deploy/dm-master-8261/log/dm-master.log",“log-format”:“text”,“log-rotate”:"",“rpc-timeout”:“30s”,“rpc-rate-limit”:10,“rpc-rate-burst”:40,“master-addr”:“0.0.0.0:8261”,“advertise-addr”:“106.75.63.211:8261”,“config-file”:“conf/dm-master.toml”,“name”:“dm-106.75.63.211-8261”,“data-dir”:"/home/tidb/dm/data/dm-master-8261",“peer-urls”:“http://106.75.63.211:8291”,“advertise-peer-urls”:“http://106.75.63.211:8291”,“initial-cluster”:“dm-106.75.63.211-8261=http://106.75.63.211:8291”,“initial-cluster-state”:“new”,“join”:"",“debug”:false,“v1-sources-path”:"",“ssl-ca”:"",“ssl-cert”:"",“ssl-key”:"",“cert-allowed-cn”:null}"]
[2020/11/25 16:43:22.063 +08:00] [ERROR] [main.go:69] [“fail to start dm-master”] [error="[code=38038:class=dm-master:scope=internal:level=high], Message: fail to start embed etcd, RawCause: listen tcp 106.75.63.211:8291: bind: cannot assign requested address"] [errorVerbose="[code=38038:class=dm-master:scope=internal:level=high], Message: fail to start embed etcd, RawCause: listen tcp 106.75.63.211:8291: bind: cannot assign requested address\ngithub.com/pingcap/dm/pkg/terror.(*Error).Delegate\ \t/home/jenkins/agent/workspace/uild_dm_multi_branch_release-2.0/go/src/github.com/pingcap/dm/pkg/terror/terror.go:309\ngithub.com/pingcap/dm/dm/master.startEtcd\ \t/home/jenkins/agent/workspace/uild_dm_multi_branch_release-2.0/go/src/github.com/pingcap/dm/dm/master/etcd.go:56\ github.com/pingcap/dm/dm/master.(*Server).Start\ \t/home/jenkins/agent/workspace/uild_dm_multi_branch_release-2.0/go/src/github.com/pingcap/dm/dm/master/server.go:200\ main.main\ \t/home/jenkins/agent/workspace/uild_dm_multi_branch_release-2.0/go/src/github.com/pingcap/dm/cmd/dm-master/main.go:67\ runtime.main\ \t/usr/local/go/src/runtime/proc.go:203\ runtime.goexit\ \t/usr/local/go/src/runtime/asm_amd64.s:1357"]
[2020/11/25 16:43:37.311 +08:00] [INFO] [printer.go:54] [“Welcome to dm-master”] [“Release Version”=v2.0.0] [“Git Commit Hash”=e6ca256257fbe6e744892841537a16eb84469116] [“Git Branch”=release-2.0] [“UTC Build Time”=“2020-10-30 07:44:03”] [“Go Version”=“go version go1.13 linux/amd64”]
[2020/11/25 16:43:37.312 +08:00] [INFO] [main.go:61] [“dm-master config”="{“log-level”:“info”,“log-file”:"/home/tidb/dm/deploy/dm-master-8261/log/dm-master.log",“log-format”:“text”,“log-rotate”:"",“rpc-timeout”:“30s”,“rpc-rate-limit”:10,“rpc-rate-burst”:40,“master-addr”:“0.0.0.0:8261”,“advertise-addr”:“106.75.63.211:8261”,“config-file”:“conf/dm-master.toml”,“name”:“dm-106.75.63.211-8261”,“data-dir”:"/home/tidb/dm/data/dm-master-8261",“peer-urls”:“http://106.75.63.211:8291”,“advertise-peer-urls”:“http://106.75.63.211:8291”,“initial-cluster”:“dm-106.75.63.211-8261=http://106.75.63.211:8291”,“initial-cluster-state”:“new”,“join”:"",“debug”:false,“v1-sources-path”:"",“ssl-ca”:"",“ssl-cert”:"",“ssl-key”:"",“cert-allowed-cn”:null}"]
[2020/11/25 16:43:37.312 +08:00] [INFO] [config.go:407] [“Set log level of etcd to warn, if you want to log more message about etcd, change log-level to debug in master configuration file”]
[2020/11/25 16:43:37.312 +08:00] [INFO] [server.go:150] [“config after join prepared”] [config="{“log-level”:“info”,“log-file”:"/home/tidb/dm/deploy/dm-master-8261/log/dm-master.log",“log-format”:“text”,“log-rotate”:"",“rpc-timeout”:“30s”,“rpc-rate-limit”:10,“rpc-rate-burst”:40,“master-addr”:“0.0.0.0:8261”,“advertise-addr”:“106.75.63.211:8261”,“config-file”:“conf/dm-master.toml”,“name”:“dm-106.75.63.211-8261”,“data-dir”:"/home/tidb/dm/data/dm-master-8261",“peer-urls”:“http://106.75.63.211:8291”,“advertise-peer-urls”:“http://106.75.63.211:8291”,“initial-cluster”:“dm-106.75.63.211-8261=http://106.75.63.211:8291”,“initial-cluster-state”:“new”,“join”:"",“debug”:false,“v1-sources-path”:"",“ssl-ca”:"",“ssl-cert”:"",“ssl-key”:"",“cert-allowed-cn”:null}"]
[2020/11/25 16:43:37.312 +08:00] [ERROR] [main.go:69] [“fail to start dm-master”] [error="[code=38038:class=dm-master:scope=internal:level=high], Message: fail to start embed etcd, RawCause: listen tcp 106.75.63.211:8291: bind: cannot assign requested address"] [errorVerbose="[code=38038:class=dm-master:scope=internal:level=high], Message: fail to start embed etcd, RawCause: listen tcp 106.75.63.211:8291: bind: cannot assign requested address\ngithub.com/pingcap/dm/pkg/terror.(*Error).Delegate\ \t/home/jenkins/agent/workspace/uild_dm_multi_branch_release-2.0/go/src/github.com/pingcap/dm/pkg/terror/terror.go:309\ngithub.com/pingcap/dm/dm/master.startEtcd\ \t/home/jenkins/agent/workspace/uild_dm_multi_branch_release-2.0/go/src/github.com/pingcap/dm/dm/master/etcd.go:56\ github.com/pingcap/dm/dm/master.(*Server).Start\ \t/home/jenkins/agent/workspace/uild_dm_multi_branch_release-2.0/go/src/github.com/pingcap/dm/dm/master/server.go:200\ main.main\ \t/home/jenkins/agent/workspace/uild_dm_multi_branch_release-2.0/go/src/github.com/pingcap/dm/cmd/dm-master/main.go:67\ runtime.main\ \t/usr/local/go/src/runtime/proc.go:203\ runtime.goexit\ \t/usr/local/go/src/runtime/asm_amd64.s:1357"]

4

image
image1612×603 197 KB

5

连接端口范围
image

6

Message: fail to start embed etcd, RawCause: listen tcp 106.75.63.211:8291: bind: cannot assign requested address
看下是否是 8291 被别的进程占用导致的

7

通过查看社区，发现有其他用户遇到同样的问题，最后通过内网连接完成了启动操作，能够确认别的进程没有占用端口。

8

你好，从日志中端口被占用。启动 etcd 失败。如果确认端口没有占用的情况，麻烦按照下面日志的建议方式，把日志级别修改为 debug，然后看下详细日志，是否有其他的报错。

9

哪一个帖子？我也遇到了同样的问题

10

我和他的解决方式一样

原因找到了，应该就是网络的问题。把IP全换成内网的，就能正常解析启动了。

我猜想是外网带宽不够

11

:+1: 应该是网络问题吧

12

此话题已在最后回复的 1 分钟后被自动关闭。不再允许新回复。