tidb连接报ERROR 2003 (HY000): Can't connect to MySQL server on 'xxx' (111)错误

[zhenjiaogao]

建议：

1、按照下面的顺序重启下： pump，tidb-server

2、重启后，查看 pump 的状态是否正常：

./bin/binlogctl -cmd drainers
./bin/binlogctl -cmd pumps

[gumupaier (起风了)]

重启

[2019/10/11 07:05:48.693 +00:00] [FATAL] [main.go:68] [“fail to execute command”] [command=drainers] [error=“dial tcp 127.0.0.1:2379: connect: connection refused”] [errorVerbose=“dial tcp 127.0.0.1:2379: connect: connection refused
github.com/pingcap/errors.AddStack
/home/jenkins/workspace/build_tidb_binlog_master/go/pkg/mod/github.com/pingcap/errors@v0.11.4/errors.go:174
github.com/pingcap/errors.Trace
/home/jenkins/workspace/build_tidb_binlog_master/go/pkg/mod/github.com/pingcap/errors@v0.11.4/juju_adaptor.go:15
github.com/pingcap/tidb-binlog/pkg/etcd.NewClientFromCfg
/home/jenkins/workspace/build_tidb_binlog_master/go/src/github.com/pingcap/tidb-binlog/pkg/etcd/etcd.go:55
github.com/pingcap/tidb-binlog/binlogctl.createRegistry
/home/jenkins/workspace/build_tidb_binlog_master/go/src/github.com/pingcap/tidb-binlog/binlogctl/nodes.go:86
github.com/pingcap/tidb-binlog/binlogctl.QueryNodesByKind
/home/jenkins/workspace/build_tidb_binlog_master/go/src/github.com/pingcap/tidb-binlog/binlogctl/nodes.go:38
main.main
/home/jenkins/workspace/build_tidb_binlog_master/go/src/github.com/pingcap/tidb-binlog/cmd/binlogctl/main.go:50
runtime.main
/usr/local/go/src/runtime/proc.go:200
runtime.goexit
/usr/local/go/src/runtime/asm_amd64.s:1337”] [stack=“github.com/pingcap/log.Fatal
/home/jenkins/workspace/build_tidb_binlog_master/go/pkg/mod/github.com/pingcap/log@v0.0.0-20190307075452-bd41d9273596/global.go:59
main.main
/home/jenkins/workspace/build_tidb_binlog_master/go/src/github.com/pingcap/tidb-binlog/cmd/binlogctl/main.go:68
runtime.main
/usr/local/go/src/runtime/proc.go:200”]

[2019/10/11 07:06:31.206 +00:00] [FATAL] [main.go:68] [“fail to execute command”] [command=pumps] [error=“dial tcp 127.0.0.1:2379: connect: connection refused”] [errorVerbose=“dial tcp 127.0.0.1:2379: connect: connection refused
github.com/pingcap/errors.AddStack
/home/jenkins/workspace/build_tidb_binlog_master/go/pkg/mod/github.com/pingcap/errors@v0.11.4/errors.go:174
github.com/pingcap/errors.Trace
/home/jenkins/workspace/build_tidb_binlog_master/go/pkg/mod/github.com/pingcap/errors@v0.11.4/juju_adaptor.go:15
github.com/pingcap/tidb-binlog/pkg/etcd.NewClientFromCfg
/home/jenkins/workspace/build_tidb_binlog_master/go/src/github.com/pingcap/tidb-binlog/pkg/etcd/etcd.go:55
github.com/pingcap/tidb-binlog/binlogctl.createRegistry
/home/jenkins/workspace/build_tidb_binlog_master/go/src/github.com/pingcap/tidb-binlog/binlogctl/nodes.go:86
github.com/pingcap/tidb-binlog/binlogctl.QueryNodesByKind
/home/jenkins/workspace/build_tidb_binlog_master/go/src/github.com/pingcap/tidb-binlog/binlogctl/nodes.go:38
main.main
/home/jenkins/workspace/build_tidb_binlog_master/go/src/github.com/pingcap/tidb-binlog/cmd/binlogctl/main.go:48
runtime.main
/usr/local/go/src/runtime/proc.go:200
runtime.goexit
/usr/local/go/src/runtime/asm_amd64.s:1337”] [stack=“github.com/pingcap/log.Fatal
/home/jenkins/workspace/build_tidb_binlog_master/go/pkg/mod/github.com/pingcap/log@v0.0.0-20190307075452-bd41d9273596/global.go:59
main.main
/home/jenkins/workspace/build_tidb_binlog_master/go/src/github.com/pingcap/tidb-binlog/cmd/binlogctl/main.go:68
runtime.main
/usr/local/go/src/runtime/proc.go:200”]

[zhenjiaogao]

1、重启后，看下 pump 和 tidb 的 log 是否正常

2、insert 条数据看看，是否正常

3、binlog-ctl 是一个单独的工具，tidb-binlog 部署后，pump 和 drianer 会注册到 pd 中 ，使用文档如下，请参考：
https://pingcap.com/docs-cn/v2.1/how-to/maintain/tidb-binlog/#binlogctl-工具

[gumupaier (起风了)]

insert就开始停顿几秒，然后断开连接报111错误，就是最开始题目上的问题， 重启后insert tidb日志就会出现错误

使用mysql show pump status等查看是正常的，截图在上方

[zhenjiaogao]

把刚才重启后，到 insert 数据报错时间段间的 pump 和 tidb server 日志提供下吧

[gumupaier (起风了)]

pump3.log (80.7 KB) tidb1.log (135.3 KB)

[gumupaier (起风了)]

重启后直接连不上了

[qizheng]

tidb 是 v4.0.0-alpha-395-g41ac571d7 版本，跟 binlog 版本对不上，4.0 版本还没有 release，需要用 3.0.4 版本重新部署

[gumupaier (起风了)]

谢谢，我试下

[gumupaier (起风了)]

大佬收下我的膝盖，你一句话解决了我的问题