tidb集群因为磁盘满了删除日志后重启失败


2020-07-21T16:25:31.579+0800 INFO SSHCommand {“host”: “192.168.122.12”, “port”: “22”, “cmd”: “export LANG=C; PATH=$PATH:/usr/bin:/usr/sbin ss -ltn”, “stdout”: "State Recv-Q Send-Q Local Address:Port Peer Address:Port
LISTEN 0 128 :22 :
LISTEN 0 128 [::]:22 [::]:

", “stderr”: “”}
2020-07-21T16:25:31.580+0800 DEBUG retry error: operation timed out after 1m0s
2020-07-21T16:25:31.580+0800 ERROR tikv 192.168.122.12:20160 failed to start: timed out waiting for port 20160 to be started after 1m0s, please check the log of the instance
2020-07-21T16:25:32.178+0800 INFO SSHCommand {“host”: “192.168.122.11”, “port”: “22”, “cmd”: “export LANG=C; PATH=$PATH:/usr/bin:/usr/sbin ss -ltn”, “stdout”: "State Recv-Q Send-Q Local Address:Port Peer Address:Port
LISTEN 0 100 127.0.0.1:25 :
LISTEN 0 128 127.0.0.1:45416 :
LISTEN 0 128 127.0.0.1:45355 :
LISTEN 0 128 192.168.122.11:2379 :
LISTEN 0 128 192.168.122.11:2380 :
LISTEN 0 128 :22 :
LISTEN 0 100 [::1]:25 [::]:

LISTEN 0 128 [::]:9115 [::]:*
LISTEN 0 128 [::]:9100 [::]:*
LISTEN 0 128 [::]:22 [::]:*
", “stderr”: “”}
2020-07-21T16:25:32.178+0800 DEBUG retry error: operation timed out after 1m0s
2020-07-21T16:25:32.178+0800 ERROR tikv 192.168.122.11:20160 failed to start: timed out waiting for port 20160 to be started after 1m0s, please check the log of the instance
2020-07-21T16:25:32.179+0800 DEBUG TaskFinish {“task”: “ClusterOperate: operation=StartOperation, options={Roles:[] Nodes:[] Force:false SSHTimeout:5 OptTimeout:60 APITimeout:300 IgnoreConfigCheck:false RetainDataRoles:[] RetainDataNodes:[]}”, “error”: “failed to start: failed to start tikv: \ttikv 192.168.122.13:20160 failed to start: timed out waiting for port 20160 to be started after 1m0s, please check the log of the instance: timed out waiting for port 20160 to be started after 1m0s”, “errorVerbose”: “timed out waiting for port 20160 to be started after 1m0s
github.com/pingcap/tiup/pkg/cluster/module.(*WaitFor).Execute
\tgithub.com/pingcap/tiup@/pkg/cluster/module/wait_for.go:90
github.com/pingcap/tiup/pkg/cluster/spec.PortStarted
\tgithub.com/pingcap/tiup@/pkg/cluster/spec/instance.go:90
github.com/pingcap/tiup/pkg/cluster/spec.(*instance).Ready
\tgithub.com/pingcap/tiup@/pkg/cluster/spec/instance.go:121
github.com/pingcap/tiup/pkg/cluster/operation.startInstance
\tgithub.com/pingcap/tiup@/pkg/cluster/operation/action.go:461
github.com/pingcap/tiup/pkg/cluster/operation.StartComponent.func1
\tgithub.com/pingcap/tiup@/pkg/cluster/operation/action.go:497
golang.org/x/sync/errgroup.(*Group).Go.func1
\tgolang.org/x/sync@v0.0.0-20190911185100-cd5d95a43a6e/errgroup/errgroup.go:57
runtime.goexit
\truntime/asm_amd64.s:1357
\ttikv 192.168.122.13:20160 failed to start: timed out waiting for port 20160 to be started after 1m0s, please check the log of the instance
failed to start tikv
failed to start”}
2020-07-21T16:25:33.387+0800 INFO Execute command finished {“code”: 1, “error”: “failed to start: failed to start tikv: \ttikv 192.168.122.13:20160 failed to start: timed out waiting for port 20160 to be started after 1m0s, please check the log of the instance: timed out waiting for port 20160 to be started after 1m0s”, “errorVerbose”: “timed out waiting for port 20160 to be started after 1m0s
github.com/pingcap/tiup/pkg/cluster/module.(*WaitFor).Execute
\tgithub.com/pingcap/tiup@/pkg/cluster/module/wait_for.go:90
github.com/pingcap/tiup/pkg/cluster/spec.PortStarted
\tgithub.com/pingcap/tiup@/pkg/cluster/spec/instance.go:90
github.com/pingcap/tiup/pkg/cluster/spec.(*instance).Ready
\tgithub.com/pingcap/tiup@/pkg/cluster/spec/instance.go:121
github.com/pingcap/tiup/pkg/cluster/operation.startInstance
\tgithub.com/pingcap/tiup@/pkg/cluster/operation/action.go:461
github.com/pingcap/tiup/pkg/cluster/operation.StartComponent.func1
\tgithub.com/pingcap/tiup@/pkg/cluster/operation/action.go:497
golang.org/x/sync/errgroup.(*Group).Go.func1
\tgolang.org/x/sync@v0.0.0-20190911185100-cd5d95a43a6e/errgroup/errgroup.go:57
runtime.goexit
\truntime/asm_amd64.s:1357
\ttikv 192.168.122.13:20160 failed to start: timed out waiting for port 20160 to be started after 1m0s, please check the log of the instance
failed to start tikv
failed to start”}

  1. 请反馈对应的 tikv 日志,看下启动时报什么错,多谢
  2. 删除了哪些日志文件?