TiUP扩容tidb节点失败

etcxy · 2020 年8 月 28 日 08:03

您好，原集群两台TiDB-server节点，现在需要多加一台TiDB-server节点。配置信息scale-out.yaml如下:

tidb_servers:
  - host: 192.168.247.74
    ssh_port: 22
    port: 4000
    status_port: 10080
    deploy_dir: /opt/tidb-deploy/tidb-4000
    log_dir: /opt/tidb-deploy/tidb-4000/log

但按教程扩容的时候，遇到了如下错误

[root@tidb1 ~]# tiup cluster scale-out tidb-hh scale-out.yaml --user root
Starting component `cluster`: /root/.tiup/components/cluster/v1.0.6/tiup-cluster scale-out tidb-hh scale-out.yaml --user root
Please confirm your topology:
TiDB Cluster: tidb-hh
TiDB Version: v4.0.0
Type  Host            Ports       OS/Arch       Directories
----  ----            -----       -------       -----------
tidb  192.168.247.74  4000/10080  linux/x86_64  /opt/tidb-deploy/tidb-4000
Attention:
    1. If the topology is not what you expected, check your yaml file.
    2. Please confirm there is no port/directory conflicts in same host.
Do you want to continue? [y/N]:  y
+ [ Serial ] - SSHKeySet: privateKey=/root/.tiup/storage/cluster/clusters/tidb-hh/ssh/id_rsa, publicKey=/root/.tiup/storage/cluster/clusters/tidb-hh/ssh/id_rsa.pub
  - Download tidb:v4.0.0 (linux/amd64) ... Error

Error: fetch /timestamp.json from mirror(https://tiup-mirrors.pingcap.com/) failed: download from https://tiup-mirrors.pingcap.com/timestamp.json failed: Get https://tiup-mirrors.pingcap.com/timestamp.json: dial tcp 192.168.247.77:443: connect: connection refused

Verbose debug logs has been written to /root/logs/tiup-cluster-debug-2020-08-28-16-01-37.log.
Error: run `/root/.tiup/components/cluster/v1.0.6/tiup-cluster` (wd:/root/.tiup/data/S8wbneG) failed: exit status 1

具体日志如下:

[root@tidb1 ~]# cat /root/logs/tiup-cluster-debug-2020-08-28-15-43-46.log
2020-08-28T15:43:45.685+0800	INFO	Execute command	{"command": "tiup cluster scale-out tidb-hh scale-out.yaml --user root"}
2020-08-28T15:43:45.685+0800	DEBUG	Environment variables	{"env": ["TIUP_HOME=/root/.tiup", "TIUP_WORK_DIR=/root", "TIUP_INSTANCE_DATA_DIR=/root/.tiup/data/S8wXJKQ", "TIUP_COMPONENT_DATA_DIR=/root/.tiup/storage/cluster", "TIUP_COMPONENT_INSTALL_DIR=/root/.tiup/components/cluster/v1.0.6", "TIUP_TELEMETRY_STATUS=disable", "TIUP_TELEMETRY_UUID=eaea9aa7-a373-40f4-bf2f-61b3b58352a0", "TIUP_TAG=S8wXJKQ", "XDG_SESSION_ID=44881", "HOSTNAME=tidb1", "TERM=xterm-256color", "SHELL=/bin/bash", "HISTSIZE=1000", "SSH_CLIENT=192.168.254.242 63488 22", "SSH_TTY=/dev/pts/2", "USER=root", "LS_COLORS=rs=0:di=38;5;27:ln=38;5;51:mh=44;38;5;15:pi=40;38;5;11:so=38;5;13:do=38;5;5:bd=48;5;232;38;5;11:cd=48;5;232;38;5;3:or=48;5;232;38;5;9:mi=05;48;5;232;38;5;15:su=48;5;196;38;5;15:sg=48;5;11;38;5;16:ca=48;5;196;38;5;226:tw=48;5;10;38;5;16:ow=48;5;10;38;5;21:st=48;5;21;38;5;15:ex=38;5;34:*.tar=38;5;9:*.tgz=38;5;9:*.arc=38;5;9:*.arj=38;5;9:*.taz=38;5;9:*.lha=38;5;9:*.lz4=38;5;9:*.lzh=38;5;9:*.lzma=38;5;9:*.tlz=38;5;9:*.txz=38;5;9:*.tzo=38;5;9:*.t7z=38;5;9:*.zip=38;5;9:*.z=38;5;9:*.Z=38;5;9:*.dz=38;5;9:*.gz=38;5;9:*.lrz=38;5;9:*.lz=38;5;9:*.lzo=38;5;9:*.xz=38;5;9:*.bz2=38;5;9:*.bz=38;5;9:*.tbz=38;5;9:*.tbz2=38;5;9:*.tz=38;5;9:*.deb=38;5;9:*.rpm=38;5;9:*.jar=38;5;9:*.war=38;5;9:*.ear=38;5;9:*.sar=38;5;9:*.rar=38;5;9:*.alz=38;5;9:*.ace=38;5;9:*.zoo=38;5;9:*.cpio=38;5;9:*.7z=38;5;9:*.rz=38;5;9:*.cab=38;5;9:*.jpg=38;5;13:*.jpeg=38;5;13:*.gif=38;5;13:*.bmp=38;5;13:*.pbm=38;5;13:*.pgm=38;5;13:*.ppm=38;5;13:*.tga=38;5;13:*.xbm=38;5;13:*.xpm=38;5;13:*.tif=38;5;13:*.tiff=38;5;13:*.png=38;5;13:*.svg=38;5;13:*.svgz=38;5;13:*.mng=38;5;13:*.pcx=38;5;13:*.mov=38;5;13:*.mpg=38;5;13:*.mpeg=38;5;13:*.m2v=38;5;13:*.mkv=38;5;13:*.webm=38;5;13:*.ogm=38;5;13:*.mp4=38;5;13:*.m4v=38;5;13:*.mp4v=38;5;13:*.vob=38;5;13:*.qt=38;5;13:*.nuv=38;5;13:*.wmv=38;5;13:*.asf=38;5;13:*.rm=38;5;13:*.rmvb=38;5;13:*.flc=38;5;13:*.avi=38;5;13:*.fli=38;5;13:*.flv=38;5;13:*.gl=38;5;13:*.dl=38;5;13:*.xcf=38;5;13:*.xwd=38;5;13:*.yuv=38;5;13:*.cgm=38;5;13:*.emf=38;5;13:*.axv=38;5;13:*.anx=38;5;13:*.ogv=38;5;13:*.ogx=38;5;13:*.aac=38;5;45:*.au=38;5;45:*.flac=38;5;45:*.mid=38;5;45:*.midi=38;5;45:*.mka=38;5;45:*.mp3=38;5;45:*.mpc=38;5;45:*.ogg=38;5;45:*.ra=38;5;45:*.wav=38;5;45:*.axa=38;5;45:*.oga=38;5;45:*.spx=38;5;45:*.xspf=38;5;45:", "COBBLER_SERVER=192.168.254.251", "MAIL=/var/spool/mail/root", "PATH=/root/.tiup/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/root/bin", "PWD=/root", "LANG=zh_CN.UTF-8", "HISTCONTROL=ignoredups", "SHLVL=1", "HOME=/root", "GODEBUG=madvdontneed=1", "LOGNAME=root", "SSH_CONNECTION=192.168.254.242 63488 192.168.247.74 22", "LESSOPEN=||/usr/bin/lesspipe.sh %s", "XDG_RUNTIME_DIR=/run/user/0", "_=/root/.tiup/bin/tiup", "OLDPWD=/opt"]}
2020-08-28T15:43:45.692+0800	DEBUG	Parse topology file	{"file": "scale-out.yaml"}
2020-08-28T15:43:45.692+0800	DEBUG	Parse topology file succeeded	{"topology": {"GlobalOptions":{"User":"root","SSHPort":22,"DeployDir":"/opt/tidb-deploy","DataDir":"/tidb-data","LogDir":"","ResourceControl":{"MemoryLimit":"","CPUQuota":"","IOReadBandwidthMax":"","IOWriteBandwidthMax":""},"OS":"linux","Arch":"amd64"},"MonitoredOptions":{"NodeExporterPort":9100,"BlackboxExporterPort":9115,"DeployDir":"/opt/tidb-deploy/monitor-9100","DataDir":"/tidb-data/monitor-9100","LogDir":"/opt/tidb-deploy/monitor-9100/log","NumaNode":"","ResourceControl":{"MemoryLimit":"","CPUQuota":"","IOReadBandwidthMax":"","IOWriteBandwidthMax":""}},"ServerConfigs":{"TiDB":{"enable-telemetry":false,"log.slow-threshold":3000,"mem-quota-query":2147483648},"TiKV":{"raftdb.defaultcf.compression-per-level":["no","no","no","lz4","lz4","zstd","zstd"],"raftdb.defaultcf.max-bytes-for-level-base":"512MB","raftdb.defaultcf.target-file-size-base":"32MB","raftdb.defaultcf.write-buffer-size":"128MB","raftdb.max-background-jobs":8,"raftdb.max-open-files":65535,"raftdb.max-write-buffer-number":8,"raftdb.min-write-buffer-number-to-merge":2,"raftdb.rate-bytes-per-sec":"50MB","raftstore.hibernate-regions":true,"raftstore.region-split-check-diff":"32MB","raftstore.split-region-check-tick-interval":"15s","raftstore.store-pool-size":4,"readpool.unified.max-thread-count":10,"rocksdb.defaultcf.block-size":"64KB","rocksdb.defaultcf.compression-per-level":["no","no","no","lz4","lz4","zstd","zstd"],"rocksdb.defaultcf.max-bytes-for-level-base":"512MB","rocksdb.defaultcf.target-file-size-base":"32MB","rocksdb.defaultcf.write-buffer-size":"128MB","rocksdb.max-background-jobs":4,"rocksdb.max-write-buffer-number":8,"rocksdb.min-write-buffer-number-to-merge":2,"rocksdb.rate-bytes-per-sec":"100MB","server.grpc-concurrency":6,"storage.block-cache.capacity":"16G","storage.scheduler-worker-pool-size":8},"PD":{"replication.enable-placement-rules":true},"TiFlash":{},"TiFlashLearner":{},"Pump":{},"Drainer":{},"CDC":{}},"TiDBServers":[{"Host":"192.168.247.74","ListenHost":"","SSHPort":22,"Imported":false,"Port":4000,"StatusPort":10080,"DeployDir":"/opt/tidb-deploy/tidb-4000","LogDir":"/opt/tidb-deploy/tidb-4000/log","NumaNode":"","Config":null,"ResourceControl":{"MemoryLimit":"","CPUQuota":"","IOReadBandwidthMax":"","IOWriteBandwidthMax":""},"Arch":"amd64","OS":"linux"}],"TiKVServers":null,"TiFlashServers":null,"PDServers":null,"PumpServers":null,"Drainers":null,"CDCServers":null,"Monitors":null,"Grafana":null,"Alertmanager":null}}
2020-08-28T15:43:45.693+0800	INFO	Please confirm your topology:
2020-08-28T15:43:45.693+0800	WARN	Attention:
2020-08-28T15:43:45.693+0800	WARN	    1. If the topology is not what you expected, check your yaml file.
2020-08-28T15:43:45.693+0800	WARN	    2. Please confirm there is no port/directory conflicts in same host.
2020-08-28T15:43:46.848+0800	INFO	+ [ Serial ] - SSHKeySet: privateKey=/root/.tiup/storage/cluster/clusters/tidb-hh/ssh/id_rsa, publicKey=/root/.tiup/storage/cluster/clusters/tidb-hh/ssh/id_rsa.pub
2020-08-28T15:43:46.849+0800	DEBUG	TaskBegin	{"task": "SSHKeySet: privateKey=/root/.tiup/storage/cluster/clusters/tidb-hh/ssh/id_rsa, publicKey=/root/.tiup/storage/cluster/clusters/tidb-hh/ssh/id_rsa.pub"}
2020-08-28T15:43:46.849+0800	DEBUG	TaskFinish	{"task": "SSHKeySet: privateKey=/root/.tiup/storage/cluster/clusters/tidb-hh/ssh/id_rsa, publicKey=/root/.tiup/storage/cluster/clusters/tidb-hh/ssh/id_rsa.pub"}
2020-08-28T15:43:46.849+0800	DEBUG	TaskBegin	{"task": "Download: component=tidb, version=v4.0.0, os=linux, arch=amd64"}
2020-08-28T15:43:46.849+0800	DEBUG	TaskBegin	{"task": "Download: component=tidb, version=v4.0.0, os=linux, arch=amd64"}
2020-08-28T15:43:46.849+0800	DEBUG	TaskBegin	{"task": "Download: component=tidb, version=v4.0.0, os=linux, arch=amd64"}
2020-08-28T15:43:46.853+0800	DEBUG	TaskFinish	{"task": "Download: component=tidb, version=v4.0.0, os=linux, arch=amd64", "error": "fetch /timestamp.json from mirror(https://tiup-mirrors.pingcap.com/) failed: download from https://tiup-mirrors.pingcap.com/timestamp.json failed: Get https://tiup-mirrors.pingcap.com/timestamp.json: dial tcp 192.168.247.77:443: connect: connection refused", "errorVerbose": "Get https://tiup-mirrors.pingcap.com/timestamp.json: dial tcp 192.168.247.77:443: connect: connection refused\
download from https://tiup-mirrors.pingcap.com/timestamp.json failed\
github.com/pingcap/tiup/pkg/repository.(*httpMirror).download\
\tgithub.com/pingcap/tiup@/pkg/repository/mirror.go:224\
github.com/pingcap/tiup/pkg/repository.(*httpMirror).Fetch\
\tgithub.com/pingcap/tiup@/pkg/repository/mirror.go:261\
github.com/pingcap/tiup/pkg/repository.(*V1Repository).fetchBase\
\tgithub.com/pingcap/tiup@/pkg/repository/v1_repository.go:553\
github.com/pingcap/tiup/pkg/repository.(*V1Repository).fetchManifest\
\tgithub.com/pingcap/tiup@/pkg/repository/v1_repository.go:530\
github.com/pingcap/tiup/pkg/repository.(*V1Repository).fetchTimestamp\
\tgithub.com/pingcap/tiup@/pkg/repository/v1_repository.go:488\
github.com/pingcap/tiup/pkg/repository.(*V1Repository).updateLocalSnapshot\
\tgithub.com/pingcap/tiup@/pkg/repository/v1_repository.go:244\
github.com/pingcap/tiup/pkg/repository.(*V1Repository).ensureManifests\
\tgithub.com/pingcap/tiup@/pkg/repository/v1_repository.go:186\
github.com/pingcap/tiup/pkg/repository.(*V1Repository).FetchComponentManifest\
\tgithub.com/pingcap/tiup@/pkg/repository/v1_repository.go:650\
github.com/pingcap/tiup/pkg/repository.(*V1Repository).ComponentVersion\
\tgithub.com/pingcap/tiup@/pkg/repository/v1_repository.go:660\
github.com/pingcap/tiup/pkg/cluster/clusterutil.(*repositoryT).DownloadComponent\
\tgithub.com/pingcap/tiup@/pkg/cluster/clusterutil/cluster.go:57\
github.com/pingcap/tiup/pkg/cluster/operation.Download\
\tgithub.com/pingcap/tiup@/pkg/cluster/operation/download.go:59\
github.com/pingcap/tiup/pkg/cluster/task.(*Downloader).Execute\
\tgithub.com/pingcap/tiup@/pkg/cluster/task/download.go:43\
github.com/pingcap/tiup/pkg/cluster/task.(*Serial).Execute\
\tgithub.com/pingcap/tiup@/pkg/cluster/task/task.go:183\
github.com/pingcap/tiup/pkg/cluster/task.(*StepDisplay).Execute\
\tgithub.com/pingcap/tiup@/pkg/cluster/task/step.go:85\
github.com/pingcap/tiup/pkg/cluster/task.(*Parallel).Execute.func1\
\tgithub.com/pingcap/tiup@/pkg/cluster/task/task.go:236\
runtime.goexit\
\truntime/asm_amd64.s:1357\
fetch /timestamp.json from mirror(https://tiup-mirrors.pingcap.com/) failed"}
2020-08-28T15:43:46.854+0800	DEBUG	TaskFinish	{"task": "Download: component=tidb, version=v4.0.0, os=linux, arch=amd64", "error": "fetch /timestamp.json from mirror(https://tiup-mirrors.pingcap.com/) failed: download from https://tiup-mirrors.pingcap.com/timestamp.json failed: Get https://tiup-mirrors.pingcap.com/timestamp.json: dial tcp 192.168.247.77:443: connect: connection refused", "errorVerbose": "Get https://tiup-mirrors.pingcap.com/timestamp.json: dial tcp 192.168.247.77:443: connect: connection refused\
download from https://tiup-mirrors.pingcap.com/timestamp.json failed\
github.com/pingcap/tiup/pkg/repository.(*httpMirror).download\
\tgithub.com/pingcap/tiup@/pkg/repository/mirror.go:224\
github.com/pingcap/tiup/pkg/repository.(*httpMirror).Fetch\
\tgithub.com/pingcap/tiup@/pkg/repository/mirror.go:261\
github.com/pingcap/tiup/pkg/repository.(*V1Repository).fetchBase\
\tgithub.com/pingcap/tiup@/pkg/repository/v1_repository.go:553\
github.com/pingcap/tiup/pkg/repository.(*V1Repository).fetchManifest\
\tgithub.com/pingcap/tiup@/pkg/repository/v1_repository.go:530\
github.com/pingcap/tiup/pkg/repository.(*V1Repository).fetchTimestamp\
\tgithub.com/pingcap/tiup@/pkg/repository/v1_repository.go:488\
github.com/pingcap/tiup/pkg/repository.(*V1Repository).updateLocalSnapshot\
\tgithub.com/pingcap/tiup@/pkg/repository/v1_repository.go:244\
github.com/pingcap/tiup/pkg/repository.(*V1Repository).ensureManifests\
\tgithub.com/pingcap/tiup@/pkg/repository/v1_repository.go:186\
github.com/pingcap/tiup/pkg/repository.(*V1Repository).FetchComponentManifest\
\tgithub.com/pingcap/tiup@/pkg/repository/v1_repository.go:650\
github.com/pingcap/tiup/pkg/repository.(*V1Repository).ComponentVersion\
\tgithub.com/pingcap/tiup@/pkg/repository/v1_repository.go:660\
github.com/pingcap/tiup/pkg/cluster/clusterutil.(*repositoryT).DownloadComponent\
\tgithub.com/pingcap/tiup@/pkg/cluster/clusterutil/cluster.go:57\
github.com/pingcap/tiup/pkg/cluster/operation.Download\
\tgithub.com/pingcap/tiup@/pkg/cluster/operation/download.go:59\
github.com/pingcap/tiup/pkg/cluster/task.(*Downloader).Execute\
\tgithub.com/pingcap/tiup@/pkg/cluster/task/download.go:43\
github.com/pingcap/tiup/pkg/cluster/task.(*Serial).Execute\
\tgithub.com/pingcap/tiup@/pkg/cluster/task/task.go:183\
github.com/pingcap/tiup/pkg/cluster/task.(*StepDisplay).Execute\
\tgithub.com/pingcap/tiup@/pkg/cluster/task/step.go:85\
github.com/pingcap/tiup/pkg/cluster/task.(*Parallel).Execute.func1\
\tgithub.com/pingcap/tiup@/pkg/cluster/task/task.go:236\
runtime.goexit\
\truntime/asm_amd64.s:1357\
fetch /timestamp.json from mirror(https://tiup-mirrors.pingcap.com/) failed"}
2020-08-28T15:43:46.854+0800	DEBUG	TaskFinish	{"task": "Download: component=tidb, version=v4.0.0, os=linux, arch=amd64", "error": "fetch /timestamp.json from mirror(https://tiup-mirrors.pingcap.com/) failed: download from https://tiup-mirrors.pingcap.com/timestamp.json failed: Get https://tiup-mirrors.pingcap.com/timestamp.json: dial tcp 192.168.247.77:443: connect: connection refused", "errorVerbose": "Get https://tiup-mirrors.pingcap.com/timestamp.json: dial tcp 192.168.247.77:443: connect: connection refused\
download from https://tiup-mirrors.pingcap.com/timestamp.json failed\
github.com/pingcap/tiup/pkg/repository.(*httpMirror).download\
\tgithub.com/pingcap/tiup@/pkg/repository/mirror.go:224\
github.com/pingcap/tiup/pkg/repository.(*httpMirror).Fetch\
\tgithub.com/pingcap/tiup@/pkg/repository/mirror.go:261\
github.com/pingcap/tiup/pkg/repository.(*V1Repository).fetchBase\
\tgithub.com/pingcap/tiup@/pkg/repository/v1_repository.go:553\
github.com/pingcap/tiup/pkg/repository.(*V1Repository).fetchManifest\
\tgithub.com/pingcap/tiup@/pkg/repository/v1_repository.go:530\
github.com/pingcap/tiup/pkg/repository.(*V1Repository).fetchTimestamp\
\tgithub.com/pingcap/tiup@/pkg/repository/v1_repository.go:488\
github.com/pingcap/tiup/pkg/repository.(*V1Repository).updateLocalSnapshot\
\tgithub.com/pingcap/tiup@/pkg/repository/v1_repository.go:244\
github.com/pingcap/tiup/pkg/repository.(*V1Repository).ensureManifests\
\tgithub.com/pingcap/tiup@/pkg/repository/v1_repository.go:186\
github.com/pingcap/tiup/pkg/repository.(*V1Repository).FetchComponentManifest\
\tgithub.com/pingcap/tiup@/pkg/repository/v1_repository.go:650\
github.com/pingcap/tiup/pkg/repository.(*V1Repository).ComponentVersion\
\tgithub.com/pingcap/tiup@/pkg/repository/v1_repository.go:660\
github.com/pingcap/tiup/pkg/cluster/clusterutil.(*repositoryT).DownloadComponent\
\tgithub.com/pingcap/tiup@/pkg/cluster/clusterutil/cluster.go:57\
github.com/pingcap/tiup/pkg/cluster/operation.Download\
\tgithub.com/pingcap/tiup@/pkg/cluster/operation/download.go:59\
github.com/pingcap/tiup/pkg/cluster/task.(*Downloader).Execute\
\tgithub.com/pingcap/tiup@/pkg/cluster/task/download.go:43\
github.com/pingcap/tiup/pkg/cluster/task.(*Serial).Execute\
\tgithub.com/pingcap/tiup@/pkg/cluster/task/task.go:183\
github.com/pingcap/tiup/pkg/cluster/task.(*StepDisplay).Execute\
\tgithub.com/pingcap/tiup@/pkg/cluster/task/step.go:85\
github.com/pingcap/tiup/pkg/cluster/task.(*Parallel).Execute.func1\
\tgithub.com/pingcap/tiup@/pkg/cluster/task/task.go:236\
runtime.goexit\
\truntime/asm_amd64.s:1357\
fetch /timestamp.json from mirror(https://tiup-mirrors.pingcap.com/) failed"}
2020-08-28T15:43:46.854+0800	INFO	Execute command finished	{"code": 1, "error": "fetch /timestamp.json from mirror(https://tiup-mirrors.pingcap.com/) failed: download from https://tiup-mirrors.pingcap.com/timestamp.json failed: Get https://tiup-mirrors.pingcap.com/timestamp.json: dial tcp 192.168.247.77:443: connect: connection refused", "errorVerbose": "Get https://tiup-mirrors.pingcap.com/timestamp.json: dial tcp 192.168.247.77:443: connect: connection refused\
download from https://tiup-mirrors.pingcap.com/timestamp.json failed\
github.com/pingcap/tiup/pkg/repository.(*httpMirror).download\
\tgithub.com/pingcap/tiup@/pkg/repository/mirror.go:224\
github.com/pingcap/tiup/pkg/repository.(*httpMirror).Fetch\
\tgithub.com/pingcap/tiup@/pkg/repository/mirror.go:261\
github.com/pingcap/tiup/pkg/repository.(*V1Repository).fetchBase\
\tgithub.com/pingcap/tiup@/pkg/repository/v1_repository.go:553\
github.com/pingcap/tiup/pkg/repository.(*V1Repository).fetchManifest\
\tgithub.com/pingcap/tiup@/pkg/repository/v1_repository.go:530\
github.com/pingcap/tiup/pkg/repository.(*V1Repository).fetchTimestamp\
\tgithub.com/pingcap/tiup@/pkg/repository/v1_repository.go:488\
github.com/pingcap/tiup/pkg/repository.(*V1Repository).updateLocalSnapshot\
\tgithub.com/pingcap/tiup@/pkg/repository/v1_repository.go:244\
github.com/pingcap/tiup/pkg/repository.(*V1Repository).ensureManifests\
\tgithub.com/pingcap/tiup@/pkg/repository/v1_repository.go:186\
github.com/pingcap/tiup/pkg/repository.(*V1Repository).FetchComponentManifest\
\tgithub.com/pingcap/tiup@/pkg/repository/v1_repository.go:650\
github.com/pingcap/tiup/pkg/repository.(*V1Repository).ComponentVersion\
\tgithub.com/pingcap/tiup@/pkg/repository/v1_repository.go:660\
github.com/pingcap/tiup/pkg/cluster/clusterutil.(*repositoryT).DownloadComponent\
\tgithub.com/pingcap/tiup@/pkg/cluster/clusterutil/cluster.go:57\
github.com/pingcap/tiup/pkg/cluster/operation.Download\
\tgithub.com/pingcap/tiup@/pkg/cluster/operation/download.go:59\
github.com/pingcap/tiup/pkg/cluster/task.(*Downloader).Execute\
\tgithub.com/pingcap/tiup@/pkg/cluster/task/download.go:43\
github.com/pingcap/tiup/pkg/cluster/task.(*Serial).Execute\
\tgithub.com/pingcap/tiup@/pkg/cluster/task/task.go:183\
github.com/pingcap/tiup/pkg/cluster/task.(*StepDisplay).Execute\
\tgithub.com/pingcap/tiup@/pkg/cluster/task/step.go:85\
github.com/pingcap/tiup/pkg/cluster/task.(*Parallel).Execute.func1\
\tgithub.com/pingcap/tiup@/pkg/cluster/task/task.go:236\
runtime.goexit\
\truntime/asm_amd64.s:1357\
fetch /timestamp.json from mirror(https://tiup-mirrors.pingcap.com/) failed"}

烦请帮忙看下问题。谢谢

不懂就问 · 2020 年8 月 28 日 09:24

测试看下能不能访问到 https://tiup-mirrors.pingcap.com/timestamp.json

etcxy · 2020 年8 月 28 日 09:32

刚刚查看了一下，内网/etc/hosts多了一个

192.168.247.77 tiup-mirrors.pingcap.com

删除了以后

[root@tidb1 ~]# tiup cluster scale-out tidb-hh scale-out.yaml --user root
Starting component `cluster`: /root/.tiup/components/cluster/v1.0.6/tiup-cluster scale-out tidb-hh scale-out.yaml --user root
Please confirm your topology:
TiDB Cluster: tidb-hh
TiDB Version: v4.0.0
Type  Host            Ports       OS/Arch       Directories
----  ----            -----       -------       -----------
tidb  192.168.247.74  4000/10080  linux/x86_64  /opt/tidb-deploy/tidb-4000
Attention:
    1. If the topology is not what you expected, check your yaml file.
    2. Please confirm there is no port/directory conflicts in same host.
Do you want to continue? [y/N]:  y
+ [ Serial ] - SSHKeySet: privateKey=/root/.tiup/storage/cluster/clusters/tidb-hh/ssh/id_rsa, publicKey=/root/.tiup/storage/cluster/clusters/tidb-hh/ssh/id_rsa.pub
  - Download tidb:v4.0.0 (linux/amd64) ... Error

Error: read manifest from mirror(https://tiup-mirrors.pingcap.com/) failed: not enough signatures (0) for threshold 1 in timestamp.json

Verbose debug logs has been written to /root/logs/tiup-cluster-debug-2020-08-28-17-39-42.log.
Error: run `/root/.tiup/components/cluster/v1.0.6/tiup-cluster` (wd:/root/.tiup/data/S8x0Uka) failed: exit status 1

[root@tidb1 ~]# cat /root/logs/tiup-cluster-debug-2020-08-28-17-39-42.log
2020-08-28T17:39:41.091+0800	INFO	Execute command	{"command": "tiup cluster scale-out tidb-hh scale-out.yaml --user root"}
2020-08-28T17:39:41.091+0800	DEBUG	Environment variables	{"env": ["TIUP_HOME=/root/.tiup", "TIUP_WORK_DIR=/root", "TIUP_INSTANCE_DATA_DIR=/root/.tiup/data/S8x0Uka", "TIUP_COMPONENT_DATA_DIR=/root/.tiup/storage/cluster", "TIUP_COMPONENT_INSTALL_DIR=/root/.tiup/components/cluster/v1.0.6", "TIUP_TELEMETRY_STATUS=disable", "TIUP_TELEMETRY_UUID=eaea9aa7-a373-40f4-bf2f-61b3b58352a0", "TIUP_TAG=S8x0Uka", "XDG_SESSION_ID=44881", "HOSTNAME=tidb1", "TERM=xterm-256color", "SHELL=/bin/bash", "HISTSIZE=1000", "SSH_CLIENT=192.168.254.242 63488 22", "SSH_TTY=/dev/pts/2", "USER=root", "LS_COLORS=rs=0:di=38;5;27:ln=38;5;51:mh=44;38;5;15:pi=40;38;5;11:so=38;5;13:do=38;5;5:bd=48;5;232;38;5;11:cd=48;5;232;38;5;3:or=48;5;232;38;5;9:mi=05;48;5;232;38;5;15:su=48;5;196;38;5;15:sg=48;5;11;38;5;16:ca=48;5;196;38;5;226:tw=48;5;10;38;5;16:ow=48;5;10;38;5;21:st=48;5;21;38;5;15:ex=38;5;34:*.tar=38;5;9:*.tgz=38;5;9:*.arc=38;5;9:*.arj=38;5;9:*.taz=38;5;9:*.lha=38;5;9:*.lz4=38;5;9:*.lzh=38;5;9:*.lzma=38;5;9:*.tlz=38;5;9:*.txz=38;5;9:*.tzo=38;5;9:*.t7z=38;5;9:*.zip=38;5;9:*.z=38;5;9:*.Z=38;5;9:*.dz=38;5;9:*.gz=38;5;9:*.lrz=38;5;9:*.lz=38;5;9:*.lzo=38;5;9:*.xz=38;5;9:*.bz2=38;5;9:*.bz=38;5;9:*.tbz=38;5;9:*.tbz2=38;5;9:*.tz=38;5;9:*.deb=38;5;9:*.rpm=38;5;9:*.jar=38;5;9:*.war=38;5;9:*.ear=38;5;9:*.sar=38;5;9:*.rar=38;5;9:*.alz=38;5;9:*.ace=38;5;9:*.zoo=38;5;9:*.cpio=38;5;9:*.7z=38;5;9:*.rz=38;5;9:*.cab=38;5;9:*.jpg=38;5;13:*.jpeg=38;5;13:*.gif=38;5;13:*.bmp=38;5;13:*.pbm=38;5;13:*.pgm=38;5;13:*.ppm=38;5;13:*.tga=38;5;13:*.xbm=38;5;13:*.xpm=38;5;13:*.tif=38;5;13:*.tiff=38;5;13:*.png=38;5;13:*.svg=38;5;13:*.svgz=38;5;13:*.mng=38;5;13:*.pcx=38;5;13:*.mov=38;5;13:*.mpg=38;5;13:*.mpeg=38;5;13:*.m2v=38;5;13:*.mkv=38;5;13:*.webm=38;5;13:*.ogm=38;5;13:*.mp4=38;5;13:*.m4v=38;5;13:*.mp4v=38;5;13:*.vob=38;5;13:*.qt=38;5;13:*.nuv=38;5;13:*.wmv=38;5;13:*.asf=38;5;13:*.rm=38;5;13:*.rmvb=38;5;13:*.flc=38;5;13:*.avi=38;5;13:*.fli=38;5;13:*.flv=38;5;13:*.gl=38;5;13:*.dl=38;5;13:*.xcf=38;5;13:*.xwd=38;5;13:*.yuv=38;5;13:*.cgm=38;5;13:*.emf=38;5;13:*.axv=38;5;13:*.anx=38;5;13:*.ogv=38;5;13:*.ogx=38;5;13:*.aac=38;5;45:*.au=38;5;45:*.flac=38;5;45:*.mid=38;5;45:*.midi=38;5;45:*.mka=38;5;45:*.mp3=38;5;45:*.mpc=38;5;45:*.ogg=38;5;45:*.ra=38;5;45:*.wav=38;5;45:*.axa=38;5;45:*.oga=38;5;45:*.spx=38;5;45:*.xspf=38;5;45:", "COBBLER_SERVER=192.168.254.251", "MAIL=/var/spool/mail/root", "PATH=/root/.tiup/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/root/bin", "PWD=/root", "LANG=zh_CN.UTF-8", "HISTCONTROL=ignoredups", "SHLVL=1", "HOME=/root", "GODEBUG=madvdontneed=1", "LOGNAME=root", "SSH_CONNECTION=192.168.254.242 63488 192.168.247.74 22", "LESSOPEN=||/usr/bin/lesspipe.sh %s", "XDG_RUNTIME_DIR=/run/user/0", "_=/root/.tiup/bin/tiup", "OLDPWD=/opt/tidb-deploy/logs"]}
2020-08-28T17:39:41.094+0800	DEBUG	Parse topology file	{"file": "scale-out.yaml"}
2020-08-28T17:39:41.094+0800	DEBUG	Parse topology file succeeded	{"topology": {"GlobalOptions":{"User":"root","SSHPort":22,"DeployDir":"/opt/tidb-deploy","DataDir":"/tidb-data","LogDir":"","ResourceControl":{"MemoryLimit":"","CPUQuota":"","IOReadBandwidthMax":"","IOWriteBandwidthMax":""},"OS":"linux","Arch":"amd64"},"MonitoredOptions":{"NodeExporterPort":9100,"BlackboxExporterPort":9115,"DeployDir":"/opt/tidb-deploy/monitor-9100","DataDir":"/tidb-data/monitor-9100","LogDir":"/opt/tidb-deploy/monitor-9100/log","NumaNode":"","ResourceControl":{"MemoryLimit":"","CPUQuota":"","IOReadBandwidthMax":"","IOWriteBandwidthMax":""}},"ServerConfigs":{"TiDB":{"enable-telemetry":false,"log.slow-threshold":3000,"mem-quota-query":2147483648},"TiKV":{"raftdb.defaultcf.compression-per-level":["no","no","no","lz4","lz4","zstd","zstd"],"raftdb.defaultcf.max-bytes-for-level-base":"512MB","raftdb.defaultcf.target-file-size-base":"32MB","raftdb.defaultcf.write-buffer-size":"128MB","raftdb.max-background-jobs":8,"raftdb.max-open-files":65535,"raftdb.max-write-buffer-number":8,"raftdb.min-write-buffer-number-to-merge":2,"raftdb.rate-bytes-per-sec":"50MB","raftstore.hibernate-regions":true,"raftstore.region-split-check-diff":"32MB","raftstore.split-region-check-tick-interval":"15s","raftstore.store-pool-size":4,"readpool.unified.max-thread-count":10,"rocksdb.defaultcf.block-size":"64KB","rocksdb.defaultcf.compression-per-level":["no","no","no","lz4","lz4","zstd","zstd"],"rocksdb.defaultcf.max-bytes-for-level-base":"512MB","rocksdb.defaultcf.target-file-size-base":"32MB","rocksdb.defaultcf.write-buffer-size":"128MB","rocksdb.max-background-jobs":4,"rocksdb.max-write-buffer-number":8,"rocksdb.min-write-buffer-number-to-merge":2,"rocksdb.rate-bytes-per-sec":"100MB","server.grpc-concurrency":6,"storage.block-cache.capacity":"16G","storage.scheduler-worker-pool-size":8},"PD":{"replication.enable-placement-rules":true},"TiFlash":{},"TiFlashLearner":{},"Pump":{},"Drainer":{},"CDC":{}},"TiDBServers":[{"Host":"192.168.247.74","ListenHost":"","SSHPort":22,"Imported":false,"Port":4000,"StatusPort":10080,"DeployDir":"/opt/tidb-deploy/tidb-4000","LogDir":"/opt/tidb-deploy/tidb-4000/log","NumaNode":"","Config":null,"ResourceControl":{"MemoryLimit":"","CPUQuota":"","IOReadBandwidthMax":"","IOWriteBandwidthMax":""},"Arch":"amd64","OS":"linux"}],"TiKVServers":null,"TiFlashServers":null,"PDServers":null,"PumpServers":null,"Drainers":null,"CDCServers":null,"Monitors":null,"Grafana":null,"Alertmanager":null}}
2020-08-28T17:39:41.095+0800	INFO	Please confirm your topology:
2020-08-28T17:39:41.095+0800	WARN	Attention:
2020-08-28T17:39:41.095+0800	WARN	    1. If the topology is not what you expected, check your yaml file.
2020-08-28T17:39:41.095+0800	WARN	    2. Please confirm there is no port/directory conflicts in same host.
2020-08-28T17:39:42.609+0800	INFO	+ [ Serial ] - SSHKeySet: privateKey=/root/.tiup/storage/cluster/clusters/tidb-hh/ssh/id_rsa, publicKey=/root/.tiup/storage/cluster/clusters/tidb-hh/ssh/id_rsa.pub
2020-08-28T17:39:42.609+0800	DEBUG	TaskBegin	{"task": "SSHKeySet: privateKey=/root/.tiup/storage/cluster/clusters/tidb-hh/ssh/id_rsa, publicKey=/root/.tiup/storage/cluster/clusters/tidb-hh/ssh/id_rsa.pub"}
2020-08-28T17:39:42.609+0800	DEBUG	TaskFinish	{"task": "SSHKeySet: privateKey=/root/.tiup/storage/cluster/clusters/tidb-hh/ssh/id_rsa, publicKey=/root/.tiup/storage/cluster/clusters/tidb-hh/ssh/id_rsa.pub"}
2020-08-28T17:39:42.609+0800	DEBUG	TaskBegin	{"task": "Download: component=tidb, version=v4.0.0, os=linux, arch=amd64"}
2020-08-28T17:39:42.609+0800	DEBUG	TaskBegin	{"task": "Download: component=tidb, version=v4.0.0, os=linux, arch=amd64"}
2020-08-28T17:39:42.609+0800	DEBUG	TaskBegin	{"task": "Download: component=tidb, version=v4.0.0, os=linux, arch=amd64"}
2020-08-28T17:39:42.761+0800	DEBUG	TaskFinish	{"task": "Download: component=tidb, version=v4.0.0, os=linux, arch=amd64", "error": "read manifest from mirror(https://tiup-mirrors.pingcap.com/) failed: not enough signatures (0) for threshold 1 in timestamp.json", "errorVerbose": "not enough signatures (0) for threshold 1 in timestamp.json\
github.com/pingcap/tiup/pkg/repository/v1manifest.(*KeyStore).verifySignature\
\tgithub.com/pingcap/tiup@/pkg/repository/v1manifest/key_store.go:143\
github.com/pingcap/tiup/pkg/repository/v1manifest.ReadManifest\
\tgithub.com/pingcap/tiup@/pkg/repository/v1manifest/manifest.go:397\
github.com/pingcap/tiup/pkg/repository.(*V1Repository).fetchManifest.func1\
\tgithub.com/pingcap/tiup@/pkg/repository/v1_repository.go:531\
github.com/pingcap/tiup/pkg/repository.(*V1Repository).fetchBase\
\tgithub.com/pingcap/tiup@/pkg/repository/v1_repository.go:559\
github.com/pingcap/tiup/pkg/repository.(*V1Repository).fetchManifest\
\tgithub.com/pingcap/tiup@/pkg/repository/v1_repository.go:530\
github.com/pingcap/tiup/pkg/repository.(*V1Repository).fetchTimestamp\
\tgithub.com/pingcap/tiup@/pkg/repository/v1_repository.go:488\
github.com/pingcap/tiup/pkg/repository.(*V1Repository).updateLocalSnapshot\
\tgithub.com/pingcap/tiup@/pkg/repository/v1_repository.go:244\
github.com/pingcap/tiup/pkg/repository.(*V1Repository).ensureManifests\
\tgithub.com/pingcap/tiup@/pkg/repository/v1_repository.go:186\
github.com/pingcap/tiup/pkg/repository.(*V1Repository).FetchComponentManifest\
\tgithub.com/pingcap/tiup@/pkg/repository/v1_repository.go:650\
github.com/pingcap/tiup/pkg/repository.(*V1Repository).ComponentVersion\
\tgithub.com/pingcap/tiup@/pkg/repository/v1_repository.go:660\
github.com/pingcap/tiup/pkg/cluster/clusterutil.(*repositoryT).DownloadComponent\
\tgithub.com/pingcap/tiup@/pkg/cluster/clusterutil/cluster.go:57\
github.com/pingcap/tiup/pkg/cluster/operation.Download\
\tgithub.com/pingcap/tiup@/pkg/cluster/operation/download.go:59\
github.com/pingcap/tiup/pkg/cluster/task.(*Downloader).Execute\
\tgithub.com/pingcap/tiup@/pkg/cluster/task/download.go:43\
github.com/pingcap/tiup/pkg/cluster/task.(*Serial).Execute\
\tgithub.com/pingcap/tiup@/pkg/cluster/task/task.go:183\
github.com/pingcap/tiup/pkg/cluster/task.(*StepDisplay).Execute\
\tgithub.com/pingcap/tiup@/pkg/cluster/task/step.go:85\
github.com/pingcap/tiup/pkg/cluster/task.(*Parallel).Execute.func1\
\tgithub.com/pingcap/tiup@/pkg/cluster/task/task.go:236\
runtime.goexit\
\truntime/asm_amd64.s:1357\
read manifest from mirror(https://tiup-mirrors.pingcap.com/) failed"}
2020-08-28T17:39:42.762+0800	DEBUG	TaskFinish	{"task": "Download: component=tidb, version=v4.0.0, os=linux, arch=amd64", "error": "read manifest from mirror(https://tiup-mirrors.pingcap.com/) failed: not enough signatures (0) for threshold 1 in timestamp.json", "errorVerbose": "not enough signatures (0) for threshold 1 in timestamp.json\
github.com/pingcap/tiup/pkg/repository/v1manifest.(*KeyStore).verifySignature\
\tgithub.com/pingcap/tiup@/pkg/repository/v1manifest/key_store.go:143\
github.com/pingcap/tiup/pkg/repository/v1manifest.ReadManifest\
\tgithub.com/pingcap/tiup@/pkg/repository/v1manifest/manifest.go:397\
github.com/pingcap/tiup/pkg/repository.(*V1Repository).fetchManifest.func1\
\tgithub.com/pingcap/tiup@/pkg/repository/v1_repository.go:531\
github.com/pingcap/tiup/pkg/repository.(*V1Repository).fetchBase\
\tgithub.com/pingcap/tiup@/pkg/repository/v1_repository.go:559\
github.com/pingcap/tiup/pkg/repository.(*V1Repository).fetchManifest\
\tgithub.com/pingcap/tiup@/pkg/repository/v1_repository.go:530\
github.com/pingcap/tiup/pkg/repository.(*V1Repository).fetchTimestamp\
\tgithub.com/pingcap/tiup@/pkg/repository/v1_repository.go:488\
github.com/pingcap/tiup/pkg/repository.(*V1Repository).updateLocalSnapshot\
\tgithub.com/pingcap/tiup@/pkg/repository/v1_repository.go:244\
github.com/pingcap/tiup/pkg/repository.(*V1Repository).ensureManifests\
\tgithub.com/pingcap/tiup@/pkg/repository/v1_repository.go:186\
github.com/pingcap/tiup/pkg/repository.(*V1Repository).FetchComponentManifest\
\tgithub.com/pingcap/tiup@/pkg/repository/v1_repository.go:650\
github.com/pingcap/tiup/pkg/repository.(*V1Repository).ComponentVersion\
\tgithub.com/pingcap/tiup@/pkg/repository/v1_repository.go:660\
github.com/pingcap/tiup/pkg/cluster/clusterutil.(*repositoryT).DownloadComponent\
\tgithub.com/pingcap/tiup@/pkg/cluster/clusterutil/cluster.go:57\
github.com/pingcap/tiup/pkg/cluster/operation.Download\
\tgithub.com/pingcap/tiup@/pkg/cluster/operation/download.go:59\
github.com/pingcap/tiup/pkg/cluster/task.(*Downloader).Execute\
\tgithub.com/pingcap/tiup@/pkg/cluster/task/download.go:43\
github.com/pingcap/tiup/pkg/cluster/task.(*Serial).Execute\
\tgithub.com/pingcap/tiup@/pkg/cluster/task/task.go:183\
github.com/pingcap/tiup/pkg/cluster/task.(*StepDisplay).Execute\
\tgithub.com/pingcap/tiup@/pkg/cluster/task/step.go:85\
github.com/pingcap/tiup/pkg/cluster/task.(*Parallel).Execute.func1\
\tgithub.com/pingcap/tiup@/pkg/cluster/task/task.go:236\
runtime.goexit\
\truntime/asm_amd64.s:1357\
read manifest from mirror(https://tiup-mirrors.pingcap.com/) failed"}
2020-08-28T17:39:42.762+0800	DEBUG	TaskFinish	{"task": "Download: component=tidb, version=v4.0.0, os=linux, arch=amd64", "error": "read manifest from mirror(https://tiup-mirrors.pingcap.com/) failed: not enough signatures (0) for threshold 1 in timestamp.json", "errorVerbose": "not enough signatures (0) for threshold 1 in timestamp.json\
github.com/pingcap/tiup/pkg/repository/v1manifest.(*KeyStore).verifySignature\
\tgithub.com/pingcap/tiup@/pkg/repository/v1manifest/key_store.go:143\
github.com/pingcap/tiup/pkg/repository/v1manifest.ReadManifest\
\tgithub.com/pingcap/tiup@/pkg/repository/v1manifest/manifest.go:397\
github.com/pingcap/tiup/pkg/repository.(*V1Repository).fetchManifest.func1\
\tgithub.com/pingcap/tiup@/pkg/repository/v1_repository.go:531\
github.com/pingcap/tiup/pkg/repository.(*V1Repository).fetchBase\
\tgithub.com/pingcap/tiup@/pkg/repository/v1_repository.go:559\
github.com/pingcap/tiup/pkg/repository.(*V1Repository).fetchManifest\
\tgithub.com/pingcap/tiup@/pkg/repository/v1_repository.go:530\
github.com/pingcap/tiup/pkg/repository.(*V1Repository).fetchTimestamp\
\tgithub.com/pingcap/tiup@/pkg/repository/v1_repository.go:488\
github.com/pingcap/tiup/pkg/repository.(*V1Repository).updateLocalSnapshot\
\tgithub.com/pingcap/tiup@/pkg/repository/v1_repository.go:244\
github.com/pingcap/tiup/pkg/repository.(*V1Repository).ensureManifests\
\tgithub.com/pingcap/tiup@/pkg/repository/v1_repository.go:186\
github.com/pingcap/tiup/pkg/repository.(*V1Repository).FetchComponentManifest\
\tgithub.com/pingcap/tiup@/pkg/repository/v1_repository.go:650\
github.com/pingcap/tiup/pkg/repository.(*V1Repository).ComponentVersion\
\tgithub.com/pingcap/tiup@/pkg/repository/v1_repository.go:660\
github.com/pingcap/tiup/pkg/cluster/clusterutil.(*repositoryT).DownloadComponent\
\tgithub.com/pingcap/tiup@/pkg/cluster/clusterutil/cluster.go:57\
github.com/pingcap/tiup/pkg/cluster/operation.Download\
\tgithub.com/pingcap/tiup@/pkg/cluster/operation/download.go:59\
github.com/pingcap/tiup/pkg/cluster/task.(*Downloader).Execute\
\tgithub.com/pingcap/tiup@/pkg/cluster/task/download.go:43\
github.com/pingcap/tiup/pkg/cluster/task.(*Serial).Execute\
\tgithub.com/pingcap/tiup@/pkg/cluster/task/task.go:183\
github.com/pingcap/tiup/pkg/cluster/task.(*StepDisplay).Execute\
\tgithub.com/pingcap/tiup@/pkg/cluster/task/step.go:85\
github.com/pingcap/tiup/pkg/cluster/task.(*Parallel).Execute.func1\
\tgithub.com/pingcap/tiup@/pkg/cluster/task/task.go:236\
runtime.goexit\
\truntime/asm_amd64.s:1357\
read manifest from mirror(https://tiup-mirrors.pingcap.com/) failed"}
2020-08-28T17:39:42.762+0800	INFO	Execute command finished	{"code": 1, "error": "read manifest from mirror(https://tiup-mirrors.pingcap.com/) failed: not enough signatures (0) for threshold 1 in timestamp.json", "errorVerbose": "not enough signatures (0) for threshold 1 in timestamp.json\
github.com/pingcap/tiup/pkg/repository/v1manifest.(*KeyStore).verifySignature\
\tgithub.com/pingcap/tiup@/pkg/repository/v1manifest/key_store.go:143\
github.com/pingcap/tiup/pkg/repository/v1manifest.ReadManifest\
\tgithub.com/pingcap/tiup@/pkg/repository/v1manifest/manifest.go:397\
github.com/pingcap/tiup/pkg/repository.(*V1Repository).fetchManifest.func1\
\tgithub.com/pingcap/tiup@/pkg/repository/v1_repository.go:531\
github.com/pingcap/tiup/pkg/repository.(*V1Repository).fetchBase\
\tgithub.com/pingcap/tiup@/pkg/repository/v1_repository.go:559\
github.com/pingcap/tiup/pkg/repository.(*V1Repository).fetchManifest\
\tgithub.com/pingcap/tiup@/pkg/repository/v1_repository.go:530\
github.com/pingcap/tiup/pkg/repository.(*V1Repository).fetchTimestamp\
\tgithub.com/pingcap/tiup@/pkg/repository/v1_repository.go:488\
github.com/pingcap/tiup/pkg/repository.(*V1Repository).updateLocalSnapshot\
\tgithub.com/pingcap/tiup@/pkg/repository/v1_repository.go:244\
github.com/pingcap/tiup/pkg/repository.(*V1Repository).ensureManifests\
\tgithub.com/pingcap/tiup@/pkg/repository/v1_repository.go:186\
github.com/pingcap/tiup/pkg/repository.(*V1Repository).FetchComponentManifest\
\tgithub.com/pingcap/tiup@/pkg/repository/v1_repository.go:650\
github.com/pingcap/tiup/pkg/repository.(*V1Repository).ComponentVersion\
\tgithub.com/pingcap/tiup@/pkg/repository/v1_repository.go:660\
github.com/pingcap/tiup/pkg/cluster/clusterutil.(*repositoryT).DownloadComponent\
\tgithub.com/pingcap/tiup@/pkg/cluster/clusterutil/cluster.go:57\
github.com/pingcap/tiup/pkg/cluster/operation.Download\
\tgithub.com/pingcap/tiup@/pkg/cluster/operation/download.go:59\
github.com/pingcap/tiup/pkg/cluster/task.(*Downloader).Execute\
\tgithub.com/pingcap/tiup@/pkg/cluster/task/download.go:43\
github.com/pingcap/tiup/pkg/cluster/task.(*Serial).Execute\
\tgithub.com/pingcap/tiup@/pkg/cluster/task/task.go:183\
github.com/pingcap/tiup/pkg/cluster/task.(*StepDisplay).Execute\
\tgithub.com/pingcap/tiup@/pkg/cluster/task/step.go:85\
github.com/pingcap/tiup/pkg/cluster/task.(*Parallel).Execute.func1\
\tgithub.com/pingcap/tiup@/pkg/cluster/task/task.go:236\
runtime.goexit\
\truntime/asm_amd64.s:1357\
read manifest from mirror(https://tiup-mirrors.pingcap.com/) failed"}

AstroProfundis · 2020 年8 月 28 日 10:12

你好，如果中控机有互联网访问，可以删掉 ~/.tiup/manifests/ 目录下的 json 文件后重试，会自动从在线仓库拉取最新的数据
如果没有公网访问，需要参考 https://docs.pingcap.com/zh/tidb/stable/production-offline-deployment-using-tiup 文档设置一下 TIUP_MIRRORS 环境变量为本地的离线镜像路径，如果已经找不到安装时的那份离线镜像，可以按文档内的步骤自己打包，或者从官网下载我们预先打包的单个版本离线镜像使用 https://pingcap.com/download-cn/community/
因为离线镜像在打包时会生成一个私有密钥用于自身校验，如果用的不是最初安装部署集群时的同一份离线镜像，同样需要清理 ~/.tiup/manifests/ 后使用

etcxy · 2020 年8 月 28 日 15:03

您好，根据您的描述，我做了如下操作:

删除~/.tiup/manifests/timestamp.json
下载离线包到中控机，并解压：

wget https://download.pingcap.org/tidb-community-server-v4.0.0-linux-amd64.tar.gz

tar -zxf tidb-community-server-v4.0.0-linux-amd64.tar.gz

执行./local_install.sh

[root@tidb1 tidb-community-server-v4.0.0-linux-amd64]# ./local_install.sh
Set mirror to /root/tidb-community-server-v4.0.0-linux-amd64 success
Detected shell: bash
Shell profile:  /root/.bash_profile
Installed path: /root/.tiup/bin/tiup
===============================================
1. source /root/.bash_profile
2. Have a try:   tiup playground
===============================================

再执行扩容操作

[root@tidb1 ~]# tiup cluster scale-out tidb-hh scale-out.yaml --user root
Failed to start component `cluster`
Error: no version: v1.0.6

目前故障为，tiup无法对集群做任何操作，任何操作均返回

Failed to start component `cluster`
Error: no version: v1.0.6

因是生产环境使用，望告知修复方案。谢谢

qizheng · 2020 年8 月 29 日 06:29

执行 tiup cluster 命令也有同样的报错吗，检查下 /root/.tiup/manifests/cluster.json 中有没有 v1.0.6 的 entry 记录

etcxy · 2020 年8 月 29 日 16:38

[root@tidb1 ~]# cat ~/.tiup/manifests/cluster.json
{"signatures":[{"keyid":"ead84d177549864b18786f7e45b6cfb100cb02f0a03ebc8d45a048b05b19680b","sig":"EBC4rvWt+QLhsiu++zHaZAA09OQUFlFChp0CGoCNvw6yJR4mLdCS1tceRn9eol77y5WSezyp/IiiYcE/YOE/Gby4GtLLvnq62Y/EKxPq7RkbwUBCYjniqJzHu58Y5mqSRNTVegTPmE4TelJMb82DI+ETS7fe6/5KfnhtVANVzxAbccql88nLq7zy8EcswYA8zsR5l/KWBK2y8OG7Mt1BkxUUUzGAv4TogNpq8xUKFX4kGIvMHYOC0h4pjSVkC90UEs8yRQvs5LOsSiPaPvWs9q/DYeTm02l+fDskpb75RYENs21eF0wiAt8rY+FkIJDhUmv7ihqTCShdSe7F9Gig+A=="}],"signed":{"_type":"component","description":"Deploy a TiDB cluster for production","expires":"2070-07-01T11:39:40Z","id":"cluster","nightly":"","platforms":{"linux/amd64":{"v1.0.8":{"dependencies":null,"entry":"tiup-cluster","hashes":{"sha256":"87ad9dd1d67b875448ec71702260797651b72b6b9fbfabeb43065eb7b7eb7c62","sha512":"ec2e1b5f518bb55f762e982ff109c390e1cbac0a586d6cc61c5d09b56b6f86b626bfe7559f5d461b21bd1476a19851332de71fc380fdd83ff75f626a26006705"},"length":10083411,"released":"2020-07-13T18:39:36+08:00","url":"/cluster-v1.0.8-linux-amd64.tar.gz","yanked":false}}},"spec_version":"0.1.0","version":34}}[root@tidb1 ~]#

json里是1.0.8，但/root/.tiup/components/cluster下，

[root@tidb1 cluster]# pwd
/root/.tiup/components/cluster
[root@tidb1 cluster]# ls
v1.0.6
[root@tidb1 cluster]# find .
.
./v1.0.6
./v1.0.6/tiup-cluster

目前是这样

qizheng · 2020 年8 月 30 日 02:29

可以下载最新的 tiup 版本，替换掉当前的版本，然后执行 tiup cluster
wget https://tiup-mirrors.pingcap.com/tiup-linux-amd64.tar.gz

etcxy · 2020 年8 月 30 日 16:38

替换后:

[root@tidb1 ~]# tiup --version
v1.1.0 tiup
Go Version: go1.13
Git Branch: release-1.1
GitHash: 3988f6f
[root@tidb1 ~]# tiup cluster
Failed to start component `cluster`
Error: read manifest from mirror(/root/tidb-community-server-v4.0.0-linux-amd64) failed: not enough signatures (0) for threshold 1 in timestamp.json

来了老弟 · 2020 年8 月 31 日 02:06

cat ~/.tiup/manifests/timestamp.json
看下返回结果，

记录后，删除 timestamp.json 试下 tiup clsuter 是否会报错

etcxy · 2020 年8 月 31 日 02:25

您好，目前集群如下

[root@tidb1 manifests]# echo $TIUP_MIRRORS
/root/tidb-community-server-v4.0.0-linux-amd64

[root@tidb1 manifests]# tiup --version
v1.0.8 tiup
Go Version: go1.13
Git Branch: master
GitHash: 4276089

[root@tidb1 manifests]# cat timestamp.json
{"signatures":[{"keyid":"d3d5b5be3699b3cc00da1188a4b852956fde08caf059bd4b047c5e142c9bf4db","sig":"SWvDskEr70RqQOsxzbBC0BoYEapYywyG/YSb3xgFWbKRpn4RGFlfV0/jBdzFZ6QfwX3ZaUEQBuKJvBBazddgjbuV89JGsmcFLd/th2Xm1CkgF9PzgO8yZKl0Bg/uv0qyBeLsgCrfoU9v7za3a9lY5xfGbh3Ll0T1WgPAY7DbUdn5uKgtn3RCkBaz0iq64bk2YRvvTZsGeMevT4qXkr/xJAo8qavJiFjvbnGOinH84pVAcLEJ1ffFgDsm9JQmY8L9FX5DpzMipFPkIJ5ORsw/rbnzvbezG9eBUvhy6mSz994ogxBcfu0+Qk8l7WZ2fGUw25+hqv/8Piw69/GRMfjCDA=="}],"signed":{"_type":"timestamp","expires":"2070-07-01T11:39:40Z","meta":{"/snapshot.json":{"hashes":{"sha256":"0fee890149618ac0eb4c7c5641dd3b667d7f892bfe02f2c396f5eb275cc0eb16","sha512":"f278a28fbb7dc1a4b04f159dec94be835864d168064e95539e3298160a94518d8739d4dd40078cdd63bbe180d0ec54d2aa134368b2c1396557773646dd8545e8"},"length":1778}},"spec_version":"0.1.0","version":1}}


[root@tidb1 manifests]# tiup cluster
Failed to start component `cluster`
Error: not enough signatures (0) for threshold 1 in index.json

[root@tidb1 manifests]# tiup list
Error: read manifest from mirror(/root/tidb-community-server-v4.0.0-linux-amd64) failed: not enough signatures (0) for threshold 1 in timestamp.json

[root@tidb1 manifests]# rm -rf timestamp.json
[root@tidb1 manifests]# tiup update --self
Error: read manifest from mirror(/root/tidb-community-server-v4.0.0-linux-amd64) failed: not enough signatures (0) for threshold 1 in timestamp.json

来了老弟 · 2020 年8 月 31 日 02:44

执行以下命令看是否可以恢复

sh /root/tidb-community-server-v4.0.0-linux-amd64/local_install.sh
source /home/root/.bash_profile
export TIUP_MIRRORS=${local_install.sh 输出的离线镜像包的位置}

etcxy · 2020 年8 月 31 日 02:48

[root@tidb1 manifests]# sh /root/tidb-community-server-v4.0.0-linux-amd64/local_install.sh
Set mirror to /root/tidb-community-server-v4.0.0-linux-amd64 success
Detected shell: bash
Shell profile:  /root/.bash_profile
Installed path: /root/.tiup/bin/tiup
===============================================
1. source /root/.bash_profile
2. Have a try:   tiup playground
===============================================

[root@tidb1 manifests]# source /root/.bash_profile

[root@tidb1 manifests]# export TIUP_MIRRORS=/root/tidb-community-server-v4.0.0-linux-amd64/

[root@tidb1 manifests]# tiup --version
v1.0.8 tiup
Go Version: go1.13
Git Branch: master
GitHash: 4276089

[root@tidb1 manifests]# tiup list
Error: read manifest from mirror(/root/tidb-community-server-v4.0.0-linux-amd64/) failed: not enough signatures (0) for threshold 1 in timestamp.json

[root@tidb1 manifests]# tiup cluster
Failed to start component `cluster`
Error: not enough signatures (0) for threshold 1 in index.json

lucklove · 2020 年8 月 31 日 03:00

试试这个：

unset TIUP_MIRRORS
tiup mirror set /root/tidb-community-server-v4.0.0-linux-amd64/

新版本的tiup使用了 tiup mirror set 来代替 TIUP_MIRRORS

etcxy · 2020 年8 月 31 日 03:17

感谢，tiup cluster现已恢复正常使用

现在TiDB扩容信息如下:

[root@tidb1 ~]# tiup cluster scale-out tidb-hh scale-out.yaml --user root
Starting component `cluster`:  scale-out tidb-hh scale-out.yaml --user root
Please confirm your topology:
TiDB Cluster: tidb-hh
TiDB Version: v4.0.0
Type  Host            Ports       OS/Arch       Directories
----  ----            -----       -------       -----------
tidb  192.168.247.74  4000/10080  linux/x86_64  /opt/tidb-deploy/tidb-4000
Attention:
    1. If the topology is not what you expected, check your yaml file.
    2. Please confirm there is no port/directory conflicts in same host.
Do you want to continue? [y/N]:  y
+ [ Serial ] - SSHKeySet: privateKey=/root/.tiup/storage/cluster/clusters/tidb-hh/ssh/id_rsa, publicKey=/root/.tiup/storage/cluster/clusters/tidb-hh/ssh/id_rsa.pub
  - Download tidb:v4.0.0 (linux/amd64) ... Done
+ [Parallel] - UserSSH: user=root, host=192.168.247.74
+ [Parallel] - UserSSH: user=root, host=192.168.247.74
+ [Parallel] - UserSSH: user=root, host=192.168.247.77
+ [Parallel] - UserSSH: user=root, host=192.168.247.74
+ [Parallel] - UserSSH: user=root, host=192.168.247.77
+ [Parallel] - UserSSH: user=root, host=192.168.247.77
+ [Parallel] - UserSSH: user=root, host=192.168.247.78
+ [Parallel] - UserSSH: user=root, host=192.168.247.78
+ [Parallel] - UserSSH: user=root, host=192.168.247.78
+ [Parallel] - UserSSH: user=root, host=192.168.247.74
+ [Parallel] - UserSSH: user=root, host=192.168.247.74
+ [Parallel] - UserSSH: user=root, host=192.168.247.74
+ [ Serial ] - UserSSH: user=root, host=192.168.247.74
+ [ Serial ] - Mkdir: host=192.168.247.74, directories='/opt/tidb-deploy/tidb-4000','/opt/tidb-deploy/tidb-4000/log','/opt/tidb-deploy/tidb-4000/bin','/opt/tidb-deploy/tidb-4000/conf','/opt/tidb-deploy/tidb-4000/scripts'
+ [ Serial ] - Mkdir: host=192.168.247.74, directories=''
+ [ Serial ] - CopyComponent: component=tidb, version=v4.0.0, remote=192.168.247.74:/opt/tidb-deploy/tidb-4000 os=linux, arch=amd64
+ [ Serial ] - ScaleConfig: cluster=tidb-hh, user=root, host=192.168.247.74, service=tidb-4000.service, deploy_dir=/opt/tidb-deploy/tidb-4000, data_dir=[], log_dir=/opt/tidb-deploy/tidb-4000/log, cache_dir=

Error: executor.ssh.execute_failed: Failed to execute command over SSH for 'root@192.168.247.74:22' {ssh_stderr: , ssh_stdout: [2020/08/31 11:04:38.706 +08:00] [FATAL] [terror.go:348] ["unexpected error"] [error="config file /opt/tidb-deploy/tidb-4000/conf/tidb.toml contained unknown configuration options: enable-telemetry"] [stack="github.com/pingcap/log.Fatal\
\t/home/jenkins/agent/workspace/tidb_v4.0.0/go/pkg/mod/github.com/pingcap/log@v0.0.0-20200511115504-543df19646ad/global.go:59\
github.com/pingcap/parser/terror.MustNil\
\t/home/jenkins/agent/workspace/tidb_v4.0.0/go/pkg/mod/github.com/pingcap/parser@v0.0.0-20200525110646-f45c2cee1dca/terror/terror.go:348\
github.com/pingcap/tidb/config.InitializeConfig\
\t/home/jenkins/agent/workspace/tidb_v4.0.0/go/src/github.com/pingcap/tidb/config/config.go:743\
main.main\
\t/home/jenkins/agent/workspace/tidb_v4.0.0/go/src/github.com/pingcap/tidb/tidb-server/main.go:168\
runtime.main\
\t/usr/local/go/src/runtime/proc.go:203"]
, ssh_command: export LANG=C; PATH=$PATH:/usr/bin:/usr/sbin /opt/tidb-deploy/tidb-4000/bin/tidb-server --config-check --config=/opt/tidb-deploy/tidb-4000/conf/tidb.toml }, cause: Process exited with status 1: check config failed

Verbose debug logs has been written to /root/logs/tiup-cluster-debug-2020-08-31-11-04-38.log.
Error: run `` (wd:/root/.tiup/data/S9Cwas2) failed: exit status 1

[root@tidb1 ~]# cat /root/logs/tiup-cluster-debug-2020-08-31-11-04-38.log
2020-08-31T11:04:32.695+0800	INFO	Execute command	{"command": "tiup cluster scale-out tidb-hh scale-out.yaml --user root"}
2020-08-31T11:04:32.695+0800	DEBUG	Environment variables	{"env": ["TIUP_HOME=/root/.tiup", "TIUP_WORK_DIR=/root", "TIUP_INSTANCE_DATA_DIR=/root/.tiup/data/S9Cwas2", "TIUP_COMPONENT_DATA_DIR=/root/.tiup/storage/cluster", "TIUP_COMPONENT_INSTALL_DIR=/root/.tiup/components/cluster/v1.0.8", "TIUP_TELEMETRY_STATUS=disable", "TIUP_TELEMETRY_UUID=eaea9aa7-a373-40f4-bf2f-61b3b58352a0", "TIUP_TAG=S9Cwas2", "XDG_SESSION_ID=49322", "HOSTNAME=tidb1", "TERM=xterm-256color", "SHELL=/bin/bash", "HISTSIZE=1000", "SSH_CLIENT=192.168.254.242 58767 22", "OLDPWD=/root/.tiup/components/cluster", "SSH_TTY=/dev/pts/1", "USER=root", "LS_COLORS=rs=0:di=38;5;27:ln=38;5;51:mh=44;38;5;15:pi=40;38;5;11:so=38;5;13:do=38;5;5:bd=48;5;232;38;5;11:cd=48;5;232;38;5;3:or=48;5;232;38;5;9:mi=05;48;5;232;38;5;15:su=48;5;196;38;5;15:sg=48;5;11;38;5;16:ca=48;5;196;38;5;226:tw=48;5;10;38;5;16:ow=48;5;10;38;5;21:st=48;5;21;38;5;15:ex=38;5;34:*.tar=38;5;9:*.tgz=38;5;9:*.arc=38;5;9:*.arj=38;5;9:*.taz=38;5;9:*.lha=38;5;9:*.lz4=38;5;9:*.lzh=38;5;9:*.lzma=38;5;9:*.tlz=38;5;9:*.txz=38;5;9:*.tzo=38;5;9:*.t7z=38;5;9:*.zip=38;5;9:*.z=38;5;9:*.Z=38;5;9:*.dz=38;5;9:*.gz=38;5;9:*.lrz=38;5;9:*.lz=38;5;9:*.lzo=38;5;9:*.xz=38;5;9:*.bz2=38;5;9:*.bz=38;5;9:*.tbz=38;5;9:*.tbz2=38;5;9:*.tz=38;5;9:*.deb=38;5;9:*.rpm=38;5;9:*.jar=38;5;9:*.war=38;5;9:*.ear=38;5;9:*.sar=38;5;9:*.rar=38;5;9:*.alz=38;5;9:*.ace=38;5;9:*.zoo=38;5;9:*.cpio=38;5;9:*.7z=38;5;9:*.rz=38;5;9:*.cab=38;5;9:*.jpg=38;5;13:*.jpeg=38;5;13:*.gif=38;5;13:*.bmp=38;5;13:*.pbm=38;5;13:*.pgm=38;5;13:*.ppm=38;5;13:*.tga=38;5;13:*.xbm=38;5;13:*.xpm=38;5;13:*.tif=38;5;13:*.tiff=38;5;13:*.png=38;5;13:*.svg=38;5;13:*.svgz=38;5;13:*.mng=38;5;13:*.pcx=38;5;13:*.mov=38;5;13:*.mpg=38;5;13:*.mpeg=38;5;13:*.m2v=38;5;13:*.mkv=38;5;13:*.webm=38;5;13:*.ogm=38;5;13:*.mp4=38;5;13:*.m4v=38;5;13:*.mp4v=38;5;13:*.vob=38;5;13:*.qt=38;5;13:*.nuv=38;5;13:*.wmv=38;5;13:*.asf=38;5;13:*.rm=38;5;13:*.rmvb=38;5;13:*.flc=38;5;13:*.avi=38;5;13:*.fli=38;5;13:*.flv=38;5;13:*.gl=38;5;13:*.dl=38;5;13:*.xcf=38;5;13:*.xwd=38;5;13:*.yuv=38;5;13:*.cgm=38;5;13:*.emf=38;5;13:*.axv=38;5;13:*.anx=38;5;13:*.ogv=38;5;13:*.ogx=38;5;13:*.aac=38;5;45:*.au=38;5;45:*.flac=38;5;45:*.mid=38;5;45:*.midi=38;5;45:*.mka=38;5;45:*.mp3=38;5;45:*.mpc=38;5;45:*.ogg=38;5;45:*.ra=38;5;45:*.wav=38;5;45:*.axa=38;5;45:*.oga=38;5;45:*.spx=38;5;45:*.xspf=38;5;45:", "COBBLER_SERVER=192.168.254.251", "MAIL=/var/spool/mail/root", "PATH=/root/.tiup/bin:/root/.tiup/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/root/bin:/root/bin", "PWD=/root", "LANG=zh_CN.UTF-8", "HISTCONTROL=ignoredups", "SHLVL=1", "HOME=/root", "GODEBUG=madvdontneed=1", "LOGNAME=root", "SSH_CONNECTION=192.168.254.242 58767 192.168.247.74 22", "LESSOPEN=||/usr/bin/lesspipe.sh %s", "XDG_RUNTIME_DIR=/run/user/0", "_=/root/.tiup/bin/tiup", "TIUP_MIRRORS=/root/tidb-community-server-v4.0.0-linux-amd64/"]}
2020-08-31T11:04:32.702+0800	DEBUG	Parse topology file	{"file": "scale-out.yaml"}
2020-08-31T11:04:32.703+0800	DEBUG	Parse topology file succeeded	{"topology": {"GlobalOptions":{"User":"root","SSHPort":22,"DeployDir":"/opt/tidb-deploy","DataDir":"/tidb-data","LogDir":"","ResourceControl":{"MemoryLimit":"","CPUQuota":"","IOReadBandwidthMax":"","IOWriteBandwidthMax":""},"OS":"linux","Arch":"amd64"},"MonitoredOptions":{"NodeExporterPort":9100,"BlackboxExporterPort":9115,"DeployDir":"/opt/tidb-deploy/monitor-9100","DataDir":"/tidb-data/monitor-9100","LogDir":"/opt/tidb-deploy/monitor-9100/log","NumaNode":"","ResourceControl":{"MemoryLimit":"","CPUQuota":"","IOReadBandwidthMax":"","IOWriteBandwidthMax":""}},"ServerConfigs":{"TiDB":{"enable-telemetry":false,"log.slow-threshold":3000,"mem-quota-query":2147483648},"TiKV":{"raftdb.defaultcf.compression-per-level":["no","no","no","lz4","lz4","zstd","zstd"],"raftdb.defaultcf.max-bytes-for-level-base":"512MB","raftdb.defaultcf.target-file-size-base":"32MB","raftdb.defaultcf.write-buffer-size":"128MB","raftdb.max-background-jobs":8,"raftdb.max-open-files":65535,"raftdb.max-write-buffer-number":8,"raftdb.min-write-buffer-number-to-merge":2,"raftdb.rate-bytes-per-sec":"50MB","raftstore.hibernate-regions":true,"raftstore.region-split-check-diff":"32MB","raftstore.split-region-check-tick-interval":"15s","raftstore.store-pool-size":4,"readpool.unified.max-thread-count":10,"rocksdb.defaultcf.block-size":"64KB","rocksdb.defaultcf.compression-per-level":["no","no","no","lz4","lz4","zstd","zstd"],"rocksdb.defaultcf.max-bytes-for-level-base":"512MB","rocksdb.defaultcf.target-file-size-base":"32MB","rocksdb.defaultcf.write-buffer-size":"128MB","rocksdb.max-background-jobs":4,"rocksdb.max-write-buffer-number":8,"rocksdb.min-write-buffer-number-to-merge":2,"rocksdb.rate-bytes-per-sec":"100MB","server.grpc-concurrency":6,"storage.block-cache.capacity":"16G","storage.scheduler-worker-pool-size":8},"PD":{"replication.enable-placement-rules":true},"TiFlash":{},"TiFlashLearner":{},"Pump":{},"Drainer":{},"CDC":{}},"TiDBServers":[{"Host":"192.168.247.74","ListenHost":"","SSHPort":22,"Imported":false,"Port":4000,"StatusPort":10080,"DeployDir":"/opt/tidb-deploy/tidb-4000","LogDir":"/opt/tidb-deploy/tidb-4000/log","NumaNode":"","Config":null,"ResourceControl":{"MemoryLimit":"","CPUQuota":"","IOReadBandwidthMax":"","IOWriteBandwidthMax":""},"Arch":"amd64","OS":"linux"}],"TiKVServers":null,"TiFlashServers":null,"PDServers":null,"PumpServers":null,"Drainers":null,"CDCServers":null,"Monitors":null,"Grafana":null,"Alertmanager":null}}
.
.
.
.

2020-08-31T11:04:33.805+0800	DEBUG	TaskFinish	{"task": "UserSSH: user=root, host=192.168.247.74\
UserSSH: user=root, host=192.168.247.77\
UserSSH: user=root, host=192.168.247.78\
UserSSH: user=root, host=192.168.247.74\
UserSSH: user=root, host=192.168.247.77\
UserSSH: user=root, host=192.168.247.78\
UserSSH: user=root, host=192.168.247.77\
UserSSH: user=root, host=192.168.247.78\
UserSSH: user=root, host=192.168.247.74\
UserSSH: user=root, host=192.168.247.74\
UserSSH: user=root, host=192.168.247.74\
UserSSH: user=root, host=192.168.247.74"}
2020-08-31T11:04:33.806+0800	DEBUG	TaskBegin	{"task": "UserSSH: user=root, host=192.168.247.74\
Mkdir: host=192.168.247.74, directories='/opt/tidb-deploy/tidb-4000','/opt/tidb-deploy/tidb-4000/log','/opt/tidb-deploy/tidb-4000/bin','/opt/tidb-deploy/tidb-4000/conf','/opt/tidb-deploy/tidb-4000/scripts'\
Mkdir: host=192.168.247.74, directories=''\
CopyComponent: component=tidb, version=v4.0.0, remote=192.168.247.74:/opt/tidb-deploy/tidb-4000 os=linux, arch=amd64\
ScaleConfig: cluster=tidb-hh, user=root, host=192.168.247.74, service=tidb-4000.service, deploy_dir=/opt/tidb-deploy/tidb-4000, data_dir=[], log_dir=/opt/tidb-deploy/tidb-4000/log, cache_dir="}
2020-08-31T11:04:33.806+0800	DEBUG	TaskBegin	{"task": "UserSSH: user=root, host=192.168.247.74\
Mkdir: host=192.168.247.74, directories='/opt/tidb-deploy/tidb-4000','/opt/tidb-deploy/tidb-4000/log','/opt/tidb-deploy/tidb-4000/bin','/opt/tidb-deploy/tidb-4000/conf','/opt/tidb-deploy/tidb-4000/scripts'\
Mkdir: host=192.168.247.74, directories=''\
CopyComponent: component=tidb, version=v4.0.0, remote=192.168.247.74:/opt/tidb-deploy/tidb-4000 os=linux, arch=amd64\
ScaleConfig: cluster=tidb-hh, user=root, host=192.168.247.74, service=tidb-4000.service, deploy_dir=/opt/tidb-deploy/tidb-4000, data_dir=[], log_dir=/opt/tidb-deploy/tidb-4000/log, cache_dir="}
2020-08-31T11:04:33.806+0800	INFO	+ [ Serial ] - UserSSH: user=root, host=192.168.247.74
2020-08-31T11:04:33.806+0800	DEBUG	TaskBegin	{"task": "UserSSH: user=root, host=192.168.247.74"}
2020-08-31T11:04:33.806+0800	DEBUG	TaskFinish	{"task": "UserSSH: user=root, host=192.168.247.74"}
2020-08-31T11:04:33.806+0800	INFO	+ [ Serial ] - Mkdir: host=192.168.247.74, directories='/opt/tidb-deploy/tidb-4000','/opt/tidb-deploy/tidb-4000/log','/opt/tidb-deploy/tidb-4000/bin','/opt/tidb-deploy/tidb-4000/conf','/opt/tidb-deploy/tidb-4000/scripts'
2020-08-31T11:04:33.806+0800	DEBUG	TaskBegin	{"task": "Mkdir: host=192.168.247.74, directories='/opt/tidb-deploy/tidb-4000','/opt/tidb-deploy/tidb-4000/log','/opt/tidb-deploy/tidb-4000/bin','/opt/tidb-deploy/tidb-4000/conf','/opt/tidb-deploy/tidb-4000/scripts'"}
2020-08-31T11:04:33.969+0800	INFO	SSHCommand	{"host": "192.168.247.74", "port": "22", "cmd": "export LANG=C; PATH=$PATH:/usr/bin:/usr/sbin sudo -H -u root bash -c \"test -d /opt || (mkdir -p /opt && chown root:root /opt)\"", "stdout": "", "stderr": ""}
2020-08-31T11:04:34.103+0800	INFO	SSHCommand	{"host": "192.168.247.74", "port": "22", "cmd": "export LANG=C; PATH=$PATH:/usr/bin:/usr/sbin sudo -H -u root bash -c \"test -d /opt/tidb-deploy || (mkdir -p /opt/tidb-deploy && chown root:root /opt/tidb-deploy)\"", "stdout": "", "stderr": ""}
2020-08-31T11:04:34.236+0800	INFO	SSHCommand	{"host": "192.168.247.74", "port": "22", "cmd": "export LANG=C; PATH=$PATH:/usr/bin:/usr/sbin sudo -H -u root bash -c \"test -d /opt/tidb-deploy/tidb-4000 || (mkdir -p /opt/tidb-deploy/tidb-4000 && chown root:root /opt/tidb-deploy/tidb-4000)\"", "stdout": "", "stderr": ""}
2020-08-31T11:04:34.361+0800	INFO	SSHCommand	{"host": "192.168.247.74", "port": "22", "cmd": "export LANG=C; PATH=$PATH:/usr/bin:/usr/sbin sudo -H -u root bash -c \"test -d /opt || (mkdir -p /opt && chown root:root /opt)\"", "stdout": "", "stderr": ""}
2020-08-31T11:04:34.492+0800	INFO	SSHCommand	{"host": "192.168.247.74", "port": "22", "cmd": "export LANG=C; PATH=$PATH:/usr/bin:/usr/sbin sudo -H -u root bash -c \"test -d /opt/tidb-deploy || (mkdir -p /opt/tidb-deploy && chown root:root /opt/tidb-deploy)\"", "stdout": "", "stderr": ""}
2020-08-31T11:04:34.607+0800	INFO	SSHCommand	{"host": "192.168.247.74", "port": "22", "cmd": "export LANG=C; PATH=$PATH:/usr/bin:/usr/sbin sudo -H -u root bash -c \"test -d /opt/tidb-deploy/tidb-4000 || (mkdir -p /opt/tidb-deploy/tidb-4000 && chown root:root /opt/tidb-deploy/tidb-4000)\"", "stdout": "", "stderr": ""}
2020-08-31T11:04:34.742+0800	INFO	SSHCommand	{"host": "192.168.247.74", "port": "22", "cmd": "export LANG=C; PATH=$PATH:/usr/bin:/usr/sbin sudo -H -u root bash -c \"test -d /opt/tidb-deploy/tidb-4000/log || (mkdir -p /opt/tidb-deploy/tidb-4000/log && chown root:root /opt/tidb-deploy/tidb-4000/log)\"", "stdout": "", "stderr": ""}
2020-08-31T11:04:34.897+0800	INFO	SSHCommand	{"host": "192.168.247.74", "port": "22", "cmd": "export LANG=C; PATH=$PATH:/usr/bin:/usr/sbin sudo -H -u root bash -c \"test -d /opt || (mkdir -p /opt && chown root:root /opt)\"", "stdout": "", "stderr": ""}
2020-08-31T11:04:35.040+0800	INFO	SSHCommand	{"host": "192.168.247.74", "port": "22", "cmd": "export LANG=C; PATH=$PATH:/usr/bin:/usr/sbin sudo -H -u root bash -c \"test -d /opt/tidb-deploy || (mkdir -p /opt/tidb-deploy && chown root:root /opt/tidb-deploy)\"", "stdout": "", "stderr": ""}
2020-08-31T11:04:35.179+0800	INFO	SSHCommand	{"host": "192.168.247.74", "port": "22", "cmd": "export LANG=C; PATH=$PATH:/usr/bin:/usr/sbin sudo -H -u root bash -c \"test -d /opt/tidb-deploy/tidb-4000 || (mkdir -p /opt/tidb-deploy/tidb-4000 && chown root:root /opt/tidb-deploy/tidb-4000)\"", "stdout": "", "stderr": ""}
2020-08-31T11:04:35.315+0800	INFO	SSHCommand	{"host": "192.168.247.74", "port": "22", "cmd": "export LANG=C; PATH=$PATH:/usr/bin:/usr/sbin sudo -H -u root bash -c \"test -d /opt/tidb-deploy/tidb-4000/bin || (mkdir -p /opt/tidb-deploy/tidb-4000/bin && chown root:root /opt/tidb-deploy/tidb-4000/bin)\"", "stdout": "", "stderr": ""}
2020-08-31T11:04:35.462+0800	INFO	SSHCommand	{"host": "192.168.247.74", "port": "22", "cmd": "export LANG=C; PATH=$PATH:/usr/bin:/usr/sbin sudo -H -u root bash -c \"test -d /opt || (mkdir -p /opt && chown root:root /opt)\"", "stdout": "", "stderr": ""}
2020-08-31T11:04:35.596+0800	INFO	SSHCommand	{"host": "192.168.247.74", "port": "22", "cmd": "export LANG=C; PATH=$PATH:/usr/bin:/usr/sbin sudo -H -u root bash -c \"test -d /opt/tidb-deploy || (mkdir -p /opt/tidb-deploy && chown root:root /opt/tidb-deploy)\"", "stdout": "", "stderr": ""}
2020-08-31T11:04:35.747+0800	INFO	SSHCommand	{"host": "192.168.247.74", "port": "22", "cmd": "export LANG=C; PATH=$PATH:/usr/bin:/usr/sbin sudo -H -u root bash -c \"test -d /opt/tidb-deploy/tidb-4000 || (mkdir -p /opt/tidb-deploy/tidb-4000 && chown root:root /opt/tidb-deploy/tidb-4000)\"", "stdout": "", "stderr": ""}
2020-08-31T11:04:35.881+0800	INFO	SSHCommand	{"host": "192.168.247.74", "port": "22", "cmd": "export LANG=C; PATH=$PATH:/usr/bin:/usr/sbin sudo -H -u root bash -c \"test -d /opt/tidb-deploy/tidb-4000/conf || (mkdir -p /opt/tidb-deploy/tidb-4000/conf && chown root:root /opt/tidb-deploy/tidb-4000/conf)\"", "stdout": "", "stderr": ""}
2020-08-31T11:04:36.019+0800	INFO	SSHCommand	{"host": "192.168.247.74", "port": "22", "cmd": "export LANG=C; PATH=$PATH:/usr/bin:/usr/sbin sudo -H -u root bash -c \"test -d /opt || (mkdir -p /opt && chown root:root /opt)\"", "stdout": "", "stderr": ""}
2020-08-31T11:04:36.174+0800	INFO	SSHCommand	{"host": "192.168.247.74", "port": "22", "cmd": "export LANG=C; PATH=$PATH:/usr/bin:/usr/sbin sudo -H -u root bash -c \"test -d /opt/tidb-deploy || (mkdir -p /opt/tidb-deploy && chown root:root /opt/tidb-deploy)\"", "stdout": "", "stderr": ""}
2020-08-31T11:04:36.325+0800	INFO	SSHCommand	{"host": "192.168.247.74", "port": "22", "cmd": "export LANG=C; PATH=$PATH:/usr/bin:/usr/sbin sudo -H -u root bash -c \"test -d /opt/tidb-deploy/tidb-4000 || (mkdir -p /opt/tidb-deploy/tidb-4000 && chown root:root /opt/tidb-deploy/tidb-4000)\"", "stdout": "", "stderr": ""}
2020-08-31T11:04:36.464+0800	INFO	SSHCommand	{"host": "192.168.247.74", "port": "22", "cmd": "export LANG=C; PATH=$PATH:/usr/bin:/usr/sbin sudo -H -u root bash -c \"test -d /opt/tidb-deploy/tidb-4000/scripts || (mkdir -p /opt/tidb-deploy/tidb-4000/scripts && chown root:root /opt/tidb-deploy/tidb-4000/scripts)\"", "stdout": "", "stderr": ""}
2020-08-31T11:04:36.464+0800	DEBUG	TaskFinish	{"task": "Mkdir: host=192.168.247.74, directories='/opt/tidb-deploy/tidb-4000','/opt/tidb-deploy/tidb-4000/log','/opt/tidb-deploy/tidb-4000/bin','/opt/tidb-deploy/tidb-4000/conf','/opt/tidb-deploy/tidb-4000/scripts'"}
2020-08-31T11:04:36.464+0800	INFO	+ [ Serial ] - Mkdir: host=192.168.247.74, directories=''
2020-08-31T11:04:36.464+0800	DEBUG	TaskBegin	{"task": "Mkdir: host=192.168.247.74, directories=''"}
2020-08-31T11:04:36.464+0800	DEBUG	TaskFinish	{"task": "Mkdir: host=192.168.247.74, directories=''"}
2020-08-31T11:04:36.464+0800	INFO	+ [ Serial ] - CopyComponent: component=tidb, version=v4.0.0, remote=192.168.247.74:/opt/tidb-deploy/tidb-4000 os=linux, arch=amd64
2020-08-31T11:04:36.464+0800	DEBUG	TaskBegin	{"task": "CopyComponent: component=tidb, version=v4.0.0, remote=192.168.247.74:/opt/tidb-deploy/tidb-4000 os=linux, arch=amd64"}
2020-08-31T11:04:37.662+0800	INFO	SSHCommand	{"host": "192.168.247.74", "port": "22", "cmd": "export LANG=C; PATH=$PATH:/usr/bin:/usr/sbin tar -xzf /opt/tidb-deploy/tidb-4000/bin/tidb-v4.0.0-linux-amd64.tar.gz -C /opt/tidb-deploy/tidb-4000/bin && rm /opt/tidb-deploy/tidb-4000/bin/tidb-v4.0.0-linux-amd64.tar.gz", "stdout": "", "stderr": ""}
2020-08-31T11:04:37.662+0800	DEBUG	TaskFinish	{"task": "CopyComponent: component=tidb, version=v4.0.0, remote=192.168.247.74:/opt/tidb-deploy/tidb-4000 os=linux, arch=amd64"}
2020-08-31T11:04:37.662+0800	INFO	+ [ Serial ] - ScaleConfig: cluster=tidb-hh, user=root, host=192.168.247.74, service=tidb-4000.service, deploy_dir=/opt/tidb-deploy/tidb-4000, data_dir=[], log_dir=/opt/tidb-deploy/tidb-4000/log, cache_dir=
2020-08-31T11:04:37.662+0800	DEBUG	TaskBegin	{"task": "ScaleConfig: cluster=tidb-hh, user=root, host=192.168.247.74, service=tidb-4000.service, deploy_dir=/opt/tidb-deploy/tidb-4000, data_dir=[], log_dir=/opt/tidb-deploy/tidb-4000/log, cache_dir="}
2020-08-31T11:04:37.955+0800	INFO	SSHCommand	{"host": "192.168.247.74", "port": "22", "cmd": "export LANG=C; PATH=$PATH:/usr/bin:/usr/sbin sudo -H -u root bash -c \"mv /tmp/tidb_ecfe1502-bd30-4ebc-b656-eb4e7ca993ae.service /etc/systemd/system/tidb-4000.service\"", "stdout": "", "stderr": ""}
2020-08-31T11:04:38.220+0800	INFO	SSHCommand	{"host": "192.168.247.74", "port": "22", "cmd": "export LANG=C; PATH=$PATH:/usr/bin:/usr/sbin chmod +x /opt/tidb-deploy/tidb-4000/scripts/run_tidb.sh", "stdout": "", "stderr": ""}
2020-08-31T11:04:38.540+0800	INFO	SSHCommand	{"host": "192.168.247.74", "port": "22", "cmd": "export LANG=C; PATH=$PATH:/usr/bin:/usr/sbin /opt/tidb-deploy/tidb-4000/bin/tidb-server --help", "error": "Process exited with status 2", "stdout": "", "stderr": "Usage of /opt/tidb-deploy/tidb-4000/bin/tidb-server:\
  -L string\
    \tlog level: info, debug, warn, error, fatal (default \"info\")\
  -P string\
    \ttidb server port (default \"4000\")\
  -V\tprint version information and exit (default false)\
  -advertise-address string\
    \ttidb server advertise IP\
  -affinity-cpus string\
    \taffinity cpu (cpu-no. separated by comma, e.g. 1,2,3)\
  -config string\
    \tconfig file path\
  -config-check\
    \tcheck config file validity and exit (default false)\
  -config-strict\
    \tenforce config file validity (default false)\
  -cors string\
    \ttidb server allow cors origin\
  -enable-binlog\
    \tenable generate binlog (default false)\
  -host string\
    \ttidb server host (default \"0.0.0.0\")\
  -lease string\
    \tschema lease duration, very dangerous to change only if you know what you do (default \"45s\")\
  -log-file string\
    \tlog file path\
  -log-slow-query string\
    \tslow query file path\
  -metrics-addr string\
    \tprometheus pushgateway address, leaves it empty will disable prometheus push.\
  -metrics-interval uint\
    \tprometheus client push interval in second, set \"0\" to disable prometheus push. (default 15)\
  -path string\
    \ttidb storage path (default \"/tmp/tidb\")\
  -plugin-dir string\
    \tthe folder that hold plugin (default \"/data/deploy/plugin\")\
  -plugin-load string\
    \twait load plugin name(separated by comma)\
  -proxy-protocol-header-timeout uint\
    \tproxy protocol header read timeout, unit is second. (default 5)\
  -proxy-protocol-networks string\
    \tproxy protocol networks allowed IP or *, empty mean disable proxy protocol support\
  -repair-list string\
    \tadmin repair table list\
  -repair-mode\
    \tenable admin repair mode (default false)\
  -report-status\
    \tIf enable status report HTTP service. (default true)\
  -require-secure-transport\
    \trequire client use secure transport\
  -run-ddl\
    \trun ddl worker on this tidb-server (default true)\
  -socket string\
    \tThe socket file to use for connection.\
  -status string\
    \ttidb server status port (default \"10080\")\
  -status-host string\
    \ttidb server status host (default \"0.0.0.0\")\
  -store string\
    \tregistered store name, [tikv, mocktikv] (default \"mocktikv\")\
  -token-limit int\
    \tthe limit of concurrent executed sessions (default 1000)\
"}
2020-08-31T11:04:38.710+0800	INFO	SSHCommand	{"host": "192.168.247.74", "port": "22", "cmd": "export LANG=C; PATH=$PATH:/usr/bin:/usr/sbin /opt/tidb-deploy/tidb-4000/bin/tidb-server --config-check --config=/opt/tidb-deploy/tidb-4000/conf/tidb.toml ", "error": "Process exited with status 1", "stdout": "[2020/08/31 11:04:38.706 +08:00] [FATAL] [terror.go:348] [\"unexpected error\"] [error=\"config file /opt/tidb-deploy/tidb-4000/conf/tidb.toml contained unknown configuration options: enable-telemetry\"] [stack=\"github.com/pingcap/log.Fatal\\
\\t/home/jenkins/agent/workspace/tidb_v4.0.0/go/pkg/mod/github.com/pingcap/log@v0.0.0-20200511115504-543df19646ad/global.go:59\\
github.com/pingcap/parser/terror.MustNil\\
\\t/home/jenkins/agent/workspace/tidb_v4.0.0/go/pkg/mod/github.com/pingcap/parser@v0.0.0-20200525110646-f45c2cee1dca/terror/terror.go:348\\
github.com/pingcap/tidb/config.InitializeConfig\\
\\t/home/jenkins/agent/workspace/tidb_v4.0.0/go/src/github.com/pingcap/tidb/config/config.go:743\\
main.main\\
\\t/home/jenkins/agent/workspace/tidb_v4.0.0/go/src/github.com/pingcap/tidb/tidb-server/main.go:168\\
runtime.main\\
\\t/usr/local/go/src/runtime/proc.go:203\"]\
", "stderr": ""}
2020-08-31T11:04:38.710+0800	DEBUG	TaskFinish	{"task": "ScaleConfig: cluster=tidb-hh, user=root, host=192.168.247.74, service=tidb-4000.service, deploy_dir=/opt/tidb-deploy/tidb-4000, data_dir=[], log_dir=/opt/tidb-deploy/tidb-4000/log, cache_dir=/root/.tiup/storage/cluster/clusters/tidb-hh/config-cache", "error": "executor.ssh.execute_failed: Failed to execute command over SSH for 'root@192.168.247.74:22' {ssh_stderr: , ssh_stdout: [2020/08/31 11:04:38.706 +08:00] [FATAL] [terror.go:348] [\"unexpected error\"] [error=\"config file /opt/tidb-deploy/tidb-4000/conf/tidb.toml contained unknown configuration options: enable-telemetry\"] [stack=\"github.com/pingcap/log.Fatal\\
\\t/home/jenkins/agent/workspace/tidb_v4.0.0/go/pkg/mod/github.com/pingcap/log@v0.0.0-20200511115504-543df19646ad/global.go:59\\
github.com/pingcap/parser/terror.MustNil\\
\\t/home/jenkins/agent/workspace/tidb_v4.0.0/go/pkg/mod/github.com/pingcap/parser@v0.0.0-20200525110646-f45c2cee1dca/terror/terror.go:348\\
github.com/pingcap/tidb/config.InitializeConfig\\
\\t/home/jenkins/agent/workspace/tidb_v4.0.0/go/src/github.com/pingcap/tidb/config/config.go:743\\
main.main\\
\\t/home/jenkins/agent/workspace/tidb_v4.0.0/go/src/github.com/pingcap/tidb/tidb-server/main.go:168\\
runtime.main\\
\\t/usr/local/go/src/runtime/proc.go:203\"]\
, ssh_command: export LANG=C; PATH=$PATH:/usr/bin:/usr/sbin /opt/tidb-deploy/tidb-4000/bin/tidb-server --config-check --config=/opt/tidb-deploy/tidb-4000/conf/tidb.toml }, cause: Process exited with status 1: check config failed", "errorVerbose": "check config failed\
executor.ssh.execute_failed: Failed to execute command over SSH for 'root@192.168.247.74:22' {ssh_stderr: , ssh_stdout: [2020/08/31 11:04:38.706 +08:00] [FATAL] [terror.go:348] [\"unexpected error\"] [error=\"config file /opt/tidb-deploy/tidb-4000/conf/tidb.toml contained unknown configuration options: enable-telemetry\"] [stack=\"github.com/pingcap/log.Fatal\\
\\t/home/jenkins/agent/workspace/tidb_v4.0.0/go/pkg/mod/github.com/pingcap/log@v0.0.0-20200511115504-543df19646ad/global.go:59\\
github.com/pingcap/parser/terror.MustNil\\
\\t/home/jenkins/agent/workspace/tidb_v4.0.0/go/pkg/mod/github.com/pingcap/parser@v0.0.0-20200525110646-f45c2cee1dca/terror/terror.go:348\\
github.com/pingcap/tidb/config.InitializeConfig\\
\\t/home/jenkins/agent/workspace/tidb_v4.0.0/go/src/github.com/pingcap/tidb/config/config.go:743\\
main.main\\
\\t/home/jenkins/agent/workspace/tidb_v4.0.0/go/src/github.com/pingcap/tidb/tidb-server/main.go:168\\
runtime.main\\
\\t/usr/local/go/src/runtime/proc.go:203\"]\
, ssh_command: export LANG=C; PATH=$PATH:/usr/bin:/usr/sbin /opt/tidb-deploy/tidb-4000/bin/tidb-server --config-check --config=/opt/tidb-deploy/tidb-4000/conf/tidb.toml }, cause: Process exited with status 1\
github.com/pingcap/tiup/pkg/cluster/spec.checkConfig\
\tgithub.com/pingcap/tiup@/pkg/cluster/spec/server_config.go:196\
github.com/pingcap/tiup/pkg/cluster/spec.(*TiDBInstance).InitConfig\
\tgithub.com/pingcap/tiup@/pkg/cluster/spec/tidb.go:181\
github.com/pingcap/tiup/pkg/cluster/spec.(*TiDBInstance).ScaleConfig\
\tgithub.com/pingcap/tiup@/pkg/cluster/spec/tidb.go:189\
github.com/pingcap/tiup/pkg/cluster/task.(*ScaleConfig).Execute\
\tgithub.com/pingcap/tiup@/pkg/cluster/task/scale_config.go:47\
github.com/pingcap/tiup/pkg/cluster/task.(*Serial).Execute\
\tgithub.com/pingcap/tiup@/pkg/cluster/task/task.go:189\
github.com/pingcap/tiup/pkg/cluster/task.(*Parallel).Execute.func1\
\tgithub.com/pingcap/tiup@/pkg/cluster/task/task.go:242\
runtime.goexit\
\truntime/asm_amd64.s:1357"}
2020-08-31T11:04:38.710+0800	DEBUG	TaskFinish	{"task": "UserSSH: user=root, host=192.168.247.74\
Mkdir: host=192.168.247.74, directories='/opt/tidb-deploy/tidb-4000','/opt/tidb-deploy/tidb-4000/log','/opt/tidb-deploy/tidb-4000/bin','/opt/tidb-deploy/tidb-4000/conf','/opt/tidb-deploy/tidb-4000/scripts'\
Mkdir: host=192.168.247.74, directories=''\
CopyComponent: component=tidb, version=v4.0.0, remote=192.168.247.74:/opt/tidb-deploy/tidb-4000 os=linux, arch=amd64\
ScaleConfig: cluster=tidb-hh, user=root, host=192.168.247.74, service=tidb-4000.service, deploy_dir=/opt/tidb-deploy/tidb-4000, data_dir=[], log_dir=/opt/tidb-deploy/tidb-4000/log, cache_dir=/root/.tiup/storage/cluster/clusters/tidb-hh/config-cache", "error": "executor.ssh.execute_failed: Failed to execute command over SSH for 'root@192.168.247.74:22' {ssh_stderr: , ssh_stdout: [2020/08/31 11:04:38.706 +08:00] [FATAL] [terror.go:348] [\"unexpected error\"] [error=\"config file /opt/tidb-deploy/tidb-4000/conf/tidb.toml contained unknown configuration options: enable-telemetry\"] [stack=\"github.com/pingcap/log.Fatal\\
\\t/home/jenkins/agent/workspace/tidb_v4.0.0/go/pkg/mod/github.com/pingcap/log@v0.0.0-20200511115504-543df19646ad/global.go:59\\
github.com/pingcap/parser/terror.MustNil\\
\\t/home/jenkins/agent/workspace/tidb_v4.0.0/go/pkg/mod/github.com/pingcap/parser@v0.0.0-20200525110646-f45c2cee1dca/terror/terror.go:348\\
github.com/pingcap/tidb/config.InitializeConfig\\
\\t/home/jenkins/agent/workspace/tidb_v4.0.0/go/src/github.com/pingcap/tidb/config/config.go:743\\
main.main\\
\\t/home/jenkins/agent/workspace/tidb_v4.0.0/go/src/github.com/pingcap/tidb/tidb-server/main.go:168\\
runtime.main\\
\\t/usr/local/go/src/runtime/proc.go:203\"]\
, ssh_command: export LANG=C; PATH=$PATH:/usr/bin:/usr/sbin /opt/tidb-deploy/tidb-4000/bin/tidb-server --config-check --config=/opt/tidb-deploy/tidb-4000/conf/tidb.toml }, cause: Process exited with status 1: check config failed", "errorVerbose": "check config failed\
executor.ssh.execute_failed: Failed to execute command over SSH for 'root@192.168.247.74:22' {ssh_stderr: , ssh_stdout: [2020/08/31 11:04:38.706 +08:00] [FATAL] [terror.go:348] [\"unexpected error\"] [error=\"config file /opt/tidb-deploy/tidb-4000/conf/tidb.toml contained unknown configuration options: enable-telemetry\"] [stack=\"github.com/pingcap/log.Fatal\\
\\t/home/jenkins/agent/workspace/tidb_v4.0.0/go/pkg/mod/github.com/pingcap/log@v0.0.0-20200511115504-543df19646ad/global.go:59\\
github.com/pingcap/parser/terror.MustNil\\
\\t/home/jenkins/agent/workspace/tidb_v4.0.0/go/pkg/mod/github.com/pingcap/parser@v0.0.0-20200525110646-f45c2cee1dca/terror/terror.go:348\\
github.com/pingcap/tidb/config.InitializeConfig\\
\\t/home/jenkins/agent/workspace/tidb_v4.0.0/go/src/github.com/pingcap/tidb/config/config.go:743\\
main.main\\
\\t/home/jenkins/agent/workspace/tidb_v4.0.0/go/src/github.com/pingcap/tidb/tidb-server/main.go:168\\
runtime.main\\
\\t/usr/local/go/src/runtime/proc.go:203\"]\
, ssh_command: export LANG=C; PATH=$PATH:/usr/bin:/usr/sbin /opt/tidb-deploy/tidb-4000/bin/tidb-server --config-check --config=/opt/tidb-deploy/tidb-4000/conf/tidb.toml }, cause: Process exited with status 1\
github.com/pingcap/tiup/pkg/cluster/spec.checkConfig\
\tgithub.com/pingcap/tiup@/pkg/cluster/spec/server_config.go:196\
github.com/pingcap/tiup/pkg/cluster/spec.(*TiDBInstance).InitConfig\
\tgithub.com/pingcap/tiup@/pkg/cluster/spec/tidb.go:181\
github.com/pingcap/tiup/pkg/cluster/spec.(*TiDBInstance).ScaleConfig\
\tgithub.com/pingcap/tiup@/pkg/cluster/spec/tidb.go:189\
github.com/pingcap/tiup/pkg/cluster/task.(*ScaleConfig).Execute\
\tgithub.com/pingcap/tiup@/pkg/cluster/task/scale_config.go:47\
github.com/pingcap/tiup/pkg/cluster/task.(*Serial).Execute\
\tgithub.com/pingcap/tiup@/pkg/cluster/task/task.go:189\
github.com/pingcap/tiup/pkg/cluster/task.(*Parallel).Execute.func1\
\tgithub.com/pingcap/tiup@/pkg/cluster/task/task.go:242\
runtime.goexit\
\truntime/asm_amd64.s:1357"}
2020-08-31T11:04:38.710+0800	DEBUG	TaskFinish	{"task": "UserSSH: user=root, host=192.168.247.74\
Mkdir: host=192.168.247.74, directories='/opt/tidb-deploy/tidb-4000','/opt/tidb-deploy/tidb-4000/log','/opt/tidb-deploy/tidb-4000/bin','/opt/tidb-deploy/tidb-4000/conf','/opt/tidb-deploy/tidb-4000/scripts'\
Mkdir: host=192.168.247.74, directories=''\
CopyComponent: component=tidb, version=v4.0.0, remote=192.168.247.74:/opt/tidb-deploy/tidb-4000 os=linux, arch=amd64\
ScaleConfig: cluster=tidb-hh, user=root, host=192.168.247.74, service=tidb-4000.service, deploy_dir=/opt/tidb-deploy/tidb-4000, data_dir=[], log_dir=/opt/tidb-deploy/tidb-4000/log, cache_dir=/root/.tiup/storage/cluster/clusters/tidb-hh/config-cache", "error": "executor.ssh.execute_failed: Failed to execute command over SSH for 'root@192.168.247.74:22' {ssh_stderr: , ssh_stdout: [2020/08/31 11:04:38.706 +08:00] [FATAL] [terror.go:348] [\"unexpected error\"] [error=\"config file /opt/tidb-deploy/tidb-4000/conf/tidb.toml contained unknown configuration options: enable-telemetry\"] [stack=\"github.com/pingcap/log.Fatal\\
\\t/home/jenkins/agent/workspace/tidb_v4.0.0/go/pkg/mod/github.com/pingcap/log@v0.0.0-20200511115504-543df19646ad/global.go:59\\
github.com/pingcap/parser/terror.MustNil\\
\\t/home/jenkins/agent/workspace/tidb_v4.0.0/go/pkg/mod/github.com/pingcap/parser@v0.0.0-20200525110646-f45c2cee1dca/terror/terror.go:348\\
github.com/pingcap/tidb/config.InitializeConfig\\
\\t/home/jenkins/agent/workspace/tidb_v4.0.0/go/src/github.com/pingcap/tidb/config/config.go:743\\
main.main\\
\\t/home/jenkins/agent/workspace/tidb_v4.0.0/go/src/github.com/pingcap/tidb/tidb-server/main.go:168\\
runtime.main\\
\\t/usr/local/go/src/runtime/proc.go:203\"]\
, ssh_command: export LANG=C; PATH=$PATH:/usr/bin:/usr/sbin /opt/tidb-deploy/tidb-4000/bin/tidb-server --config-check --config=/opt/tidb-deploy/tidb-4000/conf/tidb.toml }, cause: Process exited with status 1: check config failed", "errorVerbose": "check config failed\
executor.ssh.execute_failed: Failed to execute command over SSH for 'root@192.168.247.74:22' {ssh_stderr: , ssh_stdout: [2020/08/31 11:04:38.706 +08:00] [FATAL] [terror.go:348] [\"unexpected error\"] [error=\"config file /opt/tidb-deploy/tidb-4000/conf/tidb.toml contained unknown configuration options: enable-telemetry\"] [stack=\"github.com/pingcap/log.Fatal\\
\\t/home/jenkins/agent/workspace/tidb_v4.0.0/go/pkg/mod/github.com/pingcap/log@v0.0.0-20200511115504-543df19646ad/global.go:59\\
github.com/pingcap/parser/terror.MustNil\\
\\t/home/jenkins/agent/workspace/tidb_v4.0.0/go/pkg/mod/github.com/pingcap/parser@v0.0.0-20200525110646-f45c2cee1dca/terror/terror.go:348\\
github.com/pingcap/tidb/config.InitializeConfig\\
\\t/home/jenkins/agent/workspace/tidb_v4.0.0/go/src/github.com/pingcap/tidb/config/config.go:743\\
main.main\\
\\t/home/jenkins/agent/workspace/tidb_v4.0.0/go/src/github.com/pingcap/tidb/tidb-server/main.go:168\\
runtime.main\\
\\t/usr/local/go/src/runtime/proc.go:203\"]\
, ssh_command: export LANG=C; PATH=$PATH:/usr/bin:/usr/sbin /opt/tidb-deploy/tidb-4000/bin/tidb-server --config-check --config=/opt/tidb-deploy/tidb-4000/conf/tidb.toml }, cause: Process exited with status 1\
github.com/pingcap/tiup/pkg/cluster/spec.checkConfig\
\tgithub.com/pingcap/tiup@/pkg/cluster/spec/server_config.go:196\
github.com/pingcap/tiup/pkg/cluster/spec.(*TiDBInstance).InitConfig\
\tgithub.com/pingcap/tiup@/pkg/cluster/spec/tidb.go:181\
github.com/pingcap/tiup/pkg/cluster/spec.(*TiDBInstance).ScaleConfig\
\tgithub.com/pingcap/tiup@/pkg/cluster/spec/tidb.go:189\
github.com/pingcap/tiup/pkg/cluster/task.(*ScaleConfig).Execute\
\tgithub.com/pingcap/tiup@/pkg/cluster/task/scale_config.go:47\
github.com/pingcap/tiup/pkg/cluster/task.(*Serial).Execute\
\tgithub.com/pingcap/tiup@/pkg/cluster/task/task.go:189\
github.com/pingcap/tiup/pkg/cluster/task.(*Parallel).Execute.func1\
\tgithub.com/pingcap/tiup@/pkg/cluster/task/task.go:242\
runtime.goexit\
\truntime/asm_amd64.s:1357"}
2020-08-31T11:04:38.710+0800	INFO	Execute command finished	{"code": 1, "error": "executor.ssh.execute_failed: Failed to execute command over SSH for 'root@192.168.247.74:22' {ssh_stderr: , ssh_stdout: [2020/08/31 11:04:38.706 +08:00] [FATAL] [terror.go:348] [\"unexpected error\"] [error=\"config file /opt/tidb-deploy/tidb-4000/conf/tidb.toml contained unknown configuration options: enable-telemetry\"] [stack=\"github.com/pingcap/log.Fatal\\
\\t/home/jenkins/agent/workspace/tidb_v4.0.0/go/pkg/mod/github.com/pingcap/log@v0.0.0-20200511115504-543df19646ad/global.go:59\\
github.com/pingcap/parser/terror.MustNil\\
\\t/home/jenkins/agent/workspace/tidb_v4.0.0/go/pkg/mod/github.com/pingcap/parser@v0.0.0-20200525110646-f45c2cee1dca/terror/terror.go:348\\
github.com/pingcap/tidb/config.InitializeConfig\\
\\t/home/jenkins/agent/workspace/tidb_v4.0.0/go/src/github.com/pingcap/tidb/config/config.go:743\\
main.main\\
\\t/home/jenkins/agent/workspace/tidb_v4.0.0/go/src/github.com/pingcap/tidb/tidb-server/main.go:168\\
runtime.main\\
\\t/usr/local/go/src/runtime/proc.go:203\"]\
, ssh_command: export LANG=C; PATH=$PATH:/usr/bin:/usr/sbin /opt/tidb-deploy/tidb-4000/bin/tidb-server --config-check --config=/opt/tidb-deploy/tidb-4000/conf/tidb.toml }, cause: Process exited with status 1: check config failed", "errorVerbose": "check config failed\
executor.ssh.execute_failed: Failed to execute command over SSH for 'root@192.168.247.74:22' {ssh_stderr: , ssh_stdout: [2020/08/31 11:04:38.706 +08:00] [FATAL] [terror.go:348] [\"unexpected error\"] [error=\"config file /opt/tidb-deploy/tidb-4000/conf/tidb.toml contained unknown configuration options: enable-telemetry\"] [stack=\"github.com/pingcap/log.Fatal\\
\\t/home/jenkins/agent/workspace/tidb_v4.0.0/go/pkg/mod/github.com/pingcap/log@v0.0.0-20200511115504-543df19646ad/global.go:59\\
github.com/pingcap/parser/terror.MustNil\\
\\t/home/jenkins/agent/workspace/tidb_v4.0.0/go/pkg/mod/github.com/pingcap/parser@v0.0.0-20200525110646-f45c2cee1dca/terror/terror.go:348\\
github.com/pingcap/tidb/config.InitializeConfig\\
\\t/home/jenkins/agent/workspace/tidb_v4.0.0/go/src/github.com/pingcap/tidb/config/config.go:743\\
main.main\\
\\t/home/jenkins/agent/workspace/tidb_v4.0.0/go/src/github.com/pingcap/tidb/tidb-server/main.go:168\\
runtime.main\\
\\t/usr/local/go/src/runtime/proc.go:203\"]\
, ssh_command: export LANG=C; PATH=$PATH:/usr/bin:/usr/sbin /opt/tidb-deploy/tidb-4000/bin/tidb-server --config-check --config=/opt/tidb-deploy/tidb-4000/conf/tidb.toml }, cause: Process exited with status 1\
github.com/pingcap/tiup/pkg/cluster/spec.checkConfig\
\tgithub.com/pingcap/tiup@/pkg/cluster/spec/server_config.go:196\
github.com/pingcap/tiup/pkg/cluster/spec.(*TiDBInstance).InitConfig\
\tgithub.com/pingcap/tiup@/pkg/cluster/spec/tidb.go:181\
github.com/pingcap/tiup/pkg/cluster/spec.(*TiDBInstance).ScaleConfig\
\tgithub.com/pingcap/tiup@/pkg/cluster/spec/tidb.go:189\
github.com/pingcap/tiup/pkg/cluster/task.(*ScaleConfig).Execute\
\tgithub.com/pingcap/tiup@/pkg/cluster/task/scale_config.go:47\
github.com/pingcap/tiup/pkg/cluster/task.(*Serial).Execute\
\tgithub.com/pingcap/tiup@/pkg/cluster/task/task.go:189\
github.com/pingcap/tiup/pkg/cluster/task.(*Parallel).Execute.func1\
\tgithub.com/pingcap/tiup@/pkg/cluster/task/task.go:242\
runtime.goexit\
\truntime/asm_amd64.s:1357"}

我刚开始，以为集群间主机免密登陆异常，后来排查。免密登陆正常。
问题就落在了，/opt/tidb-deploy/tidb-4000/conf/tidb.toml contained unknown configuration options: enable-telemetry上，烦请帮忙看下

lucklove · 2020 年8 月 31 日 03:29

麻烦用 tiup cluster edit-config 看下，tidb 的配置里是否含有这个字段

etcxy · 2020 年8 月 31 日 03:31

包含

.
.
.
server_configs:
  tidb:
    enable-telemetry: false
    log.slow-threshold: 3000
    mem-quota-query: 2147483648
.
.
.

lucklove · 2020 年8 月 31 日 03:32

这个版本的 tidb 应该不支持这个字段，所以检查失败了，估计在部署的时候你们使用了 --ignore-config-check 这个参数，但是扩容操作还没有这个参数，所以扩容没法跳过，能不能把这个参数删掉呢？

来了老弟 · 2020 年8 月 31 日 03:33

此参数在 4.0.2 被引入，可以注释掉，升级之后在进行添加。
https://docs.pingcap.com/zh/tidb/stable/tidb-configuration-file#enable-telemetry-从-v402-版本开始引入

etcxy · 2020 年8 月 31 日 03:44

好的，谢谢。
我们还有一套测试环境，用的是最新版v4.0.4的，估计不小心把这个参数带过来了。