TiCDC 新架构试用 &tiup升级集群到v9.0.0失败--pd版本检查失败

Well · 2025 年3 月 17 日 06:42

【 TiDB 使用环境】测试
【 TiDB 版本】V8.5.1 单机集群， CDC已升级到9.0.0 OS:Rocky9.5
【复现路径】
v8.5.1 单机集群安装完成，升级ticdc到新架构9.0.0；
使用本地源，已提前克隆v9.0.0-beta.1.pre-nightly的本地镜像；
使用tiup 在线升级集群到v9.0.0失败，提示PD版本检测失败；

【遇到的问题：问题现象及影响】

升级前检查：

检查region正常

[root@tidb40 ~]# tiup cluster check tidb-test --cluster
+ Download necessary tools
  - Downloading check tools for linux/amd64 ... Done
+ Collect basic system information
+ Collect basic system information
  - Getting system info of 192.168.169.40:22 ... Done
+ Check time zone
  - Checking node 192.168.169.40 ... Done
+ Check system requirements
+ Check system requirements
+ Check system requirements
  - Checking node 192.168.169.40 ... Done
  - Checking node 192.168.169.40 ... Done
  - Checking node 192.168.169.40 ... Done
  - Checking node 192.168.169.40 ... Done
  - Checking node 192.168.169.40 ... Done
  - Checking node 192.168.169.40 ... Done
  - Checking node 192.168.169.40 ... Done
  - Checking node 192.168.169.40 ... Done
  - Checking node 192.168.169.40 ... Done
  - Checking node 192.168.169.40 ... Done
  - Checking node 192.168.169.40 ... Done
  - Checking node 192.168.169.40 ... Done
+ Cleanup check files
  - Cleanup check files on 192.168.169.40:22 ... Done
Node            Check         Result  Message
----            -----         ------  -------
192.168.169.40  cpu-governor  Warn    Unable to determine current CPU frequency governor policy
192.168.169.40  network       Pass    network speed of ens192 is 10000MB
192.168.169.40  selinux       Pass    SELinux is disabled
192.168.169.40  thp           Pass    THP is disabled
192.168.169.40  command       Pass    numactl: policy: default
192.168.169.40  permission    Pass    /tidb-deploy/tikv-20161 is writable
192.168.169.40  permission    Pass    /tidb-data/pd-2379 is writable
192.168.169.40  permission    Pass    /tidb-deploy/cdc-8302 is writable
192.168.169.40  permission    Pass    /tidb-deploy/tikv-20162 is writable
192.168.169.40  permission    Pass    /tidb-data/tikv-20160 is writable
192.168.169.40  permission    Pass    /tidb-deploy/grafana-3000 is writable
192.168.169.40  permission    Pass    /tidb-data/cdc-8300 is writable
192.168.169.40  permission    Pass    /tidb-deploy/pd-2379 is writable
192.168.169.40  permission    Pass    /tidb-data/tikv-20162 is writable
192.168.169.40  permission    Pass    /tidb-data/tikv-20161 is writable
192.168.169.40  permission    Pass    /tidb-deploy/cdc-8300 is writable
192.168.169.40  permission    Pass    /tidb-deploy/prometheus-9090 is writable
192.168.169.40  permission    Pass    /tidb-data/cdc-8301 is writable
192.168.169.40  permission    Pass    /tidb-data/cdc-8302 is writable
192.168.169.40  permission    Pass    /tidb-deploy/tidb-4000 is writable
192.168.169.40  permission    Pass    /tidb-deploy/tiflash-9000 is writable
192.168.169.40  permission    Pass    /tidb-data/tiflash-9000 is writable
192.168.169.40  permission    Pass    /tidb-deploy/cdc-8301 is writable
192.168.169.40  permission    Pass    /tidb-data/prometheus-9090 is writable
192.168.169.40  permission    Pass    /tidb-deploy/tikv-20160 is writable
192.168.169.40  os-version    Pass    OS is Rocky Linux 9.5 (Blue Onyx)
192.168.169.40  cpu-cores     Pass    number of CPU cores / threads: 16
192.168.169.40  memory        Pass    memory size is 131072MB
192.168.169.40  disk          Fail    multiple components tikv:/tidb-data/tikv-20160,tikv:/tidb-data/tikv-20161,tikv:/tidb-data/tikv-20162,tiflash:/tidb-data/tiflash-9000 are using the same partition 192.168.169.40:/tidb-data as data dir
Checking region status of the cluster tidb-test...
All regions are healthy.

tiup 升级

[root@tidb40 ~]# tiup update --self
Updated successfully!
[root@tidb40 ~]#
[root@tidb40 ~]# tiup update cluster
component cluster version v1.16.1 is already installed
Updated successfully!

检查升级组件是否存在

[root@tidb40 ~]# tiup list tikv
Available versions for tikv:
Version                    Installed  Release                    Platforms
-------                    ---------  -------                    ---------
v6.1.0                     YES        2022-06-13T12:20:53+08:00  linux/amd64
v8.5.1                     YES        2025-01-17T07:49:04Z       linux/amd64
v9.0.0-beta.1.pre-nightly  YES        2025-03-14T11:40:59Z       linux/amd64

[root@tidb40 ~]# tiup list pd
Available versions for pd:
Version                    Installed  Release                    Platforms
-------                    ---------  -------                    ---------
v6.1.0                     YES        2022-06-13T12:21:27+08:00  linux/amd64
v8.5.1                     YES        2025-01-17T07:54:11Z       linux/amd64
v9.0.0-beta.1.pre-nightly  YES        2025-03-14T07:46:35Z       linux/amd64

升级集群报错，提示”Error: init config failed: 192.168.169.40:2379: component pd does not have nightly on linux/amd64: unknown version: check config failed“

[root@tidb40 ~]# tiup cluster upgrade tidb-test v9.0.0-beta.1.pre-nightly
Before the upgrade, it is recommended to read the upgrade guide at https://docs.pingcap.com/tidb/stable/upgrade-tidb-using-tiup and finish the preparation steps.
This operation will upgrade tidb v8.5.1 cluster tidb-test to v9.0.0-beta.1.pre-nightly:
will upgrade and restart component "            tiflash" to "v9.0.0-beta.1.pre-nightly",
will upgrade and restart component "                cdc" to "v9.0.0-beta.1.pre-nightly",
will upgrade and restart component "                 pd" to "v9.0.0-beta.1.pre-nightly",
will upgrade and restart component "               tikv" to "v9.0.0-beta.1.pre-nightly",
will upgrade and restart component "               tidb" to "v9.0.0-beta.1.pre-nightly",
will upgrade and restart component "         prometheus" to "v9.0.0-beta.1.pre-nightly",
will upgrade and restart component "            grafana" to "v9.0.0-beta.1.pre-nightly",
will upgrade component     "node-exporter" to "",
will upgrade component "blackbox-exporter" to "".
Do you want to continue? [y/N]:(default=N) y
Upgrading cluster...
+ [ Serial ] - SSHKeySet: privateKey=/root/.tiup/storage/cluster/clusters/tidb-test/ssh/id_rsa, publicKey=/root/.tiup/storage/cluster/clusters/tidb-test/ssh/id_rsa.pub
+ [Parallel] - UserSSH: user=tidb, host=192.168.169.40
+ [Parallel] - UserSSH: user=tidb, host=192.168.169.40
+ [Parallel] - UserSSH: user=tidb, host=192.168.169.40
+ [Parallel] - UserSSH: user=tidb, host=192.168.169.40
+ [Parallel] - UserSSH: user=tidb, host=192.168.169.40
+ [Parallel] - UserSSH: user=tidb, host=192.168.169.40
+ [Parallel] - UserSSH: user=tidb, host=192.168.169.40
+ [Parallel] - UserSSH: user=tidb, host=192.168.169.40
+ [Parallel] - UserSSH: user=tidb, host=192.168.169.40
+ [Parallel] - UserSSH: user=tidb, host=192.168.169.40
+ [Parallel] - UserSSH: user=tidb, host=192.168.169.40
+ [ Serial ] - Download: component=tidb, version=v9.0.0-beta.1.pre-nightly, os=linux, arch=amd64
+ [ Serial ] - Download: component=cdc, version=v9.0.0-beta.1.pre-nightly, os=linux, arch=amd64
+ [ Serial ] - Download: component=tiflash, version=v9.0.0-beta.1.pre-nightly, os=linux, arch=amd64
+ [ Serial ] - Download: component=tikv, version=v9.0.0-beta.1.pre-nightly, os=linux, arch=amd64
+ [ Serial ] - Download: component=pd, version=v9.0.0-beta.1.pre-nightly, os=linux, arch=amd64
+ [ Serial ] - Download: component=prometheus, version=v9.0.0-beta.1.pre-nightly, os=linux, arch=amd64
+ [ Serial ] - Download: component=grafana, version=v9.0.0-beta.1.pre-nightly, os=linux, arch=amd64
download monitored
  - Download node_exporter: (linux/amd64) ... Done
  - Download blackbox_exporter: (linux/amd64) ... Done
+ [ Serial ] - Mkdir: host=192.168.169.40, directories='/tidb-data/pd-2379'
+ [ Serial ] - Mkdir: host=192.168.169.40, directories='/tidb-data/cdc-8300'
+ [ Serial ] - Mkdir: host=192.168.169.40, directories='/tidb-data/cdc-8301'
+ [ Serial ] - Mkdir: host=192.168.169.40, directories='/tidb-data/tiflash-9000'
+ [ Serial ] - Mkdir: host=192.168.169.40, directories='/tidb-data/cdc-8302'
+ [ Serial ] - BackupComponent: component=pd, currentVersion=v8.5.1, remote=192.168.169.40:/tidb-deploy/pd-2379
+ [ Serial ] - BackupComponent: component=cdc, currentVersion=v8.5.1, remote=192.168.169.40:/tidb-deploy/cdc-8301
+ [ Serial ] - BackupComponent: component=cdc, currentVersion=v8.5.1, remote=192.168.169.40:/tidb-deploy/cdc-8300
+ [ Serial ] - BackupComponent: component=tiflash, currentVersion=v8.5.1, remote=192.168.169.40:/tidb-deploy/tiflash-9000
+ [ Serial ] - BackupComponent: component=cdc, currentVersion=v8.5.1, remote=192.168.169.40:/tidb-deploy/cdc-8302
+ [ Serial ] - CopyComponent: component=pd, version=v9.0.0-beta.1.pre-nightly, remote=192.168.169.40:/tidb-deploy/pd-2379 os=linux, arch=amd64
+ [ Serial ] - CopyComponent: component=cdc, version=v9.0.0-beta.1.pre-nightly, remote=192.168.169.40:/tidb-deploy/cdc-8300 os=linux, arch=amd64
+ [ Serial ] - CopyComponent: component=cdc, version=v9.0.0-beta.1.pre-nightly, remote=192.168.169.40:/tidb-deploy/cdc-8301 os=linux, arch=amd64
+ [ Serial ] - CopyComponent: component=tiflash, version=v9.0.0-beta.1.pre-nightly, remote=192.168.169.40:/tidb-deploy/tiflash-9000 os=linux, arch=amd64
+ [ Serial ] - CopyComponent: component=cdc, version=v9.0.0-beta.1.pre-nightly, remote=192.168.169.40:/tidb-deploy/cdc-8302 os=linux, arch=amd64
+ [ Serial ] - InitConfig: cluster=tidb-test, user=tidb, host=192.168.169.40, path=/root/.tiup/storage/cluster/clusters/tidb-test/config-cache/pd-2379.service, deploy_dir=/tidb-deploy/pd-2379, data_dir=[/tidb-data/pd-2379], log_dir=/tidb-deploy/pd-2379/log, cache_dir=/root/.tiup/storage/cluster/clusters/tidb-test/config-cache
+ [ Serial ] - InitConfig: cluster=tidb-test, user=tidb, host=192.168.169.40, path=/root/.tiup/storage/cluster/clusters/tidb-test/config-cache/cdc-8301.service, deploy_dir=/tidb-deploy/cdc-8301, data_dir=[/tidb-data/cdc-8301], log_dir=/tidb-deploy/cdc-8301/log, cache_dir=/root/.tiup/storage/cluster/clusters/tidb-test/config-cache
+ [ Serial ] - InitConfig: cluster=tidb-test, user=tidb, host=192.168.169.40, path=/root/.tiup/storage/cluster/clusters/tidb-test/config-cache/cdc-8302.service, deploy_dir=/tidb-deploy/cdc-8302, data_dir=[/tidb-data/cdc-8302], log_dir=/tidb-deploy/cdc-8302/log, cache_dir=/root/.tiup/storage/cluster/clusters/tidb-test/config-cache
+ [ Serial ] - InitConfig: cluster=tidb-test, user=tidb, host=192.168.169.40, path=/root/.tiup/storage/cluster/clusters/tidb-test/config-cache/cdc-8300.service, deploy_dir=/tidb-deploy/cdc-8300, data_dir=[/tidb-data/cdc-8300], log_dir=/tidb-deploy/cdc-8300/log, cache_dir=/root/.tiup/storage/cluster/clusters/tidb-test/config-cache
+ [ Serial ] - Mkdir: host=192.168.169.40, directories='/tidb-data/tikv-20160'
+ [ Serial ] - BackupComponent: component=tikv, currentVersion=v8.5.1, remote=192.168.169.40:/tidb-deploy/tikv-20160
+ [ Serial ] - CopyComponent: component=tikv, version=v9.0.0-beta.1.pre-nightly, remote=192.168.169.40:/tidb-deploy/tikv-20160 os=linux, arch=amd64
+ [ Serial ] - Mkdir: host=192.168.169.40, directories='/tidb-data/tikv-20161'
+ [ Serial ] - Mkdir: host=192.168.169.40, directories='/tidb-data/tikv-20162'
+ [ Serial ] - Mkdir: host=192.168.169.40, directories=''
+ [ Serial ] - BackupComponent: component=tidb, currentVersion=v8.5.1, remote=192.168.169.40:/tidb-deploy/tidb-4000
+ [ Serial ] - CopyComponent: component=tidb, version=v9.0.0-beta.1.pre-nightly, remote=192.168.169.40:/tidb-deploy/tidb-4000 os=linux, arch=amd64
+ [ Serial ] - BackupComponent: component=tikv, currentVersion=v8.5.1, remote=192.168.169.40:/tidb-deploy/tikv-20161
+ [ Serial ] - BackupComponent: component=tikv, currentVersion=v8.5.1, remote=192.168.169.40:/tidb-deploy/tikv-20162
+ [ Serial ] - CopyComponent: component=tikv, version=v9.0.0-beta.1.pre-nightly, remote=192.168.169.40:/tidb-deploy/tikv-20161 os=linux, arch=amd64
+ [ Serial ] - CopyComponent: component=tikv, version=v9.0.0-beta.1.pre-nightly, remote=192.168.169.40:/tidb-deploy/tikv-20162 os=linux, arch=amd64
+ [ Serial ] - InitConfig: cluster=tidb-test, user=tidb, host=192.168.169.40, path=/root/.tiup/storage/cluster/clusters/tidb-test/config-cache/tidb-4000.service, deploy_dir=/tidb-deploy/tidb-4000, data_dir=[], log_dir=/tidb-deploy/tidb-4000/log, cache_dir=/root/.tiup/storage/cluster/clusters/tidb-test/config-cache
+ [ Serial ] - InitConfig: cluster=tidb-test, user=tidb, host=192.168.169.40, path=/root/.tiup/storage/cluster/clusters/tidb-test/config-cache/tiflash-9000.service, deploy_dir=/tidb-deploy/tiflash-9000, data_dir=[/tidb-data/tiflash-9000], log_dir=/tidb-deploy/tiflash-9000/log, cache_dir=/root/.tiup/storage/cluster/clusters/tidb-test/config-cache
+ [ Serial ] - InitConfig: cluster=tidb-test, user=tidb, host=192.168.169.40, path=/root/.tiup/storage/cluster/clusters/tidb-test/config-cache/tikv-20160.service, deploy_dir=/tidb-deploy/tikv-20160, data_dir=[/tidb-data/tikv-20160], log_dir=/tidb-deploy/tikv-20160/log, cache_dir=/root/.tiup/storage/cluster/clusters/tidb-test/config-cache
+ [ Serial ] - Mkdir: host=192.168.169.40, directories='/tidb-data/prometheus-9090'
+ [ Serial ] - BackupComponent: component=prometheus, currentVersion=v8.5.1, remote=192.168.169.40:/tidb-deploy/prometheus-9090
+ [ Serial ] - InitConfig: cluster=tidb-test, user=tidb, host=192.168.169.40, path=/root/.tiup/storage/cluster/clusters/tidb-test/config-cache/tikv-20161.service, deploy_dir=/tidb-deploy/tikv-20161, data_dir=[/tidb-data/tikv-20161], log_dir=/tidb-deploy/tikv-20161/log, cache_dir=/root/.tiup/storage/cluster/clusters/tidb-test/config-cache
+ [ Serial ] - CopyComponent: component=prometheus, version=v9.0.0-beta.1.pre-nightly, remote=192.168.169.40:/tidb-deploy/prometheus-9090 os=linux, arch=amd64
+ [ Serial ] - Mkdir: host=192.168.169.40, directories=''
+ [ Serial ] - BackupComponent: component=grafana, currentVersion=v8.5.1, remote=192.168.169.40:/tidb-deploy/grafana-3000
+ [ Serial ] - InitConfig: cluster=tidb-test, user=tidb, host=192.168.169.40, path=/root/.tiup/storage/cluster/clusters/tidb-test/config-cache/tikv-20162.service, deploy_dir=/tidb-deploy/tikv-20162, data_dir=[/tidb-data/tikv-20162], log_dir=/tidb-deploy/tikv-20162/log, cache_dir=/root/.tiup/storage/cluster/clusters/tidb-test/config-cache
+ [ Serial ] - CopyComponent: component=grafana, version=v9.0.0-beta.1.pre-nightly, remote=192.168.169.40:/tidb-deploy/grafana-3000 os=linux, arch=amd64
+ [ Serial ] - InitConfig: cluster=tidb-test, user=tidb, host=192.168.169.40, path=/root/.tiup/storage/cluster/clusters/tidb-test/config-cache/grafana-3000.service, deploy_dir=/tidb-deploy/grafana-3000, data_dir=[], log_dir=/tidb-deploy/grafana-3000/log, cache_dir=/root/.tiup/storage/cluster/clusters/tidb-test/config-cache
+ [ Serial ] - InitConfig: cluster=tidb-test, user=tidb, host=192.168.169.40, path=/root/.tiup/storage/cluster/clusters/tidb-test/config-cache/prometheus-9090.service, deploy_dir=/tidb-deploy/prometheus-9090, data_dir=[/tidb-data/prometheus-9090], log_dir=/tidb-deploy/prometheus-9090/log, cache_dir=/root/.tiup/storage/cluster/clusters/tidb-test/config-cache

Error: init config failed: 192.168.169.40:2379: component pd does not have nightly on linux/amd64: unknown version: check config failed

Verbose debug logs has been written to /root/.tiup/logs/tiup-cluster-debug-2025-03-17-14-17-20.log.
[root@tidb40 ~]#

【资源配置】进入到 TiDB Dashboard -集群信息 (Cluster Info) -主机(Hosts) 截图此页面
【附件：截图/日志/监控】

tiup-cluster-debug-2025-03-17-14-17-20.log (163.0 KB)

Kongdom · 2025 年3 月 17 日 09:56

执行这个确认看看，是不是离线镜像？
tiup mirror show

Well · 2025 年3 月 17 日 10:24

[root@tidb40 ~]# tiup mirror show
/tidb-data/tiupmirror

本测试环境联网异常，安装后就切换为本地源。

TiUP联网异常情况下，报错提示不准确

Kongdom · 2025 年3 月 17 日 10:35

是不是这里的原因？

Well · 2025 年3 月 17 日 10:51

不是，本来想加粗显示的。

WalterWj · 2025 年3 月 25 日 01:58

指定版本是 v9.0.0 呢？可以识别么

Well · 2025 年3 月 25 日 03:01

指定版本了呀

WalterWj · 2025 年3 月 25 日 03:15

好吧我测试了下。

在线升级的时候指定你这个版本，pd 是 716 。感觉有点问题。

Well · 2025 年3 月 25 日 04:44

能复现就好，又找一个bug，哈哈哈

Lucien-卢西恩 · 2025 年3 月 25 日 05:41

测试 v9.0.0-beta1.pre-nightly 是在研究啥新功能吗？

Well · 2025 年3 月 25 日 06:09

测试TiCDC新架构过程发现有些组件不适配，想着全面升级一下，没想到升级也有坑。

跨过了一坑又一坑，助力TiDB走上高速路。

TiDBer_hongyunyan · 2025 年3 月 26 日 02:27

目前本地试了一下，升级到 v9.0.0 版本 pd 已经显示正常了，可以麻烦老师再试一下吗？

Well · 2025 年3 月 26 日 06:21

经过测试，在线升级成功。

测试过程：
1.切换为在线mirror，升级tiup；看tiup 版本未变；但还是下载并提示升级成功，why?

[root@tidb40 ~]# tiup mirror show
/tidb-data/tiupmirror

[root@tidb40 ~]# tiup list tikv
Available versions for tikv:
Version                    Installed  Release                    Platforms
-------                    ---------  -------                    ---------
v6.1.0                     YES        2022-06-13T12:20:53+08:00  linux/amd64
v8.5.1                     YES        2025-01-17T07:49:04Z       linux/amd64
v9.0.0-beta.1.pre-nightly  YES        2025-03-14T11:40:59Z       linux/amd64



[root@tidb40 ~]# tiup mirror set --reset
WARN: adding root certificate via internet: https://tiup-mirrors.pingcap.com/root.json
You can revoke this by remove /root/.tiup/bin/4c18ab4179e55f01.root.json
Successfully set mirror to https://tiup-mirrors.pingcap.com/
[root@tidb40 ~]#



[root@tidb40 ~]# tiup update --self
download https://tiup-mirrors.pingcap.com/tiup-v1.16.1-linux-amd64.tar.gz 5.03 MiB / 5.03 MiB 100.00% 9.13 MiB/s
Updated successfully!
[root@tidb40 ~]# tiup update cluster
component cluster version v1.16.1 is already installed
Updated successfully!
[root@tidb40 ~]# tiup -v
1.16.1 tiup
Go Version: go1.21.13
Git Ref: v1.16.1
GitHash: 775384c48a95f7047c016cbf2905eec1e267f629
[root@tidb40 ~]#


检查本地离线镜像，均已下载，
[root@tidb40 ~]# tiup list tikv
…………
v9.0.0-beta.1.pre-nightly             YES        2025-03-21T12:20:22Z                 darwin/arm64,linux/amd64,linux/arm64,darwin/amd64
[root@tidb40 ~]# tiup list pd
………………
v9.0.0-beta.1.pre-nightly             YES        2025-03-24T09:29:48Z                 darwin/amd64,darwin/arm64,linux/amd64,linux/arm64

2. 切换为本地源，离线升级，失败；

# tiup mirror set /tidb-data/tiupmirror/

[root@tidb40 ~]# tiup cluster upgrade tidb-test v9.0.0-beta.1.pre-nightly
Before the upgrade, it is recommended to read the upgrade guide at https://docs.pingcap.com/tidb/stable/upgrade-tidb-using-tiup and finish the preparation steps.
This operation will upgrade tidb v8.5.1 cluster tidb-test to v9.0.0-beta.1.pre-nightly:
will upgrade and restart component "            tiflash" to "v9.0.0-beta.1.pre-nightly",
will upgrade and restart component "                cdc" to "v9.0.0-beta.1.pre-nightly",
will upgrade and restart component "                 pd" to "v9.0.0-beta.1.pre-nightly",
will upgrade and restart component "               tikv" to "v9.0.0-beta.1.pre-nightly",
will upgrade and restart component "               tidb" to "v9.0.0-beta.1.pre-nightly",
will upgrade and restart component "         prometheus" to "v9.0.0-beta.1.pre-nightly",
will upgrade and restart component "            grafana" to "v9.0.0-beta.1.pre-nightly",
will upgrade component     "node-exporter" to "",
will upgrade component "blackbox-exporter" to "".
Do you want to continue? [y/N]:(default=N) y
Upgrading cluster...
+ [ Serial ] - SSHKeySet: privateKey=/root/.tiup/storage/cluster/clusters/tidb-test/ssh/id_rsa, publicKey=/root/.tiup/storage/cluster/clusters/tidb-test/ssh/id_rsa.pub
+ [Parallel] - UserSSH: user=tidb, host=192.168.169.40
+ [Parallel] - UserSSH: user=tidb, host=192.168.169.40
+ [Parallel] - UserSSH: user=tidb, host=192.168.169.40
+ [Parallel] - UserSSH: user=tidb, host=192.168.169.40
+ [Parallel] - UserSSH: user=tidb, host=192.168.169.40
+ [Parallel] - UserSSH: user=tidb, host=192.168.169.40
+ [Parallel] - UserSSH: user=tidb, host=192.168.169.40
+ [Parallel] - UserSSH: user=tidb, host=192.168.169.40
+ [Parallel] - UserSSH: user=tidb, host=192.168.169.40
+ [Parallel] - UserSSH: user=tidb, host=192.168.169.40
+ [Parallel] - UserSSH: user=tidb, host=192.168.169.40
+ [ Serial ] - Download: component=tikv, version=v9.0.0-beta.1.pre-nightly, os=linux, arch=amd64
+ [ Serial ] - Download: component=tidb, version=v9.0.0-beta.1.pre-nightly, os=linux, arch=amd64
+ [ Serial ] - Download: component=tiflash, version=v9.0.0-beta.1.pre-nightly, os=linux, arch=amd64
+ [ Serial ] - Download: component=pd, version=v9.0.0-beta.1.pre-nightly, os=linux, arch=amd64
+ [ Serial ] - Download: component=cdc, version=v9.0.0-beta.1.pre-nightly, os=linux, arch=amd64
+ [ Serial ] - Download: component=prometheus, version=v9.0.0-beta.1.pre-nightly, os=linux, arch=amd64
+ [ Serial ] - Download: component=grafana, version=v9.0.0-beta.1.pre-nightly, os=linux, arch=amd64
download monitored
  - Download node_exporter: (linux/amd64) ... Done
  - Download blackbox_exporter: (linux/amd64) ... Done
+ [ Serial ] - Mkdir: host=192.168.169.40, directories='/tidb-data/pd-2379'
+ [ Serial ] - Mkdir: host=192.168.169.40, directories='/tidb-data/cdc-8300'
+ [ Serial ] - Mkdir: host=192.168.169.40, directories='/tidb-data/cdc-8301'
+ [ Serial ] - Mkdir: host=192.168.169.40, directories='/tidb-data/cdc-8302'
+ [ Serial ] - Mkdir: host=192.168.169.40, directories='/tidb-data/tiflash-9000'
+ [ Serial ] - BackupComponent: component=cdc, currentVersion=v8.5.1, remote=192.168.169.40:/tidb-deploy/cdc-8300
+ [ Serial ] - BackupComponent: component=tiflash, currentVersion=v8.5.1, remote=192.168.169.40:/tidb-deploy/tiflash-9000
+ [ Serial ] - BackupComponent: component=cdc, currentVersion=v8.5.1, remote=192.168.169.40:/tidb-deploy/cdc-8301
+ [ Serial ] - BackupComponent: component=pd, currentVersion=v8.5.1, remote=192.168.169.40:/tidb-deploy/pd-2379
+ [ Serial ] - BackupComponent: component=cdc, currentVersion=v8.5.1, remote=192.168.169.40:/tidb-deploy/cdc-8302
+ [ Serial ] - CopyComponent: component=cdc, version=v9.0.0-beta.1.pre-nightly, remote=192.168.169.40:/tidb-deploy/cdc-8300 os=linux, arch=amd64
+ [ Serial ] - CopyComponent: component=cdc, version=v9.0.0-beta.1.pre-nightly, remote=192.168.169.40:/tidb-deploy/cdc-8301 os=linux, arch=amd64
+ [ Serial ] - CopyComponent: component=pd, version=v9.0.0-beta.1.pre-nightly, remote=192.168.169.40:/tidb-deploy/pd-2379 os=linux, arch=amd64
+ [ Serial ] - CopyComponent: component=tiflash, version=v9.0.0-beta.1.pre-nightly, remote=192.168.169.40:/tidb-deploy/tiflash-9000 os=linux, arch=amd64
+ [ Serial ] - CopyComponent: component=cdc, version=v9.0.0-beta.1.pre-nightly, remote=192.168.169.40:/tidb-deploy/cdc-8302 os=linux, arch=amd64
+ [ Serial ] - InitConfig: cluster=tidb-test, user=tidb, host=192.168.169.40, path=/root/.tiup/storage/cluster/clusters/tidb-test/config-cache/pd-2379.service, deploy_dir=/tidb-deploy/pd-2379, data_dir=[/tidb-data/pd-2379], log_dir=/tidb-deploy/pd-2379/log, cache_dir=/root/.tiup/storage/cluster/clusters/tidb-test/config-cache
+ [ Serial ] - InitConfig: cluster=tidb-test, user=tidb, host=192.168.169.40, path=/root/.tiup/storage/cluster/clusters/tidb-test/config-cache/cdc-8300.service, deploy_dir=/tidb-deploy/cdc-8300, data_dir=[/tidb-data/cdc-8300], log_dir=/tidb-deploy/cdc-8300/log, cache_dir=/root/.tiup/storage/cluster/clusters/tidb-test/config-cache
+ [ Serial ] - InitConfig: cluster=tidb-test, user=tidb, host=192.168.169.40, path=/root/.tiup/storage/cluster/clusters/tidb-test/config-cache/cdc-8302.service, deploy_dir=/tidb-deploy/cdc-8302, data_dir=[/tidb-data/cdc-8302], log_dir=/tidb-deploy/cdc-8302/log, cache_dir=/root/.tiup/storage/cluster/clusters/tidb-test/config-cache
+ [ Serial ] - InitConfig: cluster=tidb-test, user=tidb, host=192.168.169.40, path=/root/.tiup/storage/cluster/clusters/tidb-test/config-cache/cdc-8301.service, deploy_dir=/tidb-deploy/cdc-8301, data_dir=[/tidb-data/cdc-8301], log_dir=/tidb-deploy/cdc-8301/log, cache_dir=/root/.tiup/storage/cluster/clusters/tidb-test/config-cache
+ [ Serial ] - Mkdir: host=192.168.169.40, directories='/tidb-data/tikv-20160'
+ [ Serial ] - BackupComponent: component=tikv, currentVersion=v8.5.1, remote=192.168.169.40:/tidb-deploy/tikv-20160
+ [ Serial ] - CopyComponent: component=tikv, version=v9.0.0-beta.1.pre-nightly, remote=192.168.169.40:/tidb-deploy/tikv-20160 os=linux, arch=amd64
+ [ Serial ] - Mkdir: host=192.168.169.40, directories='/tidb-data/tikv-20161'
+ [ Serial ] - Mkdir: host=192.168.169.40, directories='/tidb-data/tikv-20162'
+ [ Serial ] - Mkdir: host=192.168.169.40, directories=''
+ [ Serial ] - BackupComponent: component=tidb, currentVersion=v8.5.1, remote=192.168.169.40:/tidb-deploy/tidb-4000
+ [ Serial ] - CopyComponent: component=tidb, version=v9.0.0-beta.1.pre-nightly, remote=192.168.169.40:/tidb-deploy/tidb-4000 os=linux, arch=amd64
+ [ Serial ] - BackupComponent: component=tikv, currentVersion=v8.5.1, remote=192.168.169.40:/tidb-deploy/tikv-20161
+ [ Serial ] - BackupComponent: component=tikv, currentVersion=v8.5.1, remote=192.168.169.40:/tidb-deploy/tikv-20162
+ [ Serial ] - CopyComponent: component=tikv, version=v9.0.0-beta.1.pre-nightly, remote=192.168.169.40:/tidb-deploy/tikv-20161 os=linux, arch=amd64
+ [ Serial ] - CopyComponent: component=tikv, version=v9.0.0-beta.1.pre-nightly, remote=192.168.169.40:/tidb-deploy/tikv-20162 os=linux, arch=amd64
+ [ Serial ] - InitConfig: cluster=tidb-test, user=tidb, host=192.168.169.40, path=/root/.tiup/storage/cluster/clusters/tidb-test/config-cache/tidb-4000.service, deploy_dir=/tidb-deploy/tidb-4000, data_dir=[], log_dir=/tidb-deploy/tidb-4000/log, cache_dir=/root/.tiup/storage/cluster/clusters/tidb-test/config-cache
+ [ Serial ] - InitConfig: cluster=tidb-test, user=tidb, host=192.168.169.40, path=/root/.tiup/storage/cluster/clusters/tidb-test/config-cache/tiflash-9000.service, deploy_dir=/tidb-deploy/tiflash-9000, data_dir=[/tidb-data/tiflash-9000], log_dir=/tidb-deploy/tiflash-9000/log, cache_dir=/root/.tiup/storage/cluster/clusters/tidb-test/config-cache
+ [ Serial ] - InitConfig: cluster=tidb-test, user=tidb, host=192.168.169.40, path=/root/.tiup/storage/cluster/clusters/tidb-test/config-cache/tikv-20160.service, deploy_dir=/tidb-deploy/tikv-20160, data_dir=[/tidb-data/tikv-20160], log_dir=/tidb-deploy/tikv-20160/log, cache_dir=/root/.tiup/storage/cluster/clusters/tidb-test/config-cache
+ [ Serial ] - Mkdir: host=192.168.169.40, directories='/tidb-data/prometheus-9090'
+ [ Serial ] - BackupComponent: component=prometheus, currentVersion=v8.5.1, remote=192.168.169.40:/tidb-deploy/prometheus-9090
+ [ Serial ] - Mkdir: host=192.168.169.40, directories=''
+ [ Serial ] - BackupComponent: component=grafana, currentVersion=v8.5.1, remote=192.168.169.40:/tidb-deploy/grafana-3000
+ [ Serial ] - CopyComponent: component=prometheus, version=v9.0.0-beta.1.pre-nightly, remote=192.168.169.40:/tidb-deploy/prometheus-9090 os=linux, arch=amd64
+ [ Serial ] - InitConfig: cluster=tidb-test, user=tidb, host=192.168.169.40, path=/root/.tiup/storage/cluster/clusters/tidb-test/config-cache/tikv-20161.service, deploy_dir=/tidb-deploy/tikv-20161, data_dir=[/tidb-data/tikv-20161], log_dir=/tidb-deploy/tikv-20161/log, cache_dir=/root/.tiup/storage/cluster/clusters/tidb-test/config-cache
+ [ Serial ] - InitConfig: cluster=tidb-test, user=tidb, host=192.168.169.40, path=/root/.tiup/storage/cluster/clusters/tidb-test/config-cache/tikv-20162.service, deploy_dir=/tidb-deploy/tikv-20162, data_dir=[/tidb-data/tikv-20162], log_dir=/tidb-deploy/tikv-20162/log, cache_dir=/root/.tiup/storage/cluster/clusters/tidb-test/config-cache
+ [ Serial ] - CopyComponent: component=grafana, version=v9.0.0-beta.1.pre-nightly, remote=192.168.169.40:/tidb-deploy/grafana-3000 os=linux, arch=amd64
+ [ Serial ] - InitConfig: cluster=tidb-test, user=tidb, host=192.168.169.40, path=/root/.tiup/storage/cluster/clusters/tidb-test/config-cache/grafana-3000.service, deploy_dir=/tidb-deploy/grafana-3000, data_dir=[], log_dir=/tidb-deploy/grafana-3000/log, cache_dir=/root/.tiup/storage/cluster/clusters/tidb-test/config-cache
+ [ Serial ] - InitConfig: cluster=tidb-test, user=tidb, host=192.168.169.40, path=/root/.tiup/storage/cluster/clusters/tidb-test/config-cache/prometheus-9090.service, deploy_dir=/tidb-deploy/prometheus-9090, data_dir=[/tidb-data/prometheus-9090], log_dir=/tidb-deploy/prometheus-9090/log, cache_dir=/root/.tiup/storage/cluster/clusters/tidb-test/config-cache

Error: init config failed: 192.168.169.40:2379: component pd does not have nightly on linux/amd64: unknown version: check config failed

Verbose debug logs has been written to /root/.tiup/logs/tiup-cluster-debug-2025-03-26-13-49-45.log.

3. 切换为在线mirror，在线升级失败：


[root@tidb40 ~]# tiup mirror set --reset
Successfully set mirror to https://tiup-mirrors.pingcap.com/
[root@tidb40 ~]#
[root@tidb40 ~]#
[root@tidb40 ~]#
[root@tidb40 ~]#
[root@tidb40 ~]#
[root@tidb40 ~]# export http_proxy="192.168.118.199:808"
export https_proxy="192.168.118.199:808"
[root@tidb40 ~]#
[root@tidb40 ~]#
[root@tidb40 ~]#
[root@tidb40 ~]#
[root@tidb40 ~]# tiup cluster upgrade tidb-test v9.0.0-beta.1.pre-nightly
Checking updates for component cluster... Timedout (after 2s)
Before the upgrade, it is recommended to read the upgrade guide at https://docs.pingcap.com/tidb/stable/upgrade-tidb-using-tiup and finish the preparation steps.
This operation will upgrade tidb v8.5.1 cluster tidb-test to v9.0.0-beta.1.pre-nightly:
will upgrade and restart component "            tiflash" to "v9.0.0-beta.1.pre-nightly",
will upgrade and restart component "                cdc" to "v9.0.0-beta.1.pre-nightly",
will upgrade and restart component "                 pd" to "v9.0.0-beta.1.pre-nightly",
will upgrade and restart component "               tikv" to "v9.0.0-beta.1.pre-nightly",
will upgrade and restart component "               tidb" to "v9.0.0-beta.1.pre-nightly",
will upgrade and restart component "         prometheus" to "v9.0.0-beta.1.pre-nightly",
will upgrade and restart component "            grafana" to "v9.0.0-beta.1.pre-nightly",
will upgrade component     "node-exporter" to "",
will upgrade component "blackbox-exporter" to "".
Do you want to continue? [y/N]:(default=N) y
Upgrading cluster...
+ [ Serial ] - SSHKeySet: privateKey=/root/.tiup/storage/cluster/clusters/tidb-test/ssh/id_rsa, publicKey=/root/.tiup/storage/cluster/clusters/tidb-test/ssh/id_rsa.pub
+ [Parallel] - UserSSH: user=tidb, host=192.168.169.40
+ [Parallel] - UserSSH: user=tidb, host=192.168.169.40
+ [Parallel] - UserSSH: user=tidb, host=192.168.169.40
+ [Parallel] - UserSSH: user=tidb, host=192.168.169.40
+ [Parallel] - UserSSH: user=tidb, host=192.168.169.40
+ [Parallel] - UserSSH: user=tidb, host=192.168.169.40
+ [Parallel] - UserSSH: user=tidb, host=192.168.169.40
+ [Parallel] - UserSSH: user=tidb, host=192.168.169.40
+ [Parallel] - UserSSH: user=tidb, host=192.168.169.40
+ [Parallel] - UserSSH: user=tidb, host=192.168.169.40
+ [Parallel] - UserSSH: user=tidb, host=192.168.169.40
+ [ Serial ] - Download: component=tidb, version=v9.0.0-beta.1.pre-nightly, os=linux, arch=amd64
+ [ Serial ] - Download: component=cdc, version=v9.0.0-beta.1.pre-nightly, os=linux, arch=amd64
+ [ Serial ] - Download: component=tiflash, version=v9.0.0-beta.1.pre-nightly, os=linux, arch=amd64
+ [ Serial ] - Download: component=pd, version=v9.0.0-beta.1.pre-nightly, os=linux, arch=amd64
+ [ Serial ] - Download: component=tikv, version=v9.0.0-beta.1.pre-nightly, os=linux, arch=amd64
+ [ Serial ] - Download: component=prometheus, version=v9.0.0-beta.1.pre-nightly, os=linux, arch=amd64
+ [ Serial ] - Download: component=grafana, version=v9.0.0-beta.1.pre-nightly, os=linux, arch=amd64
download monitored
  - Download node_exporter: (linux/amd64) ... Done
  - Download blackbox_exporter: (linux/amd64) ... Done
+ [ Serial ] - Mkdir: host=192.168.169.40, directories='/tidb-data/pd-2379'
+ [ Serial ] - Mkdir: host=192.168.169.40, directories='/tidb-data/cdc-8300'
+ [ Serial ] - Mkdir: host=192.168.169.40, directories='/tidb-data/cdc-8302'
+ [ Serial ] - Mkdir: host=192.168.169.40, directories='/tidb-data/tiflash-9000'
+ [ Serial ] - Mkdir: host=192.168.169.40, directories='/tidb-data/cdc-8301'
+ [ Serial ] - BackupComponent: component=tiflash, currentVersion=v8.5.1, remote=192.168.169.40:/tidb-deploy/tiflash-9000
+ [ Serial ] - BackupComponent: component=pd, currentVersion=v8.5.1, remote=192.168.169.40:/tidb-deploy/pd-2379
+ [ Serial ] - BackupComponent: component=cdc, currentVersion=v8.5.1, remote=192.168.169.40:/tidb-deploy/cdc-8302
+ [ Serial ] - BackupComponent: component=cdc, currentVersion=v8.5.1, remote=192.168.169.40:/tidb-deploy/cdc-8301
+ [ Serial ] - BackupComponent: component=cdc, currentVersion=v8.5.1, remote=192.168.169.40:/tidb-deploy/cdc-8300
+ [ Serial ] - CopyComponent: component=tiflash, version=v9.0.0-beta.1.pre-nightly, remote=192.168.169.40:/tidb-deploy/tiflash-9000 os=linux, arch=amd64
+ [ Serial ] - CopyComponent: component=cdc, version=v9.0.0-beta.1.pre-nightly, remote=192.168.169.40:/tidb-deploy/cdc-8302 os=linux, arch=amd64
+ [ Serial ] - CopyComponent: component=cdc, version=v9.0.0-beta.1.pre-nightly, remote=192.168.169.40:/tidb-deploy/cdc-8301 os=linux, arch=amd64
+ [ Serial ] - CopyComponent: component=cdc, version=v9.0.0-beta.1.pre-nightly, remote=192.168.169.40:/tidb-deploy/cdc-8300 os=linux, arch=amd64
+ [ Serial ] - CopyComponent: component=pd, version=v9.0.0-beta.1.pre-nightly, remote=192.168.169.40:/tidb-deploy/pd-2379 os=linux, arch=amd64
+ [ Serial ] - Mkdir: host=192.168.169.40, directories='/tidb-data/tikv-20160'
+ [ Serial ] - Mkdir: host=192.168.169.40, directories='/tidb-data/tikv-20161'
+ [ Serial ] - Mkdir: host=192.168.169.40, directories='/tidb-data/tikv-20162'
+ [ Serial ] - Mkdir: host=192.168.169.40, directories=''
+ [ Serial ] - BackupComponent: component=tidb, currentVersion=v8.5.1, remote=192.168.169.40:/tidb-deploy/tidb-4000
+ [ Serial ] - Mkdir: host=192.168.169.40, directories='/tidb-data/prometheus-9090'
+ [ Serial ] - CopyComponent: component=tidb, version=v9.0.0-beta.1.pre-nightly, remote=192.168.169.40:/tidb-deploy/tidb-4000 os=linux, arch=amd64
+ [ Serial ] - Mkdir: host=192.168.169.40, directories=''
+ [ Serial ] - BackupComponent: component=grafana, currentVersion=v8.5.1, remote=192.168.169.40:/tidb-deploy/grafana-3000
+ [ Serial ] - BackupComponent: component=tikv, currentVersion=v8.5.1, remote=192.168.169.40:/tidb-deploy/tikv-20160
+ [ Serial ] - BackupComponent: component=tikv, currentVersion=v8.5.1, remote=192.168.169.40:/tidb-deploy/tikv-20161
+ [ Serial ] - BackupComponent: component=tikv, currentVersion=v8.5.1, remote=192.168.169.40:/tidb-deploy/tikv-20162
+ [ Serial ] - BackupComponent: component=prometheus, currentVersion=v8.5.1, remote=192.168.169.40:/tidb-deploy/prometheus-9090
+ [ Serial ] - CopyComponent: component=grafana, version=v9.0.0-beta.1.pre-nightly, remote=192.168.169.40:/tidb-deploy/grafana-3000 os=linux, arch=amd64
+ [ Serial ] - CopyComponent: component=tikv, version=v9.0.0-beta.1.pre-nightly, remote=192.168.169.40:/tidb-deploy/tikv-20160 os=linux, arch=amd64
+ [ Serial ] - CopyComponent: component=tikv, version=v9.0.0-beta.1.pre-nightly, remote=192.168.169.40:/tidb-deploy/tikv-20161 os=linux, arch=amd64
+ [ Serial ] - CopyComponent: component=tikv, version=v9.0.0-beta.1.pre-nightly, remote=192.168.169.40:/tidb-deploy/tikv-20162 os=linux, arch=amd64
+ [ Serial ] - CopyComponent: component=prometheus, version=v9.0.0-beta.1.pre-nightly, remote=192.168.169.40:/tidb-deploy/prometheus-9090 os=linux, arch=amd64

Error: failed to scp /root/.tiup/storage/cluster/packages/tiflash-v9.0.0-beta.1.pre-nightly-linux-amd64.tar.gz to 192.168.169.40:/tidb-deploy/tiflash-9000/bin/tiflash-v9.0.0-beta.1.pre-nightly-linux-amd64.tar.gz: failed to scp /root/.tiup/storage/cluster/packages/tiflash-v9.0.0-beta.1.pre-nightly-linux-amd64.tar.gz to tidb@192.168.169.40:/tidb-deploy/tiflash-9000/bin/tiflash-v9.0.0-beta.1.pre-nightly-linux-amd64.tar.gz: open /root/.tiup/storage/cluster/packages/tiflash-v9.0.0-beta.1.pre-nightly-linux-amd64.tar.gz: no such file or directory

Verbose debug logs has been written to /root/.tiup/logs/tiup-cluster-debug-2025-03-26-13-58-08.log.

4. 关闭集群，重启系统，再次在线升级，成功；


[root@tidb40 ~]# tiup cluster upgrade tidb-test v9.0.0-beta.1.pre-nightly
Checking updates for component cluster... Timedout (after 2s)
Before the upgrade, it is recommended to read the upgrade guide at https://docs.pingcap.com/tidb/stable/upgrade-tidb-using-tiup and finish the preparation steps.
This operation will upgrade tidb v8.5.1 cluster tidb-test to v9.0.0-beta.1.pre-nightly:
will upgrade and restart component "            tiflash" to "v9.0.0-beta.1.pre-nightly",
will upgrade and restart component "                cdc" to "v9.0.0-beta.1.pre-nightly",
will upgrade and restart component "                 pd" to "v9.0.0-beta.1.pre-nightly",
will upgrade and restart component "               tikv" to "v9.0.0-beta.1.pre-nightly",
will upgrade and restart component "               tidb" to "v9.0.0-beta.1.pre-nightly",
will upgrade and restart component "         prometheus" to "v9.0.0-beta.1.pre-nightly",
will upgrade and restart component "            grafana" to "v9.0.0-beta.1.pre-nightly",
will upgrade component     "node-exporter" to "",
will upgrade component "blackbox-exporter" to "".
Do you want to continue? [y/N]:(default=N) y
Upgrading cluster...
+ [ Serial ] - SSHKeySet: privateKey=/root/.tiup/storage/cluster/clusters/tidb-test/ssh/id_rsa, publicKey=/root/.tiup/storage/cluster/clusters/tidb-test/ssh/id_rsa.pub
+ [Parallel] - UserSSH: user=tidb, host=192.168.169.40
+ [Parallel] - UserSSH: user=tidb, host=192.168.169.40
+ [Parallel] - UserSSH: user=tidb, host=192.168.169.40
+ [Parallel] - UserSSH: user=tidb, host=192.168.169.40
+ [Parallel] - UserSSH: user=tidb, host=192.168.169.40
+ [Parallel] - UserSSH: user=tidb, host=192.168.169.40
+ [Parallel] - UserSSH: user=tidb, host=192.168.169.40
+ [Parallel] - UserSSH: user=tidb, host=192.168.169.40
+ [Parallel] - UserSSH: user=tidb, host=192.168.169.40
+ [Parallel] - UserSSH: user=tidb, host=192.168.169.40
+ [Parallel] - UserSSH: user=tidb, host=192.168.169.40
+ [ Serial ] - Download: component=pd, version=v9.0.0-beta.1.pre-nightly, os=linux, arch=amd64
+ [ Serial ] - Download: component=tiflash, version=v9.0.0-beta.1.pre-nightly, os=linux, arch=amd64
+ [ Serial ] - Download: component=cdc, version=v9.0.0-beta.1.pre-nightly, os=linux, arch=amd64
+ [ Serial ] - Download: component=tikv, version=v9.0.0-beta.1.pre-nightly, os=linux, arch=amd64
+ [ Serial ] - Download: component=tidb, version=v9.0.0-beta.1.pre-nightly, os=linux, arch=amd64
+ [ Serial ] - Download: component=prometheus, version=v9.0.0-beta.1.pre-nightly, os=linux, arch=amd64
+ [ Serial ] - Download: component=grafana, version=v9.0.0-beta.1.pre-nightly, os=linux, arch=amd64
download monitored
  - Download node_exporter: (linux/amd64) ... Done
  - Download blackbox_exporter: (linux/amd64) ... Done
+ [ Serial ] - Mkdir: host=192.168.169.40, directories='/tidb-data/pd-2379'
+ [ Serial ] - Mkdir: host=192.168.169.40, directories='/tidb-data/tiflash-9000'
+ [ Serial ] - Mkdir: host=192.168.169.40, directories='/tidb-data/cdc-8301'
+ [ Serial ] - Mkdir: host=192.168.169.40, directories='/tidb-data/cdc-8300'
+ [ Serial ] - Mkdir: host=192.168.169.40, directories='/tidb-data/cdc-8302'
+ [ Serial ] - BackupComponent: component=pd, currentVersion=v8.5.1, remote=192.168.169.40:/tidb-deploy/pd-2379
+ [ Serial ] - BackupComponent: component=tiflash, currentVersion=v8.5.1, remote=192.168.169.40:/tidb-deploy/tiflash-9000
+ [ Serial ] - BackupComponent: component=cdc, currentVersion=v8.5.1, remote=192.168.169.40:/tidb-deploy/cdc-8301
+ [ Serial ] - BackupComponent: component=cdc, currentVersion=v8.5.1, remote=192.168.169.40:/tidb-deploy/cdc-8302
+ [ Serial ] - BackupComponent: component=cdc, currentVersion=v8.5.1, remote=192.168.169.40:/tidb-deploy/cdc-8300
+ [ Serial ] - CopyComponent: component=pd, version=v9.0.0-beta.1.pre-nightly, remote=192.168.169.40:/tidb-deploy/pd-2379 os=linux, arch=amd64
+ [ Serial ] - CopyComponent: component=tiflash, version=v9.0.0-beta.1.pre-nightly, remote=192.168.169.40:/tidb-deploy/tiflash-9000 os=linux, arch=amd64
+ [ Serial ] - CopyComponent: component=cdc, version=v9.0.0-beta.1.pre-nightly, remote=192.168.169.40:/tidb-deploy/cdc-8302 os=linux, arch=amd64
+ [ Serial ] - CopyComponent: component=cdc, version=v9.0.0-beta.1.pre-nightly, remote=192.168.169.40:/tidb-deploy/cdc-8301 os=linux, arch=amd64
+ [ Serial ] - CopyComponent: component=cdc, version=v9.0.0-beta.1.pre-nightly, remote=192.168.169.40:/tidb-deploy/cdc-8300 os=linux, arch=amd64
+ [ Serial ] - InitConfig: cluster=tidb-test, user=tidb, host=192.168.169.40, path=/root/.tiup/storage/cluster/clusters/tidb-test/config-cache/pd-2379.service, deploy_dir=/tidb-deploy/pd-2379, data_dir=[/tidb-data/pd-2379], log_dir=/tidb-deploy/pd-2379/log, cache_dir=/root/.tiup/storage/cluster/clusters/tidb-test/config-cache
+ [ Serial ] - InitConfig: cluster=tidb-test, user=tidb, host=192.168.169.40, path=/root/.tiup/storage/cluster/clusters/tidb-test/config-cache/cdc-8301.service, deploy_dir=/tidb-deploy/cdc-8301, data_dir=[/tidb-data/cdc-8301], log_dir=/tidb-deploy/cdc-8301/log, cache_dir=/root/.tiup/storage/cluster/clusters/tidb-test/config-cache
+ [ Serial ] - InitConfig: cluster=tidb-test, user=tidb, host=192.168.169.40, path=/root/.tiup/storage/cluster/clusters/tidb-test/config-cache/cdc-8302.service, deploy_dir=/tidb-deploy/cdc-8302, data_dir=[/tidb-data/cdc-8302], log_dir=/tidb-deploy/cdc-8302/log, cache_dir=/root/.tiup/storage/cluster/clusters/tidb-test/config-cache
+ [ Serial ] - InitConfig: cluster=tidb-test, user=tidb, host=192.168.169.40, path=/root/.tiup/storage/cluster/clusters/tidb-test/config-cache/cdc-8300.service, deploy_dir=/tidb-deploy/cdc-8300, data_dir=[/tidb-data/cdc-8300], log_dir=/tidb-deploy/cdc-8300/log, cache_dir=/root/.tiup/storage/cluster/clusters/tidb-test/config-cache
+ [ Serial ] - Mkdir: host=192.168.169.40, directories='/tidb-data/tikv-20160'
+ [ Serial ] - Mkdir: host=192.168.169.40, directories='/tidb-data/tikv-20161'
+ [ Serial ] - Mkdir: host=192.168.169.40, directories='/tidb-data/tikv-20162'
+ [ Serial ] - Mkdir: host=192.168.169.40, directories=''
+ [ Serial ] - BackupComponent: component=tidb, currentVersion=v8.5.1, remote=192.168.169.40:/tidb-deploy/tidb-4000
+ [ Serial ] - CopyComponent: component=tidb, version=v9.0.0-beta.1.pre-nightly, remote=192.168.169.40:/tidb-deploy/tidb-4000 os=linux, arch=amd64
+ [ Serial ] - BackupComponent: component=tikv, currentVersion=v8.5.1, remote=192.168.169.40:/tidb-deploy/tikv-20160
+ [ Serial ] - BackupComponent: component=tikv, currentVersion=v8.5.1, remote=192.168.169.40:/tidb-deploy/tikv-20161
+ [ Serial ] - BackupComponent: component=tikv, currentVersion=v8.5.1, remote=192.168.169.40:/tidb-deploy/tikv-20162
+ [ Serial ] - CopyComponent: component=tikv, version=v9.0.0-beta.1.pre-nightly, remote=192.168.169.40:/tidb-deploy/tikv-20160 os=linux, arch=amd64
+ [ Serial ] - CopyComponent: component=tikv, version=v9.0.0-beta.1.pre-nightly, remote=192.168.169.40:/tidb-deploy/tikv-20161 os=linux, arch=amd64
+ [ Serial ] - CopyComponent: component=tikv, version=v9.0.0-beta.1.pre-nightly, remote=192.168.169.40:/tidb-deploy/tikv-20162 os=linux, arch=amd64
+ [ Serial ] - InitConfig: cluster=tidb-test, user=tidb, host=192.168.169.40, path=/root/.tiup/storage/cluster/clusters/tidb-test/config-cache/tidb-4000.service, deploy_dir=/tidb-deploy/tidb-4000, data_dir=[], log_dir=/tidb-deploy/tidb-4000/log, cache_dir=/root/.tiup/storage/cluster/clusters/tidb-test/config-cache
+ [ Serial ] - InitConfig: cluster=tidb-test, user=tidb, host=192.168.169.40, path=/root/.tiup/storage/cluster/clusters/tidb-test/config-cache/tiflash-9000.service, deploy_dir=/tidb-deploy/tiflash-9000, data_dir=[/tidb-data/tiflash-9000], log_dir=/tidb-deploy/tiflash-9000/log, cache_dir=/root/.tiup/storage/cluster/clusters/tidb-test/config-cache
+ [ Serial ] - InitConfig: cluster=tidb-test, user=tidb, host=192.168.169.40, path=/root/.tiup/storage/cluster/clusters/tidb-test/config-cache/tikv-20161.service, deploy_dir=/tidb-deploy/tikv-20161, data_dir=[/tidb-data/tikv-20161], log_dir=/tidb-deploy/tikv-20161/log, cache_dir=/root/.tiup/storage/cluster/clusters/tidb-test/config-cache
+ [ Serial ] - InitConfig: cluster=tidb-test, user=tidb, host=192.168.169.40, path=/root/.tiup/storage/cluster/clusters/tidb-test/config-cache/tikv-20162.service, deploy_dir=/tidb-deploy/tikv-20162, data_dir=[/tidb-data/tikv-20162], log_dir=/tidb-deploy/tikv-20162/log, cache_dir=/root/.tiup/storage/cluster/clusters/tidb-test/config-cache
+ [ Serial ] - InitConfig: cluster=tidb-test, user=tidb, host=192.168.169.40, path=/root/.tiup/storage/cluster/clusters/tidb-test/config-cache/tikv-20160.service, deploy_dir=/tidb-deploy/tikv-20160, data_dir=[/tidb-data/tikv-20160], log_dir=/tidb-deploy/tikv-20160/log, cache_dir=/root/.tiup/storage/cluster/clusters/tidb-test/config-cache
+ [ Serial ] - Mkdir: host=192.168.169.40, directories='/tidb-data/prometheus-9090'
+ [ Serial ] - Mkdir: host=192.168.169.40, directories=''
+ [ Serial ] - BackupComponent: component=grafana, currentVersion=v8.5.1, remote=192.168.169.40:/tidb-deploy/grafana-3000
+ [ Serial ] - CopyComponent: component=grafana, version=v9.0.0-beta.1.pre-nightly, remote=192.168.169.40:/tidb-deploy/grafana-3000 os=linux, arch=amd64
+ [ Serial ] - BackupComponent: component=prometheus, currentVersion=v8.5.1, remote=192.168.169.40:/tidb-deploy/prometheus-9090
+ [ Serial ] - CopyComponent: component=prometheus, version=v9.0.0-beta.1.pre-nightly, remote=192.168.169.40:/tidb-deploy/prometheus-9090 os=linux, arch=amd64
+ [ Serial ] - InitConfig: cluster=tidb-test, user=tidb, host=192.168.169.40, path=/root/.tiup/storage/cluster/clusters/tidb-test/config-cache/grafana-3000.service, deploy_dir=/tidb-deploy/grafana-3000, data_dir=[], log_dir=/tidb-deploy/grafana-3000/log, cache_dir=/root/.tiup/storage/cluster/clusters/tidb-test/config-cache
+ [ Serial ] - InitConfig: cluster=tidb-test, user=tidb, host=192.168.169.40, path=/root/.tiup/storage/cluster/clusters/tidb-test/config-cache/prometheus-9090.service, deploy_dir=/tidb-deploy/prometheus-9090, data_dir=[/tidb-data/prometheus-9090], log_dir=/tidb-deploy/prometheus-9090/log, cache_dir=/root/.tiup/storage/cluster/clusters/tidb-test/config-cache
deploy monitored
  - Deploy node_exporter -> 192.168.169.40 ... Done
  - Deploy blackbox_exporter -> 192.168.169.40 ... Done
refresh monitored config
  - Generate config node_exporter -> 192.168.169.40 ... Done
  - Generate config blackbox_exporter -> 192.168.169.40 ... Done
+ [ Serial ] - UpgradeCluster
Upgrading component tiflash
        Restarting instance 192.168.169.40:9000
        Restart instance 192.168.169.40:9000 success
Upgrading component cdc
         Start drain the capture, address: 192.168.169.40:8300, captureID: 11a04a02-7f4d-439b-88b7-59e1e5fcf22c
        Restarting instance 192.168.169.40:8300
        Restart instance 192.168.169.40:8300 success
         Start drain the capture, address: 192.168.169.40:8302, captureID: 5264fcaf-56b0-4c94-b9b8-3a26310af998
        Restarting instance 192.168.169.40:8302
        Restart instance 192.168.169.40:8302 success
         Start drain the capture, address: 192.168.169.40:8301, captureID: a604fa32-1784-4e71-8a72-5175e7c1c681
        Restarting instance 192.168.169.40:8301
        Restart instance 192.168.169.40:8301 success
Upgrading component pd
        Restarting instance 192.168.169.40:2379
        Restart instance 192.168.169.40:2379 success
Upgrading component tikv
        Evicting 8 leaders from store 192.168.169.40:20160...
          Still waiting for 8 store leaders to transfer...
          Still waiting for 8 store leaders to transfer...
          Still waiting for 8 store leaders to transfer...
          Still waiting for 8 store leaders to transfer...
          Still waiting for 8 store leaders to transfer...
          Still waiting for 6 store leaders to transfer...
          Still waiting for 6 store leaders to transfer...
          Still waiting for 6 store leaders to transfer...
          Still waiting for 6 store leaders to transfer...
          Still waiting for 6 store leaders to transfer...
          Still waiting for 6 store leaders to transfer...
          Still waiting for 6 store leaders to transfer...
          Still waiting for 6 store leaders to transfer...
          Still waiting for 6 store leaders to transfer...
          Still waiting for 6 store leaders to transfer...
          Still waiting for 6 store leaders to transfer...
          Still waiting for 6 store leaders to transfer...
          Still waiting for 6 store leaders to transfer...
          Still waiting for 6 store leaders to transfer...
          Still waiting for 6 store leaders to transfer...
          Still waiting for 6 store leaders to transfer...
          Still waiting for 6 store leaders to transfer...
          Still waiting for 6 store leaders to transfer...
          Still waiting for 6 store leaders to transfer...
          Still waiting for 6 store leaders to transfer...
          Still waiting for 6 store leaders to transfer...
          Still waiting for 6 store leaders to transfer...
          Still waiting for 6 store leaders to transfer...
          Still waiting for 6 store leaders to transfer...
          Still waiting for 6 store leaders to transfer...
          Still waiting for 6 store leaders to transfer...
        Restarting instance 192.168.169.40:20160
        Restart instance 192.168.169.40:20160 success
        Evicting 12 leaders from store 192.168.169.40:20161...
          Still waiting for 12 store leaders to transfer...
          Still waiting for 12 store leaders to transfer...
        Restarting instance 192.168.169.40:20161
        Restart instance 192.168.169.40:20161 success
        Evicting 16 leaders from store 192.168.169.40:20162...
          Still waiting for 16 store leaders to transfer...
          Still waiting for 16 store leaders to transfer...
          Still waiting for 16 store leaders to transfer...
        Restarting instance 192.168.169.40:20162
        Restart instance 192.168.169.40:20162 success
Upgrading component tidb
        Restarting instance 192.168.169.40:4000
        Restart instance 192.168.169.40:4000 success
Upgrading component prometheus
        Restarting instance 192.168.169.40:9090
        Restart instance 192.168.169.40:9090 success
Upgrading component grafana
        Restarting instance 192.168.169.40:3000
        Restart instance 192.168.169.40:3000 success
Stopping component node_exporter
        Stopping instance 192.168.169.40
        Stop 192.168.169.40 success
Stopping component blackbox_exporter
        Stopping instance 192.168.169.40
        Stop 192.168.169.40 success
Starting component node_exporter
        Starting instance 192.168.169.40
        Start 192.168.169.40 success
Starting component blackbox_exporter
        Starting instance 192.168.169.40
        Start 192.168.169.40 success
Upgraded cluster `tidb-test` successfully
[root@tidb40 ~]#
[root@tidb40 ~]# tiup cluster display tidb-test
Checking updates for component cluster... Timedout (after 2s)
Cluster type:       tidb
Cluster name:       tidb-test
Cluster version:    v9.0.0-beta.1.pre-nightly
Deploy user:        tidb
SSH type:           builtin
Dashboard URL:      http://192.168.169.40:2379/dashboard
Grafana URL:        http://192.168.169.40:3000
ID                    Role        Host            Ports                            OS/Arch       Status   Data Dir                    Deploy Dir
--                    ----        ----            -----                            -------       ------   --------                    ----------
192.168.169.40:8300   cdc         192.168.169.40  8300                             linux/x86_64  Up       /tidb-data/cdc-8300         /tidb-deploy/cdc-8300
192.168.169.40:8301   cdc         192.168.169.40  8301                             linux/x86_64  Up       /tidb-data/cdc-8301         /tidb-deploy/cdc-8301
192.168.169.40:8302   cdc         192.168.169.40  8302                             linux/x86_64  Up       /tidb-data/cdc-8302         /tidb-deploy/cdc-8302
192.168.169.40:3000   grafana     192.168.169.40  3000                             linux/x86_64  Up       -                           /tidb-deploy/grafana-3000
192.168.169.40:2379   pd          192.168.169.40  2379/2380                        linux/x86_64  Up|L|UI  /tidb-data/pd-2379          /tidb-deploy/pd-2379
192.168.169.40:9090   prometheus  192.168.169.40  9090/12020                       linux/x86_64  Up       /tidb-data/prometheus-9090  /tidb-deploy/prometheus-9090
192.168.169.40:4000   tidb        192.168.169.40  4000/10080                       linux/x86_64  Up       -                           /tidb-deploy/tidb-4000
192.168.169.40:9000   tiflash     192.168.169.40  9000/3930/20170/20292/8234/8123  linux/x86_64  Up       /tidb-data/tiflash-9000     /tidb-deploy/tiflash-9000
192.168.169.40:20160  tikv        192.168.169.40  20160/20180                      linux/x86_64  Up       /tidb-data/tikv-20160       /tidb-deploy/tikv-20160
192.168.169.40:20161  tikv        192.168.169.40  20161/20181                      linux/x86_64  Up       /tidb-data/tikv-20161       /tidb-deploy/tikv-20161
192.168.169.40:20162  tikv        192.168.169.40  20162/20182                      linux/x86_64  Up       /tidb-data/tikv-20162       /tidb-deploy/tikv-20162
Total nodes: 11

Lucien-卢西恩 · 2025 年3 月 26 日 07:37

咱们生产不要使用 beta 或者 MDR 的版本，现在您测试版本仅限于体验使用，其实不适合在业务场景里面做适配的。

Well · 2025 年3 月 26 日 10:33

了解，就是测试体验一下。