pd进程起不来，帮忙看下什么原因？

月明星稀 · 2024 年6 月 3 日 11:37

【 TiDB 使用环境】生产环境
【 TiDB 版本】6.5.0
【复现路径】clean --all或者–data和restart均无效
【遇到的问题：问题现象及影响】
整个集群的pd-server都起不来，进程起来又退出，集群网络没有问题。
错误日志如下：
[2024/06/03 19:20:55.408 +08:00] [ERROR] [etcdutil.go:126] [“load from etcd meet error”] [key=/pd/cluster_id] [error=“[PD:etcd:ErrEtcdKVGet]context deadline exceeded: context deadline exceeded”]
[2024/06/03 19:20:55.408 +08:00] [FATAL] [main.go:117] [“run server failed”] [error=“[PD:etcd:ErrEtcdKVGet]context deadline exceeded: context deadline exceeded”] [stack=“main.main\n\t/home/jenkins/agent/workspace/build-common/go/sr
c/github.com/pingcap/pd/cmd/pd-server/main.go:117\nruntime.main\n\t/usr/local/go/src/runtime/proc.go:250”]
[2024/06/03 19:21:11.019 +08:00] [ERROR] [etcdutil.go:71] [“failed to get cluster from remote”] [error=“[PD:etcd:ErrEtcdGetCluster]could not retrieve cluster information from the given URLs: could not retrieve cluster information f
rom the given URLs”]
[2024/06/03 19:21:11.019 +08:00] [ERROR] [etcdutil.go:71] [“failed to get cluster from remote”] [error=“[PD:etcd:ErrEtcdGetCluster]could not retrieve cluster information from the given URLs: could not retrieve cluster information f
rom the given URLs”]
[2024/06/03 19:21:49.419 +08:00] [FATAL] [main.go:117] [“run server failed”] [error=“[PD:etcd:ErrEtcdMemberList]context deadline exceeded: context deadline exceeded”] [stack=“main.main\n\t/home/jenkins/agent/workspace/build-common/
go/src/github.com/pingcap/pd/cmd/pd-server/main.go:117\nruntime.main\n\t/usr/local/go/src/runtime/proc.go:250”]
[2024/06/03 19:22:19.211 +08:00] [ERROR] [etcdutil.go:71] [“failed to get cluster from remote”] [error=“[PD:etcd:ErrEtcdGetCluster]could not retrieve cluster information from the given URLs: could not retrieve cluster information f
rom the given URLs”]
[2024/06/03 19:22:29.211 +08:00] [FATAL] [main.go:117] [“run server failed”] [error=“[PD:etcd:ErrEtcdMemberList]context deadline exceeded: context deadline exceeded”] [stack=“main.main\n\t/home/jenkins/agent/workspace/build-common/
go/src/github.com/pingcap/pd/cmd/pd-server/main.go:117\nruntime.main\n\t/usr/local/go/src/runtime/proc.go:250”]
[2024/06/03 19:22:47.524 +08:00] [ERROR] [etcdutil.go:71] [“failed to get cluster from remote”] [error=“[PD:etcd:ErrEtcdGetCluster]could not retrieve cluster information from the given URLs: could not retrieve cluster information f
rom the given URLs”]
[2024/06/03 19:23:21.706 +08:00] [FATAL] [main.go:117] [“run server failed”] [error=“[PD:etcd:ErrEtcdMemberList]context deadline exceeded: context deadline exceeded”] [stack=“main.main\n\t/home/jenkins/agent/workspace/build-common/
go/src/github.com/pingcap/pd/cmd/pd-server/main.go:117\nruntime.main\n\t/usr/local/go/src/runtime/proc.go:250”]
[2024/06/03 19:23:36.970 +08:00] [ERROR] [etcdutil.go:71] [“failed to get cluster from remote”] [error=“[PD:etcd:ErrEtcdGetCluster]could not retrieve cluster information from the given URLs: could not retrieve cluster information f
rom the given URLs”]
[2024/06/03 19:23:49.810 +08:00] [ERROR] [etcdutil.go:126] [“load from etcd meet error”] [key=/pd/cluster_id] [error=“[PD:etcd:ErrEtcdKVGet]context deadline exceeded: context deadline exceeded”]
[2024/06/03 19:23:49.810 +08:00] [FATAL] [main.go:117] [“run server failed”] [error=“[PD:etcd:ErrEtcdKVGet]context deadline exceeded: context deadline exceeded”] [stack=“main.main\n\t/home/jenkins/agent/workspace/build-common/go/sr
c/github.com/pingcap/pd/cmd/pd-server/main.go:117\nruntime.main\n\t/usr/local/go/src/runtime/proc.go:250”]
[2024/06/03 19:24:05.254 +08:00] [ERROR] [etcdutil.go:71] [“failed to get cluster from remote”] [error=“[PD:etcd:ErrEtcdGetCluster]could not retrieve cluster information from the given URLs: could not retrieve cluster information f
rom the given URLs”]
[2024/06/03 19:24:05.254 +08:00] [ERROR] [etcdutil.go:71] [“failed to get cluster from remote”] [error=“[PD:etcd:ErrEtcdGetCluster]could not retrieve cluster information from the given URLs: could not retrieve cluster information f
rom the given URLs”]
[2024/06/03 19:24:24.007 +08:00] [FATAL] [main.go:117] [“run server failed”] [error=“[PD:etcd:ErrEtcdMemberList]context deadline exceeded: context deadline exceeded”] [stack=“main.main\n\t/home/jenkins/agent/workspace/build-common/
go/src/github.com/pingcap/pd/cmd/pd-server/main.go:117\nruntime.main\n\t/usr/local/go/src/runtime/proc.go:250”]
[2024/06/03 19:24:39.510 +08:00] [ERROR] [etcdutil.go:71] [“failed to get cluster from remote”] [error=“[PD:etcd:ErrEtcdGetCluster]could not retrieve cluster information from the given URLs: could not retrieve cluster information f
rom the given URLs”]
[2024/06/03 19:24:39.510 +08:00] [ERROR] [etcdutil.go:71] [“failed to get cluster from remote”] [error=“[PD:etcd:ErrEtcdGetCluster]could not retrieve cluster information from the given URLs: could not retrieve cluster information f
rom the given URLs”]
[2024/06/03 19:24:39.510 +08:00] [ERROR] [etcdutil.go:71] [“failed to get cluster from remote”] [error=“[PD:etcd:ErrEtcdGetCluster]could not retrieve cluster information from the given URLs: could not retrieve cluster information f
rom the given URLs”]
[2024/06/03 19:25:03.310 +08:00] [ERROR] [etcdutil.go:126] [“load from etcd meet error”] [key=/pd/cluster_id] [error=“[PD:etcd:ErrEtcdKVGet]context deadline exceeded: context deadline exceeded”]
[2024/06/03 19:25:03.310 +08:00] [FATAL] [main.go:117] [“run server failed”] [error=“[PD:etcd:ErrEtcdKVGet]context deadline exceeded: context deadline exceeded”] [stack=“main.main\n\t/home/jenkins/agent/workspace/build-common/go/sr
c/github.com/pingcap/pd/cmd/pd-server/main.go:117\nruntime.main\n\t/usr/local/go/src/runtime/proc.go:250”]
[2024/06/03 19:25:18.715 +08:00] [ERROR] [etcdutil.go:71] [“failed to get cluster from remote”] [error=“[PD:etcd:ErrEtcdGetCluster]could not retrieve cluster information from the given URLs: could not retrieve cluster information f
rom the given URLs”]
[2024/06/03 19:25:35.606 +08:00] [FATAL] [main.go:117] [“run server failed”] [error=“[PD:etcd:ErrEtcdMemberList]context deadline exceeded: context deadline exceeded”] [stack=“main.main\n\t/home/jenkins/agent/workspace/build-common/
go/src/github.com/pingcap/pd/cmd/pd-server/main.go:117\nruntime.main\n\t/usr/local/go/src/runtime/proc.go:250”]
[2024/06/03 19:25:50.968 +08:00] [ERROR] [etcdutil.go:71] [“failed to get cluster from remote”] [error=“[PD:etcd:ErrEtcdGetCluster]could not retrieve cluster information from the given URLs: could not retrieve cluster information f
rom the given URLs”]
[2024/06/03 19:25:50.968 +08:00] [ERROR] [etcdutil.go:71] [“failed to get cluster from remote”] [error=“[PD:etcd:ErrEtcdGetCluster]could not retrieve cluster information from the given URLs: could not retrieve cluster information f
rom the given URLs”]
[2024/06/03 19:25:50.968 +08:00] [ERROR] [etcdutil.go:71] [“failed to get cluster from remote”] [error=“[PD:etcd:ErrEtcdGetCluster]could not retrieve cluster information from the given URLs: could not retrieve cluster information f
rom the given URLs”]
[2024/06/03 19:26:14.207 +08:00] [FATAL] [main.go:117] [“run server failed”] [error=“[PD:etcd:ErrEtcdMemberList]context deadline exceeded: context deadline exceeded”] [stack=“main.main\n\t/home/jenkins/agent/workspace/build-common/
go/src/github.com/pingcap/pd/cmd/pd-server/main.go:117\nruntime.main\n\t/usr/local/go/src/runtime/proc.go:250”]
[2024/06/03 19:26:29.990 +08:00] [ERROR] [etcdutil.go:71] [“failed to get cluster from remote”] [error=“[PD:etcd:ErrEtcdGetCluster]could not retrieve cluster information from the given URLs: could not retrieve cluster information f
rom the given URLs”]
[2024/06/03 19:26:29.990 +08:00] [ERROR] [etcdutil.go:71] [“failed to get cluster from remote”] [error=“[PD:etcd:ErrEtcdGetCluster]could not retrieve cluster information from the given URLs: could not retrieve cluster information f
rom the given URLs”]
[2024/06/03 19:26:29.999 +08:00] [ERROR] [etcdutil.go:71] [“failed to get cluster from remote”] [error=“[PD:etcd:ErrEtcdGetCluster]could not retrieve cluster information from the given URLs: could not retrieve cluster information f
rom the given URLs”]
[2024/06/03 19:26:45.910 +08:00] [FATAL] [main.go:117] [“run server failed”] [error=“[PD:etcd:ErrEtcdMemberList]context deadline exceeded: context deadline exceeded”] [stack=“main.main\n\t/home/jenkins/agent/workspace/build-common/
go/src/github.com/pingcap/pd/cmd/pd-server/main.go:117\nruntime.main\n\t/usr/local/go/src/runtime/proc.go:250”]
[2024/06/03 19:27:01.528 +08:00] [ERROR] [etcdutil.go:71] [“failed to get cluster from remote”] [error=“[PD:etcd:ErrEtcdGetCluster]could not retrieve cluster information from the given URLs: could not retrieve cluster information f
rom the given URLs”]
[2024/06/03 19:27:18.508 +08:00] [FATAL] [main.go:117] [“run server failed”] [error=“[PD:etcd:ErrEtcdMemberList]context deadline exceeded: context deadline exceeded”] [stack=“main.main\n\t/home/jenkins/agent/workspace/build-common/
go/src/github.com/pingcap/pd/cmd/pd-server/main.go:117\nruntime.main\n\t/usr/local/go/src/runtime/proc.go:250”]
[2024/06/03 19:27:33.826 +08:00] [ERROR] [etcdutil.go:71] [“failed to get cluster from remote”] [error=“[PD:etcd:ErrEtcdGetCluster]could not retrieve cluster information from the given URLs: could not retrieve cluster information f
rom the given URLs”]
[2024/06/03 19:27:33.835 +08:00] [ERROR] [etcdutil.go:71] [“failed to get cluster from remote”] [error=“[PD:etcd:ErrEtcdGetCluster]could not retrieve cluster information from the given URLs: could not retrieve cluster information f
rom the given URLs”]
[2024/06/03 19:27:52.006 +08:00] [ERROR] [etcdutil.go:126] [“load from etcd meet error”] [key=/pd/cluster_id] [error=“[PD:etcd:ErrEtcdKVGet]context deadline exceeded: context deadline exceeded”]
[2024/06/03 19:27:52.007 +08:00] [FATAL] [main.go:117] [“run server failed”] [error=“[PD:etcd:ErrEtcdKVGet]context deadline exceeded: context deadline exceeded”] [stack=“main.main\n\t/home/jenkins/agent/workspace/build-common/go/sr
c/github.com/pingcap/pd/cmd/pd-server/main.go:117\nruntime.main\n\t/usr/local/go/src/runtime/proc.go:250”]
[2024/06/03 19:28:07.513 +08:00] [ERROR] [etcdutil.go:71] [“failed to get cluster from remote”] [error=“[PD:etcd:ErrEtcdGetCluster]could not retrieve cluster information from the given URLs: could not retrieve cluster information f
rom the given URLs”]
[2024/06/03 19:28:07.526 +08:00] [ERROR] [etcdutil.go:71] [“failed to get cluster from remote”] [error=“[PD:etcd:ErrEtcdGetCluster]could not retrieve cluster information from the given URLs: could not retrieve cluster information f
rom the given URLs”]
[2024/06/03 19:28:20.306 +08:00] [FATAL] [main.go:117] [“run server failed”] [error=“[PD:etcd:ErrEtcdMemberList]context deadline exceeded: context deadline exceeded”] [stack=“main.main\n\t/home/jenkins/agent/workspace/build-common/
go/src/github.com/pingcap/pd/cmd/pd-server/main.go:117\nruntime.main\n\t/usr/local/go/src/runtime/proc.go:250”]
[2024/06/03 19:28:35.732 +08:00] [ERROR] [etcdutil.go:71] [“failed to get cluster from remote”] [error=“[PD:etcd:ErrEtcdGetCluster]could not retrieve cluster information from the given URLs: could not retrieve cluster information f
rom the given URLs”]
[2024/06/03 19:28:35.733 +08:00] [ERROR] [etcdutil.go:71] [“failed to get cluster from remote”] [error=“[PD:etcd:ErrEtcdGetCluster]could not retrieve cluster information from the given URLs: could not retrieve cluster information f
rom the given URLs”]
[2024/06/03 19:28:35.733 +08:00] [ERROR] [etcdutil.go:71] [“failed to get cluster from remote”] [error=“[PD:etcd:ErrEtcdGetCluster]could not retrieve cluster information from the given URLs: could not retrieve cluster information f
rom the given URLs”]
[2024/06/03 19:29:00.511 +08:00] [FATAL] [main.go:117] [“run server failed”] [error=“[PD:etcd:ErrEtcdMemberList]context deadline exceeded: context deadline exceeded”] [stack=“main.main\n\t/home/jenkins/agent/workspace/build-common/
go/src/github.com/pingcap/pd/cmd/pd-server/main.go:117\nruntime.main\n\t/usr/local/go/src/runtime/proc.go:250”]
[2024/06/03 19:29:18.490 +08:00] [ERROR] [etcdutil.go:71] [“failed to get cluster from remote”] [error=“[PD:etcd:ErrEtcdGetCluster]could not retrieve cluster information from the given URLs: could not retrieve cluster information f
rom the given URLs”]
[2024/06/03 19:29:18.500 +08:00] [ERROR] [etcdutil.go:71] [“failed to get cluster from remote”] [error=“[PD:etcd:ErrEtcdGetCluster]could not retrieve cluster information from the given URLs: could not retrieve cluster information f
rom the given URLs”]
[2024/06/03 19:29:45.807 +08:00] [FATAL] [main.go:117] [“run server failed”] [error=“[PD:etcd:ErrEtcdMemberList]context deadline exceeded: context deadline exceeded”] [stack=“main.main\n\t/home/jenkins/agent/workspace/build-common/
go/src/github.com/pingcap/pd/cmd/pd-server/main.go:117\nruntime.main\n\t/usr/local/go/src/runtime/proc.go:250”]
[2024/06/03 19:30:01.278 +08:00] [ERROR] [etcdutil.go:71] [“failed to get cluster from remote”] [error=“[PD:etcd:ErrEtcdGetCluster]could not retrieve cluster information from the given URLs: could not retrieve cluster information f
rom the given URLs”]
[2024/06/03 19:30:01.288 +08:00] [ERROR] [etcdutil.go:71] [“failed to get cluster from remote”] [error=“[PD:etcd:ErrEtcdGetCluster]could not retrieve cluster information from the given URLs: could not retrieve cluster information f
rom the given URLs”]
[2024/06/03 19:30:01.288 +08:00] [ERROR] [etcdutil.go:71] [“failed to get cluster from remote”] [error=“[PD:etcd:ErrEtcdGetCluster]could not retrieve cluster information from the given URLs: could not retrieve cluster information f
rom the given URLs”]

Miracle · 2024 年6 月 3 日 11:44

调整一下日志级别到info，然后再发一下pd的日志

Billmay表妹 · 2024 年6 月 3 日 11:52

部署的配置看一下，几个 pd 几个 tidb 几个tikv

月明星稀 · 2024 年6 月 3 日 12:02

感谢帮忙看下：
[2024/06/03 19:29:15.930 +08:00] [INFO] [util.go:41] [“Welcome to Placement Driver (PD)”]
[2024/06/03 19:29:15.930 +08:00] [INFO] [util.go:42] [PD] [release-version=v6.5.0]
[2024/06/03 19:29:15.930 +08:00] [INFO] [util.go:43] [PD] [edition=Community]
[2024/06/03 19:29:15.930 +08:00] [INFO] [util.go:44] [PD] [git-hash=d1a4433c3126c77fb2d5bb5720eefa0f2e05c166]
[2024/06/03 19:29:15.930 +08:00] [INFO] [util.go:45] [PD] [git-branch=heads/refs/tags/v6.5.0]
[2024/06/03 19:29:15.930 +08:00] [INFO] [util.go:46] [PD] [utc-build-time=“2022-12-16 08:19:07”]
[2024/06/03 19:29:15.930 +08:00] [INFO] [metricutil.go:83] [“disable Prometheus push client”]
[2024/06/03 19:29:15.930 +08:00] [INFO] [server.go:247] [“PD Config”] [config=“{"client-urls":"https://0.0.0.0:2379","peer-urls":"https://0.0.0.0:2380","advertise-client-urls":"https://152.122.65.30:2379","advertise-peer-urls":"https://152.122.65.30:2380","name":"pd-152.122.65.30-2379","data-dir":"/cache8/pd-data","force-new-cluster":false,"enable-grpc-gateway":true,"initial-cluster":"pd-152.122.65.30-2379=https://152.122.65.30:2380,pd-152.122.65.32-2379=https://152.122.65.32:2380,pd-152.122.65.35-2379=https://152.122.65.35:2380,pd-58.220.65.85-2379=https://58.220.65.85:2380","initial-cluster-state":"new","initial-cluster-token":"pd-cluster","join":"","lease":3,"log":{"level":"info","format":"text","disable-timestamp":false,"file":{"filename":"/usr/local/tikvserver/pd-2379/log/pd.log","max-size":300,"max-days":0,"max-backups":0},"development":false,"disable-caller":false,"disable-stacktrace":false,"disable-error-verbose":true,"sampling":null,"error-output-path":""},"tso-save-interval":"3s","tso-update-physical-interval":"50ms","enable-local-tso":false,"metric":{"job":"pd-152.122.65.30-2379","address":"","interval":"15s"},"schedule":{"max-snapshot-count":64,"max-pending-peer-count":64,"max-merge-region-size":20,"max-merge-region-keys":200000,"split-merge-interval":"1h0m0s","swtich-witness-interval":"1h0m0s","enable-one-way-merge":"false","enable-cross-table-merge":"true","patrol-region-interval":"10ms","max-store-down-time":"30m0s","max-store-preparing-time":"48h0m0s","leader-schedule-limit":20,"leader-schedule-policy":"count","region-schedule-limit":2048,"replica-schedule-limit":64,"merge-schedule-limit":8,"hot-region-schedule-limit":20,"hot-region-cache-hits-threshold":1,"store-limit":{},"tolerant-size-ratio":0,"low-space-ratio":0.8,"high-space-ratio":0.7,"region-score-formula-version":"v2","scheduler-max-waiting-operator":5,"enable-remove-down-replica":"true","enable-replace-offline-replica":"true","enable-make-up-replica":"true","enable-remove-extra-replica":"true","enable-location-replacement":"true","enable-debug-metrics":"false","enable-joint-consensus":"true","enable-tikv-split-region":"true","schedulers-v2":[{"type":"balance-region","args":null,"disable":false,"args-payload":""},{"type":"balance-leader","args":null,"disable":false,"args-payload":""},{"type":"hot-region","args":null,"disable":false,"args-payload":""},{"type":"split-bucket","args":null,"disable":false,"args-payload":""}],"schedulers-payload":null,"store-limit-mode":"manual","hot-regions-write-interval":"10m0s","hot-regions-reserved-days":7,"enable-diagnostic":"false","enable-witness":"false"},"replication":{"max-replicas":3,"location-labels":"","strictly-match-label":"false","enable-placement-rules":"true","enable-placement-rules-cache":"false","isolation-level":""},"pd-server":{"use-region-storage":"true","max-gap-reset-ts":"24h0m0s","key-type":"table","runtime-services":"","metric-storage":"","dashboard-address":"auto","trace-region-flow":"true","flow-round-by-digit":3,"min-resolved-ts-persistence-interval":"1s"},"cluster-version":"0.0.0","labels":{},"quota-backend-bytes":"8GiB","auto-compaction-mode":"periodic","auto-compaction-retention-v2":"1h","TickInterval":"500ms","ElectionInterval":"3s","PreVote":true,"max-request-bytes":157286400,"security":{"cacert-path":"/usr/local/tikvserver/pd-2379/tls/ca.crt","cert-path":"/usr/local/tikvserver/pd-2379/tls/pd.crt","key-path":"/usr/local/tikvserver/pd-2379/tls/pd.pem","cert-allowed-cn":null,"SSLCABytes":null,"SSLCertBytes":null,"SSLKEYBytes":null,"redact-info-log":false,"encryption":{"data-encryption-method":"plaintext","data-key-rotation-period":"168h0m0s","master-key":{"type":"plaintext","key-id":"","region":"","endpoint":"","path":""}}},"label-property":null,"WarningMsgs":null,"DisableStrictReconfigCheck":false,"HeartbeatStreamBindInterval":"1m0s","LeaderPriorityCheckInterval":"1m0s","dashboard":{"tidb-cacert-path":"","tidb-cert-path":"","tidb-key-path":"","public-path-prefix":"","internal-proxy":false,"enable-telemetry":true,"enable-experimental":false},"replication-mode":{"replication-mode":"majority","dr-auto-sync":{"label-key":"","primary":"","dr":"","primary-replicas":0,"dr-replicas":0,"wait-store-timeout":"1m0s","pause-region-split":"false"}}}”]
[2024/06/03 19:29:15.938 +08:00] [INFO] [server.go:222] [“register REST path”] [path=/pd/api/v1]
[2024/06/03 19:29:15.939 +08:00] [INFO] [server.go:222] [“register REST path”] [path=/pd/api/v2/]
[2024/06/03 19:29:15.939 +08:00] [INFO] [server.go:222] [“register REST path”] [path=/swagger/]
[2024/06/03 19:29:15.939 +08:00] [INFO] [server.go:222] [“register REST path”] [path=/autoscaling]
[2024/06/03 19:29:15.939 +08:00] [INFO] [distro.go:51] [“Using distribution strings”] [strings={}]
[2024/06/03 19:29:15.942 +08:00] [INFO] [server.go:222] [“register REST path”] [path=/dashboard/api/]
[2024/06/03 19:29:15.942 +08:00] [INFO] [server.go:222] [“register REST path”] [path=/dashboard/]
[2024/06/03 19:29:15.942 +08:00] [INFO] [etcd.go:117] [“configuring peer listeners”] [listen-peer-urls=“[https://0.0.0.0:2380]”]
[2024/06/03 19:29:15.942 +08:00] [INFO] [etcd.go:474] [“starting with peer TLS”] [tls-info=“cert = /usr/local/tikvserver/pd-2379/tls/pd.crt, key = /usr/local/tikvserver/pd-2379/tls/pd.pem, trusted-ca = /usr/local/tikvserver/pd-2379/tls/ca.crt, client-cert-auth = true, crl-file = “] [cipher-suites=””]
[2024/06/03 19:29:15.942 +08:00] [INFO] [systimemon.go:28] [“start system time monitor”]
[2024/06/03 19:29:15.942 +08:00] [INFO] [etcd.go:127] [“configuring client listeners”] [listen-client-urls=“[https://0.0.0.0:2379]”]
[2024/06/03 19:29:15.942 +08:00] [INFO] [etcd.go:611] [“pprof is enabled”] [path=/debug/pprof]
[2024/06/03 19:29:15.943 +08:00] [INFO] [etcd.go:305] [“starting an etcd server”] [etcd-version=3.4.21] [git-sha=“Not provided (use ./build instead of go build)”] [go-version=go1.19.3] [go-os=linux] [go-arch=amd64] [max-cpu-set=80] [max-cpu-available=80] [member-initialized=true] [name=pd-152.122.65.30-2379] [data-dir=/cache8/pd-data] [wal-dir=] [wal-dir-dedicated=] [member-dir=/cache8/pd-data/member] [force-new-cluster=false] [heartbeat-interval=500ms] [election-timeout=3s] [initial-election-tick-advance=true] [snapshot-count=100000] [snapshot-catchup-entries=5000] [initial-advertise-peer-urls=“[https://152.122.65.30:2380]”] [listen-peer-urls=“[https://0.0.0.0:2380]”] [advertise-client-urls=“[https://152.122.65.30:2379]”] [listen-client-urls=“[https://0.0.0.0:2379]”] [listen-metrics-urls=“”] [cors=“[]“] [host-whitelist=”[]”] [initial-cluster=] [initial-cluster-state=new] [initial-cluster-token=] [quota-backend-bytes=8589934592] [max-request-bytes=157286400] [max-concurrent-streams=4294967295] [pre-vote=true] [initial-corrupt-check=false] [corrupt-check-time-interval=0s] [auto-compaction-mode=periodic] [auto-compaction-retention=1h0m0s] [auto-compaction-interval=1h0m0s] [discovery-url=] [discovery-proxy=]
[2024/06/03 19:29:15.943 +08:00] [INFO] [backend.go:80] [“opened backend db”] [path=/cache8/pd-data/member/snap/db] [took=465.904µs]
[2024/06/03 19:29:15.952 +08:00] [INFO] [raft.go:586] [“restarting local member”] [cluster-id=821152945a57894b] [local-member-id=6443f7aacb544c75] [commit-index=107]
[2024/06/03 19:29:15.953 +08:00] [INFO] [raft.go:1523] [“6443f7aacb544c75 switched to configuration voters=()”]
[2024/06/03 19:29:15.953 +08:00] [INFO] [raft.go:706] [“6443f7aacb544c75 became follower at term 16”]
[2024/06/03 19:29:15.953 +08:00] [INFO] [raft.go:389] [“newRaft 6443f7aacb544c75 [peers: , term: 16, commit: 107, applied: 0, lastindex: 108, lastterm: 16]”]
[2024/06/03 19:29:15.954 +08:00] [INFO] [quota.go:126] [“enabled backend quota”] [quota-name=v3-applier] [quota-size-bytes=8589934592] [quota-size=“8.6 GB”]
[2024/06/03 19:29:15.955 +08:00] [INFO] [server.go:816] [“starting etcd server”] [local-member-id=6443f7aacb544c75] [local-server-version=3.4.21] [cluster-version=to_be_decided]
[2024/06/03 19:29:15.955 +08:00] [INFO] [server.go:704] [“starting initial election tick advance”] [election-ticks=6]
[2024/06/03 19:29:15.956 +08:00] [INFO] [raft.go:1523] [“6443f7aacb544c75 switched to configuration voters=(1282144946999282109)”]
[2024/06/03 19:29:15.956 +08:00] [INFO] [cluster.go:392] [“added member”] [cluster-id=821152945a57894b] [local-member-id=6443f7aacb544c75] [added-peer-id=11cb1809447449bd] [added-peer-peer-urls=“[https://152.122.65.35:2380]”]
[2024/06/03 19:29:15.956 +08:00] [INFO] [peer.go:128] [“starting remote peer”] [remote-peer-id=11cb1809447449bd]
[2024/06/03 19:29:15.956 +08:00] [INFO] [pipeline.go:71] [“started HTTP pipelining with remote peer”] [local-member-id=6443f7aacb544c75] [remote-peer-id=11cb1809447449bd]
[2024/06/03 19:29:15.956 +08:00] [INFO] [stream.go:166] [“started stream writer with remote peer”] [local-member-id=6443f7aacb544c75] [remote-peer-id=11cb1809447449bd]
[2024/06/03 19:29:15.956 +08:00] [INFO] [stream.go:166] [“started stream writer with remote peer”] [local-member-id=6443f7aacb544c75] [remote-peer-id=11cb1809447449bd]
[2024/06/03 19:29:15.956 +08:00] [INFO] [peer.go:134] [“started remote peer”] [remote-peer-id=11cb1809447449bd]
[2024/06/03 19:29:15.957 +08:00] [INFO] [transport.go:327] [“added remote peer”] [local-member-id=6443f7aacb544c75] [remote-peer-id=11cb1809447449bd] [remote-peer-urls=“[https://152.122.65.35:2380]”]
[2024/06/03 19:29:15.957 +08:00] [INFO] [stream.go:406] [“started stream reader with remote peer”] [stream-reader-type=“stream MsgApp v2”] [local-member-id=6443f7aacb544c75] [remote-peer-id=11cb1809447449bd]
[2024/06/03 19:29:15.957 +08:00] [INFO] [raft.go:1523] [“6443f7aacb544c75 switched to configuration voters=(1282144946999282109 7224890540160207989)”]
[2024/06/03 19:29:15.957 +08:00] [INFO] [stream.go:406] [“started stream reader with remote peer”] [stream-reader-type=“stream Message”] [local-member-id=6443f7aacb544c75] [remote-peer-id=11cb1809447449bd]
[2024/06/03 19:29:15.957 +08:00] [INFO] [cluster.go:392] [“added member”] [cluster-id=821152945a57894b] [local-member-id=6443f7aacb544c75] [added-peer-id=6443f7aacb544c75] [added-peer-peer-urls=“[https://152.122.65.30:2380]”]
[2024/06/03 19:29:15.957 +08:00] [INFO] [raft.go:1523] [“6443f7aacb544c75 switched to configuration voters=(1282144946999282109 7224890540160207989 13449958727701477628)”]
[2024/06/03 19:29:15.957 +08:00] [INFO] [cluster.go:392] [“added member”] [cluster-id=821152945a57894b] [local-member-id=6443f7aacb544c75] [added-peer-id=baa7da33b04fb8fc] [added-peer-peer-urls=“[https://152.122.65.32:2380]”]
[2024/06/03 19:29:15.957 +08:00] [INFO] [peer.go:128] [“starting remote peer”] [remote-peer-id=baa7da33b04fb8fc]
[2024/06/03 19:29:15.957 +08:00] [INFO] [pipeline.go:71] [“started HTTP pipelining with remote peer”] [local-member-id=6443f7aacb544c75] [remote-peer-id=baa7da33b04fb8fc]
[2024/06/03 19:29:15.958 +08:00] [INFO] [stream.go:166] [“started stream writer with remote peer”] [local-member-id=6443f7aacb544c75] [remote-peer-id=baa7da33b04fb8fc]
[2024/06/03 19:29:15.958 +08:00] [INFO] [peer.go:134] [“started remote peer”] [remote-peer-id=baa7da33b04fb8fc]
[2024/06/03 19:29:15.958 +08:00] [INFO] [stream.go:166] [“started stream writer with remote peer”] [local-member-id=6443f7aacb544c75] [remote-peer-id=baa7da33b04fb8fc]
[2024/06/03 19:29:15.958 +08:00] [INFO] [transport.go:327] [“added remote peer”] [local-member-id=6443f7aacb544c75] [remote-peer-id=baa7da33b04fb8fc] [remote-peer-urls=“[https://152.122.65.32:2380]”]
[2024/06/03 19:29:15.958 +08:00] [INFO] [stream.go:406] [“started stream reader with remote peer”] [stream-reader-type=“stream MsgApp v2”] [local-member-id=6443f7aacb544c75] [remote-peer-id=baa7da33b04fb8fc]
[2024/06/03 19:29:15.958 +08:00] [INFO] [stream.go:406] [“started stream reader with remote peer”] [stream-reader-type=“stream Message”] [local-member-id=6443f7aacb544c75] [remote-peer-id=baa7da33b04fb8fc]
[2024/06/03 19:29:15.958 +08:00] [INFO] [raft.go:1523] [“6443f7aacb544c75 switched to configuration voters=(1282144946999282109 7224890540160207989 13449958727701477628 14644213667457164611)”]
[2024/06/03 19:29:15.959 +08:00] [INFO] [cluster.go:392] [“added member”] [cluster-id=821152945a57894b] [local-member-id=6443f7aacb544c75] [added-peer-id=cb3ab2bdffb46543] [added-peer-peer-urls=“[https://58.220.65.85:2380]”]
[2024/06/03 19:29:15.959 +08:00] [INFO] [peer.go:128] [“starting remote peer”] [remote-peer-id=cb3ab2bdffb46543]
[2024/06/03 19:29:15.959 +08:00] [INFO] [pipeline.go:71] [“started HTTP pipelining with remote peer”] [local-member-id=6443f7aacb544c75] [remote-peer-id=cb3ab2bdffb46543]
[2024/06/03 19:29:15.959 +08:00] [INFO] [stream.go:166] [“started stream writer with remote peer”] [local-member-id=6443f7aacb544c75] [remote-peer-id=cb3ab2bdffb46543]
[2024/06/03 19:29:15.960 +08:00] [INFO] [stream.go:166] [“started stream writer with remote peer”] [local-member-id=6443f7aacb544c75] [remote-peer-id=cb3ab2bdffb46543]
[2024/06/03 19:29:15.960 +08:00] [INFO] [stream.go:406] [“started stream reader with remote peer”] [stream-reader-type=“stream Message”] [local-member-id=6443f7aacb544c75] [remote-peer-id=cb3ab2bdffb46543]
[2024/06/03 19:29:15.960 +08:00] [INFO] [peer.go:134] [“started remote peer”] [remote-peer-id=cb3ab2bdffb46543]
[2024/06/03 19:29:15.960 +08:00] [INFO] [stream.go:406] [“started stream reader with remote peer”] [stream-reader-type=“stream MsgApp v2”] [local-member-id=6443f7aacb544c75] [remote-peer-id=cb3ab2bdffb46543]
[2024/06/03 19:29:15.960 +08:00] [INFO] [transport.go:327] [“added remote peer”] [local-member-id=6443f7aacb544c75] [remote-peer-id=cb3ab2bdffb46543] [remote-peer-urls=“[https://58.220.65.85:2380]”]
[2024/06/03 19:29:15.960 +08:00] [INFO] [cluster.go:558] [“set initial cluster version”] [cluster-id=821152945a57894b] [local-member-id=6443f7aacb544c75] [cluster-version=3.4]
[2024/06/03 19:29:15.961 +08:00] [INFO] [etcd.go:717] [“starting with client TLS”] [tls-info=“cert = /usr/local/tikvserver/pd-2379/tls/pd.crt, key = /usr/local/tikvserver/pd-2379/tls/pd.pem, trusted-ca = /usr/local/tikvserver/pd-2379/tls/ca.crt, client-cert-auth = true, crl-file = “] [cipher-suites=””]
[2024/06/03 19:29:15.961 +08:00] [INFO] [etcd.go:585] [“serving peer traffic”] [address=“[::]:2380”]
[2024/06/03 19:29:15.961 +08:00] [INFO] [capability.go:76] [“enabled capabilities for version”] [cluster-version=3.4]
[2024/06/03 19:29:15.961 +08:00] [INFO] [etcd.go:247] [“now serving peer/client/metrics”] [local-member-id=6443f7aacb544c75] [initial-advertise-peer-urls=“[https://152.122.65.30:2380]”] [listen-peer-urls=“[https://0.0.0.0:2380]”] [advertise-client-urls=“[https://152.122.65.30:2379]”] [listen-client-urls=“[https://0.0.0.0:2379]”] [listen-metrics-urls=“”]
[2024/06/03 19:29:15.968 +08:00] [INFO] [peer_status.go:51] [“peer became active”] [peer-id=11cb1809447449bd]
[2024/06/03 19:29:15.968 +08:00] [INFO] [stream.go:425] [“established TCP streaming connection with remote peer”] [stream-reader-type=“stream Message”] [local-member-id=6443f7aacb544c75] [remote-peer-id=11cb1809447449bd]
[2024/06/03 19:29:15.969 +08:00] [INFO] [stream.go:425] [“established TCP streaming connection with remote peer”] [stream-reader-type=“stream MsgApp v2”] [local-member-id=6443f7aacb544c75] [remote-peer-id=11cb1809447449bd]
[2024/06/03 19:29:15.981 +08:00] [INFO] [stream.go:250] [“set message encoder”] [from=6443f7aacb544c75] [to=6443f7aacb544c75] [stream-type=“stream MsgApp v2”]
[2024/06/03 19:29:15.984 +08:00] [INFO] [stream.go:250] [“set message encoder”] [from=6443f7aacb544c75] [to=6443f7aacb544c75] [stream-type=“stream Message”]
[2024/06/03 19:29:16.319 +08:00] [INFO] [peer_status.go:51] [“peer became active”] [peer-id=cb3ab2bdffb46543]
[2024/06/03 19:29:16.319 +08:00] [INFO] [stream.go:425] [“established TCP streaming connection with remote peer”] [stream-reader-type=“stream MsgApp v2”] [local-member-id=6443f7aacb544c75] [remote-peer-id=cb3ab2bdffb46543]
[2024/06/03 19:29:16.360 +08:00] [INFO] [server.go:729] [“initialized peer connections; fast-forwarding election ticks”] [local-member-id=6443f7aacb544c75] [forward-ticks=4] [forward-duration=2s] [election-ticks=6] [election-timeout=3s] [active-remote-members=2]
[2024/06/03 19:29:16.412 +08:00] [INFO] [stream.go:425] [“established TCP streaming connection with remote peer”] [stream-reader-type=“stream Message”] [local-member-id=6443f7aacb544c75] [remote-peer-id=cb3ab2bdffb46543]
[2024/06/03 19:29:16.510 +08:00] [INFO] [raft.go:966] [“6443f7aacb544c75 [logterm: 16, index: 108, vote: baa7da33b04fb8fc] cast MsgPreVote for cb3ab2bdffb46543 [logterm: 16, index: 108] at term 16”]
[2024/06/03 19:29:18.490 +08:00] [ERROR] [etcdutil.go:71] [“failed to get cluster from remote”] [error=“[PD:etcd:ErrEtcdGetCluster]could not retrieve cluster information from the given URLs: could not retrieve cluster information from the given URLs”]
[2024/06/03 19:29:18.500 +08:00] [ERROR] [etcdutil.go:71] [“failed to get cluster from remote”] [error=“[PD:etcd:ErrEtcdGetCluster]could not retrieve cluster information from the given URLs: could not retrieve cluster information from the given URLs”]
[2024/06/03 19:29:18.954 +08:00] [INFO] [raft.go:929] [“6443f7aacb544c75 is starting a new election at term 16”]
[2024/06/03 19:29:18.954 +08:00] [INFO] [raft.go:735] [“6443f7aacb544c75 became pre-candidate at term 16”]
[2024/06/03 19:29:18.954 +08:00] [INFO] [raft.go:830] [“6443f7aacb544c75 received MsgPreVoteResp from 6443f7aacb544c75 at term 16”]
[2024/06/03 19:29:18.954 +08:00] [INFO] [raft.go:817] [“6443f7aacb544c75 [logterm: 16, index: 108] sent MsgPreVote request to 11cb1809447449bd at term 16”]
[2024/06/03 19:29:18.954 +08:00] [INFO] [raft.go:817] [“6443f7aacb544c75 [logterm: 16, index: 108] sent MsgPreVote request to baa7da33b04fb8fc at term 16”]
[2024/06/03 19:29:18.954 +08:00] [INFO] [raft.go:817] [“6443f7aacb544c75 [logterm: 16, index: 108] sent MsgPreVote request to cb3ab2bdffb46543 at term 16”]
[2024/06/03 19:29:18.955 +08:00] [INFO] [raft.go:865] [“6443f7aacb544c75 [term: 16] received a MsgPreVoteResp message with higher term from 11cb1809447449bd [term: 17]”]
[2024/06/03 19:29:18.955 +08:00] [INFO] [raft.go:706] [“6443f7aacb544c75 became follower at term 17”]
[2024/06/03 19:29:20.267 +08:00] [INFO] [raft.go:966] [“6443f7aacb544c75 [logterm: 16, index: 108, vote: 0] cast MsgPreVote for 11cb1809447449bd [logterm: 16, index: 108] at term 17”]
[2024/06/03 19:29:24.267 +08:00] [INFO] [raft.go:966] [“6443f7aacb544c75 [logterm: 16, index: 108, vote: 0] cast MsgPreVote for 11cb1809447449bd [logterm: 16, index: 108] at term 17”]
[2024/06/03 19:29:24.455 +08:00] [INFO] [raft.go:929] [“6443f7aacb544c75 is starting a new election at term 17”]
[2024/06/03 19:29:24.455 +08:00] [INFO] [raft.go:735] [“6443f7aacb544c75 became pre-candidate at term 17”]
[2024/06/03 19:29:24.455 +08:00] [INFO] [raft.go:830] [“6443f7aacb544c75 received MsgPreVoteResp from 6443f7aacb544c75 at term 17”]
[2024/06/03 19:29:24.455 +08:00] [INFO] [raft.go:817] [“6443f7aacb544c75 [logterm: 16, index: 108] sent MsgPreVote request to 11cb1809447449bd at term 17”]
[2024/06/03 19:29:24.455 +08:00] [INFO] [raft.go:817] [“6443f7aacb544c75 [logterm: 16, index: 108] sent MsgPreVote request to baa7da33b04fb8fc at term 17”]
[2024/06/03 19:29:24.455 +08:00] [INFO] [raft.go:817] [“6443f7aacb544c75 [logterm: 16, index: 108] sent MsgPreVote request to cb3ab2bdffb46543 at term 17”]
[2024/06/03 19:29:24.455 +08:00] [INFO] [raft.go:830] [“6443f7aacb544c75 received MsgPreVoteResp from 11cb1809447449bd at term 17”]
[2024/06/03 19:29:24.455 +08:00] [INFO] [raft.go:1295] [“6443f7aacb544c75 has received 2 MsgPreVoteResp votes and 0 vote rejections”]
[2024/06/03 19:29:28.267 +08:00] [INFO] [raft.go:966] [“6443f7aacb544c75 [logterm: 16, index: 108, vote: 0] cast MsgPreVote for 11cb1809447449bd [logterm: 16, index: 108] at term 17”]
[2024/06/03 19:29:29.954 +08:00] [INFO] [raft.go:929] [“6443f7aacb544c75 is starting a new election at term 17”]
[2024/06/03 19:29:29.954 +08:00] [INFO] [raft.go:735] [“6443f7aacb544c75 became pre-candidate at term 17”]
[2024/06/03 19:29:29.954 +08:00] [INFO] [raft.go:830] [“6443f7aacb544c75 received MsgPreVoteResp from 6443f7aacb544c75 at term 17”]
[2024/06/03 19:29:29.954 +08:00] [INFO] [raft.go:817] [“6443f7aacb544c75 [logterm: 16, index: 108] sent MsgPreVote request to 11cb1809447449bd at term 17”]
[2024/06/03 19:29:29.954 +08:00] [INFO] [raft.go:817] [“6443f7aacb544c75 [logterm: 16, index: 108] sent MsgPreVote request to baa7da33b04fb8fc at term 17”]
[2024/06/03 19:29:29.954 +08:00] [INFO] [raft.go:817] [“6443f7aacb544c75 [logterm: 16, index: 108] sent MsgPreVote request to cb3ab2bdffb46543 at term 17”]
[2024/06/03 19:29:29.955 +08:00] [INFO] [raft.go:830] [“6443f7aacb544c75 received MsgPreVoteResp from 11cb1809447449bd at term 17”]
[2024/06/03 19:29:29.955 +08:00] [INFO] [raft.go:1295] [“6443f7aacb544c75 has received 2 MsgPreVoteResp votes and 0 vote rejections”]
[2024/06/03 19:29:32.267 +08:00] [INFO] [raft.go:966] [“6443f7aacb544c75 [logterm: 16, index: 108, vote: 0] cast MsgPreVote for 11cb1809447449bd [logterm: 16, index: 108] at term 17”]
[2024/06/03 19:29:32.542 +08:00] [INFO] [peer_status.go:51] [“peer became active”] [peer-id=cb3ab2bdffb46543]
[2024/06/03 19:29:32.542 +08:00] [INFO] [stream.go:425] [“established TCP streaming connection with remote peer”] [stream-reader-type=“stream MsgApp v2”] [local-member-id=6443f7aacb544c75] [remote-peer-id=cb3ab2bdffb46543]
[2024/06/03 19:29:32.542 +08:00] [INFO] [stream.go:425] [“established TCP streaming connection with remote peer”] [stream-reader-type=“stream Message”] [local-member-id=6443f7aacb544c75] [remote-peer-id=cb3ab2bdffb46543]
[2024/06/03 19:29:32.548 +08:00] [INFO] [stream.go:250] [“set message encoder”] [from=6443f7aacb544c75] [to=6443f7aacb544c75] [stream-type=“stream MsgApp v2”]
[2024/06/03 19:29:32.553 +08:00] [INFO] [stream.go:250] [“set message encoder”] [from=6443f7aacb544c75] [to=6443f7aacb544c75] [stream-type=“stream Message”]
[2024/06/03 19:29:33.790 +08:00] [INFO] [stream.go:250] [“set message encoder”] [from=6443f7aacb544c75] [to=6443f7aacb544c75] [stream-type=“stream MsgApp v2”]
[2024/06/03 19:29:33.790 +08:00] [INFO] [peer_status.go:51] [“peer became active”] [peer-id=baa7da33b04fb8fc]
[2024/06/03 19:29:33.791 +08:00] [INFO] [stream.go:250] [“set message encoder”] [from=6443f7aacb544c75] [to=6443f7aacb544c75] [stream-type=“stream Message”]
[2024/06/03 19:29:33.807 +08:00] [INFO] [stream.go:425] [“established TCP streaming connection with remote peer”] [stream-reader-type=“stream Message”] [local-member-id=6443f7aacb544c75] [remote-peer-id=baa7da33b04fb8fc]
[2024/06/03 19:29:33.840 +08:00] [INFO] [stream.go:425] [“established TCP streaming connection with remote peer”] [stream-reader-type=“stream MsgApp v2”] [local-member-id=6443f7aacb544c75] [remote-peer-id=baa7da33b04fb8fc]
[2024/06/03 19:29:34.774 +08:00] [INFO] [raft.go:966] [“6443f7aacb544c75 [logterm: 16, index: 108, vote: 0] cast MsgPreVote for baa7da33b04fb8fc [logterm: 16, index: 108] at term 17”]
[2024/06/03 19:29:35.454 +08:00] [INFO] [raft.go:929] [“6443f7aacb544c75 is starting a new election at term 17”]
[2024/06/03 19:29:35.454 +08:00] [INFO] [raft.go:735] [“6443f7aacb544c75 became pre-candidate at term 17”]
[2024/06/03 19:29:35.454 +08:00] [INFO] [raft.go:830] [“6443f7aacb544c75 received MsgPreVoteResp from 6443f7aacb544c75 at term 17”]
[2024/06/03 19:29:35.454 +08:00] [INFO] [raft.go:817] [“6443f7aacb544c75 [logterm: 16, index: 108] sent MsgPreVote request to 11cb1809447449bd at term 17”]
[2024/06/03 19:29:35.454 +08:00] [INFO] [raft.go:817] [“6443f7aacb544c75 [logterm: 16, index: 108] sent MsgPreVote request to baa7da33b04fb8fc at term 17”]
[2024/06/03 19:29:35.454 +08:00] [INFO] [raft.go:817] [“6443f7aacb544c75 [logterm: 16, index: 108] sent MsgPreVote request to cb3ab2bdffb46543 at term 17”]
[2024/06/03 19:29:35.455 +08:00] [INFO] [raft.go:830] [“6443f7aacb544c75 received MsgPreVoteResp from 11cb1809447449bd at term 17”]
[2024/06/03 19:29:35.455 +08:00] [INFO] [raft.go:1295] [“6443f7aacb544c75 has received 2 MsgPreVoteResp votes and 0 vote rejections”]
[2024/06/03 19:29:35.455 +08:00] [INFO] [raft.go:830] [“6443f7aacb544c75 received MsgPreVoteResp from baa7da33b04fb8fc at term 17”]
[2024/06/03 19:29:35.455 +08:00] [INFO] [raft.go:1295] [“6443f7aacb544c75 has received 3 MsgPreVoteResp votes and 0 vote rejections”]
[2024/06/03 19:29:35.455 +08:00] [INFO] [raft.go:719] [“6443f7aacb544c75 became candidate at term 18”]
[2024/06/03 19:29:35.455 +08:00] [INFO] [raft.go:830] [“6443f7aacb544c75 received MsgVoteResp from 6443f7aacb544c75 at term 18”]
[2024/06/03 19:29:35.455 +08:00] [INFO] [raft.go:817] [“6443f7aacb544c75 [logterm: 16, index: 108] sent MsgVote request to 11cb1809447449bd at term 18”]
[2024/06/03 19:29:35.455 +08:00] [INFO] [raft.go:817] [“6443f7aacb544c75 [logterm: 16, index: 108] sent MsgVote request to baa7da33b04fb8fc at term 18”]
[2024/06/03 19:29:35.455 +08:00] [INFO] [raft.go:817] [“6443f7aacb544c75 [logterm: 16, index: 108] sent MsgVote request to cb3ab2bdffb46543 at term 18”]
[2024/06/03 19:29:35.456 +08:00] [INFO] [raft.go:830] [“6443f7aacb544c75 received MsgVoteResp from baa7da33b04fb8fc at term 18”]
[2024/06/03 19:29:35.456 +08:00] [INFO] [raft.go:1295] [“6443f7aacb544c75 has received 2 MsgVoteResp votes and 0 vote rejections”]
[2024/06/03 19:29:35.456 +08:00] [INFO] [raft.go:830] [“6443f7aacb544c75 received MsgVoteResp from cb3ab2bdffb46543 at term 18”]
[2024/06/03 19:29:35.456 +08:00] [INFO] [raft.go:1295] [“6443f7aacb544c75 has received 3 MsgVoteResp votes and 0 vote rejections”]
[2024/06/03 19:29:35.456 +08:00] [INFO] [raft.go:771] [“6443f7aacb544c75 became leader at term 18”]
[2024/06/03 19:29:35.456 +08:00] [INFO] [node.go:327] [“raft.node: 6443f7aacb544c75 elected leader 6443f7aacb544c75 at term 18”]
[2024/06/03 19:29:35.458 +08:00] [INFO] [server.go:2069] [“published local member to cluster through raft”] [local-member-id=6443f7aacb544c75] [local-member-attributes=“{Name:pd-152.122.65.30-2379 ClientURLs:[https://152.122.65.30:2379]}”] [request-path=/0/members/6443f7aacb544c75/attributes] [cluster-id=821152945a57894b] [publish-timeout=11s]
[2024/06/03 19:29:35.458 +08:00] [INFO] [server.go:329] [“create etcd v3 client”] [endpoints=“[https://152.122.65.30:2379]”] [cert=“{"cacert-path":"/usr/local/tikvserver/pd-2379/tls/ca.crt","cert-path":"/usr/local/tikvserver/pd-2379/tls/pd.crt","key-path":"/usr/local/tikvserver/pd-2379/tls/pd.pem","cert-allowed-cn":null,"SSLCABytes":null,"SSLCertBytes":null,"SSLKEYBytes":null,"redact-info-log":false,"encryption":{"data-encryption-method":"plaintext","data-key-rotation-period":"168h0m0s","master-key":{"type":"plaintext","key-id":"","region":"","endpoint":"","path":""}}}”]
[2024/06/03 19:29:35.460 +08:00] [INFO] [serve.go:201] [“serving client traffic securely”] [address=“[::]:2379”]
[2024/06/03 19:29:36.128 +08:00] [INFO] [trace.go:152] [“trace[1166308490] linearizableReadLoop”] [detail=“{readStateIndex:113; appliedIndex:113; }”] [duration=311.523994ms] [start=2024/06/03 19:29:35.816 +08:00] [end=2024/06/03 19:29:36.128 +08:00] [steps=“["trace[1166308490] ‘read index received’ (duration: 311.516981ms)","trace[1166308490] ‘applied index is now lower than readState.Index’ (duration: 5.597µs)"]”]
[2024/06/03 19:29:36.209 +08:00] [INFO] [trace.go:152] [“trace[1548495573] range”] [detail=“{range_begin:/tidb/store/gcworker/saved_safe_point; range_end:; response_count:0; response_revision:27; }”] [duration=392.676103ms] [start=2024/06/03 19:29:35.816 +08:00] [end=2024/06/03 19:29:36.209 +08:00] [steps=“["trace[1548495573] ‘agreement among raft nodes before linearized reading’ (duration: 391.673333ms)"]”]
[2024/06/03 19:29:36.506 +08:00] [INFO] [trace.go:152] [“trace[2018591368] linearizableReadLoop”] [detail=“{readStateIndex:113; appliedIndex:113; }”] [duration=283.765253ms] [start=2024/06/03 19:29:36.223 +08:00] [end=2024/06/03 19:29:36.506 +08:00] [steps=“["trace[2018591368] ‘read index received’ (duration: 283.761771ms)","trace[2018591368] ‘applied index is now lower than readState.Index’ (duration: 2.529µs)"]”]
[2024/06/03 19:29:36.507 +08:00] [INFO] [trace.go:152] [“trace[1373753435] range”] [detail=“{range_begin:/tidb/store/gcworker/saved_safe_point; range_end:; response_count:0; response_revision:27; }”] [duration=284.244841ms] [start=2024/06/03 19:29:36.223 +08:00] [end=2024/06/03 19:29:36.507 +08:00] [steps=“["trace[1373753435] ‘agreement among raft nodes before linearized reading’ (duration: 284.035442ms)"]”]
[2024/06/03 19:29:37.208 +08:00] [INFO] [trace.go:152] [“trace[691060210] linearizableReadLoop”] [detail=“{readStateIndex:113; appliedIndex:113; }”] [duration=701.460156ms] [start=2024/06/03 19:29:36.507 +08:00] [end=2024/06/03 19:29:37.208 +08:00] [steps=“["trace[691060210] ‘read index received’ (duration: 701.452545ms)","trace[691060210] ‘applied index is now lower than readState.Index’ (duration: 6.181µs)"]”]
[2024/06/03 19:29:37.208 +08:00] [INFO] [trace.go:152] [“trace[613171728] range”] [detail=“{range_begin:/tidb/store/gcworker/saved_safe_point; range_end:; response_count:0; response_revision:27; }”] [duration=800.639231ms] [start=2024/06/03 19:29:36.408 +08:00] [end=2024/06/03 19:29:37.208 +08:00] [steps=“["trace[613171728] ‘agreement among raft nodes before linearized reading’ (duration: 800.300746ms)"]”]
[2024/06/03 19:29:37.209 +08:00] [INFO] [trace.go:152] [“trace[1069862784] range”] [detail=“{range_begin:/tidb/store/gcworker/saved_safe_point; range_end:; response_count:0; response_revision:27; }”] [duration=899.317028ms] [start=2024/06/03 19:29:36.309 +08:00] [end=2024/06/03 19:29:37.209 +08:00] [steps=“["trace[1069862784] ‘agreement among raft nodes before linearized reading’ (duration: 898.862303ms)"]”]
[2024/06/03 19:29:37.209 +08:00] [INFO] [trace.go:152] [“trace[1511939976] range”] [detail=“{range_begin:/tidb/store/gcworker/saved_safe_point; range_end:; response_count:0; response_revision:27; }”] [duration=899.531077ms] [start=2024/06/03 19:29:36.309 +08:00] [end=2024/06/03 19:29:37.209 +08:00] [steps=“["trace[1511939976] ‘agreement among raft nodes before linearized reading’ (duration: 899.015764ms)"]”]
[2024/06/03 19:29:37.210 +08:00] [INFO] [trace.go:152] [“trace[1071996945] range”] [detail=“{range_begin:/tidb/store/gcworker/saved_safe_point; range_end:; response_count:0; response_revision:27; }”] [duration=892.120366ms] [start=2024/06/03 19:29:36.318 +08:00] [end=2024/06/03 19:29:37.210 +08:00] [steps=“["trace[1071996945] ‘agreement among raft nodes before linearized reading’ (duration: 891.867496ms)"]”]
[2024/06/03 19:29:37.407 +08:00] [INFO] [trace.go:152] [“trace[1795960481] range”] [detail=“{range_begin:/tidb/store/gcworker/saved_safe_point; range_end:; }”] [duration=900.725957ms] [start=2024/06/03 19:29:36.507 +08:00] [end=2024/06/03 19:29:37.407 +08:00] [steps=“["trace[1795960481] ‘agreement among raft nodes before linearized reading’ (duration: 900.643191ms)"]”]
[2024/06/03 19:29:37.508 +08:00] [INFO] [trace.go:152] [“trace[1079837179] range”] [detail=“{range_begin:/tidb/store/gcworker/saved_safe_point; range_end:; response_count:0; response_revision:27; }”] [duration=1.110253359s] [start=2024/06/03 19:29:36.398 +08:00] [end=2024/06/03 19:29:37.508 +08:00] [steps=“["trace[1079837179] ‘agreement among raft nodes before linearized reading’ (duration: 810.134886ms)","trace[1079837179] ‘range keys from in-memory index tree’ (duration: 299.929749ms)"]”]
[2024/06/03 19:29:38.707 +08:00] [INFO] [trace.go:152] [“trace[761741411] range”] [detail=“{range_begin:/tidb/store/gcworker/saved_safe_point; range_end:; }”] [duration=2.199457859s] [start=2024/06/03 19:29:36.507 +08:00] [end=2024/06/03 19:29:38.707 +08:00] [steps=“["trace[761741411] ‘agreement among raft nodes before linearized reading’ (duration: 2.199322956s)"]”]
[2024/06/03 19:29:39.107 +08:00] [INFO] [trace.go:152] [“trace[1055642135] range”] [detail=“{range_begin:/tidb/store/gcworker/saved_safe_point; range_end:; }”] [duration=1.500248912s] [start=2024/06/03 19:29:37.606 +08:00] [end=2024/06/03 19:29:39.107 +08:00] [steps=“["trace[1055642135] ‘agreement among raft nodes before linearized reading’ (duration: 1.500139412s)"]”]
[2024/06/03 19:29:39.509 +08:00] [INFO] [trace.go:152] [“trace[875935222] range”] [detail=“{range_begin:/tidb/store/gcworker/saved_safe_point; range_end:; }”] [duration=1.702481169s] [start=2024/06/03 19:29:37.806 +08:00] [end=2024/06/03 19:29:39.509 +08:00] [steps=“["trace[875935222] ‘agreement among raft nodes before linearized reading’ (duration: 1.307329016s)"]”]
[2024/06/03 19:29:39.908 +08:00] [INFO] [trace.go:152] [“trace[1403520043] linearizableReadLoop”] [detail=“{readStateIndex:113; appliedIndex:113; }”] [duration=2.699948931s] [start=2024/06/03 19:29:37.208 +08:00] [end=2024/06/03 19:29:39.908 +08:00] [steps=“["trace[1403520043] ‘read index received’ (duration: 2.699944147s)","trace[1403520043] ‘applied index is now lower than readState.Index’ (duration: 3.746µs)"]”]
[2024/06/03 19:29:39.908 +08:00] [INFO] [trace.go:152] [“trace[1814000289] range”] [detail=“{range_begin:/tidb/store/gcworker/saved_safe_point; range_end:; response_count:0; response_revision:27; }”] [duration=2.798855536s] [start=2024/06/03 19:29:37.109 +08:00] [end=2024/06/03 19:29:39.908 +08:00] [steps=“["trace[1814000289] ‘agreement among raft nodes before linearized reading’ (duration: 2.798687288s)"]”]
[2024/06/03 19:29:43.210 +08:00] [INFO] [trace.go:152] [“trace[1769371777] range”] [detail=“{range_begin:/tidb/store/gcworker/saved_safe_point; range_end:; }”] [duration=299.682203ms] [start=2024/06/03 19:29:42.910 +08:00] [end=2024/06/03 19:29:43.210 +08:00] [steps=“["trace[1769371777] ‘agreement among raft nodes before linearized reading’ (duration: 204.161642ms)"]”]
[2024/06/03 19:29:43.407 +08:00] [INFO] [trace.go:152] [“trace[1649987892] range”] [detail=“{range_begin:/tidb/store/gcworker/saved_safe_point; range_end:; }”] [duration=4.393878153s] [start=2024/06/03 19:29:39.013 +08:00] [end=2024/06/03 19:29:43.406 +08:00] [steps=“["trace[1649987892] ‘agreement among raft nodes before linearized reading’ (duration: 4.393737618s)"]”]
[2024/06/03 19:29:43.410 +08:00] [INFO] [trace.go:152] [“trace[877121917] range”] [detail=“{range_begin:/tidb/store/gcworker/saved_safe_point; range_end:; }”] [duration=5.00280338s] [start=2024/06/03 19:29:38.407 +08:00] [end=2024/06/03 19:29:43.410 +08:00] [steps=“["trace[877121917] ‘agreement among raft nodes before linearized reading’ (duration: 4.999055695s)"]”]
[2024/06/03 19:29:43.511 +08:00] [INFO] [trace.go:152] [“trace[858954669] range”] [detail=“{range_begin:/tidb/store/gcworker/saved_safe_point; range_end:; }”] [duration=4.704288745s] [start=2024/06/03 19:29:38.807 +08:00] [end=2024/06/03 19:29:43.511 +08:00] [steps=“["trace[858954669] ‘agreement among raft nodes before linearized reading’ (duration: 4.7042102s)"]”]
[2024/06/03 19:29:44.211 +08:00] [INFO] [trace.go:152] [“trace[1677884718] linearizableReadLoop”] [detail=“{readStateIndex:113; appliedIndex:113; }”] [duration=4.30326446s] [start=2024/06/03 19:29:39.908 +08:00] [end=2024/06/03 19:29:44.211 +08:00] [steps=“["trace[1677884718] ‘read index received’ (duration: 4.303260718s)","trace[1677884718] ‘applied index is now lower than readState.Index’ (duration: 3.02µs)"]”]
[2024/06/03 19:29:44.213 +08:00] [INFO] [trace.go:152] [“trace[1286917712] range”] [detail=“{range_begin:/tidb/store/gcworker/saved_safe_point; range_end:; response_count:0; response_revision:27; }”] [duration=4.605964382s] [start=2024/06/03 19:29:39.607 +08:00] [end=2024/06/03 19:29:44.213 +08:00] [steps=“["trace[1286917712] ‘agreement among raft nodes before linearized reading’ (duration: 4.60573128s)"]”]
[2024/06/03 19:29:44.914 +08:00] [INFO] [trace.go:152] [“trace[1681280154] range”] [detail=“{range_begin:/tidb/store/gcworker/saved_safe_point; range_end:; }”] [duration=1.299966307s] [start=2024/06/03 19:29:43.614 +08:00] [end=2024/06/03 19:29:44.914 +08:00] [steps=“["trace[1681280154] ‘agreement among raft nodes before linearized reading’ (duration: 1.299888141s)"]”]
[2024/06/03 19:29:45.612 +08:00] [INFO] [trace.go:152] [“trace[737094958] range”] [detail=“{range_begin:/tidb/store/gcworker/saved_safe_point; range_end:; }”] [duration=5.602376982s] [start=2024/06/03 19:29:40.010 +08:00] [end=2024/06/03 19:29:45.612 +08:00] [steps=“["trace[737094958] ‘agreement among raft nodes before linearized reading’ (duration: 5.396268727s)"]”]
[2024/06/03 19:29:45.707 +08:00] [INFO] [trace.go:152] [“trace[796474105] range”] [detail=“{range_begin:/tidb/store/gcworker/saved_safe_point; range_end:; }”] [duration=5.199033887s] [start=2024/06/03 19:29:40.508 +08:00] [end=2024/06/03 19:29:45.707 +08:00] [steps=“["trace[796474105] ‘agreement among raft nodes before linearized reading’ (duration: 4.898878265s)"]”]
[2024/06/03 19:29:45.807 +08:00] [FATAL] [main.go:117] [“run server failed”] [error=“[PD:etcd:ErrEtcdMemberList]context deadline exceeded: context deadline exceeded”] [stack=“main.main\n\t/home/jenkins/agent/workspace/build-common/go/src/github.com/pingcap/pd/cmd/pd-server/main.go:117\nruntime.main\n\t/usr/local/go/src/runtime/proc.go:250”]
[2024/06/03 19:30:01.246 +08:00] [INFO] [util.go:41] [“Welcome to Placement Driver (PD)”]
[2024/06/03 19:30:01.247 +08:00] [INFO] [util.go:42] [PD] [release-version=v6.5.0]
[2024/06/03 19:30:01.247 +08:00] [INFO] [util.go:43] [PD] [edition=Community]
[2024/06/03 19:30:01.247 +08:00] [INFO] [util.go:44] [PD] [git-hash=d1a4433c3126c77fb2d5bb5720eefa0f2e05c166]
[2024/06/03 19:30:01.247 +08:00] [INFO] [util.go:45] [PD] [git-branch=heads/refs/tags/v6.5.0]
[2024/06/03 19:30:01.247 +08:00] [INFO] [util.go:46] [PD] [utc-build-time=“2022-12-16 08:19:07”]
[2024/06/03 19:30:01.247 +08:00] [INFO] [metricutil.go:83] [“disable Prometheus push client”]
[2024/06/03 19:30:01.248 +08:00] [INFO] [server.go:247] [“PD Config”] [config=“{"client-urls":"https://0.0.0.0:2379","peer-urls":"https://0.0.0.0:2380","advertise-client-urls":"https://152.122.65.30:2379","advertise-peer-urls":"https://152.122.65.30:2380","name":"pd-152.122.65.30-2379","data-dir":"/cache8/pd-data","force-new-cluster":false,"enable-grpc-gateway":true,"initial-cluster":"pd-152.122.65.30-2379=https://152.122.65.30:2380,pd-152.122.65.32-2379=https://152.122.65.32:2380,pd-152.122.65.35-2379=https://152.122.65.35:2380,pd-58.220.65.85-2379=https://58.220.65.85:2380","initial-cluster-state":"new","initial-cluster-token":"pd-cluster","join":"","lease":3,"log":{"level":"info","format":"text","disable-timestamp":false,"file":{"filename":"/usr/local/tikvserver/pd-2379/log/pd.log","max-size":300,"max-days":0,"max-backups":0},"development":false,"disable-caller":false,"disable-stacktrace":false,"disable-error-verbose":true,"sampling":null,"error-output-path":""},"tso-save-interval":"3s","tso-update-physical-interval":"50ms","enable-local-tso":false,"metric":{"job":"pd-152.122.65.30-2379","address":"","interval":"15s"},"schedule":{"max-snapshot-count":64,"max-pending-peer-count":64,"max-merge-region-size":20,"max-merge-region-keys":200000,"split-merge-interval":"1h0m0s","swtich-witness-interval":"1h0m0s","enable-one-way-merge":"false","enable-cross-table-merge":"true","patrol-region-interval":"10ms","max-store-down-time":"30m0s","max-store-preparing-time":"48h0m0s","leader-schedule-limit":20,"leader-schedule-policy":"count","region-schedule-limit":2048,"replica-schedule-limit":64,"merge-schedule-limit":8,"hot-region-schedule-limit":20,"hot-region-cache-hits-threshold":1,"store-limit":{},"tolerant-size-ratio":0,"low-space-ratio":0.8,"high-space-ratio":0.7,"region-score-formula-version":"v2","scheduler-max-waiting-operator":5,"enable-remove-down-replica":"true","enable-replace-offline-replica":"true","enable-make-up-replica":"true","enable-remove-extra-replica":"true","enable-location-replacement":"true","enable-debug-metrics":"false","enable-joint-consensus":"true","enable-tikv-split-region":"true","schedulers-v2":[{"type":"balance-region","args":null,"disable":false,"args-payload":""},{"type":"balance-leader","args":null,"disable":false,"args-payload":""},{"type":"hot-region","args":null,"disable":false,"args-payload":""},{"type":"split-bucket","args":null,"disable":false,"args-payload":""}],"schedulers-payload":null,"store-limit-mode":"manual","hot-regions-write-interval":"10m0s","hot-regions-reserved-days":7,"enable-diagnostic":"false","enable-witness":"false"},"replication":{"max-replicas":3,"location-labels":"","strictly-match-label":"false","enable-placement-rules":"true","enable-placement-rules-cache":"false","isolation-level":""},"pd-server":{"use-region-storage":"true","max-gap-reset-ts":"24h0m0s","key-type":"table","runtime-services":"","metric-storage":"","dashboard-address":"auto","trace-region-flow":"true","flow-round-by-digit":3,"min-resolved-ts-persistence-interval":"1s"},"cluster-version":"0.0.0","labels":{},"quota-backend-bytes":"8GiB","auto-compaction-mode":"periodic","auto-compaction-retention-v2":"1h","TickInterval":"500ms","ElectionInterval":"3s","PreVote":true,"max-request-bytes":157286400,"security":{"cacert-path":"/usr/local/tikvserver/pd-2379/tls/ca.crt","cert-path":"/usr/local/tikvserver/pd-2379/tls/pd.crt","key-path":"/usr/local/tikvserver/pd-2379/tls/pd.pem","cert-allowed-cn":null,"SSLCABytes":null,"SSLCertBytes":null,"SSLKEYBytes":null,"redact-info-log":false,"encryption":{"data-encryption-method":"plaintext","data-key-rotation-period":"168h0m0s","master-key":{"type":"plaintext","key-id":"","region":"","endpoint":"","path":""}}},"label-property":null,"WarningMsgs":null,"DisableStrictReconfigCheck":false,"HeartbeatStreamBindInterval":"1m0s","LeaderPriorityCheckInterval":"1m0s","dashboard":{"tidb-cacert-path":"","tidb-cert-path":"","tidb-key-path":"","public-path-prefix":"","internal-proxy":false,"enable-telemetry":true,"enable-experimental":false},"replication-mode":{"replication-mode":"majority","dr-auto-sync":{"label-key":"","primary":"","dr":"","primary-replicas":0,"dr-replicas":0,"wait-store-timeout":"1m0s","pause-region-split":"false"}}}”]
[2024/06/03 19:30:01.255 +08:00] [INFO] [server.go:222] [“register REST path”] [path=/pd/api/v1]
[2024/06/03 19:30:01.255 +08:00] [INFO] [server.go:222] [“register REST path”] [path=/pd/api/v2/]
[2024/06/03 19:30:01.255 +08:00] [INFO] [server.go:222] [“register REST path”] [path=/swagger/]
[2024/06/03 19:30:01.255 +08:00] [INFO] [server.go:222] [“register REST path”] [path=/autoscaling]
[2024/06/03 19:30:01.255 +08:00] [INFO] [distro.go:51] [“Using distribution strings”] [strings={}]
[2024/06/03 19:30:01.258 +08:00] [INFO] [server.go:222] [“register REST path”] [path=/dashboard/api/]
[2024/06/03 19:30:01.258 +08:00] [INFO] [server.go:222] [“register REST path”] [path=/dashboard/]
[2024/06/03 19:30:01.259 +08:00] [INFO] [etcd.go:117] [“configuring peer listeners”] [listen-peer-urls=“[https://0.0.0.0:2380]”]
[2024/06/03 19:30:01.259 +08:00] [INFO] [etcd.go:474] [“starting with peer TLS”] [tls-info=“cert = /usr/local/tikvserver/pd-2379/tls/pd.crt, key = /usr/local/tikvserver/pd-2379/tls/pd.pem, trusted-ca = /usr/local/tikvserver/pd-2379/tls/ca.crt, client-cert-auth = true, crl-file = “] [cipher-suites=””]
[2024/06/03 19:30:01.259 +08:00] [INFO] [systimemon.go:28] [“start system time monitor”]
[2024/06/03 19:30:01.260 +08:00] [INFO] [etcd.go:127] [“configuring client listeners”] [listen-client-urls=“[https://0.0.0.0:2379]”]
[2024/06/03 19:30:01.260 +08:00] [INFO] [etcd.go:611] [“pprof is enabled”] [path=/debug/pprof]
[2024/06/03 19:30:01.260 +08:00] [INFO] [etcd.go:305] [“starting an etcd server”] [etcd-version=3.4.21] [git-sha=“Not provided (use ./build instead of go build)”] [go-version=go1.19.3] [go-os=linux] [go-arch=amd64] [max-cpu-set=80] [max-cpu-available=80] [member-initialized=true] [name=pd-152.122.65.30-2379] [data-dir=/cache8/pd-data] [wal-dir=] [wal-dir-dedicated=] [member-dir=/cache8/pd-data/member] [force-new-cluster=false] [heartbeat-interval=500ms] [election-timeout=3s] [initial-election-tick-advance=true] [snapshot-count=100000] [snapshot-catchup-entries=5000] [initial-advertise-peer-urls=“[https://152.122.65.30:2380]”] [listen-peer-urls=“[https://0.0.0.0:2380]”] [advertise-client-urls=“[https://152.122.65.30:2379]”] [listen-client-urls=“[https://0.0.0.0:2379]”] [listen-metrics-urls=“”] [cors=“[]“] [host-whitelist=”[]”] [initial-cluster=] [initial-cluster-state=new] [initial-cluster-token=] [quota-backend-bytes=8589934592] [max-request-bytes=157286400] [max-concurrent-streams=4294967295] [pre-vote=true] [initial-corrupt-check=false] [corrupt-check-time-interval=0s] [auto-compaction-mode=periodic] [auto-compaction-retention=1h0m0s] [auto-compaction-interval=1h0m0s] [discovery-url=] [discovery-proxy=]
[2024/06/03 19:30:01.262 +08:00] [INFO] [backend.go:80] [“opened backend db”] [path=/cache8/pd-data/member/snap/db] [took=876.116µs]
[2024/06/03 19:30:01.270 +08:00] [INFO] [raft.go:586] [“restarting local member”] [cluster-id=821152945a57894b] [local-member-id=6443f7aacb544c75] [commit-index=109]
[2024/06/03 19:30:01.270 +08:00] [INFO] [raft.go:1523] [“6443f7aacb544c75 switched to configuration voters=()”]
[2024/06/03 19:30:01.270 +08:00] [INFO] [raft.go:706] [“6443f7aacb544c75 became follower at term 18”]
[2024/06/03 19:30:01.270 +08:00] [INFO] [raft.go:389] [“newRaft 6443f7aacb544c75 [peers: , term: 18, commit: 109, applied: 0, lastindex: 113, lastterm: 18]”]
[2024/06/03 19:30:01.272 +08:00] [INFO] [quota.go:126] [“enabled backend quota”] [quota-name=v3-applier] [quota-size-bytes=8589934592] [quota-size=“8.6 GB”]
[2024/06/03 19:30:01.273 +08:00] [INFO] [server.go:816] [“starting etcd server”] [local-member-id=6443f7aacb544c75] [local-server-version=3.4.21] [cluster-version=to_be_decided]
[2024/06/03 19:30:01.273 +08:00] [INFO] [server.go:704] [“starting initial election tick advance”] [election-ticks=6]
[2024/06/03 19:30:01.273 +08:00] [INFO] [raft.go:1523] [“6443f7aacb544c75 switched to configuration voters=(1282144946999282109)”]
[2024/06/03 19:30:01.273 +08:00] [INFO] [cluster.go:392] [“added member”] [cluster-id=821152945a57894b] [local-member-id=6443f7aacb544c75] [added-peer-id=11cb1809447449bd] [added-peer-peer-urls=“[https://152.122.65.35:2380]”]
[2024/06/03 19:30:01.273 +08:00] [INFO] [peer.go:128] [“starting remote peer”] [remote-peer-id=11cb1809447449bd]
[2024/06/03 19:30:01.273 +08:00] [INFO] [pipeline.go:71] [“started HTTP pipelining with remote peer”] [local-member-id=6443f7aacb544c75] [remote-peer-id=11cb1809447449bd]
[2024/06/03 19:30:01.275 +08:00] [INFO] [stream.go:166] [“started stream writer with remote peer”] [local-member-id=6443f7aacb544c75] [remote-peer-id=11cb1809447449bd]
[2024/06/03 19:30:01.276 +08:00] [INFO] [stream.go:166] [“started stream writer with remote peer”] [local-member-id=6443f7aacb544c75] [remote-peer-id=11cb1809447449bd]
[2024/06/03 19:30:01.277 +08:00] [INFO] [etcd.go:717] [“starting with client TLS”] [tls-info=“cert = /usr/local/tikvserver/pd-2379/tls/pd.crt, key = /usr/local/tikvserver/pd-2379/tls/pd.pem, trusted-ca = /usr/local/tikvserver/pd-2379/tls/ca.crt, client-cert-auth = true, crl-file = “] [cipher-suites=””]
[2024/06/03 19:30:01.277 +08:00] [INFO] [peer.go:134] [“started remote peer”] [remote-peer-id=11cb1809447449bd]
[2024/06/03 19:30:01.277 +08:00] [INFO] [stream.go:406] [“started stream reader with remote peer”] [stream-reader-type=“stream MsgApp v2”] [local-member-id=6443f7aacb544c75] [remote-peer-id=11cb1809447449bd]
[2024/06/03 19:30:01.277 +08:00] [INFO] [stream.go:406] [“started stream reader with remote peer”] [stream-reader-type=“stream Message”] [local-member-id=6443f7aacb544c75] [remote-peer-id=11cb1809447449bd]
[2024/06/03 19:30:01.277 +08:00] [INFO] [etcd.go:585] [“serving peer traffic”] [address=“[::]:2380”]
[2024/06/03 19:30:01.277 +08:00] [INFO] [etcd.go:247] [“now serving peer/client/metrics”] [local-member-id=6443f7aacb544c75] [initial-advertise-peer-urls=“[https://152.122.65.30:2380]”] [listen-peer-urls=“[https://0.0.0.0:2380]”] [advertise-client-urls=“[https://152.122.65.30:2379]”] [listen-client-urls=“[https://0.0.0.0:2379]”] [listen-metrics-urls=“”]

月明星稀 · 2024 年6 月 3 日 12:05

4个tikv，4个pd

Miracle · 2024 年6 月 3 日 12:21

你看下58.220.65.85 这个ip是什么，是pd的pod还是pd的svc？

tidb狂热爱好者 · 2024 年6 月 3 日 12:24

tiup cluster display tidb-test 看一下架构贴上去

月明星稀 · 2024 年6 月 4 日 01:53

都是物理机，这个ip也部署了pd和tikv，是同一个集群的

月明星稀 · 2024 年6 月 4 日 02:03

tiup is checking updates for component cluster ...
Starting component `cluster`: /root/.tiup/components/cluster/v1.12.0/tiup-cluster display JS-yangzhou8-DX
Cluster type:       tidb
Cluster name:       JS-yangzhou8-DX
Cluster version:    v6.5.0
Deploy user:        tikvserver
SSH type:           builtin
TLS encryption:     enabled
CA certificate:     /root/.tiup/storage/cluster/clusters/JS-yangzhou8-DX/tls/ca.crt
Client private key: /root/.tiup/storage/cluster/clusters/JS-yangzhou8-DX/tls/client.pem
Client certificate: /root/.tiup/storage/cluster/clusters/JS-yangzhou8-DX/tls/client.crt
ID                  Role  Host          Ports        OS/Arch       Status  Data Dir                      Deploy Dir
--                  ----  ----          -----        -------       ------  --------                      ----------
152.122.65.30:2379   pd    152.122.65.30  2379/2380    linux/x86_64  Down    /cache8/pd-data               /usr/local/tikvserver/pd-2379
152.122.65.32:2379   pd    152.122.65.32  2379/2380    linux/x86_64  Down    /cache8/pd-data               /usr/local/tikvserver/pd-2379
152.122.65.35:2379   pd    152.122.65.35  2379/2380    linux/x86_64  Down    /cache8/pd-data               /usr/local/tikvserver/pd-2379
58.220.65.85:2379   pd    58.220.65.85  2379/2380    linux/x86_64  Down    /cache8/pd-data               /usr/local/tikvserver/pd-2379
152.122.65.30:20160  tikv  152.122.65.30  20160/20180  linux/x86_64  N/A     /cache8/tikv-data/tikv-20160  /usr/local/tikvserver/tikv-20160
152.122.65.32:20160  tikv  152.122.65.32  20160/20180  linux/x86_64  N/A     /cache8/tikv-data/tikv-20160  /usr/local/tikvserver/tikv-20160
152.122.65.35:20160  tikv  152.122.65.35  20160/20180  linux/x86_64  N/A     /cache8/tikv-data/tikv-20160  /usr/local/tikvserver/tikv-20160
58.220.65.85:20160  tikv  58.220.65.85  20160/20180  linux/x86_64  N/A     /cache8/tikv-data/tikv-20160  /usr/local/tikvserver/tikv-20160

h5n1 · 2024 年6 月 4 日 02:15

iptables有设置吗

mono · 2024 年6 月 4 日 02:45

你都执行clean all了。你是不是想销毁集群。重新建立一个集群吗？

月明星稀 · 2024 年6 月 4 日 08:10

没有设置

月明星稀 · 2024 年6 月 4 日 08:11

本来以为是数据损坏，详情里掉试试，试了下也是提示失败，无法执行

yulei7633 · 2024 年6 月 4 日 08:20

这个pd有四个节点，不太合适吧，都是奇数为准

lemonade010 · 2024 年6 月 4 日 08:26

没有tidb？都是偶数节点，

Billmay表妹 · 2024 年6 月 4 日 08:39

3个 pd 都放在一个机器上… 建议分开~

Billmay表妹 · 2024 年6 月 4 日 08:40

rawkv 吗？单纯用 rawkv 没有用 tidb 吗？

不太建议直接用 rawkv，rawkv 不是 tidb 的正常用法，遇到问题大家无法帮助到你

TiDBer_小阿飞 · 2024 年6 月 4 日 09:36

这个节点拉起失败啊
etcd启动失败的错误，大多数情况下都是与data-dir 有关系，data-dir 中记录的信息与 etcd启动的选项所标识的信息不太匹配造成的
如果能通过修改启动参数解决这类错误就最好不过的了，非常情况下的解决办法：
一种解决办法是删除data-dir文件
一种方法是复制其他节点的data-dir中的内容，以此为基础上以 --force-new-cluster 的形式强行拉起一个，然后以添加新成员的方式恢复这个集群
测试环境可以试一下，生产环境就当我没说

月明星稀 · 2024 年6 月 6 日 09:43

修改启动参数是怎么修改呢？如果是清理data-dir能解决，为什么我clean --data后，还是起不来？

月明星稀 · 2024 年6 月 6 日 09:49

3个pd，在不同的机器上，没有放在同一个机器上