没有开hibernate region 功能
现在的情况是这样：
我们要缩容的那个节点2上现在只剩下副本，没有leader了，但现在副本迁不走。从pd上的调度日志看，是有在调度的，但是过了十分钟之后就超时了。节点2上的副本也没任何变化，然后前面我们新增的那个节点上，就只有leader的副本，没有非leader的副本，好像也不太正常？？
具体日志如下（很多这样的日志）：
[2021/12/23 09:24:34.742 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1385813] [step=“add learner peer 1629105 on store 1498967”] [source=“active push”]
[2021/12/23 09:24:34.742 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1476621] [step=“add learner peer 1629113 on store 1498967”] [source=“active push”]
[2021/12/23 09:24:34.742 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1118565] [step=“add learner peer 1629111 on store 1498967”] [source=“active push”]
[2021/12/23 09:24:34.742 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1415657] [step=“add learner peer 1629101 on store 1498967”] [source=“active push”]
[2021/12/23 09:24:34.742 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=“active push”]
[2021/12/23 09:24:34.742 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=948784] [step=“add learner peer 1629120 on store 1”] [source=“active push”]
[2021/12/23 09:24:34.742 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=240960] [step=“add learner peer 1629127 on store 1”] [source=“active push”]
[2021/12/23 09:24:34.742 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1418145] [step=“add learner peer 1629144 on store 1”] [source=“active push”]
[2021/12/23 09:24:34.742 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=112108] [step=“add learner peer 1629148 on store 1”] [source=“active push”]
[2021/12/23 09:24:35.742 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=244416] [step=“add learner peer 1629147 on store 1”] [source=“active push”]
[2021/12/23 09:24:37.742 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1088397] [step=“merge region 1418145 into region 1088397”] [source=“active push”]
[2021/12/23 09:24:37.742 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=5016] [step=“add learner peer 1629121 on store 1”] [source=“active push”]
[2021/12/23 09:24:37.742 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=5060] [step=“merge region 5016 into region 5060”] [source=“active push”]
[2021/12/23 09:24:37.742 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=18636] [step=“add learner peer 1629130 on store 1”] [source=“active push”]
[2021/12/23 09:24:37.742 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=107880] [step=“add learner peer 1629131 on store 1”] [source=“active push”]
[2021/12/23 09:24:37.742 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=108052] [step=“add learner peer 1629145 on store 1”] [source=“active push”]
[2021/12/23 09:24:37.742 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1388401] [step=“add learner peer 1629126 on store 1”] [source=“active push”]
2021/12/23 09:18:42.742 +08:00] [INFO] [operator_controller.go:560] [“operator timeout”] [region-id=64368] [takes=10m3.927152479s] [operator="“replace-rule-offline-peer {mv peer: store [2] to [1]} (kind:region,replica, region:64368(567,84), createAt:2021-12-23 09:08:38.8150239 +0800 CST m=+11055414.672533317, startAt:2021-12-23 09:08:38.815106696 +0800 CST m=+11055414.672616123, currentStep:0, steps:[add learner peer 1629084 on store 1, promote learner peer 1629084 on store 1 to voter, remove peer on store 2]) timeout”"]
[2021/12/23 09:18:47.742 +08:00] [INFO] [operator_controller.go:560] [“operator timeout”] [region-id=119016] [takes=10m4.920553184s] [operator="“replace-rule-offline-peer {mv peer: store [2] to [1]} (kind:region,replica, region:119016(1110,92), createAt:2021-12-23 09:08:42.821604911 +0800 CST m=+11055418.679114334, startAt:2021-12-23 09:08:42.821682328 +0800 CST m=+11055418.679191751, currentStep:0, steps:[add learner peer 1629085 on store 1, promote learner peer 1629085 on store 1 to voter, remove peer on store 2]) timeout”"]
[2021/12/23 09:18:53.242 +08:00] [INFO] [operator_controller.go:560] [“operator timeout”] [region-id=935716] [takes=10m3.412135396s] [operator="“replace-rule-offline-peer {mv peer: store [2] to [1]} (kind:region,replica, region:935716(25367,68), createAt:2021-12-23 09:08:49.829832062 +0800 CST m=+11055425.687341486, startAt:2021-12-23 09:08:49.829929786 +0800 CST m=+11055425.687439213, currentStep:0, steps:[add learner peer 1629086 on store 1, promote learner peer 1629086 on store 1 to voter, remove peer on store 2]) timeout”"]
[2021/12/23 09:18:58.242 +08:00] [INFO] [operator_controller.go:560] [“operator timeout”] [region-id=1546131] [takes=10m4.407551709s] [operator="“replace-rule-offline-peer {mv peer: store [2] to [1]} (kind:region,replica, region:1546131(33859,192), createAt:2021-12-23 09:08:53.834417272 +0800 CST m=+11055429.691926694, startAt:2021-12-23 09:08:53.834489681 +0800 CST m=+11055429.691999211, currentStep:0, steps:[add learner peer 1629087 on store 1, promote learner peer 1629087 on store 1 to voter, remove peer on store 2]) timeout”"]
[2021/12/23 09:19:01.242 +08:00] [INFO] [operator_controller.go:560] [“operator timeout”] [region-id=1487021] [takes=10m3.405494558s] [operator="“replace-rule-offline-peer {mv peer: store [2] to [1]} (kind:region,replica, region:1487021(40178,294), createAt:2021-12-23 09:08:57.836705036 +0800 CST m=+11055433.694214454, startAt:2021-12-23 09:08:57.83676788 +0800 CST m=+11055433.694277303, currentStep:0, steps:[add learner peer 1629088 on store 1, promote learner peer 1629088 on store 1 to voter, remove peer on store 2]) timeout”"]
[2021/12/23 09:19:08.742 +08:00] [INFO] [operator_controller.go:560] [“operator timeout”] [region-id=6656] [takes=10m2.194256487s] [operator="“replace-rule-offline-peer {mv peer: store [2] to [1]} (kind:region,replica, region:6656(327,360), createAt:2021-12-23 09:09:06.547814545 +0800 CST m=+11055442.405323967, startAt:2021-12-23 09:09:06.547900103 +0800 CST m=+11055442.405409527, currentStep:0, steps:[add learner peer 1629089 on store 1, promote learner peer 1629089 on store 1 to voter, remove peer on store 2]) timeout”"]
[2021/12/23 09:19:08.742 +08:00] [INFO] [operator_controller.go:560] [“operator timeout”] [region-id=399272] [takes=10m2.096587074s] [operator="“replace-rule-offline-peer {mv peer: store [2] to [1]} (kind:region,replica, region:399272(337,422), createAt:2021-12-23 09:09:06.645561614 +0800 CST m=+11055442.503071037, startAt:2021-12-23 09:09:06.645625423 +0800 CST m=+11055442.503134848, currentStep:0, steps:[add learner peer 1629090 on store 1, promote learner peer 1629090 on store 1 to voter, remove peer on store 2]) timeout”"]
[2021/12/23 09:19:14.242 +08:00] [INFO] [operator_controller.go:560] [“operator timeout”] [region-id=15684] [takes=10m3.692422571s] [operator="“replace-rule-offline-peer {mv peer: store [2] to [1]} (kind:region,replica, region:15684(412,124), createAt:2021-12-23 09:09:10.549561564 +0800 CST m=+11055446.407070984, startAt:2021-12-23 09:09:10.549608236 +0800 CST m=+11055446.407117658, currentStep:0, steps:[add learner peer 1629091 on store 1, promote learner peer 1629091 on store 1 to voter, remove peer on store 2]) timeout”"]
[2021/12/23 09:19:16.742 +08:00] [INFO] [operator_controller.go:560] [“operator timeout”] [region-id=112176] [takes=10m2.187618002s] [operator="“replace-rule-offline-peer {mv peer: store [2] to [1]} (kind:region,replica, region:112176(1055,180), createAt:2021-12-23 09:09:14.55445867 +0800 CST m=+11055450.411968090, startAt:2021-12-23 09:09:14.554547477 +0800 CST m=+11055450.412056904, currentStep:0, steps:[add learner peer 1629092 on store 1, promote learner peer 1629092 on store 1 to voter, remove peer on store 2]) timeout”"]
[2021/12/23 09:18:57.465 +08:00] [INFO] [operator_controller.go:424] [“add operator”] [region-id=1322901] [operator="“replace-rule-offline-peer {mv peer: store [2] to [1]} (kind:region,replica, region:1322901(25531,82), createAt:2021-12-23 09:18:57.465084102 +0800 CST m=+11056033.322593522, startAt:0001-01-01 00:00:00 +0000 UTC, currentStep:0, steps:[add learner peer 1629124 on store 1, promote learner peer 1629124 on store 1 to voter, remove peer on store 2])”"] [“additional info”=]
[2021/12/23 09:18:57.465 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=create]
[2021/12/23 09:18:57.466 +08:00] [INFO] [cluster.go:551] [“region ConfVer changed”] [region-id=1322901] [detail=“Add peer:{id:1629124 store_id:1 is_learner:true }”] [old-confver=82] [new-confver=83]
[2021/12/23 09:18:57.466 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=heartbeat]
[2021/12/23 09:19:02.741 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=“active push”]
[2021/12/23 09:19:07.741 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=“active push”]
[2021/12/23 09:19:12.742 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=“active push”]
[2021/12/23 09:19:18.242 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=“active push”]
[2021/12/23 09:19:23.242 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=“active push”]
[2021/12/23 09:19:28.242 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=“active push”]
[2021/12/23 09:19:28.744 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=heartbeat]
[2021/12/23 09:19:33.242 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=“active push”]
[2021/12/23 09:19:38.242 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=“active push”]
[2021/12/23 09:19:43.243 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=“active push”]
[2021/12/23 09:19:48.742 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=“active push”]
[2021/12/23 09:19:54.242 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=“active push”]
[2021/12/23 09:19:59.742 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=“active push”]
[2021/12/23 09:20:05.242 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=“active push”]
[2021/12/23 09:20:10.743 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=“active push”]
[2021/12/23 09:20:16.242 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=“active push”]
[2021/12/23 09:20:21.242 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=“active push”]
[2021/12/23 09:20:26.742 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=“active push”]
[2021/12/23 09:20:28.743 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=heartbeat]
[2021/12/23 09:20:32.242 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=“active push”]
[2021/12/23 09:20:37.742 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=“active push”]
[2021/12/23 09:20:42.742 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=“active push”]
[2021/12/23 09:20:48.242 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=“active push”]
[2021/12/23 09:20:53.242 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=“active push”]
[2021/12/23 09:20:58.742 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=“active push”]
[2021/12/23 09:21:03.742 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=“active push”]
[2021/12/23 09:21:09.242 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=“active push”]
[2021/12/23 09:21:14.743 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=“active push”]
[2021/12/23 09:21:20.242 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=“active push”]
[2021/12/23 09:21:25.742 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=“active push”]
[2021/12/23 09:21:28.750 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=heartbeat]
[2021/12/23 09:21:30.742 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=“active push”]
[2021/12/23 09:21:36.242 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=“active push”]
[2021/12/23 09:21:41.242 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=“active push”]
[2021/12/23 09:21:46.742 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=“active push”]
[2021/12/23 09:21:51.742 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=“active push”]
[2021/12/23 09:21:57.242 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=“active push”]
[2021/12/23 09:22:02.242 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=“active push”]
[2021/12/23 09:22:07.742 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=“active push”]
[2021/12/23 09:22:12.742 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=“active push”]
[2021/12/23 09:22:17.742 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=“active push”]
[2021/12/23 09:22:23.242 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=“active push”]
[2021/12/23 09:22:28.242 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=“active push”]
[2021/12/23 09:22:28.754 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=heartbeat]
[2021/12/23 09:22:33.742 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=“active push”]
[2021/12/23 09:22:39.242 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=“active push”]
[2021/12/23 09:22:44.742 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=“active push”]
[2021/12/23 09:22:50.242 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=“active push”]
[2021/12/23 09:22:55.742 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=“active push”]
[2021/12/23 09:23:00.742 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=“active push”]
[2021/12/23 09:23:05.747 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=“active push”]
[2021/12/23 09:23:11.244 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=“active push”]
[2021/12/23 09:23:16.742 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=“active push”]
[2021/12/23 09:23:21.742 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=“active push”]
[2021/12/23 09:23:27.242 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=“active push”]
[2021/12/23 09:23:28.753 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=heartbeat]
[2021/12/23 09:23:32.242 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=“active push”]
[2021/12/23 09:23:37.742 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=“active push”]
[2021/12/23 09:23:42.742 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=“active push”]
[2021/12/23 09:23:47.742 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=“active push”]
[2021/12/23 09:23:53.242 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=“active push”]
[2021/12/23 09:23:58.242 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=“active push”]
[2021/12/23 09:24:03.742 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=“active push”]
[2021/12/23 09:24:08.742 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=“active push”]
[2021/12/23 09:24:14.242 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=“active push”]
[2021/12/23 09:24:19.242 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=“active push”]
[2021/12/23 09:24:24.242 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=“active push”]
[2021/12/23 09:24:28.761 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=heartbeat]
[2021/12/23 09:24:29.742 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=“active push”]
[2021/12/23 09:24:34.742 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=“active push”]
[2021/12/23 09:24:40.242 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=“active push”]
[2021/12/23 09:24:45.742 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=“active push”]
[2021/12/23 09:24:51.242 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=“active push”]
[2021/12/23 09:24:56.742 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=“active push”]
[2021/12/23 09:25:02.242 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=“active push”]
[2021/12/23 09:25:07.742 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=“active push”]
[2021/12/23 09:25:12.742 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=“active push”]
[2021/12/23 09:25:18.242 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=“active push”]
[2021/12/23 09:25:23.742 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=“active push”]
[2021/12/23 09:25:28.742 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=“active push”]
[2021/12/23 09:25:28.759 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=heartbeat]
[2021/12/23 09:25:33.743 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=“active push”]
[2021/12/23 09:25:38.743 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=“active push”]
[2021/12/23 09:25:44.242 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=“active push”]
[2021/12/23 09:25:49.742 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=“active push”]
[2021/12/23 09:25:55.242 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=“active push”]
[2021/12/23 09:26:00.742 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=“active push”]
[2021/12/23 09:26:06.242 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=“active push”]
[2021/12/23 09:26:11.742 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=“active push”]
[2021/12/23 09:26:17.242 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=“active push”]
[2021/12/23 09:26:22.742 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=“active push”]
[2021/12/23 09:26:28.242 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=“active push”]
[2021/12/23 09:26:28.758 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=heartbeat]
[2021/12/23 09:26:33.742 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=“active push”]
[2021/12/23 09:26:39.242 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=“active push”]
[2021/12/23 09:26:44.742 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=“active push”]
[2021/12/23 09:26:50.241 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=“active push”]
[2021/12/23 09:26:55.741 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=“active push”]
[2021/12/23 09:27:00.742 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=“active push”]
[2021/12/23 09:27:06.241 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=“active push”]
[2021/12/23 09:27:11.242 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=“active push”]
[2021/12/23 09:27:16.741 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=“active push”]
[2021/12/23 09:27:21.742 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=“active push”]
[2021/12/23 09:27:27.242 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=“active push”]
[2021/12/23 09:27:28.760 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=heartbeat]
[2021/12/23 09:27:32.742 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=“active push”]
[2021/12/23 09:27:38.242 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=“active push”]
[2021/12/23 09:27:43.242 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=“active push”]
[2021/12/23 09:27:48.742 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=“active push”]
[2021/12/23 09:27:54.243 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=“active push”]
[2021/12/23 09:27:59.742 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=“active push”]
[2021/12/23 09:28:05.242 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=“active push”]
[2021/12/23 09:28:10.242 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=“active push”]
[2021/12/23 09:28:15.741 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=“active push”]
[2021/12/23 09:28:20.742 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=“active push”]
[2021/12/23 09:28:25.742 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=“active push”]
[2021/12/23 09:28:28.768 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=heartbeat]
[2021/12/23 09:28:31.241 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=“active push”]
[2021/12/23 09:28:36.242 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=“active push”]
[2021/12/23 09:28:41.741 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=“active push”]
[2021/12/23 09:28:47.242 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=“active push”]
[2021/12/23 09:28:52.742 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=“active push”]
[2021/12/23 09:28:58.241 +08:00] [INFO] [operator_controller.go:560] [“operator timeout”] [region-id=1322901] [takes=10m0.776768253s] [operator="“replace-rule-offline-peer {mv peer: store [2] to [1]} (kind:region,replica, region:1322901(25531,82), createAt:2021-12-23 09:18:57.465084102 +0800 CST m=+11056033.322593522, startAt:2021-12-23 09:18:57.465212602 +0800 CST m=+11056033.322722028, currentStep:0, steps:[add learner peer 1629124 on store 1, promote learner peer 1629124 on store 1 to voter, remove peer on store 2]) timeout”"]
[2021/12/23 09:29:05.128 +08:00] [INFO] [operator_controller.go:424] [“add operator”] [region-id=1322901] [operator="“remove-orphan-peer {rm peer: store [1]} (kind:region, region:1322901(25531,83), createAt:2021-12-23 09:29:05.12860822 +0800 CST m=+11056640.986117639, startAt:0001-01-01 00:00:00 +0000 UTC, currentStep:0, steps:[remove peer on store 1])”"] [“additional info”=]
[2021/12/23 09:29:05.128 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“remove peer on store 1”] [source=create]
[2021/12/23 09:29:05.130 +08:00] [INFO] [cluster.go:551] [“region ConfVer changed”] [region-id=1322901] [detail=“Remove peer:{id:1629124 store_id:1 is_learner:true }”] [old-confver=83] [new-confver=84]
[2021/12/23 09:29:05.130 +08:00] [INFO] [operator_controller.go:537] [“operator finish”] [region-id=1322901] [takes=1.960798ms] [operator="“remove-orphan-peer {rm peer: store [1]} (kind:region, region:1322901(25531,83), createAt:2021-12-23 09:29:05.12860822 +0800 CST m=+11056640.986117639, startAt:2021-12-23 09:29:05.128700448 +0800 CST m=+11056640.986209869, currentStep:1, steps:[remove peer on store 1]) finished”"] [“additional info”=]
这是一个peer完整的日志，十分钟之后超时了
提供一下 pd 和 tikv-detail 的监控吧（一个小时的就行）
现在的问题是：不知道是因为内部资源的问题导致的超时，还是网络/服务状态导致的超时，建议给一下监控，看一下（或者你可以把 调度的 几个 limit 先调大一些）
发你了，麻烦看下
我看了一下 down和pending 就38个左右啊，这个已经好了吧
现在环境有点乱
，有点晕了。就是建议 ：pd-ctl checker 一下 down peer （offline /pending 的单独看吧），
1、用 pd ctl 的 check 看一下 down 的数量和 监控的匹配不
2、如果匹配，确实数量很大，找到上面发现的 其中一个 down peer id，根据这个 id，过滤。pd 和 tikv 的日志
其实 timeout 感觉还是网络相关（本想看看是不是 网卡打满或者 raft 信息太多，chanal 打满导致）
down 和pending的这个 应该算正常了，
现在有两根问题：
1 下线的那个节点上peer不迁移
2 扩容的新节点不增加peer 只有3千个leader
pending状态的 是新增加的peer ，它本意应该是从下线节点上迁移peer过来，但是过了十分钟 ，就超时自动删除了
先说这个问题吧：这个 怀疑你 tikv lable 没打（或者没分清楚），调度几乎没怎么产生
超时自动删除了，这句话没太理解，你的意思是 添加 peer 然后添加超时还是啥超时？
[2021/12/23 09:18:57.465 +08:00] [INFO] [operator_controller.go:424] [“add operator”] [region-id=1322901] [operator="“replace-rule-offline-peer {mv peer: store [2] to [1]} (kind:region,replica, region:1322901(25531,82), createAt:2021-12-23 09:18:57.465084102 +0800 CST m=+11056033.322593522, startAt:0001-01-01 00:00:00 +0000 UTC, currentStep:0, steps:[add learner peer 1629124 on store 1, promote learner peer 1629124 on store 1 to voter, remove peer on store 2])”"] [“additional info”=]
[2021/12/23 09:18:57.465 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=create]
[2021/12/23 09:18:57.466 +08:00] [INFO] [cluster.go:551] [“region ConfVer changed”] [region-id=1322901] [detail=“Add peer:{id:1629124 store_id:1 is_learner:true }”] [old-confver=82] [new-confver=83]
[2021/12/23 09:18:57.466 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=heartbeat]
[2021/12/23 09:19:02.741 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=“active push”]
[2021/12/23 09:19:07.741 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=“active push”]
[2021/12/23 09:19:12.742 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=“active push”]
[2021/12/23 09:19:18.242 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=“active push”]
[2021/12/23 09:19:23.242 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=“active push”]
[2021/12/23 09:19:28.242 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=“active push”]
[2021/12/23 09:19:28.744 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=heartbeat]
[2021/12/23 09:19:33.242 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=“active push”]
[2021/12/23 09:19:38.242 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=“active push”]
[2021/12/23 09:19:43.243 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=“active push”]
[2021/12/23 09:19:48.742 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=“active push”]
[2021/12/23 09:19:54.242 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=“active push”]
[2021/12/23 09:19:59.742 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=“active push”]
[2021/12/23 09:20:05.242 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=“active push”]
[2021/12/23 09:20:10.743 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=“active push”]
[2021/12/23 09:20:16.242 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=“active push”]
[2021/12/23 09:20:21.242 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=“active push”]
[2021/12/23 09:20:26.742 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=“active push”]
[2021/12/23 09:20:28.743 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=heartbeat]
[2021/12/23 09:20:32.242 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=“active push”]
[2021/12/23 09:20:37.742 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=“active push”]
[2021/12/23 09:20:42.742 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=“active push”]
[2021/12/23 09:20:48.242 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=“active push”]
[2021/12/23 09:20:53.242 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=“active push”]
[2021/12/23 09:20:58.742 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=“active push”]
[2021/12/23 09:21:03.742 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=“active push”]
[2021/12/23 09:21:09.242 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=“active push”]
[2021/12/23 09:21:14.743 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=“active push”]
[2021/12/23 09:21:20.242 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=“active push”]
[2021/12/23 09:21:25.742 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=“active push”]
[2021/12/23 09:21:28.750 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=heartbeat]
[2021/12/23 09:21:30.742 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=“active push”]
[2021/12/23 09:21:36.242 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=“active push”]
[2021/12/23 09:21:41.242 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=“active push”]
[2021/12/23 09:21:46.742 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=“active push”]
[2021/12/23 09:21:51.742 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=“active push”]
[2021/12/23 09:21:57.242 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=“active push”]
[2021/12/23 09:22:02.242 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=“active push”]
[2021/12/23 09:22:07.742 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=“active push”]
[2021/12/23 09:22:12.742 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=“active push”]
[2021/12/23 09:22:17.742 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=“active push”]
[2021/12/23 09:22:23.242 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=“active push”]
[2021/12/23 09:22:28.242 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=“active push”]
[2021/12/23 09:22:28.754 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=heartbeat]
[2021/12/23 09:22:33.742 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=“active push”]
[2021/12/23 09:22:39.242 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=“active push”]
[2021/12/23 09:22:44.742 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=“active push”]
[2021/12/23 09:22:50.242 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=“active push”]
[2021/12/23 09:22:55.742 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=“active push”]
[2021/12/23 09:23:00.742 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=“active push”]
[2021/12/23 09:23:05.747 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=“active push”]
[2021/12/23 09:23:11.244 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=“active push”]
[2021/12/23 09:23:16.742 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=“active push”]
[2021/12/23 09:23:21.742 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=“active push”]
[2021/12/23 09:23:27.242 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=“active push”]
[2021/12/23 09:23:28.753 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=heartbeat]
[2021/12/23 09:23:32.242 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=“active push”]
[2021/12/23 09:23:37.742 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=“active push”]
[2021/12/23 09:23:42.742 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=“active push”]
[2021/12/23 09:23:47.742 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=“active push”]
[2021/12/23 09:23:53.242 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=“active push”]
[2021/12/23 09:23:58.242 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=“active push”]
[2021/12/23 09:24:03.742 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=“active push”]
[2021/12/23 09:24:08.742 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=“active push”]
[2021/12/23 09:24:14.242 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=“active push”]
[2021/12/23 09:24:19.242 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=“active push”]
[2021/12/23 09:24:24.242 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=“active push”]
[2021/12/23 09:24:28.761 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=heartbeat]
[2021/12/23 09:24:29.742 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=“active push”]
[2021/12/23 09:24:34.742 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=“active push”]
[2021/12/23 09:24:40.242 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=“active push”]
[2021/12/23 09:24:45.742 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=“active push”]
[2021/12/23 09:24:51.242 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=“active push”]
[2021/12/23 09:24:56.742 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=“active push”]
[2021/12/23 09:25:02.242 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=“active push”]
[2021/12/23 09:25:07.742 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=“active push”]
[2021/12/23 09:25:12.742 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=“active push”]
[2021/12/23 09:25:18.242 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=“active push”]
[2021/12/23 09:25:23.742 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=“active push”]
[2021/12/23 09:25:28.742 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=“active push”]
[2021/12/23 09:25:28.759 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=heartbeat]
[2021/12/23 09:25:33.743 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=“active push”]
[2021/12/23 09:25:38.743 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=“active push”]
[2021/12/23 09:25:44.242 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=“active push”]
[2021/12/23 09:25:49.742 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=“active push”]
[2021/12/23 09:25:55.242 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=“active push”]
[2021/12/23 09:26:00.742 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=“active push”]
[2021/12/23 09:26:06.242 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=“active push”]
[2021/12/23 09:26:11.742 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=“active push”]
[2021/12/23 09:26:17.242 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=“active push”]
[2021/12/23 09:26:22.742 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=“active push”]
[2021/12/23 09:26:28.242 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=“active push”]
[2021/12/23 09:26:28.758 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=heartbeat]
[2021/12/23 09:26:33.742 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=“active push”]
[2021/12/23 09:26:39.242 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=“active push”]
[2021/12/23 09:26:44.742 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=“active push”]
[2021/12/23 09:26:50.241 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=“active push”]
[2021/12/23 09:26:55.741 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=“active push”]
[2021/12/23 09:27:00.742 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=“active push”]
[2021/12/23 09:27:06.241 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=“active push”]
[2021/12/23 09:27:11.242 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=“active push”]
[2021/12/23 09:27:16.741 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=“active push”]
[2021/12/23 09:27:21.742 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=“active push”]
[2021/12/23 09:27:27.242 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=“active push”]
[2021/12/23 09:27:28.760 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=heartbeat]
[2021/12/23 09:27:32.742 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=“active push”]
[2021/12/23 09:27:38.242 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=“active push”]
[2021/12/23 09:27:43.242 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=“active push”]
[2021/12/23 09:27:48.742 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=“active push”]
[2021/12/23 09:27:54.243 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=“active push”]
[2021/12/23 09:27:59.742 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=“active push”]
[2021/12/23 09:28:05.242 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=“active push”]
[2021/12/23 09:28:10.242 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=“active push”]
[2021/12/23 09:28:15.741 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=“active push”]
[2021/12/23 09:28:20.742 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=“active push”]
[2021/12/23 09:28:25.742 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=“active push”]
[2021/12/23 09:28:28.768 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=heartbeat]
[2021/12/23 09:28:31.241 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=“active push”]
[2021/12/23 09:28:36.242 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=“active push”]
[2021/12/23 09:28:41.741 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=“active push”]
[2021/12/23 09:28:47.242 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=“active push”]
[2021/12/23 09:28:52.742 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“add learner peer 1629124 on store 1”] [source=“active push”]
[2021/12/23 09:28:58.241 +08:00] [INFO] [operator_controller.go:560] [“operator timeout”] [region-id=1322901] [takes=10m0.776768253s] [operator="“replace-rule-offline-peer {mv peer: store [2] to [1]} (kind:region,replica, region:1322901(25531,82), createAt:2021-12-23 09:18:57.465084102 +0800 CST m=+11056033.322593522, startAt:2021-12-23 09:18:57.465212602 +0800 CST m=+11056033.322722028, currentStep:0, steps:[add learner peer 1629124 on store 1, promote learner peer 1629124 on store 1 to voter, remove peer on store 2]) timeout”"]
[2021/12/23 09:29:05.128 +08:00] [INFO] [operator_controller.go:424] [“add operator”] [region-id=1322901] [operator="“remove-orphan-peer {rm peer: store [1]} (kind:region, region:1322901(25531,83), createAt:2021-12-23 09:29:05.12860822 +0800 CST m=+11056640.986117639, startAt:0001-01-01 00:00:00 +0000 UTC, currentStep:0, steps:[remove peer on store 1])”"] [“additional info”=]
[2021/12/23 09:29:05.128 +08:00] [INFO] [operator_controller.go:620] [“send schedule command”] [region-id=1322901] [step=“remove peer on store 1”] [source=create]
[2021/12/23 09:29:05.130 +08:00] [INFO] [cluster.go:551] [“region ConfVer changed”] [region-id=1322901] [detail=“Remove peer:{id:1629124 store_id:1 is_learner:true }”] [old-confver=83] [new-confver=84]
[2021/12/23 09:29:05.130 +08:00] [INFO] [operator_controller.go:537] [“operator finish”] [region-id=1322901] [takes=1.960798ms] [operator="“remove-orphan-peer {rm peer: store [1]} (kind:region, region:1322901(25531,83), createAt:2021-12-23 09:29:05.12860822 +0800 CST m=+11056640.986117639, startAt:2021-12-23 09:29:05.128700448 +0800 CST m=+11056640.986209869, currentStep:1, steps:[remove peer on store 1]) finished”"] [“additional info”=]
这是一个peer完整的日志，十分钟之后超时了
这个就是它想从节点2上调度一个peer到节点1上，它先在节点1上生成了一个peer是pending状态，是learner，然后过了十分钟就报超时， 然后又从1上把这个新生成的pending状态的learner的peer给删了。
，这个就比较清晰了（现在 是 store 1 有问题，能根据 1322901 和 1629124 过滤一下 store 1 的 tikv 日志不：对应时间的）
不光是1，其他的所有节点都是这样，就是从2上调度到其他节点 也是这样
明白，不是说 store 有问题，是 命令发给了 store 1（可能是网络问题，可能是 store1 执行步骤时有问题），我现在需要看 store1 的 上面的日志，来排查 store1 是否有问题
[2021/12/23 09:18:57.467 +08:00] [INFO] [apply.rs:1187] [“execute admin command”] [command=“cmd_type: ChangePeer change_peer { change_type: AddLearnerNode peer { id: 1629124 store_id: 1 is_learner: true } }”] [index=94] [term=15] [peer_id=1322904] [region_id=1322901]
[2021/12/23 09:18:57.467 +08:00] [INFO] [apply.rs:1653] [“add learner successfully”] [region=“id: 1322901 start_key: 7480000000000030FF575F698000000000FF0000010380000000FF3CB537D500000000FB end_key: 7480000000000030FF575F698000000000FF0000010380000000FF3CBE559900000000FB region_epoch { conf_ver: 82 version: 25531 } peers { id: 1322902 store_id: 2 } peers { id: 1322904 store_id: 3 } peers { id: 1504948 store_id: 1498967 }”] [peer=“id: 1629124 store_id: 1 is_learner: true”] [peer_id=1322904] [region_id=1322901]
[2021/12/23 09:29:05.131 +08:00] [INFO] [apply.rs:1187] [“execute admin command”] [command=“cmd_type: ChangePeer change_peer { change_type: RemoveNode peer { id: 1629124 store_id: 1 is_learner: true } }”] [index=95] [term=15] [peer_id=1322904] [region_id=1322901]
[2021/12/23 09:29:05.131 +08:00] [INFO] [apply.rs:1621] [“remove peer successfully”] [region=“id: 1322901 start_key: 7480000000000030FF575F698000000000FF0000010380000000FF3CB537D500000000FB end_key: 7480000000000030FF575F698000000000FF0000010380000000FF3CBE559900000000FB region_epoch { conf_ver: 83 version: 25531 } peers { id: 1322902 store_id: 2 } peers { id: 1322904 store_id: 3 } peers { id: 1504948 store_id: 1498967 } peers { id: 1629124 store_id: 1 is_learner: true }”] [peer=“id: 1629124 store_id: 1 is_learner: true”] [peer_id=1322904] [region_id=1322901]
[2021/12/23 09:18:57.467 +08:00] [INFO] [apply.rs:1187] [“execute admin command”] [command=“cmd_type: ChangePeer change_peer { change_type: AddLearnerNode peer { id: 1629124 store_id: 1 is_learner: true } }”] [index=94] [term=15] [peer_id=1322904] [region_id=1322901]
[2021/12/23 09:18:57.467 +08:00] [INFO] [apply.rs:1513] [“exec ConfChange”] [epoch=“conf_ver: 82 version: 25531”] [type=AddLearner] [peer_id=1322904] [region_id=1322901]
[2021/12/23 09:18:57.467 +08:00] [INFO] [apply.rs:1653] [“add learner successfully”] [region=“id: 1322901 start_key: 7480000000000030FF575F698000000000FF0000010380000000FF3CB537D500000000FB end_key: 7480000000000030FF575F698000000000FF0000010380000000FF3CBE559900000000FB region_epoch { conf_ver: 82 version: 25531 } peers { id: 1322902 store_id: 2 } peers { id: 1322904 store_id: 3 } peers { id: 1504948 store_id: 1498967 }”] [peer=“id: 1629124 store_id: 1 is_learner: true”] [peer_id=1322904] [region_id=1322901]
[2021/12/23 09:29:05.131 +08:00] [INFO] [apply.rs:1187] [“execute admin command”] [command=“cmd_type: ChangePeer change_peer { change_type: RemoveNode peer { id: 1629124 store_id: 1 is_learner: true } }”] [index=95] [term=15] [peer_id=1322904] [region_id=1322901]
[2021/12/23 09:29:05.131 +08:00] [INFO] [apply.rs:1513] [“exec ConfChange”] [epoch=“conf_ver: 83 version: 25531”] [type=RemoveNode] [peer_id=1322904] [region_id=1322901]
[2021/12/23 09:29:05.131 +08:00] [INFO] [apply.rs:1621] [“remove peer successfully”] [region=“id: 1322901 start_key: 7480000000000030FF575F698000000000FF0000010380000000FF3CB537D500000000FB end_key: 7480000000000030FF575F698000000000FF0000010380000000FF3CBE559900000000FB region_epoch { conf_ver: 83 version: 25531 } peers { id: 1322902 store_id: 2 } peers { id: 1322904 store_id: 3 } peers { id: 1504948 store_id: 1498967 } peers { id: 1629124 store_id: 1 is_learner: true }”] [peer=“id: 1629124 store_id: 1 is_learner: true”] [peer_id=1322904] [region_id=1322901]
[2021/12/23 10:24:13.222 +08:00] [INFO] [apply.rs:1187] [“execute admin command”] [command=“cmd_type: ChangePeer change_peer { change_type: AddLearnerNode peer { id: 1629392 store_id: 1 is_learner: true } }”] [index=96] [term=15] [peer_id=1322904] [region_id=1322901]
[2021/12/23 10:24:13.222 +08:00] [INFO] [apply.rs:1513] [“exec ConfChange”] [epoch=“conf_ver: 84 version: 25531”] [type=AddLearner] [peer_id=1322904] [region_id=1322901]
[2021/12/23 10:24:13.222 +08:00] [INFO] [apply.rs:1653] [“add learner successfully”] [region=“id: 1322901 start_key: 7480000000000030FF575F698000000000FF0000010380000000FF3CB537D500000000FB end_key: 7480000000000030FF575F698000000000FF0000010380000000FF3CBE559900000000FB region_epoch { conf_ver: 84 version: 25531 } peers { id: 1322902 store_id: 2 } peers { id: 1322904 store_id: 3 } peers { id: 1504948 store_id: 1498967 }”] [peer=“id: 1629392 store_id: 1 is_learner: true”] [peer_id=1322904] [region_id=1322901]
[2021/12/23 10:34:20.863 +08:00] [INFO] [apply.rs:1187] [“execute admin command”] [command=“cmd_type: ChangePeer change_peer { change_type: RemoveNode peer { id: 1629392 store_id: 1 is_learner: true } }”] [index=97] [term=15] [peer_id=1322904] [region_id=1322901]
[2021/12/23 10:34:20.863 +08:00] [INFO] [apply.rs:1513] [“exec ConfChange”] [epoch=“conf_ver: 85 version: 25531”] [type=RemoveNode] [peer_id=1322904] [region_id=1322901]
[2021/12/23 10:34:20.863 +08:00] [INFO] [apply.rs:1621] [“remove peer successfully”] [region=“id: 1322901 start_key: 7480000000000030FF575F698000000000FF0000010380000000FF3CB537D500000000FB end_key: 7480000000000030FF575F698000000000FF0000010380000000FF3CBE559900000000FB region_epoch { conf_ver: 85 version: 25531 } peers { id: 1322902 store_id: 2 } peers { id: 1322904 store_id: 3 } peers { id: 1504948 store_id: 1498967 } peers { id: 1629392 store_id: 1 is_learner: true }”] [peer=“id: 1629392 store_id: 1 is_learner: true”] [peer_id=1322904] [region_id=1322901]
[2021/12/23 14:06:03.993 +08:00] [INFO] [apply.rs:1187] [“execute admin command”] [command=“cmd_type: ChangePeer change_peer { change_type: AddLearnerNode peer { id: 1630887 store_id: 1 is_learner: true } }”] [index=98] [term=15] [peer_id=1322904] [region_id=1322901]
[2021/12/23 14:06:03.993 +08:00] [INFO] [apply.rs:1513] [“exec ConfChange”] [epoch=“conf_ver: 86 version: 25531”] [type=AddLearner] [peer_id=1322904] [region_id=1322901]
[2021/12/23 14:06:03.993 +08:00] [INFO] [apply.rs:1653] [“add learner successfully”] [region=“id: 1322901 start_key: 7480000000000030FF575F698000000000FF0000010380000000FF3CB537D500000000FB end_key: 7480000000000030FF575F698000000000FF0000010380000000FF3CBE559900000000FB region_epoch { conf_ver: 86 version: 25531 } peers { id: 1322902 store_id: 2 } peers { id: 1322904 store_id: 3 } peers { id: 1504948 store_id: 1498967 }”] [peer=“id: 1630887 store_id: 1 is_learner: true”] [peer_id=1322904] [region_id=1322901]
[2021/12/23 14:16:13.219 +08:00] [INFO] [apply.rs:1187] [“execute admin command”] [command=“cmd_type: ChangePeer change_peer { change_type: RemoveNode peer { id: 1630887 store_id: 1 is_learner: true } }”] [index=99] [term=15] [peer_id=1322904] [region_id=1322901]
[2021/12/23 14:16:13.219 +08:00] [INFO] [apply.rs:1513] [“exec ConfChange”] [epoch=“conf_ver: 87 version: 25531”] [type=RemoveNode] [peer_id=1322904] [region_id=1322901]
[2021/12/23 14:16:13.219 +08:00] [INFO] [apply.rs:1621] [“remove peer successfully”] [region=“id: 1322901 start_key: 7480000000000030FF575F698000000000FF0000010380000000FF3CB537D500000000FB end_key: 7480000000000030FF575F698000000000FF0000010380000000FF3CBE559900000000FB region_epoch { conf_ver: 87 version: 25531 } peers { id: 1322902 store_id: 2 } peers { id: 1322904 store_id: 3 } peers { id: 1504948 store_id: 1498967 } peers { id: 1630887 store_id: 1 is_learner: true }”] [peer=“id: 1630887 store_id: 1 is_learner: true”] [peer_id=1322904] [region_id=1322901]
您好 我们是一个机器一个tikv节点的 不打标签应该没影响吧 我看打标签说是一个机器上有多个tikv才有必要打 或者做多机房 机架容灾的时候
不是的：目前 tikv 还不能根据服务器 ip 或者啥的，来自动生成标签，需要咱们都打标签，而且调度也是根据标签来调度的