从5.2.2升级到5.4.2，PD Leader就一直处于CPU占满的状态，已经持续一周了，不知道要如何排查
先把日志看一下
你是说PD安装目录下的log日志吗？
[2022/08/08 09:46:27.508 +08:00] [WARN] [tso.go:321] [“clock offset”] [jet-lag=293.575883ms] [prev-physical=2022/08/08 09:46:27.214 +08:00] [now=2022/08/08 09:46:27.508 +08:00] [update-physical-interval=50ms]
[2022/08/08 09:46:28.109 +08:00] [WARN] [tso.go:321] [“clock offset”] [jet-lag=601.258977ms] [prev-physical=2022/08/08 09:46:27.508 +08:00] [now=2022/08/08 09:46:28.109 +08:00] [update-physical-interval=50ms]
[2022/08/08 09:46:28.602 +08:00] [WARN] [tso.go:321] [“clock offset”] [jet-lag=194.190784ms] [prev-physical=2022/08/08 09:46:28.408 +08:00] [now=2022/08/08 09:46:28.602 +08:00] [update-physical-interval=50ms]
[2022/08/08 09:46:29.003 +08:00] [WARN] [tso.go:321] [“clock offset”] [jet-lag=291.640443ms] [prev-physical=2022/08/08 09:46:28.712 +08:00] [now=2022/08/08 09:46:29.003 +08:00] [update-physical-interval=50ms]
[2022/08/08 09:46:30.020 +08:00] [WARN] [tso.go:321] [“clock offset”] [jet-lag=1.016291668s] [prev-physical=2022/08/08 09:46:29.003 +08:00] [now=2022/08/08 09:46:30.019 +08:00] [update-physical-interval=50ms]
[2022/08/08 09:46:31.006 +08:00] [WARN] [tso.go:321] [“clock offset”] [jet-lag=202.307569ms] [prev-physical=2022/08/08 09:46:30.804 +08:00] [now=2022/08/08 09:46:31.006 +08:00] [update-physical-interval=50ms]
[2022/08/08 09:46:32.008 +08:00] [WARN] [tso.go:321] [“clock offset”] [jet-lag=295.607662ms] [prev-physical=2022/08/08 09:46:31.712 +08:00] [now=2022/08/08 09:46:32.008 +08:00] [update-physical-interval=50ms]
[2022/08/08 09:46:32.408 +08:00] [WARN] [tso.go:321] [“clock offset”] [jet-lag=204.619156ms] [prev-physical=2022/08/08 09:46:32.204 +08:00] [now=2022/08/08 09:46:32.408 +08:00] [update-physical-interval=50ms]
[2022/08/08 09:46:35.407 +08:00] [WARN] [util.go:144] [“apply request took too long”] [took=103.486777ms] [expected-duration=100ms] [prefix=“read-only range “] [request=“key:”/tidb/ddl/all_schema_versions” range_end:”/tidb/ddl/all_schema_versiont" “] [response=“range_response_count:4 size:424”] []
[2022/08/08 09:46:35.408 +08:00] [INFO] [trace.go:145] [“trace[559434866] range”] [detail=”{range_begin:/tidb/ddl/all_schema_versions; range_end:/tidb/ddl/all_schema_versiont; response_count:4; response_revision:681330326; }"] [duration=103.552858ms] [start=2022/08/08 09:46:35.304 +08:00] [end=2022/08/08 09:46:35.407 +08:00] [steps="[“trace[559434866] ‘agreement among raft nodes before linearized reading’ (duration: 103.395062ms)”]"]
[2022/08/08 09:46:35.408 +08:00] [INFO] [trace.go:145] [“trace[131189320] put”] [detail="{key:/topology/tidb/tidb-0002:4000/ttl; req_size:66; response_revision:681330327; }"] [duration=102.197829ms] [start=2022/08/08 09:46:35.305 +08:00] [end=2022/08/08 09:46:35.408 +08:00] [steps="[“trace[131189320] ‘process raft request’ (duration: 102.081561ms)”]"]
[2022/08/08 09:46:35.805 +08:00] [WARN] [tso.go:321] [“clock offset”] [jet-lag=199.957909ms] [prev-physical=2022/08/08 09:46:35.605 +08:00] [now=2022/08/08 09:46:35.805 +08:00] [update-physical-interval=50ms]
[2022/08/08 09:46:38.309 +08:00] [INFO] [cluster_worker.go:128] [“alloc ids for region split”] [region-id=6959609] [peer-ids="[6959610,6959611,6959612]"]
[2022/08/08 09:46:38.402 +08:00] [INFO] [cluster_worker.go:220] [“region batch split, generate new regions”] [region-id=6953001] [origin=“id:6959609 start_key:“7480000000000364FF3900000000000000F8” end_key:“7480000000000364FF3C00000000000000F8” region_epoch:<conf_ver:6753 version:85488 > peers:<id:6959610 store_id:2853742 > peers:<id:6959611 store_id:2853733 > peers:<id:6959612 store_id:2853787 >”] [total=1]
[2022/08/08 09:46:38.402 +08:00] [INFO] [region.go:528] [“region Version changed”] [region-id=6953001] [detail=“StartKey Changed:{7480000000000364FF3900000000000000F8} -> {7480000000000364FF3C00000000000000F8}, EndKey:{}”] [old-version=85487] [new-version=85488]
[2022/08/08 09:46:38.405 +08:00] [WARN] [util.go:144] [“apply request took too long”] [took=292.83899ms] [expected-duration=100ms] [prefix=“read-only range “] [request=“key:”/tidb/store/gcworker/saved_safe_point” “] [response=“range_response_count:1 size:84”] []
[2022/08/08 09:46:38.405 +08:00] [INFO] [trace.go:145] [“trace[455350557] range”] [detail=”{range_begin:/tidb/store/gcworker/saved_safe_point; range_end:; response_count:1; response_revision:681330343; }”] [duration=292.902662ms] [start=2022/08/08 09:46:38.112 +08:00] [end=2022/08/08 09:46:38.405 +08:00] [steps="[“trace[455350557] ‘agreement among raft nodes before linearized reading’ (duration: 292.759514ms)”]"]
[2022/08/08 09:46:38.405 +08:00] [WARN] [util.go:144] [“apply request took too long”] [took=193.120277ms] [expected-duration=100ms] [prefix=“read-only range “] [request=“key:”/topology/tidb/” range_end:”/topology/tidb0" “] [response=“range_response_count:8 size:1375”] []
[2022/08/08 09:46:38.405 +08:00] [INFO] [trace.go:145] [“trace[305887116] range”] [detail=”{range_begin:/topology/tidb/; range_end:/topology/tidb0; response_count:8; response_revision:681330343; }"] [duration=193.17967ms] [start=2022/08/08 09:46:38.212 +08:00] [end=2022/08/08 09:46:38.405 +08:00] [steps="[“trace[305887116] ‘agreement among raft nodes before linearized reading’ (duration: 193.013382ms)”]"]
[2022/08/08 09:46:38.410 +08:00] [WARN] [tso.go:321] [“clock offset”] [jet-lag=1.607190539s] [prev-physical=2022/08/08 09:46:36.803 +08:00] [now=2022/08/08 09:46:38.410 +08:00] [update-physical-interval=50ms]
[2022/08/08 09:46:40.404 +08:00] [WARN] [tso.go:321] [“clock offset”] [jet-lag=501.991535ms] [prev-physical=2022/08/08 09:46:39.902 +08:00] [now=2022/08/08 09:46:40.404 +08:00] [update-physical-interval=50ms]
[2022/08/08 09:46:41.217 +08:00] [WARN] [tso.go:321] [“clock offset”] [jet-lag=308.272273ms] [prev-physical=2022/08/08 09:46:40.909 +08:00] [now=2022/08/08 09:46:41.217 +08:00] [update-physical-interval=50ms]
[2022/08/08 09:46:41.702 +08:00] [WARN] [tso.go:321] [“clock offset”] [jet-lag=186.389151ms] [prev-physical=2022/08/08 09:46:41.516 +08:00] [now=2022/08/08 09:46:41.702 +08:00] [update-physical-interval=50ms]
[2022/08/08 09:46:42.502 +08:00] [WARN] [tso.go:321] [“clock offset”] [jet-lag=196.190637ms] [prev-physical=2022/08/08 09:46:42.305 +08:00] [now=2022/08/08 09:46:42.502 +08:00] [update-physical-interval=50ms]
[2022/08/08 09:46:42.709 +08:00] [WARN] [tso.go:321] [“clock offset”] [jet-lag=204.088922ms] [prev-physical=2022/08/08 09:46:42.505 +08:00] [now=2022/08/08 09:46:42.709 +08:00] [update-physical-interval=50ms]
[2022/08/08 09:46:42.803 +08:00] [WARN] [util.go:144] [“apply request took too long”] [took=288.651938ms] [expected-duration=100ms] [prefix=“read-only range “] [request=“key:”/pd/7044348576070183058/gc/safe_point” “] [response=“range_response_count:1 size:81”] []
[2022/08/08 09:46:42.803 +08:00] [INFO] [trace.go:145] [“trace[1774603517] range”] [detail=”{range_begin:/pd/7044348576070183058/gc/safe_point; range_end:; response_count:1; response_revision:681330347; }”] [duration=288.743843ms] [start=2022/08/08 09:46:42.515 +08:00] [end=2022/08/08 09:46:42.803 +08:00] [steps="[“trace[1774603517] ‘range keys from in-memory index tree’ (duration: 287.902006ms)”]"]
[2022/08/08 09:46:42.804 +08:00] [INFO] [operator_controller.go:437] [“add operator”] [region-id=4611780] [operator="“transfer-hot-read-leader {transfer leader: store 2853733 to 2853742} (kind:hot-region,leader, region:4611780(12683,809), createAt:2022-08-08 09:46:42.804286055 +0800 CST m=+58403.773526759, startAt:0001-01-01 00:00:00 +0000 UTC, currentStep:0, steps:[transfer leader from store 2853733 to store 2853742])”"] [additional-info=]
[2022/08/08 09:46:42.804 +08:00] [INFO] [operator_controller.go:635] [“send schedule command”] [region-id=4611780] [step=“transfer leader from store 2853733 to store 2853742”] [source=create]
[2022/08/08 09:46:42.809 +08:00] [INFO] [region.go:549] [“leader changed”] [region-id=4611780] [from=2853733] [to=2853742]
[2022/08/08 09:46:42.809 +08:00] [INFO] [operator_controller.go:552] [“operator finish”] [region-id=4611780] [takes=4.746357ms] [operator="“transfer-hot-read-leader {transfer leader: store 2853733 to 2853742} (kind:hot-region,leader, region:4611780(12683,809), createAt:2022-08-08 09:46:42.804286055 +0800 CST m=+58403.773526759, startAt:2022-08-08 09:46:42.804678425 +0800 CST m=+58403.773919141, currentStep:1, steps:[transfer leader from store 2853733 to store 2853742]) finished”"] [additional-info=]
[2022/08/08 09:46:45.202 +08:00] [WARN] [tso.go:321] [“clock offset”] [jet-lag=196.708225ms] [prev-physical=2022/08/08 09:46:45.006 +08:00] [now=2022/08/08 09:46:45.202 +08:00] [update-physical-interval=50ms]
[2022/08/08 09:46:45.605 +08:00] [WARN] [tso.go:321] [“clock offset”] [jet-lag=197.798723ms] [prev-physical=2022/08/08 09:46:45.407 +08:00] [now=2022/08/08 09:46:45.605 +08:00] [update-physical-interval=50ms]
[2022/08/08 09:46:46.602 +08:00] [WARN] [tso.go:321] [“clock offset”] [jet-lag=189.783443ms] [prev-physical=2022/08/08 09:46:46.412 +08:00] [now=2022/08/08 09:46:46.602 +08:00] [update-physical-interval=50ms]
[2022/08/08 09:46:46.802 +08:00] [WARN] [tso.go:321] [“clock offset”] [jet-lag=196.359192ms] [prev-physical=2022/08/08 09:46:46.605 +08:00] [now=2022/08/08 09:46:46.802 +08:00] [update-physical-interval=50ms]
[2022/08/08 09:46:47.005 +08:00] [WARN] [tso.go:321] [“clock offset”] [jet-lag=191.775348ms] [prev-physical=2022/08/08 09:46:46.813 +08:00] [now=2022/08/08 09:46:47.005 +08:00] [update-physical-interval=50ms]
[2022/08/08 09:46:47.319 +08:00] [WARN] [tso.go:321] [“clock offset”] [jet-lag=214.364387ms] [prev-physical=2022/08/08 09:46:47.104 +08:00] [now=2022/08/08 09:46:47.319 +08:00] [update-physical-interval=50ms]
[2022/08/08 09:46:47.515 +08:00] [WARN] [tso.go:321] [“clock offset”] [jet-lag=196.499979ms] [prev-physical=2022/08/08 09:46:47.319 +08:00] [now=2022/08/08 09:46:47.515 +08:00] [update-physical-interval=50ms]
[2022/08/08 09:46:49.515 +08:00] [WARN] [tso.go:321] [“clock offset”] [jet-lag=606.559195ms] [prev-physical=2022/08/08 09:46:48.908 +08:00] [now=2022/08/08 09:46:49.514 +08:00] [update-physical-interval=50ms]
[2022/08/08 09:46:50.403 +08:00] [WARN] [tso.go:321] [“clock offset”] [jet-lag=298.747451ms] [prev-physical=2022/08/08 09:46:50.104 +08:00] [now=2022/08/08 09:46:50.403 +08:00] [update-physical-interval=50ms]
[2022/08/08 09:46:50.702 +08:00] [WARN] [tso.go:321] [“clock offset”] [jet-lag=198.436288ms] [prev-physical=2022/08/08 09:46:50.504 +08:00] [now=2022/08/08 09:46:50.702 +08:00] [update-physical-interval=50ms]
[2022/08/08 09:46:51.303 +08:00] [WARN] [tso.go:321] [“clock offset”] [jet-lag=198.210798ms] [prev-physical=2022/08/08 09:46:51.105 +08:00] [now=2022/08/08 09:46:51.303 +08:00] [update-physical-interval=50ms]
[2022/08/08 09:46:51.602 +08:00] [WARN] [tso.go:321] [“clock offset”] [jet-lag=192.704227ms] [prev-physical=2022/08/08 09:46:51.410 +08:00] [now=2022/08/08 09:46:51.602 +08:00] [update-physical-interval=50ms]
[2022/08/08 09:46:52.104 +08:00] [WARN] [tso.go:321] [“clock offset”] [jet-lag=201.745924ms] [prev-physical=2022/08/08 09:46:51.902 +08:00] [now=2022/08/08 09:46:52.104 +08:00] [update-physical-interval=50ms]
[2022/08/08 09:46:55.213 +08:00] [WARN] [tso.go:321] [“clock offset”] [jet-lag=209.150512ms] [prev-physical=2022/08/08 09:46:55.004 +08:00] [now=2022/08/08 09:46:55.213 +08:00] [update-physical-interval=50ms]
[2022/08/08 09:46:56.100 +08:00] [WARN] [tso.go:321] [“clock offset”] [jet-lag=196.854553ms] [prev-physical=2022/08/08 09:46:55.903 +08:00] [now=2022/08/08 09:46:56.100 +08:00] [update-physical-interval=50ms]
[2022/08/08 09:46:56.417 +08:00] [WARN] [tso.go:321] [“clock offset”] [jet-lag=202.317964ms] [prev-physical=2022/08/08 09:46:56.214 +08:00] [now=2022/08/08 09:46:56.417 +08:00] [update-physical-interval=50ms]
[2022/08/08 09:46:57.710 +08:00] [WARN] [tso.go:321] [“clock offset”] [jet-lag=206.917997ms] [prev-physical=2022/08/08 09:46:57.503 +08:00] [now=2022/08/08 09:46:57.710 +08:00] [update-physical-interval=50ms]
[2022/08/08 09:46:58.001 +08:00] [WARN] [tso.go:321] [“clock offset”] [jet-lag=198.167502ms] [prev-physical=2022/08/08 09:46:57.803 +08:00] [now=2022/08/08 09:46:58.001 +08:00] [update-physical-interval=50ms]
[2022/08/08 09:46:59.106 +08:00] [WARN] [tso.go:321] [“clock offset”] [jet-lag=201.078255ms] [prev-physical=2022/08/08 09:46:58.905 +08:00] [now=2022/08/08 09:46:59.106 +08:00] [update-physical-interval=50ms]
[2022/08/08 09:47:01.200 +08:00] [WARN] [tso.go:321] [“clock offset”] [jet-lag=182.90995ms] [prev-physical=2022/08/08 09:47:01.017 +08:00] [now=2022/08/08 09:47:01.200 +08:00] [update-physical-interval=50ms]
[2022/08/08 09:47:02.206 +08:00] [WARN] [tso.go:321] [“clock offset”] [jet-lag=200.983505ms] [prev-physical=2022/08/08 09:47:02.005 +08:00] [now=2022/08/08 09:47:02.206 +08:00] [update-physical-interval=50ms]
[2022/08/08 09:47:04.902 +08:00] [WARN] [tso.go:321] [“clock offset”] [jet-lag=1.004409571s] [prev-physical=2022/08/08 09:47:03.898 +08:00] [now=2022/08/08 09:47:04.902 +08:00] [update-physical-interval=50ms]
[2022/08/08 09:47:05.100 +08:00] [INFO] [trace.go:145] [“trace[1408648047] put”] [detail="{key:/tidb/ddl/all_schema_versions/fe2fd9ea-b7bc-462b-b81f-f5c283e380e7; req_size:86; response_revision:681330366; }"] [duration=194.935816ms] [start=2022/08/08 09:47:04.905 +08:00] [end=2022/08/08 09:47:05.100 +08:00] [steps="[“trace[1408648047] ‘process raft request’ (duration: 194.896388ms)”]"]
[2022/08/08 09:47:05.114 +08:00] [INFO] [operator_controller.go:437] [“add operator”] [region-id=4304074] [operator="“transfer-hot-read-leader {transfer leader: store 2853787 to 2853742} (kind:hot-region,leader, region:4304074(12006,243), createAt:2022-08-08 09:47:05.113693074 +0800 CST m=+58426.082933784, startAt:0001-01-01 00:00:00 +0000 UTC, currentStep:0, steps:[transfer leader from store 2853787 to store 2853742])”"] [additional-info=]
[2022/08/08 09:47:05.114 +08:00] [INFO] [operator_controller.go:635] [“send schedule command”] [region-id=4304074] [step=“transfer leader from store 2853787 to store 2853742”] [source=create]
[2022/08/08 09:47:05.203 +08:00] [INFO] [trace.go:145] [“trace[1052585503] put”] [detail="{key:/tidb/ddl/all_schema_versions/aff01b24-4f89-4c4e-96cc-d8d777e51b9e; req_size:86; response_revision:681330369; }"] [duration=294.351747ms] [start=2022/08/08 09:47:04.908 +08:00] [end=2022/08/08 09:47:05.203 +08:00] [steps="[“trace[1052585503] ‘process raft request’ (duration: 294.317098ms)”]"]
[2022/08/08 09:47:05.203 +08:00] [INFO] [trace.go:145] [“trace[1851143745] put”] [detail="{key:/tidb/ddl/all_schema_versions/3e3e9f01-db78-4d66-a043-743a2dced488; req_size:86; response_revision:681330368; }"] [duration=294.654721ms] [start=2022/08/08 09:47:04.908 +08:00] [end=2022/08/08 09:47:05.203 +08:00] [steps="[“trace[1851143745] ‘process raft request’ (duration: 294.378826ms)”]"]
[2022/08/08 09:47:05.214 +08:00] [WARN] [tso.go:321] [“clock offset”] [jet-lag=311.555941ms] [prev-physical=2022/08/08 09:47:04.902 +08:00] [now=2022/08/08 09:47:05.214 +08:00] [update-physical-interval=50ms]
[2022/08/08 09:47:05.411 +08:00] [INFO] [region.go:549] [“leader changed”] [region-id=4304074] [from=2853787] [to=2853742]
[2022/08/08 09:47:05.414 +08:00] [INFO] [operator_controller.go:552] [“operator finish”] [region-id=4304074] [takes=299.576369ms] [operator="“transfer-hot-read-leader {transfer leader: store 2853787 to 2853742} (kind:hot-region,leader, region:4304074(12006,243), createAt:2022-08-08 09:47:05.113693074 +0800 CST m=+58426.082933784, startAt:2022-08-08 09:47:05.114765133 +0800 CST m=+58426.084005849, currentStep:1, steps:[transfer leader from store 2853787 to store 2853742]) finished”"] [additional-info=]
[2022/08/08 09:47:05.499 +08:00] [WARN] [tso.go:321] [“clock offset”] [jet-lag=191.359521ms] [prev-physical=2022/08/08 09:47:05.308 +08:00] [now=2022/08/08 09:47:05.499 +08:00] [update-physical-interval=50ms]
[2022/08/08 09:47:05.611 +08:00] [INFO] [operator_controller.go:437] [“add operator”] [region-id=4597905] [operator="“transfer-hot-read-leader {transfer leader: store 2853787 to 2853742} (kind:hot-region,leader, region:4597905(12684,1181), createAt:2022-08-08 09:47:05.61098478 +0800 CST m=+58426.580225487, startAt:0001-01-01 00:00:00 +0000 UTC, currentStep:0, steps:[transfer leader from store 2853787 to store 2853742])”"] [additional-info=]
[2022/08/08 09:47:05.611 +08:00] [INFO] [operator_controller.go:635] [“send schedule command”] [region-id=4597905] [step=“transfer leader from store 2853787 to store 2853742”] [source=create]
[2022/08/08 09:47:05.707 +08:00] [WARN] [util.go:144] [“apply request took too long”] [took=295.716275ms] [expected-duration=100ms] [prefix=] [request=“header:<ID:14905650842170569979 > put:<key:”/tidb/server/minstartts/aff01b24-4f89-4c4e-96cc-d8d777e51b9e" value_size:18 lease:5682278800681139126 >"] [response=size:8] []
[2022/08/08 09:47:05.707 +08:00] [INFO] [trace.go:145] [“trace[984043018] put”] [detail="{key:/topology/tidb/tidb-0002:4000/ttl; req_size:66; response_revision:681330372; }"] [duration=107.140334ms] [start=2022/08/08 09:47:05.600 +08:00] [end=2022/08/08 09:47:05.707 +08:00] [steps="[“trace[984043018] ‘process raft request’ (duration: 107.104307ms)”]"]
[2022/08/08 09:47:05.709 +08:00] [INFO] [region.go:549] [“leader changed”] [region-id=4597905] [from=2853787] [to=2853742]
[2022/08/08 09:47:05.799 +08:00] [INFO] [operator_controller.go:552] [“operator finish”] [region-id=4597905] [takes=187.739241ms] [operator="“transfer-hot-read-leader {transfer leader: store 2853787 to 2853742} (kind:hot-region,leader, region:4597905(12684,1181), createAt:2022-08-08 09:47:05.61098478 +0800 CST m=+58426.580225487, startAt:2022-08-08 09:47:05.611609279 +0800 CST m=+58426.580849997, currentStep:1, steps:[transfer leader from store 2853787 to store 2853742]) finished”"] [additional-info=]
[2022/08/08 09:47:05.908 +08:00] [WARN] [util.go:144] [“apply request took too long”] [took=106.026641ms] [expected-duration=100ms] [prefix=“read-only range “] [request=“key:”/tidb/ddl/all_schema_versions” range_end:”/tidb/ddl/all_schema_versiont" “] [response=“range_response_count:4 size:424”] []
[2022/08/08 09:47:05.908 +08:00] [INFO] [trace.go:145] [“trace[11682609] put”] [detail=”{key:/tidb/ddl/all_schema_versions/997b45ca-62c6-4f8b-9802-19e6a45e65f9; req_size:86; response_revision:681330375; }"] [duration=110.118596ms] [start=2022/08/08 09:47:05.798 +08:00] [end=2022/08/08 09:47:05.908 +08:00] [steps="[“trace[11682609] ‘process raft request’ (duration: 110.052848ms)”]"]
[2022/08/08 09:47:05.908 +08:00] [INFO] [trace.go:145] [“trace[2050096813] range”] [detail="{range_begin:/tidb/ddl/all_schema_versions; range_end:/tidb/ddl/all_schema_versiont; response_count:4; response_revision:681330374; }"] [duration=106.107826ms] [start=2022/08/08 09:47:05.802 +08:00] [end=2022/08/08 09:47:05.908 +08:00] [steps="[“trace[2050096813] ‘agreement among raft nodes before linearized reading’ (duration: 105.959713ms)”]"]
[2022/08/08 09:47:08.902 +08:00] [WARN] [tso.go:321] [“clock offset”] [jet-lag=497.868189ms] [prev-physical=2022/08/08 09:47:08.404 +08:00] [now=2022/08/08 09:47:08.902 +08:00] [update-physical-interval=50ms]
[2022/08/08 09:47:09.415 +08:00] [INFO] [cluster_worker.go:128] [“alloc ids for region split”] [region-id=6959613] [peer-ids="[6959614,6959615,6959616]"]
[2022/08/08 09:47:09.510 +08:00] [INFO] [cluster_worker.go:220] [“region batch split, generate new regions”] [region-id=6953001] [origin=“id:6959613 start_key:“7480000000000364FF3C00000000000000F8” end_key:“7480000000000364FF3F00000000000000F8” region_epoch:<conf_ver:6753 version:85489 > peers:<id:6959614 store_id:2853742 > peers:<id:6959615 store_id:2853733 > peers:<id:6959616 store_id:2853787 >”] [total=1]
[2022/08/08 09:47:09.601 +08:00] [INFO] [region.go:528] [“region Version changed”] [region-id=6953001] [detail=“StartKey Changed:{7480000000000364FF3C00000000000000F8} -> {7480000000000364FF3F00000000000000F8}, EndKey:{}”] [old-version=85488] [new-version=85489]
[2022/08/08 09:47:12.098 +08:00] [WARN] [tso.go:321] [“clock offset”] [jet-lag=182.866299ms] [prev-physical=2022/08/08 09:47:11.915 +08:00] [now=2022/08/08 09:47:12.098 +08:00] [update-physical-interval=50ms]
[2022/08/08 09:47:12.398 +08:00] [WARN] [tso.go:321] [“clock offset”] [jet-lag=190.075703ms] [prev-physical=2022/08/08 09:47:12.208 +08:00] [now=2022/08/08 09:47:12.398 +08:00] [update-physical-interval=50ms]
[2022/08/08 09:47:12.706 +08:00] [WARN] [tso.go:321] [“clock offset”] [jet-lag=202.231393ms] [prev-physical=2022/08/08 09:47:12.504 +08:00] [now=2022/08/08 09:47:12.706 +08:00] [update-physical-interval=50ms]
[2022/08/08 09:47:14.715 +08:00] [WARN] [tso.go:321] [“clock offset”] [jet-lag=411.294915ms] [prev-physical=2022/08/08 09:47:14.303 +08:00] [now=2022/08/08 09:47:14.715 +08:00] [update-physical-interval=50ms]
[2022/08/08 09:47:15.599 +08:00] [WARN] [tso.go:321] [“clock offset”] [jet-lag=197.11434ms] [prev-physical=2022/08/08 09:47:15.402 +08:00] [now=2022/08/08 09:47:15.599 +08:00] [update-physical-interval=50ms]
[2022/08/08 09:47:16.200 +08:00] [WARN] [tso.go:321] [“clock offset”] [jet-lag=401.571208ms] [prev-physical=2022/08/08 09:47:15.798 +08:00] [now=2022/08/08 09:47:16.200 +08:00] [update-physical-interval=50ms]
[2022/08/08 09:47:16.699 +08:00] [WARN] [tso.go:321] [“clock offset”] [jet-lag=195.627737ms] [prev-physical=2022/08/08 09:47:16.503 +08:00] [now=2022/08/08 09:47:16.699 +08:00] [update-physical-interval=50ms]
[2022/08/08 09:47:18.398 +08:00] [WARN] [tso.go:321] [“clock offset”] [jet-lag=191.141841ms] [prev-physical=2022/08/08 09:47:18.207 +08:00] [now=2022/08/08 09:47:18.398 +08:00] [update-physical-interval=50ms]
[2022/08/08 09:47:19.007 +08:00] [WARN] [tso.go:321] [“clock offset”] [jet-lag=408.678879ms] [prev-physical=2022/08/08 09:47:18.598 +08:00] [now=2022/08/08 09:47:19.007 +08:00] [update-physical-interval=50ms]
[2022/08/08 09:47:20.998 +08:00] [WARN] [tso.go:321] [“clock offset”] [jet-lag=799.882664ms] [prev-physical=2022/08/08 09:47:20.198 +08:00] [now=2022/08/08 09:47:20.998 +08:00] [update-physical-interval=50ms]
[2022/08/08 09:47:21.998 +08:00] [WARN] [tso.go:321] [“clock offset”] [jet-lag=189.952258ms] [prev-physical=2022/08/08 09:47:21.808 +08:00] [now=2022/08/08 09:47:21.998 +08:00] [update-physical-interval=50ms]
[2022/08/08 09:47:23.007 +08:00] [WARN] [tso.go:321] [“clock offset”] [jet-lag=299.562701ms] [prev-physical=2022/08/08 09:47:22.708 +08:00] [now=2022/08/08 09:47:23.007 +08:00] [update-physical-interval=50ms]
[2022/08/08 09:47:23.300 +08:00] [WARN] [tso.go:321] [“clock offset”] [jet-lag=202.057371ms] [prev-physical=2022/08/08 09:47:23.098 +08:00] [now=2022/08/08 09:47:23.300 +08:00] [update-physical-interval=50ms]
[2022/08/08 09:47:24.802 +08:00] [WARN] [tso.go:321] [“clock offset”] [jet-lag=197.502383ms] [prev-physical=2022/08/08 09:47:24.604 +08:00] [now=2022/08/08 09:47:24.802 +08:00] [update-physical-interval=50ms]
[2022/08/08 09:47:24.998 +08:00] [WARN] [tso.go:321] [“clock offset”] [jet-lag=189.196398ms] [prev-physical=2022/08/08 09:47:24.809 +08:00] [now=2022/08/08 09:47:24.998 +08:00] [update-physical-interval=50ms]
[2022/08/08 09:47:27.403 +08:00] [WARN] [tso.go:321] [“clock offset”] [jet-lag=197.210621ms] [prev-physical=2022/08/08 09:47:27.205 +08:00] [now=2022/08/08 09:47:27.403 +08:00] [update-physical-interval=50ms]
[2022/08/08 09:47:27.898 +08:00] [WARN] [tso.go:321] [“clock offset”] [jet-lag=388.465467ms] [prev-physical=2022/08/08 09:47:27.510 +08:00] [now=2022/08/08 09:47:27.898 +08:00] [update-physical-interval=50ms]
[2022/08/08 09:47:31.999 +08:00] [WARN] [tso.go:321] [“clock offset”] [jet-lag=196.174063ms] [prev-physical=2022/08/08 09:47:31.803 +08:00] [now=2022/08/08 09:47:31.999 +08:00] [update-physical-interval=50ms]
[2022/08/08 09:47:33.110 +08:00] [WARN] [tso.go:321] [“clock offset”] [jet-lag=202.618794ms] [prev-physical=2022/08/08 09:47:32.908 +08:00] [now=2022/08/08 09:47:33.110 +08:00] [update-physical-interval=50ms]
[2022/08/08 09:47:33.611 +08:00] [WARN] [tso.go:321] [“clock offset”] [jet-lag=312.335272ms] [prev-physical=2022/08/08 09:47:33.298 +08:00] [now=2022/08/08 09:47:33.611 +08:00] [update-physical-interval=50ms]
[2022/08/08 09:47:35.314 +08:00] [INFO] [trace.go:145] [“trace[531761491] put”] [detail="{key:/topology/tidb/tidb-0002:4000/info; req_size:234; response_revision:681330411; }"] [duration=110.784594ms] [start=2022/08/08 09:47:35.203 +08:00] [end=2022/08/08 09:47:35.314 +08:00] [steps="[“trace[531761491] ‘process raft request’ (duration: 110.653739ms)”]"]
[2022/08/08 09:47:35.609 +08:00] [INFO] [trace.go:145] [“trace[1481482286] put”] [detail="{key:/topology/tidb/tidb-0002:4000/ttl; req_size:66; response_revision:681330417; }"] [duration=211.132627ms] [start=2022/08/08 09:47:35.398 +08:00] [end=2022/08/08 09:47:35.609 +08:00] [steps="[“trace[1481482286] ‘process raft request’ (duration: 115.503776ms)”,“trace[1481482286] ‘get key’s previous created_revision and leaseID’ (duration: 95.435716ms)”]"]
[2022/08/08 09:47:37.607 +08:00] [INFO] [trace.go:145] [“trace[1791564680] put”] [detail="{key:/tidb/ddl/all_schema_versions/aff01b24-4f89-4c4e-96cc-d8d777e51b9e; req_size:86; response_revision:681330430; }"] [duration=100.378347ms] [start=2022/08/08 09:47:37.507 +08:00] [end=2022/08/08 09:47:37.607 +08:00] [steps="[“trace[1791564680] ‘get key’s previous created_revision and leaseID’ (duration: 94.200738ms)”]"]
[2022/08/08 09:47:38.199 +08:00] [INFO] [cluster_worker.go:128] [“alloc ids for region split”] [region-id=6959617] [peer-ids="[6959618,6959619,6959620]"]
[2022/08/08 09:47:38.305 +08:00] [INFO] [cluster_worker.go:220] [“region batch split, generate new regions”] [region-id=6953001] [origin=“id:6959617 start_key:“7480000000000364FF3F00000000000000F8” end_key:“7480000000000364FF4200000000000000F8” region_epoch:<conf_ver:6753 version:85490 > peers:<id:6959618 store_id:2853742 > peers:<id:6959619 store_id:2853733 > peers:<id:6959620 store_id:2853787 >”] [total=1]
[2022/08/08 09:47:38.399 +08:00] [INFO] [region.go:528] [“region Version changed”] [region-id=6953001] [detail=“StartKey Changed:{7480000000000364FF3F00000000000000F8} -> {7480000000000364FF4200000000000000F8}, EndKey:{}”] [old-version=85489] [new-version=85490]
[2022/08/08 09:47:38.602 +08:00] [INFO] [operator_controller.go:437] [“add operator”] [region-id=6959137] [operator="“merge-region {merge: region 6959137 to 6958005} (kind:merge, region:6959137(85371,6753), createAt:2022-08-08 09:47:38.602771173 +0800 CST m=+58459.572011890, startAt:0001-01-01 00:00:00 +0000 UTC, currentStep:0, steps:[merge region 6959137 into region 6958005])”"] [additional-info=]
[2022/08/08 09:47:38.602 +08:00] [INFO] [operator_controller.go:635] [“send schedule command”] [region-id=6959137] [step=“merge region 6959137 into region 6958005”] [source=create]
[2022/08/08 09:47:38.603 +08:00] [INFO] [operator_controller.go:437] [“add operator”] [region-id=6958005] [operator="“merge-region {merge: region 6959137 to 6958005} (kind:merge, region:6958005(85372,6753), createAt:2022-08-08 09:47:38.602772587 +0800 CST m=+58459.572013293, startAt:0001-01-01 00:00:00 +0000 UTC, currentStep:0, steps:[merge region 6959137 into region 6958005])”"] [additional-info=]
[2022/08/08 09:47:38.603 +08:00] [INFO] [operator_controller.go:635] [“send schedule command”] [region-id=6958005] [step=“merge region 6959137 into region 6958005”] [source=create]
[2022/08/08 09:47:38.804 +08:00] [WARN] [tso.go:321] [“clock offset”] [jet-lag=197.09411ms] [prev-physical=2022/08/08 09:47:38.607 +08:00] [now=2022/08/08 09:47:38.804 +08:00] [update-physical-interval=50ms]
[2022/08/08 09:47:39.199 +08:00] [INFO] [region.go:528] [“region Version changed”] [region-id=6958005] [detail=“StartKey:{7480000000000362FF715F72E000000000FF1F8B520000000000FA}, EndKey Changed:{7480000000000362FFDA00000000000000F8} -> {7480000000000362FFDD00000000000000F8}”] [old-version=85372] [new-version=85373]
[2022/08/08 09:47:39.200 +08:00] [INFO] [operator_controller.go:552] [“operator finish”] [region-id=6958005] [takes=597.477109ms] [operator="“merge-region {merge: region 6959137 to 6958005} (kind:merge, region:6958005(85372,6753), createAt:2022-08-08 09:47:38.602772587 +0800 CST m=+58459.572013293, startAt:2022-08-08 09:47:38.603034343 +0800 CST m=+58459.572275053, currentStep:1, steps:[merge region 6959137 into region 6958005]) finished”"] [additional-info=]
[2022/08/08 09:47:39.298 +08:00] [WARN] [operator_controller.go:224] [“remove operator because region disappeared”] [region-id=6959137] [operator=“merge-region {merge: region 6959137 to 6958005} (kind:merge, region:6959137(85371,6753), createAt:2022-08-08 09:47:38.602771173 +0800 CST m=+58459.572011890, startAt:2022-08-08 09:47:38.60296934 +0800 CST m=+58459.572210056, currentStep:0, steps:[merge region 6959137 into region 6958005])”]
[2022/08/08 09:47:39.299 +08:00] [INFO] [operator_controller.go:587] [“operator canceled”] [region-id=6959137] [takes=696.52909ms] [operator="“merge-region {merge: region 6959137 to 6958005} (kind:merge, region:6959137(85371,6753), createAt:2022-08-08 09:47:38.602771173 +0800 CST m=+58459.572011890, startAt:2022-08-08 09:47:38.60296934 +0800 CST m=+58459.572210056, currentStep:0, steps:[merge region 6959137 into region 6958005])”"]
[2022/08/08 09:47:40.008 +08:00] [WARN] [tso.go:321] [“clock offset”] [jet-lag=194.355243ms] [prev-physical=2022/08/08 09:47:39.813 +08:00] [now=2022/08/08 09:47:40.008 +08:00] [update-physical-interval=50ms]
[2022/08/08 09:47:40.398 +08:00] [WARN] [tso.go:321] [“clock offset”] [jet-lag=192.887691ms] [prev-physical=2022/08/08 09:47:40.206 +08:00] [now=2022/08/08 09:47:40.398 +08:00] [update-physical-interval=50ms]
[2022/08/08 09:47:40.999 +08:00] [WARN] [tso.go:321] [“clock offset”] [jet-lag=196.598655ms] [prev-physical=2022/08/08 09:47:40.803 +08:00] [now=2022/08/08 09:47:40.999 +08:00] [update-physical-interval=50ms]
[2022/08/08 09:47:41.300 +08:00] [WARN] [tso.go:321] [“clock offset”] [jet-lag=196.260159ms] [prev-physical=2022/08/08 09:47:41.104 +08:00] [now=2022/08/08 09:47:41.300 +08:00] [update-physical-interval=50ms]
[2022/08/08 09:47:42.111 +08:00] [WARN] [tso.go:321] [“clock offset”] [jet-lag=207.335941ms] [prev-physical=2022/08/08 09:47:41.904 +08:00] [now=2022/08/08 09:47:42.111 +08:00] [update-physical-interval=50ms]
[2022/08/08 09:47:42.509 +08:00] [INFO] [operator_controller.go:437] [“add operator”] [region-id=4611780] [operator="“transfer-hot-read-leader {transfer leader: store 2853742 to 2853787} (kind:hot-region,leader, region:4611780(12683,809), createAt:2022-08-08 09:47:42.509350736 +0800 CST m=+58463.478591500, startAt:0001-01-01 00:00:00 +0000 UTC, currentStep:0, steps:[transfer leader from store 2853742 to store 2853787])”"] [additional-info=]
[2022/08/08 09:47:42.509 +08:00] [INFO] [operator_controller.go:635] [“send schedule command”] [region-id=4611780] [step=“transfer leader from store 2853742 to store 2853787”] [source=create]
[2022/08/08 09:47:42.514 +08:00] [INFO] [region.go:549] [“leader changed”] [region-id=4611780] [from=2853742] [to=2853787]
[2022/08/08 09:47:42.515 +08:00] [INFO] [operator_controller.go:552] [“operator finish”] [region-id=4611780] [takes=6.087877ms] [operator="“transfer-hot-read-leader {transfer leader: store 2853742 to 2853787} (kind:hot-region,leader, region:4611780(12683,809), createAt:2022-08-08 09:47:42.509350736 +0800 CST m=+58463.478591500, startAt:2022-08-08 09:47:42.509618884 +0800 CST m=+58463.478859593, currentStep:1, steps:[transfer leader from store 2853742 to store 2853787]) finished”"] [additional-info=]
[2022/08/08 09:47:42.915 +08:00] [WARN] [tso.go:321] [“clock offset”] [jet-lag=609.817254ms] [prev-physical=2022/08/08 09:47:42.305 +08:00] [now=2022/08/08 09:47:42.915 +08:00] [update-physical-interval=50ms]
[2022/08/08 09:47:44.204 +08:00] [WARN] [tso.go:321] [“clock offset”] [jet-lag=299.665762ms] [prev-physical=2022/08/08 09:47:43.904 +08:00] [now=2022/08/08 09:47:44.204 +08:00] [update-physical-interval=50ms]
[2022/08/08 09:47:45.298 +08:00] [WARN] [tso.go:321] [“clock offset”] [jet-lag=199.103633ms] [prev-physical=2022/08/08 09:47:45.099 +08:00] [now=2022/08/08 09:47:45.298 +08:00] [update-physical-interval=50ms]
[2022/08/08 09:47:45.500 +08:00] [INFO] [trace.go:145] [“trace[1761738868] put”] [detail="{key:/tidb/server/minstartts/fe2fd9ea-b7bc-462b-b81f-f5c283e380e7; req_size:92; response_revision:681330442; }"] [duration=194.017035ms] [start=2022/08/08 09:47:45.306 +08:00] [end=2022/08/08 09:47:45.500 +08:00] [steps="[“trace[1761738868] ‘process raft request’ (duration: 104.259148ms)”,“trace[1761738868] ‘get key’s previous created_revision and leaseID’ (duration: 89.67176ms)”]"]
[2022/08/08 09:47:46.414 +08:00] [WARN] [tso.go:321] [“clock offset”] [jet-lag=905.42424ms] [prev-physical=2022/08/08 09:47:45.508 +08:00] [now=2022/08/08 09:47:46.414 +08:00] [update-physical-interval=50ms]
[2022/08/08 09:47:47.801 +08:00] [WARN] [tso.go:321] [“clock offset”] [jet-lag=194.347735ms] [prev-physical=2022/08/08 09:47:47.607 +08:00] [now=2022/08/08 09:47:47.801 +08:00] [update-physical-interval=50ms]
[2022/08/08 09:47:48.600 +08:00] [WARN] [tso.go:321] [“clock offset”] [jet-lag=189.297056ms] [prev-physical=2022/08/08 09:47:48.411 +08:00] [now=2022/08/08 09:47:48.600 +08:00] [update-physical-interval=50ms]
[2022/08/08 09:47:50.398 +08:00] [WARN] [tso.go:321] [“clock offset”] [jet-lag=286.741747ms] [prev-physical=2022/08/08 09:47:50.112 +08:00] [now=2022/08/08 09:47:50.398 +08:00] [update-physical-interval=50ms]
[2022/08/08 09:47:50.698 +08:00] [WARN] [tso.go:321] [“clock offset”] [jet-lag=192.858618ms] [prev-physical=2022/08/08 09:47:50.506 +08:00] [now=2022/08/08 09:47:50.698 +08:00] [update-physical-interval=50ms]
[2022/08/08 09:47:51.303 +08:00] [WARN] [tso.go:321] [“clock offset”] [jet-lag=193.458652ms] [prev-physical=2022/08/08 09:47:51.110 +08:00] [now=2022/08/08 09:47:51.303 +08:00] [update-physical-interval=50ms]
[2022/08/08 09:47:51.799 +08:00] [WARN] [tso.go:321] [“clock offset”] [jet-lag=191.075879ms] [prev-physical=2022/08/08 09:47:51.608 +08:00] [now=2022/08/08 09:47:51.799 +08:00] [update-physical-interval=50ms]
[2022/08/08 09:47:52.999 +08:00] [WARN] [tso.go:321] [“clock offset”] [jet-lag=285.531701ms] [prev-physical=2022/08/08 09:47:52.714 +08:00] [now=2022/08/08 09:47:52.999 +08:00] [update-physical-interval=50ms]
[2022/08/08 09:47:53.699 +08:00] [WARN] [tso.go:321] [“clock offset”] [jet-lag=194.034241ms] [prev-physical=2022/08/08 09:47:53.505 +08:00] [now=2022/08/08 09:47:53.699 +08:00] [update-physical-interval=50ms]
[2022/08/08 09:47:53.899 +08:00] [WARN] [tso.go:321] [“clock offset”] [jet-lag=199.40276ms] [prev-physical=2022/08/08 09:47:53.699 +08:00] [now=2022/08/08 09:47:53.899 +08:00] [update-physical-interval=50ms]
[2022/08/08 09:47:54.199 +08:00] [WARN] [tso.go:321] [“clock offset”] [jet-lag=191.422443ms] [prev-physical=2022/08/08 09:47:54.007 +08:00] [now=2022/08/08 09:47:54.199 +08:00] [update-physical-interval=50ms]
[2022/08/08 09:47:55.001 +08:00] [WARN] [tso.go:321] [“clock offset”] [jet-lag=187.236765ms] [prev-physical=2022/08/08 09:47:54.814 +08:00] [now=2022/08/08 09:47:55.001 +08:00] [update-physical-interval=50ms]
[2022/08/08 09:47:55.799 +08:00] [WARN] [tso.go:321] [“clock offset”] [jet-lag=194.583844ms] [prev-physical=2022/08/08 09:47:55.605 +08:00] [now=2022/08/08 09:47:55.799 +08:00] [update-physical-interval=50ms]
[2022/08/08 09:47:56.103 +08:00] [WARN] [tso.go:321] [“clock offset”] [jet-lag=199.362178ms] [prev-physical=2022/08/08 09:47:55.904 +08:00] [now=2022/08/08 09:47:56.103 +08:00] [update-physical-interval=50ms]
[2022/08/08 09:47:57.300 +08:00] [WARN] [tso.go:321] [“clock offset”] [jet-lag=195.337868ms] [prev-physical=2022/08/08 09:47:57.105 +08:00] [now=2022/08/08 09:47:57.300 +08:00] [update-physical-interval=50ms]
[2022/08/08 09:47:59.504 +08:00] [WARN] [tso.go:321] [“clock offset”] [jet-lag=198.632913ms] [prev-physical=2022/08/08 09:47:59.305 +08:00] [now=2022/08/08 09:47:59.504 +08:00] [update-physical-interval=50ms]
[2022/08/08 09:48:00.200 +08:00] [WARN] [tso.go:321] [“clock offset”] [jet-lag=192.781066ms] [prev-physical=2022/08/08 09:48:00.007 +08:00] [now=2022/08/08 09:48:00.200 +08:00] [update-physical-interval=50ms]
[2022/08/08 09:48:01.814 +08:00] [WARN] [tso.go:321] [“clock offset”] [jet-lag=205.899491ms] [prev-physical=2022/08/08 09:48:01.608 +08:00] [now=2022/08/08 09:48:01.814 +08:00] [update-physical-interval=50ms]
[2022/08/08 09:48:03.909 +08:00] [WARN] [tso.go:321] [“clock offset”] [jet-lag=204.6075ms] [prev-physical=2022/08/08 09:48:03.705 +08:00] [now=2022/08/08 09:48:03.909 +08:00] [update-physical-interval=50ms]
[2022/08/08 09:48:04.207 +08:00] [WARN] [tso.go:321] [“clock offset”] [jet-lag=190.210954ms] [prev-physical=2022/08/08 09:48:04.016 +08:00] [now=2022/08/08 09:48:04.207 +08:00] [update-physical-interval=50ms]
[2022/08/08 09:48:04.401 +08:00] [WARN] [tso.go:321] [“clock offset”] [jet-lag=194.32372ms] [prev-physical=2022/08/08 09:48:04.207 +08:00] [now=2022/08/08 09:48:04.401 +08:00] [update-physical-interval=50ms]
[2022/08/08 09:48:04.802 +08:00] [WARN] [tso.go:321] [“clock offset”] [jet-lag=198.233478ms] [prev-physical=2022/08/08 09:48:04.604 +08:00] [now=2022/08/08 09:48:04.802 +08:00] [update-physical-interval=50ms]
[2022/08/08 09:48:05.399 +08:00] [INFO] [trace.go:145] [“trace[206193813] put”] [detail="{key:/tidb/server/minstartts/aff01b24-4f89-4c4e-96cc-d8d777e51b9e; req_size:92; response_revision:681330456; }"] [duration=191.262911ms] [start=2022/08/08 09:48:05.208 +08:00] [end=2022/08/08 09:48:05.399 +08:00] [steps="[“trace[206193813] ‘process raft request’ (duration: 191.217747ms)”]"]
[2022/08/08 09:48:05.400 +08:00] [INFO] [trace.go:145] [“trace[1677972904] put”] [detail="{key:/tidb/ddl/global_schema_version; req_size:41; response_revision:681330455; }"] [duration=194.026058ms] [start=2022/08/08 09:48:05.206 +08:00] [end=2022/08/08 09:48:05.400 +08:00] [steps="[“trace[1677972904] ‘process raft request’ (duration: 193.768526ms)”]"]
[2022/08/08 09:48:05.699 +08:00] [WARN] [tso.go:321] [“clock offset”] [jet-lag=699.554252ms] [prev-physical=2022/08/08 09:48:04.999 +08:00] [now=2022/08/08 09:48:05.699 +08:00] [update-physical-interval=50ms]
[2022/08/08 09:48:06.005 +08:00] [WARN] [tso.go:321] [“clock offset”] [jet-lag=196.221182ms] [prev-physical=2022/08/08 09:48:05.809 +08:00] [now=2022/08/08 09:48:06.005 +08:00] [update-physical-interval=50ms]
[2022/08/08 09:48:06.999 +08:00] [WARN] [util.go:144] [“apply request took too long”] [took=296.019638ms] [expected-duration=100ms] [prefix=“read-only range “] [request=“key:”/tidb/ddl/all_schema_versions” range_end:”/tidb/ddl/all_schema_versiont" “] [response=“range_response_count:4 size:424”] []
[2022/08/08 09:48:06.999 +08:00] [INFO] [trace.go:145] [“trace[1609230232] range”] [detail=”{range_begin:/tidb/ddl/all_schema_versions; range_end:/tidb/ddl/all_schema_versiont; response_count:4; response_revision:681330469; }"] [duration=296.129778ms] [start=2022/08/08 09:48:06.703 +08:00] [end=2022/08/08 09:48:06.999 +08:00] [steps="[“trace[1609230232] ‘agreement among raft nodes before linearized reading’ (duration: 207.841558ms)”,“trace[1609230232] ‘range keys from in-memory index tree’ (duration: 88.133816ms)”]"]
[2022/08/08 09:48:07.905 +08:00] [WARN] [tso.go:321] [“clock offset”] [jet-lag=200.577956ms] [prev-physical=2022/08/08 09:48:07.704 +08:00] [now=2022/08/08 09:48:07.905 +08:00] [update-physical-interval=50ms]
[2022/08/08 09:48:09.403 +08:00] [WARN] [tso.go:321] [“clock offset”] [jet-lag=196.858727ms] [prev-physical=2022/08/08 09:48:09.206 +08:00] [now=2022/08/08 09:48:09.403 +08:00] [update-physical-interval=50ms]
[2022/08/08 09:48:09.604 +08:00] [INFO] [cluster_worker.go:128] [“alloc ids for region split”] [region-id=6959621] [peer-ids="[6959622,6959623,6959624]"]
[2022/08/08 09:48:09.704 +08:00] [INFO] [region.go:528] [“region Version changed”] [region-id=6953001] [detail=“StartKey Changed:{7480000000000364FF4200000000000000F8} -> {7480000000000364FF4500000000000000F8}, EndKey:{}”] [old-version=85490] [new-version=85491]
[2022/08/08 09:48:09.713 +08:00] [INFO] [cluster_worker.go:220] [“region batch split, generate new regions”] [region-id=6953001] [origin=“id:6959621 start_key:“7480000000000364FF4200000000000000F8” end_key:“7480000000000364FF4500000000000000F8” region_epoch:<conf_ver:6753 version:85491 > peers:<id:6959622 store_id:2853742 > peers:<id:6959623 store_id:2853733 > peers:<id:6959624 store_id:2853787 >”] [total=1]
不知道有没有用
https://metricstool.pingcap.com/#backup-with-dev-tools
按上面的把pd/tikv/tidb/overview的监控导出，导出前要保障所有的面板都已展开
1、还有些tombone store信息残留，清理下： pd-ctl -u http://pd_ip:2379 store remove-tombstone
2、有大量的table scatter调度，看上去是每个表都添加了这个调度，使用pd-ctl scheduler show/remove检查和清理这些scatter调度。一般情况不需要给每个表加scatter调度 由balance scheduler完成均衡调度即可，有特殊情况再处理
感谢，果然remove掉scatter调度后，CPU就降下来了，我再观察观察
请问table scatter调度是用来手工均衡region的吗？
对，之前为了解决热点表问题，执行了operator add split-region命令，就多了这些table scatter任务。但这个热点问题应该是个bug，我升级到5.4.2以后就没有这个问题了
该主题在最后一个回复创建后60天后自动关闭。不再允许新的回复。