TIKV 提示util.rs:449问题

🪐 TiDB 技术问题 部署&运维管理
1

【 TiDB 使用环境】测试
【 TiDB 版本】 v6.4.0
【复现路径】tiup cluster start tidb-cluster 后，观察日志发现如下信息
[2022/12/29 13:08:46.139 +08:00] [INFO] [util.rs:589] [“connecting to PD endpoint”] [endpoints=http://192.168.2.21:2379]
[2022/12/29 13:09:16.897 +08:00] [ERROR] [util.rs:449] [“request failed, retry”] [err_code=KV:Pd:Grpc] [err=“Grpc(RpcFailure(RpcStatus { code: 4-DEADLINE_EXCEEDED, message: "Deadline Exceeded", details: [] }))”]
[2022/12/29 13:09:17.898 +08:00] [ERROR] [util.rs:449] [“request failed, retry”] [err_code=KV:Pd:Grpc] [err=“Grpc(RpcFailure(RpcStatus { code: 4-DEADLINE_EXCEEDED, message: "Deadline Exceeded", details: [] }))”]
[2022/12/29 13:10:37.132 +08:00] [ERROR] [util.rs:449] [“request failed, retry”] [err_code=KV:Pd:Grpc] [err=“Grpc(RpcFailure(RpcStatus { code: 4-DEADLINE_EXCEEDED, message: "Deadline Exceeded", details: [] }))”]
[2022/12/29 13:13:03.628 +08:00] [ERROR] [util.rs:449] [“request failed, retry”] [err_code=KV:Pd:Grpc] [err=“Grpc(RpcFailure(RpcStatus { code: 4-DEADLINE_EXCEEDED, message: "Deadline Exceeded", details: [] }))”]
[2022/12/29 13:13:03.821 +08:00] [ERROR] [util.rs:449] [“request failed, retry”] [err_code=KV:Pd:Grpc] [err=“Grpc(RpcFailure(RpcStatus { code: 4-DEADLINE_EXCEEDED, message: "Deadline Exceeded", details: [] }))”]
[2022/12/29 13:18:46.144 +08:00] [INFO] [util.rs:589] [“connecting to PD endpoint”] [endpoints=http://192.168.2.21:2379]

【遇到的问题：问题现象及影响】
【资源配置】
【附件：截图/日志/监控】

image
image1784×487 133 KB

2

[tidb@tidb-mdb ~]$
[tidb@tidb-mdb ~]$ tiup ctl:v6.4.0 pd store -u http://192.168.2.21:2379
The component ctl version v6.4.0 is not installed; downloading from repository.
Starting component ctl: /home/tidb/.tiup/components/ctl/v6.4.0/ctl pd store -u http://192.168.2.21:2379
{
“count”: 5,
“stores”: [
{
“store”: {
“id”: 121,
“address”: “192.168.2.22:3930”,
“labels”: [
{
“key”: “engine”,
“value”: “tiflash”
}
],
“version”: “v6.4.0”,
“peer_address”: “192.168.2.22:20170”,
“status_address”: “192.168.2.22:20292”,
“git_hash”: “301561b850ca3545ae359b5430321cee3523f90c”,
“start_timestamp”: 1672282139,
“deploy_path”: “/data/tidb-deploy/tiflash-9000/bin/tiflash”,
“last_heartbeat”: 1672298417208991134,
“state_name”: “Up”
},
“status”: {
“capacity”: “7.986GiB”,
“available”: “5.647GiB”,
“used_size”: “1B”,
“leader_count”: 0,
“leader_weight”: 1,
“leader_score”: 0,
“leader_size”: 0,
“region_count”: 0,
“region_weight”: 1,
“region_score”: 8871108626.574278,
“region_size”: 0,
“witness_count”: 0,
“slow_score”: 1,
“start_ts”: “2022-12-29T10:48:59+08:00”,
“last_heartbeat_ts”: “2022-12-29T15:20:17.208991134+08:00”,
“uptime”: “4h31m18.208991134s”
}
},
{
“store”: {
“id”: 1,
“address”: “192.168.2.151:20160”,
“version”: “6.4.0”,
“peer_address”: “192.168.2.151:20160”,
“status_address”: “192.168.2.151:20180”,
“git_hash”: “af4c732c46ef62e677266e0055e2a8b50207f09c”,
“start_timestamp”: 1672282126,
“deploy_path”: “/data/tidb-deploy/tikv-20160/bin”,
“last_heartbeat”: 1672298418240303709,
“state_name”: “Up”
},
“status”: {
“capacity”: “70.49GiB”,
“available”: “47.47GiB”,
“used_size”: “291.8MiB”,
“leader_count”: 0,
“leader_weight”: 1,
“leader_score”: 0,
“leader_size”: 0,
“region_count”: 1,
“region_weight”: 1,
“region_score”: 499542924.266385,
“region_size”: 1,
“witness_count”: 0,
“slow_score”: 1,
“start_ts”: “2022-12-29T10:48:46+08:00”,
“last_heartbeat_ts”: “2022-12-29T15:20:18.240303709+08:00”,
“uptime”: “4h31m32.240303709s”
}
},
{
“store”: {
“id”: 2,
“address”: “192.168.2.21:20160”,
“version”: “6.4.0”,
“peer_address”: “192.168.2.21:20160”,
“status_address”: “192.168.2.21:20180”,
“git_hash”: “af4c732c46ef62e677266e0055e2a8b50207f09c”,
“start_timestamp”: 1672282125,
“deploy_path”: “/data/tidb-deploy/tikv-20160/bin”,
“last_heartbeat”: 1672298417977337836,
“state_name”: “Up”
},
“status”: {
“capacity”: “7.986GiB”,
“available”: “5.502GiB”,
“used_size”: “291.8MiB”,
“leader_count”: 0,
“leader_weight”: 1,
“leader_score”: 0,
“leader_size”: 0,
“region_count”: 1,
“region_weight”: 1,
“region_score”: 8899701753.059637,
“region_size”: 1,
“witness_count”: 0,
“slow_score”: 1,
“start_ts”: “2022-12-29T10:48:45+08:00”,
“last_heartbeat_ts”: “2022-12-29T15:20:17.977337836+08:00”,
“uptime”: “4h31m32.977337836s”
}
},
{
“store”: {
“id”: 7,
“address”: “192.168.2.22:20160”,
“version”: “6.4.0”,
“peer_address”: “192.168.2.22:20160”,
“status_address”: “192.168.2.22:20180”,
“git_hash”: “af4c732c46ef62e677266e0055e2a8b50207f09c”,
“start_timestamp”: 1672282125,
“deploy_path”: “/data/tidb-deploy/tikv-20160/bin”,
“last_heartbeat”: 1672298417562748638,
“state_name”: “Up”
},
“status”: {
“capacity”: “7.986GiB”,
“available”: “5.646GiB”,
“used_size”: “290.6MiB”,
“leader_count”: 1,
“leader_weight”: 1,
“leader_score”: 1,
“leader_size”: 1,
“region_count”: 1,
“region_weight”: 1,
“region_score”: 8871176229.963314,
“region_size”: 1,
“witness_count”: 0,
“slow_score”: 1,
“start_ts”: “2022-12-29T10:48:45+08:00”,
“last_heartbeat_ts”: “2022-12-29T15:20:17.562748638+08:00”,
“uptime”: “4h31m32.562748638s”
}
},
{
“store”: {
“id”: 120,
“address”: “192.168.2.21:3930”,
“labels”: [
{
“key”: “engine”,
“value”: “tiflash”
}
],
“version”: “v6.4.0”,
“peer_address”: “192.168.2.21:20170”,
“status_address”: “192.168.2.21:20292”,
“git_hash”: “301561b850ca3545ae359b5430321cee3523f90c”,
“start_timestamp”: 1672282139,
“deploy_path”: “/data/tidb-deploy/tiflash-9000/bin/tiflash”,
“last_heartbeat”: 1672298416947881186,
“state_name”: “Up”
},
“status”: {
“capacity”: “7.986GiB”,
“available”: “5.502GiB”,
“used_size”: “1B”,
“leader_count”: 0,
“leader_weight”: 1,
“leader_score”: 0,
“leader_size”: 0,
“region_count”: 0,
“region_weight”: 1,
“region_score”: 8899702551.402153,
“region_size”: 0,
“witness_count”: 0,
“slow_score”: 1,
“start_ts”: “2022-12-29T10:48:59+08:00”,
“last_heartbeat_ts”: “2022-12-29T15:20:16.947881186+08:00”,
“uptime”: “4h31m17.947881186s”
}
}
]
}
[tidb@tidb-mdb ~]$

2.21 的PD 信息

3

会不会是权限问题：

4

tikv.log显示一致链接pd，但是显示pd deadline无法链接，一致重试

5

嗯，我检查下

6

好的~有答案也同步一下回贴子，也让我们学习学习~

7

此话题已在最后回复的 60 天后被自动关闭。不再允许新回复。