tiflash占用IO近100%，查询执行特别慢，正常请求没办法正常响应

🪐 TiDB 技术问题
1

【TiDB 版本】
V4.0.0
【问题描述】
“enable-placement-rules”: “true”
leader:
||max|current|
|192.168.0.209:20180|113.9 K|113.9 K|
这个数值一直很高：miss-peer-region-count 113.9 K
也就是没有同步的和leader是一样的，即100%缺失副本
[tidb@crm209 bin]$ tiup cluster display test-cluster
Found cluster newer version:

The latest version:         v1.4.3
Local installed version:    v1.3.5
Update current component:   tiup update cluster
Update all components:      tiup update --all

Starting component cluster: /home/tidb/.tiup/components/cluster/v1.3.5/tiup-cluster display test-cluster
Cluster type: tidb
Cluster name: test-cluster
Cluster version: v4.0.0
SSH type: builtin
Dashboard URL: http://192.168.0.209:2379/dashboard
ID Role Host Ports OS/Arch Status Data Dir Deploy Dir

192.168.0.209:9093 alertmanager 192.168.0.209 9093/9094 linux/x86_64 Up /home/tidb/deploy/data.alertmanager /home/tidb/deploy
192.168.0.209:3000 grafana 192.168.0.209 3000 linux/x86_64 Up - /home/tidb/deploy
192.168.0.209:2379 pd 192.168.0.209 2379/2380 linux/x86_64 Up|L|UI /home/tidb/deploy/data.pd /home/tidb/deploy
192.168.0.209:9090 prometheus 192.168.0.209 9090 linux/x86_64 Up /home/tidb/deploy/prometheus2.0.0.data.metrics /home/tidb/deploy
192.168.0.209:4000 tidb 192.168.0.209 4000/10080 linux/x86_64 Up - /home/tidb/deploy
192.168.0.209:9000 tiflash 192.168.0.209 9000/8123/3930/20170/20292/8234 linux/x86_64 Up /home/tidb/deploy/tiflash-9000/data /home/tidb/deploy/tiflash-9000
192.168.0.209:20160 tikv 192.168.0.209 20160/20180 linux/x86_64 Up /home/tidb/deploy/data /home/tidb/deploy
Total nodes: 7
[tidb@crm209 bin]$

2

麻烦提供下 pd 面板的监控，另外 miss peer 特别多的现象，是否检查过 tikv 或者 tiflash 有异常？可以看下对应节点的 log 信息，根据标题描述，感觉是后者。

1 个赞
3

可以参考一下TiFlash常见问题排查

4

如果可以帮助解决问题，请点赞！:grin:

2 个赞