tidb v4 版本读热点 peer transfer leader 导致 TiDB oom

了解,辛苦大佬帮看下上面的图。

goroutine 文件,发现很多 goroutine 11 [syscall, 529542 minutes]: 的进程。
goroutine2023-03-10T04:51:34+08:00 (1.2 MB)

看到这个帖子说TiDB内存占用持续增长 - #22,来自 OldJack 说有 enable-streaming 可能导致内存缓慢释放。

goroutine 290 [select, 380228 minutes]:
google.golang.org/grpc.(*ccBalancerWrapper).watcher(0xc00065c880)
	/home/jenkins/agent/workspace/optimization-build-tidb-linux-amd/go/pkg/mod/google.golang.org/grpc@v1.26.0/balancer_conn_wrappers.go:69 +0xc2
created by google.golang.org/grpc.newCCBalancerWrapper
	/home/jenkins/agent/workspace/optimization-build-tidb-linux-amd/go/pkg/mod/google.golang.org/grpc@v1.26.0/balancer_conn_wrappers.go:60 +0x16d

  • 检查参数配置已经关闭
root@ 22:05:57 [(none)]> select @@tidb_enable_streaming;
+-------------------------+
| @@tidb_enable_streaming |
+-------------------------+
| 0                       |
+-------------------------+
1 row in set (0.00 sec)

root@22:06:18 [(none)]> show global variables like '%tidb_enable_streaming%';

+-----------------------+-------+
| Variable_name         | Value |
+-----------------------+-------+
| tidb_enable_streaming | 0     |
+-----------------------+-------+