BR备份报错:[pd] fetch pending tso requests error

【 TiDB 使用环境】生产环境 /测试/ Poc
【 TiDB 版本】v5.4.3
【复现路径】tidb集群是是从v5.1.4升级到v5.4.3,发现所有的备份都会报错,恢复数据能成功,但是也会报这个错误
【遇到的问题:问题现象及影响】
backup报错如下:
[2023/05/18 09:36:26.756 +00:00] [INFO] [schema.go:137] [“backup checksum”] [take=1m8.099528156s]
[2023/05/18 09:36:26.756 +00:00] [INFO] [metafile.go:562] [“write metas finished”] [type=schema]
[2023/05/18 09:36:26.756 +00:00] [INFO] [metafile.go:602] [“finish the write metas”] [item=727] [type=schema] [costs=1m8.099578709s]
[2023/05/18 09:36:26.757 +00:00] [INFO] [metafile.go:622] [“save backup meta”] [size=223283]
[2023/05/18 09:36:26.864 +00:00] [INFO] [validate.go:78] [“checksum success”] [db=discovery_plus] [table=patsnap_master_entity_discovery_techindex_20230518]
[2023/05/18 09:36:26.864 +00:00] [ERROR] [client.go:752] [“[pd] fetch pending tso requests error”] [dc-location=global] [error=“[PD:client:ErrClientGetTSO]context canceled: context canceled”] [stack=“github.com/tikv/pd/client.(*client).handleDispatcher\n\t/go/pkg/mod/github.com/tikv/pd@v1.1.0-beta.0.20211118054146-02848d2660ee/client/client.go:752”]
[2023/05/18 09:36:26.864 +00:00] [INFO] [client.go:666] [“[pd] exit tso dispatcher”] [dc-location=global]
[2023/05/18 09:36:26.865 +00:00] [ERROR] [client.go:752] [“[pd] fetch pending tso requests error”] [dc-location=global] [error=“[PD:client:ErrClientGetTSO]context canceled: context canceled”] [stack=“github.com/tikv/pd/client.(*client).handleDispatcher\n\t/go/pkg/mod/github.com/tikv/pd@v1.1.0-beta.0.20211118054146-02848d2660ee/client/client.go:752”]
[2023/05/18 09:36:26.865 +00:00] [INFO] [client.go:666] [“[pd] exit tso dispatcher”] [dc-location=global]
[2023/05/18 09:36:26.865 +00:00] [INFO] [collector.go:68] [“Table backup success summary”] [total-ranges=726] [ranges-succeed=726] [ranges-failed=0] [backup-fast-checksum=608.943µs] [backup-checksum=1m8.099548023s] [backup-total-ranges=2] [backup-total-regions=463] [total-take=5m39.143832204s] [total-kv-size=37.54GB] [average-speed=110.7MB/s] [backup-data-size(after-compressed)=15.27GB] [Size=15273290208] [BackupTS=441555942879002627] [total-kv=252076760]

restore报错:
[2023/05/18 09:54:59.720 +00:00] [INFO] [domain.go:716] [“domain closed”] [“take time”=11.843483ms]
[2023/05/18 09:54:59.720 +00:00] [INFO] [manager.go:277] [“failed to campaign”] [“owner info”=“[stats] /tidb/stats/owner ownerManager 16582131-38c0-4ad2-be77-3c91d0b7c702”] [error=“rpc error: code = Unavailable desc = transport is closing”]
[2023/05/18 09:54:59.720 +00:00] [INFO] [manager.go:249] [“etcd session is done, creates a new one”] [“owner info”=“[stats] /tidb/stats/owner ownerManager 16582131-38c0-4ad2-be77-3c91d0b7c702”]
[2023/05/18 09:54:59.721 +00:00] [INFO] [manager.go:277] [“failed to campaign”] [“owner info”=“[stats] /tidb/stats/owner ownerManager 16582131-38c0-4ad2-be77-3c91d0b7c702”] [error=“rpc error: code = Unavailable desc = transport is closing”]
[2023/05/18 09:54:59.721 +00:00] [INFO] [manager.go:249] [“etcd session is done, creates a new one”] [“owner info”=“[stats] /tidb/stats/owner ownerManager 16582131-38c0-4ad2-be77-3c91d0b7c702”]
[2023/05/18 09:54:59.721 +00:00] [ERROR] [client.go:752] [“[pd] fetch pending tso requests error”] [dc-location=global] [error=“[PD:client:ErrClientGetTSO]context canceled: context canceled”] [stack=“github.com/tikv/pd/client.(*client).handleDispatcher\n\t/go/pkg/mod/github.com/tikv/pd@v1.1.0-beta.0.20211118054146-02848d2660ee/client/client.go:752”]
[2023/05/18 09:54:59.721 +00:00] [INFO] [client.go:666] [“[pd] exit tso dispatcher”] [dc-location=global]
[2023/05/18 09:54:59.722 +00:00] [ERROR] [client.go:752] [“[pd] fetch pending tso requests error”] [dc-location=global] [error=“[PD:client:ErrClientGetTSO]context canceled: context canceled”] [stack=“github.com/tikv/pd/client.(*client).handleDispatcher\n\t/go/pkg/mod/github.com/tikv/pd@v1.1.0-beta.0.20211118054146-02848d2660ee/client/client.go:752”]
[2023/05/18 09:54:59.722 +00:00] [INFO] [client.go:666] [“[pd] exit tso dispatcher”] [dc-location=global]
[2023/05/18 09:54:59.722 +00:00] [INFO] [collector.go:68] [“Table restore success summary”] [total-ranges=727] [ranges-succeed=727] [ranges-failed=0] [split-region=4.13103895s] [restore-ranges=463] [total-take=4m28.764527919s] [restore-data-size(after-compressed)=15.27GB] [Size=15273290208] [BackupTS=441556253211885575] [total-kv=252076760] [total-kv-size=37.54GB] [average-speed=139.7MB/s]

这个报错用br备份工具v5.4.3备份tidb数据库(v5.4.3)是必现的,但是不知道会不会有什么影响

这个应该是一个已知的问题,只要日志里有备份成功就可以了。[“Table backup success summary”]

是的,这个问题存在很久了,一直没有修复。生产环境,备份数据很大,一旦恢复出现问题,哪怕一次,我就得跑路了

https://github.com/pingcap/tidb/issues/31335

6.x 上解决了,请升级到 6.x 以上的版本

此话题已在最后回复的 60 天后被自动关闭。不再允许新回复。