huixiang
(huixiang)
1
【TiDB 使用环境】生产环境
【TiDB 版本】7.5.3
【问题复现路径】TIDB备份到Ceph没有成功
【遇到的问题:问题现象及影响】
以前使用br备份到minios3中是成功的。最近因空间存储原因改为备份到Ceph没有成功。
我使用的命令是:
tiup br backup full
–pd “IP:2379”
–storage “s3://dba-test/tidbbackup/testtidb00”
–s3.endpoint “http://lfdbabk.in.autohome.com.cn:80”
–s3.access-key “2BMWx”
–s3.secret-key “7A6TYyafhxx”
–s3.region “default”
–s3.provider “ceph”
–s3.force-path-style=true
–ratelimit 100
–log-file /tmp/testtidb001_back20250708-new.log
提示不支持 --s3.access-key直接br出错,不能执行。
改为:如下后进度为0%
export AWS_ACCESS_KEY_ID=xx
export AWS_SECRET_ACCESS_KEY=xx
br_753/br backup full --pd 10.28.6.112:2379 --storage “s3://dba-test/tidbbackup/testtidb003” --s3.endpoint “http://lxx:80” --s3.provider “ceph” --pd 10.28.xxx:2379 --log-level info --log-file /tmp/testtidb001_back20250708-new.log;
问:如何br正确的备份到ceph?
【复制黏贴 ERROR 报错的日志】
日志中内容:
huixiang
(huixiang)
2
用export AWS_ACCESS_KEY_ID=xx
export AWS_SECRET_ACCESS_KEY=xx 。 进度为0%时
br日志情况:
cat testtidb001_back20250708-bakck3.log |grep error -i
[2025/07/08 20:16:38.228 +08:00] [INFO] [manager.go:292] [“failed to campaign”] [“owner info”=“[log-backup] /tidb/br-stream/owner ownerManager 28e0ed8d-dc32-4ba3-aa6c-9d846b0f24b8”] [error=“lost watcher waiting for delete”]
[2025/07/08 20:16:38.228 +08:00] [ERROR] [advancer.go:399] [“listen task meet error, would reopen.”] [error=EOF] [stack=“github.com/pingcap/tidb/br/pkg/streamhelper.(*CheckpointAdvancer).StartTaskListener.func1\n\t/workspace/source/tidb/br/pkg/streamhelper/advancer.go:399”]
[2025/07/08 20:16:38.228 +08:00] [INFO] [advancer.go:402] [“Task watcher exits due to some error.”] [category=“log backup advancer”] [error=EOF]
[2025/07/08 20:16:38.230 +08:00] [INFO] [manager.go:292] [“failed to campaign”] [“owner info”=“[log-backup] /tidb/br-stream/owner ownerManager 28e0ed8d-dc32-4ba3-aa6c-9d846b0f24b8”] [error=“context canceled”]
[2025/07/08 20:16:38.246 +08:00] [WARN] [s3.go:521] [“failed to check object lock for bucket”] [bucket=dba-test] [error=“ObjectLockConfigurationNotFoundError: \n\tstatus code: 404, request id: tx00000000000000004f6f6-00686d0c26-20bf4-default, host id: “]
[2025/07/08 20:16:39.483 +08:00] [INFO] [manager.go:317] [“revoke session”] [“owner info”=”[log-backup] /tidb/br-stream/owner ownerManager 28e0ed8d-dc32-4ba3-aa6c-9d846b0f24b8”] [error=“rpc error: code = Canceled desc = grpc: the client connection is closing”]
WalterWj
(王军 - PingCAP)
3
试试 uri 这么写:
# 生成年月日时分时间戳
ts=$(date +%Y%m%d%H%M)
# 构造 S3 URI
S3_URI="s3://${S3_BUCKET}/${S3_PATH}/${ts}/?access-key=${AWS_ACCESS_KEY_ID}&secret-access-key=${AWS_SECRET_ACCESS_KEY}&force-path-style=true"
1 个赞
WalterWj
(王军 - PingCAP)
4
就这个报错而言,确认下每个 tikv 节点到 ceph 是否网络都是通的。
wfxxh
(倔强的蜗牛)
6
tiup br:v6.5.3 backup full --pd “YOUR_PD_ADDR” --storage “s3://YOUR_BUCKET/PATH/TO/YOUR/FILE?endpoint=http://YOUR_CEPH_IP:PORT&access-key=YOUR_ACCESS_KEY&secret-access-key=YOUR_SECRET_KEY” --ratelimit 128 --log-file /dev/null
这样就行了,我们是用的xsky 的ceph商业版,可以正常备份