安装tiflash后无法使用

Mingdr · 2020 年5 月 20 日 09:58

用ansible升级到4.0后，
先用ansible部署tiflash 然后启动都没问题
就是在使用tiflash的时候，失败了

另外发现tiflash节点tiflash_error.log 有错误

pd节点已经执行了

config placement-rules true

show的结果为：

yilong · 2020 年5 月 20 日 10:20

什么环境部署的？是虚拟机吗？
ansible 环境吗？建议 4.0 使用 tiup 管理
pd-ctl 查看 member 和 store 信息是否正常，多谢
如果都正常，尝试重启tiflash，多谢

Mingdr · 2020 年5 月 20 日 10:36

1：物理机器，tiflash单独一台部署

2：线上使用3.0 目前没看到tiup的离线部署，所以本地测试只能ansible了

3 member：

store：

好像是down了，然后我重新部署一次启动的时候报错了：

Mingdr · 2020 年5 月 20 日 10:49

已经启动了，但是在store里面还是看到是down，怎么处理呢

Mingdr · 2020 年5 月 20 日 10:57

在tiflash_tikv.log里面发现这种日志：

[2020/05/20 06:46:18.200 -04:00] [ERROR] [util.rs:327] ["request failed"] [err="Grpc(RpcFailure(RpcStatus { status: 2-UNKNOWN, details: Some(\"duplicated store address: id:81081 address:\\\"192.168.0.230:3930\\\" labels:<key:\\\"engine\\\" value:\\\"tiflash\\\" > version:\\\"v4.0.0-rc.2\\\" peer_address:\\\"192.168.0.230:20170\\\" status_address:\\\"192.168.0.230:20292\\\" git_hash:\\\"09bd9e6b9a271b1fcd25c676083104a97f18739a\\\" start_timestamp:1589971578 , already registered by id:76077 address:\\\"192.168.0.230:3930\\\" labels:<key:\\\"engine\\\" value:\\\"tiflash\\\" > version:\\\"3.1.0-beta\\\" peer_address:\\\"192.168.0.230:20170\\\" last_heartbeat:1589963943232933704 \") }))"]
[2020/05/20 06:46:18.200 -04:00] [ERROR] [util.rs:327] ["request failed"] [err="Grpc(RpcFailure(RpcStatus { status: 2-UNKNOWN, details: Some(\"duplicated store address: id:81081 address:\\\"192.168.0.230:3930\\\" labels:<key:\\\"engine\\\" value:\\\"tiflash\\\" > version:\\\"v4.0.0-rc.2\\\" peer_address:\\\"192.168.0.230:20170\\\" status_address:\\\"192.168.0.230:20292\\\" git_hash:\\\"09bd9e6b9a271b1fcd25c676083104a97f18739a\\\" start_timestamp:1589971578 , already registered by id:76077 address:\\\"192.168.0.230:3930\\\" labels:<key:\\\"engine\\\" value:\\\"tiflash\\\" > version:\\\"3.1.0-beta\\\" peer_address:\\\"192.168.0.230:20170\\\" last_heartbeat:1589963943232933704 \") }))"]
[2020/05/20 06:46:18.201 -04:00] [ERROR] [util.rs:327] ["request failed"] [err="Grpc(RpcFailure(RpcStatus { status: 2-UNKNOWN, details: Some(\"duplicated store address: id:81081 address:\\\"192.168.0.230:3930\\\" labels:<key:\\\"engine\\\" value:\\\"tiflash\\\" > version:\\\"v4.0.0-rc.2\\\" peer_address:\\\"192.168.0.230:20170\\\" status_address:\\\"192.168.0.230:20292\\\" git_hash:\\\"09bd9e6b9a271b1fcd25c676083104a97f18739a\\\" start_timestamp:1589971578 , already registered by id:76077 address:\\\"192.168.0.230:3930\\\" labels:<key:\\\"engine\\\" value:\\\"tiflash\\\" > version:\\\"3.1.0-beta\\\" peer_address:\\\"192.168.0.230:20170\\\" last_heartbeat:1589963943232933704 \") }))"]
[2020/05/20 06:46:18.202 -04:00] [ERROR] [util.rs:327] ["request failed"] [err="Grpc(RpcFailure(RpcStatus { status: 2-UNKNOWN, details: Some(\"duplicated store address: id:81081 address:\\\"192.168.0.230:3930\\\" labels:<key:\\\"engine\\\" value:\\\"tiflash\\\" > version:\\\"v4.0.0-rc.2\\\" peer_address:\\\"192.168.0.230:20170\\\" status_address:\\\"192.168.0.230:20292\\\" git_hash:\\\"09bd9e6b9a271b1fcd25c676083104a97f18739a\\\" start_timestamp:1589971578 , already registered by id:76077 address:\\\"192.168.0.230:3930\\\" labels:<key:\\\"engine\\\" value:\\\"tiflash\\\" > version:\\\"3.1.0-beta\\\" peer_address:\\\"192.168.0.230:20170\\\" last_heartbeat:1589963943232933704 \") }))"]
[2020/05/20 06:46:18.203 -04:00] [ERROR] [util.rs:327] ["request failed"] [err="Grpc(RpcFailure(RpcStatus { status: 2-UNKNOWN, details: Some(\"duplicated store address: id:81081 address:\\\"192.168.0.230:3930\\\" labels:<key:\\\"engine\\\" value:\\\"tiflash\\\" > version:\\\"v4.0.0-rc.2\\\" peer_address:\\\"192.168.0.230:20170\\\" status_address:\\\"192.168.0.230:20292\\\" git_hash:\\\"09bd9e6b9a271b1fcd25c676083104a97f18739a\\\" start_timestamp:1589971578 , already registered by id:76077 address:\\\"192.168.0.230:3930\\\" labels:<key:\\\"engine\\\" value:\\\"tiflash\\\" > version:\\\"3.1.0-beta\\\" peer_address:\\\"192.168.0.230:20170\\\" last_heartbeat:1589963943232933704 \") }))"]
[2020/05/20 06:46:18.204 -04:00] [ERROR] [util.rs:327] ["request failed"] [err="Grpc(RpcFailure(RpcStatus { status: 2-UNKNOWN, details: Some(\"duplicated store address: id:81081 address:\\\"192.168.0.230:3930\\\" labels:<key:\\\"engine\\\" value:\\\"tiflash\\\" > version:\\\"v4.0.0-rc.2\\\" peer_address:\\\"192.168.0.230:20170\\\" status_address:\\\"192.168.0.230:20292\\\" git_hash:\\\"09bd9e6b9a271b1fcd25c676083104a97f18739a\\\" start_timestamp:1589971578 , already registered by id:76077 address:\\\"192.168.0.230:3930\\\" labels:<key:\\\"engine\\\" value:\\\"tiflash\\\" > version:\\\"3.1.0-beta\\\" peer_address:\\\"192.168.0.230:20170\\\" last_heartbeat:1589963943232933704 \") }))"]
[2020/05/20 06:46:18.204 -04:00] [ERROR] [util.rs:327] ["request failed"] [err="Grpc(RpcFailure(RpcStatus { status: 2-UNKNOWN, details: Some(\"duplicated store address: id:81081 address:\\\"192.168.0.230:3930\\\" labels:<key:\\\"engine\\\" value:\\\"tiflash\\\" > version:\\\"v4.0.0-rc.2\\\" peer_address:\\\"192.168.0.230:20170\\\" status_address:\\\"192.168.0.230:20292\\\" git_hash:\\\"09bd9e6b9a271b1fcd25c676083104a97f18739a\\\" start_timestamp:1589971578 , already registered by id:76077 address:\\\"192.168.0.230:3930\\\" labels:<key:\\\"engine\\\" value:\\\"tiflash\\\" > version:\\\"3.1.0-beta\\\" peer_address:\\\"192.168.0.230:20170\\\" last_heartbeat:1589963943232933704 \") }))"]
[2020/05/20 06:46:18.205 -04:00] [ERROR] [util.rs:327] ["request failed"] [err="Grpc(RpcFailure(RpcStatus { status: 2-UNKNOWN, details: Some(\"duplicated store address: id:81081 address:\\\"192.168.0.230:3930\\\" labels:<key:\\\"engine\\\" value:\\\"tiflash\\\" > version:\\\"v4.0.0-rc.2\\\" peer_address:\\\"192.168.0.230:20170\\\" status_address:\\\"192.168.0.230:20292\\\" git_hash:\\\"09bd9e6b9a271b1fcd25c676083104a97f18739a\\\" start_timestamp:1589971578 , already registered by id:76077 address:\\\"192.168.0.230:3930\\\" labels:<key:\\\"engine\\\" value:\\\"tiflash\\\" > version:\\\"3.1.0-beta\\\" peer_address:\\\"192.168.0.230:20170\\\" last_heartbeat:1589963943232933704 \") }))"]
[2020/05/20 06:46:18.206 -04:00] [ERROR] [util.rs:327] ["request failed"] [err="Grpc(RpcFailure(RpcStatus { status: 2-UNKNOWN, details: Some(\"duplicated store address: id:81081 address:\\\"192.168.0.230:3930\\\" labels:<key:\\\"engine\\\" value:\\\"tiflash\\\" > version:\\\"v4.0.0-rc.2\\\" peer_address:\\\"192.168.0.230:20170\\\" status_address:\\\"192.168.0.230:20292\\\" git_hash:\\\"09bd9e6b9a271b1fcd25c676083104a97f18739a\\\" start_timestamp:1589971578 , already registered by id:76077 address:\\\"192.168.0.230:3930\\\" labels:<key:\\\"engine\\\" value:\\\"tiflash\\\" > version:\\\"3.1.0-beta\\\" peer_address:\\\"192.168.0.230:20170\\\" last_heartbeat:1589963943232933704 \") }))"]
[2020/05/20 06:46:18.207 -04:00] [ERROR] [util.rs:327] ["request failed"] [err="Grpc(RpcFailure(RpcStatus { status: 2-UNKNOWN, details: Some(\"duplicated store address: id:81081 address:\\\"192.168.0.230:3930\\\" labels:<key:\\\"engine\\\" value:\\\"tiflash\\\" > version:\\\"v4.0.0-rc.2\\\" peer_address:\\\"192.168.0.230:20170\\\" status_address:\\\"192.168.0.230:20292\\\" git_hash:\\\"09bd9e6b9a271b1fcd25c676083104a

而且在store里面查看，它是3.1.0版本的tiflash，但是查看tiflash.log日志是4.0的

> 
> 2020.05.20 06:43:03.742741 [ 1 ] <Information> : Starting daemon with revision 54381
> 2020.05.20 06:43:03.745634 [ 1 ] <Information> : TiFlash build info: TiFlash 4.0.0
> Release Version: v4.0.0-rc.2
> Git Commit Hash: 09bd9e6b9a271b1fcd25c676083104a97f18739a
> Git Branch:      heads/refs/tags/v4.0.0-rc.2
> UTC Build Time:  2020-05-11 10:46:33
> 
> 2020.05.20 06:43:03.745668 [ 1 ] <Information> Application: starting up
> 2020.05.20 06:43:03.746009 [ 1 ] <Debug> Application: Data part candidate path: /home/tidb/deploy/tiflash/data/db, capacity: 0
> 2020.05.20 06:43:03.746040 [ 1 ] <Information> Application: Found pd addrs: 192.168.0.246:2379
> 2020.05.20 06:43:03.746417 [ 1 ] <Debug> Application: rlimit on number of file descriptors is 1000000
> 2020.05.20 06:43:03.746422 [ 1 ] <Debug> Application: Initializing DateLUT.

是因为我在3.1的时候使用过tiflash，升级后没删除这个节点信息才导致的吗

yilong · 2020 年5 月 20 日 11:55

是的，有重复的。 tiflash 从3.1升级，需要先缩容tiflash，升级tidb后，再升级
tiup 可以离线安装

https://pingcap.com/docs-cn/stable/tiup/tiup-mirrors/#使用-tiup-离线安装-tidb-集群

Mingdr · 2020 年5 月 21 日 02:10

我现在按照4.0的方法缩容了tiflash，再重新部署，还是不行，现在行了，昨晚走之前我看还是失败的，今早来查看，居然可以用了。。。。。

来了老弟 · 2020 年5 月 21 日 02:45

，辛苦继续测试使用下，有问题欢迎开新帖继续讨论

system · 2022 年10 月 31 日 19:15

此话题已在最后回复的 1 分钟后被自动关闭。不再允许新回复。