tidb-operator无法创建TiDB集群

🪐 TiDB 技术问题 K8s
1

为提高效率，提问时请提供以下信息，问题描述清晰可优先响应。

  • 【TiDB 版本】：operator v1.1.4 ,tidb v4.0.6
  • 【问题描述】：显示配置出错，但是删除或者调整原有TC依然法无法正常工作。

会一直报错，每秒报一次错

[root@dcn-tidb-k8s-p-l-11:/home/appdeploy/push-tidb]#kubectl logs tidb-controller-manager-67d596c978-6sfjs  -n tidb-admin
I1228 12:09:57.154424       1 version.go:38] Welcome to TiDB Operator.
I1228 12:09:57.154457       1 version.go:39] TiDB Operator Version: version.Info{GitVersion:"v1.1.4", GitCommit:"08e85646cc848d594337bbeab187c9c65a5545c2", GitTreeState:"clean", BuildDate:"2020-08-21T07:22:23Z", GoVersion:"go1.13.8", Compiler:"gc", Platform:"linux/amd64"}
I1228 12:09:57.155024       1 main.go:100] FLAG: --V="false"
I1228 12:09:57.155045       1 main.go:100] FLAG: --add_dir_header="false"
I1228 12:09:57.155055       1 main.go:100] FLAG: --alsologtostderr="false"
I1228 12:09:57.155063       1 main.go:100] FLAG: --auto-failover="true"
I1228 12:09:57.155071       1 main.go:100] FLAG: --cluster-scoped="true"
I1228 12:09:57.155078       1 main.go:100] FLAG: --features="AdvancedStatefulSet=false,AutoScaling=false,StableScheduling=true"
I1228 12:09:57.155111       1 main.go:100] FLAG: --log_backtrace_at=":0"
I1228 12:09:57.155124       1 main.go:100] FLAG: --log_dir=""
I1228 12:09:57.155135       1 main.go:100] FLAG: --log_file=""
I1228 12:09:57.155144       1 main.go:100] FLAG: --log_file_max_size="1800"
I1228 12:09:57.155154       1 main.go:100] FLAG: --logtostderr="true"
I1228 12:09:57.155162       1 main.go:100] FLAG: --pd-failover-period="5m0s"
I1228 12:09:57.155174       1 main.go:100] FLAG: --pod-webhook-enabled="false"
I1228 12:09:57.155181       1 main.go:100] FLAG: --resync-duration="30s"
I1228 12:09:57.155190       1 main.go:100] FLAG: --skip_headers="false"
I1228 12:09:57.155198       1 main.go:100] FLAG: --skip_log_headers="false"
I1228 12:09:57.155205       1 main.go:100] FLAG: --stderrthreshold="2"
I1228 12:09:57.155216       1 main.go:100] FLAG: --test-mode="false"
I1228 12:09:57.155223       1 main.go:100] FLAG: --tidb-backup-manager-image="harbor.fcbox.com/tidb/pingcap/tidb-backup-manager:v1.1.4"
I1228 12:09:57.155234       1 main.go:100] FLAG: --tidb-discovery-image="harbor.fcbox.com/tidb/pingcap/tidb-operator:v1.1.4"
I1228 12:09:57.155261       1 main.go:100] FLAG: --tidb-failover-period="5m0s"
I1228 12:09:57.155271       1 main.go:100] FLAG: --tiflash-failover-period="5m0s"
I1228 12:09:57.155279       1 main.go:100] FLAG: --tikv-failover-period="5m0s"
I1228 12:09:57.155295       1 main.go:100] FLAG: --v="2"
I1228 12:09:57.155309       1 main.go:100] FLAG: --version="false"
I1228 12:09:57.155317       1 main.go:100] FLAG: --vmodule=""
I1228 12:09:57.155327       1 main.go:100] FLAG: --workers="5"
I1228 12:09:57.197056       1 leaderelection.go:241] attempting to acquire leader lease  tidb-admin/tidb-controller-manager...
I1228 12:10:14.178021       1 leaderelection.go:251] successfully acquired lease tidb-admin/tidb-controller-manager
I1228 12:10:14.182191       1 upgrader.go:106] Upgrader: APIGroup apps.pingcap.com is not registered, skip checking Advanced Statfulset
E1228 12:10:14.245846       1 reflector.go:123] k8s.io/client-go@v0.0.0/tools/cache/reflector.go:96: Failed to list *v1alpha1.TidbCluster: v1alpha1.TidbClusterList.Items: []v1alpha1.TidbCluster: v1alpha1.TidbCluster.Spec: v1alpha1.TidbClusterSpec.TiKV: v1alpha1.TiKVSpec.ResourceRequirements: Requests: unmarshalerDecoder: quantities must match the regular expression '^([+-]?[0-9.]+)([eEinumkKMGTP]*[-+]?[0-9]*)$', error found in #10 byte of ...|ry":"45GB","storage"|..., bigger context ...|3,"replicas":3,"requests":{"cpu":8,"memory":"45GB","storage":"50Gi"},"storageClassName":"kv-storage"|...
E1228 12:10:15.252945       1 reflector.go:123] k8s.io/client-go@v0.0.0/tools/cache/reflector.go:96: Failed to list *v1alpha1.TidbCluster: v1alpha1.TidbClusterList.Items: []v1alpha1.TidbCluster: v1alpha1.TidbCluster.Spec: v1alpha1.TidbClusterSpec.TiKV: v1alpha1.TiKVSpec.ResourceRequirements: Requests: unmarshalerDecoder: quantities must match the regular expression '^([+-]?[0-9.]+)([eEinumkKMGTP]*[-+]?[0-9]*)$', error found in #10 byte of ...|ry":"45GB","storage"|..., bigger context ...|3,"replicas":3,"requests":{"cpu":8,"memory":"45GB","storage":"50Gi"},"storageClassName":"kv-storage"|...
E1228 12:10:16.259691       1 reflector.go:123] k8s.io/client-go@v0.0.0/tools/cache/reflector.go:96: Failed to list *v1alpha1.TidbCluster: v1alpha1.TidbClusterList.Items: []v1alpha1.TidbCluster: v1alpha1.TidbCluster.Spec: v1alpha1.TidbClusterSpec.TiKV: v1alpha1.TiKVSpec.ResourceRequirements: Requests: unmarshalerDecoder: quantities must match the regular expression '^([+-]?[0-9.]+)([eEinumkKMGTP]*[-+]?[0-9]*)$', error found in #10 byte of ...|ry":"45GB","storage"|..., bigger context ...|3,"replicas":3,"requests":{"cpu":8,"memory":"45GB","storage":"50Gi"},"storageClassName":"kv-storage"|...
E1228 12:10:17.268064       1 reflector.go:123] k8s.io/client-go@v0.0.0/tools/cache/reflector.go:96: Failed to list *v1alpha1.TidbCluster: v1alpha1.TidbClusterList.Items: []v1alpha1.TidbCluster: v1alpha1.TidbCluster.Spec: v1alpha1.TidbClusterSpec.TiKV: v1alpha1.TiKVSpec.ResourceRequirements: Requests: unmarshalerDecoder: quantities must match the regular expression '^([+-]?[0-9.]+)([eEinumkKMGTP]*[-+]?[0-9]*)$', error found in #10 byte of ...|ry":"45GB","storage"|..., bigger context ...|3,"replicas":3,"requests":{"cpu":8,"memory":"45GB","storage":"50Gi"},"storageClassName":"kv-storage"|...
E1228 12:10:18.274234       1 reflector.go:123] k8s.io/client-go@v0.0.0/tools/cache/reflector.go:96: Failed to list *v1alpha1.TidbCluster: v1alpha1.TidbClusterList.Items: []v1alpha1.TidbCluster: v1alpha1.TidbCluster.Spec: v1alpha1.TidbClusterSpec.TiKV: v1alpha1.TiKVSpec.ResourceRequirements: Requests: unmarshalerDecoder: quantities must match the regular expression '^([+-]?[0-9.]+)([eEinumkKMGTP]*[-+]?[0-9]*)$', error found in #10 byte of ...|ry":"45GB","storage"|..., bigger context ...|},"replicas":3,"requests":{"cpu":8,"memory":"45GB","storage":"50Gi"},"storageClassName":"kv-storage"|...

当前已经显示，删除了异常的TC

[root@dcn-tidb-k8s-p-l-11:/home/appdeploy/push-tidb]#kubectl get tc -A
NAMESPACE         NAME        READY   PD                                        STORAGE   READY   DESIRE   TIKV                                        STORAGE   READY   DESIRE   TIDB                                        READY   DESIRE   AGE
push-namespace    push-tidb   True    harbor.fcbox.com/tidb/pingcap/pd:v4.0.6   50Gi      3       3        harbor.fcbox.com/tidb/pingcap/tikv:v4.0.6   50Gi      3       3        harbor.fcbox.com/tidb/pingcap/tidb:v4.0.6   3       3        95d
test-namespace1   basic1      True    harbor.fcbox.com/tidb/pingcap/pd:v4.0.6   1Gi       3       3        harbor.fcbox.com/tidb/pingcap/tikv:v4.0.6   1Gi       3       3        harbor.fcbox.com/tidb/pingcap/tidb:v4.0.6   3       3        103d
2

找到问题了，由于在很久之前操作了push-namespace push-tidb的CR配置出了问题，没有及时发现，整个operator被该问题阻塞了，其他集群的操作都无法执行。

错误中的GB都得该成Gi

"45GB","storage"|..., bigger context ...|},"replicas":3,"requests":{"cpu":8,"memory":"45GB","storage":"50Gi"},
3

好的 :+1:

4

此话题已在最后回复的 1 分钟后被自动关闭。不再允许新回复。