source commons files source engines files source kubeblocks files `kubectl get namespace | grep ns-xqred ` `kubectl create namespace ns-xqred` namespace/ns-xqred created create namespace ns-xqred done download kbcli `gh release list --repo apecloud/kbcli --limit 100 | (grep "0.9" || true)` `curl -fsSL https://kubeblocks.io/installer/install_cli.sh | bash -s v0.9.4-beta.1` Your system is linux_amd64 Installing kbcli ... Downloading ... % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 32.1M 100 32.1M 0 0 146M 0 --:--:-- --:--:-- --:--:-- 146M kbcli installed successfully. Kubernetes: v1.32.5-eks-5d4a308 KubeBlocks: 0.9.4 kbcli: 0.9.4-beta.1 WARNING: version difference between kbcli (0.9.4-beta.1) and kubeblocks (0.9.4) Make sure your docker service is running and begin your journey with kbcli: kbcli playground init For more information on how to get started, please visit: https://kubeblocks.io download kbcli v0.9.4-beta.1 done Kubernetes: v1.32.5-eks-5d4a308 KubeBlocks: 0.9.4 kbcli: 0.9.4-beta.1 WARNING: version difference between kbcli (0.9.4-beta.1) and kubeblocks (0.9.4) Kubernetes Env: v1.32.5-eks-5d4a308 POD_RESOURCES: No resources found found default storage class: gp3 kubeblocks version is:0.9.4 skip upgrade kubeblocks Error: no repositories to show helm repo add chaos-mesh https://charts.chaos-mesh.org "chaos-mesh" has been added to your repositories add helm chart repo chaos-mesh success chaos mesh already installed check cluster definition set component name:redis set component version set component version:redis-cluster set service versions:7.0.6,7.2.4,7.2.7 set service versions sorted:7.0.6,7.2.4,7.2.7 set replicas first:2 set replicas third:2 set minimum cmpv service version set minimum cmpv service version replicas:2 REPORT_COUNT:1 LIMIT_CPU:0.1 LIMIT_MEMORY:0.5 storage size: 1 No resources found in ns-xqred namespace. termination_policy:Halt create 2 replica Halt redis cluster check cluster version check cluster definition check component definition set component definition by component version check cmpd by labels check cmpd by compDefs set component definition: redis-cluster-7 by component version:redis-cluster apiVersion: apps.kubeblocks.io/v1alpha1 kind: Cluster metadata: name: rediscl-huzdsq namespace: ns-xqred spec: terminationPolicy: Halt shardingSpecs: - name: shard shards: 3 template: name: redis componentDef: redis-cluster-7 replicas: 2 services: - name: redis-advertised serviceType: NodePort podService: true serviceAccountName: systemAccounts: - name: default passwordConfig: length: 10 numDigits: 5 numSymbols: 0 letterCase: MixedCases seed: redisc resources: limits: cpu: 100m memory: 0.5Gi requests: cpu: 100m memory: 0.5Gi volumeClaimTemplates: - name: data spec: storageClassName: accessModes: - ReadWriteOnce resources: requests: storage: 1Gi `kubectl apply -f test_create_rediscl-huzdsq.yaml` cluster.apps.kubeblocks.io/rediscl-huzdsq created apply test_create_rediscl-huzdsq.yaml Success `rm -rf test_create_rediscl-huzdsq.yaml` check cluster status `kbcli cluster list rediscl-huzdsq --show-labels --namespace ns-xqred ` NAME NAMESPACE CLUSTER-DEFINITION VERSION TERMINATION-POLICY STATUS CREATED-TIME LABELS rediscl-huzdsq ns-xqred Halt Jun 19,2025 18:15 UTC+0800 cluster_status: cluster_status:Creating cluster_status:Creating cluster_status:Updating check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances rediscl-huzdsq --namespace ns-xqred ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME rediscl-huzdsq-shard-fwk-0 ns-xqred rediscl-huzdsq shard-fwk Running primary us-west-2a 100m / 100m 512Mi / 512Mi ip-172-31-2-115.us-west-2.compute.internal/172.31.2.115 Jun 19,2025 18:15 UTC+0800 rediscl-huzdsq-shard-fwk-1 ns-xqred rediscl-huzdsq shard-fwk Running secondary us-west-2a 100m / 100m 512Mi / 512Mi ip-172-31-10-241.us-west-2.compute.internal/172.31.10.241 Jun 19,2025 18:16 UTC+0800 rediscl-huzdsq-shard-tt9-0 ns-xqred rediscl-huzdsq shard-tt9 Running primary us-west-2a 100m / 100m 512Mi / 512Mi ip-172-31-6-202.us-west-2.compute.internal/172.31.6.202 Jun 19,2025 18:15 UTC+0800 rediscl-huzdsq-shard-tt9-1 ns-xqred rediscl-huzdsq shard-tt9 Running secondary us-west-2a 100m / 100m 512Mi / 512Mi ip-172-31-12-213.us-west-2.compute.internal/172.31.12.213 Jun 19,2025 18:16 UTC+0800 rediscl-huzdsq-shard-wvn-0 ns-xqred rediscl-huzdsq shard-wvn Running primary us-west-2a 100m / 100m 512Mi / 512Mi ip-172-31-13-158.us-west-2.compute.internal/172.31.13.158 Jun 19,2025 18:15 UTC+0800 rediscl-huzdsq-shard-wvn-1 ns-xqred rediscl-huzdsq shard-wvn Running secondary us-west-2a 100m / 100m 512Mi / 512Mi ip-172-31-13-158.us-west-2.compute.internal/172.31.13.158 Jun 19,2025 18:16 UTC+0800 check pod status done check cluster role check cluster role done primary: rediscl-huzdsq-shard-fwk-0 rediscl-huzdsq-shard-tt9-0 rediscl-huzdsq-shard-wvn-0;secondary: rediscl-huzdsq-shard-fwk-1 rediscl-huzdsq-shard-tt9-1 rediscl-huzdsq-shard-wvn-1 analyze cluster health check cluster connect `` ========== 节点: kb-post-provision-job-rediscl-huzdsq-shard-fwk-49fs9 ========== 无法识别分片编号，跳过该节点 ========== 节点: kb-post-provision-job-rediscl-huzdsq-shard-fwk-rt4wk ========== 无法识别分片编号，跳过该节点 ========== 节点: rediscl-huzdsq-shard-fwk-0 ========== 检测到基础名称: rediscl-huzdsq-shard-fwk, 分片编号: 0 使用 Secret: rediscl-huzdsq-shard-fwk-account-default 密码获取成功，前缀: Xm... 使用Pod环境变量中的Redis端口: 6379 --- 集群节点信息 --- 566610eaebef8ad78e4fa9a8957436093634de2c 172.31.12.213:31054@30545,rediscl-huzdsq-shard-tt9-1.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local slave 9a47e108282ae378589e88936924a2f36a944e1a 0 1750328241000 3 connected 6805dfae60f82469d32f167a0762f10b9fe532dc 172.31.2.115:30964@30479,rediscl-huzdsq-shard-fwk-0.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local myself,master - 0 1750328241000 1 connected 0-5460 fb7b00f6dbf1252875b2ec80a6473bb2900a6bc5 172.31.13.158:31917@32641,rediscl-huzdsq-shard-wvn-1.rediscl-huzdsq-shard-wvn-headless.ns-xqred.svc.cluster.local slave efb2cb384b2308639b0dd695e052beb099239f04 0 1750328242093 2 connected f1e5ba6810221fd9b7af42fc1ff2907eaed2b142 172.31.10.241:31209@30928,rediscl-huzdsq-shard-fwk-1.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local slave 6805dfae60f82469d32f167a0762f10b9fe532dc 0 1750328242093 1 connected 9a47e108282ae378589e88936924a2f36a944e1a 172.31.6.202:30626@31966,rediscl-huzdsq-shard-tt9-0.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local master - 0 1750328241591 3 connected 10923-16383 efb2cb384b2308639b0dd695e052beb099239f04 172.31.13.158:32444@31013,rediscl-huzdsq-shard-wvn-0.rediscl-huzdsq-shard-wvn-headless.ns-xqred.svc.cluster.local master - 0 1750328241088 2 connected 5461-10922 --- 集群状态信息 --- cluster_state:ok cluster_slots_assigned:16384 cluster_slots_ok:16384 cluster_slots_pfail:0 cluster_slots_fail:0 cluster_known_nodes:6 cluster_size:3 cluster_current_epoch:3 cluster_my_epoch:1 cluster_stats_messages_ping_sent:49 cluster_stats_messages_pong_sent:53 cluster_stats_messages_sent:102 cluster_stats_messages_ping_received:50 cluster_stats_messages_pong_received:49 cluster_stats_messages_meet_received:3 cluster_stats_messages_received:102 total_cluster_links_buffer_limit_exceeded:0 ========== 节点: rediscl-huzdsq-shard-fwk-1 ========== 检测到基础名称: rediscl-huzdsq-shard-fwk, 分片编号: 1 使用 Secret: rediscl-huzdsq-shard-fwk-account-default 密码获取成功，前缀: Xm... 使用Pod环境变量中的Redis端口: 6379 --- 集群节点信息 --- efb2cb384b2308639b0dd695e052beb099239f04 172.31.13.158:32444@31013,rediscl-huzdsq-shard-wvn-0.rediscl-huzdsq-shard-wvn-headless.ns-xqred.svc.cluster.local master - 0 1750328262515 2 connected 5461-10922 9a47e108282ae378589e88936924a2f36a944e1a 172.31.6.202:30626@31966,rediscl-huzdsq-shard-tt9-0.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local master - 0 1750328261000 3 connected 10923-16383 fb7b00f6dbf1252875b2ec80a6473bb2900a6bc5 172.31.13.158:31917@32641,rediscl-huzdsq-shard-wvn-1.rediscl-huzdsq-shard-wvn-headless.ns-xqred.svc.cluster.local slave efb2cb384b2308639b0dd695e052beb099239f04 0 1750328262515 2 connected f1e5ba6810221fd9b7af42fc1ff2907eaed2b142 172.31.10.241:31209@30928,rediscl-huzdsq-shard-fwk-1.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local myself,slave 6805dfae60f82469d32f167a0762f10b9fe532dc 0 1750328260000 1 connected 6805dfae60f82469d32f167a0762f10b9fe532dc 172.31.2.115:30964@30479,rediscl-huzdsq-shard-fwk-0.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local master - 0 1750328261502 1 connected 0-5460 566610eaebef8ad78e4fa9a8957436093634de2c 172.31.12.213:31054@30545,rediscl-huzdsq-shard-tt9-1.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local slave 9a47e108282ae378589e88936924a2f36a944e1a 0 1750328261000 3 connected --- 集群状态信息 --- cluster_state:ok cluster_slots_assigned:16384 cluster_slots_ok:16384 cluster_slots_pfail:0 cluster_slots_fail:0 cluster_known_nodes:6 cluster_size:3 cluster_current_epoch:3 cluster_my_epoch:1 cluster_stats_messages_ping_sent:77 cluster_stats_messages_pong_sent:89 cluster_stats_messages_meet_sent:1 cluster_stats_messages_sent:167 cluster_stats_messages_ping_received:89 cluster_stats_messages_pong_received:78 cluster_stats_messages_received:167 total_cluster_links_buffer_limit_exceeded:0 ========== 节点: rediscl-huzdsq-shard-tt9-0 ========== 检测到基础名称: rediscl-huzdsq-shard-tt9, 分片编号: 0 使用 Secret: rediscl-huzdsq-shard-tt9-account-default 密码获取成功，前缀: Xm... 使用Pod环境变量中的Redis端口: 6379 --- 集群节点信息 --- 566610eaebef8ad78e4fa9a8957436093634de2c 172.31.12.213:31054@30545,rediscl-huzdsq-shard-tt9-1.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local slave 9a47e108282ae378589e88936924a2f36a944e1a 0 1750328269155 3 connected efb2cb384b2308639b0dd695e052beb099239f04 172.31.13.158:32444@31013,rediscl-huzdsq-shard-wvn-0.rediscl-huzdsq-shard-wvn-headless.ns-xqred.svc.cluster.local master - 0 1750328267543 2 connected 5461-10922 fb7b00f6dbf1252875b2ec80a6473bb2900a6bc5 172.31.13.158:31917@32641,rediscl-huzdsq-shard-wvn-1.rediscl-huzdsq-shard-wvn-headless.ns-xqred.svc.cluster.local slave efb2cb384b2308639b0dd695e052beb099239f04 0 1750328267543 2 connected 9a47e108282ae378589e88936924a2f36a944e1a 172.31.6.202:30626@31966,rediscl-huzdsq-shard-tt9-0.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local myself,master - 0 1750328266000 3 connected 10923-16383 6805dfae60f82469d32f167a0762f10b9fe532dc 172.31.2.115:30964@30479,rediscl-huzdsq-shard-fwk-0.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local master - 0 1750328268149 1 connected 0-5460 f1e5ba6810221fd9b7af42fc1ff2907eaed2b142 172.31.10.241:31209@30928,rediscl-huzdsq-shard-fwk-1.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local slave 6805dfae60f82469d32f167a0762f10b9fe532dc 0 1750328268000 1 connected --- 集群状态信息 --- cluster_state:ok cluster_slots_assigned:16384 cluster_slots_ok:16384 cluster_slots_pfail:0 cluster_slots_fail:0 cluster_known_nodes:6 cluster_size:3 cluster_current_epoch:3 cluster_my_epoch:3 cluster_stats_messages_ping_sent:107 cluster_stats_messages_pong_sent:97 cluster_stats_messages_meet_sent:1 cluster_stats_messages_sent:205 cluster_stats_messages_ping_received:96 cluster_stats_messages_pong_received:108 cluster_stats_messages_meet_received:1 cluster_stats_messages_received:205 total_cluster_links_buffer_limit_exceeded:0 ========== 节点: rediscl-huzdsq-shard-tt9-1 ========== 检测到基础名称: rediscl-huzdsq-shard-tt9, 分片编号: 1 使用 Secret: rediscl-huzdsq-shard-tt9-account-default 密码获取成功，前缀: Xm... 使用Pod环境变量中的Redis端口: 6379 --- 集群节点信息 --- f1e5ba6810221fd9b7af42fc1ff2907eaed2b142 172.31.10.241:31209@30928,rediscl-huzdsq-shard-fwk-1.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local slave 6805dfae60f82469d32f167a0762f10b9fe532dc 0 1750328275219 1 connected efb2cb384b2308639b0dd695e052beb099239f04 172.31.13.158:32444@31013,rediscl-huzdsq-shard-wvn-0.rediscl-huzdsq-shard-wvn-headless.ns-xqred.svc.cluster.local master - 0 1750328274000 2 connected 5461-10922 6805dfae60f82469d32f167a0762f10b9fe532dc 172.31.2.115:30964@30479,rediscl-huzdsq-shard-fwk-0.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local master - 0 1750328275718 1 connected 0-5460 fb7b00f6dbf1252875b2ec80a6473bb2900a6bc5 172.31.13.158:31917@32641,rediscl-huzdsq-shard-wvn-1.rediscl-huzdsq-shard-wvn-headless.ns-xqred.svc.cluster.local slave efb2cb384b2308639b0dd695e052beb099239f04 0 1750328273706 2 connected 566610eaebef8ad78e4fa9a8957436093634de2c 172.31.12.213:31054@30545,rediscl-huzdsq-shard-tt9-1.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local myself,slave 9a47e108282ae378589e88936924a2f36a944e1a 0 1750328274000 3 connected 9a47e108282ae378589e88936924a2f36a944e1a 172.31.6.202:30626@31966,rediscl-huzdsq-shard-tt9-0.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local master - 0 1750328274213 3 connected 10923-16383 --- 集群状态信息 --- cluster_state:ok cluster_slots_assigned:16384 cluster_slots_ok:16384 cluster_slots_pfail:0 cluster_slots_fail:0 cluster_known_nodes:6 cluster_size:3 cluster_current_epoch:3 cluster_my_epoch:3 cluster_stats_messages_ping_sent:94 cluster_stats_messages_pong_sent:100 cluster_stats_messages_meet_sent:1 cluster_stats_messages_sent:195 cluster_stats_messages_ping_received:100 cluster_stats_messages_pong_received:95 cluster_stats_messages_received:195 total_cluster_links_buffer_limit_exceeded:0 ========== 节点: rediscl-huzdsq-shard-wvn-0 ========== 检测到基础名称: rediscl-huzdsq-shard-wvn, 分片编号: 0 使用 Secret: rediscl-huzdsq-shard-wvn-account-default 密码获取成功，前缀: Xm... 使用Pod环境变量中的Redis端口: 6379 --- 集群节点信息 --- 566610eaebef8ad78e4fa9a8957436093634de2c 172.31.12.213:31054@30545,rediscl-huzdsq-shard-tt9-1.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local slave 9a47e108282ae378589e88936924a2f36a944e1a 0 1750328282596 3 connected 6805dfae60f82469d32f167a0762f10b9fe532dc 172.31.2.115:30964@30479,rediscl-huzdsq-shard-fwk-0.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local master - 0 1750328282000 1 connected 0-5460 9a47e108282ae378589e88936924a2f36a944e1a 172.31.6.202:30626@31966,rediscl-huzdsq-shard-tt9-0.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local master - 0 1750328281391 3 connected 10923-16383 f1e5ba6810221fd9b7af42fc1ff2907eaed2b142 172.31.10.241:31209@30928,rediscl-huzdsq-shard-fwk-1.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local slave 6805dfae60f82469d32f167a0762f10b9fe532dc 0 1750328282395 1 connected fb7b00f6dbf1252875b2ec80a6473bb2900a6bc5 172.31.13.158:31917@32641,rediscl-huzdsq-shard-wvn-1.rediscl-huzdsq-shard-wvn-headless.ns-xqred.svc.cluster.local slave efb2cb384b2308639b0dd695e052beb099239f04 0 1750328282596 2 connected efb2cb384b2308639b0dd695e052beb099239f04 172.31.13.158:32444@31013,rediscl-huzdsq-shard-wvn-0.rediscl-huzdsq-shard-wvn-headless.ns-xqred.svc.cluster.local myself,master - 0 1750328281000 2 connected 5461-10922 --- 集群状态信息 --- cluster_state:ok cluster_slots_assigned:16384 cluster_slots_ok:16384 cluster_slots_pfail:0 cluster_slots_fail:0 cluster_known_nodes:6 cluster_size:3 cluster_current_epoch:3 cluster_my_epoch:2 cluster_stats_messages_ping_sent:122 cluster_stats_messages_pong_sent:125 cluster_stats_messages_meet_sent:1 cluster_stats_messages_sent:248 cluster_stats_messages_ping_received:124 cluster_stats_messages_pong_received:123 cluster_stats_messages_meet_received:1 cluster_stats_messages_received:248 total_cluster_links_buffer_limit_exceeded:0 ========== 节点: rediscl-huzdsq-shard-wvn-1 ========== 检测到基础名称: rediscl-huzdsq-shard-wvn, 分片编号: 1 使用 Secret: rediscl-huzdsq-shard-wvn-account-default 密码获取成功，前缀: Xm... 使用Pod环境变量中的Redis端口: 6379 --- 集群节点信息 --- 566610eaebef8ad78e4fa9a8957436093634de2c 172.31.12.213:31054@30545,rediscl-huzdsq-shard-tt9-1.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local slave 9a47e108282ae378589e88936924a2f36a944e1a 0 1750328288281 3 connected f1e5ba6810221fd9b7af42fc1ff2907eaed2b142 172.31.10.241:31209@30928,rediscl-huzdsq-shard-fwk-1.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local slave 6805dfae60f82469d32f167a0762f10b9fe532dc 0 1750328287000 1 connected efb2cb384b2308639b0dd695e052beb099239f04 172.31.13.158:32444@31013,rediscl-huzdsq-shard-wvn-0.rediscl-huzdsq-shard-wvn-headless.ns-xqred.svc.cluster.local master - 0 1750328287277 2 connected 5461-10922 fb7b00f6dbf1252875b2ec80a6473bb2900a6bc5 172.31.13.158:31917@32641,rediscl-huzdsq-shard-wvn-1.rediscl-huzdsq-shard-wvn-headless.ns-xqred.svc.cluster.local myself,slave efb2cb384b2308639b0dd695e052beb099239f04 0 1750328287000 2 connected 9a47e108282ae378589e88936924a2f36a944e1a 172.31.6.202:30626@31966,rediscl-huzdsq-shard-tt9-0.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local master - 0 1750328289286 3 connected 10923-16383 6805dfae60f82469d32f167a0762f10b9fe532dc 172.31.2.115:30964@30479,rediscl-huzdsq-shard-fwk-0.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local master - 0 1750328288583 1 connected 0-5460 --- 集群状态信息 --- cluster_state:ok cluster_slots_assigned:16384 cluster_slots_ok:16384 cluster_slots_pfail:0 cluster_slots_fail:0 cluster_known_nodes:6 cluster_size:3 cluster_current_epoch:3 cluster_my_epoch:2 cluster_stats_messages_ping_sent:133 cluster_stats_messages_pong_sent:123 cluster_stats_messages_meet_sent:1 cluster_stats_messages_sent:257 cluster_stats_messages_ping_received:123 cluster_stats_messages_pong_received:134 cluster_stats_messages_received:257 total_cluster_links_buffer_limit_exceeded:0 ========== 集群健康分析 ========== 使用节点 rediscl-huzdsq-shard-fwk-0 作为参考基准 检测到以下分片标识符: - fwk - tt9 - wvn 参考节点观察到的拓扑结构: ID IP地址 状态 主节点ID 槽位 ---------------------------------------- ------------- ---------------- ---------------------------------------- -------------- 566610eaebef8ad78e4fa9a8957436093634de2c 172.31.12.213:31054 从节点 9a47e108282ae378589e88936924a2f36a944e1a 6805dfae60f82469d32f167a0762f10b9fe532dc 172.31.2.115:30964 主节点 - 0-5460 (共 0 个槽位) fb7b00f6dbf1252875b2ec80a6473bb2900a6bc5 172.31.13.158:31917 从节点 efb2cb384b2308639b0dd695e052beb099239f04 f1e5ba6810221fd9b7af42fc1ff2907eaed2b142 172.31.10.241:31209 从节点 6805dfae60f82469d32f167a0762f10b9fe532dc 9a47e108282ae378589e88936924a2f36a944e1a 172.31.6.202:30626 主节点 - 10923-16383 (共 0 个槽位) efb2cb384b2308639b0dd695e052beb099239f04 172.31.13.158:32444 主节点 - 5461-10922 (共 0 个槽位) 正在分析节点 rediscl-huzdsq-shard-fwk-1 的拓扑视图... 正在分析节点 rediscl-huzdsq-shard-tt9-0 的拓扑视图... 正在分析节点 rediscl-huzdsq-shard-tt9-1 的拓扑视图... 正在分析节点 rediscl-huzdsq-shard-wvn-0 的拓扑视图... 正在分析节点 rediscl-huzdsq-shard-wvn-1 的拓扑视图... 槽位分配统计: - 总槽位数: 16384 - 未覆盖槽位数: 0 - 重复覆盖槽位数: 0 - 正确覆盖槽位数: 16384 主节点槽位分配明细: 节点 6805dfae60f82469d32f167a0762f10b9fe532dc (172.31.2.115:30964) 负责 0 个槽位: 0-5460 节点 9a47e108282ae378589e88936924a2f36a944e1a (172.31.6.202:30626) 负责 0 个槽位: 10923-16383 节点 efb2cb384b2308639b0dd695e052beb099239f04 (172.31.13.158:32444) 负责 0 个槽位: 5461-10922 总计分配槽位: 0 / 16384 警告: 分配的总槽位数 (0) 不等于 16384 缺少 16384 个槽位分配 分片分析: 分片 fwk: 1 个主节点, 1 个从节点 ✅ 分片 tt9: 1 个主节点, 1 个从节点 ✅ 分片 wvn: 1 个主节点, 1 个从节点 ✅ 集群分析总结: - 检测到 3 个主节点和 3 个从节点 - 检测到 0 个故障或疑似故障节点 - 集群状态统一显示为OK: 是 - 所有槽位正确分配: 是 - 所有节点看到一致的集群大小: 是 - 所有节点看到一致的拓扑结构: 是 - 所有槽位被正确覆盖: 是 - 集群中无故障或疑似故障节点: 是 集群健康状态: 健康 ✅ 所有检查均通过，Redis集群运行正常。 analyze cluster health success `kubectl get secrets -l app.kubernetes.io/instance=rediscl-huzdsq` set secret: rediscl-huzdsq-shard-wvn-account-default `kubectl get secrets rediscl-huzdsq-shard-wvn-account-default -o jsonpath="***.data.username***"` `kubectl get secrets rediscl-huzdsq-shard-wvn-account-default -o jsonpath="***.data.password***"` `kubectl get secrets rediscl-huzdsq-shard-wvn-account-default -o jsonpath="***.data.port***"` DB_USERNAME:default;DB_PASSWORD:Xm507FZu07;DB_PORT:6379;DB_DATABASE: check pod rediscl-huzdsq-shard-fwk-0 container_name redis-cluster exist password Xm507FZu07 check pod rediscl-huzdsq-shard-fwk-0 container_name metrics exist password Xm507FZu07 check pod rediscl-huzdsq-shard-fwk-0 container_name lorry exist password Xm507FZu07 No container logs contain secret password. describe cluster `kbcli cluster describe rediscl-huzdsq --namespace ns-xqred ` Name: rediscl-huzdsq Created Time: Jun 19,2025 18:15 UTC+0800 NAMESPACE CLUSTER-DEFINITION VERSION STATUS TERMINATION-POLICY ns-xqred Running Halt Endpoints: COMPONENT MODE INTERNAL EXTERNAL Topology: COMPONENT INSTANCE ROLE STATUS AZ NODE CREATED-TIME shard-fwk rediscl-huzdsq-shard-fwk-0 primary Running us-west-2a ip-172-31-2-115.us-west-2.compute.internal/172.31.2.115 Jun 19,2025 18:15 UTC+0800 shard-fwk rediscl-huzdsq-shard-fwk-1 secondary Running us-west-2a ip-172-31-10-241.us-west-2.compute.internal/172.31.10.241 Jun 19,2025 18:16 UTC+0800 shard-tt9 rediscl-huzdsq-shard-tt9-0 primary Running us-west-2a ip-172-31-6-202.us-west-2.compute.internal/172.31.6.202 Jun 19,2025 18:15 UTC+0800 shard-tt9 rediscl-huzdsq-shard-tt9-1 secondary Running us-west-2a ip-172-31-12-213.us-west-2.compute.internal/172.31.12.213 Jun 19,2025 18:16 UTC+0800 shard-wvn rediscl-huzdsq-shard-wvn-0 primary Running us-west-2a ip-172-31-13-158.us-west-2.compute.internal/172.31.13.158 Jun 19,2025 18:15 UTC+0800 shard-wvn rediscl-huzdsq-shard-wvn-1 secondary Running us-west-2a ip-172-31-13-158.us-west-2.compute.internal/172.31.13.158 Jun 19,2025 18:16 UTC+0800 Resources Allocation: COMPONENT DEDICATED CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE-SIZE STORAGE-CLASS Images: COMPONENT TYPE IMAGE Data Protection: BACKUP-REPO AUTO-BACKUP BACKUP-SCHEDULE BACKUP-METHOD BACKUP-RETENTION RECOVERABLE-TIME Show cluster events: kbcli cluster list-events -n ns-xqred rediscl-huzdsq get shard component name set shard component name:shard-fwk `kbcli cluster label rediscl-huzdsq app.kubernetes.io/instance- --namespace ns-xqred ` label "app.kubernetes.io/instance" not found. `kbcli cluster label rediscl-huzdsq app.kubernetes.io/instance=rediscl-huzdsq --namespace ns-xqred ` `kbcli cluster label rediscl-huzdsq --list --namespace ns-xqred ` NAME NAMESPACE LABELS rediscl-huzdsq ns-xqred app.kubernetes.io/instance=rediscl-huzdsq label cluster app.kubernetes.io/instance=rediscl-huzdsq Success `kbcli cluster label case.name=kbcli.test1 -l app.kubernetes.io/instance=rediscl-huzdsq --namespace ns-xqred ` `kbcli cluster label rediscl-huzdsq --list --namespace ns-xqred ` NAME NAMESPACE LABELS rediscl-huzdsq ns-xqred app.kubernetes.io/instance=rediscl-huzdsq case.name=kbcli.test1 label cluster case.name=kbcli.test1 Success `kbcli cluster label rediscl-huzdsq case.name=kbcli.test2 --overwrite --namespace ns-xqred ` `kbcli cluster label rediscl-huzdsq --list --namespace ns-xqred ` NAME NAMESPACE LABELS rediscl-huzdsq ns-xqred app.kubernetes.io/instance=rediscl-huzdsq case.name=kbcli.test2 label cluster case.name=kbcli.test2 Success `kbcli cluster label rediscl-huzdsq case.name- --namespace ns-xqred ` `kbcli cluster label rediscl-huzdsq --list --namespace ns-xqred ` NAME NAMESPACE LABELS rediscl-huzdsq ns-xqred app.kubernetes.io/instance=rediscl-huzdsq delete cluster label case.name Success cluster connect kbcli unsupported engine type: shard-fwk cluster restart check cluster status before ops check cluster status done cluster_status:Running `kbcli cluster restart rediscl-huzdsq --auto-approve --force=true --namespace ns-xqred ` OpsRequest rediscl-huzdsq-restart-jwcrh created successfully, you can view the progress: kbcli cluster describe-ops rediscl-huzdsq-restart-jwcrh -n ns-xqred check ops status `kbcli cluster list-ops rediscl-huzdsq --status all --namespace ns-xqred ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME rediscl-huzdsq-restart-jwcrh ns-xqred Restart rediscl-huzdsq shard Running 0/6 Jun 19,2025 18:19 UTC+0800 check cluster status `kbcli cluster list rediscl-huzdsq --show-labels --namespace ns-xqred ` NAME NAMESPACE CLUSTER-DEFINITION VERSION TERMINATION-POLICY STATUS CREATED-TIME LABELS rediscl-huzdsq ns-xqred Halt Updating Jun 19,2025 18:15 UTC+0800 app.kubernetes.io/instance=rediscl-huzdsq cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances rediscl-huzdsq --namespace ns-xqred ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME rediscl-huzdsq-shard-fwk-0 ns-xqred rediscl-huzdsq shard-fwk Running primary us-west-2a 100m / 100m 512Mi / 512Mi ip-172-31-2-115.us-west-2.compute.internal/172.31.2.115 Jun 19,2025 18:20 UTC+0800 rediscl-huzdsq-shard-fwk-1 ns-xqred rediscl-huzdsq shard-fwk Running secondary us-west-2a 100m / 100m 512Mi / 512Mi ip-172-31-13-158.us-west-2.compute.internal/172.31.13.158 Jun 19,2025 18:19 UTC+0800 rediscl-huzdsq-shard-tt9-0 ns-xqred rediscl-huzdsq shard-tt9 Running primary us-west-2a 100m / 100m 512Mi / 512Mi ip-172-31-12-213.us-west-2.compute.internal/172.31.12.213 Jun 19,2025 18:20 UTC+0800 rediscl-huzdsq-shard-tt9-1 ns-xqred rediscl-huzdsq shard-tt9 Running secondary us-west-2a 100m / 100m 512Mi / 512Mi ip-172-31-12-213.us-west-2.compute.internal/172.31.12.213 Jun 19,2025 18:19 UTC+0800 rediscl-huzdsq-shard-wvn-0 ns-xqred rediscl-huzdsq shard-wvn Running primary us-west-2a 100m / 100m 512Mi / 512Mi ip-172-31-2-115.us-west-2.compute.internal/172.31.2.115 Jun 19,2025 18:20 UTC+0800 rediscl-huzdsq-shard-wvn-1 ns-xqred rediscl-huzdsq shard-wvn Running secondary us-west-2a 100m / 100m 512Mi / 512Mi ip-172-31-13-158.us-west-2.compute.internal/172.31.13.158 Jun 19,2025 18:19 UTC+0800 check pod status done check cluster role check cluster role done primary: rediscl-huzdsq-shard-fwk-0 rediscl-huzdsq-shard-tt9-0 rediscl-huzdsq-shard-wvn-0;secondary: rediscl-huzdsq-shard-fwk-1 rediscl-huzdsq-shard-tt9-1 rediscl-huzdsq-shard-wvn-1 analyze cluster health check cluster connect `` ========== 节点: rediscl-huzdsq-shard-fwk-0 ========== 检测到基础名称: rediscl-huzdsq-shard-fwk, 分片编号: 0 使用 Secret: rediscl-huzdsq-shard-fwk-account-default 密码获取成功，前缀: Xm... 使用Pod环境变量中的Redis端口: 6379 --- 集群节点信息 --- f1e5ba6810221fd9b7af42fc1ff2907eaed2b142 172.31.13.158:31209@30928,rediscl-huzdsq-shard-fwk-1.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local slave 6805dfae60f82469d32f167a0762f10b9fe532dc 0 1750328453504 1 connected fb7b00f6dbf1252875b2ec80a6473bb2900a6bc5 172.31.13.158:31917@32641,rediscl-huzdsq-shard-wvn-1.rediscl-huzdsq-shard-wvn-headless.ns-xqred.svc.cluster.local slave efb2cb384b2308639b0dd695e052beb099239f04 0 1750328453605 2 connected 6805dfae60f82469d32f167a0762f10b9fe532dc 172.31.2.115:30964@30479,rediscl-huzdsq-shard-fwk-0.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local myself,master - 0 1750328452000 1 connected 0-5460 9a47e108282ae378589e88936924a2f36a944e1a 172.31.12.213:30626@31966,rediscl-huzdsq-shard-tt9-0.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local master - 0 1750328454610 3 connected 10923-16383 efb2cb384b2308639b0dd695e052beb099239f04 172.31.2.115:32444@31013,rediscl-huzdsq-shard-wvn-0.rediscl-huzdsq-shard-wvn-headless.ns-xqred.svc.cluster.local master - 0 1750328454509 2 connected 5461-10922 566610eaebef8ad78e4fa9a8957436093634de2c 172.31.12.213:31054@30545,rediscl-huzdsq-shard-tt9-1.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local slave 9a47e108282ae378589e88936924a2f36a944e1a 0 1750328453504 3 connected --- 集群状态信息 --- cluster_state:ok cluster_slots_assigned:16384 cluster_slots_ok:16384 cluster_slots_pfail:0 cluster_slots_fail:0 cluster_known_nodes:6 cluster_size:3 cluster_current_epoch:4 cluster_my_epoch:1 cluster_stats_messages_ping_sent:61 cluster_stats_messages_pong_sent:49 cluster_stats_messages_meet_sent:2 cluster_stats_messages_fail_sent:4 cluster_stats_messages_sent:116 cluster_stats_messages_ping_received:47 cluster_stats_messages_pong_received:63 cluster_stats_messages_meet_received:2 cluster_stats_messages_received:112 total_cluster_links_buffer_limit_exceeded:0 ========== 节点: rediscl-huzdsq-shard-fwk-1 ========== 检测到基础名称: rediscl-huzdsq-shard-fwk, 分片编号: 1 使用 Secret: rediscl-huzdsq-shard-fwk-account-default 密码获取成功，前缀: Xm... 使用Pod环境变量中的Redis端口: 6379 --- 集群节点信息 --- efb2cb384b2308639b0dd695e052beb099239f04 172.31.2.115:32444@31013,rediscl-huzdsq-shard-wvn-0.rediscl-huzdsq-shard-wvn-headless.ns-xqred.svc.cluster.local master - 0 1750328460000 2 connected 5461-10922 f1e5ba6810221fd9b7af42fc1ff2907eaed2b142 172.31.13.158:31209@30928,rediscl-huzdsq-shard-fwk-1.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local myself,slave 6805dfae60f82469d32f167a0762f10b9fe532dc 0 1750328460000 1 connected 6805dfae60f82469d32f167a0762f10b9fe532dc 172.31.2.115:30964@30479,rediscl-huzdsq-shard-fwk-0.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local master - 0 1750328459296 1 connected 0-5460 566610eaebef8ad78e4fa9a8957436093634de2c 172.31.12.213:31054@30545,rediscl-huzdsq-shard-tt9-1.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local slave 9a47e108282ae378589e88936924a2f36a944e1a 0 1750328460000 3 connected fb7b00f6dbf1252875b2ec80a6473bb2900a6bc5 172.31.13.158:31917@32641,rediscl-huzdsq-shard-wvn-1.rediscl-huzdsq-shard-wvn-headless.ns-xqred.svc.cluster.local slave efb2cb384b2308639b0dd695e052beb099239f04 0 1750328460301 2 connected 9a47e108282ae378589e88936924a2f36a944e1a 172.31.12.213:30626@31966,rediscl-huzdsq-shard-tt9-0.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local master - 0 1750328460502 3 connected 10923-16383 --- 集群状态信息 --- cluster_state:ok cluster_slots_assigned:16384 cluster_slots_ok:16384 cluster_slots_pfail:0 cluster_slots_fail:0 cluster_known_nodes:6 cluster_size:3 cluster_current_epoch:4 cluster_my_epoch:1 cluster_stats_messages_ping_sent:104 cluster_stats_messages_pong_sent:94 cluster_stats_messages_meet_sent:1 cluster_stats_messages_sent:199 cluster_stats_messages_ping_received:94 cluster_stats_messages_pong_received:101 cluster_stats_messages_fail_received:3 cluster_stats_messages_auth-req_received:1 cluster_stats_messages_received:199 total_cluster_links_buffer_limit_exceeded:0 ========== 节点: rediscl-huzdsq-shard-tt9-0 ========== 检测到基础名称: rediscl-huzdsq-shard-tt9, 分片编号: 0 使用 Secret: rediscl-huzdsq-shard-tt9-account-default 密码获取成功，前缀: Xm... 使用Pod环境变量中的Redis端口: 6379 --- 集群节点信息 --- 566610eaebef8ad78e4fa9a8957436093634de2c 172.31.12.213:31054@30545,rediscl-huzdsq-shard-tt9-1.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local slave 9a47e108282ae378589e88936924a2f36a944e1a 0 1750328468053 3 connected 9a47e108282ae378589e88936924a2f36a944e1a 172.31.12.213:30626@31966,rediscl-huzdsq-shard-tt9-0.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local myself,master - 0 1750328466000 3 connected 10923-16383 f1e5ba6810221fd9b7af42fc1ff2907eaed2b142 172.31.13.158:31209@30928,rediscl-huzdsq-shard-fwk-1.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local slave 6805dfae60f82469d32f167a0762f10b9fe532dc 0 1750328467000 1 connected fb7b00f6dbf1252875b2ec80a6473bb2900a6bc5 172.31.13.158:31917@32641,rediscl-huzdsq-shard-wvn-1.rediscl-huzdsq-shard-wvn-headless.ns-xqred.svc.cluster.local slave efb2cb384b2308639b0dd695e052beb099239f04 0 1750328467575 2 connected efb2cb384b2308639b0dd695e052beb099239f04 172.31.2.115:32444@31013,rediscl-huzdsq-shard-wvn-0.rediscl-huzdsq-shard-wvn-headless.ns-xqred.svc.cluster.local master - 0 1750328467575 2 connected 5461-10922 6805dfae60f82469d32f167a0762f10b9fe532dc 172.31.2.115:30964@30479,rediscl-huzdsq-shard-fwk-0.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local master - 0 1750328466973 1 connected 0-5460 --- 集群状态信息 --- cluster_state:ok cluster_slots_assigned:16384 cluster_slots_ok:16384 cluster_slots_pfail:0 cluster_slots_fail:0 cluster_known_nodes:6 cluster_size:3 cluster_current_epoch:4 cluster_my_epoch:3 cluster_stats_messages_ping_sent:80 cluster_stats_messages_pong_sent:63 cluster_stats_messages_meet_sent:2 cluster_stats_messages_sent:145 cluster_stats_messages_ping_received:61 cluster_stats_messages_pong_received:80 cluster_stats_messages_meet_received:2 cluster_stats_messages_received:143 total_cluster_links_buffer_limit_exceeded:0 ========== 节点: rediscl-huzdsq-shard-tt9-1 ========== 检测到基础名称: rediscl-huzdsq-shard-tt9, 分片编号: 1 使用 Secret: rediscl-huzdsq-shard-tt9-account-default 密码获取成功，前缀: Xm... 使用Pod环境变量中的Redis端口: 6379 --- 集群节点信息 --- 6805dfae60f82469d32f167a0762f10b9fe532dc 172.31.2.115:30964@30479,rediscl-huzdsq-shard-fwk-0.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local master - 0 1750328474000 1 connected 0-5460 fb7b00f6dbf1252875b2ec80a6473bb2900a6bc5 172.31.13.158:31917@32641,rediscl-huzdsq-shard-wvn-1.rediscl-huzdsq-shard-wvn-headless.ns-xqred.svc.cluster.local slave efb2cb384b2308639b0dd695e052beb099239f04 0 1750328474504 2 connected f1e5ba6810221fd9b7af42fc1ff2907eaed2b142 172.31.13.158:31209@30928,rediscl-huzdsq-shard-fwk-1.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local slave 6805dfae60f82469d32f167a0762f10b9fe532dc 0 1750328474102 1 connected 566610eaebef8ad78e4fa9a8957436093634de2c 172.31.12.213:31054@30545,rediscl-huzdsq-shard-tt9-1.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local myself,slave 9a47e108282ae378589e88936924a2f36a944e1a 0 1750328473000 3 connected efb2cb384b2308639b0dd695e052beb099239f04 172.31.2.115:32444@31013,rediscl-huzdsq-shard-wvn-0.rediscl-huzdsq-shard-wvn-headless.ns-xqred.svc.cluster.local master - 0 1750328474605 2 connected 5461-10922 9a47e108282ae378589e88936924a2f36a944e1a 172.31.12.213:30626@31966,rediscl-huzdsq-shard-tt9-0.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local master - 0 1750328473599 3 connected 10923-16383 --- 集群状态信息 --- cluster_state:ok cluster_slots_assigned:16384 cluster_slots_ok:16384 cluster_slots_pfail:0 cluster_slots_fail:0 cluster_known_nodes:6 cluster_size:3 cluster_current_epoch:4 cluster_my_epoch:3 cluster_stats_messages_ping_sent:126 cluster_stats_messages_pong_sent:133 cluster_stats_messages_meet_sent:1 cluster_stats_messages_fail_sent:10 cluster_stats_messages_auth-req_sent:5 cluster_stats_messages_sent:275 cluster_stats_messages_ping_received:133 cluster_stats_messages_pong_received:122 cluster_stats_messages_fail_received:3 cluster_stats_messages_received:258 total_cluster_links_buffer_limit_exceeded:0 ========== 节点: rediscl-huzdsq-shard-wvn-0 ========== 检测到基础名称: rediscl-huzdsq-shard-wvn, 分片编号: 0 使用 Secret: rediscl-huzdsq-shard-wvn-account-default 密码获取成功，前缀: Xm... 使用Pod环境变量中的Redis端口: 6379 --- 集群节点信息 --- 566610eaebef8ad78e4fa9a8957436093634de2c 172.31.12.213:31054@30545,rediscl-huzdsq-shard-tt9-1.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local slave 9a47e108282ae378589e88936924a2f36a944e1a 0 1750328480735 3 connected f1e5ba6810221fd9b7af42fc1ff2907eaed2b142 172.31.13.158:31209@30928,rediscl-huzdsq-shard-fwk-1.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local slave 6805dfae60f82469d32f167a0762f10b9fe532dc 0 1750328481000 1 connected 6805dfae60f82469d32f167a0762f10b9fe532dc 172.31.2.115:30964@30479,rediscl-huzdsq-shard-fwk-0.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local master - 0 1750328480000 1 connected 0-5460 9a47e108282ae378589e88936924a2f36a944e1a 172.31.12.213:30626@31966,rediscl-huzdsq-shard-tt9-0.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local master - 0 1750328480000 3 connected 10923-16383 efb2cb384b2308639b0dd695e052beb099239f04 172.31.2.115:32444@31013,rediscl-huzdsq-shard-wvn-0.rediscl-huzdsq-shard-wvn-headless.ns-xqred.svc.cluster.local myself,master - 0 1750328480000 2 connected 5461-10922 fb7b00f6dbf1252875b2ec80a6473bb2900a6bc5 172.31.13.158:31917@32641,rediscl-huzdsq-shard-wvn-1.rediscl-huzdsq-shard-wvn-headless.ns-xqred.svc.cluster.local slave efb2cb384b2308639b0dd695e052beb099239f04 0 1750328480032 2 connected --- 集群状态信息 --- cluster_state:ok cluster_slots_assigned:16384 cluster_slots_ok:16384 cluster_slots_pfail:0 cluster_slots_fail:0 cluster_known_nodes:6 cluster_size:3 cluster_current_epoch:4 cluster_my_epoch:2 cluster_stats_messages_ping_sent:112 cluster_stats_messages_pong_sent:100 cluster_stats_messages_meet_sent:2 cluster_stats_messages_fail_sent:5 cluster_stats_messages_sent:219 cluster_stats_messages_ping_received:98 cluster_stats_messages_pong_received:113 cluster_stats_messages_meet_received:2 cluster_stats_messages_fail_received:1 cluster_stats_messages_received:214 total_cluster_links_buffer_limit_exceeded:0 ========== 节点: rediscl-huzdsq-shard-wvn-1 ========== 检测到基础名称: rediscl-huzdsq-shard-wvn, 分片编号: 1 使用 Secret: rediscl-huzdsq-shard-wvn-account-default 密码获取成功，前缀: Xm... 使用Pod环境变量中的Redis端口: 6379 --- 集群节点信息 --- f1e5ba6810221fd9b7af42fc1ff2907eaed2b142 172.31.13.158:31209@30928,rediscl-huzdsq-shard-fwk-1.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local slave 6805dfae60f82469d32f167a0762f10b9fe532dc 0 1750328487000 1 connected 566610eaebef8ad78e4fa9a8957436093634de2c 172.31.12.213:31054@30545,rediscl-huzdsq-shard-tt9-1.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local slave 9a47e108282ae378589e88936924a2f36a944e1a 0 1750328487547 3 connected fb7b00f6dbf1252875b2ec80a6473bb2900a6bc5 172.31.13.158:31917@32641,rediscl-huzdsq-shard-wvn-1.rediscl-huzdsq-shard-wvn-headless.ns-xqred.svc.cluster.local myself,slave efb2cb384b2308639b0dd695e052beb099239f04 0 1750328487000 2 connected 9a47e108282ae378589e88936924a2f36a944e1a 172.31.12.213:30626@31966,rediscl-huzdsq-shard-tt9-0.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local master - 0 1750328487000 3 connected 10923-16383 6805dfae60f82469d32f167a0762f10b9fe532dc 172.31.2.115:30964@30479,rediscl-huzdsq-shard-fwk-0.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local master - 0 1750328488350 1 connected 0-5460 efb2cb384b2308639b0dd695e052beb099239f04 172.31.2.115:32444@31013,rediscl-huzdsq-shard-wvn-0.rediscl-huzdsq-shard-wvn-headless.ns-xqred.svc.cluster.local master - 0 1750328487346 2 connected 5461-10922 --- 集群状态信息 --- cluster_state:ok cluster_slots_assigned:16384 cluster_slots_ok:16384 cluster_slots_pfail:0 cluster_slots_fail:0 cluster_known_nodes:6 cluster_size:3 cluster_current_epoch:4 cluster_my_epoch:2 cluster_stats_messages_ping_sent:157 cluster_stats_messages_pong_sent:151 cluster_stats_messages_meet_sent:1 cluster_stats_messages_fail_sent:10 cluster_stats_messages_sent:319 cluster_stats_messages_ping_received:151 cluster_stats_messages_pong_received:153 cluster_stats_messages_fail_received:2 cluster_stats_messages_auth-req_received:1 cluster_stats_messages_received:307 total_cluster_links_buffer_limit_exceeded:0 ========== 集群健康分析 ========== 使用节点 rediscl-huzdsq-shard-fwk-0 作为参考基准 检测到以下分片标识符: - fwk - tt9 - wvn 参考节点观察到的拓扑结构: ID IP地址 状态 主节点ID 槽位 ---------------------------------------- ------------- ---------------- ---------------------------------------- -------------- f1e5ba6810221fd9b7af42fc1ff2907eaed2b142 172.31.13.158:31209 从节点 6805dfae60f82469d32f167a0762f10b9fe532dc fb7b00f6dbf1252875b2ec80a6473bb2900a6bc5 172.31.13.158:31917 从节点 efb2cb384b2308639b0dd695e052beb099239f04 6805dfae60f82469d32f167a0762f10b9fe532dc 172.31.2.115:30964 主节点 - 0-5460 (共 0 个槽位) 9a47e108282ae378589e88936924a2f36a944e1a 172.31.12.213:30626 主节点 - 10923-16383 (共 0 个槽位) efb2cb384b2308639b0dd695e052beb099239f04 172.31.2.115:32444 主节点 - 5461-10922 (共 0 个槽位) 566610eaebef8ad78e4fa9a8957436093634de2c 172.31.12.213:31054 从节点 9a47e108282ae378589e88936924a2f36a944e1a 正在分析节点 rediscl-huzdsq-shard-fwk-1 的拓扑视图... 正在分析节点 rediscl-huzdsq-shard-tt9-0 的拓扑视图... 正在分析节点 rediscl-huzdsq-shard-tt9-1 的拓扑视图... 正在分析节点 rediscl-huzdsq-shard-wvn-0 的拓扑视图... 正在分析节点 rediscl-huzdsq-shard-wvn-1 的拓扑视图... 槽位分配统计: - 总槽位数: 16384 - 未覆盖槽位数: 0 - 重复覆盖槽位数: 0 - 正确覆盖槽位数: 16384 主节点槽位分配明细: 节点 6805dfae60f82469d32f167a0762f10b9fe532dc (172.31.2.115:30964) 负责 0 个槽位: 0-5460 节点 9a47e108282ae378589e88936924a2f36a944e1a (172.31.12.213:30626) 负责 0 个槽位: 10923-16383 节点 efb2cb384b2308639b0dd695e052beb099239f04 (172.31.2.115:32444) 负责 0 个槽位: 5461-10922 总计分配槽位: 0 / 16384 警告: 分配的总槽位数 (0) 不等于 16384 缺少 16384 个槽位分配 分片分析: 分片 fwk: 1 个主节点, 1 个从节点 ✅ 分片 tt9: 1 个主节点, 1 个从节点 ✅ 分片 wvn: 1 个主节点, 1 个从节点 ✅ 集群分析总结: - 检测到 3 个主节点和 3 个从节点 - 检测到 0 个故障或疑似故障节点 - 集群状态统一显示为OK: 是 - 所有槽位正确分配: 是 - 所有节点看到一致的集群大小: 是 - 所有节点看到一致的拓扑结构: 是 - 所有槽位被正确覆盖: 是 - 集群中无故障或疑似故障节点: 是 集群健康状态: 健康 ✅ 所有检查均通过，Redis集群运行正常。 analyze cluster health success check ops status `kbcli cluster list-ops rediscl-huzdsq --status all --namespace ns-xqred ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME rediscl-huzdsq-restart-jwcrh ns-xqred Restart rediscl-huzdsq shard Succeed 6/6 Jun 19,2025 18:19 UTC+0800 check ops status done ops_status:rediscl-huzdsq-restart-jwcrh ns-xqred Restart rediscl-huzdsq shard Succeed 6/6 Jun 19,2025 18:19 UTC+0800 `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge opsrequests rediscl-huzdsq-restart-jwcrh --namespace ns-xqred ` opsrequest.apps.kubeblocks.io/rediscl-huzdsq-restart-jwcrh patched `kbcli cluster delete-ops --name rediscl-huzdsq-restart-jwcrh --force --auto-approve --namespace ns-xqred ` OpsRequest rediscl-huzdsq-restart-jwcrh deleted patch rediscl-huzdsq shards 4 `kubectl patch cluster rediscl-huzdsq --namespace ns-xqred --type json -p '[***"op": "replace", "path": "/spec/shardingSpecs/0/shards", "value": '4'***]'` cluster.apps.kubeblocks.io/rediscl-huzdsq patched check cluster status `kbcli cluster list rediscl-huzdsq --show-labels --namespace ns-xqred ` NAME NAMESPACE CLUSTER-DEFINITION VERSION TERMINATION-POLICY STATUS CREATED-TIME LABELS rediscl-huzdsq ns-xqred Halt Running Jun 19,2025 18:15 UTC+0800 app.kubernetes.io/instance=rediscl-huzdsq check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances rediscl-huzdsq --namespace ns-xqred ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME rediscl-huzdsq-shard-bfc-0 ns-xqred rediscl-huzdsq shard-bfc Pending 100m / 100m 512Mi / 512Mi Jun 19,2025 18:22 UTC+0800 rediscl-huzdsq-shard-fwk-0 ns-xqred rediscl-huzdsq shard-fwk Running primary us-west-2a 100m / 100m 512Mi / 512Mi ip-172-31-2-115.us-west-2.compute.internal/172.31.2.115 Jun 19,2025 18:20 UTC+0800 rediscl-huzdsq-shard-fwk-1 ns-xqred rediscl-huzdsq shard-fwk Running secondary us-west-2a 100m / 100m 512Mi / 512Mi ip-172-31-13-158.us-west-2.compute.internal/172.31.13.158 Jun 19,2025 18:19 UTC+0800 rediscl-huzdsq-shard-tt9-0 ns-xqred rediscl-huzdsq shard-tt9 Running primary us-west-2a 100m / 100m 512Mi / 512Mi ip-172-31-12-213.us-west-2.compute.internal/172.31.12.213 Jun 19,2025 18:20 UTC+0800 rediscl-huzdsq-shard-tt9-1 ns-xqred rediscl-huzdsq shard-tt9 Running secondary us-west-2a 100m / 100m 512Mi / 512Mi ip-172-31-12-213.us-west-2.compute.internal/172.31.12.213 Jun 19,2025 18:19 UTC+0800 rediscl-huzdsq-shard-wvn-0 ns-xqred rediscl-huzdsq shard-wvn Running primary us-west-2a 100m / 100m 512Mi / 512Mi ip-172-31-2-115.us-west-2.compute.internal/172.31.2.115 Jun 19,2025 18:20 UTC+0800 rediscl-huzdsq-shard-wvn-1 ns-xqred rediscl-huzdsq shard-wvn Running secondary us-west-2a 100m / 100m 512Mi / 512Mi ip-172-31-13-158.us-west-2.compute.internal/172.31.13.158 Jun 19,2025 18:19 UTC+0800 pod_status:Init:0/1 pod_status:PodInitializing check pod status done check cluster role check cluster role done primary: rediscl-huzdsq-shard-fwk-0 rediscl-huzdsq-shard-tt9-0 rediscl-huzdsq-shard-wvn-0;secondary: rediscl-huzdsq-shard-fwk-1 rediscl-huzdsq-shard-tt9-1 rediscl-huzdsq-shard-wvn-1 analyze cluster health check cluster connect `` ========== 节点: rediscl-huzdsq-shard-bfc-0 ========== 检测到基础名称: rediscl-huzdsq-shard-bfc, 分片编号: 0 使用 Secret: rediscl-huzdsq-shard-bfc-account-default 密码获取成功，前缀: Xm... 使用Pod环境变量中的Redis端口: 6379 --- 集群节点信息 --- a5d4fc43276d727e0f162488944b68ba7c1e439d 172.31.12.213:32496@30676,rediscl-huzdsq-shard-bfc-0.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local myself,master - 0 0 0 connected --- 集群状态信息 --- cluster_state:fail cluster_slots_assigned:0 cluster_slots_ok:0 cluster_slots_pfail:0 cluster_slots_fail:0 cluster_known_nodes:1 cluster_size:0 cluster_current_epoch:0 cluster_my_epoch:0 cluster_stats_messages_sent:0 cluster_stats_messages_received:0 total_cluster_links_buffer_limit_exceeded:0 ========== 节点: rediscl-huzdsq-shard-bfc-1 ========== 检测到基础名称: rediscl-huzdsq-shard-bfc, 分片编号: 1 使用 Secret: rediscl-huzdsq-shard-bfc-account-default 密码获取成功，前缀: Xm... 无法从环境变量中获取Redis端口，使用默认端口6379 --- 集群节点信息 --- 执行命令失败 ========== 节点: rediscl-huzdsq-shard-fwk-0 ========== 检测到基础名称: rediscl-huzdsq-shard-fwk, 分片编号: 0 使用 Secret: rediscl-huzdsq-shard-fwk-account-default 密码获取成功，前缀: Xm... 使用Pod环境变量中的Redis端口: 6379 --- 集群节点信息 --- f1e5ba6810221fd9b7af42fc1ff2907eaed2b142 172.31.13.158:31209@30928,rediscl-huzdsq-shard-fwk-1.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local slave 6805dfae60f82469d32f167a0762f10b9fe532dc 0 1750328591000 1 connected fb7b00f6dbf1252875b2ec80a6473bb2900a6bc5 172.31.13.158:31917@32641,rediscl-huzdsq-shard-wvn-1.rediscl-huzdsq-shard-wvn-headless.ns-xqred.svc.cluster.local slave efb2cb384b2308639b0dd695e052beb099239f04 0 1750328591000 2 connected 6805dfae60f82469d32f167a0762f10b9fe532dc 172.31.2.115:30964@30479,rediscl-huzdsq-shard-fwk-0.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local myself,master - 0 1750328590000 1 connected 0-5460 9a47e108282ae378589e88936924a2f36a944e1a 172.31.12.213:30626@31966,rediscl-huzdsq-shard-tt9-0.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local master - 0 1750328591300 3 connected 10923-16383 efb2cb384b2308639b0dd695e052beb099239f04 172.31.2.115:32444@31013,rediscl-huzdsq-shard-wvn-0.rediscl-huzdsq-shard-wvn-headless.ns-xqred.svc.cluster.local master - 0 1750328591600 2 connected 5461-10922 566610eaebef8ad78e4fa9a8957436093634de2c 172.31.12.213:31054@30545,rediscl-huzdsq-shard-tt9-1.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local slave 9a47e108282ae378589e88936924a2f36a944e1a 0 1750328590000 3 connected --- 集群状态信息 --- cluster_state:ok cluster_slots_assigned:16384 cluster_slots_ok:16384 cluster_slots_pfail:0 cluster_slots_fail:0 cluster_known_nodes:6 cluster_size:3 cluster_current_epoch:4 cluster_my_epoch:1 cluster_stats_messages_ping_sent:322 cluster_stats_messages_pong_sent:295 cluster_stats_messages_meet_sent:2 cluster_stats_messages_fail_sent:4 cluster_stats_messages_sent:623 cluster_stats_messages_ping_received:293 cluster_stats_messages_pong_received:324 cluster_stats_messages_meet_received:2 cluster_stats_messages_received:619 total_cluster_links_buffer_limit_exceeded:0 ========== 节点: rediscl-huzdsq-shard-fwk-1 ========== 检测到基础名称: rediscl-huzdsq-shard-fwk, 分片编号: 1 使用 Secret: rediscl-huzdsq-shard-fwk-account-default 密码获取成功，前缀: Xm... 使用Pod环境变量中的Redis端口: 6379 --- 集群节点信息 --- efb2cb384b2308639b0dd695e052beb099239f04 172.31.2.115:32444@31013,rediscl-huzdsq-shard-wvn-0.rediscl-huzdsq-shard-wvn-headless.ns-xqred.svc.cluster.local master - 0 1750328597034 2 connected 5461-10922 f1e5ba6810221fd9b7af42fc1ff2907eaed2b142 172.31.13.158:31209@30928,rediscl-huzdsq-shard-fwk-1.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local myself,slave 6805dfae60f82469d32f167a0762f10b9fe532dc 0 1750328596000 1 connected 6805dfae60f82469d32f167a0762f10b9fe532dc 172.31.2.115:30964@30479,rediscl-huzdsq-shard-fwk-0.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local master - 0 1750328597000 1 connected 0-5460 566610eaebef8ad78e4fa9a8957436093634de2c 172.31.12.213:31054@30545,rediscl-huzdsq-shard-tt9-1.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local slave 9a47e108282ae378589e88936924a2f36a944e1a 0 1750328597536 3 connected fb7b00f6dbf1252875b2ec80a6473bb2900a6bc5 172.31.13.158:31917@32641,rediscl-huzdsq-shard-wvn-1.rediscl-huzdsq-shard-wvn-headless.ns-xqred.svc.cluster.local slave efb2cb384b2308639b0dd695e052beb099239f04 0 1750328598038 2 connected 9a47e108282ae378589e88936924a2f36a944e1a 172.31.12.213:30626@31966,rediscl-huzdsq-shard-tt9-0.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local master - 0 1750328596531 3 connected 10923-16383 --- 集群状态信息 --- cluster_state:ok cluster_slots_assigned:16384 cluster_slots_ok:16384 cluster_slots_pfail:0 cluster_slots_fail:0 cluster_known_nodes:6 cluster_size:3 cluster_current_epoch:4 cluster_my_epoch:1 cluster_stats_messages_ping_sent:352 cluster_stats_messages_pong_sent:350 cluster_stats_messages_meet_sent:1 cluster_stats_messages_sent:703 cluster_stats_messages_ping_received:350 cluster_stats_messages_pong_received:349 cluster_stats_messages_fail_received:3 cluster_stats_messages_auth-req_received:1 cluster_stats_messages_received:703 total_cluster_links_buffer_limit_exceeded:0 ========== 节点: rediscl-huzdsq-shard-tt9-0 ========== 检测到基础名称: rediscl-huzdsq-shard-tt9, 分片编号: 0 使用 Secret: rediscl-huzdsq-shard-tt9-account-default 密码获取成功，前缀: Xm... 使用Pod环境变量中的Redis端口: 6379 --- 集群节点信息 --- 566610eaebef8ad78e4fa9a8957436093634de2c 172.31.12.213:31054@30545,rediscl-huzdsq-shard-tt9-1.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local slave 9a47e108282ae378589e88936924a2f36a944e1a 0 1750328604186 3 connected 9a47e108282ae378589e88936924a2f36a944e1a 172.31.12.213:30626@31966,rediscl-huzdsq-shard-tt9-0.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local myself,master - 0 1750328603000 3 connected 10923-16383 f1e5ba6810221fd9b7af42fc1ff2907eaed2b142 172.31.13.158:31209@30928,rediscl-huzdsq-shard-fwk-1.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local slave 6805dfae60f82469d32f167a0762f10b9fe532dc 0 1750328603000 1 connected fb7b00f6dbf1252875b2ec80a6473bb2900a6bc5 172.31.13.158:31917@32641,rediscl-huzdsq-shard-wvn-1.rediscl-huzdsq-shard-wvn-headless.ns-xqred.svc.cluster.local slave efb2cb384b2308639b0dd695e052beb099239f04 0 1750328602577 2 connected efb2cb384b2308639b0dd695e052beb099239f04 172.31.2.115:32444@31013,rediscl-huzdsq-shard-wvn-0.rediscl-huzdsq-shard-wvn-headless.ns-xqred.svc.cluster.local master - 0 1750328603181 2 connected 5461-10922 6805dfae60f82469d32f167a0762f10b9fe532dc 172.31.2.115:30964@30479,rediscl-huzdsq-shard-fwk-0.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local master - 0 1750328603683 1 connected 0-5460 --- 集群状态信息 --- cluster_state:ok cluster_slots_assigned:16384 cluster_slots_ok:16384 cluster_slots_pfail:0 cluster_slots_fail:0 cluster_known_nodes:6 cluster_size:3 cluster_current_epoch:4 cluster_my_epoch:3 cluster_stats_messages_ping_sent:331 cluster_stats_messages_pong_sent:318 cluster_stats_messages_meet_sent:2 cluster_stats_messages_sent:651 cluster_stats_messages_ping_received:316 cluster_stats_messages_pong_received:331 cluster_stats_messages_meet_received:2 cluster_stats_messages_received:649 total_cluster_links_buffer_limit_exceeded:0 ========== 节点: rediscl-huzdsq-shard-tt9-1 ========== 检测到基础名称: rediscl-huzdsq-shard-tt9, 分片编号: 1 使用 Secret: rediscl-huzdsq-shard-tt9-account-default 密码获取成功，前缀: Xm... 使用Pod环境变量中的Redis端口: 6379 --- 集群节点信息 --- 6805dfae60f82469d32f167a0762f10b9fe532dc 172.31.2.115:30964@30479,rediscl-huzdsq-shard-fwk-0.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local master - 0 1750328610007 1 connected 0-5460 fb7b00f6dbf1252875b2ec80a6473bb2900a6bc5 172.31.13.158:31917@32641,rediscl-huzdsq-shard-wvn-1.rediscl-huzdsq-shard-wvn-headless.ns-xqred.svc.cluster.local slave efb2cb384b2308639b0dd695e052beb099239f04 0 1750328610511 2 connected f1e5ba6810221fd9b7af42fc1ff2907eaed2b142 172.31.13.158:31209@30928,rediscl-huzdsq-shard-fwk-1.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local slave 6805dfae60f82469d32f167a0762f10b9fe532dc 0 1750328611558 1 connected 566610eaebef8ad78e4fa9a8957436093634de2c 172.31.12.213:31054@30545,rediscl-huzdsq-shard-tt9-1.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local myself,slave 9a47e108282ae378589e88936924a2f36a944e1a 0 1750328611000 3 connected efb2cb384b2308639b0dd695e052beb099239f04 172.31.2.115:32444@31013,rediscl-huzdsq-shard-wvn-0.rediscl-huzdsq-shard-wvn-headless.ns-xqred.svc.cluster.local master - 0 1750328610000 2 connected 5461-10922 9a47e108282ae378589e88936924a2f36a944e1a 172.31.12.213:30626@31966,rediscl-huzdsq-shard-tt9-0.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local master - 0 1750328611055 3 connected 10923-16383 --- 集群状态信息 --- cluster_state:ok cluster_slots_assigned:16384 cluster_slots_ok:16384 cluster_slots_pfail:0 cluster_slots_fail:0 cluster_known_nodes:6 cluster_size:3 cluster_current_epoch:4 cluster_my_epoch:3 cluster_stats_messages_ping_sent:376 cluster_stats_messages_pong_sent:379 cluster_stats_messages_meet_sent:1 cluster_stats_messages_fail_sent:10 cluster_stats_messages_auth-req_sent:5 cluster_stats_messages_sent:771 cluster_stats_messages_ping_received:379 cluster_stats_messages_pong_received:372 cluster_stats_messages_fail_received:3 cluster_stats_messages_received:754 total_cluster_links_buffer_limit_exceeded:0 ========== 节点: rediscl-huzdsq-shard-wvn-0 ========== 检测到基础名称: rediscl-huzdsq-shard-wvn, 分片编号: 0 使用 Secret: rediscl-huzdsq-shard-wvn-account-default 密码获取成功，前缀: Xm... 使用Pod环境变量中的Redis端口: 6379 --- 集群节点信息 --- 566610eaebef8ad78e4fa9a8957436093634de2c 172.31.12.213:31054@30545,rediscl-huzdsq-shard-tt9-1.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local slave 9a47e108282ae378589e88936924a2f36a944e1a 0 1750328616000 3 connected f1e5ba6810221fd9b7af42fc1ff2907eaed2b142 172.31.13.158:31209@30928,rediscl-huzdsq-shard-fwk-1.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local slave 6805dfae60f82469d32f167a0762f10b9fe532dc 0 1750328616559 1 connected 6805dfae60f82469d32f167a0762f10b9fe532dc 172.31.2.115:30964@30479,rediscl-huzdsq-shard-fwk-0.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local master - 0 1750328617000 1 connected 0-5460 9a47e108282ae378589e88936924a2f36a944e1a 172.31.12.213:30626@31966,rediscl-huzdsq-shard-tt9-0.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local master - 0 1750328617462 3 connected 10923-16383 efb2cb384b2308639b0dd695e052beb099239f04 172.31.2.115:32444@31013,rediscl-huzdsq-shard-wvn-0.rediscl-huzdsq-shard-wvn-headless.ns-xqred.svc.cluster.local myself,master - 0 1750328617000 2 connected 5461-10922 fb7b00f6dbf1252875b2ec80a6473bb2900a6bc5 172.31.13.158:31917@32641,rediscl-huzdsq-shard-wvn-1.rediscl-huzdsq-shard-wvn-headless.ns-xqred.svc.cluster.local slave efb2cb384b2308639b0dd695e052beb099239f04 0 1750328618065 2 connected --- 集群状态信息 --- cluster_state:ok cluster_slots_assigned:16384 cluster_slots_ok:16384 cluster_slots_pfail:0 cluster_slots_fail:0 cluster_known_nodes:7 cluster_size:3 cluster_current_epoch:4 cluster_my_epoch:2 cluster_stats_messages_ping_sent:362 cluster_stats_messages_pong_sent:347 cluster_stats_messages_meet_sent:2 cluster_stats_messages_fail_sent:5 cluster_stats_messages_sent:716 cluster_stats_messages_ping_received:345 cluster_stats_messages_pong_received:363 cluster_stats_messages_meet_received:2 cluster_stats_messages_fail_received:1 cluster_stats_messages_received:711 total_cluster_links_buffer_limit_exceeded:0 ========== 节点: rediscl-huzdsq-shard-wvn-1 ========== 检测到基础名称: rediscl-huzdsq-shard-wvn, 分片编号: 1 使用 Secret: rediscl-huzdsq-shard-wvn-account-default 密码获取成功，前缀: Xm... 使用Pod环境变量中的Redis端口: 6379 --- 集群节点信息 --- f1e5ba6810221fd9b7af42fc1ff2907eaed2b142 172.31.13.158:31209@30928,rediscl-huzdsq-shard-fwk-1.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local slave 6805dfae60f82469d32f167a0762f10b9fe532dc 0 1750328623802 1 connected 566610eaebef8ad78e4fa9a8957436093634de2c 172.31.12.213:31054@30545,rediscl-huzdsq-shard-tt9-1.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local slave 9a47e108282ae378589e88936924a2f36a944e1a 0 1750328622294 3 connected a5d4fc43276d727e0f162488944b68ba7c1e439d 172.31.12.213:32496@30676,rediscl-huzdsq-shard-bfc-0.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local master - 0 1750328624505 0 connected fb7b00f6dbf1252875b2ec80a6473bb2900a6bc5 172.31.13.158:31917@32641,rediscl-huzdsq-shard-wvn-1.rediscl-huzdsq-shard-wvn-headless.ns-xqred.svc.cluster.local myself,slave efb2cb384b2308639b0dd695e052beb099239f04 0 1750328621000 2 connected 9a47e108282ae378589e88936924a2f36a944e1a 172.31.12.213:30626@31966,rediscl-huzdsq-shard-tt9-0.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local master - 0 1750328624312 3 connected 10923-16383 6805dfae60f82469d32f167a0762f10b9fe532dc 172.31.2.115:30964@30479,rediscl-huzdsq-shard-fwk-0.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local master - 0 1750328623300 1 connected 0-5460 efb2cb384b2308639b0dd695e052beb099239f04 172.31.2.115:32444@31013,rediscl-huzdsq-shard-wvn-0.rediscl-huzdsq-shard-wvn-headless.ns-xqred.svc.cluster.local master - 0 1750328623000 2 connected 5461-10922 --- 集群状态信息 --- cluster_state:ok cluster_slots_assigned:16384 cluster_slots_ok:16384 cluster_slots_pfail:0 cluster_slots_fail:0 cluster_known_nodes:8 cluster_size:4 cluster_current_epoch:5 cluster_my_epoch:2 cluster_stats_messages_ping_sent:402 cluster_stats_messages_pong_sent:405 cluster_stats_messages_meet_sent:1 cluster_stats_messages_fail_sent:10 cluster_stats_messages_sent:818 cluster_stats_messages_ping_received:405 cluster_stats_messages_pong_received:471 cluster_stats_messages_fail_received:2 cluster_stats_messages_auth-req_received:1 cluster_stats_messages_received:879 total_cluster_links_buffer_limit_exceeded:0 ========== 集群健康分析 ========== 使用节点 rediscl-huzdsq-shard-bfc-0 作为参考基准 检测到以下分片标识符: - bfc - fwk - tt9 - wvn 警告: 节点 rediscl-huzdsq-shard-bfc-0 报告集群状态为 'fail'，期望值为 'ok' 警告: 节点 rediscl-huzdsq-shard-bfc-0 报告分配的槽位数为 '0'，期望值为 '16384' 警告: 节点 rediscl-huzdsq-shard-wvn-0 报告已知节点数为 '7'，与第一个节点报告的 '6' 不一致 警告: 节点 rediscl-huzdsq-shard-wvn-1 报告集群大小为 '4'，与第一个节点报告的 '3' 不一致 参考节点观察到的拓扑结构: ID IP地址 状态 主节点ID 槽位 ---------------------------------------- ------------- ---------------- ---------------------------------------- -------------- a5d4fc43276d727e0f162488944b68ba7c1e439d 172.31.12.213:32496 主节点 - 无槽位 (共 0 个槽位) 正在分析节点 rediscl-huzdsq-shard-fwk-0 的拓扑视图... 警告: 节点 rediscl-huzdsq-shard-fwk-0 看到 6 个节点，而参考节点看到 1 个节点 警告: 节点 rediscl-huzdsq-shard-fwk-0 缺少 1 个节点，它们在参考节点视图中存在 缺失的节点详情: ID IP地址 状态 主节点ID 槽位 ---------------------------------------- ------------- ---------------- ---------------------------------------- -------------- a5d4fc43276d727e0f162488944b68ba7c1e439d 172.31.12.213:32496 主节点 - 无槽位 警告: 节点 rediscl-huzdsq-shard-fwk-0 看到 6 个节点，它们在参考节点视图中不存在 额外的节点详情: ID IP地址 状态 ---------------------------------------- ------------- ---------------- f1e5ba6810221fd9b7af42fc1ff2907eaed2b142 172.31.13.158:31209 从节点 fb7b00f6dbf1252875b2ec80a6473bb2900a6bc5 172.31.13.158:31917 从节点 6805dfae60f82469d32f167a0762f10b9fe532dc 172.31.2.115:30964 主节点 9a47e108282ae378589e88936924a2f36a944e1a 172.31.12.213:30626 主节点 efb2cb384b2308639b0dd695e052beb099239f04 172.31.2.115:32444 主节点 566610eaebef8ad78e4fa9a8957436093634de2c 172.31.12.213:31054 从节点 正在分析节点 rediscl-huzdsq-shard-fwk-1 的拓扑视图... 警告: 节点 rediscl-huzdsq-shard-fwk-1 看到 6 个节点，而参考节点看到 1 个节点 警告: 节点 rediscl-huzdsq-shard-fwk-1 缺少 1 个节点，它们在参考节点视图中存在 缺失的节点详情: ID IP地址 状态 主节点ID 槽位 ---------------------------------------- ------------- ---------------- ---------------------------------------- -------------- a5d4fc43276d727e0f162488944b68ba7c1e439d 172.31.12.213:32496 主节点 - 无槽位 警告: 节点 rediscl-huzdsq-shard-fwk-1 看到 6 个节点，它们在参考节点视图中不存在 额外的节点详情: ID IP地址 状态 ---------------------------------------- ------------- ---------------- efb2cb384b2308639b0dd695e052beb099239f04 172.31.2.115:32444 主节点 f1e5ba6810221fd9b7af42fc1ff2907eaed2b142 172.31.13.158:31209 从节点 6805dfae60f82469d32f167a0762f10b9fe532dc 172.31.2.115:30964 主节点 566610eaebef8ad78e4fa9a8957436093634de2c 172.31.12.213:31054 从节点 fb7b00f6dbf1252875b2ec80a6473bb2900a6bc5 172.31.13.158:31917 从节点 9a47e108282ae378589e88936924a2f36a944e1a 172.31.12.213:30626 主节点 正在分析节点 rediscl-huzdsq-shard-tt9-0 的拓扑视图... 警告: 节点 rediscl-huzdsq-shard-tt9-0 看到 6 个节点，而参考节点看到 1 个节点 警告: 节点 rediscl-huzdsq-shard-tt9-0 缺少 1 个节点，它们在参考节点视图中存在 缺失的节点详情: ID IP地址 状态 主节点ID 槽位 ---------------------------------------- ------------- ---------------- ---------------------------------------- -------------- a5d4fc43276d727e0f162488944b68ba7c1e439d 172.31.12.213:32496 主节点 - 无槽位 警告: 节点 rediscl-huzdsq-shard-tt9-0 看到 6 个节点，它们在参考节点视图中不存在 额外的节点详情: ID IP地址 状态 ---------------------------------------- ------------- ---------------- 566610eaebef8ad78e4fa9a8957436093634de2c 172.31.12.213:31054 从节点 9a47e108282ae378589e88936924a2f36a944e1a 172.31.12.213:30626 主节点 f1e5ba6810221fd9b7af42fc1ff2907eaed2b142 172.31.13.158:31209 从节点 fb7b00f6dbf1252875b2ec80a6473bb2900a6bc5 172.31.13.158:31917 从节点 efb2cb384b2308639b0dd695e052beb099239f04 172.31.2.115:32444 主节点 6805dfae60f82469d32f167a0762f10b9fe532dc 172.31.2.115:30964 主节点 正在分析节点 rediscl-huzdsq-shard-tt9-1 的拓扑视图... 警告: 节点 rediscl-huzdsq-shard-tt9-1 看到 6 个节点，而参考节点看到 1 个节点 警告: 节点 rediscl-huzdsq-shard-tt9-1 缺少 1 个节点，它们在参考节点视图中存在 缺失的节点详情: ID IP地址 状态 主节点ID 槽位 ---------------------------------------- ------------- ---------------- ---------------------------------------- -------------- a5d4fc43276d727e0f162488944b68ba7c1e439d 172.31.12.213:32496 主节点 - 无槽位 警告: 节点 rediscl-huzdsq-shard-tt9-1 看到 6 个节点，它们在参考节点视图中不存在 额外的节点详情: ID IP地址 状态 ---------------------------------------- ------------- ---------------- 6805dfae60f82469d32f167a0762f10b9fe532dc 172.31.2.115:30964 主节点 fb7b00f6dbf1252875b2ec80a6473bb2900a6bc5 172.31.13.158:31917 从节点 f1e5ba6810221fd9b7af42fc1ff2907eaed2b142 172.31.13.158:31209 从节点 566610eaebef8ad78e4fa9a8957436093634de2c 172.31.12.213:31054 从节点 efb2cb384b2308639b0dd695e052beb099239f04 172.31.2.115:32444 主节点 9a47e108282ae378589e88936924a2f36a944e1a 172.31.12.213:30626 主节点 正在分析节点 rediscl-huzdsq-shard-wvn-0 的拓扑视图... 警告: 节点 rediscl-huzdsq-shard-wvn-0 看到 6 个节点，而参考节点看到 1 个节点 警告: 节点 rediscl-huzdsq-shard-wvn-0 缺少 1 个节点，它们在参考节点视图中存在 缺失的节点详情: ID IP地址 状态 主节点ID 槽位 ---------------------------------------- ------------- ---------------- ---------------------------------------- -------------- a5d4fc43276d727e0f162488944b68ba7c1e439d 172.31.12.213:32496 主节点 - 无槽位 警告: 节点 rediscl-huzdsq-shard-wvn-0 看到 6 个节点，它们在参考节点视图中不存在 额外的节点详情: ID IP地址 状态 ---------------------------------------- ------------- ---------------- 566610eaebef8ad78e4fa9a8957436093634de2c 172.31.12.213:31054 从节点 f1e5ba6810221fd9b7af42fc1ff2907eaed2b142 172.31.13.158:31209 从节点 6805dfae60f82469d32f167a0762f10b9fe532dc 172.31.2.115:30964 主节点 9a47e108282ae378589e88936924a2f36a944e1a 172.31.12.213:30626 主节点 efb2cb384b2308639b0dd695e052beb099239f04 172.31.2.115:32444 主节点 fb7b00f6dbf1252875b2ec80a6473bb2900a6bc5 172.31.13.158:31917 从节点 正在分析节点 rediscl-huzdsq-shard-wvn-1 的拓扑视图... 警告: 节点 rediscl-huzdsq-shard-wvn-1 看到 7 个节点，而参考节点看到 1 个节点 警告: 节点 rediscl-huzdsq-shard-wvn-1 看到 6 个节点，它们在参考节点视图中不存在 额外的节点详情: ID IP地址 状态 ---------------------------------------- ------------- ---------------- f1e5ba6810221fd9b7af42fc1ff2907eaed2b142 172.31.13.158:31209 从节点 566610eaebef8ad78e4fa9a8957436093634de2c 172.31.12.213:31054 从节点 fb7b00f6dbf1252875b2ec80a6473bb2900a6bc5 172.31.13.158:31917 从节点 9a47e108282ae378589e88936924a2f36a944e1a 172.31.12.213:30626 主节点 6805dfae60f82469d32f167a0762f10b9fe532dc 172.31.2.115:30964 主节点 efb2cb384b2308639b0dd695e052beb099239f04 172.31.2.115:32444 主节点 警告: 槽位 0 未被任何主节点覆盖 警告: 槽位 1 未被任何主节点覆盖 警告: 槽位 2 未被任何主节点覆盖 警告: 槽位 3 未被任何主节点覆盖 警告: 槽位 4 未被任何主节点覆盖 警告: 槽位 5 未被任何主节点覆盖 警告: 槽位 6 未被任何主节点覆盖 警告: 槽位 7 未被任何主节点覆盖 警告: 槽位 8 未被任何主节点覆盖 警告: 槽位 9 未被任何主节点覆盖 ...等 16374 个未覆盖槽位未显示 槽位分配统计: - 总槽位数: 16384 - 未覆盖槽位数: 16384 - 重复覆盖槽位数: 0 - 正确覆盖槽位数: 0 主节点槽位分配明细: 节点 a5d4fc43276d727e0f162488944b68ba7c1e439d (172.31.12.213:32496) 负责 0 个槽位: 总计分配槽位: 0 / 16384 警告: 分配的总槽位数 (0) 不等于 16384 缺少 16384 个槽位分配 分片分析: 分片 bfc: 1 个主节点, 0 个从节点 ✅ 集群分析总结: - 检测到 1 个主节点和 0 个从节点 - 检测到 0 个故障或疑似故障节点 - 集群状态统一显示为OK: 否 - 所有槽位正确分配: 否 - 所有节点看到一致的集群大小: 否 - 所有节点看到一致的拓扑结构: 否 - 所有槽位被正确覆盖: 否 - 集群中无故障或疑似故障节点: 是 集群健康状态: 不健康 ❌ 检测到以下问题: - 集群状态异常: 一个或多个节点报告集群状态不为OK - 槽位分配问题: 槽位数量不正确或存在故障槽位 - 集群视图不一致: 不同节点看到的集群大小或节点数量不同 - 拓扑结构不一致: 节点间对集群成员或角色的认知不一致 - 槽位覆盖问题: 存在未分配或重复分配的槽位 建议措施: 4. 使用 CLUSTER MEET 命令修复节点间的连接 5. 确保所有节点的配置(如cluster-announce-ip)正确 6. 使用 CLUSTER FIX 命令修复槽位分配问题 7. 手动检查未分配或重复分配的槽位 health analyzing... health analyzing... health analyzing... health analyzing... health analyzing... health analyzing... health analyzing... health analyzing... health analyzing... health analyzing... health analyzing... health analyzing... health analyzing... health analyzing... health analyzing... health analyzing... ========== 节点: rediscl-huzdsq-shard-bfc-0 ========== 检测到基础名称: rediscl-huzdsq-shard-bfc, 分片编号: 0 使用 Secret: rediscl-huzdsq-shard-bfc-account-default 密码获取成功，前缀: Xm... 使用Pod环境变量中的Redis端口: 6379 --- 集群节点信息 --- efb2cb384b2308639b0dd695e052beb099239f04 172.31.2.115:32444@31013,rediscl-huzdsq-shard-wvn-0.rediscl-huzdsq-shard-wvn-headless.ns-xqred.svc.cluster.local master - 0 1750328821000 2 connected 6827-10922 6805dfae60f82469d32f167a0762f10b9fe532dc 172.31.2.115:30964@30479,rediscl-huzdsq-shard-fwk-0.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local master - 0 1750328822000 1 connected 1365-5460 9a47e108282ae378589e88936924a2f36a944e1a 172.31.12.213:30626@31966,rediscl-huzdsq-shard-tt9-0.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local master - 0 1750328821000 3 connected 12288-16383 f1e5ba6810221fd9b7af42fc1ff2907eaed2b142 172.31.13.158:31209@30928,rediscl-huzdsq-shard-fwk-1.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local slave 6805dfae60f82469d32f167a0762f10b9fe532dc 0 1750328821554 1 connected fb7b00f6dbf1252875b2ec80a6473bb2900a6bc5 172.31.13.158:31917@32641,rediscl-huzdsq-shard-wvn-1.rediscl-huzdsq-shard-wvn-headless.ns-xqred.svc.cluster.local slave efb2cb384b2308639b0dd695e052beb099239f04 0 1750328822859 2 connected 566610eaebef8ad78e4fa9a8957436093634de2c 172.31.12.213:31054@30545,rediscl-huzdsq-shard-tt9-1.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local slave 9a47e108282ae378589e88936924a2f36a944e1a 0 1750328821000 3 connected f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 172.31.5.137:32508@31084,rediscl-huzdsq-shard-bfc-1.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local slave a5d4fc43276d727e0f162488944b68ba7c1e439d 0 1750328821855 5 connected a5d4fc43276d727e0f162488944b68ba7c1e439d 172.31.12.213:32496@30676,rediscl-huzdsq-shard-bfc-0.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local myself,master - 0 1750328819000 5 connected 0-1364 5461-6826 10923-12287 --- 集群状态信息 --- cluster_state:ok cluster_slots_assigned:16384 cluster_slots_ok:16384 cluster_slots_pfail:0 cluster_slots_fail:0 cluster_known_nodes:8 cluster_size:4 cluster_current_epoch:5 cluster_my_epoch:5 cluster_stats_messages_ping_sent:514 cluster_stats_messages_pong_sent:29177 cluster_stats_messages_meet_sent:1 cluster_stats_messages_update_sent:9 cluster_stats_messages_sent:29701 cluster_stats_messages_ping_received:504 cluster_stats_messages_pong_received:515 cluster_stats_messages_meet_received:1 cluster_stats_messages_received:1020 total_cluster_links_buffer_limit_exceeded:0 ========== 节点: rediscl-huzdsq-shard-bfc-1 ========== 检测到基础名称: rediscl-huzdsq-shard-bfc, 分片编号: 1 使用 Secret: rediscl-huzdsq-shard-bfc-account-default 密码获取成功，前缀: Xm... 使用Pod环境变量中的Redis端口: 6379 --- 集群节点信息 --- efb2cb384b2308639b0dd695e052beb099239f04 172.31.2.115:32444@31013,rediscl-huzdsq-shard-wvn-0.rediscl-huzdsq-shard-wvn-headless.ns-xqred.svc.cluster.local master - 0 1750328828551 2 connected 6827-10922 a5d4fc43276d727e0f162488944b68ba7c1e439d 172.31.12.213:32496@30676,rediscl-huzdsq-shard-bfc-0.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local master - 0 1750328829054 5 connected 0-1364 5461-6826 10923-12287 f1e5ba6810221fd9b7af42fc1ff2907eaed2b142 172.31.13.158:31209@30928,rediscl-huzdsq-shard-fwk-1.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local slave 6805dfae60f82469d32f167a0762f10b9fe532dc 0 1750328828000 1 connected 566610eaebef8ad78e4fa9a8957436093634de2c 172.31.12.213:31054@30545,rediscl-huzdsq-shard-tt9-1.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local slave 9a47e108282ae378589e88936924a2f36a944e1a 0 1750328828000 3 connected 9a47e108282ae378589e88936924a2f36a944e1a 172.31.12.213:30626@31966,rediscl-huzdsq-shard-tt9-0.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local master - 0 1750328828000 3 connected 12288-16383 f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 172.31.5.137:32508@31084,rediscl-huzdsq-shard-bfc-1.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local myself,slave a5d4fc43276d727e0f162488944b68ba7c1e439d 0 1750328826000 5 connected fb7b00f6dbf1252875b2ec80a6473bb2900a6bc5 172.31.13.158:31917@32641,rediscl-huzdsq-shard-wvn-1.rediscl-huzdsq-shard-wvn-headless.ns-xqred.svc.cluster.local slave efb2cb384b2308639b0dd695e052beb099239f04 0 1750328829054 2 connected 6805dfae60f82469d32f167a0762f10b9fe532dc 172.31.2.115:30964@30479,rediscl-huzdsq-shard-fwk-0.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local master - 0 1750328828048 1 connected 1365-5460 --- 集群状态信息 --- cluster_state:ok cluster_slots_assigned:16384 cluster_slots_ok:16384 cluster_slots_pfail:0 cluster_slots_fail:0 cluster_known_nodes:8 cluster_size:4 cluster_current_epoch:5 cluster_my_epoch:5 cluster_stats_messages_ping_sent:480 cluster_stats_messages_pong_sent:482 cluster_stats_messages_meet_sent:1 cluster_stats_messages_update_sent:5 cluster_stats_messages_sent:968 cluster_stats_messages_ping_received:482 cluster_stats_messages_pong_received:4577 cluster_stats_messages_received:5059 total_cluster_links_buffer_limit_exceeded:0 ========== 节点: rediscl-huzdsq-shard-fwk-0 ========== 检测到基础名称: rediscl-huzdsq-shard-fwk, 分片编号: 0 使用 Secret: rediscl-huzdsq-shard-fwk-account-default 密码获取成功，前缀: Xm... 使用Pod环境变量中的Redis端口: 6379 --- 集群节点信息 --- f1e5ba6810221fd9b7af42fc1ff2907eaed2b142 172.31.13.158:31209@30928,rediscl-huzdsq-shard-fwk-1.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local slave 6805dfae60f82469d32f167a0762f10b9fe532dc 0 1750328834446 1 connected fb7b00f6dbf1252875b2ec80a6473bb2900a6bc5 172.31.13.158:31917@32641,rediscl-huzdsq-shard-wvn-1.rediscl-huzdsq-shard-wvn-headless.ns-xqred.svc.cluster.local slave efb2cb384b2308639b0dd695e052beb099239f04 0 1750328835552 2 connected f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 172.31.5.137:32508@31084,rediscl-huzdsq-shard-bfc-1.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local slave a5d4fc43276d727e0f162488944b68ba7c1e439d 0 1750328835451 5 connected 6805dfae60f82469d32f167a0762f10b9fe532dc 172.31.2.115:30964@30479,rediscl-huzdsq-shard-fwk-0.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local myself,master - 0 1750328835000 1 connected 1365-5460 a5d4fc43276d727e0f162488944b68ba7c1e439d 172.31.12.213:32496@30676,rediscl-huzdsq-shard-bfc-0.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local master - 0 1750328834087 5 connected 0-1364 5461-6826 10923-12287 9a47e108282ae378589e88936924a2f36a944e1a 172.31.12.213:30626@31966,rediscl-huzdsq-shard-tt9-0.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local master - 0 1750328835552 3 connected 12288-16383 efb2cb384b2308639b0dd695e052beb099239f04 172.31.2.115:32444@31013,rediscl-huzdsq-shard-wvn-0.rediscl-huzdsq-shard-wvn-headless.ns-xqred.svc.cluster.local master - 0 1750328835000 2 connected 6827-10922 566610eaebef8ad78e4fa9a8957436093634de2c 172.31.12.213:31054@30545,rediscl-huzdsq-shard-tt9-1.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local slave 9a47e108282ae378589e88936924a2f36a944e1a 0 1750328835000 3 connected --- 集群状态信息 --- cluster_state:ok cluster_slots_assigned:16384 cluster_slots_ok:16384 cluster_slots_pfail:0 cluster_slots_fail:0 cluster_known_nodes:8 cluster_size:4 cluster_current_epoch:5 cluster_my_epoch:1 cluster_stats_messages_ping_sent:860 cluster_stats_messages_pong_sent:836 cluster_stats_messages_meet_sent:2 cluster_stats_messages_fail_sent:4 cluster_stats_messages_update_sent:4 cluster_stats_messages_sent:1706 cluster_stats_messages_ping_received:834 cluster_stats_messages_pong_received:4958 cluster_stats_messages_meet_received:2 cluster_stats_messages_update_received:3 cluster_stats_messages_received:5797 total_cluster_links_buffer_limit_exceeded:0 ========== 节点: rediscl-huzdsq-shard-fwk-1 ========== 检测到基础名称: rediscl-huzdsq-shard-fwk, 分片编号: 1 使用 Secret: rediscl-huzdsq-shard-fwk-account-default 密码获取成功，前缀: Xm... 使用Pod环境变量中的Redis端口: 6379 --- 集群节点信息 --- a5d4fc43276d727e0f162488944b68ba7c1e439d 172.31.12.213:32496@30676,rediscl-huzdsq-shard-bfc-0.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local master - 0 1750328841524 5 connected 0-1364 5461-6826 10923-12287 efb2cb384b2308639b0dd695e052beb099239f04 172.31.2.115:32444@31013,rediscl-huzdsq-shard-wvn-0.rediscl-huzdsq-shard-wvn-headless.ns-xqred.svc.cluster.local master - 0 1750328842000 2 connected 6827-10922 f1e5ba6810221fd9b7af42fc1ff2907eaed2b142 172.31.13.158:31209@30928,rediscl-huzdsq-shard-fwk-1.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local myself,slave 6805dfae60f82469d32f167a0762f10b9fe532dc 0 1750328840000 1 connected 6805dfae60f82469d32f167a0762f10b9fe532dc 172.31.2.115:30964@30479,rediscl-huzdsq-shard-fwk-0.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local master - 0 1750328841021 1 connected 1365-5460 566610eaebef8ad78e4fa9a8957436093634de2c 172.31.12.213:31054@30545,rediscl-huzdsq-shard-tt9-1.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local slave 9a47e108282ae378589e88936924a2f36a944e1a 0 1750328842000 3 connected fb7b00f6dbf1252875b2ec80a6473bb2900a6bc5 172.31.13.158:31917@32641,rediscl-huzdsq-shard-wvn-1.rediscl-huzdsq-shard-wvn-headless.ns-xqred.svc.cluster.local slave efb2cb384b2308639b0dd695e052beb099239f04 0 1750328842027 2 connected f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 172.31.5.137:32508@31084,rediscl-huzdsq-shard-bfc-1.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local slave a5d4fc43276d727e0f162488944b68ba7c1e439d 0 1750328842000 5 connected 9a47e108282ae378589e88936924a2f36a944e1a 172.31.12.213:30626@31966,rediscl-huzdsq-shard-tt9-0.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local master - 0 1750328842531 3 connected 12288-16383 --- 集群状态信息 --- cluster_state:ok cluster_slots_assigned:16384 cluster_slots_ok:16384 cluster_slots_pfail:0 cluster_slots_fail:0 cluster_known_nodes:8 cluster_size:4 cluster_current_epoch:5 cluster_my_epoch:1 cluster_stats_messages_ping_sent:907 cluster_stats_messages_pong_sent:915 cluster_stats_messages_meet_sent:1 cluster_stats_messages_update_sent:3 cluster_stats_messages_sent:1826 cluster_stats_messages_ping_received:915 cluster_stats_messages_pong_received:5000 cluster_stats_messages_fail_received:3 cluster_stats_messages_auth-req_received:1 cluster_stats_messages_update_received:13 cluster_stats_messages_received:5932 total_cluster_links_buffer_limit_exceeded:0 ========== 节点: rediscl-huzdsq-shard-tt9-0 ========== 检测到基础名称: rediscl-huzdsq-shard-tt9, 分片编号: 0 使用 Secret: rediscl-huzdsq-shard-tt9-account-default 密码获取成功，前缀: Xm... 使用Pod环境变量中的Redis端口: 6379 --- 集群节点信息 --- a5d4fc43276d727e0f162488944b68ba7c1e439d 172.31.12.213:32496@30676,rediscl-huzdsq-shard-bfc-0.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local master - 0 1750328848582 5 connected 0-1364 5461-6826 10923-12287 f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 172.31.5.137:32508@31084,rediscl-huzdsq-shard-bfc-1.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local slave a5d4fc43276d727e0f162488944b68ba7c1e439d 0 1750328847578 5 connected 566610eaebef8ad78e4fa9a8957436093634de2c 172.31.12.213:31054@30545,rediscl-huzdsq-shard-tt9-1.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local slave 9a47e108282ae378589e88936924a2f36a944e1a 0 1750328848080 3 connected 9a47e108282ae378589e88936924a2f36a944e1a 172.31.12.213:30626@31966,rediscl-huzdsq-shard-tt9-0.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local myself,master - 0 1750328847000 3 connected 12288-16383 f1e5ba6810221fd9b7af42fc1ff2907eaed2b142 172.31.13.158:31209@30928,rediscl-huzdsq-shard-fwk-1.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local slave 6805dfae60f82469d32f167a0762f10b9fe532dc 0 1750328849086 1 connected fb7b00f6dbf1252875b2ec80a6473bb2900a6bc5 172.31.13.158:31917@32641,rediscl-huzdsq-shard-wvn-1.rediscl-huzdsq-shard-wvn-headless.ns-xqred.svc.cluster.local slave efb2cb384b2308639b0dd695e052beb099239f04 0 1750328847074 2 connected efb2cb384b2308639b0dd695e052beb099239f04 172.31.2.115:32444@31013,rediscl-huzdsq-shard-wvn-0.rediscl-huzdsq-shard-wvn-headless.ns-xqred.svc.cluster.local master - 0 1750328848582 2 connected 6827-10922 6805dfae60f82469d32f167a0762f10b9fe532dc 172.31.2.115:30964@30479,rediscl-huzdsq-shard-fwk-0.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local master - 0 1750328847577 1 connected 1365-5460 --- 集群状态信息 --- cluster_state:ok cluster_slots_assigned:16384 cluster_slots_ok:16384 cluster_slots_pfail:0 cluster_slots_fail:0 cluster_known_nodes:8 cluster_size:4 cluster_current_epoch:5 cluster_my_epoch:3 cluster_stats_messages_ping_sent:875 cluster_stats_messages_pong_sent:859 cluster_stats_messages_meet_sent:2 cluster_stats_messages_update_sent:4 cluster_stats_messages_sent:1740 cluster_stats_messages_ping_received:856 cluster_stats_messages_pong_received:4971 cluster_stats_messages_meet_received:3 cluster_stats_messages_update_received:2 cluster_stats_messages_received:5832 total_cluster_links_buffer_limit_exceeded:0 ========== 节点: rediscl-huzdsq-shard-tt9-1 ========== 检测到基础名称: rediscl-huzdsq-shard-tt9, 分片编号: 1 使用 Secret: rediscl-huzdsq-shard-tt9-account-default 密码获取成功，前缀: Xm... 使用Pod环境变量中的Redis端口: 6379 --- 集群节点信息 --- 6805dfae60f82469d32f167a0762f10b9fe532dc 172.31.2.115:30964@30479,rediscl-huzdsq-shard-fwk-0.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local master - 0 1750328855560 1 connected 1365-5460 fb7b00f6dbf1252875b2ec80a6473bb2900a6bc5 172.31.13.158:31917@32641,rediscl-huzdsq-shard-wvn-1.rediscl-huzdsq-shard-wvn-headless.ns-xqred.svc.cluster.local slave efb2cb384b2308639b0dd695e052beb099239f04 0 1750328855000 2 connected f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 172.31.5.137:32508@31084,rediscl-huzdsq-shard-bfc-1.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local slave a5d4fc43276d727e0f162488944b68ba7c1e439d 0 1750328855560 5 connected f1e5ba6810221fd9b7af42fc1ff2907eaed2b142 172.31.13.158:31209@30928,rediscl-huzdsq-shard-fwk-1.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local slave 6805dfae60f82469d32f167a0762f10b9fe532dc 0 1750328855000 1 connected 566610eaebef8ad78e4fa9a8957436093634de2c 172.31.12.213:31054@30545,rediscl-huzdsq-shard-tt9-1.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local myself,slave 9a47e108282ae378589e88936924a2f36a944e1a 0 1750328853000 3 connected a5d4fc43276d727e0f162488944b68ba7c1e439d 172.31.12.213:32496@30676,rediscl-huzdsq-shard-bfc-0.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local master - 0 1750328855358 5 connected 0-1364 5461-6826 10923-12287 efb2cb384b2308639b0dd695e052beb099239f04 172.31.2.115:32444@31013,rediscl-huzdsq-shard-wvn-0.rediscl-huzdsq-shard-wvn-headless.ns-xqred.svc.cluster.local master - 0 1750328855000 2 connected 6827-10922 9a47e108282ae378589e88936924a2f36a944e1a 172.31.12.213:30626@31966,rediscl-huzdsq-shard-tt9-0.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local master - 0 1750328855000 3 connected 12288-16383 --- 集群状态信息 --- cluster_state:ok cluster_slots_assigned:16384 cluster_slots_ok:16384 cluster_slots_pfail:0 cluster_slots_fail:0 cluster_known_nodes:8 cluster_size:4 cluster_current_epoch:5 cluster_my_epoch:3 cluster_stats_messages_ping_sent:927 cluster_stats_messages_pong_sent:931 cluster_stats_messages_meet_sent:1 cluster_stats_messages_fail_sent:10 cluster_stats_messages_auth-req_sent:5 cluster_stats_messages_update_sent:4 cluster_stats_messages_sent:1878 cluster_stats_messages_ping_received:931 cluster_stats_messages_pong_received:5019 cluster_stats_messages_fail_received:3 cluster_stats_messages_update_received:6 cluster_stats_messages_received:5959 total_cluster_links_buffer_limit_exceeded:0 ========== 节点: rediscl-huzdsq-shard-wvn-0 ========== 检测到基础名称: rediscl-huzdsq-shard-wvn, 分片编号: 0 使用 Secret: rediscl-huzdsq-shard-wvn-account-default 密码获取成功，前缀: Xm... 使用Pod环境变量中的Redis端口: 6379 --- 集群节点信息 --- f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 172.31.5.137:32508@31084,rediscl-huzdsq-shard-bfc-1.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local slave a5d4fc43276d727e0f162488944b68ba7c1e439d 0 1750328862554 5 connected 566610eaebef8ad78e4fa9a8957436093634de2c 172.31.12.213:31054@30545,rediscl-huzdsq-shard-tt9-1.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local slave 9a47e108282ae378589e88936924a2f36a944e1a 0 1750328861000 3 connected f1e5ba6810221fd9b7af42fc1ff2907eaed2b142 172.31.13.158:31209@30928,rediscl-huzdsq-shard-fwk-1.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local slave 6805dfae60f82469d32f167a0762f10b9fe532dc 0 1750328862000 1 connected a5d4fc43276d727e0f162488944b68ba7c1e439d 172.31.12.213:32496@30676,rediscl-huzdsq-shard-bfc-0.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local master - 0 1750328861000 5 connected 0-1364 5461-6826 10923-12287 6805dfae60f82469d32f167a0762f10b9fe532dc 172.31.2.115:30964@30479,rediscl-huzdsq-shard-fwk-0.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local master - 0 1750328862000 1 connected 1365-5460 9a47e108282ae378589e88936924a2f36a944e1a 172.31.12.213:30626@31966,rediscl-huzdsq-shard-tt9-0.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local master - 0 1750328862555 3 connected 12288-16383 efb2cb384b2308639b0dd695e052beb099239f04 172.31.2.115:32444@31013,rediscl-huzdsq-shard-wvn-0.rediscl-huzdsq-shard-wvn-headless.ns-xqred.svc.cluster.local myself,master - 0 1750328860000 2 connected 6827-10922 fb7b00f6dbf1252875b2ec80a6473bb2900a6bc5 172.31.13.158:31917@32641,rediscl-huzdsq-shard-wvn-1.rediscl-huzdsq-shard-wvn-headless.ns-xqred.svc.cluster.local slave efb2cb384b2308639b0dd695e052beb099239f04 0 1750328862554 2 connected --- 集群状态信息 --- cluster_state:ok cluster_slots_assigned:16384 cluster_slots_ok:16384 cluster_slots_pfail:0 cluster_slots_fail:0 cluster_known_nodes:8 cluster_size:4 cluster_current_epoch:5 cluster_my_epoch:2 cluster_stats_messages_ping_sent:924 cluster_stats_messages_pong_sent:903 cluster_stats_messages_meet_sent:2 cluster_stats_messages_fail_sent:5 cluster_stats_messages_update_sent:4 cluster_stats_messages_sent:1838 cluster_stats_messages_ping_received:901 cluster_stats_messages_pong_received:5021 cluster_stats_messages_meet_received:2 cluster_stats_messages_fail_received:1 cluster_stats_messages_update_received:1 cluster_stats_messages_received:5926 total_cluster_links_buffer_limit_exceeded:0 ========== 节点: rediscl-huzdsq-shard-wvn-1 ========== 检测到基础名称: rediscl-huzdsq-shard-wvn, 分片编号: 1 使用 Secret: rediscl-huzdsq-shard-wvn-account-default 密码获取成功，前缀: Xm... 使用Pod环境变量中的Redis端口: 6379 --- 集群节点信息 --- f1e5ba6810221fd9b7af42fc1ff2907eaed2b142 172.31.13.158:31209@30928,rediscl-huzdsq-shard-fwk-1.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local slave 6805dfae60f82469d32f167a0762f10b9fe532dc 0 1750328868000 1 connected 566610eaebef8ad78e4fa9a8957436093634de2c 172.31.12.213:31054@30545,rediscl-huzdsq-shard-tt9-1.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local slave 9a47e108282ae378589e88936924a2f36a944e1a 0 1750328868000 3 connected a5d4fc43276d727e0f162488944b68ba7c1e439d 172.31.12.213:32496@30676,rediscl-huzdsq-shard-bfc-0.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local master - 0 1750328868000 5 connected 0-1364 5461-6826 10923-12287 fb7b00f6dbf1252875b2ec80a6473bb2900a6bc5 172.31.13.158:31917@32641,rediscl-huzdsq-shard-wvn-1.rediscl-huzdsq-shard-wvn-headless.ns-xqred.svc.cluster.local myself,slave efb2cb384b2308639b0dd695e052beb099239f04 0 1750328868000 2 connected 9a47e108282ae378589e88936924a2f36a944e1a 172.31.12.213:30626@31966,rediscl-huzdsq-shard-tt9-0.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local master - 0 1750328869550 3 connected 12288-16383 f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 172.31.5.137:32508@31084,rediscl-huzdsq-shard-bfc-1.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local slave a5d4fc43276d727e0f162488944b68ba7c1e439d 0 1750328869000 5 connected 6805dfae60f82469d32f167a0762f10b9fe532dc 172.31.2.115:30964@30479,rediscl-huzdsq-shard-fwk-0.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local master - 0 1750328869550 1 connected 1365-5460 efb2cb384b2308639b0dd695e052beb099239f04 172.31.2.115:32444@31013,rediscl-huzdsq-shard-wvn-0.rediscl-huzdsq-shard-wvn-headless.ns-xqred.svc.cluster.local master - 0 1750328868545 2 connected 6827-10922 --- 集群状态信息 --- cluster_state:ok cluster_slots_assigned:16384 cluster_slots_ok:16384 cluster_slots_pfail:0 cluster_slots_fail:0 cluster_known_nodes:8 cluster_size:4 cluster_current_epoch:5 cluster_my_epoch:2 cluster_stats_messages_ping_sent:959 cluster_stats_messages_pong_sent:964 cluster_stats_messages_meet_sent:1 cluster_stats_messages_fail_sent:10 cluster_stats_messages_update_sent:3 cluster_stats_messages_sent:1937 cluster_stats_messages_ping_received:964 cluster_stats_messages_pong_received:5051 cluster_stats_messages_fail_received:2 cluster_stats_messages_auth-req_received:1 cluster_stats_messages_update_received:11 cluster_stats_messages_received:6029 total_cluster_links_buffer_limit_exceeded:0 ========== 集群健康分析 ========== 使用节点 rediscl-huzdsq-shard-bfc-0 作为参考基准 检测到以下分片标识符: - bfc - fwk - tt9 - wvn 参考节点观察到的拓扑结构: ID IP地址 状态 主节点ID 槽位 ---------------------------------------- ------------- ---------------- ---------------------------------------- -------------- efb2cb384b2308639b0dd695e052beb099239f04 172.31.2.115:32444 主节点 - 6827-10922 (共 0 个槽位) 6805dfae60f82469d32f167a0762f10b9fe532dc 172.31.2.115:30964 主节点 - 1365-5460 (共 0 个槽位) 9a47e108282ae378589e88936924a2f36a944e1a 172.31.12.213:30626 主节点 - 12288-16383 (共 0 个槽位) f1e5ba6810221fd9b7af42fc1ff2907eaed2b142 172.31.13.158:31209 从节点 6805dfae60f82469d32f167a0762f10b9fe532dc fb7b00f6dbf1252875b2ec80a6473bb2900a6bc5 172.31.13.158:31917 从节点 efb2cb384b2308639b0dd695e052beb099239f04 566610eaebef8ad78e4fa9a8957436093634de2c 172.31.12.213:31054 从节点 9a47e108282ae378589e88936924a2f36a944e1a f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 172.31.5.137:32508 从节点 a5d4fc43276d727e0f162488944b68ba7c1e439d a5d4fc43276d727e0f162488944b68ba7c1e439d 172.31.12.213:32496 主节点 - 0-1364 5461-6826 10923-12287 (共 0 个槽位) 正在分析节点 rediscl-huzdsq-shard-bfc-1 的拓扑视图... 正在分析节点 rediscl-huzdsq-shard-fwk-0 的拓扑视图... 正在分析节点 rediscl-huzdsq-shard-fwk-1 的拓扑视图... 正在分析节点 rediscl-huzdsq-shard-tt9-0 的拓扑视图... 正在分析节点 rediscl-huzdsq-shard-tt9-1 的拓扑视图... 正在分析节点 rediscl-huzdsq-shard-wvn-0 的拓扑视图... 正在分析节点 rediscl-huzdsq-shard-wvn-1 的拓扑视图... 槽位分配统计: - 总槽位数: 16384 - 未覆盖槽位数: 0 - 重复覆盖槽位数: 0 - 正确覆盖槽位数: 16384 主节点槽位分配明细: 节点 efb2cb384b2308639b0dd695e052beb099239f04 (172.31.2.115:32444) 负责 0 个槽位: 6827-10922 节点 6805dfae60f82469d32f167a0762f10b9fe532dc (172.31.2.115:30964) 负责 0 个槽位: 1365-5460 节点 9a47e108282ae378589e88936924a2f36a944e1a (172.31.12.213:30626) 负责 0 个槽位: 12288-16383 节点 a5d4fc43276d727e0f162488944b68ba7c1e439d (172.31.12.213:32496) 负责 0 个槽位: 0-1364 5461-6826 10923-12287 总计分配槽位: 0 / 16384 警告: 分配的总槽位数 (0) 不等于 16384 缺少 16384 个槽位分配 分片分析: 分片 bfc: 1 个主节点, 1 个从节点 ✅ 分片 fwk: 1 个主节点, 1 个从节点 ✅ 分片 tt9: 1 个主节点, 1 个从节点 ✅ 分片 wvn: 1 个主节点, 1 个从节点 ✅ 集群分析总结: - 检测到 4 个主节点和 4 个从节点 - 检测到 0 个故障或疑似故障节点 - 集群状态统一显示为OK: 是 - 所有槽位正确分配: 是 - 所有节点看到一致的集群大小: 是 - 所有节点看到一致的拓扑结构: 是 - 所有槽位被正确覆盖: 是 - 集群中无故障或疑似故障节点: 是 集群健康状态: 健康 ✅ 所有检查均通过，Redis集群运行正常。 analyze cluster health success No resources found in ns-xqred namespace. job pod status: No resources found in ns-xqred namespace. job pod status: No resources found in ns-xqred namespace. job pod status: No resources found in ns-xqred namespace. job pod status: No resources found in ns-xqred namespace. job pod status: No resources found in ns-xqred namespace. job pod status: No resources found in ns-xqred namespace. job pod status: No resources found in ns-xqred namespace. job pod status: No resources found in ns-xqred namespace. job pod status: No resources found in ns-xqred namespace. job pod status: No resources found in ns-xqred namespace. job pod status: No resources found in ns-xqred namespace. job pod status: No resources found in ns-xqred namespace. job pod status: No resources found in ns-xqred namespace. check rediscl-huzdsq post-provision skip patch rediscl-huzdsq shards 3 `kubectl patch cluster rediscl-huzdsq --namespace ns-xqred --type json -p '[***"op": "replace", "path": "/spec/shardingSpecs/0/shards", "value": '3'***]'` cluster.apps.kubeblocks.io/rediscl-huzdsq patched check cluster status `kbcli cluster list rediscl-huzdsq --show-labels --namespace ns-xqred ` NAME NAMESPACE CLUSTER-DEFINITION VERSION TERMINATION-POLICY STATUS CREATED-TIME LABELS rediscl-huzdsq ns-xqred Halt Running Jun 19,2025 18:15 UTC+0800 app.kubernetes.io/instance=rediscl-huzdsq check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances rediscl-huzdsq --namespace ns-xqred ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME rediscl-huzdsq-shard-bfc-0 ns-xqred rediscl-huzdsq shard-bfc Running primary us-west-2a 100m / 100m 512Mi / 512Mi ip-172-31-12-213.us-west-2.compute.internal/172.31.12.213 Jun 19,2025 18:22 UTC+0800 rediscl-huzdsq-shard-bfc-1 ns-xqred rediscl-huzdsq shard-bfc Running secondary us-west-2a 100m / 100m 512Mi / 512Mi ip-172-31-5-137.us-west-2.compute.internal/172.31.5.137 Jun 19,2025 18:22 UTC+0800 rediscl-huzdsq-shard-fwk-0 ns-xqred rediscl-huzdsq shard-fwk Running primary us-west-2a 100m / 100m 512Mi / 512Mi ip-172-31-2-115.us-west-2.compute.internal/172.31.2.115 Jun 19,2025 18:20 UTC+0800 rediscl-huzdsq-shard-fwk-1 ns-xqred rediscl-huzdsq shard-fwk Running secondary us-west-2a 100m / 100m 512Mi / 512Mi ip-172-31-13-158.us-west-2.compute.internal/172.31.13.158 Jun 19,2025 18:19 UTC+0800 rediscl-huzdsq-shard-tt9-0 ns-xqred rediscl-huzdsq shard-tt9 Running primary us-west-2a 100m / 100m 512Mi / 512Mi ip-172-31-12-213.us-west-2.compute.internal/172.31.12.213 Jun 19,2025 18:20 UTC+0800 rediscl-huzdsq-shard-tt9-1 ns-xqred rediscl-huzdsq shard-tt9 Running secondary us-west-2a 100m / 100m 512Mi / 512Mi ip-172-31-12-213.us-west-2.compute.internal/172.31.12.213 Jun 19,2025 18:19 UTC+0800 rediscl-huzdsq-shard-wvn-0 ns-xqred rediscl-huzdsq shard-wvn Running primary us-west-2a 100m / 100m 512Mi / 512Mi ip-172-31-2-115.us-west-2.compute.internal/172.31.2.115 Jun 19,2025 18:20 UTC+0800 rediscl-huzdsq-shard-wvn-1 ns-xqred rediscl-huzdsq shard-wvn Running secondary us-west-2a 100m / 100m 512Mi / 512Mi ip-172-31-13-158.us-west-2.compute.internal/172.31.13.158 Jun 19,2025 18:19 UTC+0800 check pod status done check cluster role check cluster role done primary: rediscl-huzdsq-shard-bfc-0 rediscl-huzdsq-shard-fwk-0 rediscl-huzdsq-shard-tt9-0 rediscl-huzdsq-shard-wvn-0;secondary: rediscl-huzdsq-shard-bfc-1 rediscl-huzdsq-shard-fwk-1 rediscl-huzdsq-shard-tt9-1 rediscl-huzdsq-shard-wvn-1 analyze cluster health check cluster connect `` ========== 节点: kb-pre-terminate-job-rediscl-huzdsq-shard-wvn-2mgjp ========== 无法识别分片编号，跳过该节点 ========== 节点: rediscl-huzdsq-shard-bfc-0 ========== 检测到基础名称: rediscl-huzdsq-shard-bfc, 分片编号: 0 使用 Secret: rediscl-huzdsq-shard-bfc-account-default 密码获取成功，前缀: Xm... 使用Pod环境变量中的Redis端口: 6379 --- 集群节点信息 --- efb2cb384b2308639b0dd695e052beb099239f04 172.31.2.115:32444@31013,rediscl-huzdsq-shard-wvn-0.rediscl-huzdsq-shard-wvn-headless.ns-xqred.svc.cluster.local master - 0 1750329026269 2 connected 7751-10922 6805dfae60f82469d32f167a0762f10b9fe532dc 172.31.2.115:30964@30479,rediscl-huzdsq-shard-fwk-0.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local master - 0 1750329026165 1 connected 1365-5460 9a47e108282ae378589e88936924a2f36a944e1a 172.31.12.213:30626@31966,rediscl-huzdsq-shard-tt9-0.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local master - 0 1750329026000 3 connected 12288-16383 f1e5ba6810221fd9b7af42fc1ff2907eaed2b142 172.31.13.158:31209@30928,rediscl-huzdsq-shard-fwk-1.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local slave 6805dfae60f82469d32f167a0762f10b9fe532dc 0 1750329025765 1 connected fb7b00f6dbf1252875b2ec80a6473bb2900a6bc5 172.31.13.158:31917@32641,rediscl-huzdsq-shard-wvn-1.rediscl-huzdsq-shard-wvn-headless.ns-xqred.svc.cluster.local slave efb2cb384b2308639b0dd695e052beb099239f04 0 1750329026569 2 connected 566610eaebef8ad78e4fa9a8957436093634de2c 172.31.12.213:31054@30545,rediscl-huzdsq-shard-tt9-1.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local slave 9a47e108282ae378589e88936924a2f36a944e1a 0 1750329026000 3 connected f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 172.31.5.137:32508@31084,rediscl-huzdsq-shard-bfc-1.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local slave a5d4fc43276d727e0f162488944b68ba7c1e439d 0 1750329025000 5 connected a5d4fc43276d727e0f162488944b68ba7c1e439d 172.31.12.213:32496@30676,rediscl-huzdsq-shard-bfc-0.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local myself,master - 0 1750329024000 5 connected 0-1364 5461-7750 10923-12287 --- 集群状态信息 --- cluster_state:ok cluster_slots_assigned:16384 cluster_slots_ok:16384 cluster_slots_pfail:0 cluster_slots_fail:0 cluster_known_nodes:8 cluster_size:4 cluster_current_epoch:5 cluster_my_epoch:5 cluster_stats_messages_ping_sent:1007 cluster_stats_messages_pong_sent:37113 cluster_stats_messages_meet_sent:1 cluster_stats_messages_update_sent:9 cluster_stats_messages_sent:38130 cluster_stats_messages_ping_received:999 cluster_stats_messages_pong_received:1008 cluster_stats_messages_meet_received:1 cluster_stats_messages_received:2008 total_cluster_links_buffer_limit_exceeded:0 ========== 节点: rediscl-huzdsq-shard-bfc-1 ========== 检测到基础名称: rediscl-huzdsq-shard-bfc, 分片编号: 1 使用 Secret: rediscl-huzdsq-shard-bfc-account-default 密码获取成功，前缀: Xm... 使用Pod环境变量中的Redis端口: 6379 --- 集群节点信息 --- efb2cb384b2308639b0dd695e052beb099239f04 172.31.2.115:32444@31013,rediscl-huzdsq-shard-wvn-0.rediscl-huzdsq-shard-wvn-headless.ns-xqred.svc.cluster.local master - 0 1750329033000 2 connected 8263-10922 a5d4fc43276d727e0f162488944b68ba7c1e439d 172.31.12.213:32496@30676,rediscl-huzdsq-shard-bfc-0.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local master - 0 1750329033000 5 connected 0-1364 5461-8192 10923-12287 f1e5ba6810221fd9b7af42fc1ff2907eaed2b142 172.31.13.158:31209@30928,rediscl-huzdsq-shard-fwk-1.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local slave 6805dfae60f82469d32f167a0762f10b9fe532dc 0 1750329032000 6 connected 566610eaebef8ad78e4fa9a8957436093634de2c 172.31.12.213:31054@30545,rediscl-huzdsq-shard-tt9-1.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local slave 9a47e108282ae378589e88936924a2f36a944e1a 0 1750329032541 3 connected 9a47e108282ae378589e88936924a2f36a944e1a 172.31.12.213:30626@31966,rediscl-huzdsq-shard-tt9-0.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local master - 0 1750329033000 3 connected 12288-16383 f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 172.31.5.137:32508@31084,rediscl-huzdsq-shard-bfc-1.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local myself,slave a5d4fc43276d727e0f162488944b68ba7c1e439d 0 1750329033000 5 connected fb7b00f6dbf1252875b2ec80a6473bb2900a6bc5 172.31.13.158:31917@32641,rediscl-huzdsq-shard-wvn-1.rediscl-huzdsq-shard-wvn-headless.ns-xqred.svc.cluster.local slave efb2cb384b2308639b0dd695e052beb099239f04 0 1750329033606 2 connected 6805dfae60f82469d32f167a0762f10b9fe532dc 172.31.2.115:30964@30479,rediscl-huzdsq-shard-fwk-0.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local master - 0 1750329032037 6 connected 1365-5460 8193-8262 --- 集群状态信息 --- cluster_state:ok cluster_slots_assigned:16384 cluster_slots_ok:16384 cluster_slots_pfail:0 cluster_slots_fail:0 cluster_known_nodes:8 cluster_size:4 cluster_current_epoch:6 cluster_my_epoch:5 cluster_stats_messages_ping_sent:949 cluster_stats_messages_pong_sent:957 cluster_stats_messages_meet_sent:1 cluster_stats_messages_update_sent:5 cluster_stats_messages_sent:1912 cluster_stats_messages_ping_received:957 cluster_stats_messages_pong_received:6607 cluster_stats_messages_received:7564 total_cluster_links_buffer_limit_exceeded:0 ========== 节点: rediscl-huzdsq-shard-fwk-0 ========== 检测到基础名称: rediscl-huzdsq-shard-fwk, 分片编号: 0 使用 Secret: rediscl-huzdsq-shard-fwk-account-default 密码获取成功，前缀: Xm... 使用Pod环境变量中的Redis端口: 6379 --- 集群节点信息 --- f1e5ba6810221fd9b7af42fc1ff2907eaed2b142 172.31.13.158:31209@30928,rediscl-huzdsq-shard-fwk-1.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local slave 6805dfae60f82469d32f167a0762f10b9fe532dc 0 1750329039000 6 connected fb7b00f6dbf1252875b2ec80a6473bb2900a6bc5 172.31.13.158:31917@32641,rediscl-huzdsq-shard-wvn-1.rediscl-huzdsq-shard-wvn-headless.ns-xqred.svc.cluster.local slave efb2cb384b2308639b0dd695e052beb099239f04 0 1750329038866 2 connected f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 172.31.5.137:32508@31084,rediscl-huzdsq-shard-bfc-1.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local slave a5d4fc43276d727e0f162488944b68ba7c1e439d 0 1750329039870 5 connected 6805dfae60f82469d32f167a0762f10b9fe532dc 172.31.2.115:30964@30479,rediscl-huzdsq-shard-fwk-0.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local myself,master - 0 1750329038000 6 connected 1365-5460 8193-8751 a5d4fc43276d727e0f162488944b68ba7c1e439d 172.31.12.213:32496@30676,rediscl-huzdsq-shard-bfc-0.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local master - 0 1750329039569 5 connected 0-1364 5461-8192 10923-12287 9a47e108282ae378589e88936924a2f36a944e1a 172.31.12.213:30626@31966,rediscl-huzdsq-shard-tt9-0.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local master - 0 1750329038563 3 connected 12288-16383 efb2cb384b2308639b0dd695e052beb099239f04 172.31.2.115:32444@31013,rediscl-huzdsq-shard-wvn-0.rediscl-huzdsq-shard-wvn-headless.ns-xqred.svc.cluster.local master - 0 1750329039000 2 connected 8752-10922 566610eaebef8ad78e4fa9a8957436093634de2c 172.31.12.213:31054@30545,rediscl-huzdsq-shard-tt9-1.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local slave 9a47e108282ae378589e88936924a2f36a944e1a 0 1750329039568 3 connected --- 集群状态信息 --- cluster_state:ok cluster_slots_assigned:16384 cluster_slots_ok:16384 cluster_slots_pfail:0 cluster_slots_fail:0 cluster_known_nodes:8 cluster_size:4 cluster_current_epoch:6 cluster_my_epoch:6 cluster_stats_messages_ping_sent:1331 cluster_stats_messages_pong_sent:6165 cluster_stats_messages_meet_sent:2 cluster_stats_messages_fail_sent:4 cluster_stats_messages_update_sent:4 cluster_stats_messages_sent:7506 cluster_stats_messages_ping_received:1312 cluster_stats_messages_pong_received:6795 cluster_stats_messages_meet_received:2 cluster_stats_messages_update_received:3 cluster_stats_messages_received:8112 total_cluster_links_buffer_limit_exceeded:0 ========== 节点: rediscl-huzdsq-shard-fwk-1 ========== 检测到基础名称: rediscl-huzdsq-shard-fwk, 分片编号: 1 使用 Secret: rediscl-huzdsq-shard-fwk-account-default 密码获取成功，前缀: Xm... 使用Pod环境变量中的Redis端口: 6379 --- 集群节点信息 --- a5d4fc43276d727e0f162488944b68ba7c1e439d 172.31.12.213:32496@30676,rediscl-huzdsq-shard-bfc-0.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local master - 0 1750329047000 5 connected 0-1364 5461-8192 10923-12287 efb2cb384b2308639b0dd695e052beb099239f04 172.31.2.115:32444@31013,rediscl-huzdsq-shard-wvn-0.rediscl-huzdsq-shard-wvn-headless.ns-xqred.svc.cluster.local master - 0 1750329046548 2 connected 9256-10922 f1e5ba6810221fd9b7af42fc1ff2907eaed2b142 172.31.13.158:31209@30928,rediscl-huzdsq-shard-fwk-1.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local myself,slave 6805dfae60f82469d32f167a0762f10b9fe532dc 0 1750329045000 6 connected 6805dfae60f82469d32f167a0762f10b9fe532dc 172.31.2.115:30964@30479,rediscl-huzdsq-shard-fwk-0.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local master - 0 1750329046000 6 connected 1365-5460 8193-9255 566610eaebef8ad78e4fa9a8957436093634de2c 172.31.12.213:31054@30545,rediscl-huzdsq-shard-tt9-1.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local slave 9a47e108282ae378589e88936924a2f36a944e1a 0 1750329047000 3 connected fb7b00f6dbf1252875b2ec80a6473bb2900a6bc5 172.31.13.158:31917@32641,rediscl-huzdsq-shard-wvn-1.rediscl-huzdsq-shard-wvn-headless.ns-xqred.svc.cluster.local slave efb2cb384b2308639b0dd695e052beb099239f04 0 1750329046000 2 connected f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 172.31.5.137:32508@31084,rediscl-huzdsq-shard-bfc-1.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local slave a5d4fc43276d727e0f162488944b68ba7c1e439d 0 1750329047047 5 connected 9a47e108282ae378589e88936924a2f36a944e1a 172.31.12.213:30626@31966,rediscl-huzdsq-shard-tt9-0.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local master - 0 1750329046000 3 connected 12288-16383 --- 集群状态信息 --- cluster_state:ok cluster_slots_assigned:16384 cluster_slots_ok:16384 cluster_slots_pfail:0 cluster_slots_fail:0 cluster_known_nodes:8 cluster_size:4 cluster_current_epoch:6 cluster_my_epoch:6 cluster_stats_messages_ping_sent:1380 cluster_stats_messages_pong_sent:1392 cluster_stats_messages_meet_sent:1 cluster_stats_messages_update_sent:4 cluster_stats_messages_sent:2777 cluster_stats_messages_ping_received:1392 cluster_stats_messages_pong_received:8039 cluster_stats_messages_fail_received:3 cluster_stats_messages_auth-req_received:1 cluster_stats_messages_update_received:13 cluster_stats_messages_received:9448 total_cluster_links_buffer_limit_exceeded:0 ========== 节点: rediscl-huzdsq-shard-tt9-0 ========== 检测到基础名称: rediscl-huzdsq-shard-tt9, 分片编号: 0 使用 Secret: rediscl-huzdsq-shard-tt9-account-default 密码获取成功，前缀: Xm... 使用Pod环境变量中的Redis端口: 6379 --- 集群节点信息 --- a5d4fc43276d727e0f162488944b68ba7c1e439d 172.31.12.213:32496@30676,rediscl-huzdsq-shard-bfc-0.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local master - 0 1750329054165 5 connected 0-1364 5461-8192 10923-12287 f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 172.31.5.137:32508@31084,rediscl-huzdsq-shard-bfc-1.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local slave a5d4fc43276d727e0f162488944b68ba7c1e439d 0 1750329052555 5 connected 566610eaebef8ad78e4fa9a8957436093634de2c 172.31.12.213:31054@30545,rediscl-huzdsq-shard-tt9-1.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local slave 9a47e108282ae378589e88936924a2f36a944e1a 0 1750329052000 7 connected 9a47e108282ae378589e88936924a2f36a944e1a 172.31.12.213:30626@31966,rediscl-huzdsq-shard-tt9-0.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local myself,master - 0 1750329052000 7 connected 9558-9790 12288-16383 f1e5ba6810221fd9b7af42fc1ff2907eaed2b142 172.31.13.158:31209@30928,rediscl-huzdsq-shard-fwk-1.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local slave 6805dfae60f82469d32f167a0762f10b9fe532dc 0 1750329053000 6 connected fb7b00f6dbf1252875b2ec80a6473bb2900a6bc5 172.31.13.158:31917@32641,rediscl-huzdsq-shard-wvn-1.rediscl-huzdsq-shard-wvn-headless.ns-xqred.svc.cluster.local slave efb2cb384b2308639b0dd695e052beb099239f04 0 1750329053564 2 connected efb2cb384b2308639b0dd695e052beb099239f04 172.31.2.115:32444@31013,rediscl-huzdsq-shard-wvn-0.rediscl-huzdsq-shard-wvn-headless.ns-xqred.svc.cluster.local master - 0 1750329052102 2 connected 9791-10922 6805dfae60f82469d32f167a0762f10b9fe532dc 172.31.2.115:30964@30479,rediscl-huzdsq-shard-fwk-0.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local master - 0 1750329053161 6 connected 1365-5460 8193-9557 --- 集群状态信息 --- cluster_state:ok cluster_slots_assigned:16384 cluster_slots_ok:16384 cluster_slots_pfail:0 cluster_slots_fail:0 cluster_known_nodes:8 cluster_size:4 cluster_current_epoch:7 cluster_my_epoch:7 cluster_stats_messages_ping_sent:1339 cluster_stats_messages_pong_sent:4059 cluster_stats_messages_meet_sent:2 cluster_stats_messages_update_sent:7 cluster_stats_messages_sent:5407 cluster_stats_messages_ping_received:1340 cluster_stats_messages_pong_received:8166 cluster_stats_messages_meet_received:3 cluster_stats_messages_update_received:2 cluster_stats_messages_received:9511 total_cluster_links_buffer_limit_exceeded:0 ========== 节点: rediscl-huzdsq-shard-tt9-1 ========== 检测到基础名称: rediscl-huzdsq-shard-tt9, 分片编号: 1 使用 Secret: rediscl-huzdsq-shard-tt9-account-default 密码获取成功，前缀: Xm... 使用Pod环境变量中的Redis端口: 6379 --- 集群节点信息 --- 6805dfae60f82469d32f167a0762f10b9fe532dc 172.31.2.115:30964@30479,rediscl-huzdsq-shard-fwk-0.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local master - 0 1750329060959 6 connected 1365-5460 8193-9557 fb7b00f6dbf1252875b2ec80a6473bb2900a6bc5 172.31.13.158:31917@32641,rediscl-huzdsq-shard-wvn-1.rediscl-huzdsq-shard-wvn-headless.ns-xqred.svc.cluster.local slave efb2cb384b2308639b0dd695e052beb099239f04 0 1750329059000 2 connected f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 172.31.5.137:32508@31084,rediscl-huzdsq-shard-bfc-1.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local slave a5d4fc43276d727e0f162488944b68ba7c1e439d 0 1750329059507 5 connected f1e5ba6810221fd9b7af42fc1ff2907eaed2b142 172.31.13.158:31209@30928,rediscl-huzdsq-shard-fwk-1.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local slave 6805dfae60f82469d32f167a0762f10b9fe532dc 0 1750329060000 6 connected 566610eaebef8ad78e4fa9a8957436093634de2c 172.31.12.213:31054@30545,rediscl-huzdsq-shard-tt9-1.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local myself,slave 9a47e108282ae378589e88936924a2f36a944e1a 0 1750329060000 7 connected a5d4fc43276d727e0f162488944b68ba7c1e439d 172.31.12.213:32496@30676,rediscl-huzdsq-shard-bfc-0.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local master - 0 1750329060516 5 connected 0-1364 5461-8192 10923-12287 efb2cb384b2308639b0dd695e052beb099239f04 172.31.2.115:32444@31013,rediscl-huzdsq-shard-wvn-0.rediscl-huzdsq-shard-wvn-headless.ns-xqred.svc.cluster.local master - 0 1750329061000 2 connected 10410-10922 9a47e108282ae378589e88936924a2f36a944e1a 172.31.12.213:30626@31966,rediscl-huzdsq-shard-tt9-0.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local master - 0 1750329059507 7 connected 9558-10409 12288-16383 --- 集群状态信息 --- cluster_state:ok cluster_slots_assigned:16384 cluster_slots_ok:16384 cluster_slots_pfail:0 cluster_slots_fail:0 cluster_known_nodes:8 cluster_size:4 cluster_current_epoch:7 cluster_my_epoch:7 cluster_stats_messages_ping_sent:1409 cluster_stats_messages_pong_sent:1391 cluster_stats_messages_meet_sent:1 cluster_stats_messages_fail_sent:10 cluster_stats_messages_auth-req_sent:5 cluster_stats_messages_update_sent:11 cluster_stats_messages_sent:2827 cluster_stats_messages_ping_received:1391 cluster_stats_messages_pong_received:9262 cluster_stats_messages_fail_received:3 cluster_stats_messages_update_received:6 cluster_stats_messages_received:10662 total_cluster_links_buffer_limit_exceeded:0 ========== 节点: rediscl-huzdsq-shard-wvn-0 ========== 检测到基础名称: rediscl-huzdsq-shard-wvn, 分片编号: 0 使用 Secret: rediscl-huzdsq-shard-wvn-account-default 密码获取成功，前缀: Xm... 使用Pod环境变量中的Redis端口: 6379 --- 集群节点信息 --- f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 172.31.5.137:32508@31084,rediscl-huzdsq-shard-bfc-1.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local slave a5d4fc43276d727e0f162488944b68ba7c1e439d 0 1750329066354 5 connected 566610eaebef8ad78e4fa9a8957436093634de2c 172.31.12.213:31054@30545,rediscl-huzdsq-shard-tt9-1.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local slave 9a47e108282ae378589e88936924a2f36a944e1a 0 1750329067561 7 connected f1e5ba6810221fd9b7af42fc1ff2907eaed2b142 172.31.13.158:31209@30928,rediscl-huzdsq-shard-fwk-1.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local slave 6805dfae60f82469d32f167a0762f10b9fe532dc 0 1750329066000 6 connected a5d4fc43276d727e0f162488944b68ba7c1e439d 172.31.12.213:32496@30676,rediscl-huzdsq-shard-bfc-0.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local master - 0 1750329066000 5 connected 0-1364 5461-8192 10923-12287 6805dfae60f82469d32f167a0762f10b9fe532dc 172.31.2.115:30964@30479,rediscl-huzdsq-shard-fwk-0.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local master - 0 1750329067862 6 connected 1365-5460 8193-9557 9a47e108282ae378589e88936924a2f36a944e1a 172.31.12.213:30626@31966,rediscl-huzdsq-shard-tt9-0.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local master - 0 1750329067360 7 connected 9558-10922 12288-16383 efb2cb384b2308639b0dd695e052beb099239f04 172.31.2.115:32444@31013,rediscl-huzdsq-shard-wvn-0.rediscl-huzdsq-shard-wvn-headless.ns-xqred.svc.cluster.local myself,master - 0 1750329068000 2 connected fb7b00f6dbf1252875b2ec80a6473bb2900a6bc5 172.31.13.158:31917@32641,rediscl-huzdsq-shard-wvn-1.rediscl-huzdsq-shard-wvn-headless.ns-xqred.svc.cluster.local slave efb2cb384b2308639b0dd695e052beb099239f04 0 1750329068368 2 connected --- 集群状态信息 --- cluster_state:ok cluster_slots_assigned:16384 cluster_slots_ok:16384 cluster_slots_pfail:0 cluster_slots_fail:0 cluster_known_nodes:8 cluster_size:3 cluster_current_epoch:7 cluster_my_epoch:2 cluster_stats_messages_ping_sent:1386 cluster_stats_messages_pong_sent:1349 cluster_stats_messages_meet_sent:2 cluster_stats_messages_fail_sent:5 cluster_stats_messages_update_sent:6 cluster_stats_messages_sent:2748 cluster_stats_messages_ping_received:1347 cluster_stats_messages_pong_received:9579 cluster_stats_messages_meet_received:2 cluster_stats_messages_fail_received:1 cluster_stats_messages_update_received:4 cluster_stats_messages_received:10933 total_cluster_links_buffer_limit_exceeded:0 ========== 节点: rediscl-huzdsq-shard-wvn-1 ========== 检测到基础名称: rediscl-huzdsq-shard-wvn, 分片编号: 1 使用 Secret: rediscl-huzdsq-shard-wvn-account-default 密码获取成功，前缀: Xm... 使用Pod环境变量中的Redis端口: 6379 --- 集群节点信息 --- f1e5ba6810221fd9b7af42fc1ff2907eaed2b142 172.31.13.158:31209@30928,rediscl-huzdsq-shard-fwk-1.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local slave 6805dfae60f82469d32f167a0762f10b9fe532dc 0 1750329073545 6 connected 566610eaebef8ad78e4fa9a8957436093634de2c 172.31.12.213:31054@30545,rediscl-huzdsq-shard-tt9-1.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local slave 9a47e108282ae378589e88936924a2f36a944e1a 0 1750329074249 7 connected a5d4fc43276d727e0f162488944b68ba7c1e439d 172.31.12.213:32496@30676,rediscl-huzdsq-shard-bfc-0.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local master - 0 1750329074048 5 connected 0-1364 5461-8192 10923-12287 fb7b00f6dbf1252875b2ec80a6473bb2900a6bc5 172.31.13.158:31917@32641,rediscl-huzdsq-shard-wvn-1.rediscl-huzdsq-shard-wvn-headless.ns-xqred.svc.cluster.local myself,slave efb2cb384b2308639b0dd695e052beb099239f04 0 1750329073000 2 connected 9a47e108282ae378589e88936924a2f36a944e1a 172.31.12.213:30626@31966,rediscl-huzdsq-shard-tt9-0.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local master - 0 1750329074000 7 connected 9558-10922 12288-16383 f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 172.31.5.137:32508@31084,rediscl-huzdsq-shard-bfc-1.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local slave a5d4fc43276d727e0f162488944b68ba7c1e439d 0 1750329073244 5 connected 6805dfae60f82469d32f167a0762f10b9fe532dc 172.31.2.115:30964@30479,rediscl-huzdsq-shard-fwk-0.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local master - 0 1750329073000 6 connected 1365-5460 8193-9557 efb2cb384b2308639b0dd695e052beb099239f04 172.31.2.115:32444@31013,rediscl-huzdsq-shard-wvn-0.rediscl-huzdsq-shard-wvn-headless.ns-xqred.svc.cluster.local master - 0 1750329073000 2 connected --- 集群状态信息 --- cluster_state:ok cluster_slots_assigned:16384 cluster_slots_ok:16384 cluster_slots_pfail:0 cluster_slots_fail:0 cluster_known_nodes:8 cluster_size:3 cluster_current_epoch:7 cluster_my_epoch:2 cluster_stats_messages_ping_sent:1426 cluster_stats_messages_pong_sent:1433 cluster_stats_messages_meet_sent:1 cluster_stats_messages_fail_sent:10 cluster_stats_messages_update_sent:3 cluster_stats_messages_sent:2873 cluster_stats_messages_ping_received:1433 cluster_stats_messages_pong_received:9614 cluster_stats_messages_fail_received:2 cluster_stats_messages_auth-req_received:1 cluster_stats_messages_update_received:34 cluster_stats_messages_received:11084 total_cluster_links_buffer_limit_exceeded:0 ========== 集群健康分析 ========== 使用节点 rediscl-huzdsq-shard-bfc-0 作为参考基准 检测到以下分片标识符: - bfc - fwk - tt9 - wvn 警告: 节点 rediscl-huzdsq-shard-wvn-0 报告集群大小为 '3'，与第一个节点报告的 '4' 不一致 警告: 节点 rediscl-huzdsq-shard-wvn-1 报告集群大小为 '3'，与第一个节点报告的 '4' 不一致 参考节点观察到的拓扑结构: ID IP地址 状态 主节点ID 槽位 ---------------------------------------- ------------- ---------------- ---------------------------------------- -------------- efb2cb384b2308639b0dd695e052beb099239f04 172.31.2.115:32444 主节点 - 7751-10922 (共 0 个槽位) 6805dfae60f82469d32f167a0762f10b9fe532dc 172.31.2.115:30964 主节点 - 1365-5460 (共 0 个槽位) 9a47e108282ae378589e88936924a2f36a944e1a 172.31.12.213:30626 主节点 - 12288-16383 (共 0 个槽位) f1e5ba6810221fd9b7af42fc1ff2907eaed2b142 172.31.13.158:31209 从节点 6805dfae60f82469d32f167a0762f10b9fe532dc fb7b00f6dbf1252875b2ec80a6473bb2900a6bc5 172.31.13.158:31917 从节点 efb2cb384b2308639b0dd695e052beb099239f04 566610eaebef8ad78e4fa9a8957436093634de2c 172.31.12.213:31054 从节点 9a47e108282ae378589e88936924a2f36a944e1a f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 172.31.5.137:32508 从节点 a5d4fc43276d727e0f162488944b68ba7c1e439d a5d4fc43276d727e0f162488944b68ba7c1e439d 172.31.12.213:32496 主节点 - 0-1364 5461-7750 10923-12287 (共 0 个槽位) 正在分析节点 rediscl-huzdsq-shard-bfc-1 的拓扑视图... 正在分析节点 rediscl-huzdsq-shard-fwk-0 的拓扑视图... 正在分析节点 rediscl-huzdsq-shard-fwk-1 的拓扑视图... 正在分析节点 rediscl-huzdsq-shard-tt9-0 的拓扑视图... 正在分析节点 rediscl-huzdsq-shard-tt9-1 的拓扑视图... 正在分析节点 rediscl-huzdsq-shard-wvn-0 的拓扑视图... 正在分析节点 rediscl-huzdsq-shard-wvn-1 的拓扑视图... 槽位分配统计: - 总槽位数: 16384 - 未覆盖槽位数: 0 - 重复覆盖槽位数: 0 - 正确覆盖槽位数: 16384 主节点槽位分配明细: 节点 efb2cb384b2308639b0dd695e052beb099239f04 (172.31.2.115:32444) 负责 0 个槽位: 7751-10922 节点 6805dfae60f82469d32f167a0762f10b9fe532dc (172.31.2.115:30964) 负责 0 个槽位: 1365-5460 节点 9a47e108282ae378589e88936924a2f36a944e1a (172.31.12.213:30626) 负责 0 个槽位: 12288-16383 节点 a5d4fc43276d727e0f162488944b68ba7c1e439d (172.31.12.213:32496) 负责 0 个槽位: 0-1364 5461-7750 10923-12287 总计分配槽位: 0 / 16384 警告: 分配的总槽位数 (0) 不等于 16384 缺少 16384 个槽位分配 分片分析: 分片 bfc: 1 个主节点, 1 个从节点 ✅ 分片 fwk: 1 个主节点, 1 个从节点 ✅ 分片 tt9: 1 个主节点, 1 个从节点 ✅ 分片 wvn: 1 个主节点, 1 个从节点 ✅ 集群分析总结: - 检测到 4 个主节点和 4 个从节点 - 检测到 0 个故障或疑似故障节点 - 集群状态统一显示为OK: 是 - 所有槽位正确分配: 是 - 所有节点看到一致的集群大小: 否 - 所有节点看到一致的拓扑结构: 是 - 所有槽位被正确覆盖: 是 - 集群中无故障或疑似故障节点: 是 集群健康状态: 不健康 ❌ 检测到以下问题: - 集群视图不一致: 不同节点看到的集群大小或节点数量不同 建议措施: health analyzing... health analyzing... health analyzing... health analyzing... health analyzing... health analyzing... health analyzing... health analyzing... health analyzing... health analyzing... health analyzing... health analyzing... health analyzing... health analyzing... health analyzing... health analyzing... ========== 节点: rediscl-huzdsq-shard-bfc-0 ========== 检测到基础名称: rediscl-huzdsq-shard-bfc, 分片编号: 0 使用 Secret: rediscl-huzdsq-shard-bfc-account-default 密码获取成功，前缀: Xm... 使用Pod环境变量中的Redis端口: 6379 --- 集群节点信息 --- 6805dfae60f82469d32f167a0762f10b9fe532dc 172.31.2.115:30964@30479,rediscl-huzdsq-shard-fwk-0.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local master - 0 1750329302519 6 connected 1365-5460 8193-9557 9a47e108282ae378589e88936924a2f36a944e1a 172.31.12.213:30626@31966,rediscl-huzdsq-shard-tt9-0.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local master - 0 1750329302000 7 connected 9558-10922 12288-16383 f1e5ba6810221fd9b7af42fc1ff2907eaed2b142 172.31.13.158:31209@30928,rediscl-huzdsq-shard-fwk-1.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local slave 6805dfae60f82469d32f167a0762f10b9fe532dc 0 1750329303525 6 connected 566610eaebef8ad78e4fa9a8957436093634de2c 172.31.12.213:31054@30545,rediscl-huzdsq-shard-tt9-1.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local slave 9a47e108282ae378589e88936924a2f36a944e1a 0 1750329302620 7 connected f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 172.31.5.137:32508@31084,rediscl-huzdsq-shard-bfc-1.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local slave a5d4fc43276d727e0f162488944b68ba7c1e439d 0 1750329303626 5 connected a5d4fc43276d727e0f162488944b68ba7c1e439d 172.31.12.213:32496@30676,rediscl-huzdsq-shard-bfc-0.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local myself,master - 0 1750329302000 5 connected 0-1364 5461-8192 10923-12287 --- 集群状态信息 --- cluster_state:ok cluster_slots_assigned:16384 cluster_slots_ok:16384 cluster_slots_pfail:0 cluster_slots_fail:0 cluster_known_nodes:6 cluster_size:3 cluster_current_epoch:7 cluster_my_epoch:5 cluster_stats_messages_ping_sent:1527 cluster_stats_messages_pong_sent:39735 cluster_stats_messages_meet_sent:1 cluster_stats_messages_update_sent:12 cluster_stats_messages_sent:41275 cluster_stats_messages_ping_received:1500 cluster_stats_messages_pong_received:4258 cluster_stats_messages_meet_received:1 cluster_stats_messages_received:5759 total_cluster_links_buffer_limit_exceeded:0 ========== 节点: rediscl-huzdsq-shard-bfc-1 ========== 检测到基础名称: rediscl-huzdsq-shard-bfc, 分片编号: 1 使用 Secret: rediscl-huzdsq-shard-bfc-account-default 密码获取成功，前缀: Xm... 使用Pod环境变量中的Redis端口: 6379 --- 集群节点信息 --- a5d4fc43276d727e0f162488944b68ba7c1e439d 172.31.12.213:32496@30676,rediscl-huzdsq-shard-bfc-0.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local master - 0 1750329309474 5 connected 0-1364 5461-8192 10923-12287 f1e5ba6810221fd9b7af42fc1ff2907eaed2b142 172.31.13.158:31209@30928,rediscl-huzdsq-shard-fwk-1.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local slave 6805dfae60f82469d32f167a0762f10b9fe532dc 0 1750329310000 6 connected 566610eaebef8ad78e4fa9a8957436093634de2c 172.31.12.213:31054@30545,rediscl-huzdsq-shard-tt9-1.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local slave 9a47e108282ae378589e88936924a2f36a944e1a 0 1750329310981 7 connected 9a47e108282ae378589e88936924a2f36a944e1a 172.31.12.213:30626@31966,rediscl-huzdsq-shard-tt9-0.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local master - 0 1750329311482 7 connected 9558-10922 12288-16383 f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 172.31.5.137:32508@31084,rediscl-huzdsq-shard-bfc-1.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local myself,slave a5d4fc43276d727e0f162488944b68ba7c1e439d 0 1750329310000 5 connected 6805dfae60f82469d32f167a0762f10b9fe532dc 172.31.2.115:30964@30479,rediscl-huzdsq-shard-fwk-0.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local master - 0 1750329310478 6 connected 1365-5460 8193-9557 --- 集群状态信息 --- cluster_state:ok cluster_slots_assigned:16384 cluster_slots_ok:16384 cluster_slots_pfail:0 cluster_slots_fail:0 cluster_known_nodes:6 cluster_size:3 cluster_current_epoch:7 cluster_my_epoch:5 cluster_stats_messages_ping_sent:1458 cluster_stats_messages_pong_sent:1473 cluster_stats_messages_meet_sent:1 cluster_stats_messages_update_sent:7 cluster_stats_messages_sent:2939 cluster_stats_messages_ping_received:1473 cluster_stats_messages_pong_received:9651 cluster_stats_messages_received:11124 total_cluster_links_buffer_limit_exceeded:0 ========== 节点: rediscl-huzdsq-shard-fwk-0 ========== 检测到基础名称: rediscl-huzdsq-shard-fwk, 分片编号: 0 使用 Secret: rediscl-huzdsq-shard-fwk-account-default 密码获取成功，前缀: Xm... 使用Pod环境变量中的Redis端口: 6379 --- 集群节点信息 --- f1e5ba6810221fd9b7af42fc1ff2907eaed2b142 172.31.13.158:31209@30928,rediscl-huzdsq-shard-fwk-1.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local slave 6805dfae60f82469d32f167a0762f10b9fe532dc 0 1750329317000 6 connected f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 172.31.5.137:32508@31084,rediscl-huzdsq-shard-bfc-1.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local slave a5d4fc43276d727e0f162488944b68ba7c1e439d 0 1750329317599 5 connected 6805dfae60f82469d32f167a0762f10b9fe532dc 172.31.2.115:30964@30479,rediscl-huzdsq-shard-fwk-0.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local myself,master - 0 1750329317000 6 connected 1365-5460 8193-9557 a5d4fc43276d727e0f162488944b68ba7c1e439d 172.31.12.213:32496@30676,rediscl-huzdsq-shard-bfc-0.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local master - 0 1750329318503 5 connected 0-1364 5461-8192 10923-12287 9a47e108282ae378589e88936924a2f36a944e1a 172.31.12.213:30626@31966,rediscl-huzdsq-shard-tt9-0.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local master - 0 1750329317195 7 connected 9558-10922 12288-16383 566610eaebef8ad78e4fa9a8957436093634de2c 172.31.12.213:31054@30545,rediscl-huzdsq-shard-tt9-1.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local slave 9a47e108282ae378589e88936924a2f36a944e1a 0 1750329317699 7 connected --- 集群状态信息 --- cluster_state:ok cluster_slots_assigned:16384 cluster_slots_ok:16384 cluster_slots_pfail:0 cluster_slots_fail:0 cluster_known_nodes:6 cluster_size:3 cluster_current_epoch:7 cluster_my_epoch:6 cluster_stats_messages_ping_sent:1838 cluster_stats_messages_pong_sent:11393 cluster_stats_messages_meet_sent:2 cluster_stats_messages_fail_sent:4 cluster_stats_messages_update_sent:7 cluster_stats_messages_sent:13244 cluster_stats_messages_ping_received:1836 cluster_stats_messages_pong_received:8667 cluster_stats_messages_meet_received:2 cluster_stats_messages_update_received:3 cluster_stats_messages_received:10508 total_cluster_links_buffer_limit_exceeded:0 ========== 节点: rediscl-huzdsq-shard-fwk-1 ========== 检测到基础名称: rediscl-huzdsq-shard-fwk, 分片编号: 1 使用 Secret: rediscl-huzdsq-shard-fwk-account-default 密码获取成功，前缀: Xm... 使用Pod环境变量中的Redis端口: 6379 --- 集群节点信息 --- a5d4fc43276d727e0f162488944b68ba7c1e439d 172.31.12.213:32496@30676,rediscl-huzdsq-shard-bfc-0.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local master - 0 1750329324000 5 connected 0-1364 5461-8192 10923-12287 f1e5ba6810221fd9b7af42fc1ff2907eaed2b142 172.31.13.158:31209@30928,rediscl-huzdsq-shard-fwk-1.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local myself,slave 6805dfae60f82469d32f167a0762f10b9fe532dc 0 1750329323000 6 connected 6805dfae60f82469d32f167a0762f10b9fe532dc 172.31.2.115:30964@30479,rediscl-huzdsq-shard-fwk-0.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local master - 0 1750329322927 6 connected 1365-5460 8193-9557 566610eaebef8ad78e4fa9a8957436093634de2c 172.31.12.213:31054@30545,rediscl-huzdsq-shard-tt9-1.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local slave 9a47e108282ae378589e88936924a2f36a944e1a 0 1750329324936 7 connected f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 172.31.5.137:32508@31084,rediscl-huzdsq-shard-bfc-1.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local slave a5d4fc43276d727e0f162488944b68ba7c1e439d 0 1750329325036 5 connected 9a47e108282ae378589e88936924a2f36a944e1a 172.31.12.213:30626@31966,rediscl-huzdsq-shard-tt9-0.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local master - 0 1750329324434 7 connected 9558-10922 12288-16383 --- 集群状态信息 --- cluster_state:ok cluster_slots_assigned:16384 cluster_slots_ok:16384 cluster_slots_pfail:0 cluster_slots_fail:0 cluster_known_nodes:6 cluster_size:3 cluster_current_epoch:7 cluster_my_epoch:6 cluster_stats_messages_ping_sent:1893 cluster_stats_messages_pong_sent:1903 cluster_stats_messages_meet_sent:1 cluster_stats_messages_update_sent:7 cluster_stats_messages_sent:3804 cluster_stats_messages_ping_received:1903 cluster_stats_messages_pong_received:10082 cluster_stats_messages_fail_received:3 cluster_stats_messages_auth-req_received:1 cluster_stats_messages_update_received:13 cluster_stats_messages_received:12002 total_cluster_links_buffer_limit_exceeded:0 ========== 节点: rediscl-huzdsq-shard-tt9-0 ========== 检测到基础名称: rediscl-huzdsq-shard-tt9, 分片编号: 0 使用 Secret: rediscl-huzdsq-shard-tt9-account-default 密码获取成功，前缀: Xm... 使用Pod环境变量中的Redis端口: 6379 --- 集群节点信息 --- a5d4fc43276d727e0f162488944b68ba7c1e439d 172.31.12.213:32496@30676,rediscl-huzdsq-shard-bfc-0.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local master - 0 1750329330561 5 connected 0-1364 5461-8192 10923-12287 f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 172.31.5.137:32508@31084,rediscl-huzdsq-shard-bfc-1.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local slave a5d4fc43276d727e0f162488944b68ba7c1e439d 0 1750329331868 5 connected 566610eaebef8ad78e4fa9a8957436093634de2c 172.31.12.213:31054@30545,rediscl-huzdsq-shard-tt9-1.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local slave 9a47e108282ae378589e88936924a2f36a944e1a 0 1750329330000 7 connected 9a47e108282ae378589e88936924a2f36a944e1a 172.31.12.213:30626@31966,rediscl-huzdsq-shard-tt9-0.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local myself,master - 0 1750329329000 7 connected 9558-10922 12288-16383 f1e5ba6810221fd9b7af42fc1ff2907eaed2b142 172.31.13.158:31209@30928,rediscl-huzdsq-shard-fwk-1.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local slave 6805dfae60f82469d32f167a0762f10b9fe532dc 0 1750329331000 6 connected 6805dfae60f82469d32f167a0762f10b9fe532dc 172.31.2.115:30964@30479,rediscl-huzdsq-shard-fwk-0.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local master - 0 1750329330865 6 connected 1365-5460 8193-9557 --- 集群状态信息 --- cluster_state:ok cluster_slots_assigned:16384 cluster_slots_ok:16384 cluster_slots_pfail:0 cluster_slots_fail:0 cluster_known_nodes:6 cluster_size:3 cluster_current_epoch:7 cluster_my_epoch:7 cluster_stats_messages_ping_sent:1859 cluster_stats_messages_pong_sent:11410 cluster_stats_messages_meet_sent:2 cluster_stats_messages_update_sent:9 cluster_stats_messages_sent:13280 cluster_stats_messages_ping_received:1852 cluster_stats_messages_pong_received:8686 cluster_stats_messages_meet_received:3 cluster_stats_messages_update_received:2 cluster_stats_messages_received:10543 total_cluster_links_buffer_limit_exceeded:0 ========== 节点: rediscl-huzdsq-shard-tt9-1 ========== 检测到基础名称: rediscl-huzdsq-shard-tt9, 分片编号: 1 使用 Secret: rediscl-huzdsq-shard-tt9-account-default 密码获取成功，前缀: Xm... 使用Pod环境变量中的Redis端口: 6379 --- 集群节点信息 --- 6805dfae60f82469d32f167a0762f10b9fe532dc 172.31.2.115:30964@30479,rediscl-huzdsq-shard-fwk-0.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local master - 0 1750329337000 6 connected 1365-5460 8193-9557 f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 172.31.5.137:32508@31084,rediscl-huzdsq-shard-bfc-1.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local slave a5d4fc43276d727e0f162488944b68ba7c1e439d 0 1750329338510 5 connected f1e5ba6810221fd9b7af42fc1ff2907eaed2b142 172.31.13.158:31209@30928,rediscl-huzdsq-shard-fwk-1.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local slave 6805dfae60f82469d32f167a0762f10b9fe532dc 0 1750329338611 6 connected 566610eaebef8ad78e4fa9a8957436093634de2c 172.31.12.213:31054@30545,rediscl-huzdsq-shard-tt9-1.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local myself,slave 9a47e108282ae378589e88936924a2f36a944e1a 0 1750329337000 7 connected a5d4fc43276d727e0f162488944b68ba7c1e439d 172.31.12.213:32496@30676,rediscl-huzdsq-shard-bfc-0.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local master - 0 1750329338000 5 connected 0-1364 5461-8192 10923-12287 9a47e108282ae378589e88936924a2f36a944e1a 172.31.12.213:30626@31966,rediscl-huzdsq-shard-tt9-0.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local master - 0 1750329337607 7 connected 9558-10922 12288-16383 --- 集群状态信息 --- cluster_state:ok cluster_slots_assigned:16384 cluster_slots_ok:16384 cluster_slots_pfail:0 cluster_slots_fail:0 cluster_known_nodes:6 cluster_size:3 cluster_current_epoch:7 cluster_my_epoch:7 cluster_stats_messages_ping_sent:1924 cluster_stats_messages_pong_sent:1913 cluster_stats_messages_meet_sent:1 cluster_stats_messages_fail_sent:10 cluster_stats_messages_auth-req_sent:5 cluster_stats_messages_update_sent:11 cluster_stats_messages_sent:3864 cluster_stats_messages_ping_received:1913 cluster_stats_messages_pong_received:10112 cluster_stats_messages_fail_received:3 cluster_stats_messages_update_received:6 cluster_stats_messages_received:12034 total_cluster_links_buffer_limit_exceeded:0 ========== 集群健康分析 ========== 使用节点 rediscl-huzdsq-shard-bfc-0 作为参考基准 检测到以下分片标识符: - bfc - fwk - tt9 参考节点观察到的拓扑结构: ID IP地址 状态 主节点ID 槽位 ---------------------------------------- ------------- ---------------- ---------------------------------------- -------------- 6805dfae60f82469d32f167a0762f10b9fe532dc 172.31.2.115:30964 主节点 - 1365-5460 8193-9557 (共 0 个槽位) 9a47e108282ae378589e88936924a2f36a944e1a 172.31.12.213:30626 主节点 - 9558-10922 12288-16383 (共 0 个槽位) f1e5ba6810221fd9b7af42fc1ff2907eaed2b142 172.31.13.158:31209 从节点 6805dfae60f82469d32f167a0762f10b9fe532dc 566610eaebef8ad78e4fa9a8957436093634de2c 172.31.12.213:31054 从节点 9a47e108282ae378589e88936924a2f36a944e1a f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 172.31.5.137:32508 从节点 a5d4fc43276d727e0f162488944b68ba7c1e439d a5d4fc43276d727e0f162488944b68ba7c1e439d 172.31.12.213:32496 主节点 - 0-1364 5461-8192 10923-12287 (共 0 个槽位) 正在分析节点 rediscl-huzdsq-shard-bfc-1 的拓扑视图... 正在分析节点 rediscl-huzdsq-shard-fwk-0 的拓扑视图... 正在分析节点 rediscl-huzdsq-shard-fwk-1 的拓扑视图... 正在分析节点 rediscl-huzdsq-shard-tt9-0 的拓扑视图... 正在分析节点 rediscl-huzdsq-shard-tt9-1 的拓扑视图... 槽位分配统计: - 总槽位数: 16384 - 未覆盖槽位数: 0 - 重复覆盖槽位数: 0 - 正确覆盖槽位数: 16384 主节点槽位分配明细: 节点 6805dfae60f82469d32f167a0762f10b9fe532dc (172.31.2.115:30964) 负责 0 个槽位: 1365-5460 8193-9557 节点 9a47e108282ae378589e88936924a2f36a944e1a (172.31.12.213:30626) 负责 0 个槽位: 9558-10922 12288-16383 节点 a5d4fc43276d727e0f162488944b68ba7c1e439d (172.31.12.213:32496) 负责 0 个槽位: 0-1364 5461-8192 10923-12287 总计分配槽位: 0 / 16384 警告: 分配的总槽位数 (0) 不等于 16384 缺少 16384 个槽位分配 分片分析: 分片 bfc: 1 个主节点, 1 个从节点 ✅ 分片 fwk: 1 个主节点, 1 个从节点 ✅ 分片 tt9: 1 个主节点, 1 个从节点 ✅ 集群分析总结: - 检测到 3 个主节点和 3 个从节点 - 检测到 0 个故障或疑似故障节点 - 集群状态统一显示为OK: 是 - 所有槽位正确分配: 是 - 所有节点看到一致的集群大小: 是 - 所有节点看到一致的拓扑结构: 是 - 所有槽位被正确覆盖: 是 - 集群中无故障或疑似故障节点: 是 集群健康状态: 健康 ✅ 所有检查均通过，Redis集群运行正常。 analyze cluster health success No resources found in ns-xqred namespace. job pod status: No resources found in ns-xqred namespace. job pod status: No resources found in ns-xqred namespace. job pod status: No resources found in ns-xqred namespace. job pod status: No resources found in ns-xqred namespace. job pod status: No resources found in ns-xqred namespace. job pod status: No resources found in ns-xqred namespace. job pod status: No resources found in ns-xqred namespace. job pod status: No resources found in ns-xqred namespace. job pod status: No resources found in ns-xqred namespace. job pod status: No resources found in ns-xqred namespace. job pod status: No resources found in ns-xqred namespace. job pod status: No resources found in ns-xqred namespace. job pod status: No resources found in ns-xqred namespace. check rediscl-huzdsq pre-terminate skip get shard component name set shard component name:shard-fwk test failover podfailure check node drain check node drain success `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge PodChaos test-chaos-mesh-podfailure-rediscl-huzdsq --namespace ns-xqred ` Warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely. Error from server (NotFound): podchaos.chaos-mesh.org "test-chaos-mesh-podfailure-rediscl-huzdsq" not found Error from server (NotFound): podchaos.chaos-mesh.org "test-chaos-mesh-podfailure-rediscl-huzdsq" not found apiVersion: chaos-mesh.org/v1alpha1 kind: PodChaos metadata: name: test-chaos-mesh-podfailure-rediscl-huzdsq namespace: ns-xqred spec: selector: namespaces: - ns-xqred labelSelectors: apps.kubeblocks.io/pod-name: rediscl-huzdsq-shard-bfc-0 mode: all action: pod-failure duration: 2m `kubectl apply -f test-chaos-mesh-podfailure-rediscl-huzdsq.yaml` podchaos.chaos-mesh.org/test-chaos-mesh-podfailure-rediscl-huzdsq created apply test-chaos-mesh-podfailure-rediscl-huzdsq.yaml Success `rm -rf test-chaos-mesh-podfailure-rediscl-huzdsq.yaml` podfailure chaos test waiting 120 seconds check cluster status `kbcli cluster list rediscl-huzdsq --show-labels --namespace ns-xqred ` NAME NAMESPACE CLUSTER-DEFINITION VERSION TERMINATION-POLICY STATUS CREATED-TIME LABELS rediscl-huzdsq ns-xqred Halt Abnormal Jun 19,2025 18:15 UTC+0800 app.kubernetes.io/instance=rediscl-huzdsq cluster_status:Updating cluster_status:Updating check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances rediscl-huzdsq --namespace ns-xqred ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME rediscl-huzdsq-shard-bfc-0 ns-xqred rediscl-huzdsq shard-bfc Running secondary us-west-2a 100m / 100m 512Mi / 512Mi ip-172-31-12-213.us-west-2.compute.internal/172.31.12.213 Jun 19,2025 18:22 UTC+0800 rediscl-huzdsq-shard-bfc-1 ns-xqred rediscl-huzdsq shard-bfc Running primary us-west-2a 100m / 100m 512Mi / 512Mi ip-172-31-5-137.us-west-2.compute.internal/172.31.5.137 Jun 19,2025 18:22 UTC+0800 rediscl-huzdsq-shard-fwk-0 ns-xqred rediscl-huzdsq shard-fwk Running primary us-west-2a 100m / 100m 512Mi / 512Mi ip-172-31-2-115.us-west-2.compute.internal/172.31.2.115 Jun 19,2025 18:20 UTC+0800 rediscl-huzdsq-shard-fwk-1 ns-xqred rediscl-huzdsq shard-fwk Running secondary us-west-2a 100m / 100m 512Mi / 512Mi ip-172-31-13-158.us-west-2.compute.internal/172.31.13.158 Jun 19,2025 18:19 UTC+0800 rediscl-huzdsq-shard-tt9-0 ns-xqred rediscl-huzdsq shard-tt9 Running primary us-west-2a 100m / 100m 512Mi / 512Mi ip-172-31-12-213.us-west-2.compute.internal/172.31.12.213 Jun 19,2025 18:20 UTC+0800 rediscl-huzdsq-shard-tt9-1 ns-xqred rediscl-huzdsq shard-tt9 Running secondary us-west-2a 100m / 100m 512Mi / 512Mi ip-172-31-12-213.us-west-2.compute.internal/172.31.12.213 Jun 19,2025 18:19 UTC+0800 check pod status done check cluster role check cluster role done primary: rediscl-huzdsq-shard-bfc-1 rediscl-huzdsq-shard-fwk-0 rediscl-huzdsq-shard-tt9-0;secondary: rediscl-huzdsq-shard-bfc-0 rediscl-huzdsq-shard-fwk-1 rediscl-huzdsq-shard-tt9-1 analyze cluster health check cluster connect `` ========== 节点: rediscl-huzdsq-shard-bfc-0 ========== 检测到基础名称: rediscl-huzdsq-shard-bfc, 分片编号: 0 使用 Secret: rediscl-huzdsq-shard-bfc-account-default 密码获取成功，前缀: Xm... 使用Pod环境变量中的Redis端口: 6379 --- 集群节点信息 --- a5d4fc43276d727e0f162488944b68ba7c1e439d 172.31.12.213:32496@30676,rediscl-huzdsq-shard-bfc-0.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local myself,slave f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 0 1750329643000 8 connected 6805dfae60f82469d32f167a0762f10b9fe532dc 172.31.2.115:30964@30479,rediscl-huzdsq-shard-fwk-0.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local master - 0 1750329642047 6 connected 1365-5460 8193-9557 9a47e108282ae378589e88936924a2f36a944e1a 172.31.12.213:30626@31966,rediscl-huzdsq-shard-tt9-0.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local master - 0 1750329643000 7 connected 9558-10922 12288-16383 566610eaebef8ad78e4fa9a8957436093634de2c 172.31.12.213:31054@30545,rediscl-huzdsq-shard-tt9-1.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local slave 9a47e108282ae378589e88936924a2f36a944e1a 0 1750329643000 7 connected f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 172.31.5.137:32508@31084,rediscl-huzdsq-shard-bfc-1.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local master - 0 1750329643054 8 connected 0-1364 5461-8192 10923-12287 f1e5ba6810221fd9b7af42fc1ff2907eaed2b142 172.31.13.158:31209@30928,rediscl-huzdsq-shard-fwk-1.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local slave 6805dfae60f82469d32f167a0762f10b9fe532dc 0 1750329644059 6 connected --- 集群状态信息 --- cluster_state:ok cluster_slots_assigned:16384 cluster_slots_ok:16384 cluster_slots_pfail:0 cluster_slots_fail:0 cluster_known_nodes:6 cluster_size:3 cluster_current_epoch:8 cluster_my_epoch:8 cluster_stats_messages_ping_sent:53 cluster_stats_messages_pong_sent:29 cluster_stats_messages_meet_sent:1 cluster_stats_messages_sent:83 cluster_stats_messages_ping_received:29 cluster_stats_messages_pong_received:54 cluster_stats_messages_received:83 total_cluster_links_buffer_limit_exceeded:0 ========== 节点: rediscl-huzdsq-shard-bfc-1 ========== 检测到基础名称: rediscl-huzdsq-shard-bfc, 分片编号: 1 使用 Secret: rediscl-huzdsq-shard-bfc-account-default 密码获取成功，前缀: Xm... 使用Pod环境变量中的Redis端口: 6379 --- 集群节点信息 --- a5d4fc43276d727e0f162488944b68ba7c1e439d 172.31.12.213:32496@30676,rediscl-huzdsq-shard-bfc-0.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local slave f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 0 1750329650582 8 connected f1e5ba6810221fd9b7af42fc1ff2907eaed2b142 172.31.13.158:31209@30928,rediscl-huzdsq-shard-fwk-1.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local slave 6805dfae60f82469d32f167a0762f10b9fe532dc 0 1750329650481 6 connected 566610eaebef8ad78e4fa9a8957436093634de2c 172.31.12.213:31054@30545,rediscl-huzdsq-shard-tt9-1.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local slave 9a47e108282ae378589e88936924a2f36a944e1a 0 1750329650582 7 connected 9a47e108282ae378589e88936924a2f36a944e1a 172.31.12.213:30626@31966,rediscl-huzdsq-shard-tt9-0.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local master - 0 1750329650984 7 connected 9558-10922 12288-16383 f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 172.31.5.137:32508@31084,rediscl-huzdsq-shard-bfc-1.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local myself,master - 0 1750329650000 8 connected 0-1364 5461-8192 10923-12287 6805dfae60f82469d32f167a0762f10b9fe532dc 172.31.2.115:30964@30479,rediscl-huzdsq-shard-fwk-0.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local master - 0 1750329650000 6 connected 1365-5460 8193-9557 --- 集群状态信息 --- cluster_state:ok cluster_slots_assigned:16384 cluster_slots_ok:16384 cluster_slots_pfail:0 cluster_slots_fail:0 cluster_known_nodes:6 cluster_size:3 cluster_current_epoch:8 cluster_my_epoch:8 cluster_stats_messages_ping_sent:2054 cluster_stats_messages_pong_sent:2054 cluster_stats_messages_meet_sent:1 cluster_stats_messages_auth-req_sent:5 cluster_stats_messages_update_sent:8 cluster_stats_messages_sent:4122 cluster_stats_messages_ping_received:2048 cluster_stats_messages_pong_received:10246 cluster_stats_messages_meet_received:1 cluster_stats_messages_fail_received:1 cluster_stats_messages_auth-ack_received:2 cluster_stats_messages_received:12298 total_cluster_links_buffer_limit_exceeded:0 ========== 节点: rediscl-huzdsq-shard-fwk-0 ========== 检测到基础名称: rediscl-huzdsq-shard-fwk, 分片编号: 0 使用 Secret: rediscl-huzdsq-shard-fwk-account-default 密码获取成功，前缀: Xm... 使用Pod环境变量中的Redis端口: 6379 --- 集群节点信息 --- f1e5ba6810221fd9b7af42fc1ff2907eaed2b142 172.31.13.158:31209@30928,rediscl-huzdsq-shard-fwk-1.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local slave 6805dfae60f82469d32f167a0762f10b9fe532dc 0 1750329657423 6 connected f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 172.31.5.137:32508@31084,rediscl-huzdsq-shard-bfc-1.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local master - 0 1750329656921 8 connected 0-1364 5461-8192 10923-12287 6805dfae60f82469d32f167a0762f10b9fe532dc 172.31.2.115:30964@30479,rediscl-huzdsq-shard-fwk-0.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local myself,master - 0 1750329655000 6 connected 1365-5460 8193-9557 a5d4fc43276d727e0f162488944b68ba7c1e439d 172.31.12.213:32496@30676,rediscl-huzdsq-shard-bfc-0.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local slave f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 0 1750329656000 8 connected 9a47e108282ae378589e88936924a2f36a944e1a 172.31.12.213:30626@31966,rediscl-huzdsq-shard-tt9-0.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local master - 0 1750329656117 7 connected 9558-10922 12288-16383 566610eaebef8ad78e4fa9a8957436093634de2c 172.31.12.213:31054@30545,rediscl-huzdsq-shard-tt9-1.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local slave 9a47e108282ae378589e88936924a2f36a944e1a 0 1750329656419 7 connected --- 集群状态信息 --- cluster_state:ok cluster_slots_assigned:16384 cluster_slots_ok:16384 cluster_slots_pfail:0 cluster_slots_fail:0 cluster_known_nodes:6 cluster_size:3 cluster_current_epoch:8 cluster_my_epoch:6 cluster_stats_messages_ping_sent:2432 cluster_stats_messages_pong_sent:11995 cluster_stats_messages_meet_sent:2 cluster_stats_messages_fail_sent:9 cluster_stats_messages_auth-ack_sent:1 cluster_stats_messages_update_sent:8 cluster_stats_messages_sent:14447 cluster_stats_messages_ping_received:2438 cluster_stats_messages_pong_received:9261 cluster_stats_messages_meet_received:2 cluster_stats_messages_auth-req_received:1 cluster_stats_messages_update_received:3 cluster_stats_messages_received:11705 total_cluster_links_buffer_limit_exceeded:0 ========== 节点: rediscl-huzdsq-shard-fwk-1 ========== 检测到基础名称: rediscl-huzdsq-shard-fwk, 分片编号: 1 使用 Secret: rediscl-huzdsq-shard-fwk-account-default 密码获取成功，前缀: Xm... 使用Pod环境变量中的Redis端口: 6379 --- 集群节点信息 --- a5d4fc43276d727e0f162488944b68ba7c1e439d 172.31.12.213:32496@30676,rediscl-huzdsq-shard-bfc-0.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local slave f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 0 1750329663503 8 connected f1e5ba6810221fd9b7af42fc1ff2907eaed2b142 172.31.13.158:31209@30928,rediscl-huzdsq-shard-fwk-1.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local myself,slave 6805dfae60f82469d32f167a0762f10b9fe532dc 0 1750329664000 6 connected 6805dfae60f82469d32f167a0762f10b9fe532dc 172.31.2.115:30964@30479,rediscl-huzdsq-shard-fwk-0.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local master - 0 1750329664711 6 connected 1365-5460 8193-9557 566610eaebef8ad78e4fa9a8957436093634de2c 172.31.12.213:31054@30545,rediscl-huzdsq-shard-tt9-1.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local slave 9a47e108282ae378589e88936924a2f36a944e1a 0 1750329664510 7 connected f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 172.31.5.137:32508@31084,rediscl-huzdsq-shard-bfc-1.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local master - 0 1750329664000 8 connected 0-1364 5461-8192 10923-12287 9a47e108282ae378589e88936924a2f36a944e1a 172.31.12.213:30626@31966,rediscl-huzdsq-shard-tt9-0.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local master - 0 1750329663704 7 connected 9558-10922 12288-16383 --- 集群状态信息 --- cluster_state:ok cluster_slots_assigned:16384 cluster_slots_ok:16384 cluster_slots_pfail:0 cluster_slots_fail:0 cluster_known_nodes:6 cluster_size:3 cluster_current_epoch:8 cluster_my_epoch:6 cluster_stats_messages_ping_sent:2475 cluster_stats_messages_pong_sent:2520 cluster_stats_messages_meet_sent:1 cluster_stats_messages_update_sent:8 cluster_stats_messages_sent:5004 cluster_stats_messages_ping_received:2520 cluster_stats_messages_pong_received:10664 cluster_stats_messages_fail_received:4 cluster_stats_messages_auth-req_received:2 cluster_stats_messages_update_received:13 cluster_stats_messages_received:13203 total_cluster_links_buffer_limit_exceeded:0 ========== 节点: rediscl-huzdsq-shard-tt9-0 ========== 检测到基础名称: rediscl-huzdsq-shard-tt9, 分片编号: 0 使用 Secret: rediscl-huzdsq-shard-tt9-account-default 密码获取成功，前缀: Xm... 使用Pod环境变量中的Redis端口: 6379 --- 集群节点信息 --- a5d4fc43276d727e0f162488944b68ba7c1e439d 172.31.12.213:32496@30676,rediscl-huzdsq-shard-bfc-0.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local slave f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 0 1750329669561 8 connected f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 172.31.5.137:32508@31084,rediscl-huzdsq-shard-bfc-1.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local master - 0 1750329670566 8 connected 0-1364 5461-8192 10923-12287 566610eaebef8ad78e4fa9a8957436093634de2c 172.31.12.213:31054@30545,rediscl-huzdsq-shard-tt9-1.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local slave 9a47e108282ae378589e88936924a2f36a944e1a 0 1750329671270 7 connected 9a47e108282ae378589e88936924a2f36a944e1a 172.31.12.213:30626@31966,rediscl-huzdsq-shard-tt9-0.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local myself,master - 0 1750329670000 7 connected 9558-10922 12288-16383 f1e5ba6810221fd9b7af42fc1ff2907eaed2b142 172.31.13.158:31209@30928,rediscl-huzdsq-shard-fwk-1.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local slave 6805dfae60f82469d32f167a0762f10b9fe532dc 0 1750329670566 6 connected 6805dfae60f82469d32f167a0762f10b9fe532dc 172.31.2.115:30964@30479,rediscl-huzdsq-shard-fwk-0.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local master - 0 1750329670768 6 connected 1365-5460 8193-9557 --- 集群状态信息 --- cluster_state:ok cluster_slots_assigned:16384 cluster_slots_ok:16384 cluster_slots_pfail:0 cluster_slots_fail:0 cluster_known_nodes:6 cluster_size:3 cluster_current_epoch:8 cluster_my_epoch:7 cluster_stats_messages_ping_sent:2436 cluster_stats_messages_pong_sent:11997 cluster_stats_messages_meet_sent:2 cluster_stats_messages_auth-ack_sent:1 cluster_stats_messages_update_sent:10 cluster_stats_messages_sent:14446 cluster_stats_messages_ping_received:2439 cluster_stats_messages_pong_received:9263 cluster_stats_messages_meet_received:3 cluster_stats_messages_fail_received:1 cluster_stats_messages_auth-req_received:1 cluster_stats_messages_update_received:2 cluster_stats_messages_received:11709 total_cluster_links_buffer_limit_exceeded:0 ========== 节点: rediscl-huzdsq-shard-tt9-1 ========== 检测到基础名称: rediscl-huzdsq-shard-tt9, 分片编号: 1 使用 Secret: rediscl-huzdsq-shard-tt9-account-default 密码获取成功，前缀: Xm... 使用Pod环境变量中的Redis端口: 6379 --- 集群节点信息 --- 6805dfae60f82469d32f167a0762f10b9fe532dc 172.31.2.115:30964@30479,rediscl-huzdsq-shard-fwk-0.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local master - 0 1750329677000 6 connected 1365-5460 8193-9557 f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 172.31.5.137:32508@31084,rediscl-huzdsq-shard-bfc-1.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local master - 0 1750329677582 8 connected 0-1364 5461-8192 10923-12287 f1e5ba6810221fd9b7af42fc1ff2907eaed2b142 172.31.13.158:31209@30928,rediscl-huzdsq-shard-fwk-1.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local slave 6805dfae60f82469d32f167a0762f10b9fe532dc 0 1750329676000 6 connected 566610eaebef8ad78e4fa9a8957436093634de2c 172.31.12.213:31054@30545,rediscl-huzdsq-shard-tt9-1.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local myself,slave 9a47e108282ae378589e88936924a2f36a944e1a 0 1750329677000 7 connected a5d4fc43276d727e0f162488944b68ba7c1e439d 172.31.12.213:32496@30676,rediscl-huzdsq-shard-bfc-0.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local slave f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 0 1750329677783 8 connected 9a47e108282ae378589e88936924a2f36a944e1a 172.31.12.213:30626@31966,rediscl-huzdsq-shard-tt9-0.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local master - 0 1750329677582 7 connected 9558-10922 12288-16383 --- 集群状态信息 --- cluster_state:ok cluster_slots_assigned:16384 cluster_slots_ok:16384 cluster_slots_pfail:0 cluster_slots_fail:0 cluster_known_nodes:6 cluster_size:3 cluster_current_epoch:8 cluster_my_epoch:7 cluster_stats_messages_ping_sent:2514 cluster_stats_messages_pong_sent:2503 cluster_stats_messages_meet_sent:1 cluster_stats_messages_fail_sent:10 cluster_stats_messages_auth-req_sent:5 cluster_stats_messages_update_sent:12 cluster_stats_messages_sent:5045 cluster_stats_messages_ping_received:2503 cluster_stats_messages_pong_received:10702 cluster_stats_messages_fail_received:4 cluster_stats_messages_auth-req_received:1 cluster_stats_messages_update_received:6 cluster_stats_messages_received:13216 total_cluster_links_buffer_limit_exceeded:0 ========== 集群健康分析 ========== 使用节点 rediscl-huzdsq-shard-bfc-0 作为参考基准 检测到以下分片标识符: - bfc - fwk - tt9 参考节点观察到的拓扑结构: ID IP地址 状态 主节点ID 槽位 ---------------------------------------- ------------- ---------------- ---------------------------------------- -------------- a5d4fc43276d727e0f162488944b68ba7c1e439d 172.31.12.213:32496 从节点 f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 6805dfae60f82469d32f167a0762f10b9fe532dc 172.31.2.115:30964 主节点 - 1365-5460 8193-9557 (共 0 个槽位) 9a47e108282ae378589e88936924a2f36a944e1a 172.31.12.213:30626 主节点 - 9558-10922 12288-16383 (共 0 个槽位) 566610eaebef8ad78e4fa9a8957436093634de2c 172.31.12.213:31054 从节点 9a47e108282ae378589e88936924a2f36a944e1a f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 172.31.5.137:32508 主节点 - 0-1364 5461-8192 10923-12287 (共 0 个槽位) f1e5ba6810221fd9b7af42fc1ff2907eaed2b142 172.31.13.158:31209 从节点 6805dfae60f82469d32f167a0762f10b9fe532dc 正在分析节点 rediscl-huzdsq-shard-bfc-1 的拓扑视图... 正在分析节点 rediscl-huzdsq-shard-fwk-0 的拓扑视图... 正在分析节点 rediscl-huzdsq-shard-fwk-1 的拓扑视图... 正在分析节点 rediscl-huzdsq-shard-tt9-0 的拓扑视图... 正在分析节点 rediscl-huzdsq-shard-tt9-1 的拓扑视图... 槽位分配统计: - 总槽位数: 16384 - 未覆盖槽位数: 0 - 重复覆盖槽位数: 0 - 正确覆盖槽位数: 16384 主节点槽位分配明细: 节点 6805dfae60f82469d32f167a0762f10b9fe532dc (172.31.2.115:30964) 负责 0 个槽位: 1365-5460 8193-9557 节点 9a47e108282ae378589e88936924a2f36a944e1a (172.31.12.213:30626) 负责 0 个槽位: 9558-10922 12288-16383 节点 f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 (172.31.5.137:32508) 负责 0 个槽位: 0-1364 5461-8192 10923-12287 总计分配槽位: 0 / 16384 警告: 分配的总槽位数 (0) 不等于 16384 缺少 16384 个槽位分配 分片分析: 分片 bfc: 1 个主节点, 1 个从节点 ✅ 分片 fwk: 1 个主节点, 1 个从节点 ✅ 分片 tt9: 1 个主节点, 1 个从节点 ✅ 集群分析总结: - 检测到 3 个主节点和 3 个从节点 - 检测到 0 个故障或疑似故障节点 - 集群状态统一显示为OK: 是 - 所有槽位正确分配: 是 - 所有节点看到一致的集群大小: 是 - 所有节点看到一致的拓扑结构: 是 - 所有槽位被正确覆盖: 是 - 集群中无故障或疑似故障节点: 是 集群健康状态: 健康 ✅ 所有检查均通过，Redis集群运行正常。 analyze cluster health success `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge PodChaos test-chaos-mesh-podfailure-rediscl-huzdsq --namespace ns-xqred ` Warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely. podchaos.chaos-mesh.org "test-chaos-mesh-podfailure-rediscl-huzdsq" force deleted Error from server (NotFound): podchaos.chaos-mesh.org "test-chaos-mesh-podfailure-rediscl-huzdsq" not found check failover pod name failover pod name:rediscl-huzdsq-shard-bfc-1 failover podfailure Success test failover oom check node drain check node drain success `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge StressChaos test-chaos-mesh-oom-rediscl-huzdsq --namespace ns-xqred ` Warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely. Error from server (NotFound): stresschaos.chaos-mesh.org "test-chaos-mesh-oom-rediscl-huzdsq" not found Error from server (NotFound): stresschaos.chaos-mesh.org "test-chaos-mesh-oom-rediscl-huzdsq" not found apiVersion: chaos-mesh.org/v1alpha1 kind: StressChaos metadata: name: test-chaos-mesh-oom-rediscl-huzdsq namespace: ns-xqred spec: selector: namespaces: - ns-xqred labelSelectors: apps.kubeblocks.io/pod-name: rediscl-huzdsq-shard-bfc-1 mode: all stressors: memory: workers: 1 size: "100GB" oomScoreAdj: -1000 duration: 2m `kubectl apply -f test-chaos-mesh-oom-rediscl-huzdsq.yaml` stresschaos.chaos-mesh.org/test-chaos-mesh-oom-rediscl-huzdsq created apply test-chaos-mesh-oom-rediscl-huzdsq.yaml Success `rm -rf test-chaos-mesh-oom-rediscl-huzdsq.yaml` check cluster status `kbcli cluster list rediscl-huzdsq --show-labels --namespace ns-xqred ` NAME NAMESPACE CLUSTER-DEFINITION VERSION TERMINATION-POLICY STATUS CREATED-TIME LABELS rediscl-huzdsq ns-xqred Halt Updating Jun 19,2025 18:15 UTC+0800 app.kubernetes.io/instance=rediscl-huzdsq check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances rediscl-huzdsq --namespace ns-xqred ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME rediscl-huzdsq-shard-bfc-0 ns-xqred rediscl-huzdsq shard-bfc Running secondary us-west-2a 100m / 100m 512Mi / 512Mi ip-172-31-12-213.us-west-2.compute.internal/172.31.12.213 Jun 19,2025 18:22 UTC+0800 rediscl-huzdsq-shard-bfc-1 ns-xqred rediscl-huzdsq shard-bfc Running primary us-west-2a 100m / 100m 512Mi / 512Mi ip-172-31-5-137.us-west-2.compute.internal/172.31.5.137 Jun 19,2025 18:22 UTC+0800 rediscl-huzdsq-shard-fwk-0 ns-xqred rediscl-huzdsq shard-fwk Running primary us-west-2a 100m / 100m 512Mi / 512Mi ip-172-31-2-115.us-west-2.compute.internal/172.31.2.115 Jun 19,2025 18:20 UTC+0800 rediscl-huzdsq-shard-fwk-1 ns-xqred rediscl-huzdsq shard-fwk Running secondary us-west-2a 100m / 100m 512Mi / 512Mi ip-172-31-13-158.us-west-2.compute.internal/172.31.13.158 Jun 19,2025 18:19 UTC+0800 rediscl-huzdsq-shard-tt9-0 ns-xqred rediscl-huzdsq shard-tt9 Running primary us-west-2a 100m / 100m 512Mi / 512Mi ip-172-31-12-213.us-west-2.compute.internal/172.31.12.213 Jun 19,2025 18:20 UTC+0800 rediscl-huzdsq-shard-tt9-1 ns-xqred rediscl-huzdsq shard-tt9 Running secondary us-west-2a 100m / 100m 512Mi / 512Mi ip-172-31-12-213.us-west-2.compute.internal/172.31.12.213 Jun 19,2025 18:19 UTC+0800 check pod status done check cluster role check cluster role done primary: rediscl-huzdsq-shard-bfc-1 rediscl-huzdsq-shard-fwk-0 rediscl-huzdsq-shard-tt9-0;secondary: rediscl-huzdsq-shard-bfc-0 rediscl-huzdsq-shard-fwk-1 rediscl-huzdsq-shard-tt9-1 analyze cluster health check cluster connect `` ========== 节点: rediscl-huzdsq-shard-bfc-0 ========== 检测到基础名称: rediscl-huzdsq-shard-bfc, 分片编号: 0 使用 Secret: rediscl-huzdsq-shard-bfc-account-default 密码获取成功，前缀: Xm... 使用Pod环境变量中的Redis端口: 6379 --- 集群节点信息 --- a5d4fc43276d727e0f162488944b68ba7c1e439d 172.31.12.213:32496@30676,rediscl-huzdsq-shard-bfc-0.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local myself,slave f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 0 1750329793000 8 connected 6805dfae60f82469d32f167a0762f10b9fe532dc 172.31.2.115:30964@30479,rediscl-huzdsq-shard-fwk-0.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local master - 0 1750329793000 6 connected 1365-5460 8193-9557 9a47e108282ae378589e88936924a2f36a944e1a 172.31.12.213:30626@31966,rediscl-huzdsq-shard-tt9-0.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local master - 0 1750329792849 7 connected 9558-10922 12288-16383 566610eaebef8ad78e4fa9a8957436093634de2c 172.31.12.213:31054@30545,rediscl-huzdsq-shard-tt9-1.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local slave 9a47e108282ae378589e88936924a2f36a944e1a 0 1750329793000 7 connected f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 172.31.5.137:32508@31084,rediscl-huzdsq-shard-bfc-1.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local master - 0 1750329792548 8 connected 0-1364 5461-8192 10923-12287 f1e5ba6810221fd9b7af42fc1ff2907eaed2b142 172.31.13.158:31209@30928,rediscl-huzdsq-shard-fwk-1.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local slave 6805dfae60f82469d32f167a0762f10b9fe532dc 0 1750329793553 6 connected --- 集群状态信息 --- cluster_state:ok cluster_slots_assigned:16384 cluster_slots_ok:16384 cluster_slots_pfail:0 cluster_slots_fail:0 cluster_known_nodes:6 cluster_size:3 cluster_current_epoch:8 cluster_my_epoch:8 cluster_stats_messages_ping_sent:320 cluster_stats_messages_pong_sent:299 cluster_stats_messages_meet_sent:1 cluster_stats_messages_sent:620 cluster_stats_messages_ping_received:299 cluster_stats_messages_pong_received:319 cluster_stats_messages_received:618 total_cluster_links_buffer_limit_exceeded:0 ========== 节点: rediscl-huzdsq-shard-bfc-1 ========== 检测到基础名称: rediscl-huzdsq-shard-bfc, 分片编号: 1 使用 Secret: rediscl-huzdsq-shard-bfc-account-default 密码获取成功，前缀: Xm... 使用Pod环境变量中的Redis端口: 6379 --- 集群节点信息 --- f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 172.31.5.137:32508@31084,rediscl-huzdsq-shard-bfc-1.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local myself,master - 0 1750329797000 8 connected 0-1364 5461-8192 10923-12287 f1e5ba6810221fd9b7af42fc1ff2907eaed2b142 172.31.13.158:31209@30928,rediscl-huzdsq-shard-fwk-1.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local slave 6805dfae60f82469d32f167a0762f10b9fe532dc 0 1750329799000 6 connected 9a47e108282ae378589e88936924a2f36a944e1a 172.31.12.213:30626@31966,rediscl-huzdsq-shard-tt9-0.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local master - 0 1750329799595 7 connected 9558-10922 12288-16383 a5d4fc43276d727e0f162488944b68ba7c1e439d 172.31.12.213:32496@30676,rediscl-huzdsq-shard-bfc-0.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local slave f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 0 1750329799000 8 connected 6805dfae60f82469d32f167a0762f10b9fe532dc 172.31.2.115:30964@30479,rediscl-huzdsq-shard-fwk-0.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local master - 0 1750329798015 6 connected 1365-5460 8193-9557 566610eaebef8ad78e4fa9a8957436093634de2c 172.31.12.213:31054@30545,rediscl-huzdsq-shard-tt9-1.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local slave 9a47e108282ae378589e88936924a2f36a944e1a 0 1750329798216 7 connected --- 集群状态信息 --- cluster_state:ok cluster_slots_assigned:16384 cluster_slots_ok:16384 cluster_slots_pfail:0 cluster_slots_fail:0 cluster_known_nodes:6 cluster_size:3 cluster_current_epoch:8 cluster_my_epoch:8 cluster_stats_messages_ping_sent:66 cluster_stats_messages_pong_sent:42 cluster_stats_messages_meet_sent:2 cluster_stats_messages_sent:110 cluster_stats_messages_ping_received:42 cluster_stats_messages_pong_received:68 cluster_stats_messages_received:110 total_cluster_links_buffer_limit_exceeded:0 ========== 节点: rediscl-huzdsq-shard-fwk-0 ========== 检测到基础名称: rediscl-huzdsq-shard-fwk, 分片编号: 0 使用 Secret: rediscl-huzdsq-shard-fwk-account-default 密码获取成功，前缀: Xm... 使用Pod环境变量中的Redis端口: 6379 --- 集群节点信息 --- f1e5ba6810221fd9b7af42fc1ff2907eaed2b142 172.31.13.158:31209@30928,rediscl-huzdsq-shard-fwk-1.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local slave 6805dfae60f82469d32f167a0762f10b9fe532dc 0 1750329807174 6 connected f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 172.31.5.137:32508@31084,rediscl-huzdsq-shard-bfc-1.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local master - 0 1750329806069 8 connected 0-1364 5461-8192 10923-12287 6805dfae60f82469d32f167a0762f10b9fe532dc 172.31.2.115:30964@30479,rediscl-huzdsq-shard-fwk-0.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local myself,master - 0 1750329805000 6 connected 1365-5460 8193-9557 a5d4fc43276d727e0f162488944b68ba7c1e439d 172.31.12.213:32496@30676,rediscl-huzdsq-shard-bfc-0.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local slave f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 0 1750329806170 8 connected 9a47e108282ae378589e88936924a2f36a944e1a 172.31.12.213:30626@31966,rediscl-huzdsq-shard-tt9-0.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local master - 0 1750329805000 7 connected 9558-10922 12288-16383 566610eaebef8ad78e4fa9a8957436093634de2c 172.31.12.213:31054@30545,rediscl-huzdsq-shard-tt9-1.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local slave 9a47e108282ae378589e88936924a2f36a944e1a 0 1750329805000 7 connected --- 集群状态信息 --- cluster_state:ok cluster_slots_assigned:16384 cluster_slots_ok:16384 cluster_slots_pfail:0 cluster_slots_fail:0 cluster_known_nodes:6 cluster_size:3 cluster_current_epoch:8 cluster_my_epoch:6 cluster_stats_messages_ping_sent:2703 cluster_stats_messages_pong_sent:12260 cluster_stats_messages_meet_sent:2 cluster_stats_messages_fail_sent:9 cluster_stats_messages_auth-ack_sent:1 cluster_stats_messages_update_sent:8 cluster_stats_messages_sent:14983 cluster_stats_messages_ping_received:2702 cluster_stats_messages_pong_received:9531 cluster_stats_messages_meet_received:3 cluster_stats_messages_auth-req_received:1 cluster_stats_messages_update_received:3 cluster_stats_messages_received:12240 total_cluster_links_buffer_limit_exceeded:0 ========== 节点: rediscl-huzdsq-shard-fwk-1 ========== 检测到基础名称: rediscl-huzdsq-shard-fwk, 分片编号: 1 使用 Secret: rediscl-huzdsq-shard-fwk-account-default 密码获取成功，前缀: Xm... 使用Pod环境变量中的Redis端口: 6379 --- 集群节点信息 --- a5d4fc43276d727e0f162488944b68ba7c1e439d 172.31.12.213:32496@30676,rediscl-huzdsq-shard-bfc-0.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local slave f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 0 1750329812696 8 connected f1e5ba6810221fd9b7af42fc1ff2907eaed2b142 172.31.13.158:31209@30928,rediscl-huzdsq-shard-fwk-1.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local myself,slave 6805dfae60f82469d32f167a0762f10b9fe532dc 0 1750329813000 6 connected 6805dfae60f82469d32f167a0762f10b9fe532dc 172.31.2.115:30964@30479,rediscl-huzdsq-shard-fwk-0.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local master - 0 1750329813000 6 connected 1365-5460 8193-9557 566610eaebef8ad78e4fa9a8957436093634de2c 172.31.12.213:31054@30545,rediscl-huzdsq-shard-tt9-1.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local slave 9a47e108282ae378589e88936924a2f36a944e1a 0 1750329813000 7 connected f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 172.31.5.137:32508@31084,rediscl-huzdsq-shard-bfc-1.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local master - 0 1750329813702 8 connected 0-1364 5461-8192 10923-12287 9a47e108282ae378589e88936924a2f36a944e1a 172.31.12.213:30626@31966,rediscl-huzdsq-shard-tt9-0.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local master - 0 1750329813000 7 connected 9558-10922 12288-16383 --- 集群状态信息 --- cluster_state:ok cluster_slots_assigned:16384 cluster_slots_ok:16384 cluster_slots_pfail:0 cluster_slots_fail:0 cluster_known_nodes:6 cluster_size:3 cluster_current_epoch:8 cluster_my_epoch:6 cluster_stats_messages_ping_sent:2737 cluster_stats_messages_pong_sent:2791 cluster_stats_messages_meet_sent:1 cluster_stats_messages_update_sent:8 cluster_stats_messages_sent:5537 cluster_stats_messages_ping_received:2791 cluster_stats_messages_pong_received:10925 cluster_stats_messages_fail_received:4 cluster_stats_messages_auth-req_received:2 cluster_stats_messages_update_received:13 cluster_stats_messages_received:13735 total_cluster_links_buffer_limit_exceeded:0 ========== 节点: rediscl-huzdsq-shard-tt9-0 ========== 检测到基础名称: rediscl-huzdsq-shard-tt9, 分片编号: 0 使用 Secret: rediscl-huzdsq-shard-tt9-account-default 密码获取成功，前缀: Xm... 使用Pod环境变量中的Redis端口: 6379 --- 集群节点信息 --- a5d4fc43276d727e0f162488944b68ba7c1e439d 172.31.12.213:32496@30676,rediscl-huzdsq-shard-bfc-0.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local slave f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 0 1750329820360 8 connected f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 172.31.5.137:32508@31084,rediscl-huzdsq-shard-bfc-1.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local master - 0 1750329819000 8 connected 0-1364 5461-8192 10923-12287 566610eaebef8ad78e4fa9a8957436093634de2c 172.31.12.213:31054@30545,rediscl-huzdsq-shard-tt9-1.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local slave 9a47e108282ae378589e88936924a2f36a944e1a 0 1750329820000 7 connected 9a47e108282ae378589e88936924a2f36a944e1a 172.31.12.213:30626@31966,rediscl-huzdsq-shard-tt9-0.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local myself,master - 0 1750329818000 7 connected 9558-10922 12288-16383 f1e5ba6810221fd9b7af42fc1ff2907eaed2b142 172.31.13.158:31209@30928,rediscl-huzdsq-shard-fwk-1.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local slave 6805dfae60f82469d32f167a0762f10b9fe532dc 0 1750329819354 6 connected 6805dfae60f82469d32f167a0762f10b9fe532dc 172.31.2.115:30964@30479,rediscl-huzdsq-shard-fwk-0.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local master - 0 1750329819858 6 connected 1365-5460 8193-9557 --- 集群状态信息 --- cluster_state:ok cluster_slots_assigned:16384 cluster_slots_ok:16384 cluster_slots_pfail:0 cluster_slots_fail:0 cluster_known_nodes:6 cluster_size:3 cluster_current_epoch:8 cluster_my_epoch:7 cluster_stats_messages_ping_sent:2700 cluster_stats_messages_pong_sent:12269 cluster_stats_messages_meet_sent:2 cluster_stats_messages_auth-ack_sent:1 cluster_stats_messages_update_sent:10 cluster_stats_messages_sent:14982 cluster_stats_messages_ping_received:2710 cluster_stats_messages_pong_received:9526 cluster_stats_messages_meet_received:4 cluster_stats_messages_fail_received:1 cluster_stats_messages_auth-req_received:1 cluster_stats_messages_update_received:2 cluster_stats_messages_received:12244 total_cluster_links_buffer_limit_exceeded:0 ========== 节点: rediscl-huzdsq-shard-tt9-1 ========== 检测到基础名称: rediscl-huzdsq-shard-tt9, 分片编号: 1 使用 Secret: rediscl-huzdsq-shard-tt9-account-default 密码获取成功，前缀: Xm... 使用Pod环境变量中的Redis端口: 6379 --- 集群节点信息 --- 6805dfae60f82469d32f167a0762f10b9fe532dc 172.31.2.115:30964@30479,rediscl-huzdsq-shard-fwk-0.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local master - 0 1750329825000 6 connected 1365-5460 8193-9557 f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 172.31.5.137:32508@31084,rediscl-huzdsq-shard-bfc-1.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local master - 0 1750329826604 8 connected 0-1364 5461-8192 10923-12287 f1e5ba6810221fd9b7af42fc1ff2907eaed2b142 172.31.13.158:31209@30928,rediscl-huzdsq-shard-fwk-1.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local slave 6805dfae60f82469d32f167a0762f10b9fe532dc 0 1750329826000 6 connected 566610eaebef8ad78e4fa9a8957436093634de2c 172.31.12.213:31054@30545,rediscl-huzdsq-shard-tt9-1.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local myself,slave 9a47e108282ae378589e88936924a2f36a944e1a 0 1750329826000 7 connected a5d4fc43276d727e0f162488944b68ba7c1e439d 172.31.12.213:32496@30676,rediscl-huzdsq-shard-bfc-0.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local slave f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 0 1750329826000 8 connected 9a47e108282ae378589e88936924a2f36a944e1a 172.31.12.213:30626@31966,rediscl-huzdsq-shard-tt9-0.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local master - 0 1750329826604 7 connected 9558-10922 12288-16383 --- 集群状态信息 --- cluster_state:ok cluster_slots_assigned:16384 cluster_slots_ok:16384 cluster_slots_pfail:0 cluster_slots_fail:0 cluster_known_nodes:6 cluster_size:3 cluster_current_epoch:8 cluster_my_epoch:7 cluster_stats_messages_ping_sent:2776 cluster_stats_messages_pong_sent:2768 cluster_stats_messages_meet_sent:1 cluster_stats_messages_fail_sent:10 cluster_stats_messages_auth-req_sent:5 cluster_stats_messages_update_sent:12 cluster_stats_messages_sent:5572 cluster_stats_messages_ping_received:2768 cluster_stats_messages_pong_received:10963 cluster_stats_messages_fail_received:4 cluster_stats_messages_auth-req_received:1 cluster_stats_messages_update_received:6 cluster_stats_messages_received:13742 total_cluster_links_buffer_limit_exceeded:0 ========== 集群健康分析 ========== 使用节点 rediscl-huzdsq-shard-bfc-0 作为参考基准 检测到以下分片标识符: - bfc - fwk - tt9 参考节点观察到的拓扑结构: ID IP地址 状态 主节点ID 槽位 ---------------------------------------- ------------- ---------------- ---------------------------------------- -------------- a5d4fc43276d727e0f162488944b68ba7c1e439d 172.31.12.213:32496 从节点 f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 6805dfae60f82469d32f167a0762f10b9fe532dc 172.31.2.115:30964 主节点 - 1365-5460 8193-9557 (共 0 个槽位) 9a47e108282ae378589e88936924a2f36a944e1a 172.31.12.213:30626 主节点 - 9558-10922 12288-16383 (共 0 个槽位) 566610eaebef8ad78e4fa9a8957436093634de2c 172.31.12.213:31054 从节点 9a47e108282ae378589e88936924a2f36a944e1a f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 172.31.5.137:32508 主节点 - 0-1364 5461-8192 10923-12287 (共 0 个槽位) f1e5ba6810221fd9b7af42fc1ff2907eaed2b142 172.31.13.158:31209 从节点 6805dfae60f82469d32f167a0762f10b9fe532dc 正在分析节点 rediscl-huzdsq-shard-bfc-1 的拓扑视图... 正在分析节点 rediscl-huzdsq-shard-fwk-0 的拓扑视图... 正在分析节点 rediscl-huzdsq-shard-fwk-1 的拓扑视图... 正在分析节点 rediscl-huzdsq-shard-tt9-0 的拓扑视图... 正在分析节点 rediscl-huzdsq-shard-tt9-1 的拓扑视图... 槽位分配统计: - 总槽位数: 16384 - 未覆盖槽位数: 0 - 重复覆盖槽位数: 0 - 正确覆盖槽位数: 16384 主节点槽位分配明细: 节点 6805dfae60f82469d32f167a0762f10b9fe532dc (172.31.2.115:30964) 负责 0 个槽位: 1365-5460 8193-9557 节点 9a47e108282ae378589e88936924a2f36a944e1a (172.31.12.213:30626) 负责 0 个槽位: 9558-10922 12288-16383 节点 f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 (172.31.5.137:32508) 负责 0 个槽位: 0-1364 5461-8192 10923-12287 总计分配槽位: 0 / 16384 警告: 分配的总槽位数 (0) 不等于 16384 缺少 16384 个槽位分配 分片分析: 分片 bfc: 1 个主节点, 1 个从节点 ✅ 分片 fwk: 1 个主节点, 1 个从节点 ✅ 分片 tt9: 1 个主节点, 1 个从节点 ✅ 集群分析总结: - 检测到 3 个主节点和 3 个从节点 - 检测到 0 个故障或疑似故障节点 - 集群状态统一显示为OK: 是 - 所有槽位正确分配: 是 - 所有节点看到一致的集群大小: 是 - 所有节点看到一致的拓扑结构: 是 - 所有槽位被正确覆盖: 是 - 集群中无故障或疑似故障节点: 是 集群健康状态: 健康 ✅ 所有检查均通过，Redis集群运行正常。 analyze cluster health success `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge StressChaos test-chaos-mesh-oom-rediscl-huzdsq --namespace ns-xqred ` Warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely. stresschaos.chaos-mesh.org "test-chaos-mesh-oom-rediscl-huzdsq" force deleted Error from server (NotFound): stresschaos.chaos-mesh.org "test-chaos-mesh-oom-rediscl-huzdsq" not found check failover pod name failover pod name:rediscl-huzdsq-shard-bfc-1 failover oom Success test failover delete pod:rediscl-huzdsq-shard-bfc-1 `kubectl delete pod rediscl-huzdsq-shard-bfc-1 --namespace ns-xqred ` pod "rediscl-huzdsq-shard-bfc-1" deleted check cluster status `kbcli cluster list rediscl-huzdsq --show-labels --namespace ns-xqred ` NAME NAMESPACE CLUSTER-DEFINITION VERSION TERMINATION-POLICY STATUS CREATED-TIME LABELS rediscl-huzdsq ns-xqred Halt Updating Jun 19,2025 18:15 UTC+0800 app.kubernetes.io/instance=rediscl-huzdsq cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances rediscl-huzdsq --namespace ns-xqred ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME rediscl-huzdsq-shard-bfc-0 ns-xqred rediscl-huzdsq shard-bfc Running primary us-west-2a 100m / 100m 512Mi / 512Mi ip-172-31-12-213.us-west-2.compute.internal/172.31.12.213 Jun 19,2025 18:22 UTC+0800 rediscl-huzdsq-shard-bfc-1 ns-xqred rediscl-huzdsq shard-bfc Running secondary us-west-2a 100m / 100m 512Mi / 512Mi ip-172-31-10-241.us-west-2.compute.internal/172.31.10.241 Jun 19,2025 18:45 UTC+0800 rediscl-huzdsq-shard-fwk-0 ns-xqred rediscl-huzdsq shard-fwk Running primary us-west-2a 100m / 100m 512Mi / 512Mi ip-172-31-2-115.us-west-2.compute.internal/172.31.2.115 Jun 19,2025 18:20 UTC+0800 rediscl-huzdsq-shard-fwk-1 ns-xqred rediscl-huzdsq shard-fwk Running secondary us-west-2a 100m / 100m 512Mi / 512Mi ip-172-31-13-158.us-west-2.compute.internal/172.31.13.158 Jun 19,2025 18:19 UTC+0800 rediscl-huzdsq-shard-tt9-0 ns-xqred rediscl-huzdsq shard-tt9 Running primary us-west-2a 100m / 100m 512Mi / 512Mi ip-172-31-12-213.us-west-2.compute.internal/172.31.12.213 Jun 19,2025 18:20 UTC+0800 rediscl-huzdsq-shard-tt9-1 ns-xqred rediscl-huzdsq shard-tt9 Running secondary us-west-2a 100m / 100m 512Mi / 512Mi ip-172-31-12-213.us-west-2.compute.internal/172.31.12.213 Jun 19,2025 18:19 UTC+0800 check pod status done check cluster role check cluster role done primary: rediscl-huzdsq-shard-bfc-0 rediscl-huzdsq-shard-fwk-0 rediscl-huzdsq-shard-tt9-0;secondary: rediscl-huzdsq-shard-bfc-1 rediscl-huzdsq-shard-fwk-1 rediscl-huzdsq-shard-tt9-1 analyze cluster health check cluster connect `` ========== 节点: rediscl-huzdsq-shard-bfc-0 ========== 检测到基础名称: rediscl-huzdsq-shard-bfc, 分片编号: 0 使用 Secret: rediscl-huzdsq-shard-bfc-account-default 密码获取成功，前缀: Xm... 使用Pod环境变量中的Redis端口: 6379 --- 集群节点信息 --- a5d4fc43276d727e0f162488944b68ba7c1e439d 172.31.12.213:32496@30676,rediscl-huzdsq-shard-bfc-0.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local myself,master - 0 1750329946000 9 connected 0-1364 5461-8192 10923-12287 6805dfae60f82469d32f167a0762f10b9fe532dc 172.31.2.115:30964@30479,rediscl-huzdsq-shard-fwk-0.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local master - 0 1750329947554 6 connected 1365-5460 8193-9557 9a47e108282ae378589e88936924a2f36a944e1a 172.31.12.213:30626@31966,rediscl-huzdsq-shard-tt9-0.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local master - 0 1750329946750 7 connected 9558-10922 12288-16383 566610eaebef8ad78e4fa9a8957436093634de2c 172.31.12.213:31054@30545,rediscl-huzdsq-shard-tt9-1.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local slave 9a47e108282ae378589e88936924a2f36a944e1a 0 1750329947000 7 connected f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 172.31.10.241:32508@31084,rediscl-huzdsq-shard-bfc-1.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local slave a5d4fc43276d727e0f162488944b68ba7c1e439d 0 1750329946000 9 connected f1e5ba6810221fd9b7af42fc1ff2907eaed2b142 172.31.13.158:31209@30928,rediscl-huzdsq-shard-fwk-1.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local slave 6805dfae60f82469d32f167a0762f10b9fe532dc 0 1750329947756 6 connected --- 集群状态信息 --- cluster_state:ok cluster_slots_assigned:16384 cluster_slots_ok:16384 cluster_slots_pfail:0 cluster_slots_fail:0 cluster_known_nodes:6 cluster_size:3 cluster_current_epoch:9 cluster_my_epoch:9 cluster_stats_messages_ping_sent:605 cluster_stats_messages_pong_sent:581 cluster_stats_messages_meet_sent:1 cluster_stats_messages_fail_sent:5 cluster_stats_messages_auth-req_sent:5 cluster_stats_messages_sent:1197 cluster_stats_messages_ping_received:575 cluster_stats_messages_pong_received:603 cluster_stats_messages_meet_received:1 cluster_stats_messages_auth-ack_received:2 cluster_stats_messages_received:1181 total_cluster_links_buffer_limit_exceeded:0 ========== 节点: rediscl-huzdsq-shard-bfc-1 ========== 检测到基础名称: rediscl-huzdsq-shard-bfc, 分片编号: 1 使用 Secret: rediscl-huzdsq-shard-bfc-account-default 密码获取成功，前缀: Xm... 使用Pod环境变量中的Redis端口: 6379 --- 集群节点信息 --- 566610eaebef8ad78e4fa9a8957436093634de2c 172.31.12.213:31054@30545,rediscl-huzdsq-shard-tt9-1.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local slave 9a47e108282ae378589e88936924a2f36a944e1a 0 1750329954000 7 connected 6805dfae60f82469d32f167a0762f10b9fe532dc 172.31.2.115:30964@30479,rediscl-huzdsq-shard-fwk-0.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local master - 0 1750329954000 6 connected 1365-5460 8193-9557 9a47e108282ae378589e88936924a2f36a944e1a 172.31.12.213:30626@31966,rediscl-huzdsq-shard-tt9-0.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local master - 0 1750329953360 7 connected 9558-10922 12288-16383 f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 172.31.10.241:32508@31084,rediscl-huzdsq-shard-bfc-1.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local myself,slave a5d4fc43276d727e0f162488944b68ba7c1e439d 0 1750329952000 9 connected a5d4fc43276d727e0f162488944b68ba7c1e439d 172.31.12.213:32496@30676,rediscl-huzdsq-shard-bfc-0.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local master - 0 1750329954364 9 connected 0-1364 5461-8192 10923-12287 f1e5ba6810221fd9b7af42fc1ff2907eaed2b142 172.31.13.158:31209@30928,rediscl-huzdsq-shard-fwk-1.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local slave 6805dfae60f82469d32f167a0762f10b9fe532dc 0 1750329954566 6 connected --- 集群状态信息 --- cluster_state:ok cluster_slots_assigned:16384 cluster_slots_ok:16384 cluster_slots_pfail:0 cluster_slots_fail:0 cluster_known_nodes:6 cluster_size:3 cluster_current_epoch:9 cluster_my_epoch:9 cluster_stats_messages_ping_sent:62 cluster_stats_messages_pong_sent:46 cluster_stats_messages_meet_sent:1 cluster_stats_messages_sent:109 cluster_stats_messages_ping_received:46 cluster_stats_messages_pong_received:63 cluster_stats_messages_received:109 total_cluster_links_buffer_limit_exceeded:0 ========== 节点: rediscl-huzdsq-shard-fwk-0 ========== 检测到基础名称: rediscl-huzdsq-shard-fwk, 分片编号: 0 使用 Secret: rediscl-huzdsq-shard-fwk-account-default 密码获取成功，前缀: Xm... 使用Pod环境变量中的Redis端口: 6379 --- 集群节点信息 --- f1e5ba6810221fd9b7af42fc1ff2907eaed2b142 172.31.13.158:31209@30928,rediscl-huzdsq-shard-fwk-1.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local slave 6805dfae60f82469d32f167a0762f10b9fe532dc 0 1750329960000 6 connected f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 172.31.10.241:32508@31084,rediscl-huzdsq-shard-bfc-1.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local slave a5d4fc43276d727e0f162488944b68ba7c1e439d 0 1750329960972 9 connected 6805dfae60f82469d32f167a0762f10b9fe532dc 172.31.2.115:30964@30479,rediscl-huzdsq-shard-fwk-0.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local myself,master - 0 1750329960000 6 connected 1365-5460 8193-9557 a5d4fc43276d727e0f162488944b68ba7c1e439d 172.31.12.213:32496@30676,rediscl-huzdsq-shard-bfc-0.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local master - 0 1750329960000 9 connected 0-1364 5461-8192 10923-12287 9a47e108282ae378589e88936924a2f36a944e1a 172.31.12.213:30626@31966,rediscl-huzdsq-shard-tt9-0.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local master - 0 1750329960000 7 connected 9558-10922 12288-16383 566610eaebef8ad78e4fa9a8957436093634de2c 172.31.12.213:31054@30545,rediscl-huzdsq-shard-tt9-1.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local slave 9a47e108282ae378589e88936924a2f36a944e1a 0 1750329960000 7 connected --- 集群状态信息 --- cluster_state:ok cluster_slots_assigned:16384 cluster_slots_ok:16384 cluster_slots_pfail:0 cluster_slots_fail:0 cluster_known_nodes:6 cluster_size:3 cluster_current_epoch:9 cluster_my_epoch:6 cluster_stats_messages_ping_sent:2981 cluster_stats_messages_pong_sent:12540 cluster_stats_messages_meet_sent:2 cluster_stats_messages_fail_sent:9 cluster_stats_messages_auth-ack_sent:2 cluster_stats_messages_update_sent:8 cluster_stats_messages_sent:15542 cluster_stats_messages_ping_received:2982 cluster_stats_messages_pong_received:9809 cluster_stats_messages_meet_received:3 cluster_stats_messages_fail_received:1 cluster_stats_messages_auth-req_received:2 cluster_stats_messages_update_received:3 cluster_stats_messages_received:12800 total_cluster_links_buffer_limit_exceeded:0 ========== 节点: rediscl-huzdsq-shard-fwk-1 ========== 检测到基础名称: rediscl-huzdsq-shard-fwk, 分片编号: 1 使用 Secret: rediscl-huzdsq-shard-fwk-account-default 密码获取成功，前缀: Xm... 使用Pod环境变量中的Redis端口: 6379 --- 集群节点信息 --- a5d4fc43276d727e0f162488944b68ba7c1e439d 172.31.12.213:32496@30676,rediscl-huzdsq-shard-bfc-0.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local master - 0 1750329966295 9 connected 0-1364 5461-8192 10923-12287 f1e5ba6810221fd9b7af42fc1ff2907eaed2b142 172.31.13.158:31209@30928,rediscl-huzdsq-shard-fwk-1.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local myself,slave 6805dfae60f82469d32f167a0762f10b9fe532dc 0 1750329965000 6 connected 6805dfae60f82469d32f167a0762f10b9fe532dc 172.31.2.115:30964@30479,rediscl-huzdsq-shard-fwk-0.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local master - 0 1750329966000 6 connected 1365-5460 8193-9557 566610eaebef8ad78e4fa9a8957436093634de2c 172.31.12.213:31054@30545,rediscl-huzdsq-shard-tt9-1.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local slave 9a47e108282ae378589e88936924a2f36a944e1a 0 1750329967807 7 connected f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 172.31.10.241:32508@31084,rediscl-huzdsq-shard-bfc-1.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local slave a5d4fc43276d727e0f162488944b68ba7c1e439d 0 1750329967000 9 connected 9a47e108282ae378589e88936924a2f36a944e1a 172.31.12.213:30626@31966,rediscl-huzdsq-shard-tt9-0.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local master - 0 1750329966598 7 connected 9558-10922 12288-16383 --- 集群状态信息 --- cluster_state:ok cluster_slots_assigned:16384 cluster_slots_ok:16384 cluster_slots_pfail:0 cluster_slots_fail:0 cluster_known_nodes:6 cluster_size:3 cluster_current_epoch:9 cluster_my_epoch:6 cluster_stats_messages_ping_sent:3009 cluster_stats_messages_pong_sent:3064 cluster_stats_messages_meet_sent:1 cluster_stats_messages_update_sent:8 cluster_stats_messages_sent:6082 cluster_stats_messages_ping_received:3064 cluster_stats_messages_pong_received:11197 cluster_stats_messages_fail_received:5 cluster_stats_messages_auth-req_received:3 cluster_stats_messages_update_received:13 cluster_stats_messages_received:14282 total_cluster_links_buffer_limit_exceeded:0 ========== 节点: rediscl-huzdsq-shard-tt9-0 ========== 检测到基础名称: rediscl-huzdsq-shard-tt9, 分片编号: 0 使用 Secret: rediscl-huzdsq-shard-tt9-account-default 密码获取成功，前缀: Xm... 使用Pod环境变量中的Redis端口: 6379 --- 集群节点信息 --- a5d4fc43276d727e0f162488944b68ba7c1e439d 172.31.12.213:32496@30676,rediscl-huzdsq-shard-bfc-0.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local master - 0 1750329974640 9 connected 0-1364 5461-8192 10923-12287 f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 172.31.10.241:32508@31084,rediscl-huzdsq-shard-bfc-1.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local slave a5d4fc43276d727e0f162488944b68ba7c1e439d 0 1750329974539 9 connected 566610eaebef8ad78e4fa9a8957436093634de2c 172.31.12.213:31054@30545,rediscl-huzdsq-shard-tt9-1.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local slave 9a47e108282ae378589e88936924a2f36a944e1a 0 1750329973533 7 connected 9a47e108282ae378589e88936924a2f36a944e1a 172.31.12.213:30626@31966,rediscl-huzdsq-shard-tt9-0.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local myself,master - 0 1750329974000 7 connected 9558-10922 12288-16383 f1e5ba6810221fd9b7af42fc1ff2907eaed2b142 172.31.13.158:31209@30928,rediscl-huzdsq-shard-fwk-1.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local slave 6805dfae60f82469d32f167a0762f10b9fe532dc 0 1750329973000 6 connected 6805dfae60f82469d32f167a0762f10b9fe532dc 172.31.2.115:30964@30479,rediscl-huzdsq-shard-fwk-0.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local master - 0 1750329974000 6 connected 1365-5460 8193-9557 --- 集群状态信息 --- cluster_state:ok cluster_slots_assigned:16384 cluster_slots_ok:16384 cluster_slots_pfail:0 cluster_slots_fail:0 cluster_known_nodes:6 cluster_size:3 cluster_current_epoch:9 cluster_my_epoch:7 cluster_stats_messages_ping_sent:2974 cluster_stats_messages_pong_sent:12545 cluster_stats_messages_meet_sent:2 cluster_stats_messages_auth-ack_sent:2 cluster_stats_messages_update_sent:10 cluster_stats_messages_sent:15533 cluster_stats_messages_ping_received:2986 cluster_stats_messages_pong_received:9800 cluster_stats_messages_meet_received:4 cluster_stats_messages_fail_received:2 cluster_stats_messages_auth-req_received:2 cluster_stats_messages_update_received:2 cluster_stats_messages_received:12796 total_cluster_links_buffer_limit_exceeded:0 ========== 节点: rediscl-huzdsq-shard-tt9-1 ========== 检测到基础名称: rediscl-huzdsq-shard-tt9, 分片编号: 1 使用 Secret: rediscl-huzdsq-shard-tt9-account-default 密码获取成功，前缀: Xm... 使用Pod环境变量中的Redis端口: 6379 --- 集群节点信息 --- 6805dfae60f82469d32f167a0762f10b9fe532dc 172.31.2.115:30964@30479,rediscl-huzdsq-shard-fwk-0.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local master - 0 1750329980505 6 connected 1365-5460 8193-9557 f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 172.31.10.241:32508@31084,rediscl-huzdsq-shard-bfc-1.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local slave a5d4fc43276d727e0f162488944b68ba7c1e439d 0 1750329981511 9 connected f1e5ba6810221fd9b7af42fc1ff2907eaed2b142 172.31.13.158:31209@30928,rediscl-huzdsq-shard-fwk-1.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local slave 6805dfae60f82469d32f167a0762f10b9fe532dc 0 1750329981000 6 connected 566610eaebef8ad78e4fa9a8957436093634de2c 172.31.12.213:31054@30545,rediscl-huzdsq-shard-tt9-1.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local myself,slave 9a47e108282ae378589e88936924a2f36a944e1a 0 1750329979000 7 connected a5d4fc43276d727e0f162488944b68ba7c1e439d 172.31.12.213:32496@30676,rediscl-huzdsq-shard-bfc-0.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local master - 0 1750329979500 9 connected 0-1364 5461-8192 10923-12287 9a47e108282ae378589e88936924a2f36a944e1a 172.31.12.213:30626@31966,rediscl-huzdsq-shard-tt9-0.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local master - 0 1750329980000 7 connected 9558-10922 12288-16383 --- 集群状态信息 --- cluster_state:ok cluster_slots_assigned:16384 cluster_slots_ok:16384 cluster_slots_pfail:0 cluster_slots_fail:0 cluster_known_nodes:6 cluster_size:3 cluster_current_epoch:9 cluster_my_epoch:7 cluster_stats_messages_ping_sent:3037 cluster_stats_messages_pong_sent:3037 cluster_stats_messages_meet_sent:1 cluster_stats_messages_fail_sent:10 cluster_stats_messages_auth-req_sent:5 cluster_stats_messages_update_sent:12 cluster_stats_messages_sent:6102 cluster_stats_messages_ping_received:3037 cluster_stats_messages_pong_received:11224 cluster_stats_messages_fail_received:5 cluster_stats_messages_auth-req_received:2 cluster_stats_messages_update_received:6 cluster_stats_messages_received:14274 total_cluster_links_buffer_limit_exceeded:0 ========== 集群健康分析 ========== 使用节点 rediscl-huzdsq-shard-bfc-0 作为参考基准 检测到以下分片标识符: - bfc - fwk - tt9 参考节点观察到的拓扑结构: ID IP地址 状态 主节点ID 槽位 ---------------------------------------- ------------- ---------------- ---------------------------------------- -------------- a5d4fc43276d727e0f162488944b68ba7c1e439d 172.31.12.213:32496 主节点 - 0-1364 5461-8192 10923-12287 (共 0 个槽位) 6805dfae60f82469d32f167a0762f10b9fe532dc 172.31.2.115:30964 主节点 - 1365-5460 8193-9557 (共 0 个槽位) 9a47e108282ae378589e88936924a2f36a944e1a 172.31.12.213:30626 主节点 - 9558-10922 12288-16383 (共 0 个槽位) 566610eaebef8ad78e4fa9a8957436093634de2c 172.31.12.213:31054 从节点 9a47e108282ae378589e88936924a2f36a944e1a f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 172.31.10.241:32508 从节点 a5d4fc43276d727e0f162488944b68ba7c1e439d f1e5ba6810221fd9b7af42fc1ff2907eaed2b142 172.31.13.158:31209 从节点 6805dfae60f82469d32f167a0762f10b9fe532dc 正在分析节点 rediscl-huzdsq-shard-bfc-1 的拓扑视图... 正在分析节点 rediscl-huzdsq-shard-fwk-0 的拓扑视图... 正在分析节点 rediscl-huzdsq-shard-fwk-1 的拓扑视图... 正在分析节点 rediscl-huzdsq-shard-tt9-0 的拓扑视图... 正在分析节点 rediscl-huzdsq-shard-tt9-1 的拓扑视图... 槽位分配统计: - 总槽位数: 16384 - 未覆盖槽位数: 0 - 重复覆盖槽位数: 0 - 正确覆盖槽位数: 16384 主节点槽位分配明细: 节点 a5d4fc43276d727e0f162488944b68ba7c1e439d (172.31.12.213:32496) 负责 0 个槽位: 0-1364 5461-8192 10923-12287 节点 6805dfae60f82469d32f167a0762f10b9fe532dc (172.31.2.115:30964) 负责 0 个槽位: 1365-5460 8193-9557 节点 9a47e108282ae378589e88936924a2f36a944e1a (172.31.12.213:30626) 负责 0 个槽位: 9558-10922 12288-16383 总计分配槽位: 0 / 16384 警告: 分配的总槽位数 (0) 不等于 16384 缺少 16384 个槽位分配 分片分析: 分片 bfc: 1 个主节点, 1 个从节点 ✅ 分片 fwk: 1 个主节点, 1 个从节点 ✅ 分片 tt9: 1 个主节点, 1 个从节点 ✅ 集群分析总结: - 检测到 3 个主节点和 3 个从节点 - 检测到 0 个故障或疑似故障节点 - 集群状态统一显示为OK: 是 - 所有槽位正确分配: 是 - 所有节点看到一致的集群大小: 是 - 所有节点看到一致的拓扑结构: 是 - 所有槽位被正确覆盖: 是 - 集群中无故障或疑似故障节点: 是 集群健康状态: 健康 ✅ 所有检查均通过，Redis集群运行正常。 analyze cluster health success check failover pod name failover pod name:rediscl-huzdsq-shard-bfc-0 failover Success `kubectl get secrets -l app.kubernetes.io/instance=rediscl-huzdsq` set secret: rediscl-huzdsq-shard-fwk-account-default `kubectl get secrets rediscl-huzdsq-shard-fwk-account-default -o jsonpath="***.data.username***"` `kubectl get secrets rediscl-huzdsq-shard-fwk-account-default -o jsonpath="***.data.password***"` `kubectl get secrets rediscl-huzdsq-shard-fwk-account-default -o jsonpath="***.data.port***"` DB_USERNAME:default;DB_PASSWORD:Xm507FZu07;DB_PORT:6379;DB_DATABASE: apiVersion: v1 kind: Pod metadata: name: benchtest-rediscl-huzdsq namespace: ns-xqred spec: containers: - name: test-benchmark imagePullPolicy: IfNotPresent image: docker.io/apecloud/redis-benchmark:latest args: - "-h" - "rediscl-huzdsq-shard-fwk-redis-advertised-0.ns-xqred.svc.cluster.local" - "-p" - "6379" - "-a" - "Xm507FZu07" - "-n" - "5000" - "-c" - "10" - "--cluster" - "-q" restartPolicy: Never `kubectl apply -f benchtest-rediscl-huzdsq.yaml` pod/benchtest-rediscl-huzdsq created apply benchtest-rediscl-huzdsq.yaml Success `rm -rf benchtest-rediscl-huzdsq.yaml` check pod status pod_status:NAME READY STATUS RESTARTS AGE benchtest-rediscl-huzdsq 0/1 ContainerCreating 0 1s pod_status:NAME READY STATUS RESTARTS AGE benchtest-rediscl-huzdsq 1/1 Running 0 6s pod_status:NAME READY STATUS RESTARTS AGE benchtest-rediscl-huzdsq 1/1 Running 0 13s pod_status:NAME READY STATUS RESTARTS AGE benchtest-rediscl-huzdsq 1/1 Running 0 19s pod_status:NAME READY STATUS RESTARTS AGE benchtest-rediscl-huzdsq 1/1 Running 0 25s pod_status:NAME READY STATUS RESTARTS AGE benchtest-rediscl-huzdsq 1/1 Running 0 31s check pod benchtest-rediscl-huzdsq status done pod_status:NAME READY STATUS RESTARTS AGE benchtest-rediscl-huzdsq 0/1 Completed 0 37s `kubectl logs benchtest-rediscl-huzdsq --tail 30 --namespace ns-xqred ` Cluster has 3 master nodes: Master 0: 6805dfae60f82469d32f167a0762f10b9fe532dc 172.31.2.115:30964 Master 1: a5d4fc43276d727e0f162488944b68ba7c1e439d 172.31.12.213:32496 Master 2: 9a47e108282ae378589e88936924a2f36a944e1a 172.31.12.213:30626 PING_INLINE: rps=0.0 (overall: 4000.0) avg_msec=0.299 (overall: 0.171) PING_INLINE: rps=9300.4 (overall: 9258.8) avg_msec=0.991 (overall: 0.983) PING_INLINE: rps=4382.5 (overall: 6839.9) avg_msec=1.720 (overall: 1.218) PING_INLINE: rps=6115.5 (overall: 6599.7) avg_msec=1.903 (overall: 1.428) PING_INLINE: 4990.02 requests per second, p50=0.311 msec PING_MBULK: rps=20.2 (overall: 5000.0) avg_msec=0.215 (overall: 0.175) PING_MBULK: rps=9313.5 (overall: 9296.4) avg_msec=0.978 (overall: 0.975) PING_MBULK: rps=6055.8 (overall: 7682.5) avg_msec=1.333 (overall: 1.115) PING_MBULK: 6631.30 requests per second, p50=0.319 msec SET: rps=4.0 (overall: 1000.0) avg_msec=0.683 (overall: 0.090) SET: rps=3462.2 (overall: 3452.4) avg_msec=1.912 (overall: 1.902) SET: rps=4649.4 (overall: 4049.7) avg_msec=2.632 (overall: 2.320) SET: rps=3124.0 (overall: 3742.4) avg_msec=2.486 (overall: 2.366) SET: rps=3840.6 (overall: 3766.9) avg_msec=3.080 (overall: 2.548) SET: rps=3027.9 (overall: 3619.1) avg_msec=3.081 (overall: 2.637) SET: 3320.05 requests per second, p50=0.367 msec GET: rps=15.8 (overall: 4000.0) avg_msec=0.221 (overall: 0.552) GET: rps=7729.1 (overall: 7714.3) avg_msec=1.047 (overall: 1.045) GET: rps=7972.1 (overall: 7842.9) avg_msec=1.294 (overall: 1.171) GET: 6631.30 requests per second, p50=0.295 msec INCR: rps=0.0 (overall: -nan) avg_msec=-nan (overall: -nan) INCR: rps=4849.2 (overall: 4849.2) avg_msec=1.741 (overall: 1.741) INCR: rps=3952.0 (overall: 4402.4) avg_msec=2.813 (overall: 2.225) INCR: rps=3575.4 (overall: 4126.0) avg_msec=2.288 (overall: 2.242) INCR: rps=3836.7 (overall: 4053.7) avg_msec=3.021 (overall: 2.428) INCR: 3993.61 requests per second, p50=0.359 msec LPUSH: rps=0.0 (overall: 0.0) avg_msec=0.433 (overall: 0.000) LPUSH: rps=4171.3 (overall: 4154.8) avg_msec=2.337 (overall: 2.330) LPUSH: rps=3621.5 (overall: 3888.7) avg_msec=2.295 (overall: 2.311) LPUSH: rps=4282.9 (overall: 4019.9) avg_msec=2.697 (overall: 2.452) LPUSH: rps=3988.0 (overall: 4011.9) avg_msec=2.072 (overall: 2.356) LPUSH: 3987.24 requests per second, p50=0.359 msec RPUSH: rps=0.0 (overall: 0.0) avg_msec=0.000 (overall: -nan) RPUSH: rps=4406.4 (overall: 4388.9) avg_msec=1.821 (overall: 1.818) RPUSH: rps=4820.7 (overall: 4604.4) avg_msec=2.402 (overall: 2.125) RPUSH: rps=3745.0 (overall: 4318.3) avg_msec=2.125 (overall: 2.124) RPUSH: rps=4525.9 (overall: 4370.1) avg_msec=2.617 (overall: 2.252) RPUSH: rps=2420.0 (overall: 3981.7) avg_msec=3.118 (overall: 2.356) RPUSH: 3320.05 requests per second, p50=0.351 msec LPOP: rps=31.6 (overall: 8000.0) avg_msec=0.287 (overall: 0.502) LPOP: rps=4952.4 (overall: 4964.4) avg_msec=1.526 (overall: 1.514) LPOP: rps=4552.0 (overall: 4759.4) avg_msec=2.627 (overall: 2.044) LPOP: rps=3797.6 (overall: 4438.4) avg_msec=2.078 (overall: 2.054) LPOP: rps=4796.8 (overall: 4527.8) avg_msec=2.430 (overall: 2.153) LPOP: 3977.72 requests per second, p50=0.351 msec RPOP: rps=4.0 (overall: inf) avg_msec=0.328 (overall: 0.081) RPOP: rps=6216.5 (overall: 6220.5) avg_msec=1.472 (overall: 1.467) RPOP: rps=2494.0 (overall: 4368.3) avg_msec=3.115 (overall: 1.934) RPOP: rps=4513.9 (overall: 4416.7) avg_msec=2.659 (overall: 2.180) RPOP: rps=3593.6 (overall: 4211.5) avg_msec=2.173 (overall: 2.179) RPOP: 3990.42 requests per second, p50=0.375 msec SADD: rps=24.2 (overall: 6000.0) avg_msec=0.380 (overall: 0.331) SADD: rps=5845.2 (overall: 5845.9) avg_msec=1.281 (overall: 1.273) SADD: rps=6697.2 (overall: 6269.8) avg_msec=1.741 (overall: 1.522) SADD: rps=4282.9 (overall: 5609.3) avg_msec=1.820 (overall: 1.597) SADD: 4975.12 requests per second, p50=0.383 msec HSET: rps=7.9 (overall: 1000.0) avg_msec=0.546 (overall: 0.486) HSET: rps=4599.2 (overall: 4570.9) avg_msec=1.513 (overall: 1.508) HSET: rps=4573.7 (overall: 4572.3) avg_msec=2.621 (overall: 2.061) HSET: rps=2996.0 (overall: 4048.9) avg_msec=2.521 (overall: 2.174) HSET: rps=4218.3 (overall: 4091.3) avg_msec=2.812 (overall: 2.339) HSET: rps=2753.0 (overall: 3824.5) avg_msec=3.304 (overall: 2.477) HSET: 3313.45 requests per second, p50=0.399 msec SPOP: rps=0.0 (overall: 0.0) avg_msec=0.000 (overall: -nan) SPOP: rps=8191.2 (overall: 8158.7) avg_msec=1.020 (overall: 1.019) SPOP: rps=7948.2 (overall: 8053.7) avg_msec=1.331 (overall: 1.173) SPOP: 6631.30 requests per second, p50=0.383 msec ZADD: rps=0.0 (overall: -nan) avg_msec=-nan (overall: -nan) ZADD: rps=6754.0 (overall: 6754.0) avg_msec=1.374 (overall: 1.374) ZADD: rps=4224.0 (overall: 5494.0) avg_msec=2.390 (overall: 1.764) ZADD: rps=5880.5 (overall: 5622.8) avg_msec=1.449 (overall: 1.654) ZADD: 4980.08 requests per second, p50=0.391 msec ZPOPMIN: rps=0.0 (overall: -nan) avg_msec=-nan (overall: -nan) ZPOPMIN: rps=7301.6 (overall: 7301.6) avg_msec=1.204 (overall: 1.204) ZPOPMIN: rps=6019.9 (overall: 6662.0) avg_msec=1.768 (overall: 1.461) ZPOPMIN: rps=5713.1 (overall: 6346.2) avg_msec=1.396 (overall: 1.441) ZPOPMIN: 4985.04 requests per second, p50=0.335 msec LPUSH (needed to benchmark LRANGE): rps=23.9 (overall: 6000.0) avg_msec=0.579 (overall: 0.751) LPUSH (needed to benchmark LRANGE): rps=4860.6 (overall: 4865.1) avg_msec=1.729 (overall: 1.718) LPUSH (needed to benchmark LRANGE): rps=4418.3 (overall: 4642.1) avg_msec=2.541 (overall: 2.111) LPUSH (needed to benchmark LRANGE): rps=3857.1 (overall: 4380.1) avg_msec=2.075 (overall: 2.100) LPUSH (needed to benchmark LRANGE): rps=4573.7 (overall: 4428.4) avg_msec=2.551 (overall: 2.218) LPUSH (needed to benchmark LRANGE): 3980.89 requests per second, p50=0.359 msec LRANGE_100 (first 100 elements): rps=4.0 (overall: 1000.0) avg_msec=0.077 (overall: 0.460) LRANGE_100 (first 100 elements): rps=7488.1 (overall: 7462.5) avg_msec=1.270 (overall: 1.269) LRANGE_100 (first 100 elements): rps=3804.8 (overall: 5640.9) avg_msec=2.018 (overall: 1.519) LRANGE_100 (first 100 elements): rps=4418.3 (overall: 5234.4) avg_msec=2.605 (overall: 1.837) LRANGE_100 (first 100 elements): 4985.04 requests per second, p50=0.359 msec LRANGE_300 (first 300 elements): rps=0.0 (overall: 0.0) avg_msec=-nan (overall: -nan) LRANGE_300 (first 300 elements): rps=4392.9 (overall: 4375.5) avg_msec=2.048 (overall: 2.045) LRANGE_300 (first 300 elements): rps=3498.0 (overall: 3938.5) avg_msec=2.167 (overall: 2.100) LRANGE_300 (first 300 elements): rps=4247.0 (overall: 4041.1) avg_msec=2.572 (overall: 2.267) LRANGE_300 (first 300 elements): rps=3047.8 (overall: 3793.2) avg_msec=2.525 (overall: 2.317) LRANGE_300 (first 300 elements): rps=4167.3 (overall: 3867.9) avg_msec=2.589 (overall: 2.376) LRANGE_300 (first 300 elements): 3326.68 requests per second, p50=0.511 msec LRANGE_500 (first 500 elements): rps=32.1 (overall: 8000.0) avg_msec=0.652 (overall: 0.633) LRANGE_500 (first 500 elements): rps=3828.7 (overall: 3845.2) avg_msec=2.247 (overall: 2.233) LRANGE_500 (first 500 elements): rps=2596.0 (overall: 3223.1) avg_msec=2.856 (overall: 2.481) LRANGE_500 (first 500 elements): rps=3559.5 (overall: 3335.5) avg_msec=3.082 (overall: 2.716) LRANGE_500 (first 500 elements): rps=2133.9 (overall: 3032.7) avg_msec=3.378 (overall: 2.817) LRANGE_500 (first 500 elements): rps=3788.8 (overall: 3183.5) avg_msec=2.923 (overall: 2.844) LRANGE_500 (first 500 elements): rps=2587.3 (overall: 3084.1) avg_msec=2.752 (overall: 2.830) LRANGE_500 (first 500 elements): 2839.30 requests per second, p50=0.519 msec LRANGE_600 (first 600 elements): rps=0.0 (overall: 0.0) avg_msec=-nan (overall: -nan) LRANGE_600 (first 600 elements): rps=3478.1 (overall: 3464.3) avg_msec=1.796 (overall: 1.796) LRANGE_600 (first 600 elements): rps=3510.0 (overall: 3487.1) avg_msec=3.111 (overall: 2.457) LRANGE_600 (first 600 elements): rps=2450.2 (overall: 3141.9) avg_msec=3.089 (overall: 2.621) LRANGE_600 (first 600 elements): rps=3458.2 (overall: 3220.9) avg_msec=3.042 (overall: 2.734) LRANGE_600 (first 600 elements): rps=2143.4 (overall: 3005.6) avg_msec=3.820 (overall: 2.889) LRANGE_600 (first 600 elements): rps=2904.4 (overall: 2988.7) avg_msec=3.522 (overall: 2.991) LRANGE_600 (first 600 elements): 2495.01 requests per second, p50=0.551 msec MSET (10 keys): rps=2.0 (overall: 1000.0) avg_msec=0.265 (overall: 1.060) MSET (10 keys): rps=3729.1 (overall: 3718.3) avg_msec=2.174 (overall: 2.170) MSET (10 keys): rps=3749.0 (overall: 3733.6) avg_msec=2.784 (overall: 2.478) MSET (10 keys): rps=2725.1 (overall: 3397.9) avg_msec=3.366 (overall: 2.715) MSET (10 keys): rps=3681.3 (overall: 3468.7) avg_msec=2.865 (overall: 2.755) MSET (10 keys): rps=2660.0 (overall: 3307.6) avg_msec=3.456 (overall: 2.867) MSET (10 keys): rps=2733.1 (overall: 3211.8) avg_msec=3.767 (overall: 2.995) MSET (10 keys): 2845.76 requests per second, p50=0.439 msec XADD: rps=15.7 (overall: 4000.0) avg_msec=0.483 (overall: 0.260) XADD: rps=4557.8 (overall: 4555.6) avg_msec=1.841 (overall: 1.830) XADD: rps=2768.9 (overall: 3664.0) avg_msec=4.037 (overall: 2.669) XADD: rps=3749.0 (overall: 3692.3) avg_msec=2.228 (overall: 2.520) XADD: rps=3900.4 (overall: 3744.3) avg_msec=2.910 (overall: 2.622) XADD: rps=3466.1 (overall: 3688.7) avg_msec=2.355 (overall: 2.572) XADD: 3320.05 requests per second, p50=0.399 msec `kubectl delete pod benchtest-rediscl-huzdsq --force --namespace ns-xqred ` Warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely. pod "benchtest-rediscl-huzdsq" force deleted test delete pod all `kubectl get pod -n ns-xqred | grep rediscl-huzdsq-shard | awk '***print $1***' | xargs kubectl delete pod -n ns-xqred --force ` test delete pod all times: 1 Warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely. pod "rediscl-huzdsq-shard-bfc-0" force deleted pod "rediscl-huzdsq-shard-bfc-1" force deleted pod "rediscl-huzdsq-shard-fwk-0" force deleted pod "rediscl-huzdsq-shard-fwk-1" force deleted pod "rediscl-huzdsq-shard-tt9-0" force deleted pod "rediscl-huzdsq-shard-tt9-1" force deleted check cluster status `kbcli cluster list rediscl-huzdsq --show-labels --namespace ns-xqred ` NAME NAMESPACE CLUSTER-DEFINITION VERSION TERMINATION-POLICY STATUS CREATED-TIME LABELS rediscl-huzdsq ns-xqred Halt Updating Jun 19,2025 18:15 UTC+0800 app.kubernetes.io/instance=rediscl-huzdsq cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances rediscl-huzdsq --namespace ns-xqred ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME rediscl-huzdsq-shard-bfc-0 ns-xqred rediscl-huzdsq shard-bfc Running primary us-west-2a 100m / 100m 512Mi / 512Mi ip-172-31-6-202.us-west-2.compute.internal/172.31.6.202 Jun 19,2025 18:49 UTC+0800 rediscl-huzdsq-shard-bfc-1 ns-xqred rediscl-huzdsq shard-bfc Running secondary us-west-2a 100m / 100m 512Mi / 512Mi ip-172-31-12-213.us-west-2.compute.internal/172.31.12.213 Jun 19,2025 18:49 UTC+0800 rediscl-huzdsq-shard-fwk-0 ns-xqred rediscl-huzdsq shard-fwk Running primary us-west-2a 100m / 100m 512Mi / 512Mi ip-172-31-10-241.us-west-2.compute.internal/172.31.10.241 Jun 19,2025 18:49 UTC+0800 rediscl-huzdsq-shard-fwk-1 ns-xqred rediscl-huzdsq shard-fwk Running secondary us-west-2a 100m / 100m 512Mi / 512Mi ip-172-31-9-102.us-west-2.compute.internal/172.31.9.102 Jun 19,2025 18:49 UTC+0800 rediscl-huzdsq-shard-tt9-0 ns-xqred rediscl-huzdsq shard-tt9 Running primary us-west-2a 100m / 100m 512Mi / 512Mi ip-172-31-15-205.us-west-2.compute.internal/172.31.15.205 Jun 19,2025 18:49 UTC+0800 rediscl-huzdsq-shard-tt9-1 ns-xqred rediscl-huzdsq shard-tt9 Running secondary us-west-2a 100m / 100m 512Mi / 512Mi ip-172-31-5-137.us-west-2.compute.internal/172.31.5.137 Jun 19,2025 18:50 UTC+0800 check pod status done check cluster role check cluster role done primary: rediscl-huzdsq-shard-bfc-0 rediscl-huzdsq-shard-fwk-0 rediscl-huzdsq-shard-tt9-0;secondary: rediscl-huzdsq-shard-bfc-1 rediscl-huzdsq-shard-fwk-1 rediscl-huzdsq-shard-tt9-1 analyze cluster health check cluster connect `` ========== 节点: rediscl-huzdsq-shard-bfc-0 ========== 检测到基础名称: rediscl-huzdsq-shard-bfc, 分片编号: 0 使用 Secret: rediscl-huzdsq-shard-bfc-account-default 密码获取成功，前缀: Xm... 使用Pod环境变量中的Redis端口: 6379 --- 集群节点信息 --- f1e5ba6810221fd9b7af42fc1ff2907eaed2b142 172.31.9.102:31209@30928,rediscl-huzdsq-shard-fwk-1.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local slave 6805dfae60f82469d32f167a0762f10b9fe532dc 0 1750330236427 6 connected 566610eaebef8ad78e4fa9a8957436093634de2c 172.31.5.137:31054@30545,rediscl-huzdsq-shard-tt9-1.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local slave 9a47e108282ae378589e88936924a2f36a944e1a 0 1750330236528 7 connected a5d4fc43276d727e0f162488944b68ba7c1e439d 172.31.6.202:32496@30676,rediscl-huzdsq-shard-bfc-0.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local myself,master - 0 1750330235000 9 connected 0-1364 5461-8192 10923-12287 6805dfae60f82469d32f167a0762f10b9fe532dc 172.31.10.241:30964@30479,rediscl-huzdsq-shard-fwk-0.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local master - 0 1750330237432 6 connected 1365-5460 8193-9557 9a47e108282ae378589e88936924a2f36a944e1a 172.31.15.205:30626@31966,rediscl-huzdsq-shard-tt9-0.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local master - 0 1750330235418 7 connected 9558-10922 12288-16383 f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 172.31.12.213:32508@31084,rediscl-huzdsq-shard-bfc-1.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local slave a5d4fc43276d727e0f162488944b68ba7c1e439d 0 1750330236000 9 connected --- 集群状态信息 --- cluster_state:ok cluster_slots_assigned:16384 cluster_slots_ok:16384 cluster_slots_pfail:0 cluster_slots_fail:0 cluster_known_nodes:6 cluster_size:3 cluster_current_epoch:9 cluster_my_epoch:9 cluster_stats_messages_ping_sent:66 cluster_stats_messages_pong_sent:83 cluster_stats_messages_meet_sent:2 cluster_stats_messages_fail_sent:12 cluster_stats_messages_sent:163 cluster_stats_messages_ping_received:80 cluster_stats_messages_pong_received:63 cluster_stats_messages_meet_received:3 cluster_stats_messages_fail_received:7 cluster_stats_messages_received:153 total_cluster_links_buffer_limit_exceeded:0 ========== 节点: rediscl-huzdsq-shard-bfc-1 ========== 检测到基础名称: rediscl-huzdsq-shard-bfc, 分片编号: 1 使用 Secret: rediscl-huzdsq-shard-bfc-account-default 密码获取成功，前缀: Xm... 使用Pod环境变量中的Redis端口: 6379 --- 集群节点信息 --- f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 172.31.12.213:32508@31084,rediscl-huzdsq-shard-bfc-1.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local myself,slave a5d4fc43276d727e0f162488944b68ba7c1e439d 0 1750330242000 9 connected a5d4fc43276d727e0f162488944b68ba7c1e439d 172.31.6.202:32496@30676,rediscl-huzdsq-shard-bfc-0.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local master - 0 1750330243503 9 connected 0-1364 5461-8192 10923-12287 9a47e108282ae378589e88936924a2f36a944e1a 172.31.15.205:30626@31966,rediscl-huzdsq-shard-tt9-0.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local master - 0 1750330243000 7 connected 9558-10922 12288-16383 566610eaebef8ad78e4fa9a8957436093634de2c 172.31.5.137:31054@30545,rediscl-huzdsq-shard-tt9-1.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local slave 9a47e108282ae378589e88936924a2f36a944e1a 0 1750330244006 7 connected f1e5ba6810221fd9b7af42fc1ff2907eaed2b142 172.31.9.102:31209@30928,rediscl-huzdsq-shard-fwk-1.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local slave 6805dfae60f82469d32f167a0762f10b9fe532dc 0 1750330243502 6 connected 6805dfae60f82469d32f167a0762f10b9fe532dc 172.31.10.241:30964@30479,rediscl-huzdsq-shard-fwk-0.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local master - 0 1750330243000 6 connected 1365-5460 8193-9557 --- 集群状态信息 --- cluster_state:ok cluster_slots_assigned:16384 cluster_slots_ok:16384 cluster_slots_pfail:0 cluster_slots_fail:0 cluster_known_nodes:6 cluster_size:3 cluster_current_epoch:9 cluster_my_epoch:9 cluster_stats_messages_ping_sent:72 cluster_stats_messages_pong_sent:64 cluster_stats_messages_meet_sent:1 cluster_stats_messages_fail_sent:10 cluster_stats_messages_sent:147 cluster_stats_messages_ping_received:64 cluster_stats_messages_pong_received:71 cluster_stats_messages_received:135 total_cluster_links_buffer_limit_exceeded:0 ========== 节点: rediscl-huzdsq-shard-fwk-0 ========== 检测到基础名称: rediscl-huzdsq-shard-fwk, 分片编号: 0 使用 Secret: rediscl-huzdsq-shard-fwk-account-default 密码获取成功，前缀: Xm... 使用Pod环境变量中的Redis端口: 6379 --- 集群节点信息 --- f1e5ba6810221fd9b7af42fc1ff2907eaed2b142 172.31.9.102:31209@30928,rediscl-huzdsq-shard-fwk-1.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local slave 6805dfae60f82469d32f167a0762f10b9fe532dc 0 1750330249000 6 connected 9a47e108282ae378589e88936924a2f36a944e1a 172.31.15.205:30626@31966,rediscl-huzdsq-shard-tt9-0.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local master - 0 1750330250559 7 connected 9558-10922 12288-16383 6805dfae60f82469d32f167a0762f10b9fe532dc 172.31.10.241:30964@30479,rediscl-huzdsq-shard-fwk-0.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local myself,master - 0 1750330248000 6 connected 1365-5460 8193-9557 566610eaebef8ad78e4fa9a8957436093634de2c 172.31.5.137:31054@30545,rediscl-huzdsq-shard-tt9-1.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local slave 9a47e108282ae378589e88936924a2f36a944e1a 0 1750330250000 7 connected a5d4fc43276d727e0f162488944b68ba7c1e439d 172.31.6.202:32496@30676,rediscl-huzdsq-shard-bfc-0.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local master - 0 1750330248851 9 connected 0-1364 5461-8192 10923-12287 f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 172.31.12.213:32508@31084,rediscl-huzdsq-shard-bfc-1.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local slave a5d4fc43276d727e0f162488944b68ba7c1e439d 0 1750330249856 9 connected --- 集群状态信息 --- cluster_state:ok cluster_slots_assigned:16384 cluster_slots_ok:16384 cluster_slots_pfail:0 cluster_slots_fail:0 cluster_known_nodes:6 cluster_size:3 cluster_current_epoch:9 cluster_my_epoch:6 cluster_stats_messages_ping_sent:91 cluster_stats_messages_pong_sent:112 cluster_stats_messages_meet_sent:2 cluster_stats_messages_fail_sent:16 cluster_stats_messages_sent:221 cluster_stats_messages_ping_received:109 cluster_stats_messages_pong_received:88 cluster_stats_messages_meet_received:3 cluster_stats_messages_fail_received:11 cluster_stats_messages_received:211 total_cluster_links_buffer_limit_exceeded:0 ========== 节点: rediscl-huzdsq-shard-fwk-1 ========== 检测到基础名称: rediscl-huzdsq-shard-fwk, 分片编号: 1 使用 Secret: rediscl-huzdsq-shard-fwk-account-default 密码获取成功，前缀: Xm... 使用Pod环境变量中的Redis端口: 6379 --- 集群节点信息 --- f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 172.31.12.213:32508@31084,rediscl-huzdsq-shard-bfc-1.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local slave a5d4fc43276d727e0f162488944b68ba7c1e439d 0 1750330255072 9 connected a5d4fc43276d727e0f162488944b68ba7c1e439d 172.31.6.202:32496@30676,rediscl-huzdsq-shard-bfc-0.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local master - 0 1750330256578 9 connected 0-1364 5461-8192 10923-12287 f1e5ba6810221fd9b7af42fc1ff2907eaed2b142 172.31.9.102:31209@30928,rediscl-huzdsq-shard-fwk-1.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local myself,slave 6805dfae60f82469d32f167a0762f10b9fe532dc 0 1750330256000 6 connected 9a47e108282ae378589e88936924a2f36a944e1a 172.31.15.205:30626@31966,rediscl-huzdsq-shard-tt9-0.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local master - 0 1750330256000 7 connected 9558-10922 12288-16383 6805dfae60f82469d32f167a0762f10b9fe532dc 172.31.10.241:30964@30479,rediscl-huzdsq-shard-fwk-0.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local master - 0 1750330257080 6 connected 1365-5460 8193-9557 566610eaebef8ad78e4fa9a8957436093634de2c 172.31.5.137:31054@30545,rediscl-huzdsq-shard-tt9-1.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local slave 9a47e108282ae378589e88936924a2f36a944e1a 0 1750330256578 7 connected --- 集群状态信息 --- cluster_state:ok cluster_slots_assigned:16384 cluster_slots_ok:16384 cluster_slots_pfail:0 cluster_slots_fail:0 cluster_known_nodes:6 cluster_size:3 cluster_current_epoch:9 cluster_my_epoch:6 cluster_stats_messages_ping_sent:97 cluster_stats_messages_pong_sent:76 cluster_stats_messages_meet_sent:1 cluster_stats_messages_fail_sent:10 cluster_stats_messages_sent:184 cluster_stats_messages_ping_received:76 cluster_stats_messages_pong_received:96 cluster_stats_messages_received:172 total_cluster_links_buffer_limit_exceeded:0 ========== 节点: rediscl-huzdsq-shard-tt9-0 ========== 检测到基础名称: rediscl-huzdsq-shard-tt9, 分片编号: 0 使用 Secret: rediscl-huzdsq-shard-tt9-account-default 密码获取成功，前缀: Xm... 使用Pod环境变量中的Redis端口: 6379 --- 集群节点信息 --- 6805dfae60f82469d32f167a0762f10b9fe532dc 172.31.10.241:30964@30479,rediscl-huzdsq-shard-fwk-0.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local master - 0 1750330263349 6 connected 1365-5460 8193-9557 a5d4fc43276d727e0f162488944b68ba7c1e439d 172.31.6.202:32496@30676,rediscl-huzdsq-shard-bfc-0.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local master - 0 1750330261539 9 connected 0-1364 5461-8192 10923-12287 9a47e108282ae378589e88936924a2f36a944e1a 172.31.15.205:30626@31966,rediscl-huzdsq-shard-tt9-0.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local myself,master - 0 1750330263000 7 connected 9558-10922 12288-16383 f1e5ba6810221fd9b7af42fc1ff2907eaed2b142 172.31.9.102:31209@30928,rediscl-huzdsq-shard-fwk-1.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local slave 6805dfae60f82469d32f167a0762f10b9fe532dc 0 1750330263650 6 connected 566610eaebef8ad78e4fa9a8957436093634de2c 172.31.5.137:31054@30545,rediscl-huzdsq-shard-tt9-1.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local slave 9a47e108282ae378589e88936924a2f36a944e1a 0 1750330262343 7 connected f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 172.31.12.213:32508@31084,rediscl-huzdsq-shard-bfc-1.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local slave a5d4fc43276d727e0f162488944b68ba7c1e439d 0 1750330262000 9 connected --- 集群状态信息 --- cluster_state:ok cluster_slots_assigned:16384 cluster_slots_ok:16384 cluster_slots_pfail:0 cluster_slots_fail:0 cluster_known_nodes:6 cluster_size:3 cluster_current_epoch:9 cluster_my_epoch:7 cluster_stats_messages_ping_sent:122 cluster_stats_messages_pong_sent:128 cluster_stats_messages_meet_sent:2 cluster_stats_messages_fail_sent:15 cluster_stats_messages_sent:267 cluster_stats_messages_ping_received:125 cluster_stats_messages_pong_received:119 cluster_stats_messages_meet_received:3 cluster_stats_messages_fail_received:4 cluster_stats_messages_received:251 total_cluster_links_buffer_limit_exceeded:0 ========== 节点: rediscl-huzdsq-shard-tt9-1 ========== 检测到基础名称: rediscl-huzdsq-shard-tt9, 分片编号: 1 使用 Secret: rediscl-huzdsq-shard-tt9-account-default 密码获取成功，前缀: Xm... 使用Pod环境变量中的Redis端口: 6379 --- 集群节点信息 --- 9a47e108282ae378589e88936924a2f36a944e1a 172.31.15.205:30626@31966,rediscl-huzdsq-shard-tt9-0.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local master - 0 1750330270133 7 connected 9558-10922 12288-16383 f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 172.31.12.213:32508@31084,rediscl-huzdsq-shard-bfc-1.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local slave a5d4fc43276d727e0f162488944b68ba7c1e439d 0 1750330269027 9 connected a5d4fc43276d727e0f162488944b68ba7c1e439d 172.31.6.202:32496@30676,rediscl-huzdsq-shard-bfc-0.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local master - 0 1750330269027 9 connected 0-1364 5461-8192 10923-12287 f1e5ba6810221fd9b7af42fc1ff2907eaed2b142 172.31.9.102:31209@30928,rediscl-huzdsq-shard-fwk-1.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local slave 6805dfae60f82469d32f167a0762f10b9fe532dc 0 1750330268123 6 connected 566610eaebef8ad78e4fa9a8957436093634de2c 172.31.5.137:31054@30545,rediscl-huzdsq-shard-tt9-1.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local myself,slave 9a47e108282ae378589e88936924a2f36a944e1a 0 1750330269000 7 connected 6805dfae60f82469d32f167a0762f10b9fe532dc 172.31.10.241:30964@30479,rediscl-huzdsq-shard-fwk-0.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local master - 0 1750330269128 6 connected 1365-5460 8193-9557 --- 集群状态信息 --- cluster_state:ok cluster_slots_assigned:16384 cluster_slots_ok:16384 cluster_slots_pfail:0 cluster_slots_fail:0 cluster_known_nodes:6 cluster_size:3 cluster_current_epoch:9 cluster_my_epoch:7 cluster_stats_messages_ping_sent:117 cluster_stats_messages_pong_sent:91 cluster_stats_messages_meet_sent:1 cluster_stats_messages_sent:209 cluster_stats_messages_ping_received:91 cluster_stats_messages_pong_received:117 cluster_stats_messages_received:208 total_cluster_links_buffer_limit_exceeded:0 ========== 集群健康分析 ========== 使用节点 rediscl-huzdsq-shard-bfc-0 作为参考基准 检测到以下分片标识符: - bfc - fwk - tt9 参考节点观察到的拓扑结构: ID IP地址 状态 主节点ID 槽位 ---------------------------------------- ------------- ---------------- ---------------------------------------- -------------- f1e5ba6810221fd9b7af42fc1ff2907eaed2b142 172.31.9.102:31209 从节点 6805dfae60f82469d32f167a0762f10b9fe532dc 566610eaebef8ad78e4fa9a8957436093634de2c 172.31.5.137:31054 从节点 9a47e108282ae378589e88936924a2f36a944e1a a5d4fc43276d727e0f162488944b68ba7c1e439d 172.31.6.202:32496 主节点 - 0-1364 5461-8192 10923-12287 (共 0 个槽位) 6805dfae60f82469d32f167a0762f10b9fe532dc 172.31.10.241:30964 主节点 - 1365-5460 8193-9557 (共 0 个槽位) 9a47e108282ae378589e88936924a2f36a944e1a 172.31.15.205:30626 主节点 - 9558-10922 12288-16383 (共 0 个槽位) f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 172.31.12.213:32508 从节点 a5d4fc43276d727e0f162488944b68ba7c1e439d 正在分析节点 rediscl-huzdsq-shard-bfc-1 的拓扑视图... 正在分析节点 rediscl-huzdsq-shard-fwk-0 的拓扑视图... 正在分析节点 rediscl-huzdsq-shard-fwk-1 的拓扑视图... 正在分析节点 rediscl-huzdsq-shard-tt9-0 的拓扑视图... 正在分析节点 rediscl-huzdsq-shard-tt9-1 的拓扑视图... 槽位分配统计: - 总槽位数: 16384 - 未覆盖槽位数: 0 - 重复覆盖槽位数: 0 - 正确覆盖槽位数: 16384 主节点槽位分配明细: 节点 a5d4fc43276d727e0f162488944b68ba7c1e439d (172.31.6.202:32496) 负责 0 个槽位: 0-1364 5461-8192 10923-12287 节点 6805dfae60f82469d32f167a0762f10b9fe532dc (172.31.10.241:30964) 负责 0 个槽位: 1365-5460 8193-9557 节点 9a47e108282ae378589e88936924a2f36a944e1a (172.31.15.205:30626) 负责 0 个槽位: 9558-10922 12288-16383 总计分配槽位: 0 / 16384 警告: 分配的总槽位数 (0) 不等于 16384 缺少 16384 个槽位分配 分片分析: 分片 bfc: 1 个主节点, 1 个从节点 ✅ 分片 fwk: 1 个主节点, 1 个从节点 ✅ 分片 tt9: 1 个主节点, 1 个从节点 ✅ 集群分析总结: - 检测到 3 个主节点和 3 个从节点 - 检测到 0 个故障或疑似故障节点 - 集群状态统一显示为OK: 是 - 所有槽位正确分配: 是 - 所有节点看到一致的集群大小: 是 - 所有节点看到一致的拓扑结构: 是 - 所有槽位被正确覆盖: 是 - 集群中无故障或疑似故障节点: 是 集群健康状态: 健康 ✅ 所有检查均通过，Redis集群运行正常。 analyze cluster health success test delete pod all times: 2 Warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely. pod "rediscl-huzdsq-shard-bfc-0" force deleted pod "rediscl-huzdsq-shard-bfc-1" force deleted pod "rediscl-huzdsq-shard-fwk-0" force deleted pod "rediscl-huzdsq-shard-fwk-1" force deleted pod "rediscl-huzdsq-shard-tt9-0" force deleted pod "rediscl-huzdsq-shard-tt9-1" force deleted check cluster status `kbcli cluster list rediscl-huzdsq --show-labels --namespace ns-xqred ` NAME NAMESPACE CLUSTER-DEFINITION VERSION TERMINATION-POLICY STATUS CREATED-TIME LABELS rediscl-huzdsq ns-xqred Halt Updating Jun 19,2025 18:15 UTC+0800 app.kubernetes.io/instance=rediscl-huzdsq cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances rediscl-huzdsq --namespace ns-xqred ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME rediscl-huzdsq-shard-bfc-0 ns-xqred rediscl-huzdsq shard-bfc Running primary us-west-2a 100m / 100m 512Mi / 512Mi ip-172-31-15-205.us-west-2.compute.internal/172.31.15.205 Jun 19,2025 18:52 UTC+0800 rediscl-huzdsq-shard-bfc-1 ns-xqred rediscl-huzdsq shard-bfc Running secondary us-west-2a 100m / 100m 512Mi / 512Mi ip-172-31-10-241.us-west-2.compute.internal/172.31.10.241 Jun 19,2025 18:52 UTC+0800 rediscl-huzdsq-shard-fwk-0 ns-xqred rediscl-huzdsq shard-fwk Running primary us-west-2a 100m / 100m 512Mi / 512Mi ip-172-31-9-102.us-west-2.compute.internal/172.31.9.102 Jun 19,2025 18:52 UTC+0800 rediscl-huzdsq-shard-fwk-1 ns-xqred rediscl-huzdsq shard-fwk Running secondary us-west-2a 100m / 100m 512Mi / 512Mi ip-172-31-6-202.us-west-2.compute.internal/172.31.6.202 Jun 19,2025 18:52 UTC+0800 rediscl-huzdsq-shard-tt9-0 ns-xqred rediscl-huzdsq shard-tt9 Running primary us-west-2a 100m / 100m 512Mi / 512Mi ip-172-31-15-205.us-west-2.compute.internal/172.31.15.205 Jun 19,2025 18:52 UTC+0800 rediscl-huzdsq-shard-tt9-1 ns-xqred rediscl-huzdsq shard-tt9 Running secondary us-west-2a 100m / 100m 512Mi / 512Mi ip-172-31-9-102.us-west-2.compute.internal/172.31.9.102 Jun 19,2025 18:52 UTC+0800 check pod status done check cluster role check cluster role done primary: rediscl-huzdsq-shard-bfc-0 rediscl-huzdsq-shard-fwk-0 rediscl-huzdsq-shard-tt9-0;secondary: rediscl-huzdsq-shard-bfc-1 rediscl-huzdsq-shard-fwk-1 rediscl-huzdsq-shard-tt9-1 analyze cluster health check cluster connect `` ========== 节点: rediscl-huzdsq-shard-bfc-0 ========== 检测到基础名称: rediscl-huzdsq-shard-bfc, 分片编号: 0 使用 Secret: rediscl-huzdsq-shard-bfc-account-default 密码获取成功，前缀: Xm... 使用Pod环境变量中的Redis端口: 6379 --- 集群节点信息 --- 566610eaebef8ad78e4fa9a8957436093634de2c 172.31.9.102:31054@30545,rediscl-huzdsq-shard-tt9-1.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local slave 9a47e108282ae378589e88936924a2f36a944e1a 0 1750330403000 7 connected a5d4fc43276d727e0f162488944b68ba7c1e439d 172.31.15.205:32496@30676,rediscl-huzdsq-shard-bfc-0.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local myself,master - 0 1750330403000 9 connected 0-1364 5461-8192 10923-12287 6805dfae60f82469d32f167a0762f10b9fe532dc 172.31.9.102:30964@30479,rediscl-huzdsq-shard-fwk-0.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local master - 0 1750330404514 6 connected 1365-5460 8193-9557 f1e5ba6810221fd9b7af42fc1ff2907eaed2b142 172.31.6.202:31209@30928,rediscl-huzdsq-shard-fwk-1.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local slave 6805dfae60f82469d32f167a0762f10b9fe532dc 0 1750330404011 6 connected 9a47e108282ae378589e88936924a2f36a944e1a 172.31.15.205:30626@31966,rediscl-huzdsq-shard-tt9-0.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local master - 0 1750330404112 7 connected 9558-10922 12288-16383 f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 172.31.10.241:32508@31084,rediscl-huzdsq-shard-bfc-1.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local slave a5d4fc43276d727e0f162488944b68ba7c1e439d 0 1750330405017 9 connected --- 集群状态信息 --- cluster_state:ok cluster_slots_assigned:16384 cluster_slots_ok:16384 cluster_slots_pfail:0 cluster_slots_fail:0 cluster_known_nodes:6 cluster_size:3 cluster_current_epoch:9 cluster_my_epoch:9 cluster_stats_messages_ping_sent:89 cluster_stats_messages_pong_sent:98 cluster_stats_messages_meet_sent:2 cluster_stats_messages_fail_sent:20 cluster_stats_messages_sent:209 cluster_stats_messages_ping_received:95 cluster_stats_messages_pong_received:87 cluster_stats_messages_meet_received:3 cluster_stats_messages_fail_received:5 cluster_stats_messages_received:190 total_cluster_links_buffer_limit_exceeded:0 ========== 节点: rediscl-huzdsq-shard-bfc-1 ========== 检测到基础名称: rediscl-huzdsq-shard-bfc, 分片编号: 1 使用 Secret: rediscl-huzdsq-shard-bfc-account-default 密码获取成功，前缀: Xm... 使用Pod环境变量中的Redis端口: 6379 --- 集群节点信息 --- 6805dfae60f82469d32f167a0762f10b9fe532dc 172.31.9.102:30964@30479,rediscl-huzdsq-shard-fwk-0.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local master - 0 1750330411507 6 connected 1365-5460 8193-9557 9a47e108282ae378589e88936924a2f36a944e1a 172.31.15.205:30626@31966,rediscl-huzdsq-shard-tt9-0.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local master - 0 1750330411507 7 connected 9558-10922 12288-16383 f1e5ba6810221fd9b7af42fc1ff2907eaed2b142 172.31.6.202:31209@30928,rediscl-huzdsq-shard-fwk-1.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local slave 6805dfae60f82469d32f167a0762f10b9fe532dc 0 1750330410503 6 connected 566610eaebef8ad78e4fa9a8957436093634de2c 172.31.9.102:31054@30545,rediscl-huzdsq-shard-tt9-1.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local slave 9a47e108282ae378589e88936924a2f36a944e1a 0 1750330411708 7 connected f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 172.31.10.241:32508@31084,rediscl-huzdsq-shard-bfc-1.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local myself,slave a5d4fc43276d727e0f162488944b68ba7c1e439d 0 1750330410000 9 connected a5d4fc43276d727e0f162488944b68ba7c1e439d 172.31.15.205:32496@30676,rediscl-huzdsq-shard-bfc-0.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local master - 0 1750330410704 9 connected 0-1364 5461-8192 10923-12287 --- 集群状态信息 --- cluster_state:ok cluster_slots_assigned:16384 cluster_slots_ok:16384 cluster_slots_pfail:0 cluster_slots_fail:0 cluster_known_nodes:6 cluster_size:3 cluster_current_epoch:9 cluster_my_epoch:9 cluster_stats_messages_ping_sent:95 cluster_stats_messages_pong_sent:83 cluster_stats_messages_meet_sent:1 cluster_stats_messages_fail_sent:5 cluster_stats_messages_sent:184 cluster_stats_messages_ping_received:83 cluster_stats_messages_pong_received:93 cluster_stats_messages_received:176 total_cluster_links_buffer_limit_exceeded:0 ========== 节点: rediscl-huzdsq-shard-fwk-0 ========== 检测到基础名称: rediscl-huzdsq-shard-fwk, 分片编号: 0 使用 Secret: rediscl-huzdsq-shard-fwk-account-default 密码获取成功，前缀: Xm... 使用Pod环境变量中的Redis端口: 6379 --- 集群节点信息 --- f1e5ba6810221fd9b7af42fc1ff2907eaed2b142 172.31.6.202:31209@30928,rediscl-huzdsq-shard-fwk-1.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local slave 6805dfae60f82469d32f167a0762f10b9fe532dc 0 1750330417000 6 connected a5d4fc43276d727e0f162488944b68ba7c1e439d 172.31.15.205:32496@30676,rediscl-huzdsq-shard-bfc-0.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local master - 0 1750330418015 9 connected 0-1364 5461-8192 10923-12287 6805dfae60f82469d32f167a0762f10b9fe532dc 172.31.9.102:30964@30479,rediscl-huzdsq-shard-fwk-0.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local myself,master - 0 1750330417000 6 connected 1365-5460 8193-9557 566610eaebef8ad78e4fa9a8957436093634de2c 172.31.9.102:31054@30545,rediscl-huzdsq-shard-tt9-1.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local slave 9a47e108282ae378589e88936924a2f36a944e1a 0 1750330417512 7 connected 9a47e108282ae378589e88936924a2f36a944e1a 172.31.15.205:30626@31966,rediscl-huzdsq-shard-tt9-0.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local master - 0 1750330416507 7 connected 9558-10922 12288-16383 f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 172.31.10.241:32508@31084,rediscl-huzdsq-shard-bfc-1.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local slave a5d4fc43276d727e0f162488944b68ba7c1e439d 0 1750330417010 9 connected --- 集群状态信息 --- cluster_state:ok cluster_slots_assigned:16384 cluster_slots_ok:16384 cluster_slots_pfail:0 cluster_slots_fail:0 cluster_known_nodes:6 cluster_size:3 cluster_current_epoch:9 cluster_my_epoch:6 cluster_stats_messages_ping_sent:110 cluster_stats_messages_pong_sent:110 cluster_stats_messages_meet_sent:2 cluster_stats_messages_fail_sent:10 cluster_stats_messages_sent:232 cluster_stats_messages_ping_received:107 cluster_stats_messages_pong_received:109 cluster_stats_messages_meet_received:3 cluster_stats_messages_fail_received:1 cluster_stats_messages_received:220 total_cluster_links_buffer_limit_exceeded:0 ========== 节点: rediscl-huzdsq-shard-fwk-1 ========== 检测到基础名称: rediscl-huzdsq-shard-fwk, 分片编号: 1 使用 Secret: rediscl-huzdsq-shard-fwk-account-default 密码获取成功，前缀: Xm... 使用Pod环境变量中的Redis端口: 6379 --- 集群节点信息 --- a5d4fc43276d727e0f162488944b68ba7c1e439d 172.31.15.205:32496@30676,rediscl-huzdsq-shard-bfc-0.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local master - 0 1750330425117 9 connected 0-1364 5461-8192 10923-12287 f1e5ba6810221fd9b7af42fc1ff2907eaed2b142 172.31.6.202:31209@30928,rediscl-huzdsq-shard-fwk-1.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local myself,slave 6805dfae60f82469d32f167a0762f10b9fe532dc 0 1750330424000 6 connected 6805dfae60f82469d32f167a0762f10b9fe532dc 172.31.9.102:30964@30479,rediscl-huzdsq-shard-fwk-0.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local master - 0 1750330424000 6 connected 1365-5460 8193-9557 9a47e108282ae378589e88936924a2f36a944e1a 172.31.15.205:30626@31966,rediscl-huzdsq-shard-tt9-0.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local master - 0 1750330425620 7 connected 9558-10922 12288-16383 f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 172.31.10.241:32508@31084,rediscl-huzdsq-shard-bfc-1.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local slave a5d4fc43276d727e0f162488944b68ba7c1e439d 0 1750330425000 9 connected 566610eaebef8ad78e4fa9a8957436093634de2c 172.31.9.102:31054@30545,rediscl-huzdsq-shard-tt9-1.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local slave 9a47e108282ae378589e88936924a2f36a944e1a 0 1750330424615 7 connected --- 集群状态信息 --- cluster_state:ok cluster_slots_assigned:16384 cluster_slots_ok:16384 cluster_slots_pfail:0 cluster_slots_fail:0 cluster_known_nodes:6 cluster_size:3 cluster_current_epoch:9 cluster_my_epoch:6 cluster_stats_messages_ping_sent:90 cluster_stats_messages_pong_sent:68 cluster_stats_messages_meet_sent:1 cluster_stats_messages_sent:159 cluster_stats_messages_ping_received:68 cluster_stats_messages_pong_received:91 cluster_stats_messages_received:159 total_cluster_links_buffer_limit_exceeded:0 ========== 节点: rediscl-huzdsq-shard-tt9-0 ========== 检测到基础名称: rediscl-huzdsq-shard-tt9, 分片编号: 0 使用 Secret: rediscl-huzdsq-shard-tt9-account-default 密码获取成功，前缀: Xm... 使用Pod环境变量中的Redis端口: 6379 --- 集群节点信息 --- a5d4fc43276d727e0f162488944b68ba7c1e439d 172.31.15.205:32496@30676,rediscl-huzdsq-shard-bfc-0.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local master - 0 1750330430937 9 connected 0-1364 5461-8192 10923-12287 566610eaebef8ad78e4fa9a8957436093634de2c 172.31.9.102:31054@30545,rediscl-huzdsq-shard-tt9-1.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local slave 9a47e108282ae378589e88936924a2f36a944e1a 0 1750330430000 7 connected f1e5ba6810221fd9b7af42fc1ff2907eaed2b142 172.31.6.202:31209@30928,rediscl-huzdsq-shard-fwk-1.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local slave 6805dfae60f82469d32f167a0762f10b9fe532dc 0 1750330431941 6 connected 9a47e108282ae378589e88936924a2f36a944e1a 172.31.15.205:30626@31966,rediscl-huzdsq-shard-tt9-0.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local myself,master - 0 1750330430000 7 connected 9558-10922 12288-16383 f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 172.31.10.241:32508@31084,rediscl-huzdsq-shard-bfc-1.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local slave a5d4fc43276d727e0f162488944b68ba7c1e439d 0 1750330431000 9 connected 6805dfae60f82469d32f167a0762f10b9fe532dc 172.31.9.102:30964@30479,rediscl-huzdsq-shard-fwk-0.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local master - 0 1750330430535 6 connected 1365-5460 8193-9557 --- 集群状态信息 --- cluster_state:ok cluster_slots_assigned:16384 cluster_slots_ok:16384 cluster_slots_pfail:0 cluster_slots_fail:0 cluster_known_nodes:6 cluster_size:3 cluster_current_epoch:9 cluster_my_epoch:7 cluster_stats_messages_ping_sent:134 cluster_stats_messages_pong_sent:156 cluster_stats_messages_meet_sent:2 cluster_stats_messages_fail_sent:16 cluster_stats_messages_sent:308 cluster_stats_messages_ping_received:153 cluster_stats_messages_pong_received:131 cluster_stats_messages_meet_received:3 cluster_stats_messages_fail_received:10 cluster_stats_messages_received:297 total_cluster_links_buffer_limit_exceeded:0 ========== 节点: rediscl-huzdsq-shard-tt9-1 ========== 检测到基础名称: rediscl-huzdsq-shard-tt9, 分片编号: 1 使用 Secret: rediscl-huzdsq-shard-tt9-account-default 密码获取成功，前缀: Xm... 使用Pod环境变量中的Redis端口: 6379 --- 集群节点信息 --- a5d4fc43276d727e0f162488944b68ba7c1e439d 172.31.15.205:32496@30676,rediscl-huzdsq-shard-bfc-0.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local master - 0 1750330437430 9 connected 0-1364 5461-8192 10923-12287 f1e5ba6810221fd9b7af42fc1ff2907eaed2b142 172.31.6.202:31209@30928,rediscl-huzdsq-shard-fwk-1.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local slave 6805dfae60f82469d32f167a0762f10b9fe532dc 0 1750330437000 6 connected 566610eaebef8ad78e4fa9a8957436093634de2c 172.31.9.102:31054@30545,rediscl-huzdsq-shard-tt9-1.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local myself,slave 9a47e108282ae378589e88936924a2f36a944e1a 0 1750330438000 7 connected 6805dfae60f82469d32f167a0762f10b9fe532dc 172.31.9.102:30964@30479,rediscl-huzdsq-shard-fwk-0.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local master - 0 1750330438434 6 connected 1365-5460 8193-9557 9a47e108282ae378589e88936924a2f36a944e1a 172.31.15.205:30626@31966,rediscl-huzdsq-shard-tt9-0.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local master - 0 1750330438032 7 connected 9558-10922 12288-16383 f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 172.31.10.241:32508@31084,rediscl-huzdsq-shard-bfc-1.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local slave a5d4fc43276d727e0f162488944b68ba7c1e439d 0 1750330439000 9 connected --- 集群状态信息 --- cluster_state:ok cluster_slots_assigned:16384 cluster_slots_ok:16384 cluster_slots_pfail:0 cluster_slots_fail:0 cluster_known_nodes:6 cluster_size:3 cluster_current_epoch:9 cluster_my_epoch:7 cluster_stats_messages_ping_sent:152 cluster_stats_messages_pong_sent:145 cluster_stats_messages_meet_sent:1 cluster_stats_messages_fail_sent:14 cluster_stats_messages_sent:312 cluster_stats_messages_ping_received:145 cluster_stats_messages_pong_received:149 cluster_stats_messages_fail_received:3 cluster_stats_messages_received:297 total_cluster_links_buffer_limit_exceeded:0 ========== 集群健康分析 ========== 使用节点 rediscl-huzdsq-shard-bfc-0 作为参考基准 检测到以下分片标识符: - bfc - fwk - tt9 参考节点观察到的拓扑结构: ID IP地址 状态 主节点ID 槽位 ---------------------------------------- ------------- ---------------- ---------------------------------------- -------------- 566610eaebef8ad78e4fa9a8957436093634de2c 172.31.9.102:31054 从节点 9a47e108282ae378589e88936924a2f36a944e1a a5d4fc43276d727e0f162488944b68ba7c1e439d 172.31.15.205:32496 主节点 - 0-1364 5461-8192 10923-12287 (共 0 个槽位) 6805dfae60f82469d32f167a0762f10b9fe532dc 172.31.9.102:30964 主节点 - 1365-5460 8193-9557 (共 0 个槽位) f1e5ba6810221fd9b7af42fc1ff2907eaed2b142 172.31.6.202:31209 从节点 6805dfae60f82469d32f167a0762f10b9fe532dc 9a47e108282ae378589e88936924a2f36a944e1a 172.31.15.205:30626 主节点 - 9558-10922 12288-16383 (共 0 个槽位) f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 172.31.10.241:32508 从节点 a5d4fc43276d727e0f162488944b68ba7c1e439d 正在分析节点 rediscl-huzdsq-shard-bfc-1 的拓扑视图... 正在分析节点 rediscl-huzdsq-shard-fwk-0 的拓扑视图... 正在分析节点 rediscl-huzdsq-shard-fwk-1 的拓扑视图... 正在分析节点 rediscl-huzdsq-shard-tt9-0 的拓扑视图... 正在分析节点 rediscl-huzdsq-shard-tt9-1 的拓扑视图... 槽位分配统计: - 总槽位数: 16384 - 未覆盖槽位数: 0 - 重复覆盖槽位数: 0 - 正确覆盖槽位数: 16384 主节点槽位分配明细: 节点 a5d4fc43276d727e0f162488944b68ba7c1e439d (172.31.15.205:32496) 负责 0 个槽位: 0-1364 5461-8192 10923-12287 节点 6805dfae60f82469d32f167a0762f10b9fe532dc (172.31.9.102:30964) 负责 0 个槽位: 1365-5460 8193-9557 节点 9a47e108282ae378589e88936924a2f36a944e1a (172.31.15.205:30626) 负责 0 个槽位: 9558-10922 12288-16383 总计分配槽位: 0 / 16384 警告: 分配的总槽位数 (0) 不等于 16384 缺少 16384 个槽位分配 分片分析: 分片 bfc: 1 个主节点, 1 个从节点 ✅ 分片 fwk: 1 个主节点, 1 个从节点 ✅ 分片 tt9: 1 个主节点, 1 个从节点 ✅ 集群分析总结: - 检测到 3 个主节点和 3 个从节点 - 检测到 0 个故障或疑似故障节点 - 集群状态统一显示为OK: 是 - 所有槽位正确分配: 是 - 所有节点看到一致的集群大小: 是 - 所有节点看到一致的拓扑结构: 是 - 所有槽位被正确覆盖: 是 - 集群中无故障或疑似故障节点: 是 集群健康状态: 健康 ✅ 所有检查均通过，Redis集群运行正常。 analyze cluster health success test delete pod all times: 3 Warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely. pod "rediscl-huzdsq-shard-bfc-0" force deleted pod "rediscl-huzdsq-shard-bfc-1" force deleted pod "rediscl-huzdsq-shard-fwk-0" force deleted pod "rediscl-huzdsq-shard-fwk-1" force deleted pod "rediscl-huzdsq-shard-tt9-0" force deleted pod "rediscl-huzdsq-shard-tt9-1" force deleted check cluster status `kbcli cluster list rediscl-huzdsq --show-labels --namespace ns-xqred ` NAME NAMESPACE CLUSTER-DEFINITION VERSION TERMINATION-POLICY STATUS CREATED-TIME LABELS rediscl-huzdsq ns-xqred Halt Updating Jun 19,2025 18:15 UTC+0800 app.kubernetes.io/instance=rediscl-huzdsq cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances rediscl-huzdsq --namespace ns-xqred ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME rediscl-huzdsq-shard-bfc-0 ns-xqred rediscl-huzdsq shard-bfc Running primary us-west-2a 100m / 100m 512Mi / 512Mi ip-172-31-15-205.us-west-2.compute.internal/172.31.15.205 Jun 19,2025 18:55 UTC+0800 rediscl-huzdsq-shard-bfc-1 ns-xqred rediscl-huzdsq shard-bfc Running secondary us-west-2a 100m / 100m 512Mi / 512Mi ip-172-31-9-102.us-west-2.compute.internal/172.31.9.102 Jun 19,2025 18:55 UTC+0800 rediscl-huzdsq-shard-fwk-0 ns-xqred rediscl-huzdsq shard-fwk Running primary us-west-2a 100m / 100m 512Mi / 512Mi ip-172-31-9-102.us-west-2.compute.internal/172.31.9.102 Jun 19,2025 18:55 UTC+0800 rediscl-huzdsq-shard-fwk-1 ns-xqred rediscl-huzdsq shard-fwk Running secondary us-west-2a 100m / 100m 512Mi / 512Mi ip-172-31-6-202.us-west-2.compute.internal/172.31.6.202 Jun 19,2025 18:55 UTC+0800 rediscl-huzdsq-shard-tt9-0 ns-xqred rediscl-huzdsq shard-tt9 Running primary us-west-2a 100m / 100m 512Mi / 512Mi ip-172-31-15-205.us-west-2.compute.internal/172.31.15.205 Jun 19,2025 18:55 UTC+0800 rediscl-huzdsq-shard-tt9-1 ns-xqred rediscl-huzdsq shard-tt9 Running secondary us-west-2a 100m / 100m 512Mi / 512Mi ip-172-31-10-241.us-west-2.compute.internal/172.31.10.241 Jun 19,2025 18:55 UTC+0800 check pod status done check cluster role check cluster role done primary: rediscl-huzdsq-shard-bfc-0 rediscl-huzdsq-shard-fwk-0 rediscl-huzdsq-shard-tt9-0;secondary: rediscl-huzdsq-shard-bfc-1 rediscl-huzdsq-shard-fwk-1 rediscl-huzdsq-shard-tt9-1 analyze cluster health check cluster connect `` ========== 节点: rediscl-huzdsq-shard-bfc-0 ========== 检测到基础名称: rediscl-huzdsq-shard-bfc, 分片编号: 0 使用 Secret: rediscl-huzdsq-shard-bfc-account-default 密码获取成功，前缀: Xm... 使用Pod环境变量中的Redis端口: 6379 --- 集群节点信息 --- f1e5ba6810221fd9b7af42fc1ff2907eaed2b142 172.31.6.202:31209@30928,rediscl-huzdsq-shard-fwk-1.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local slave 6805dfae60f82469d32f167a0762f10b9fe532dc 0 1750330549147 6 connected 566610eaebef8ad78e4fa9a8957436093634de2c 172.31.10.241:31054@30545,rediscl-huzdsq-shard-tt9-1.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local slave 9a47e108282ae378589e88936924a2f36a944e1a 0 1750330548644 7 connected a5d4fc43276d727e0f162488944b68ba7c1e439d 172.31.15.205:32496@30676,rediscl-huzdsq-shard-bfc-0.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local myself,master - 0 1750330548000 9 connected 0-1364 5461-8192 10923-12287 9a47e108282ae378589e88936924a2f36a944e1a 172.31.15.205:30626@31966,rediscl-huzdsq-shard-tt9-0.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local master - 0 1750330549649 7 connected 9558-10922 12288-16383 f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 172.31.9.102:32508@31084,rediscl-huzdsq-shard-bfc-1.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local slave a5d4fc43276d727e0f162488944b68ba7c1e439d 0 1750330549549 9 connected 6805dfae60f82469d32f167a0762f10b9fe532dc 172.31.9.102:30964@30479,rediscl-huzdsq-shard-fwk-0.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local master - 0 1750330549000 6 connected 1365-5460 8193-9557 --- 集群状态信息 --- cluster_state:ok cluster_slots_assigned:16384 cluster_slots_ok:16384 cluster_slots_pfail:0 cluster_slots_fail:0 cluster_known_nodes:6 cluster_size:3 cluster_current_epoch:9 cluster_my_epoch:9 cluster_stats_messages_ping_sent:58 cluster_stats_messages_pong_sent:71 cluster_stats_messages_meet_sent:2 cluster_stats_messages_fail_sent:25 cluster_stats_messages_sent:156 cluster_stats_messages_ping_received:68 cluster_stats_messages_pong_received:54 cluster_stats_messages_meet_received:3 cluster_stats_messages_fail_received:11 cluster_stats_messages_received:136 total_cluster_links_buffer_limit_exceeded:0 ========== 节点: rediscl-huzdsq-shard-bfc-1 ========== 检测到基础名称: rediscl-huzdsq-shard-bfc, 分片编号: 1 使用 Secret: rediscl-huzdsq-shard-bfc-account-default 密码获取成功，前缀: Xm... 使用Pod环境变量中的Redis端口: 6379 --- 集群节点信息 --- a5d4fc43276d727e0f162488944b68ba7c1e439d 172.31.15.205:32496@30676,rediscl-huzdsq-shard-bfc-0.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local master - 0 1750330556563 9 connected 0-1364 5461-8192 10923-12287 6805dfae60f82469d32f167a0762f10b9fe532dc 172.31.9.102:30964@30479,rediscl-huzdsq-shard-fwk-0.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local master - 0 1750330556563 6 connected 1365-5460 8193-9557 9a47e108282ae378589e88936924a2f36a944e1a 172.31.15.205:30626@31966,rediscl-huzdsq-shard-tt9-0.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local master - 0 1750330555000 7 connected 9558-10922 12288-16383 f1e5ba6810221fd9b7af42fc1ff2907eaed2b142 172.31.6.202:31209@30928,rediscl-huzdsq-shard-fwk-1.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local slave 6805dfae60f82469d32f167a0762f10b9fe532dc 0 1750330556563 6 connected f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 172.31.9.102:32508@31084,rediscl-huzdsq-shard-bfc-1.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local myself,slave a5d4fc43276d727e0f162488944b68ba7c1e439d 0 1750330555000 9 connected 566610eaebef8ad78e4fa9a8957436093634de2c 172.31.10.241:31054@30545,rediscl-huzdsq-shard-tt9-1.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local slave 9a47e108282ae378589e88936924a2f36a944e1a 0 1750330555560 7 connected --- 集群状态信息 --- cluster_state:ok cluster_slots_assigned:16384 cluster_slots_ok:16384 cluster_slots_pfail:0 cluster_slots_fail:0 cluster_known_nodes:6 cluster_size:3 cluster_current_epoch:9 cluster_my_epoch:9 cluster_stats_messages_ping_sent:58 cluster_stats_messages_pong_sent:40 cluster_stats_messages_meet_sent:1 cluster_stats_messages_sent:99 cluster_stats_messages_ping_received:40 cluster_stats_messages_pong_received:57 cluster_stats_messages_received:97 total_cluster_links_buffer_limit_exceeded:0 ========== 节点: rediscl-huzdsq-shard-fwk-0 ========== 检测到基础名称: rediscl-huzdsq-shard-fwk, 分片编号: 0 使用 Secret: rediscl-huzdsq-shard-fwk-account-default 密码获取成功，前缀: Xm... 使用Pod环境变量中的Redis端口: 6379 --- 集群节点信息 --- f1e5ba6810221fd9b7af42fc1ff2907eaed2b142 172.31.6.202:31209@30928,rediscl-huzdsq-shard-fwk-1.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local slave 6805dfae60f82469d32f167a0762f10b9fe532dc 0 1750330562591 6 connected a5d4fc43276d727e0f162488944b68ba7c1e439d 172.31.15.205:32496@30676,rediscl-huzdsq-shard-bfc-0.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local master - 0 1750330562190 9 connected 0-1364 5461-8192 10923-12287 566610eaebef8ad78e4fa9a8957436093634de2c 172.31.10.241:31054@30545,rediscl-huzdsq-shard-tt9-1.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local slave 9a47e108282ae378589e88936924a2f36a944e1a 0 1750330562000 7 connected f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 172.31.9.102:32508@31084,rediscl-huzdsq-shard-bfc-1.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local slave a5d4fc43276d727e0f162488944b68ba7c1e439d 0 1750330563194 9 connected 9a47e108282ae378589e88936924a2f36a944e1a 172.31.15.205:30626@31966,rediscl-huzdsq-shard-tt9-0.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local master - 0 1750330563596 7 connected 9558-10922 12288-16383 6805dfae60f82469d32f167a0762f10b9fe532dc 172.31.9.102:30964@30479,rediscl-huzdsq-shard-fwk-0.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local myself,master - 0 1750330563000 6 connected 1365-5460 8193-9557 --- 集群状态信息 --- cluster_state:ok cluster_slots_assigned:16384 cluster_slots_ok:16384 cluster_slots_pfail:0 cluster_slots_fail:0 cluster_known_nodes:6 cluster_size:3 cluster_current_epoch:9 cluster_my_epoch:6 cluster_stats_messages_ping_sent:78 cluster_stats_messages_pong_sent:91 cluster_stats_messages_meet_sent:2 cluster_stats_messages_fail_sent:16 cluster_stats_messages_sent:187 cluster_stats_messages_ping_received:88 cluster_stats_messages_pong_received:75 cluster_stats_messages_meet_received:3 cluster_stats_messages_fail_received:4 cluster_stats_messages_received:170 total_cluster_links_buffer_limit_exceeded:0 ========== 节点: rediscl-huzdsq-shard-fwk-1 ========== 检测到基础名称: rediscl-huzdsq-shard-fwk, 分片编号: 1 使用 Secret: rediscl-huzdsq-shard-fwk-account-default 密码获取成功，前缀: Xm... 使用Pod环境变量中的Redis端口: 6379 --- 集群节点信息 --- 6805dfae60f82469d32f167a0762f10b9fe532dc 172.31.9.102:30964@30479,rediscl-huzdsq-shard-fwk-0.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local master - 0 1750330570213 6 connected 1365-5460 8193-9557 f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 172.31.9.102:32508@31084,rediscl-huzdsq-shard-bfc-1.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local slave a5d4fc43276d727e0f162488944b68ba7c1e439d 0 1750330568700 9 connected 9a47e108282ae378589e88936924a2f36a944e1a 172.31.15.205:30626@31966,rediscl-huzdsq-shard-tt9-0.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local master - 0 1750330569000 7 connected 9558-10922 12288-16383 a5d4fc43276d727e0f162488944b68ba7c1e439d 172.31.15.205:32496@30676,rediscl-huzdsq-shard-bfc-0.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local master - 0 1750330569204 9 connected 0-1364 5461-8192 10923-12287 566610eaebef8ad78e4fa9a8957436093634de2c 172.31.10.241:31054@30545,rediscl-huzdsq-shard-tt9-1.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local slave 9a47e108282ae378589e88936924a2f36a944e1a 0 1750330569103 7 connected f1e5ba6810221fd9b7af42fc1ff2907eaed2b142 172.31.6.202:31209@30928,rediscl-huzdsq-shard-fwk-1.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local myself,slave 6805dfae60f82469d32f167a0762f10b9fe532dc 0 1750330570000 6 connected --- 集群状态信息 --- cluster_state:ok cluster_slots_assigned:16384 cluster_slots_ok:16384 cluster_slots_pfail:0 cluster_slots_fail:0 cluster_known_nodes:6 cluster_size:3 cluster_current_epoch:9 cluster_my_epoch:6 cluster_stats_messages_ping_sent:91 cluster_stats_messages_pong_sent:79 cluster_stats_messages_meet_sent:1 cluster_stats_messages_fail_sent:10 cluster_stats_messages_sent:181 cluster_stats_messages_ping_received:79 cluster_stats_messages_pong_received:90 cluster_stats_messages_fail_received:1 cluster_stats_messages_received:170 total_cluster_links_buffer_limit_exceeded:0 ========== 节点: rediscl-huzdsq-shard-tt9-0 ========== 检测到基础名称: rediscl-huzdsq-shard-tt9, 分片编号: 0 使用 Secret: rediscl-huzdsq-shard-tt9-account-default 密码获取成功，前缀: Xm... 使用Pod环境变量中的Redis端口: 6379 --- 集群节点信息 --- 566610eaebef8ad78e4fa9a8957436093634de2c 172.31.10.241:31054@30545,rediscl-huzdsq-shard-tt9-1.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local slave 9a47e108282ae378589e88936924a2f36a944e1a 0 1750330576551 7 connected 9a47e108282ae378589e88936924a2f36a944e1a 172.31.15.205:30626@31966,rediscl-huzdsq-shard-tt9-0.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local myself,master - 0 1750330576000 7 connected 9558-10922 12288-16383 f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 172.31.9.102:32508@31084,rediscl-huzdsq-shard-bfc-1.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local slave a5d4fc43276d727e0f162488944b68ba7c1e439d 0 1750330575000 9 connected f1e5ba6810221fd9b7af42fc1ff2907eaed2b142 172.31.6.202:31209@30928,rediscl-huzdsq-shard-fwk-1.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local slave 6805dfae60f82469d32f167a0762f10b9fe532dc 0 1750330575547 6 connected a5d4fc43276d727e0f162488944b68ba7c1e439d 172.31.15.205:32496@30676,rediscl-huzdsq-shard-bfc-0.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local master - 0 1750330576551 9 connected 0-1364 5461-8192 10923-12287 6805dfae60f82469d32f167a0762f10b9fe532dc 172.31.9.102:30964@30479,rediscl-huzdsq-shard-fwk-0.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local master - 0 1750330575000 6 connected 1365-5460 8193-9557 --- 集群状态信息 --- cluster_state:ok cluster_slots_assigned:16384 cluster_slots_ok:16384 cluster_slots_pfail:0 cluster_slots_fail:0 cluster_known_nodes:6 cluster_size:3 cluster_current_epoch:9 cluster_my_epoch:7 cluster_stats_messages_ping_sent:106 cluster_stats_messages_pong_sent:122 cluster_stats_messages_meet_sent:2 cluster_stats_messages_fail_sent:12 cluster_stats_messages_sent:242 cluster_stats_messages_ping_received:119 cluster_stats_messages_pong_received:103 cluster_stats_messages_meet_received:3 cluster_stats_messages_fail_received:4 cluster_stats_messages_received:229 total_cluster_links_buffer_limit_exceeded:0 ========== 节点: rediscl-huzdsq-shard-tt9-1 ========== 检测到基础名称: rediscl-huzdsq-shard-tt9, 分片编号: 1 使用 Secret: rediscl-huzdsq-shard-tt9-account-default 密码获取成功，前缀: Xm... 使用Pod环境变量中的Redis端口: 6379 --- 集群节点信息 --- 9a47e108282ae378589e88936924a2f36a944e1a 172.31.15.205:30626@31966,rediscl-huzdsq-shard-tt9-0.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local master - 0 1750330583731 7 connected 9558-10922 12288-16383 f1e5ba6810221fd9b7af42fc1ff2907eaed2b142 172.31.6.202:31209@30928,rediscl-huzdsq-shard-fwk-1.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local slave 6805dfae60f82469d32f167a0762f10b9fe532dc 0 1750330582000 6 connected 6805dfae60f82469d32f167a0762f10b9fe532dc 172.31.9.102:30964@30479,rediscl-huzdsq-shard-fwk-0.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local master - 0 1750330582625 6 connected 1365-5460 8193-9557 a5d4fc43276d727e0f162488944b68ba7c1e439d 172.31.15.205:32496@30676,rediscl-huzdsq-shard-bfc-0.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local master - 0 1750330583228 9 connected 0-1364 5461-8192 10923-12287 f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 172.31.9.102:32508@31084,rediscl-huzdsq-shard-bfc-1.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local slave a5d4fc43276d727e0f162488944b68ba7c1e439d 0 1750330582223 9 connected 566610eaebef8ad78e4fa9a8957436093634de2c 172.31.10.241:31054@30545,rediscl-huzdsq-shard-tt9-1.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local myself,slave 9a47e108282ae378589e88936924a2f36a944e1a 0 1750330583000 7 connected --- 集群状态信息 --- cluster_state:ok cluster_slots_assigned:16384 cluster_slots_ok:16384 cluster_slots_pfail:0 cluster_slots_fail:0 cluster_known_nodes:6 cluster_size:3 cluster_current_epoch:9 cluster_my_epoch:7 cluster_stats_messages_ping_sent:111 cluster_stats_messages_pong_sent:93 cluster_stats_messages_meet_sent:1 cluster_stats_messages_fail_sent:5 cluster_stats_messages_sent:210 cluster_stats_messages_ping_received:93 cluster_stats_messages_pong_received:110 cluster_stats_messages_received:203 total_cluster_links_buffer_limit_exceeded:0 ========== 集群健康分析 ========== 使用节点 rediscl-huzdsq-shard-bfc-0 作为参考基准 检测到以下分片标识符: - bfc - fwk - tt9 参考节点观察到的拓扑结构: ID IP地址 状态 主节点ID 槽位 ---------------------------------------- ------------- ---------------- ---------------------------------------- -------------- f1e5ba6810221fd9b7af42fc1ff2907eaed2b142 172.31.6.202:31209 从节点 6805dfae60f82469d32f167a0762f10b9fe532dc 566610eaebef8ad78e4fa9a8957436093634de2c 172.31.10.241:31054 从节点 9a47e108282ae378589e88936924a2f36a944e1a a5d4fc43276d727e0f162488944b68ba7c1e439d 172.31.15.205:32496 主节点 - 0-1364 5461-8192 10923-12287 (共 0 个槽位) 9a47e108282ae378589e88936924a2f36a944e1a 172.31.15.205:30626 主节点 - 9558-10922 12288-16383 (共 0 个槽位) f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 172.31.9.102:32508 从节点 a5d4fc43276d727e0f162488944b68ba7c1e439d 6805dfae60f82469d32f167a0762f10b9fe532dc 172.31.9.102:30964 主节点 - 1365-5460 8193-9557 (共 0 个槽位) 正在分析节点 rediscl-huzdsq-shard-bfc-1 的拓扑视图... 正在分析节点 rediscl-huzdsq-shard-fwk-0 的拓扑视图... 正在分析节点 rediscl-huzdsq-shard-fwk-1 的拓扑视图... 正在分析节点 rediscl-huzdsq-shard-tt9-0 的拓扑视图... 正在分析节点 rediscl-huzdsq-shard-tt9-1 的拓扑视图... 槽位分配统计: - 总槽位数: 16384 - 未覆盖槽位数: 0 - 重复覆盖槽位数: 0 - 正确覆盖槽位数: 16384 主节点槽位分配明细: 节点 a5d4fc43276d727e0f162488944b68ba7c1e439d (172.31.15.205:32496) 负责 0 个槽位: 0-1364 5461-8192 10923-12287 节点 9a47e108282ae378589e88936924a2f36a944e1a (172.31.15.205:30626) 负责 0 个槽位: 9558-10922 12288-16383 节点 6805dfae60f82469d32f167a0762f10b9fe532dc (172.31.9.102:30964) 负责 0 个槽位: 1365-5460 8193-9557 总计分配槽位: 0 / 16384 警告: 分配的总槽位数 (0) 不等于 16384 缺少 16384 个槽位分配 分片分析: 分片 bfc: 1 个主节点, 1 个从节点 ✅ 分片 fwk: 1 个主节点, 1 个从节点 ✅ 分片 tt9: 1 个主节点, 1 个从节点 ✅ 集群分析总结: - 检测到 3 个主节点和 3 个从节点 - 检测到 0 个故障或疑似故障节点 - 集群状态统一显示为OK: 是 - 所有槽位正确分配: 是 - 所有节点看到一致的集群大小: 是 - 所有节点看到一致的拓扑结构: 是 - 所有槽位被正确覆盖: 是 - 集群中无故障或疑似故障节点: 是 集群健康状态: 健康 ✅ 所有检查均通过，Redis集群运行正常。 analyze cluster health success test failover networkduplicate check node drain check node drain success `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge NetworkChaos test-chaos-mesh-networkduplicate-rediscl-huzdsq --namespace ns-xqred ` Warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely. Error from server (NotFound): networkchaos.chaos-mesh.org "test-chaos-mesh-networkduplicate-rediscl-huzdsq" not found Error from server (NotFound): networkchaos.chaos-mesh.org "test-chaos-mesh-networkduplicate-rediscl-huzdsq" not found apiVersion: chaos-mesh.org/v1alpha1 kind: NetworkChaos metadata: name: test-chaos-mesh-networkduplicate-rediscl-huzdsq namespace: ns-xqred spec: selector: namespaces: - ns-xqred labelSelectors: apps.kubeblocks.io/pod-name: rediscl-huzdsq-shard-bfc-0 mode: all action: duplicate duplicate: duplicate: '100' correlation: '100' direction: to duration: 2m `kubectl apply -f test-chaos-mesh-networkduplicate-rediscl-huzdsq.yaml` networkchaos.chaos-mesh.org/test-chaos-mesh-networkduplicate-rediscl-huzdsq created apply test-chaos-mesh-networkduplicate-rediscl-huzdsq.yaml Success `rm -rf test-chaos-mesh-networkduplicate-rediscl-huzdsq.yaml` networkduplicate chaos test waiting 120 seconds check cluster status `kbcli cluster list rediscl-huzdsq --show-labels --namespace ns-xqred ` NAME NAMESPACE CLUSTER-DEFINITION VERSION TERMINATION-POLICY STATUS CREATED-TIME LABELS rediscl-huzdsq ns-xqred Halt Running Jun 19,2025 18:15 UTC+0800 app.kubernetes.io/instance=rediscl-huzdsq check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances rediscl-huzdsq --namespace ns-xqred ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME rediscl-huzdsq-shard-bfc-0 ns-xqred rediscl-huzdsq shard-bfc Running primary us-west-2a 100m / 100m 512Mi / 512Mi ip-172-31-15-205.us-west-2.compute.internal/172.31.15.205 Jun 19,2025 18:55 UTC+0800 rediscl-huzdsq-shard-bfc-1 ns-xqred rediscl-huzdsq shard-bfc Running secondary us-west-2a 100m / 100m 512Mi / 512Mi ip-172-31-9-102.us-west-2.compute.internal/172.31.9.102 Jun 19,2025 18:55 UTC+0800 rediscl-huzdsq-shard-fwk-0 ns-xqred rediscl-huzdsq shard-fwk Running primary us-west-2a 100m / 100m 512Mi / 512Mi ip-172-31-9-102.us-west-2.compute.internal/172.31.9.102 Jun 19,2025 18:55 UTC+0800 rediscl-huzdsq-shard-fwk-1 ns-xqred rediscl-huzdsq shard-fwk Running secondary us-west-2a 100m / 100m 512Mi / 512Mi ip-172-31-6-202.us-west-2.compute.internal/172.31.6.202 Jun 19,2025 18:55 UTC+0800 rediscl-huzdsq-shard-tt9-0 ns-xqred rediscl-huzdsq shard-tt9 Running primary us-west-2a 100m / 100m 512Mi / 512Mi ip-172-31-15-205.us-west-2.compute.internal/172.31.15.205 Jun 19,2025 18:55 UTC+0800 rediscl-huzdsq-shard-tt9-1 ns-xqred rediscl-huzdsq shard-tt9 Running secondary us-west-2a 100m / 100m 512Mi / 512Mi ip-172-31-10-241.us-west-2.compute.internal/172.31.10.241 Jun 19,2025 18:55 UTC+0800 check pod status done check cluster role check cluster role done primary: rediscl-huzdsq-shard-bfc-0 rediscl-huzdsq-shard-fwk-0 rediscl-huzdsq-shard-tt9-0;secondary: rediscl-huzdsq-shard-bfc-1 rediscl-huzdsq-shard-fwk-1 rediscl-huzdsq-shard-tt9-1 analyze cluster health check cluster connect `` ========== 节点: rediscl-huzdsq-shard-bfc-0 ========== 检测到基础名称: rediscl-huzdsq-shard-bfc, 分片编号: 0 使用 Secret: rediscl-huzdsq-shard-bfc-account-default 密码获取成功，前缀: Xm... 使用Pod环境变量中的Redis端口: 6379 --- 集群节点信息 --- f1e5ba6810221fd9b7af42fc1ff2907eaed2b142 172.31.6.202:31209@30928,rediscl-huzdsq-shard-fwk-1.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local slave 6805dfae60f82469d32f167a0762f10b9fe532dc 0 1750330787544 6 connected 566610eaebef8ad78e4fa9a8957436093634de2c 172.31.10.241:31054@30545,rediscl-huzdsq-shard-tt9-1.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local slave 9a47e108282ae378589e88936924a2f36a944e1a 0 1750330787000 7 connected a5d4fc43276d727e0f162488944b68ba7c1e439d 172.31.15.205:32496@30676,rediscl-huzdsq-shard-bfc-0.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local myself,master - 0 1750330786000 9 connected 0-1364 5461-8192 10923-12287 9a47e108282ae378589e88936924a2f36a944e1a 172.31.15.205:30626@31966,rediscl-huzdsq-shard-tt9-0.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local master - 0 1750330787041 7 connected 9558-10922 12288-16383 f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 172.31.9.102:32508@31084,rediscl-huzdsq-shard-bfc-1.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local slave a5d4fc43276d727e0f162488944b68ba7c1e439d 0 1750330787544 9 connected 6805dfae60f82469d32f167a0762f10b9fe532dc 172.31.9.102:30964@30479,rediscl-huzdsq-shard-fwk-0.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local master - 0 1750330786000 6 connected 1365-5460 8193-9557 --- 集群状态信息 --- cluster_state:ok cluster_slots_assigned:16384 cluster_slots_ok:16384 cluster_slots_pfail:0 cluster_slots_fail:0 cluster_known_nodes:6 cluster_size:3 cluster_current_epoch:9 cluster_my_epoch:9 cluster_stats_messages_ping_sent:484 cluster_stats_messages_pong_sent:493 cluster_stats_messages_meet_sent:2 cluster_stats_messages_fail_sent:25 cluster_stats_messages_sent:1004 cluster_stats_messages_ping_received:490 cluster_stats_messages_pong_received:480 cluster_stats_messages_meet_received:3 cluster_stats_messages_fail_received:11 cluster_stats_messages_received:984 total_cluster_links_buffer_limit_exceeded:0 ========== 节点: rediscl-huzdsq-shard-bfc-1 ========== 检测到基础名称: rediscl-huzdsq-shard-bfc, 分片编号: 1 使用 Secret: rediscl-huzdsq-shard-bfc-account-default 密码获取成功，前缀: Xm... 使用Pod环境变量中的Redis端口: 6379 --- 集群节点信息 --- a5d4fc43276d727e0f162488944b68ba7c1e439d 172.31.15.205:32496@30676,rediscl-huzdsq-shard-bfc-0.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local master - 0 1750330793000 9 connected 0-1364 5461-8192 10923-12287 6805dfae60f82469d32f167a0762f10b9fe532dc 172.31.9.102:30964@30479,rediscl-huzdsq-shard-fwk-0.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local master - 0 1750330793000 6 connected 1365-5460 8193-9557 9a47e108282ae378589e88936924a2f36a944e1a 172.31.15.205:30626@31966,rediscl-huzdsq-shard-tt9-0.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local master - 0 1750330793000 7 connected 9558-10922 12288-16383 f1e5ba6810221fd9b7af42fc1ff2907eaed2b142 172.31.6.202:31209@30928,rediscl-huzdsq-shard-fwk-1.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local slave 6805dfae60f82469d32f167a0762f10b9fe532dc 0 1750330793562 6 connected f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 172.31.9.102:32508@31084,rediscl-huzdsq-shard-bfc-1.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local myself,slave a5d4fc43276d727e0f162488944b68ba7c1e439d 0 1750330793000 9 connected 566610eaebef8ad78e4fa9a8957436093634de2c 172.31.10.241:31054@30545,rediscl-huzdsq-shard-tt9-1.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local slave 9a47e108282ae378589e88936924a2f36a944e1a 0 1750330794064 7 connected --- 集群状态信息 --- cluster_state:ok cluster_slots_assigned:16384 cluster_slots_ok:16384 cluster_slots_pfail:0 cluster_slots_fail:0 cluster_known_nodes:6 cluster_size:3 cluster_current_epoch:9 cluster_my_epoch:9 cluster_stats_messages_ping_sent:497 cluster_stats_messages_pong_sent:476 cluster_stats_messages_meet_sent:1 cluster_stats_messages_sent:974 cluster_stats_messages_ping_received:476 cluster_stats_messages_pong_received:496 cluster_stats_messages_received:972 total_cluster_links_buffer_limit_exceeded:0 ========== 节点: rediscl-huzdsq-shard-fwk-0 ========== 检测到基础名称: rediscl-huzdsq-shard-fwk, 分片编号: 0 使用 Secret: rediscl-huzdsq-shard-fwk-account-default 密码获取成功，前缀: Xm... 使用Pod环境变量中的Redis端口: 6379 --- 集群节点信息 --- f1e5ba6810221fd9b7af42fc1ff2907eaed2b142 172.31.6.202:31209@30928,rediscl-huzdsq-shard-fwk-1.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local slave 6805dfae60f82469d32f167a0762f10b9fe532dc 0 1750330800581 6 connected a5d4fc43276d727e0f162488944b68ba7c1e439d 172.31.15.205:32496@30676,rediscl-huzdsq-shard-bfc-0.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local master - 0 1750330798575 9 connected 0-1364 5461-8192 10923-12287 566610eaebef8ad78e4fa9a8957436093634de2c 172.31.10.241:31054@30545,rediscl-huzdsq-shard-tt9-1.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local slave 9a47e108282ae378589e88936924a2f36a944e1a 0 1750330799076 7 connected f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 172.31.9.102:32508@31084,rediscl-huzdsq-shard-bfc-1.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local slave a5d4fc43276d727e0f162488944b68ba7c1e439d 0 1750330799578 9 connected 9a47e108282ae378589e88936924a2f36a944e1a 172.31.15.205:30626@31966,rediscl-huzdsq-shard-tt9-0.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local master - 0 1750330800000 7 connected 9558-10922 12288-16383 6805dfae60f82469d32f167a0762f10b9fe532dc 172.31.9.102:30964@30479,rediscl-huzdsq-shard-fwk-0.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local myself,master - 0 1750330798000 6 connected 1365-5460 8193-9557 --- 集群状态信息 --- cluster_state:ok cluster_slots_assigned:16384 cluster_slots_ok:16384 cluster_slots_pfail:0 cluster_slots_fail:0 cluster_known_nodes:6 cluster_size:3 cluster_current_epoch:9 cluster_my_epoch:6 cluster_stats_messages_ping_sent:513 cluster_stats_messages_pong_sent:527 cluster_stats_messages_meet_sent:2 cluster_stats_messages_fail_sent:16 cluster_stats_messages_sent:1058 cluster_stats_messages_ping_received:524 cluster_stats_messages_pong_received:510 cluster_stats_messages_meet_received:3 cluster_stats_messages_fail_received:4 cluster_stats_messages_received:1041 total_cluster_links_buffer_limit_exceeded:0 ========== 节点: rediscl-huzdsq-shard-fwk-1 ========== 检测到基础名称: rediscl-huzdsq-shard-fwk, 分片编号: 1 使用 Secret: rediscl-huzdsq-shard-fwk-account-default 密码获取成功，前缀: Xm... 使用Pod环境变量中的Redis端口: 6379 --- 集群节点信息 --- 6805dfae60f82469d32f167a0762f10b9fe532dc 172.31.9.102:30964@30479,rediscl-huzdsq-shard-fwk-0.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local master - 0 1750330807097 6 connected 1365-5460 8193-9557 f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 172.31.9.102:32508@31084,rediscl-huzdsq-shard-bfc-1.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local slave a5d4fc43276d727e0f162488944b68ba7c1e439d 0 1750330806091 9 connected 9a47e108282ae378589e88936924a2f36a944e1a 172.31.15.205:30626@31966,rediscl-huzdsq-shard-tt9-0.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local master - 0 1750330807097 7 connected 9558-10922 12288-16383 a5d4fc43276d727e0f162488944b68ba7c1e439d 172.31.15.205:32496@30676,rediscl-huzdsq-shard-bfc-0.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local master - 0 1750330805088 9 connected 0-1364 5461-8192 10923-12287 566610eaebef8ad78e4fa9a8957436093634de2c 172.31.10.241:31054@30545,rediscl-huzdsq-shard-tt9-1.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local slave 9a47e108282ae378589e88936924a2f36a944e1a 0 1750330806000 7 connected f1e5ba6810221fd9b7af42fc1ff2907eaed2b142 172.31.6.202:31209@30928,rediscl-huzdsq-shard-fwk-1.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local myself,slave 6805dfae60f82469d32f167a0762f10b9fe532dc 0 1750330805000 6 connected --- 集群状态信息 --- cluster_state:ok cluster_slots_assigned:16384 cluster_slots_ok:16384 cluster_slots_pfail:0 cluster_slots_fail:0 cluster_known_nodes:6 cluster_size:3 cluster_current_epoch:9 cluster_my_epoch:6 cluster_stats_messages_ping_sent:514 cluster_stats_messages_pong_sent:503 cluster_stats_messages_meet_sent:1 cluster_stats_messages_fail_sent:10 cluster_stats_messages_sent:1028 cluster_stats_messages_ping_received:503 cluster_stats_messages_pong_received:513 cluster_stats_messages_fail_received:1 cluster_stats_messages_received:1017 total_cluster_links_buffer_limit_exceeded:0 ========== 节点: rediscl-huzdsq-shard-tt9-0 ========== 检测到基础名称: rediscl-huzdsq-shard-tt9, 分片编号: 0 使用 Secret: rediscl-huzdsq-shard-tt9-account-default 密码获取成功，前缀: Xm... 使用Pod环境变量中的Redis端口: 6379 --- 集群节点信息 --- 566610eaebef8ad78e4fa9a8957436093634de2c 172.31.10.241:31054@30545,rediscl-huzdsq-shard-tt9-1.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local slave 9a47e108282ae378589e88936924a2f36a944e1a 0 1750330812235 7 connected 9a47e108282ae378589e88936924a2f36a944e1a 172.31.15.205:30626@31966,rediscl-huzdsq-shard-tt9-0.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local myself,master - 0 1750330812000 7 connected 9558-10922 12288-16383 f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 172.31.9.102:32508@31084,rediscl-huzdsq-shard-bfc-1.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local slave a5d4fc43276d727e0f162488944b68ba7c1e439d 0 1750330812000 9 connected f1e5ba6810221fd9b7af42fc1ff2907eaed2b142 172.31.6.202:31209@30928,rediscl-huzdsq-shard-fwk-1.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local slave 6805dfae60f82469d32f167a0762f10b9fe532dc 0 1750330812235 6 connected a5d4fc43276d727e0f162488944b68ba7c1e439d 172.31.15.205:32496@30676,rediscl-huzdsq-shard-bfc-0.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local master - 0 1750330812537 9 connected 0-1364 5461-8192 10923-12287 6805dfae60f82469d32f167a0762f10b9fe532dc 172.31.9.102:30964@30479,rediscl-huzdsq-shard-fwk-0.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local master - 0 1750330813242 6 connected 1365-5460 8193-9557 --- 集群状态信息 --- cluster_state:ok cluster_slots_assigned:16384 cluster_slots_ok:16384 cluster_slots_pfail:0 cluster_slots_fail:0 cluster_known_nodes:6 cluster_size:3 cluster_current_epoch:9 cluster_my_epoch:7 cluster_stats_messages_ping_sent:541 cluster_stats_messages_pong_sent:553 cluster_stats_messages_meet_sent:2 cluster_stats_messages_fail_sent:12 cluster_stats_messages_sent:1108 cluster_stats_messages_ping_received:550 cluster_stats_messages_pong_received:538 cluster_stats_messages_meet_received:3 cluster_stats_messages_fail_received:4 cluster_stats_messages_received:1095 total_cluster_links_buffer_limit_exceeded:0 ========== 节点: rediscl-huzdsq-shard-tt9-1 ========== 检测到基础名称: rediscl-huzdsq-shard-tt9, 分片编号: 1 使用 Secret: rediscl-huzdsq-shard-tt9-account-default 密码获取成功，前缀: Xm... 使用Pod环境变量中的Redis端口: 6379 --- 集群节点信息 --- 9a47e108282ae378589e88936924a2f36a944e1a 172.31.15.205:30626@31966,rediscl-huzdsq-shard-tt9-0.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local master - 0 1750330819000 7 connected 9558-10922 12288-16383 f1e5ba6810221fd9b7af42fc1ff2907eaed2b142 172.31.6.202:31209@30928,rediscl-huzdsq-shard-fwk-1.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local slave 6805dfae60f82469d32f167a0762f10b9fe532dc 0 1750330819522 6 connected 6805dfae60f82469d32f167a0762f10b9fe532dc 172.31.9.102:30964@30479,rediscl-huzdsq-shard-fwk-0.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local master - 0 1750330818015 6 connected 1365-5460 8193-9557 a5d4fc43276d727e0f162488944b68ba7c1e439d 172.31.15.205:32496@30676,rediscl-huzdsq-shard-bfc-0.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local master - 0 1750330820026 9 connected 0-1364 5461-8192 10923-12287 f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 172.31.9.102:32508@31084,rediscl-huzdsq-shard-bfc-1.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local slave a5d4fc43276d727e0f162488944b68ba7c1e439d 0 1750330819000 9 connected 566610eaebef8ad78e4fa9a8957436093634de2c 172.31.10.241:31054@30545,rediscl-huzdsq-shard-tt9-1.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local myself,slave 9a47e108282ae378589e88936924a2f36a944e1a 0 1750330819000 7 connected --- 集群状态信息 --- cluster_state:ok cluster_slots_assigned:16384 cluster_slots_ok:16384 cluster_slots_pfail:0 cluster_slots_fail:0 cluster_known_nodes:6 cluster_size:3 cluster_current_epoch:9 cluster_my_epoch:7 cluster_stats_messages_ping_sent:540 cluster_stats_messages_pong_sent:525 cluster_stats_messages_meet_sent:1 cluster_stats_messages_fail_sent:5 cluster_stats_messages_sent:1071 cluster_stats_messages_ping_received:525 cluster_stats_messages_pong_received:539 cluster_stats_messages_received:1064 total_cluster_links_buffer_limit_exceeded:0 ========== 集群健康分析 ========== 使用节点 rediscl-huzdsq-shard-bfc-0 作为参考基准 检测到以下分片标识符: - bfc - fwk - tt9 参考节点观察到的拓扑结构: ID IP地址 状态 主节点ID 槽位 ---------------------------------------- ------------- ---------------- ---------------------------------------- -------------- f1e5ba6810221fd9b7af42fc1ff2907eaed2b142 172.31.6.202:31209 从节点 6805dfae60f82469d32f167a0762f10b9fe532dc 566610eaebef8ad78e4fa9a8957436093634de2c 172.31.10.241:31054 从节点 9a47e108282ae378589e88936924a2f36a944e1a a5d4fc43276d727e0f162488944b68ba7c1e439d 172.31.15.205:32496 主节点 - 0-1364 5461-8192 10923-12287 (共 0 个槽位) 9a47e108282ae378589e88936924a2f36a944e1a 172.31.15.205:30626 主节点 - 9558-10922 12288-16383 (共 0 个槽位) f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 172.31.9.102:32508 从节点 a5d4fc43276d727e0f162488944b68ba7c1e439d 6805dfae60f82469d32f167a0762f10b9fe532dc 172.31.9.102:30964 主节点 - 1365-5460 8193-9557 (共 0 个槽位) 正在分析节点 rediscl-huzdsq-shard-bfc-1 的拓扑视图... 正在分析节点 rediscl-huzdsq-shard-fwk-0 的拓扑视图... 正在分析节点 rediscl-huzdsq-shard-fwk-1 的拓扑视图... 正在分析节点 rediscl-huzdsq-shard-tt9-0 的拓扑视图... 正在分析节点 rediscl-huzdsq-shard-tt9-1 的拓扑视图... 槽位分配统计: - 总槽位数: 16384 - 未覆盖槽位数: 0 - 重复覆盖槽位数: 0 - 正确覆盖槽位数: 16384 主节点槽位分配明细: 节点 a5d4fc43276d727e0f162488944b68ba7c1e439d (172.31.15.205:32496) 负责 0 个槽位: 0-1364 5461-8192 10923-12287 节点 9a47e108282ae378589e88936924a2f36a944e1a (172.31.15.205:30626) 负责 0 个槽位: 9558-10922 12288-16383 节点 6805dfae60f82469d32f167a0762f10b9fe532dc (172.31.9.102:30964) 负责 0 个槽位: 1365-5460 8193-9557 总计分配槽位: 0 / 16384 警告: 分配的总槽位数 (0) 不等于 16384 缺少 16384 个槽位分配 分片分析: 分片 bfc: 1 个主节点, 1 个从节点 ✅ 分片 fwk: 1 个主节点, 1 个从节点 ✅ 分片 tt9: 1 个主节点, 1 个从节点 ✅ 集群分析总结: - 检测到 3 个主节点和 3 个从节点 - 检测到 0 个故障或疑似故障节点 - 集群状态统一显示为OK: 是 - 所有槽位正确分配: 是 - 所有节点看到一致的集群大小: 是 - 所有节点看到一致的拓扑结构: 是 - 所有槽位被正确覆盖: 是 - 集群中无故障或疑似故障节点: 是 集群健康状态: 健康 ✅ 所有检查均通过，Redis集群运行正常。 analyze cluster health success `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge NetworkChaos test-chaos-mesh-networkduplicate-rediscl-huzdsq --namespace ns-xqred ` Warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely. networkchaos.chaos-mesh.org "test-chaos-mesh-networkduplicate-rediscl-huzdsq" force deleted Error from server (NotFound): networkchaos.chaos-mesh.org "test-chaos-mesh-networkduplicate-rediscl-huzdsq" not found check failover pod name failover pod name:rediscl-huzdsq-shard-bfc-0 failover networkduplicate Success cluster vscale check cluster status before ops check cluster status done cluster_status:Running `kbcli cluster vscale rediscl-huzdsq --auto-approve --force=true --components shard --cpu 200m --memory 0.6Gi --namespace ns-xqred ` OpsRequest rediscl-huzdsq-verticalscaling-4x6fk created successfully, you can view the progress: kbcli cluster describe-ops rediscl-huzdsq-verticalscaling-4x6fk -n ns-xqred check ops status `kbcli cluster list-ops rediscl-huzdsq --status all --namespace ns-xqred ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME rediscl-huzdsq-verticalscaling-4x6fk ns-xqred VerticalScaling rediscl-huzdsq shard Running 0/6 Jun 19,2025 19:01 UTC+0800 check cluster status `kbcli cluster list rediscl-huzdsq --show-labels --namespace ns-xqred ` NAME NAMESPACE CLUSTER-DEFINITION VERSION TERMINATION-POLICY STATUS CREATED-TIME LABELS rediscl-huzdsq ns-xqred Halt Updating Jun 19,2025 18:15 UTC+0800 app.kubernetes.io/instance=rediscl-huzdsq cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances rediscl-huzdsq --namespace ns-xqred ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME rediscl-huzdsq-shard-bfc-0 ns-xqred rediscl-huzdsq shard-bfc Running secondary us-west-2a 200m / 200m 644245094400m / 644245094400m ip-172-31-15-205.us-west-2.compute.internal/172.31.15.205 Jun 19,2025 19:02 UTC+0800 rediscl-huzdsq-shard-bfc-1 ns-xqred rediscl-huzdsq shard-bfc Running primary us-west-2a 200m / 200m 644245094400m / 644245094400m ip-172-31-10-241.us-west-2.compute.internal/172.31.10.241 Jun 19,2025 19:01 UTC+0800 rediscl-huzdsq-shard-fwk-0 ns-xqred rediscl-huzdsq shard-fwk Running primary us-west-2a 200m / 200m 644245094400m / 644245094400m ip-172-31-15-205.us-west-2.compute.internal/172.31.15.205 Jun 19,2025 19:02 UTC+0800 rediscl-huzdsq-shard-fwk-1 ns-xqred rediscl-huzdsq shard-fwk Running secondary us-west-2a 200m / 200m 644245094400m / 644245094400m ip-172-31-9-102.us-west-2.compute.internal/172.31.9.102 Jun 19,2025 19:01 UTC+0800 rediscl-huzdsq-shard-tt9-0 ns-xqred rediscl-huzdsq shard-tt9 Running primary us-west-2a 200m / 200m 644245094400m / 644245094400m ip-172-31-9-102.us-west-2.compute.internal/172.31.9.102 Jun 19,2025 19:02 UTC+0800 rediscl-huzdsq-shard-tt9-1 ns-xqred rediscl-huzdsq shard-tt9 Running secondary us-west-2a 200m / 200m 644245094400m / 644245094400m ip-172-31-6-202.us-west-2.compute.internal/172.31.6.202 Jun 19,2025 19:01 UTC+0800 check pod status done check cluster role check cluster role done primary: rediscl-huzdsq-shard-bfc-1 rediscl-huzdsq-shard-fwk-0 rediscl-huzdsq-shard-tt9-0;secondary: rediscl-huzdsq-shard-bfc-0 rediscl-huzdsq-shard-fwk-1 rediscl-huzdsq-shard-tt9-1 analyze cluster health check cluster connect `` ========== 节点: rediscl-huzdsq-shard-bfc-0 ========== 检测到基础名称: rediscl-huzdsq-shard-bfc, 分片编号: 0 使用 Secret: rediscl-huzdsq-shard-bfc-account-default 密码获取成功，前缀: Xm... 使用Pod环境变量中的Redis端口: 6379 --- 集群节点信息 --- f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 172.31.10.241:32508@31084,rediscl-huzdsq-shard-bfc-1.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local master - 0 1750330973913 10 connected 0-1364 5461-8192 10923-12287 9a47e108282ae378589e88936924a2f36a944e1a 172.31.9.102:30626@31966,rediscl-huzdsq-shard-tt9-0.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local master - 0 1750330972909 7 connected 9558-10922 12288-16383 f1e5ba6810221fd9b7af42fc1ff2907eaed2b142 172.31.9.102:31209@30928,rediscl-huzdsq-shard-fwk-1.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local slave 6805dfae60f82469d32f167a0762f10b9fe532dc 0 1750330973511 6 connected 6805dfae60f82469d32f167a0762f10b9fe532dc 172.31.15.205:30964@30479,rediscl-huzdsq-shard-fwk-0.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local master - 0 1750330973512 6 connected 1365-5460 8193-9557 a5d4fc43276d727e0f162488944b68ba7c1e439d 172.31.15.205:32496@30676,rediscl-huzdsq-shard-bfc-0.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local myself,slave f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 0 1750330972000 10 connected 566610eaebef8ad78e4fa9a8957436093634de2c 172.31.6.202:31054@30545,rediscl-huzdsq-shard-tt9-1.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local slave 9a47e108282ae378589e88936924a2f36a944e1a 0 1750330973000 7 connected --- 集群状态信息 --- cluster_state:ok cluster_slots_assigned:16384 cluster_slots_ok:16384 cluster_slots_pfail:0 cluster_slots_fail:0 cluster_known_nodes:6 cluster_size:3 cluster_current_epoch:12 cluster_my_epoch:10 cluster_stats_messages_ping_sent:81 cluster_stats_messages_pong_sent:69 cluster_stats_messages_meet_sent:1 cluster_stats_messages_sent:151 cluster_stats_messages_ping_received:69 cluster_stats_messages_pong_received:79 cluster_stats_messages_fail_received:4 cluster_stats_messages_auth-req_received:2 cluster_stats_messages_received:154 total_cluster_links_buffer_limit_exceeded:0 ========== 节点: rediscl-huzdsq-shard-bfc-1 ========== 检测到基础名称: rediscl-huzdsq-shard-bfc, 分片编号: 1 使用 Secret: rediscl-huzdsq-shard-bfc-account-default 密码获取成功，前缀: Xm... 使用Pod环境变量中的Redis端口: 6379 --- 集群节点信息 --- f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 172.31.10.241:32508@31084,rediscl-huzdsq-shard-bfc-1.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local myself,master - 0 1750330980000 10 connected 0-1364 5461-8192 10923-12287 566610eaebef8ad78e4fa9a8957436093634de2c 172.31.6.202:31054@30545,rediscl-huzdsq-shard-tt9-1.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local slave 9a47e108282ae378589e88936924a2f36a944e1a 0 1750330978561 7 connected 6805dfae60f82469d32f167a0762f10b9fe532dc 172.31.15.205:30964@30479,rediscl-huzdsq-shard-fwk-0.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local master - 0 1750330980571 6 connected 1365-5460 8193-9557 9a47e108282ae378589e88936924a2f36a944e1a 172.31.9.102:30626@31966,rediscl-huzdsq-shard-tt9-0.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local master - 0 1750330979000 7 connected 9558-10922 12288-16383 f1e5ba6810221fd9b7af42fc1ff2907eaed2b142 172.31.9.102:31209@30928,rediscl-huzdsq-shard-fwk-1.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local slave 6805dfae60f82469d32f167a0762f10b9fe532dc 0 1750330979566 6 connected a5d4fc43276d727e0f162488944b68ba7c1e439d 172.31.15.205:32496@30676,rediscl-huzdsq-shard-bfc-0.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local slave f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 0 1750330980571 10 connected --- 集群状态信息 --- cluster_state:ok cluster_slots_assigned:16384 cluster_slots_ok:16384 cluster_slots_pfail:0 cluster_slots_fail:0 cluster_known_nodes:6 cluster_size:3 cluster_current_epoch:12 cluster_my_epoch:10 cluster_stats_messages_ping_sent:112 cluster_stats_messages_pong_sent:137 cluster_stats_messages_meet_sent:1 cluster_stats_messages_fail_sent:10 cluster_stats_messages_auth-req_sent:5 cluster_stats_messages_auth-ack_sent:2 cluster_stats_messages_update_sent:1 cluster_stats_messages_sent:268 cluster_stats_messages_ping_received:129 cluster_stats_messages_pong_received:108 cluster_stats_messages_meet_received:3 cluster_stats_messages_fail_received:7 cluster_stats_messages_auth-req_received:2 cluster_stats_messages_auth-ack_received:2 cluster_stats_messages_received:251 total_cluster_links_buffer_limit_exceeded:0 ========== 节点: rediscl-huzdsq-shard-fwk-0 ========== 检测到基础名称: rediscl-huzdsq-shard-fwk, 分片编号: 0 使用 Secret: rediscl-huzdsq-shard-fwk-account-default 密码获取成功，前缀: Xm... 使用Pod环境变量中的Redis端口: 6379 --- 集群节点信息 --- 6805dfae60f82469d32f167a0762f10b9fe532dc 172.31.15.205:30964@30479,rediscl-huzdsq-shard-fwk-0.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local myself,master - 0 1750330985000 6 connected 1365-5460 8193-9557 f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 172.31.10.241:32508@31084,rediscl-huzdsq-shard-bfc-1.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local master - 0 1750330987164 10 connected 0-1364 5461-8192 10923-12287 f1e5ba6810221fd9b7af42fc1ff2907eaed2b142 172.31.9.102:31209@30928,rediscl-huzdsq-shard-fwk-1.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local slave 6805dfae60f82469d32f167a0762f10b9fe532dc 0 1750330986000 6 connected a5d4fc43276d727e0f162488944b68ba7c1e439d 172.31.15.205:32496@30676,rediscl-huzdsq-shard-bfc-0.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local slave f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 0 1750330986160 10 connected 9a47e108282ae378589e88936924a2f36a944e1a 172.31.9.102:30626@31966,rediscl-huzdsq-shard-tt9-0.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local master - 0 1750330986561 7 connected 9558-10922 12288-16383 566610eaebef8ad78e4fa9a8957436093634de2c 172.31.6.202:31054@30545,rediscl-huzdsq-shard-tt9-1.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local slave 9a47e108282ae378589e88936924a2f36a944e1a 0 1750330985155 7 connected --- 集群状态信息 --- cluster_state:ok cluster_slots_assigned:16384 cluster_slots_ok:16384 cluster_slots_pfail:0 cluster_slots_fail:0 cluster_known_nodes:6 cluster_size:3 cluster_current_epoch:12 cluster_my_epoch:6 cluster_stats_messages_ping_sent:90 cluster_stats_messages_pong_sent:70 cluster_stats_messages_meet_sent:2 cluster_stats_messages_fail_sent:5 cluster_stats_messages_sent:167 cluster_stats_messages_ping_received:69 cluster_stats_messages_pong_received:91 cluster_stats_messages_meet_received:1 cluster_stats_messages_fail_received:2 cluster_stats_messages_auth-req_received:1 cluster_stats_messages_received:164 total_cluster_links_buffer_limit_exceeded:0 ========== 节点: rediscl-huzdsq-shard-fwk-1 ========== 检测到基础名称: rediscl-huzdsq-shard-fwk, 分片编号: 1 使用 Secret: rediscl-huzdsq-shard-fwk-account-default 密码获取成功，前缀: Xm... 使用Pod环境变量中的Redis端口: 6379 --- 集群节点信息 --- f1e5ba6810221fd9b7af42fc1ff2907eaed2b142 172.31.9.102:31209@30928,rediscl-huzdsq-shard-fwk-1.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local myself,slave 6805dfae60f82469d32f167a0762f10b9fe532dc 0 1750330992000 6 connected 6805dfae60f82469d32f167a0762f10b9fe532dc 172.31.15.205:30964@30479,rediscl-huzdsq-shard-fwk-0.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local master - 0 1750330992203 6 connected 1365-5460 8193-9557 a5d4fc43276d727e0f162488944b68ba7c1e439d 172.31.15.205:32496@30676,rediscl-huzdsq-shard-bfc-0.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local slave f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 0 1750330991701 10 connected 566610eaebef8ad78e4fa9a8957436093634de2c 172.31.6.202:31054@30545,rediscl-huzdsq-shard-tt9-1.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local slave 9a47e108282ae378589e88936924a2f36a944e1a 0 1750330992000 7 connected 9a47e108282ae378589e88936924a2f36a944e1a 172.31.9.102:30626@31966,rediscl-huzdsq-shard-tt9-0.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local master - 0 1750330993710 7 connected 9558-10922 12288-16383 f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 172.31.10.241:32508@31084,rediscl-huzdsq-shard-bfc-1.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local master - 0 1750330993208 10 connected 0-1364 5461-8192 10923-12287 --- 集群状态信息 --- cluster_state:ok cluster_slots_assigned:16384 cluster_slots_ok:16384 cluster_slots_pfail:0 cluster_slots_fail:0 cluster_known_nodes:6 cluster_size:3 cluster_current_epoch:12 cluster_my_epoch:6 cluster_stats_messages_ping_sent:132 cluster_stats_messages_pong_sent:117 cluster_stats_messages_meet_sent:1 cluster_stats_messages_fail_sent:9 cluster_stats_messages_auth-req_sent:5 cluster_stats_messages_sent:264 cluster_stats_messages_ping_received:117 cluster_stats_messages_pong_received:129 cluster_stats_messages_fail_received:3 cluster_stats_messages_auth-req_received:1 cluster_stats_messages_auth-ack_received:1 cluster_stats_messages_received:251 total_cluster_links_buffer_limit_exceeded:0 ========== 节点: rediscl-huzdsq-shard-tt9-0 ========== 检测到基础名称: rediscl-huzdsq-shard-tt9, 分片编号: 0 使用 Secret: rediscl-huzdsq-shard-tt9-account-default 密码获取成功，前缀: Xm... 使用Pod环境变量中的Redis端口: 6379 --- 集群节点信息 --- f1e5ba6810221fd9b7af42fc1ff2907eaed2b142 172.31.9.102:31209@30928,rediscl-huzdsq-shard-fwk-1.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local slave 6805dfae60f82469d32f167a0762f10b9fe532dc 0 1750330999000 6 connected 9a47e108282ae378589e88936924a2f36a944e1a 172.31.9.102:30626@31966,rediscl-huzdsq-shard-tt9-0.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local myself,master - 0 1750330998000 7 connected 9558-10922 12288-16383 a5d4fc43276d727e0f162488944b68ba7c1e439d 172.31.15.205:32496@30676,rediscl-huzdsq-shard-bfc-0.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local slave f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 0 1750330999534 10 connected 6805dfae60f82469d32f167a0762f10b9fe532dc 172.31.15.205:30964@30479,rediscl-huzdsq-shard-fwk-0.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local master - 0 1750331000037 6 connected 1365-5460 8193-9557 f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 172.31.10.241:32508@31084,rediscl-huzdsq-shard-bfc-1.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local master - 0 1750331000037 10 connected 0-1364 5461-8192 10923-12287 566610eaebef8ad78e4fa9a8957436093634de2c 172.31.6.202:31054@30545,rediscl-huzdsq-shard-tt9-1.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local slave 9a47e108282ae378589e88936924a2f36a944e1a 0 1750330999000 7 connected --- 集群状态信息 --- cluster_state:ok cluster_slots_assigned:16384 cluster_slots_ok:16384 cluster_slots_pfail:0 cluster_slots_fail:0 cluster_known_nodes:6 cluster_size:3 cluster_current_epoch:12 cluster_my_epoch:7 cluster_stats_messages_ping_sent:103 cluster_stats_messages_pong_sent:93 cluster_stats_messages_meet_sent:2 cluster_stats_messages_fail_sent:5 cluster_stats_messages_sent:203 cluster_stats_messages_ping_received:92 cluster_stats_messages_pong_received:104 cluster_stats_messages_meet_received:1 cluster_stats_messages_fail_received:1 cluster_stats_messages_auth-req_received:1 cluster_stats_messages_received:199 total_cluster_links_buffer_limit_exceeded:0 ========== 节点: rediscl-huzdsq-shard-tt9-1 ========== 检测到基础名称: rediscl-huzdsq-shard-tt9, 分片编号: 1 使用 Secret: rediscl-huzdsq-shard-tt9-account-default 密码获取成功，前缀: Xm... 使用Pod环境变量中的Redis端口: 6379 --- 集群节点信息 --- 9a47e108282ae378589e88936924a2f36a944e1a 172.31.9.102:30626@31966,rediscl-huzdsq-shard-tt9-0.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local master - 0 1750331006581 7 connected 9558-10922 12288-16383 a5d4fc43276d727e0f162488944b68ba7c1e439d 172.31.15.205:32496@30676,rediscl-huzdsq-shard-bfc-0.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local slave f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 0 1750331006784 10 connected f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 172.31.10.241:32508@31084,rediscl-huzdsq-shard-bfc-1.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local master - 0 1750331006000 10 connected 0-1364 5461-8192 10923-12287 6805dfae60f82469d32f167a0762f10b9fe532dc 172.31.15.205:30964@30479,rediscl-huzdsq-shard-fwk-0.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local master - 0 1750331005000 6 connected 1365-5460 8193-9557 566610eaebef8ad78e4fa9a8957436093634de2c 172.31.6.202:31054@30545,rediscl-huzdsq-shard-tt9-1.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local myself,slave 9a47e108282ae378589e88936924a2f36a944e1a 0 1750331005000 7 connected f1e5ba6810221fd9b7af42fc1ff2907eaed2b142 172.31.9.102:31209@30928,rediscl-huzdsq-shard-fwk-1.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local slave 6805dfae60f82469d32f167a0762f10b9fe532dc 0 1750331005778 6 connected --- 集群状态信息 --- cluster_state:ok cluster_slots_assigned:16384 cluster_slots_ok:16384 cluster_slots_pfail:0 cluster_slots_fail:0 cluster_known_nodes:6 cluster_size:3 cluster_current_epoch:12 cluster_my_epoch:7 cluster_stats_messages_ping_sent:151 cluster_stats_messages_pong_sent:149 cluster_stats_messages_meet_sent:1 cluster_stats_messages_fail_sent:9 cluster_stats_messages_auth-req_sent:5 cluster_stats_messages_sent:315 cluster_stats_messages_ping_received:149 cluster_stats_messages_pong_received:149 cluster_stats_messages_fail_received:4 cluster_stats_messages_auth-req_received:2 cluster_stats_messages_auth-ack_received:1 cluster_stats_messages_received:305 total_cluster_links_buffer_limit_exceeded:0 ========== 集群健康分析 ========== 使用节点 rediscl-huzdsq-shard-bfc-0 作为参考基准 检测到以下分片标识符: - bfc - fwk - tt9 参考节点观察到的拓扑结构: ID IP地址 状态 主节点ID 槽位 ---------------------------------------- ------------- ---------------- ---------------------------------------- -------------- f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 172.31.10.241:32508 主节点 - 0-1364 5461-8192 10923-12287 (共 0 个槽位) 9a47e108282ae378589e88936924a2f36a944e1a 172.31.9.102:30626 主节点 - 9558-10922 12288-16383 (共 0 个槽位) f1e5ba6810221fd9b7af42fc1ff2907eaed2b142 172.31.9.102:31209 从节点 6805dfae60f82469d32f167a0762f10b9fe532dc 6805dfae60f82469d32f167a0762f10b9fe532dc 172.31.15.205:30964 主节点 - 1365-5460 8193-9557 (共 0 个槽位) a5d4fc43276d727e0f162488944b68ba7c1e439d 172.31.15.205:32496 从节点 f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 566610eaebef8ad78e4fa9a8957436093634de2c 172.31.6.202:31054 从节点 9a47e108282ae378589e88936924a2f36a944e1a 正在分析节点 rediscl-huzdsq-shard-bfc-1 的拓扑视图... 正在分析节点 rediscl-huzdsq-shard-fwk-0 的拓扑视图... 正在分析节点 rediscl-huzdsq-shard-fwk-1 的拓扑视图... 正在分析节点 rediscl-huzdsq-shard-tt9-0 的拓扑视图... 正在分析节点 rediscl-huzdsq-shard-tt9-1 的拓扑视图... 槽位分配统计: - 总槽位数: 16384 - 未覆盖槽位数: 0 - 重复覆盖槽位数: 0 - 正确覆盖槽位数: 16384 主节点槽位分配明细: 节点 f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 (172.31.10.241:32508) 负责 0 个槽位: 0-1364 5461-8192 10923-12287 节点 9a47e108282ae378589e88936924a2f36a944e1a (172.31.9.102:30626) 负责 0 个槽位: 9558-10922 12288-16383 节点 6805dfae60f82469d32f167a0762f10b9fe532dc (172.31.15.205:30964) 负责 0 个槽位: 1365-5460 8193-9557 总计分配槽位: 0 / 16384 警告: 分配的总槽位数 (0) 不等于 16384 缺少 16384 个槽位分配 分片分析: 分片 bfc: 1 个主节点, 1 个从节点 ✅ 分片 fwk: 1 个主节点, 1 个从节点 ✅ 分片 tt9: 1 个主节点, 1 个从节点 ✅ 集群分析总结: - 检测到 3 个主节点和 3 个从节点 - 检测到 0 个故障或疑似故障节点 - 集群状态统一显示为OK: 是 - 所有槽位正确分配: 是 - 所有节点看到一致的集群大小: 是 - 所有节点看到一致的拓扑结构: 是 - 所有槽位被正确覆盖: 是 - 集群中无故障或疑似故障节点: 是 集群健康状态: 健康 ✅ 所有检查均通过，Redis集群运行正常。 analyze cluster health success check ops status `kbcli cluster list-ops rediscl-huzdsq --status all --namespace ns-xqred ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME rediscl-huzdsq-verticalscaling-4x6fk ns-xqred VerticalScaling rediscl-huzdsq shard Succeed 6/6 Jun 19,2025 19:01 UTC+0800 check ops status done ops_status:rediscl-huzdsq-verticalscaling-4x6fk ns-xqred VerticalScaling rediscl-huzdsq shard Succeed 6/6 Jun 19,2025 19:01 UTC+0800 `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge opsrequests rediscl-huzdsq-verticalscaling-4x6fk --namespace ns-xqred ` opsrequest.apps.kubeblocks.io/rediscl-huzdsq-verticalscaling-4x6fk patched `kbcli cluster delete-ops --name rediscl-huzdsq-verticalscaling-4x6fk --force --auto-approve --namespace ns-xqred ` OpsRequest rediscl-huzdsq-verticalscaling-4x6fk deleted test failover networklossover check node drain check node drain success `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge NetworkChaos test-chaos-mesh-networklossover-rediscl-huzdsq --namespace ns-xqred ` Warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely. Error from server (NotFound): networkchaos.chaos-mesh.org "test-chaos-mesh-networklossover-rediscl-huzdsq" not found Error from server (NotFound): networkchaos.chaos-mesh.org "test-chaos-mesh-networklossover-rediscl-huzdsq" not found apiVersion: chaos-mesh.org/v1alpha1 kind: NetworkChaos metadata: name: test-chaos-mesh-networklossover-rediscl-huzdsq namespace: ns-xqred spec: selector: namespaces: - ns-xqred labelSelectors: apps.kubeblocks.io/pod-name: rediscl-huzdsq-shard-bfc-1 mode: all action: loss loss: loss: '100' correlation: '100' direction: to duration: 2m `kubectl apply -f test-chaos-mesh-networklossover-rediscl-huzdsq.yaml` networkchaos.chaos-mesh.org/test-chaos-mesh-networklossover-rediscl-huzdsq created apply test-chaos-mesh-networklossover-rediscl-huzdsq.yaml Success `rm -rf test-chaos-mesh-networklossover-rediscl-huzdsq.yaml` networklossover chaos test waiting 120 seconds check cluster status `kbcli cluster list rediscl-huzdsq --show-labels --namespace ns-xqred ` NAME NAMESPACE CLUSTER-DEFINITION VERSION TERMINATION-POLICY STATUS CREATED-TIME LABELS rediscl-huzdsq ns-xqred Halt Updating Jun 19,2025 18:15 UTC+0800 app.kubernetes.io/instance=rediscl-huzdsq check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances rediscl-huzdsq --namespace ns-xqred ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME rediscl-huzdsq-shard-bfc-0 ns-xqred rediscl-huzdsq shard-bfc Running primary us-west-2a 200m / 200m 644245094400m / 644245094400m ip-172-31-15-205.us-west-2.compute.internal/172.31.15.205 Jun 19,2025 19:02 UTC+0800 rediscl-huzdsq-shard-bfc-1 ns-xqred rediscl-huzdsq shard-bfc Running secondary us-west-2a 200m / 200m 644245094400m / 644245094400m ip-172-31-10-241.us-west-2.compute.internal/172.31.10.241 Jun 19,2025 19:01 UTC+0800 rediscl-huzdsq-shard-fwk-0 ns-xqred rediscl-huzdsq shard-fwk Running primary us-west-2a 200m / 200m 644245094400m / 644245094400m ip-172-31-15-205.us-west-2.compute.internal/172.31.15.205 Jun 19,2025 19:02 UTC+0800 rediscl-huzdsq-shard-fwk-1 ns-xqred rediscl-huzdsq shard-fwk Running secondary us-west-2a 200m / 200m 644245094400m / 644245094400m ip-172-31-9-102.us-west-2.compute.internal/172.31.9.102 Jun 19,2025 19:01 UTC+0800 rediscl-huzdsq-shard-tt9-0 ns-xqred rediscl-huzdsq shard-tt9 Running primary us-west-2a 200m / 200m 644245094400m / 644245094400m ip-172-31-9-102.us-west-2.compute.internal/172.31.9.102 Jun 19,2025 19:02 UTC+0800 rediscl-huzdsq-shard-tt9-1 ns-xqred rediscl-huzdsq shard-tt9 Running secondary us-west-2a 200m / 200m 644245094400m / 644245094400m ip-172-31-6-202.us-west-2.compute.internal/172.31.6.202 Jun 19,2025 19:01 UTC+0800 check pod status done check cluster role check cluster role done primary: rediscl-huzdsq-shard-bfc-0 rediscl-huzdsq-shard-fwk-0 rediscl-huzdsq-shard-tt9-0;secondary: rediscl-huzdsq-shard-bfc-1 rediscl-huzdsq-shard-fwk-1 rediscl-huzdsq-shard-tt9-1 analyze cluster health check cluster connect `` ========== 节点: rediscl-huzdsq-shard-bfc-0 ========== 检测到基础名称: rediscl-huzdsq-shard-bfc, 分片编号: 0 使用 Secret: rediscl-huzdsq-shard-bfc-account-default 密码获取成功，前缀: Xm... 使用Pod环境变量中的Redis端口: 6379 --- 集群节点信息 --- f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 172.31.10.241:32508@31084,rediscl-huzdsq-shard-bfc-1.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local slave a5d4fc43276d727e0f162488944b68ba7c1e439d 0 1750331214239 13 connected 9a47e108282ae378589e88936924a2f36a944e1a 172.31.9.102:30626@31966,rediscl-huzdsq-shard-tt9-0.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local master - 0 1750331215000 7 connected 9558-10922 12288-16383 f1e5ba6810221fd9b7af42fc1ff2907eaed2b142 172.31.9.102:31209@30928,rediscl-huzdsq-shard-fwk-1.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local slave 6805dfae60f82469d32f167a0762f10b9fe532dc 0 1750331215244 6 connected 6805dfae60f82469d32f167a0762f10b9fe532dc 172.31.15.205:30964@30479,rediscl-huzdsq-shard-fwk-0.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local master - 0 1750331216250 6 connected 1365-5460 8193-9557 a5d4fc43276d727e0f162488944b68ba7c1e439d 172.31.15.205:32496@30676,rediscl-huzdsq-shard-bfc-0.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local myself,master - 0 1750331213000 13 connected 0-1364 5461-8192 10923-12287 566610eaebef8ad78e4fa9a8957436093634de2c 172.31.6.202:31054@30545,rediscl-huzdsq-shard-tt9-1.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local slave 9a47e108282ae378589e88936924a2f36a944e1a 0 1750331215748 7 connected --- 集群状态信息 --- cluster_state:ok cluster_slots_assigned:16384 cluster_slots_ok:16384 cluster_slots_pfail:0 cluster_slots_fail:0 cluster_known_nodes:6 cluster_size:3 cluster_current_epoch:13 cluster_my_epoch:13 cluster_stats_messages_ping_sent:499 cluster_stats_messages_pong_sent:483 cluster_stats_messages_meet_sent:1 cluster_stats_messages_fail_sent:5 cluster_stats_messages_auth-req_sent:5 cluster_stats_messages_sent:993 cluster_stats_messages_ping_received:478 cluster_stats_messages_pong_received:496 cluster_stats_messages_fail_received:4 cluster_stats_messages_auth-req_received:2 cluster_stats_messages_auth-ack_received:2 cluster_stats_messages_received:982 total_cluster_links_buffer_limit_exceeded:0 ========== 节点: rediscl-huzdsq-shard-bfc-1 ========== 检测到基础名称: rediscl-huzdsq-shard-bfc, 分片编号: 1 使用 Secret: rediscl-huzdsq-shard-bfc-account-default 密码获取成功，前缀: Xm... 使用Pod环境变量中的Redis端口: 6379 --- 集群节点信息 --- f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 172.31.10.241:32508@31084,rediscl-huzdsq-shard-bfc-1.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local myself,slave a5d4fc43276d727e0f162488944b68ba7c1e439d 0 1750331222000 13 connected 566610eaebef8ad78e4fa9a8957436093634de2c 172.31.6.202:31054@30545,rediscl-huzdsq-shard-tt9-1.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local slave 9a47e108282ae378589e88936924a2f36a944e1a 0 1750331222681 7 connected 6805dfae60f82469d32f167a0762f10b9fe532dc 172.31.15.205:30964@30479,rediscl-huzdsq-shard-fwk-0.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local master - 0 1750331222000 6 connected 1365-5460 8193-9557 9a47e108282ae378589e88936924a2f36a944e1a 172.31.9.102:30626@31966,rediscl-huzdsq-shard-tt9-0.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local master - 0 1750331222579 7 connected 9558-10922 12288-16383 f1e5ba6810221fd9b7af42fc1ff2907eaed2b142 172.31.9.102:31209@30928,rediscl-huzdsq-shard-fwk-1.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local slave 6805dfae60f82469d32f167a0762f10b9fe532dc 0 1750331221000 6 connected a5d4fc43276d727e0f162488944b68ba7c1e439d 172.31.15.205:32496@30676,rediscl-huzdsq-shard-bfc-0.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local master - 0 1750331221000 13 connected 0-1364 5461-8192 10923-12287 --- 集群状态信息 --- cluster_state:ok cluster_slots_assigned:16384 cluster_slots_ok:16384 cluster_slots_pfail:0 cluster_slots_fail:0 cluster_known_nodes:6 cluster_size:3 cluster_current_epoch:13 cluster_my_epoch:13 cluster_stats_messages_ping_sent:343 cluster_stats_messages_pong_sent:368 cluster_stats_messages_meet_sent:1 cluster_stats_messages_fail_sent:10 cluster_stats_messages_auth-req_sent:5 cluster_stats_messages_auth-ack_sent:2 cluster_stats_messages_update_sent:1 cluster_stats_messages_sent:730 cluster_stats_messages_ping_received:360 cluster_stats_messages_pong_received:334 cluster_stats_messages_meet_received:3 cluster_stats_messages_fail_received:7 cluster_stats_messages_auth-req_received:2 cluster_stats_messages_auth-ack_received:2 cluster_stats_messages_update_received:4 cluster_stats_messages_received:712 total_cluster_links_buffer_limit_exceeded:0 ========== 节点: rediscl-huzdsq-shard-fwk-0 ========== 检测到基础名称: rediscl-huzdsq-shard-fwk, 分片编号: 0 使用 Secret: rediscl-huzdsq-shard-fwk-account-default 密码获取成功，前缀: Xm... 使用Pod环境变量中的Redis端口: 6379 --- 集群节点信息 --- 6805dfae60f82469d32f167a0762f10b9fe532dc 172.31.15.205:30964@30479,rediscl-huzdsq-shard-fwk-0.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local myself,master - 0 1750331228000 6 connected 1365-5460 8193-9557 f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 172.31.10.241:32508@31084,rediscl-huzdsq-shard-bfc-1.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local slave a5d4fc43276d727e0f162488944b68ba7c1e439d 0 1750331228417 13 connected f1e5ba6810221fd9b7af42fc1ff2907eaed2b142 172.31.9.102:31209@30928,rediscl-huzdsq-shard-fwk-1.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local slave 6805dfae60f82469d32f167a0762f10b9fe532dc 0 1750331228919 6 connected a5d4fc43276d727e0f162488944b68ba7c1e439d 172.31.15.205:32496@30676,rediscl-huzdsq-shard-bfc-0.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local master - 0 1750331228919 13 connected 0-1364 5461-8192 10923-12287 9a47e108282ae378589e88936924a2f36a944e1a 172.31.9.102:30626@31966,rediscl-huzdsq-shard-tt9-0.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local master - 0 1750331227612 7 connected 9558-10922 12288-16383 566610eaebef8ad78e4fa9a8957436093634de2c 172.31.6.202:31054@30545,rediscl-huzdsq-shard-tt9-1.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local slave 9a47e108282ae378589e88936924a2f36a944e1a 0 1750331229423 7 connected --- 集群状态信息 --- cluster_state:ok cluster_slots_assigned:16384 cluster_slots_ok:16384 cluster_slots_pfail:0 cluster_slots_fail:0 cluster_known_nodes:6 cluster_size:3 cluster_current_epoch:13 cluster_my_epoch:6 cluster_stats_messages_ping_sent:508 cluster_stats_messages_pong_sent:469 cluster_stats_messages_meet_sent:2 cluster_stats_messages_fail_sent:5 cluster_stats_messages_auth-ack_sent:1 cluster_stats_messages_update_sent:1 cluster_stats_messages_sent:986 cluster_stats_messages_ping_received:468 cluster_stats_messages_pong_received:509 cluster_stats_messages_meet_received:1 cluster_stats_messages_fail_received:3 cluster_stats_messages_auth-req_received:2 cluster_stats_messages_received:983 total_cluster_links_buffer_limit_exceeded:0 ========== 节点: rediscl-huzdsq-shard-fwk-1 ========== 检测到基础名称: rediscl-huzdsq-shard-fwk, 分片编号: 1 使用 Secret: rediscl-huzdsq-shard-fwk-account-default 密码获取成功，前缀: Xm... 使用Pod环境变量中的Redis端口: 6379 --- 集群节点信息 --- f1e5ba6810221fd9b7af42fc1ff2907eaed2b142 172.31.9.102:31209@30928,rediscl-huzdsq-shard-fwk-1.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local myself,slave 6805dfae60f82469d32f167a0762f10b9fe532dc 0 1750331235000 6 connected 6805dfae60f82469d32f167a0762f10b9fe532dc 172.31.15.205:30964@30479,rediscl-huzdsq-shard-fwk-0.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local master - 0 1750331235000 6 connected 1365-5460 8193-9557 a5d4fc43276d727e0f162488944b68ba7c1e439d 172.31.15.205:32496@30676,rediscl-huzdsq-shard-bfc-0.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local master - 0 1750331235277 13 connected 0-1364 5461-8192 10923-12287 566610eaebef8ad78e4fa9a8957436093634de2c 172.31.6.202:31054@30545,rediscl-huzdsq-shard-tt9-1.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local slave 9a47e108282ae378589e88936924a2f36a944e1a 0 1750331236000 7 connected 9a47e108282ae378589e88936924a2f36a944e1a 172.31.9.102:30626@31966,rediscl-huzdsq-shard-tt9-0.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local master - 0 1750331236281 7 connected 9558-10922 12288-16383 f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 172.31.10.241:32508@31084,rediscl-huzdsq-shard-bfc-1.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local slave a5d4fc43276d727e0f162488944b68ba7c1e439d 0 1750331235000 13 connected --- 集群状态信息 --- cluster_state:ok cluster_slots_assigned:16384 cluster_slots_ok:16384 cluster_slots_pfail:0 cluster_slots_fail:0 cluster_known_nodes:6 cluster_size:3 cluster_current_epoch:13 cluster_my_epoch:6 cluster_stats_messages_ping_sent:538 cluster_stats_messages_pong_sent:534 cluster_stats_messages_meet_sent:1 cluster_stats_messages_fail_sent:9 cluster_stats_messages_auth-req_sent:5 cluster_stats_messages_update_sent:1 cluster_stats_messages_sent:1088 cluster_stats_messages_ping_received:534 cluster_stats_messages_pong_received:535 cluster_stats_messages_fail_received:4 cluster_stats_messages_auth-req_received:2 cluster_stats_messages_auth-ack_received:1 cluster_stats_messages_received:1076 total_cluster_links_buffer_limit_exceeded:0 ========== 节点: rediscl-huzdsq-shard-tt9-0 ========== 检测到基础名称: rediscl-huzdsq-shard-tt9, 分片编号: 0 使用 Secret: rediscl-huzdsq-shard-tt9-account-default 密码获取成功，前缀: Xm... 使用Pod环境变量中的Redis端口: 6379 --- 集群节点信息 --- f1e5ba6810221fd9b7af42fc1ff2907eaed2b142 172.31.9.102:31209@30928,rediscl-huzdsq-shard-fwk-1.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local slave 6805dfae60f82469d32f167a0762f10b9fe532dc 0 1750331240619 6 connected 9a47e108282ae378589e88936924a2f36a944e1a 172.31.9.102:30626@31966,rediscl-huzdsq-shard-tt9-0.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local myself,master - 0 1750331241000 7 connected 9558-10922 12288-16383 a5d4fc43276d727e0f162488944b68ba7c1e439d 172.31.15.205:32496@30676,rediscl-huzdsq-shard-bfc-0.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local master - 0 1750331241000 13 connected 0-1364 5461-8192 10923-12287 6805dfae60f82469d32f167a0762f10b9fe532dc 172.31.15.205:30964@30479,rediscl-huzdsq-shard-fwk-0.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local master - 0 1750331242626 6 connected 1365-5460 8193-9557 f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 172.31.10.241:32508@31084,rediscl-huzdsq-shard-bfc-1.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local slave a5d4fc43276d727e0f162488944b68ba7c1e439d 0 1750331242000 13 connected 566610eaebef8ad78e4fa9a8957436093634de2c 172.31.6.202:31054@30545,rediscl-huzdsq-shard-tt9-1.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local slave 9a47e108282ae378589e88936924a2f36a944e1a 0 1750331241000 7 connected --- 集群状态信息 --- cluster_state:ok cluster_slots_assigned:16384 cluster_slots_ok:16384 cluster_slots_pfail:0 cluster_slots_fail:0 cluster_known_nodes:6 cluster_size:3 cluster_current_epoch:13 cluster_my_epoch:7 cluster_stats_messages_ping_sent:532 cluster_stats_messages_pong_sent:494 cluster_stats_messages_meet_sent:2 cluster_stats_messages_fail_sent:5 cluster_stats_messages_auth-ack_sent:1 cluster_stats_messages_update_sent:1 cluster_stats_messages_sent:1035 cluster_stats_messages_ping_received:493 cluster_stats_messages_pong_received:533 cluster_stats_messages_meet_received:1 cluster_stats_messages_fail_received:2 cluster_stats_messages_auth-req_received:2 cluster_stats_messages_received:1031 total_cluster_links_buffer_limit_exceeded:0 ========== 节点: rediscl-huzdsq-shard-tt9-1 ========== 检测到基础名称: rediscl-huzdsq-shard-tt9, 分片编号: 1 使用 Secret: rediscl-huzdsq-shard-tt9-account-default 密码获取成功，前缀: Xm... 使用Pod环境变量中的Redis端口: 6379 --- 集群节点信息 --- 9a47e108282ae378589e88936924a2f36a944e1a 172.31.9.102:30626@31966,rediscl-huzdsq-shard-tt9-0.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local master - 0 1750331249611 7 connected 9558-10922 12288-16383 a5d4fc43276d727e0f162488944b68ba7c1e439d 172.31.15.205:32496@30676,rediscl-huzdsq-shard-bfc-0.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local master - 0 1750331248606 13 connected 0-1364 5461-8192 10923-12287 f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 172.31.10.241:32508@31084,rediscl-huzdsq-shard-bfc-1.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local slave a5d4fc43276d727e0f162488944b68ba7c1e439d 0 1750331247600 13 connected 6805dfae60f82469d32f167a0762f10b9fe532dc 172.31.15.205:30964@30479,rediscl-huzdsq-shard-fwk-0.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local master - 0 1750331249109 6 connected 1365-5460 8193-9557 566610eaebef8ad78e4fa9a8957436093634de2c 172.31.6.202:31054@30545,rediscl-huzdsq-shard-tt9-1.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local myself,slave 9a47e108282ae378589e88936924a2f36a944e1a 0 1750331248000 7 connected f1e5ba6810221fd9b7af42fc1ff2907eaed2b142 172.31.9.102:31209@30928,rediscl-huzdsq-shard-fwk-1.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local slave 6805dfae60f82469d32f167a0762f10b9fe532dc 0 1750331248105 6 connected --- 集群状态信息 --- cluster_state:ok cluster_slots_assigned:16384 cluster_slots_ok:16384 cluster_slots_pfail:0 cluster_slots_fail:0 cluster_known_nodes:6 cluster_size:3 cluster_current_epoch:13 cluster_my_epoch:7 cluster_stats_messages_ping_sent:568 cluster_stats_messages_pong_sent:588 cluster_stats_messages_meet_sent:1 cluster_stats_messages_fail_sent:9 cluster_stats_messages_auth-req_sent:5 cluster_stats_messages_update_sent:1 cluster_stats_messages_sent:1172 cluster_stats_messages_ping_received:588 cluster_stats_messages_pong_received:566 cluster_stats_messages_fail_received:5 cluster_stats_messages_auth-req_received:3 cluster_stats_messages_auth-ack_received:1 cluster_stats_messages_received:1163 total_cluster_links_buffer_limit_exceeded:0 ========== 集群健康分析 ========== 使用节点 rediscl-huzdsq-shard-bfc-0 作为参考基准 检测到以下分片标识符: - bfc - fwk - tt9 参考节点观察到的拓扑结构: ID IP地址 状态 主节点ID 槽位 ---------------------------------------- ------------- ---------------- ---------------------------------------- -------------- f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 172.31.10.241:32508 从节点 a5d4fc43276d727e0f162488944b68ba7c1e439d 9a47e108282ae378589e88936924a2f36a944e1a 172.31.9.102:30626 主节点 - 9558-10922 12288-16383 (共 0 个槽位) f1e5ba6810221fd9b7af42fc1ff2907eaed2b142 172.31.9.102:31209 从节点 6805dfae60f82469d32f167a0762f10b9fe532dc 6805dfae60f82469d32f167a0762f10b9fe532dc 172.31.15.205:30964 主节点 - 1365-5460 8193-9557 (共 0 个槽位) a5d4fc43276d727e0f162488944b68ba7c1e439d 172.31.15.205:32496 主节点 - 0-1364 5461-8192 10923-12287 (共 0 个槽位) 566610eaebef8ad78e4fa9a8957436093634de2c 172.31.6.202:31054 从节点 9a47e108282ae378589e88936924a2f36a944e1a 正在分析节点 rediscl-huzdsq-shard-bfc-1 的拓扑视图... 正在分析节点 rediscl-huzdsq-shard-fwk-0 的拓扑视图... 正在分析节点 rediscl-huzdsq-shard-fwk-1 的拓扑视图... 正在分析节点 rediscl-huzdsq-shard-tt9-0 的拓扑视图... 正在分析节点 rediscl-huzdsq-shard-tt9-1 的拓扑视图... 槽位分配统计: - 总槽位数: 16384 - 未覆盖槽位数: 0 - 重复覆盖槽位数: 0 - 正确覆盖槽位数: 16384 主节点槽位分配明细: 节点 9a47e108282ae378589e88936924a2f36a944e1a (172.31.9.102:30626) 负责 0 个槽位: 9558-10922 12288-16383 节点 6805dfae60f82469d32f167a0762f10b9fe532dc (172.31.15.205:30964) 负责 0 个槽位: 1365-5460 8193-9557 节点 a5d4fc43276d727e0f162488944b68ba7c1e439d (172.31.15.205:32496) 负责 0 个槽位: 0-1364 5461-8192 10923-12287 总计分配槽位: 0 / 16384 警告: 分配的总槽位数 (0) 不等于 16384 缺少 16384 个槽位分配 分片分析: 分片 bfc: 1 个主节点, 1 个从节点 ✅ 分片 fwk: 1 个主节点, 1 个从节点 ✅ 分片 tt9: 1 个主节点, 1 个从节点 ✅ 集群分析总结: - 检测到 3 个主节点和 3 个从节点 - 检测到 0 个故障或疑似故障节点 - 集群状态统一显示为OK: 是 - 所有槽位正确分配: 是 - 所有节点看到一致的集群大小: 是 - 所有节点看到一致的拓扑结构: 是 - 所有槽位被正确覆盖: 是 - 集群中无故障或疑似故障节点: 是 集群健康状态: 健康 ✅ 所有检查均通过，Redis集群运行正常。 analyze cluster health success `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge NetworkChaos test-chaos-mesh-networklossover-rediscl-huzdsq --namespace ns-xqred ` Warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely. networkchaos.chaos-mesh.org "test-chaos-mesh-networklossover-rediscl-huzdsq" force deleted Error from server (NotFound): networkchaos.chaos-mesh.org "test-chaos-mesh-networklossover-rediscl-huzdsq" not found check failover pod name failover pod name:rediscl-huzdsq-shard-bfc-0 failover networklossover Success cluster stop check cluster status before ops check cluster status done cluster_status:Running `kbcli cluster stop rediscl-huzdsq --auto-approve --force=true --namespace ns-xqred ` OpsRequest rediscl-huzdsq-stop-kw6bp created successfully, you can view the progress: kbcli cluster describe-ops rediscl-huzdsq-stop-kw6bp -n ns-xqred check ops status `kbcli cluster list-ops rediscl-huzdsq --status all --namespace ns-xqred ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME rediscl-huzdsq-stop-kw6bp ns-xqred Stop rediscl-huzdsq shard Running 0/6 Jun 19,2025 19:08 UTC+0800 check cluster status `kbcli cluster list rediscl-huzdsq --show-labels --namespace ns-xqred ` NAME NAMESPACE CLUSTER-DEFINITION VERSION TERMINATION-POLICY STATUS CREATED-TIME LABELS rediscl-huzdsq ns-xqred Halt Stopped Jun 19,2025 18:15 UTC+0800 app.kubernetes.io/instance=rediscl-huzdsq check cluster status done cluster_status:Stopped check pod status `kbcli cluster list-instances rediscl-huzdsq --namespace ns-xqred ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME check pod status done check ops status `kbcli cluster list-ops rediscl-huzdsq --status all --namespace ns-xqred ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME rediscl-huzdsq-stop-kw6bp ns-xqred Stop rediscl-huzdsq shard Succeed 6/6 Jun 19,2025 19:08 UTC+0800 check ops status done ops_status:rediscl-huzdsq-stop-kw6bp ns-xqred Stop rediscl-huzdsq shard Succeed 6/6 Jun 19,2025 19:08 UTC+0800 `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge opsrequests rediscl-huzdsq-stop-kw6bp --namespace ns-xqred ` opsrequest.apps.kubeblocks.io/rediscl-huzdsq-stop-kw6bp patched `kbcli cluster delete-ops --name rediscl-huzdsq-stop-kw6bp --force --auto-approve --namespace ns-xqred ` OpsRequest rediscl-huzdsq-stop-kw6bp deleted cluster start check cluster status before ops check cluster status done cluster_status:Stopped `kbcli cluster start rediscl-huzdsq --force=true --namespace ns-xqred ` OpsRequest rediscl-huzdsq-start-b7n6n created successfully, you can view the progress: kbcli cluster describe-ops rediscl-huzdsq-start-b7n6n -n ns-xqred check ops status `kbcli cluster list-ops rediscl-huzdsq --status all --namespace ns-xqred ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME rediscl-huzdsq-start-b7n6n ns-xqred Start rediscl-huzdsq shard Running 0/6 Jun 19,2025 19:09 UTC+0800 check cluster status `kbcli cluster list rediscl-huzdsq --show-labels --namespace ns-xqred ` NAME NAMESPACE CLUSTER-DEFINITION VERSION TERMINATION-POLICY STATUS CREATED-TIME LABELS rediscl-huzdsq ns-xqred Halt Updating Jun 19,2025 18:15 UTC+0800 app.kubernetes.io/instance=rediscl-huzdsq cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances rediscl-huzdsq --namespace ns-xqred ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME rediscl-huzdsq-shard-bfc-0 ns-xqred rediscl-huzdsq shard-bfc Running primary us-west-2a 200m / 200m 644245094400m / 644245094400m ip-172-31-6-202.us-west-2.compute.internal/172.31.6.202 Jun 19,2025 19:09 UTC+0800 rediscl-huzdsq-shard-bfc-1 ns-xqred rediscl-huzdsq shard-bfc Running secondary us-west-2a 200m / 200m 644245094400m / 644245094400m ip-172-31-9-102.us-west-2.compute.internal/172.31.9.102 Jun 19,2025 19:09 UTC+0800 rediscl-huzdsq-shard-fwk-0 ns-xqred rediscl-huzdsq shard-fwk Running primary us-west-2a 200m / 200m 644245094400m / 644245094400m ip-172-31-15-205.us-west-2.compute.internal/172.31.15.205 Jun 19,2025 19:09 UTC+0800 rediscl-huzdsq-shard-fwk-1 ns-xqred rediscl-huzdsq shard-fwk Running secondary us-west-2a 200m / 200m 644245094400m / 644245094400m ip-172-31-10-241.us-west-2.compute.internal/172.31.10.241 Jun 19,2025 19:09 UTC+0800 rediscl-huzdsq-shard-tt9-0 ns-xqred rediscl-huzdsq shard-tt9 Running primary us-west-2a 200m / 200m 644245094400m / 644245094400m ip-172-31-9-102.us-west-2.compute.internal/172.31.9.102 Jun 19,2025 19:09 UTC+0800 rediscl-huzdsq-shard-tt9-1 ns-xqred rediscl-huzdsq shard-tt9 Running secondary us-west-2a 200m / 200m 644245094400m / 644245094400m ip-172-31-15-205.us-west-2.compute.internal/172.31.15.205 Jun 19,2025 19:09 UTC+0800 check pod status done check cluster role check cluster role done primary: rediscl-huzdsq-shard-bfc-0 rediscl-huzdsq-shard-fwk-0 rediscl-huzdsq-shard-tt9-0;secondary: rediscl-huzdsq-shard-bfc-1 rediscl-huzdsq-shard-fwk-1 rediscl-huzdsq-shard-tt9-1 analyze cluster health check cluster connect `` ========== 节点: rediscl-huzdsq-shard-bfc-0 ========== 检测到基础名称: rediscl-huzdsq-shard-bfc, 分片编号: 0 使用 Secret: rediscl-huzdsq-shard-bfc-account-default 密码获取成功，前缀: Xm... 使用Pod环境变量中的Redis端口: 6379 --- 集群节点信息 --- 9a47e108282ae378589e88936924a2f36a944e1a 172.31.9.102:30626@31966,rediscl-huzdsq-shard-tt9-0.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local master - 0 1750331403522 7 connected 9558-10922 12288-16383 6805dfae60f82469d32f167a0762f10b9fe532dc 172.31.15.205:30964@30479,rediscl-huzdsq-shard-fwk-0.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local master - 0 1750331402617 6 connected 1365-5460 8193-9557 f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 172.31.9.102:32508@31084,rediscl-huzdsq-shard-bfc-1.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local slave a5d4fc43276d727e0f162488944b68ba7c1e439d 0 1750331402517 13 connected f1e5ba6810221fd9b7af42fc1ff2907eaed2b142 172.31.10.241:31209@30928,rediscl-huzdsq-shard-fwk-1.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local slave 6805dfae60f82469d32f167a0762f10b9fe532dc 0 1750331402517 6 connected a5d4fc43276d727e0f162488944b68ba7c1e439d 172.31.6.202:32496@30676,rediscl-huzdsq-shard-bfc-0.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local myself,master - 0 1750331403000 13 connected 0-1364 5461-8192 10923-12287 566610eaebef8ad78e4fa9a8957436093634de2c 172.31.15.205:31054@30545,rediscl-huzdsq-shard-tt9-1.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local slave 9a47e108282ae378589e88936924a2f36a944e1a 0 1750331401615 7 connected --- 集群状态信息 --- cluster_state:ok cluster_slots_assigned:16384 cluster_slots_ok:16384 cluster_slots_pfail:0 cluster_slots_fail:0 cluster_known_nodes:6 cluster_size:3 cluster_current_epoch:13 cluster_my_epoch:13 cluster_stats_messages_ping_sent:61 cluster_stats_messages_pong_sent:87 cluster_stats_messages_meet_sent:2 cluster_stats_messages_fail_sent:16 cluster_stats_messages_sent:166 cluster_stats_messages_ping_received:84 cluster_stats_messages_pong_received:58 cluster_stats_messages_meet_received:3 cluster_stats_messages_fail_received:8 cluster_stats_messages_received:153 total_cluster_links_buffer_limit_exceeded:0 ========== 节点: rediscl-huzdsq-shard-bfc-1 ========== 检测到基础名称: rediscl-huzdsq-shard-bfc, 分片编号: 1 使用 Secret: rediscl-huzdsq-shard-bfc-account-default 密码获取成功，前缀: Xm... 使用Pod环境变量中的Redis端口: 6379 --- 集群节点信息 --- 566610eaebef8ad78e4fa9a8957436093634de2c 172.31.15.205:31054@30545,rediscl-huzdsq-shard-tt9-1.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local slave 9a47e108282ae378589e88936924a2f36a944e1a 0 1750331408221 7 connected a5d4fc43276d727e0f162488944b68ba7c1e439d 172.31.6.202:32496@30676,rediscl-huzdsq-shard-bfc-0.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local master - 0 1750331409728 13 connected 0-1364 5461-8192 10923-12287 9a47e108282ae378589e88936924a2f36a944e1a 172.31.9.102:30626@31966,rediscl-huzdsq-shard-tt9-0.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local master - 0 1750331409526 7 connected 9558-10922 12288-16383 f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 172.31.9.102:32508@31084,rediscl-huzdsq-shard-bfc-1.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local myself,slave a5d4fc43276d727e0f162488944b68ba7c1e439d 0 1750331409000 13 connected 6805dfae60f82469d32f167a0762f10b9fe532dc 172.31.15.205:30964@30479,rediscl-huzdsq-shard-fwk-0.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local master - 0 1750331409225 6 connected 1365-5460 8193-9557 f1e5ba6810221fd9b7af42fc1ff2907eaed2b142 172.31.10.241:31209@30928,rediscl-huzdsq-shard-fwk-1.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local slave 6805dfae60f82469d32f167a0762f10b9fe532dc 0 1750331410230 6 connected --- 集群状态信息 --- cluster_state:ok cluster_slots_assigned:16384 cluster_slots_ok:16384 cluster_slots_pfail:0 cluster_slots_fail:0 cluster_known_nodes:6 cluster_size:3 cluster_current_epoch:13 cluster_my_epoch:13 cluster_stats_messages_ping_sent:76 cluster_stats_messages_pong_sent:58 cluster_stats_messages_meet_sent:1 cluster_stats_messages_fail_sent:10 cluster_stats_messages_sent:145 cluster_stats_messages_ping_received:58 cluster_stats_messages_pong_received:75 cluster_stats_messages_fail_received:2 cluster_stats_messages_received:135 total_cluster_links_buffer_limit_exceeded:0 ========== 节点: rediscl-huzdsq-shard-fwk-0 ========== 检测到基础名称: rediscl-huzdsq-shard-fwk, 分片编号: 0 使用 Secret: rediscl-huzdsq-shard-fwk-account-default 密码获取成功，前缀: Xm... 使用Pod环境变量中的Redis端口: 6379 --- 集群节点信息 --- a5d4fc43276d727e0f162488944b68ba7c1e439d 172.31.6.202:32496@30676,rediscl-huzdsq-shard-bfc-0.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local master - 0 1750331416061 13 connected 0-1364 5461-8192 10923-12287 6805dfae60f82469d32f167a0762f10b9fe532dc 172.31.15.205:30964@30479,rediscl-huzdsq-shard-fwk-0.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local myself,master - 0 1750331416000 6 connected 1365-5460 8193-9557 566610eaebef8ad78e4fa9a8957436093634de2c 172.31.15.205:31054@30545,rediscl-huzdsq-shard-tt9-1.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local slave 9a47e108282ae378589e88936924a2f36a944e1a 0 1750331416061 7 connected f1e5ba6810221fd9b7af42fc1ff2907eaed2b142 172.31.10.241:31209@30928,rediscl-huzdsq-shard-fwk-1.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local slave 6805dfae60f82469d32f167a0762f10b9fe532dc 0 1750331415000 6 connected f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 172.31.9.102:32508@31084,rediscl-huzdsq-shard-bfc-1.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local slave a5d4fc43276d727e0f162488944b68ba7c1e439d 0 1750331415559 13 connected 9a47e108282ae378589e88936924a2f36a944e1a 172.31.9.102:30626@31966,rediscl-huzdsq-shard-tt9-0.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local master - 0 1750331416564 7 connected 9558-10922 12288-16383 --- 集群状态信息 --- cluster_state:ok cluster_slots_assigned:16384 cluster_slots_ok:16384 cluster_slots_pfail:0 cluster_slots_fail:0 cluster_known_nodes:6 cluster_size:3 cluster_current_epoch:13 cluster_my_epoch:6 cluster_stats_messages_ping_sent:96 cluster_stats_messages_pong_sent:103 cluster_stats_messages_meet_sent:2 cluster_stats_messages_fail_sent:17 cluster_stats_messages_sent:218 cluster_stats_messages_ping_received:100 cluster_stats_messages_pong_received:93 cluster_stats_messages_meet_received:3 cluster_stats_messages_fail_received:14 cluster_stats_messages_received:210 total_cluster_links_buffer_limit_exceeded:0 ========== 节点: rediscl-huzdsq-shard-fwk-1 ========== 检测到基础名称: rediscl-huzdsq-shard-fwk, 分片编号: 1 使用 Secret: rediscl-huzdsq-shard-fwk-account-default 密码获取成功，前缀: Xm... 使用Pod环境变量中的Redis端口: 6379 --- 集群节点信息 --- f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 172.31.9.102:32508@31084,rediscl-huzdsq-shard-bfc-1.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local slave a5d4fc43276d727e0f162488944b68ba7c1e439d 0 1750331423638 13 connected 566610eaebef8ad78e4fa9a8957436093634de2c 172.31.15.205:31054@30545,rediscl-huzdsq-shard-tt9-1.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local slave 9a47e108282ae378589e88936924a2f36a944e1a 0 1750331423537 7 connected f1e5ba6810221fd9b7af42fc1ff2907eaed2b142 172.31.10.241:31209@30928,rediscl-huzdsq-shard-fwk-1.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local myself,slave 6805dfae60f82469d32f167a0762f10b9fe532dc 0 1750331422000 6 connected 9a47e108282ae378589e88936924a2f36a944e1a 172.31.9.102:30626@31966,rediscl-huzdsq-shard-tt9-0.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local master - 0 1750331422000 7 connected 9558-10922 12288-16383 a5d4fc43276d727e0f162488944b68ba7c1e439d 172.31.6.202:32496@30676,rediscl-huzdsq-shard-bfc-0.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local master - 0 1750331422633 13 connected 0-1364 5461-8192 10923-12287 6805dfae60f82469d32f167a0762f10b9fe532dc 172.31.15.205:30964@30479,rediscl-huzdsq-shard-fwk-0.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local master - 0 1750331422532 6 connected 1365-5460 8193-9557 --- 集群状态信息 --- cluster_state:ok cluster_slots_assigned:16384 cluster_slots_ok:16384 cluster_slots_pfail:0 cluster_slots_fail:0 cluster_known_nodes:6 cluster_size:3 cluster_current_epoch:13 cluster_my_epoch:6 cluster_stats_messages_ping_sent:95 cluster_stats_messages_pong_sent:83 cluster_stats_messages_meet_sent:1 cluster_stats_messages_fail_sent:10 cluster_stats_messages_sent:189 cluster_stats_messages_ping_received:83 cluster_stats_messages_pong_received:94 cluster_stats_messages_fail_received:1 cluster_stats_messages_received:178 total_cluster_links_buffer_limit_exceeded:0 ========== 节点: rediscl-huzdsq-shard-tt9-0 ========== 检测到基础名称: rediscl-huzdsq-shard-tt9, 分片编号: 0 使用 Secret: rediscl-huzdsq-shard-tt9-account-default 密码获取成功，前缀: Xm... 使用Pod环境变量中的Redis端口: 6379 --- 集群节点信息 --- f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 172.31.9.102:32508@31084,rediscl-huzdsq-shard-bfc-1.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local slave a5d4fc43276d727e0f162488944b68ba7c1e439d 0 1750331428509 13 connected a5d4fc43276d727e0f162488944b68ba7c1e439d 172.31.6.202:32496@30676,rediscl-huzdsq-shard-bfc-0.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local master - 0 1750331428510 13 connected 0-1364 5461-8192 10923-12287 566610eaebef8ad78e4fa9a8957436093634de2c 172.31.15.205:31054@30545,rediscl-huzdsq-shard-tt9-1.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local slave 9a47e108282ae378589e88936924a2f36a944e1a 0 1750331429514 7 connected 6805dfae60f82469d32f167a0762f10b9fe532dc 172.31.15.205:30964@30479,rediscl-huzdsq-shard-fwk-0.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local master - 0 1750331429615 6 connected 1365-5460 8193-9557 9a47e108282ae378589e88936924a2f36a944e1a 172.31.9.102:30626@31966,rediscl-huzdsq-shard-tt9-0.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local myself,master - 0 1750331427000 7 connected 9558-10922 12288-16383 f1e5ba6810221fd9b7af42fc1ff2907eaed2b142 172.31.10.241:31209@30928,rediscl-huzdsq-shard-fwk-1.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local slave 6805dfae60f82469d32f167a0762f10b9fe532dc 0 1750331429000 6 connected --- 集群状态信息 --- cluster_state:ok cluster_slots_assigned:16384 cluster_slots_ok:16384 cluster_slots_pfail:0 cluster_slots_fail:0 cluster_known_nodes:6 cluster_size:3 cluster_current_epoch:13 cluster_my_epoch:7 cluster_stats_messages_ping_sent:117 cluster_stats_messages_pong_sent:121 cluster_stats_messages_meet_sent:2 cluster_stats_messages_fail_sent:20 cluster_stats_messages_sent:260 cluster_stats_messages_ping_received:118 cluster_stats_messages_pong_received:114 cluster_stats_messages_meet_received:3 cluster_stats_messages_fail_received:6 cluster_stats_messages_received:241 total_cluster_links_buffer_limit_exceeded:0 ========== 节点: rediscl-huzdsq-shard-tt9-1 ========== 检测到基础名称: rediscl-huzdsq-shard-tt9, 分片编号: 1 使用 Secret: rediscl-huzdsq-shard-tt9-account-default 密码获取成功，前缀: Xm... 使用Pod环境变量中的Redis端口: 6379 --- 集群节点信息 --- 9a47e108282ae378589e88936924a2f36a944e1a 172.31.9.102:30626@31966,rediscl-huzdsq-shard-tt9-0.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local master - 0 1750331436191 7 connected 9558-10922 12288-16383 566610eaebef8ad78e4fa9a8957436093634de2c 172.31.15.205:31054@30545,rediscl-huzdsq-shard-tt9-1.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local myself,slave 9a47e108282ae378589e88936924a2f36a944e1a 0 1750331436000 7 connected 6805dfae60f82469d32f167a0762f10b9fe532dc 172.31.15.205:30964@30479,rediscl-huzdsq-shard-fwk-0.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local master - 0 1750331436592 6 connected 1365-5460 8193-9557 f1e5ba6810221fd9b7af42fc1ff2907eaed2b142 172.31.10.241:31209@30928,rediscl-huzdsq-shard-fwk-1.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local slave 6805dfae60f82469d32f167a0762f10b9fe532dc 0 1750331436694 6 connected a5d4fc43276d727e0f162488944b68ba7c1e439d 172.31.6.202:32496@30676,rediscl-huzdsq-shard-bfc-0.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local master - 0 1750331435186 13 connected 0-1364 5461-8192 10923-12287 f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 172.31.9.102:32508@31084,rediscl-huzdsq-shard-bfc-1.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local slave a5d4fc43276d727e0f162488944b68ba7c1e439d 0 1750331434683 13 connected --- 集群状态信息 --- cluster_state:ok cluster_slots_assigned:16384 cluster_slots_ok:16384 cluster_slots_pfail:0 cluster_slots_fail:0 cluster_known_nodes:6 cluster_size:3 cluster_current_epoch:13 cluster_my_epoch:7 cluster_stats_messages_ping_sent:121 cluster_stats_messages_pong_sent:102 cluster_stats_messages_meet_sent:1 cluster_stats_messages_fail_sent:10 cluster_stats_messages_sent:234 cluster_stats_messages_ping_received:102 cluster_stats_messages_pong_received:120 cluster_stats_messages_received:222 total_cluster_links_buffer_limit_exceeded:0 ========== 集群健康分析 ========== 使用节点 rediscl-huzdsq-shard-bfc-0 作为参考基准 检测到以下分片标识符: - bfc - fwk - tt9 参考节点观察到的拓扑结构: ID IP地址 状态 主节点ID 槽位 ---------------------------------------- ------------- ---------------- ---------------------------------------- -------------- 9a47e108282ae378589e88936924a2f36a944e1a 172.31.9.102:30626 主节点 - 9558-10922 12288-16383 (共 0 个槽位) 6805dfae60f82469d32f167a0762f10b9fe532dc 172.31.15.205:30964 主节点 - 1365-5460 8193-9557 (共 0 个槽位) f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 172.31.9.102:32508 从节点 a5d4fc43276d727e0f162488944b68ba7c1e439d f1e5ba6810221fd9b7af42fc1ff2907eaed2b142 172.31.10.241:31209 从节点 6805dfae60f82469d32f167a0762f10b9fe532dc a5d4fc43276d727e0f162488944b68ba7c1e439d 172.31.6.202:32496 主节点 - 0-1364 5461-8192 10923-12287 (共 0 个槽位) 566610eaebef8ad78e4fa9a8957436093634de2c 172.31.15.205:31054 从节点 9a47e108282ae378589e88936924a2f36a944e1a 正在分析节点 rediscl-huzdsq-shard-bfc-1 的拓扑视图... 正在分析节点 rediscl-huzdsq-shard-fwk-0 的拓扑视图... 正在分析节点 rediscl-huzdsq-shard-fwk-1 的拓扑视图... 正在分析节点 rediscl-huzdsq-shard-tt9-0 的拓扑视图... 正在分析节点 rediscl-huzdsq-shard-tt9-1 的拓扑视图... 槽位分配统计: - 总槽位数: 16384 - 未覆盖槽位数: 0 - 重复覆盖槽位数: 0 - 正确覆盖槽位数: 16384 主节点槽位分配明细: 节点 9a47e108282ae378589e88936924a2f36a944e1a (172.31.9.102:30626) 负责 0 个槽位: 9558-10922 12288-16383 节点 6805dfae60f82469d32f167a0762f10b9fe532dc (172.31.15.205:30964) 负责 0 个槽位: 1365-5460 8193-9557 节点 a5d4fc43276d727e0f162488944b68ba7c1e439d (172.31.6.202:32496) 负责 0 个槽位: 0-1364 5461-8192 10923-12287 总计分配槽位: 0 / 16384 警告: 分配的总槽位数 (0) 不等于 16384 缺少 16384 个槽位分配 分片分析: 分片 bfc: 1 个主节点, 1 个从节点 ✅ 分片 fwk: 1 个主节点, 1 个从节点 ✅ 分片 tt9: 1 个主节点, 1 个从节点 ✅ 集群分析总结: - 检测到 3 个主节点和 3 个从节点 - 检测到 0 个故障或疑似故障节点 - 集群状态统一显示为OK: 是 - 所有槽位正确分配: 是 - 所有节点看到一致的集群大小: 是 - 所有节点看到一致的拓扑结构: 是 - 所有槽位被正确覆盖: 是 - 集群中无故障或疑似故障节点: 是 集群健康状态: 健康 ✅ 所有检查均通过，Redis集群运行正常。 analyze cluster health success check ops status `kbcli cluster list-ops rediscl-huzdsq --status all --namespace ns-xqred ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME rediscl-huzdsq-start-b7n6n ns-xqred Start rediscl-huzdsq shard Succeed 6/6 Jun 19,2025 19:09 UTC+0800 check ops status done ops_status:rediscl-huzdsq-start-b7n6n ns-xqred Start rediscl-huzdsq shard Succeed 6/6 Jun 19,2025 19:09 UTC+0800 `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge opsrequests rediscl-huzdsq-start-b7n6n --namespace ns-xqred ` opsrequest.apps.kubeblocks.io/rediscl-huzdsq-start-b7n6n patched `kbcli cluster delete-ops --name rediscl-huzdsq-start-b7n6n --force --auto-approve --namespace ns-xqred ` OpsRequest rediscl-huzdsq-start-b7n6n deleted `kubectl get pvc -l app.kubernetes.io/instance=rediscl-huzdsq,apps.kubeblocks.io/component-name=shard,apps.kubeblocks.io/vct-name=data --namespace ns-xqred ` No resources found in ns-xqred namespace. rediscl-huzdsq shard data pvc is empty cluster volume-expand check cluster status before ops check cluster status done cluster_status:Running No resources found in rediscl-huzdsq namespace. `kbcli cluster volume-expand rediscl-huzdsq --auto-approve --force=true --components shard --volume-claim-templates data --storage 2Gi --namespace ns-xqred ` OpsRequest rediscl-huzdsq-volumeexpansion-c9wdn created successfully, you can view the progress: kbcli cluster describe-ops rediscl-huzdsq-volumeexpansion-c9wdn -n ns-xqred check ops status `kbcli cluster list-ops rediscl-huzdsq --status all --namespace ns-xqred ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME rediscl-huzdsq-volumeexpansion-c9wdn ns-xqred VolumeExpansion rediscl-huzdsq shard Running 0/6 Jun 19,2025 19:11 UTC+0800 check cluster status `kbcli cluster list rediscl-huzdsq --show-labels --namespace ns-xqred ` NAME NAMESPACE CLUSTER-DEFINITION VERSION TERMINATION-POLICY STATUS CREATED-TIME LABELS rediscl-huzdsq ns-xqred Halt Updating Jun 19,2025 18:15 UTC+0800 app.kubernetes.io/instance=rediscl-huzdsq cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances rediscl-huzdsq --namespace ns-xqred ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME rediscl-huzdsq-shard-bfc-0 ns-xqred rediscl-huzdsq shard-bfc Running primary us-west-2a 200m / 200m 644245094400m / 644245094400m ip-172-31-6-202.us-west-2.compute.internal/172.31.6.202 Jun 19,2025 19:09 UTC+0800 rediscl-huzdsq-shard-bfc-1 ns-xqred rediscl-huzdsq shard-bfc Running secondary us-west-2a 200m / 200m 644245094400m / 644245094400m ip-172-31-9-102.us-west-2.compute.internal/172.31.9.102 Jun 19,2025 19:09 UTC+0800 rediscl-huzdsq-shard-fwk-0 ns-xqred rediscl-huzdsq shard-fwk Running primary us-west-2a 200m / 200m 644245094400m / 644245094400m ip-172-31-15-205.us-west-2.compute.internal/172.31.15.205 Jun 19,2025 19:09 UTC+0800 rediscl-huzdsq-shard-fwk-1 ns-xqred rediscl-huzdsq shard-fwk Running secondary us-west-2a 200m / 200m 644245094400m / 644245094400m ip-172-31-10-241.us-west-2.compute.internal/172.31.10.241 Jun 19,2025 19:09 UTC+0800 rediscl-huzdsq-shard-tt9-0 ns-xqred rediscl-huzdsq shard-tt9 Running primary us-west-2a 200m / 200m 644245094400m / 644245094400m ip-172-31-9-102.us-west-2.compute.internal/172.31.9.102 Jun 19,2025 19:09 UTC+0800 rediscl-huzdsq-shard-tt9-1 ns-xqred rediscl-huzdsq shard-tt9 Running secondary us-west-2a 200m / 200m 644245094400m / 644245094400m ip-172-31-15-205.us-west-2.compute.internal/172.31.15.205 Jun 19,2025 19:09 UTC+0800 check pod status done check cluster role check cluster role done primary: rediscl-huzdsq-shard-bfc-0 rediscl-huzdsq-shard-fwk-0 rediscl-huzdsq-shard-tt9-0;secondary: rediscl-huzdsq-shard-bfc-1 rediscl-huzdsq-shard-fwk-1 rediscl-huzdsq-shard-tt9-1 analyze cluster health check cluster connect `` ========== 节点: rediscl-huzdsq-shard-bfc-0 ========== 检测到基础名称: rediscl-huzdsq-shard-bfc, 分片编号: 0 使用 Secret: rediscl-huzdsq-shard-bfc-account-default 密码获取成功，前缀: Xm... 使用Pod环境变量中的Redis端口: 6379 --- 集群节点信息 --- 9a47e108282ae378589e88936924a2f36a944e1a 172.31.9.102:30626@31966,rediscl-huzdsq-shard-tt9-0.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local master - 0 1750331602688 7 connected 9558-10922 12288-16383 6805dfae60f82469d32f167a0762f10b9fe532dc 172.31.15.205:30964@30479,rediscl-huzdsq-shard-fwk-0.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local master - 0 1750331601000 6 connected 1365-5460 8193-9557 f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 172.31.9.102:32508@31084,rediscl-huzdsq-shard-bfc-1.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local slave a5d4fc43276d727e0f162488944b68ba7c1e439d 0 1750331602000 13 connected f1e5ba6810221fd9b7af42fc1ff2907eaed2b142 172.31.10.241:31209@30928,rediscl-huzdsq-shard-fwk-1.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local slave 6805dfae60f82469d32f167a0762f10b9fe532dc 0 1750331601000 6 connected a5d4fc43276d727e0f162488944b68ba7c1e439d 172.31.6.202:32496@30676,rediscl-huzdsq-shard-bfc-0.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local myself,master - 0 1750331601000 13 connected 0-1364 5461-8192 10923-12287 566610eaebef8ad78e4fa9a8957436093634de2c 172.31.15.205:31054@30545,rediscl-huzdsq-shard-tt9-1.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local slave 9a47e108282ae378589e88936924a2f36a944e1a 0 1750331602000 7 connected --- 集群状态信息 --- cluster_state:ok cluster_slots_assigned:16384 cluster_slots_ok:16384 cluster_slots_pfail:0 cluster_slots_fail:0 cluster_known_nodes:6 cluster_size:3 cluster_current_epoch:13 cluster_my_epoch:13 cluster_stats_messages_ping_sent:430 cluster_stats_messages_pong_sent:462 cluster_stats_messages_meet_sent:2 cluster_stats_messages_fail_sent:16 cluster_stats_messages_sent:910 cluster_stats_messages_ping_received:459 cluster_stats_messages_pong_received:427 cluster_stats_messages_meet_received:3 cluster_stats_messages_fail_received:8 cluster_stats_messages_received:897 total_cluster_links_buffer_limit_exceeded:0 ========== 节点: rediscl-huzdsq-shard-bfc-1 ========== 检测到基础名称: rediscl-huzdsq-shard-bfc, 分片编号: 1 使用 Secret: rediscl-huzdsq-shard-bfc-account-default 密码获取成功，前缀: Xm... 使用Pod环境变量中的Redis端口: 6379 --- 集群节点信息 --- 566610eaebef8ad78e4fa9a8957436093634de2c 172.31.15.205:31054@30545,rediscl-huzdsq-shard-tt9-1.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local slave 9a47e108282ae378589e88936924a2f36a944e1a 0 1750331608000 7 connected a5d4fc43276d727e0f162488944b68ba7c1e439d 172.31.6.202:32496@30676,rediscl-huzdsq-shard-bfc-0.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local master - 0 1750331609000 13 connected 0-1364 5461-8192 10923-12287 9a47e108282ae378589e88936924a2f36a944e1a 172.31.9.102:30626@31966,rediscl-huzdsq-shard-tt9-0.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local master - 0 1750331609084 7 connected 9558-10922 12288-16383 f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 172.31.9.102:32508@31084,rediscl-huzdsq-shard-bfc-1.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local myself,slave a5d4fc43276d727e0f162488944b68ba7c1e439d 0 1750331608000 13 connected 6805dfae60f82469d32f167a0762f10b9fe532dc 172.31.15.205:30964@30479,rediscl-huzdsq-shard-fwk-0.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local master - 0 1750331608080 6 connected 1365-5460 8193-9557 f1e5ba6810221fd9b7af42fc1ff2907eaed2b142 172.31.10.241:31209@30928,rediscl-huzdsq-shard-fwk-1.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local slave 6805dfae60f82469d32f167a0762f10b9fe532dc 0 1750331608000 6 connected --- 集群状态信息 --- cluster_state:ok cluster_slots_assigned:16384 cluster_slots_ok:16384 cluster_slots_pfail:0 cluster_slots_fail:0 cluster_known_nodes:6 cluster_size:3 cluster_current_epoch:13 cluster_my_epoch:13 cluster_stats_messages_ping_sent:438 cluster_stats_messages_pong_sent:418 cluster_stats_messages_meet_sent:1 cluster_stats_messages_fail_sent:10 cluster_stats_messages_sent:867 cluster_stats_messages_ping_received:418 cluster_stats_messages_pong_received:437 cluster_stats_messages_fail_received:2 cluster_stats_messages_received:857 total_cluster_links_buffer_limit_exceeded:0 ========== 节点: rediscl-huzdsq-shard-fwk-0 ========== 检测到基础名称: rediscl-huzdsq-shard-fwk, 分片编号: 0 使用 Secret: rediscl-huzdsq-shard-fwk-account-default 密码获取成功，前缀: Xm... 使用Pod环境变量中的Redis端口: 6379 --- 集群节点信息 --- a5d4fc43276d727e0f162488944b68ba7c1e439d 172.31.6.202:32496@30676,rediscl-huzdsq-shard-bfc-0.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local master - 0 1750331614000 13 connected 0-1364 5461-8192 10923-12287 6805dfae60f82469d32f167a0762f10b9fe532dc 172.31.15.205:30964@30479,rediscl-huzdsq-shard-fwk-0.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local myself,master - 0 1750331614000 6 connected 1365-5460 8193-9557 566610eaebef8ad78e4fa9a8957436093634de2c 172.31.15.205:31054@30545,rediscl-huzdsq-shard-tt9-1.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local slave 9a47e108282ae378589e88936924a2f36a944e1a 0 1750331614548 7 connected f1e5ba6810221fd9b7af42fc1ff2907eaed2b142 172.31.10.241:31209@30928,rediscl-huzdsq-shard-fwk-1.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local slave 6805dfae60f82469d32f167a0762f10b9fe532dc 0 1750331615000 6 connected f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 172.31.9.102:32508@31084,rediscl-huzdsq-shard-bfc-1.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local slave a5d4fc43276d727e0f162488944b68ba7c1e439d 0 1750331615553 13 connected 9a47e108282ae378589e88936924a2f36a944e1a 172.31.9.102:30626@31966,rediscl-huzdsq-shard-tt9-0.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local master - 0 1750331615051 7 connected 9558-10922 12288-16383 --- 集群状态信息 --- cluster_state:ok cluster_slots_assigned:16384 cluster_slots_ok:16384 cluster_slots_pfail:0 cluster_slots_fail:0 cluster_known_nodes:6 cluster_size:3 cluster_current_epoch:13 cluster_my_epoch:6 cluster_stats_messages_ping_sent:466 cluster_stats_messages_pong_sent:472 cluster_stats_messages_meet_sent:2 cluster_stats_messages_fail_sent:17 cluster_stats_messages_sent:957 cluster_stats_messages_ping_received:469 cluster_stats_messages_pong_received:463 cluster_stats_messages_meet_received:3 cluster_stats_messages_fail_received:14 cluster_stats_messages_received:949 total_cluster_links_buffer_limit_exceeded:0 ========== 节点: rediscl-huzdsq-shard-fwk-1 ========== 检测到基础名称: rediscl-huzdsq-shard-fwk, 分片编号: 1 使用 Secret: rediscl-huzdsq-shard-fwk-account-default 密码获取成功，前缀: Xm... 使用Pod环境变量中的Redis端口: 6379 --- 集群节点信息 --- f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 172.31.9.102:32508@31084,rediscl-huzdsq-shard-bfc-1.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local slave a5d4fc43276d727e0f162488944b68ba7c1e439d 0 1750331622732 13 connected 566610eaebef8ad78e4fa9a8957436093634de2c 172.31.15.205:31054@30545,rediscl-huzdsq-shard-tt9-1.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local slave 9a47e108282ae378589e88936924a2f36a944e1a 0 1750331621523 7 connected f1e5ba6810221fd9b7af42fc1ff2907eaed2b142 172.31.10.241:31209@30928,rediscl-huzdsq-shard-fwk-1.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local myself,slave 6805dfae60f82469d32f167a0762f10b9fe532dc 0 1750331621000 6 connected 9a47e108282ae378589e88936924a2f36a944e1a 172.31.9.102:30626@31966,rediscl-huzdsq-shard-tt9-0.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local master - 0 1750331622531 7 connected 9558-10922 12288-16383 a5d4fc43276d727e0f162488944b68ba7c1e439d 172.31.6.202:32496@30676,rediscl-huzdsq-shard-bfc-0.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local master - 0 1750331621000 13 connected 0-1364 5461-8192 10923-12287 6805dfae60f82469d32f167a0762f10b9fe532dc 172.31.15.205:30964@30479,rediscl-huzdsq-shard-fwk-0.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local master - 0 1750331622000 6 connected 1365-5460 8193-9557 --- 集群状态信息 --- cluster_state:ok cluster_slots_assigned:16384 cluster_slots_ok:16384 cluster_slots_pfail:0 cluster_slots_fail:0 cluster_known_nodes:6 cluster_size:3 cluster_current_epoch:13 cluster_my_epoch:6 cluster_stats_messages_ping_sent:459 cluster_stats_messages_pong_sent:457 cluster_stats_messages_meet_sent:1 cluster_stats_messages_fail_sent:10 cluster_stats_messages_sent:927 cluster_stats_messages_ping_received:457 cluster_stats_messages_pong_received:458 cluster_stats_messages_fail_received:1 cluster_stats_messages_received:916 total_cluster_links_buffer_limit_exceeded:0 ========== 节点: rediscl-huzdsq-shard-tt9-0 ========== 检测到基础名称: rediscl-huzdsq-shard-tt9, 分片编号: 0 使用 Secret: rediscl-huzdsq-shard-tt9-account-default 密码获取成功，前缀: Xm... 使用Pod环境变量中的Redis端口: 6379 --- 集群节点信息 --- f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 172.31.9.102:32508@31084,rediscl-huzdsq-shard-bfc-1.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local slave a5d4fc43276d727e0f162488944b68ba7c1e439d 0 1750331628000 13 connected a5d4fc43276d727e0f162488944b68ba7c1e439d 172.31.6.202:32496@30676,rediscl-huzdsq-shard-bfc-0.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local master - 0 1750331628567 13 connected 0-1364 5461-8192 10923-12287 566610eaebef8ad78e4fa9a8957436093634de2c 172.31.15.205:31054@30545,rediscl-huzdsq-shard-tt9-1.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local slave 9a47e108282ae378589e88936924a2f36a944e1a 0 1750331628467 7 connected 6805dfae60f82469d32f167a0762f10b9fe532dc 172.31.15.205:30964@30479,rediscl-huzdsq-shard-fwk-0.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local master - 0 1750331628000 6 connected 1365-5460 8193-9557 9a47e108282ae378589e88936924a2f36a944e1a 172.31.9.102:30626@31966,rediscl-huzdsq-shard-tt9-0.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local myself,master - 0 1750331627000 7 connected 9558-10922 12288-16383 f1e5ba6810221fd9b7af42fc1ff2907eaed2b142 172.31.10.241:31209@30928,rediscl-huzdsq-shard-fwk-1.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local slave 6805dfae60f82469d32f167a0762f10b9fe532dc 0 1750331628969 6 connected --- 集群状态信息 --- cluster_state:ok cluster_slots_assigned:16384 cluster_slots_ok:16384 cluster_slots_pfail:0 cluster_slots_fail:0 cluster_known_nodes:6 cluster_size:3 cluster_current_epoch:13 cluster_my_epoch:7 cluster_stats_messages_ping_sent:490 cluster_stats_messages_pong_sent:479 cluster_stats_messages_meet_sent:2 cluster_stats_messages_fail_sent:20 cluster_stats_messages_sent:991 cluster_stats_messages_ping_received:476 cluster_stats_messages_pong_received:487 cluster_stats_messages_meet_received:3 cluster_stats_messages_fail_received:6 cluster_stats_messages_received:972 total_cluster_links_buffer_limit_exceeded:0 ========== 节点: rediscl-huzdsq-shard-tt9-1 ========== 检测到基础名称: rediscl-huzdsq-shard-tt9, 分片编号: 1 使用 Secret: rediscl-huzdsq-shard-tt9-account-default 密码获取成功，前缀: Xm... 使用Pod环境变量中的Redis端口: 6379 --- 集群节点信息 --- 9a47e108282ae378589e88936924a2f36a944e1a 172.31.9.102:30626@31966,rediscl-huzdsq-shard-tt9-0.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local master - 0 1750331636173 7 connected 9558-10922 12288-16383 566610eaebef8ad78e4fa9a8957436093634de2c 172.31.15.205:31054@30545,rediscl-huzdsq-shard-tt9-1.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local myself,slave 9a47e108282ae378589e88936924a2f36a944e1a 0 1750331635000 7 connected 6805dfae60f82469d32f167a0762f10b9fe532dc 172.31.15.205:30964@30479,rediscl-huzdsq-shard-fwk-0.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local master - 0 1750331634000 6 connected 1365-5460 8193-9557 f1e5ba6810221fd9b7af42fc1ff2907eaed2b142 172.31.10.241:31209@30928,rediscl-huzdsq-shard-fwk-1.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local slave 6805dfae60f82469d32f167a0762f10b9fe532dc 0 1750331635000 6 connected a5d4fc43276d727e0f162488944b68ba7c1e439d 172.31.6.202:32496@30676,rediscl-huzdsq-shard-bfc-0.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local master - 0 1750331635167 13 connected 0-1364 5461-8192 10923-12287 f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 172.31.9.102:32508@31084,rediscl-huzdsq-shard-bfc-1.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local slave a5d4fc43276d727e0f162488944b68ba7c1e439d 0 1750331635670 13 connected --- 集群状态信息 --- cluster_state:ok cluster_slots_assigned:16384 cluster_slots_ok:16384 cluster_slots_pfail:0 cluster_slots_fail:0 cluster_known_nodes:6 cluster_size:3 cluster_current_epoch:13 cluster_my_epoch:7 cluster_stats_messages_ping_sent:489 cluster_stats_messages_pong_sent:469 cluster_stats_messages_meet_sent:1 cluster_stats_messages_fail_sent:10 cluster_stats_messages_sent:969 cluster_stats_messages_ping_received:469 cluster_stats_messages_pong_received:488 cluster_stats_messages_received:957 total_cluster_links_buffer_limit_exceeded:0 ========== 集群健康分析 ========== 使用节点 rediscl-huzdsq-shard-bfc-0 作为参考基准 检测到以下分片标识符: - bfc - fwk - tt9 参考节点观察到的拓扑结构: ID IP地址 状态 主节点ID 槽位 ---------------------------------------- ------------- ---------------- ---------------------------------------- -------------- 9a47e108282ae378589e88936924a2f36a944e1a 172.31.9.102:30626 主节点 - 9558-10922 12288-16383 (共 0 个槽位) 6805dfae60f82469d32f167a0762f10b9fe532dc 172.31.15.205:30964 主节点 - 1365-5460 8193-9557 (共 0 个槽位) f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 172.31.9.102:32508 从节点 a5d4fc43276d727e0f162488944b68ba7c1e439d f1e5ba6810221fd9b7af42fc1ff2907eaed2b142 172.31.10.241:31209 从节点 6805dfae60f82469d32f167a0762f10b9fe532dc a5d4fc43276d727e0f162488944b68ba7c1e439d 172.31.6.202:32496 主节点 - 0-1364 5461-8192 10923-12287 (共 0 个槽位) 566610eaebef8ad78e4fa9a8957436093634de2c 172.31.15.205:31054 从节点 9a47e108282ae378589e88936924a2f36a944e1a 正在分析节点 rediscl-huzdsq-shard-bfc-1 的拓扑视图... 正在分析节点 rediscl-huzdsq-shard-fwk-0 的拓扑视图... 正在分析节点 rediscl-huzdsq-shard-fwk-1 的拓扑视图... 正在分析节点 rediscl-huzdsq-shard-tt9-0 的拓扑视图... 正在分析节点 rediscl-huzdsq-shard-tt9-1 的拓扑视图... 槽位分配统计: - 总槽位数: 16384 - 未覆盖槽位数: 0 - 重复覆盖槽位数: 0 - 正确覆盖槽位数: 16384 主节点槽位分配明细: 节点 9a47e108282ae378589e88936924a2f36a944e1a (172.31.9.102:30626) 负责 0 个槽位: 9558-10922 12288-16383 节点 6805dfae60f82469d32f167a0762f10b9fe532dc (172.31.15.205:30964) 负责 0 个槽位: 1365-5460 8193-9557 节点 a5d4fc43276d727e0f162488944b68ba7c1e439d (172.31.6.202:32496) 负责 0 个槽位: 0-1364 5461-8192 10923-12287 总计分配槽位: 0 / 16384 警告: 分配的总槽位数 (0) 不等于 16384 缺少 16384 个槽位分配 分片分析: 分片 bfc: 1 个主节点, 1 个从节点 ✅ 分片 fwk: 1 个主节点, 1 个从节点 ✅ 分片 tt9: 1 个主节点, 1 个从节点 ✅ 集群分析总结: - 检测到 3 个主节点和 3 个从节点 - 检测到 0 个故障或疑似故障节点 - 集群状态统一显示为OK: 是 - 所有槽位正确分配: 是 - 所有节点看到一致的集群大小: 是 - 所有节点看到一致的拓扑结构: 是 - 所有槽位被正确覆盖: 是 - 集群中无故障或疑似故障节点: 是 集群健康状态: 健康 ✅ 所有检查均通过，Redis集群运行正常。 analyze cluster health success No resources found in rediscl-huzdsq namespace. check ops status `kbcli cluster list-ops rediscl-huzdsq --status all --namespace ns-xqred ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME rediscl-huzdsq-volumeexpansion-c9wdn ns-xqred VolumeExpansion rediscl-huzdsq shard Succeed 6/6 Jun 19,2025 19:11 UTC+0800 check ops status done ops_status:rediscl-huzdsq-volumeexpansion-c9wdn ns-xqred VolumeExpansion rediscl-huzdsq shard Succeed 6/6 Jun 19,2025 19:11 UTC+0800 `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge opsrequests rediscl-huzdsq-volumeexpansion-c9wdn --namespace ns-xqred ` opsrequest.apps.kubeblocks.io/rediscl-huzdsq-volumeexpansion-c9wdn patched `kbcli cluster delete-ops --name rediscl-huzdsq-volumeexpansion-c9wdn --force --auto-approve --namespace ns-xqred ` OpsRequest rediscl-huzdsq-volumeexpansion-c9wdn deleted test failover drainnode check node drain check node drain success kubectl get pod rediscl-huzdsq-shard-bfc-0 --namespace ns-xqred -o jsonpath='***.spec.nodeName***' get node name:ip-172-31-6-202.us-west-2.compute.internal success check if multiple pods are on the same node kubectl get pod rediscl-huzdsq-shard-bfc-1 --namespace ns-xqred -o jsonpath='***.spec.nodeName***' get node name:ip-172-31-9-102.us-west-2.compute.internal success kubectl drain ip-172-31-6-202.us-west-2.compute.internal --delete-emptydir-data --ignore-daemonsets --force --grace-period 0 --timeout 60s node/ip-172-31-6-202.us-west-2.compute.internal cordoned Warning: ignoring DaemonSet-managed Pods: chaos-mesh/chaos-daemon-g45kb, kb-devqu/kb-addon-apecloud-otel-collector-zpkq9, kube-system/aws-node-ng8pv, kube-system/ebs-csi-node-bzmn9, kube-system/kube-proxy-r5fjx evicting pod ns-xqred/rediscl-huzdsq-shard-bfc-0 evicting pod kube-system/coredns-5449774944-n5fcv pod/coredns-5449774944-n5fcv evicted pod/rediscl-huzdsq-shard-bfc-0 evicted node/ip-172-31-6-202.us-west-2.compute.internal drained kubectl uncordon ip-172-31-6-202.us-west-2.compute.internal node/ip-172-31-6-202.us-west-2.compute.internal uncordoned check cluster status `kbcli cluster list rediscl-huzdsq --show-labels --namespace ns-xqred ` NAME NAMESPACE CLUSTER-DEFINITION VERSION TERMINATION-POLICY STATUS CREATED-TIME LABELS rediscl-huzdsq ns-xqred Halt Running Jun 19,2025 18:15 UTC+0800 app.kubernetes.io/instance=rediscl-huzdsq check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances rediscl-huzdsq --namespace ns-xqred ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME rediscl-huzdsq-shard-bfc-0 ns-xqred rediscl-huzdsq shard-bfc Running secondary us-west-2a 200m / 200m 644245094400m / 644245094400m ip-172-31-5-137.us-west-2.compute.internal/172.31.5.137 Jun 19,2025 19:15 UTC+0800 rediscl-huzdsq-shard-bfc-1 ns-xqred rediscl-huzdsq shard-bfc Running primary us-west-2a 200m / 200m 644245094400m / 644245094400m ip-172-31-9-102.us-west-2.compute.internal/172.31.9.102 Jun 19,2025 19:09 UTC+0800 rediscl-huzdsq-shard-fwk-0 ns-xqred rediscl-huzdsq shard-fwk Running primary us-west-2a 200m / 200m 644245094400m / 644245094400m ip-172-31-15-205.us-west-2.compute.internal/172.31.15.205 Jun 19,2025 19:09 UTC+0800 rediscl-huzdsq-shard-fwk-1 ns-xqred rediscl-huzdsq shard-fwk Running secondary us-west-2a 200m / 200m 644245094400m / 644245094400m ip-172-31-10-241.us-west-2.compute.internal/172.31.10.241 Jun 19,2025 19:09 UTC+0800 rediscl-huzdsq-shard-tt9-0 ns-xqred rediscl-huzdsq shard-tt9 Running primary us-west-2a 200m / 200m 644245094400m / 644245094400m ip-172-31-9-102.us-west-2.compute.internal/172.31.9.102 Jun 19,2025 19:09 UTC+0800 rediscl-huzdsq-shard-tt9-1 ns-xqred rediscl-huzdsq shard-tt9 Running secondary us-west-2a 200m / 200m 644245094400m / 644245094400m ip-172-31-15-205.us-west-2.compute.internal/172.31.15.205 Jun 19,2025 19:09 UTC+0800 check pod status done check cluster role check cluster role done primary: rediscl-huzdsq-shard-bfc-1 rediscl-huzdsq-shard-fwk-0 rediscl-huzdsq-shard-tt9-0;secondary: rediscl-huzdsq-shard-bfc-0 rediscl-huzdsq-shard-fwk-1 rediscl-huzdsq-shard-tt9-1 analyze cluster health check cluster connect `` ========== 节点: rediscl-huzdsq-shard-bfc-0 ========== 检测到基础名称: rediscl-huzdsq-shard-bfc, 分片编号: 0 使用 Secret: rediscl-huzdsq-shard-bfc-account-default 密码获取成功，前缀: Xm... 使用Pod环境变量中的Redis端口: 6379 --- 集群节点信息 --- 566610eaebef8ad78e4fa9a8957436093634de2c 172.31.15.205:31054@30545,rediscl-huzdsq-shard-tt9-1.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local slave 9a47e108282ae378589e88936924a2f36a944e1a 0 1750331790572 7 connected a5d4fc43276d727e0f162488944b68ba7c1e439d 172.31.5.137:32496@30676,rediscl-huzdsq-shard-bfc-0.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local myself,slave f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 0 1750331789000 14 connected f1e5ba6810221fd9b7af42fc1ff2907eaed2b142 172.31.10.241:31209@30928,rediscl-huzdsq-shard-fwk-1.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local slave 6805dfae60f82469d32f167a0762f10b9fe532dc 0 1750331791000 6 connected 9a47e108282ae378589e88936924a2f36a944e1a 172.31.9.102:30626@31966,rediscl-huzdsq-shard-tt9-0.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local master - 0 1750331790000 7 connected 9558-10922 12288-16383 6805dfae60f82469d32f167a0762f10b9fe532dc 172.31.15.205:30964@30479,rediscl-huzdsq-shard-fwk-0.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local master - 0 1750331790974 6 connected 1365-5460 8193-9557 f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 172.31.9.102:32508@31084,rediscl-huzdsq-shard-bfc-1.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local master - 0 1750331790572 14 connected 0-1364 5461-8192 10923-12287 --- 集群状态信息 --- cluster_state:ok cluster_slots_assigned:16384 cluster_slots_ok:16384 cluster_slots_pfail:0 cluster_slots_fail:0 cluster_known_nodes:6 cluster_size:3 cluster_current_epoch:14 cluster_my_epoch:14 cluster_stats_messages_ping_sent:111 cluster_stats_messages_pong_sent:100 cluster_stats_messages_meet_sent:1 cluster_stats_messages_sent:212 cluster_stats_messages_ping_received:99 cluster_stats_messages_pong_received:112 cluster_stats_messages_meet_received:1 cluster_stats_messages_received:212 total_cluster_links_buffer_limit_exceeded:0 ========== 节点: rediscl-huzdsq-shard-bfc-1 ========== 检测到基础名称: rediscl-huzdsq-shard-bfc, 分片编号: 1 使用 Secret: rediscl-huzdsq-shard-bfc-account-default 密码获取成功，前缀: Xm... 使用Pod环境变量中的Redis端口: 6379 --- 集群节点信息 --- 566610eaebef8ad78e4fa9a8957436093634de2c 172.31.15.205:31054@30545,rediscl-huzdsq-shard-tt9-1.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local slave 9a47e108282ae378589e88936924a2f36a944e1a 0 1750331797906 7 connected a5d4fc43276d727e0f162488944b68ba7c1e439d 172.31.5.137:32496@30676,rediscl-huzdsq-shard-bfc-0.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local slave f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 0 1750331797000 14 connected 9a47e108282ae378589e88936924a2f36a944e1a 172.31.9.102:30626@31966,rediscl-huzdsq-shard-tt9-0.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local master - 0 1750331796000 7 connected 9558-10922 12288-16383 f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 172.31.9.102:32508@31084,rediscl-huzdsq-shard-bfc-1.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local myself,master - 0 1750331795000 14 connected 0-1364 5461-8192 10923-12287 6805dfae60f82469d32f167a0762f10b9fe532dc 172.31.15.205:30964@30479,rediscl-huzdsq-shard-fwk-0.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local master - 0 1750331796900 6 connected 1365-5460 8193-9557 f1e5ba6810221fd9b7af42fc1ff2907eaed2b142 172.31.10.241:31209@30928,rediscl-huzdsq-shard-fwk-1.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local slave 6805dfae60f82469d32f167a0762f10b9fe532dc 0 1750331796598 6 connected --- 集群状态信息 --- cluster_state:ok cluster_slots_assigned:16384 cluster_slots_ok:16384 cluster_slots_pfail:0 cluster_slots_fail:0 cluster_known_nodes:6 cluster_size:3 cluster_current_epoch:14 cluster_my_epoch:14 cluster_stats_messages_ping_sent:772 cluster_stats_messages_pong_sent:768 cluster_stats_messages_meet_sent:1 cluster_stats_messages_fail_sent:10 cluster_stats_messages_auth-req_sent:5 cluster_stats_messages_sent:1556 cluster_stats_messages_ping_received:763 cluster_stats_messages_pong_received:770 cluster_stats_messages_fail_received:4 cluster_stats_messages_auth-ack_received:2 cluster_stats_messages_received:1539 total_cluster_links_buffer_limit_exceeded:0 ========== 节点: rediscl-huzdsq-shard-fwk-0 ========== 检测到基础名称: rediscl-huzdsq-shard-fwk, 分片编号: 0 使用 Secret: rediscl-huzdsq-shard-fwk-account-default 密码获取成功，前缀: Xm... 使用Pod环境变量中的Redis端口: 6379 --- 集群节点信息 --- a5d4fc43276d727e0f162488944b68ba7c1e439d 172.31.5.137:32496@30676,rediscl-huzdsq-shard-bfc-0.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local slave f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 0 1750331804000 14 connected 6805dfae60f82469d32f167a0762f10b9fe532dc 172.31.15.205:30964@30479,rediscl-huzdsq-shard-fwk-0.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local myself,master - 0 1750331803000 6 connected 1365-5460 8193-9557 566610eaebef8ad78e4fa9a8957436093634de2c 172.31.15.205:31054@30545,rediscl-huzdsq-shard-tt9-1.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local slave 9a47e108282ae378589e88936924a2f36a944e1a 0 1750331804000 7 connected f1e5ba6810221fd9b7af42fc1ff2907eaed2b142 172.31.10.241:31209@30928,rediscl-huzdsq-shard-fwk-1.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local slave 6805dfae60f82469d32f167a0762f10b9fe532dc 0 1750331804000 6 connected f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 172.31.9.102:32508@31084,rediscl-huzdsq-shard-bfc-1.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local master - 0 1750331804547 14 connected 0-1364 5461-8192 10923-12287 9a47e108282ae378589e88936924a2f36a944e1a 172.31.9.102:30626@31966,rediscl-huzdsq-shard-tt9-0.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local master - 0 1750331803543 7 connected 9558-10922 12288-16383 --- 集群状态信息 --- cluster_state:ok cluster_slots_assigned:16384 cluster_slots_ok:16384 cluster_slots_pfail:0 cluster_slots_fail:0 cluster_known_nodes:6 cluster_size:3 cluster_current_epoch:14 cluster_my_epoch:6 cluster_stats_messages_ping_sent:806 cluster_stats_messages_pong_sent:817 cluster_stats_messages_meet_sent:2 cluster_stats_messages_fail_sent:22 cluster_stats_messages_auth-ack_sent:1 cluster_stats_messages_sent:1648 cluster_stats_messages_ping_received:814 cluster_stats_messages_pong_received:803 cluster_stats_messages_meet_received:3 cluster_stats_messages_fail_received:15 cluster_stats_messages_auth-req_received:1 cluster_stats_messages_received:1636 total_cluster_links_buffer_limit_exceeded:0 ========== 节点: rediscl-huzdsq-shard-fwk-1 ========== 检测到基础名称: rediscl-huzdsq-shard-fwk, 分片编号: 1 使用 Secret: rediscl-huzdsq-shard-fwk-account-default 密码获取成功，前缀: Xm... 使用Pod环境变量中的Redis端口: 6379 --- 集群节点信息 --- f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 172.31.9.102:32508@31084,rediscl-huzdsq-shard-bfc-1.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local master - 0 1750331809770 14 connected 0-1364 5461-8192 10923-12287 566610eaebef8ad78e4fa9a8957436093634de2c 172.31.15.205:31054@30545,rediscl-huzdsq-shard-tt9-1.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local slave 9a47e108282ae378589e88936924a2f36a944e1a 0 1750331810000 7 connected f1e5ba6810221fd9b7af42fc1ff2907eaed2b142 172.31.10.241:31209@30928,rediscl-huzdsq-shard-fwk-1.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local myself,slave 6805dfae60f82469d32f167a0762f10b9fe532dc 0 1750331810000 6 connected 9a47e108282ae378589e88936924a2f36a944e1a 172.31.9.102:30626@31966,rediscl-huzdsq-shard-tt9-0.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local master - 0 1750331810575 7 connected 9558-10922 12288-16383 a5d4fc43276d727e0f162488944b68ba7c1e439d 172.31.5.137:32496@30676,rediscl-huzdsq-shard-bfc-0.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local slave f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 0 1750331810072 14 connected 6805dfae60f82469d32f167a0762f10b9fe532dc 172.31.15.205:30964@30479,rediscl-huzdsq-shard-fwk-0.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local master - 0 1750331810776 6 connected 1365-5460 8193-9557 --- 集群状态信息 --- cluster_state:ok cluster_slots_assigned:16384 cluster_slots_ok:16384 cluster_slots_pfail:0 cluster_slots_fail:0 cluster_known_nodes:6 cluster_size:3 cluster_current_epoch:14 cluster_my_epoch:6 cluster_stats_messages_ping_sent:794 cluster_stats_messages_pong_sent:792 cluster_stats_messages_meet_sent:1 cluster_stats_messages_fail_sent:10 cluster_stats_messages_sent:1597 cluster_stats_messages_ping_received:792 cluster_stats_messages_pong_received:793 cluster_stats_messages_fail_received:3 cluster_stats_messages_auth-req_received:1 cluster_stats_messages_received:1589 total_cluster_links_buffer_limit_exceeded:0 ========== 节点: rediscl-huzdsq-shard-tt9-0 ========== 检测到基础名称: rediscl-huzdsq-shard-tt9, 分片编号: 0 使用 Secret: rediscl-huzdsq-shard-tt9-account-default 密码获取成功，前缀: Xm... 使用Pod环境变量中的Redis端口: 6379 --- 集群节点信息 --- f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 172.31.9.102:32508@31084,rediscl-huzdsq-shard-bfc-1.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local master - 0 1750331816280 14 connected 0-1364 5461-8192 10923-12287 a5d4fc43276d727e0f162488944b68ba7c1e439d 172.31.5.137:32496@30676,rediscl-huzdsq-shard-bfc-0.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local slave f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 0 1750331817083 14 connected 566610eaebef8ad78e4fa9a8957436093634de2c 172.31.15.205:31054@30545,rediscl-huzdsq-shard-tt9-1.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local slave 9a47e108282ae378589e88936924a2f36a944e1a 0 1750331817585 7 connected 6805dfae60f82469d32f167a0762f10b9fe532dc 172.31.15.205:30964@30479,rediscl-huzdsq-shard-fwk-0.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local master - 0 1750331816000 6 connected 1365-5460 8193-9557 9a47e108282ae378589e88936924a2f36a944e1a 172.31.9.102:30626@31966,rediscl-huzdsq-shard-tt9-0.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local myself,master - 0 1750331817000 7 connected 9558-10922 12288-16383 f1e5ba6810221fd9b7af42fc1ff2907eaed2b142 172.31.10.241:31209@30928,rediscl-huzdsq-shard-fwk-1.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local slave 6805dfae60f82469d32f167a0762f10b9fe532dc 0 1750331817283 6 connected --- 集群状态信息 --- cluster_state:ok cluster_slots_assigned:16384 cluster_slots_ok:16384 cluster_slots_pfail:0 cluster_slots_fail:0 cluster_known_nodes:6 cluster_size:3 cluster_current_epoch:14 cluster_my_epoch:7 cluster_stats_messages_ping_sent:830 cluster_stats_messages_pong_sent:822 cluster_stats_messages_meet_sent:2 cluster_stats_messages_fail_sent:25 cluster_stats_messages_auth-ack_sent:1 cluster_stats_messages_sent:1680 cluster_stats_messages_ping_received:819 cluster_stats_messages_pong_received:827 cluster_stats_messages_meet_received:3 cluster_stats_messages_fail_received:7 cluster_stats_messages_auth-req_received:1 cluster_stats_messages_received:1657 total_cluster_links_buffer_limit_exceeded:0 ========== 节点: rediscl-huzdsq-shard-tt9-1 ========== 检测到基础名称: rediscl-huzdsq-shard-tt9, 分片编号: 1 使用 Secret: rediscl-huzdsq-shard-tt9-account-default 密码获取成功，前缀: Xm... 使用Pod环境变量中的Redis端口: 6379 --- 集群节点信息 --- 9a47e108282ae378589e88936924a2f36a944e1a 172.31.9.102:30626@31966,rediscl-huzdsq-shard-tt9-0.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local master - 0 1750331822511 7 connected 9558-10922 12288-16383 566610eaebef8ad78e4fa9a8957436093634de2c 172.31.15.205:31054@30545,rediscl-huzdsq-shard-tt9-1.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local myself,slave 9a47e108282ae378589e88936924a2f36a944e1a 0 1750331823000 7 connected 6805dfae60f82469d32f167a0762f10b9fe532dc 172.31.15.205:30964@30479,rediscl-huzdsq-shard-fwk-0.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local master - 0 1750331824000 6 connected 1365-5460 8193-9557 f1e5ba6810221fd9b7af42fc1ff2907eaed2b142 172.31.10.241:31209@30928,rediscl-huzdsq-shard-fwk-1.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local slave 6805dfae60f82469d32f167a0762f10b9fe532dc 0 1750331823116 6 connected a5d4fc43276d727e0f162488944b68ba7c1e439d 172.31.5.137:32496@30676,rediscl-huzdsq-shard-bfc-0.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local slave f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 0 1750331824528 14 connected f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 172.31.9.102:32508@31084,rediscl-huzdsq-shard-bfc-1.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local master - 0 1750331824126 14 connected 0-1364 5461-8192 10923-12287 --- 集群状态信息 --- cluster_state:ok cluster_slots_assigned:16384 cluster_slots_ok:16384 cluster_slots_pfail:0 cluster_slots_fail:0 cluster_known_nodes:6 cluster_size:3 cluster_current_epoch:14 cluster_my_epoch:7 cluster_stats_messages_ping_sent:831 cluster_stats_messages_pong_sent:798 cluster_stats_messages_meet_sent:1 cluster_stats_messages_fail_sent:10 cluster_stats_messages_sent:1640 cluster_stats_messages_ping_received:798 cluster_stats_messages_pong_received:830 cluster_stats_messages_fail_received:2 cluster_stats_messages_auth-req_received:1 cluster_stats_messages_received:1631 total_cluster_links_buffer_limit_exceeded:0 ========== 集群健康分析 ========== 使用节点 rediscl-huzdsq-shard-bfc-0 作为参考基准 检测到以下分片标识符: - bfc - fwk - tt9 参考节点观察到的拓扑结构: ID IP地址 状态 主节点ID 槽位 ---------------------------------------- ------------- ---------------- ---------------------------------------- -------------- 566610eaebef8ad78e4fa9a8957436093634de2c 172.31.15.205:31054 从节点 9a47e108282ae378589e88936924a2f36a944e1a a5d4fc43276d727e0f162488944b68ba7c1e439d 172.31.5.137:32496 从节点 f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 f1e5ba6810221fd9b7af42fc1ff2907eaed2b142 172.31.10.241:31209 从节点 6805dfae60f82469d32f167a0762f10b9fe532dc 9a47e108282ae378589e88936924a2f36a944e1a 172.31.9.102:30626 主节点 - 9558-10922 12288-16383 (共 0 个槽位) 6805dfae60f82469d32f167a0762f10b9fe532dc 172.31.15.205:30964 主节点 - 1365-5460 8193-9557 (共 0 个槽位) f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 172.31.9.102:32508 主节点 - 0-1364 5461-8192 10923-12287 (共 0 个槽位) 正在分析节点 rediscl-huzdsq-shard-bfc-1 的拓扑视图... 正在分析节点 rediscl-huzdsq-shard-fwk-0 的拓扑视图... 正在分析节点 rediscl-huzdsq-shard-fwk-1 的拓扑视图... 正在分析节点 rediscl-huzdsq-shard-tt9-0 的拓扑视图... 正在分析节点 rediscl-huzdsq-shard-tt9-1 的拓扑视图... 槽位分配统计: - 总槽位数: 16384 - 未覆盖槽位数: 0 - 重复覆盖槽位数: 0 - 正确覆盖槽位数: 16384 主节点槽位分配明细: 节点 9a47e108282ae378589e88936924a2f36a944e1a (172.31.9.102:30626) 负责 0 个槽位: 9558-10922 12288-16383 节点 6805dfae60f82469d32f167a0762f10b9fe532dc (172.31.15.205:30964) 负责 0 个槽位: 1365-5460 8193-9557 节点 f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 (172.31.9.102:32508) 负责 0 个槽位: 0-1364 5461-8192 10923-12287 总计分配槽位: 0 / 16384 警告: 分配的总槽位数 (0) 不等于 16384 缺少 16384 个槽位分配 分片分析: 分片 bfc: 1 个主节点, 1 个从节点 ✅ 分片 fwk: 1 个主节点, 1 个从节点 ✅ 分片 tt9: 1 个主节点, 1 个从节点 ✅ 集群分析总结: - 检测到 3 个主节点和 3 个从节点 - 检测到 0 个故障或疑似故障节点 - 集群状态统一显示为OK: 是 - 所有槽位正确分配: 是 - 所有节点看到一致的集群大小: 是 - 所有节点看到一致的拓扑结构: 是 - 所有槽位被正确覆盖: 是 - 集群中无故障或疑似故障节点: 是 集群健康状态: 健康 ✅ 所有检查均通过，Redis集群运行正常。 analyze cluster health success check failover pod name failover pod name:rediscl-huzdsq-shard-bfc-1 failover drainnode Success test failover timeoffset check node drain check node drain success `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge TimeChaos test-chaos-mesh-timeoffset-rediscl-huzdsq --namespace ns-xqred ` Warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely. Error from server (NotFound): timechaos.chaos-mesh.org "test-chaos-mesh-timeoffset-rediscl-huzdsq" not found Error from server (NotFound): timechaos.chaos-mesh.org "test-chaos-mesh-timeoffset-rediscl-huzdsq" not found apiVersion: chaos-mesh.org/v1alpha1 kind: TimeChaos metadata: name: test-chaos-mesh-timeoffset-rediscl-huzdsq namespace: ns-xqred spec: selector: namespaces: - ns-xqred labelSelectors: apps.kubeblocks.io/pod-name: rediscl-huzdsq-shard-bfc-1 mode: all timeOffset: '-10m' clockIds: - CLOCK_REALTIME duration: 2m `kubectl apply -f test-chaos-mesh-timeoffset-rediscl-huzdsq.yaml` timechaos.chaos-mesh.org/test-chaos-mesh-timeoffset-rediscl-huzdsq created apply test-chaos-mesh-timeoffset-rediscl-huzdsq.yaml Success `rm -rf test-chaos-mesh-timeoffset-rediscl-huzdsq.yaml` timeoffset chaos test waiting 120 seconds check cluster status `kbcli cluster list rediscl-huzdsq --show-labels --namespace ns-xqred ` NAME NAMESPACE CLUSTER-DEFINITION VERSION TERMINATION-POLICY STATUS CREATED-TIME LABELS rediscl-huzdsq ns-xqred Halt Running Jun 19,2025 18:15 UTC+0800 app.kubernetes.io/instance=rediscl-huzdsq check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances rediscl-huzdsq --namespace ns-xqred ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME rediscl-huzdsq-shard-bfc-0 ns-xqred rediscl-huzdsq shard-bfc Running secondary us-west-2a 200m / 200m 644245094400m / 644245094400m ip-172-31-5-137.us-west-2.compute.internal/172.31.5.137 Jun 19,2025 19:15 UTC+0800 rediscl-huzdsq-shard-bfc-1 ns-xqred rediscl-huzdsq shard-bfc Running primary us-west-2a 200m / 200m 644245094400m / 644245094400m ip-172-31-9-102.us-west-2.compute.internal/172.31.9.102 Jun 19,2025 19:09 UTC+0800 rediscl-huzdsq-shard-fwk-0 ns-xqred rediscl-huzdsq shard-fwk Running primary us-west-2a 200m / 200m 644245094400m / 644245094400m ip-172-31-15-205.us-west-2.compute.internal/172.31.15.205 Jun 19,2025 19:09 UTC+0800 rediscl-huzdsq-shard-fwk-1 ns-xqred rediscl-huzdsq shard-fwk Running secondary us-west-2a 200m / 200m 644245094400m / 644245094400m ip-172-31-10-241.us-west-2.compute.internal/172.31.10.241 Jun 19,2025 19:09 UTC+0800 rediscl-huzdsq-shard-tt9-0 ns-xqred rediscl-huzdsq shard-tt9 Running primary us-west-2a 200m / 200m 644245094400m / 644245094400m ip-172-31-9-102.us-west-2.compute.internal/172.31.9.102 Jun 19,2025 19:09 UTC+0800 rediscl-huzdsq-shard-tt9-1 ns-xqred rediscl-huzdsq shard-tt9 Running secondary us-west-2a 200m / 200m 644245094400m / 644245094400m ip-172-31-15-205.us-west-2.compute.internal/172.31.15.205 Jun 19,2025 19:09 UTC+0800 check pod status done check cluster role check cluster role done primary: rediscl-huzdsq-shard-bfc-1 rediscl-huzdsq-shard-fwk-0 rediscl-huzdsq-shard-tt9-0;secondary: rediscl-huzdsq-shard-bfc-0 rediscl-huzdsq-shard-fwk-1 rediscl-huzdsq-shard-tt9-1 analyze cluster health check cluster connect `` ========== 节点: rediscl-huzdsq-shard-bfc-0 ========== 检测到基础名称: rediscl-huzdsq-shard-bfc, 分片编号: 0 使用 Secret: rediscl-huzdsq-shard-bfc-account-default 密码获取成功，前缀: Xm... 使用Pod环境变量中的Redis端口: 6379 --- 集群节点信息 --- 566610eaebef8ad78e4fa9a8957436093634de2c 172.31.15.205:31054@30545,rediscl-huzdsq-shard-tt9-1.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local slave 9a47e108282ae378589e88936924a2f36a944e1a 0 1750332039000 7 connected a5d4fc43276d727e0f162488944b68ba7c1e439d 172.31.5.137:32496@30676,rediscl-huzdsq-shard-bfc-0.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local myself,slave f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 0 1750332038000 14 connected f1e5ba6810221fd9b7af42fc1ff2907eaed2b142 172.31.10.241:31209@30928,rediscl-huzdsq-shard-fwk-1.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local slave 6805dfae60f82469d32f167a0762f10b9fe532dc 0 1750332040264 6 connected 9a47e108282ae378589e88936924a2f36a944e1a 172.31.9.102:30626@31966,rediscl-huzdsq-shard-tt9-0.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local master - 0 1750332039000 7 connected 9558-10922 12288-16383 6805dfae60f82469d32f167a0762f10b9fe532dc 172.31.15.205:30964@30479,rediscl-huzdsq-shard-fwk-0.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local master - 0 1750332039257 6 connected 1365-5460 8193-9557 f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 172.31.9.102:32508@31084,rediscl-huzdsq-shard-bfc-1.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local master - 0 1750332039000 14 connected 0-1364 5461-8192 10923-12287 --- 集群状态信息 --- cluster_state:ok cluster_slots_assigned:16384 cluster_slots_ok:16384 cluster_slots_pfail:0 cluster_slots_fail:0 cluster_known_nodes:6 cluster_size:3 cluster_current_epoch:14 cluster_my_epoch:14 cluster_stats_messages_ping_sent:555 cluster_stats_messages_pong_sent:519 cluster_stats_messages_meet_sent:1 cluster_stats_messages_sent:1075 cluster_stats_messages_ping_received:518 cluster_stats_messages_pong_received:556 cluster_stats_messages_meet_received:1 cluster_stats_messages_received:1075 total_cluster_links_buffer_limit_exceeded:0 ========== 节点: rediscl-huzdsq-shard-bfc-1 ========== 检测到基础名称: rediscl-huzdsq-shard-bfc, 分片编号: 1 使用 Secret: rediscl-huzdsq-shard-bfc-account-default 密码获取成功，前缀: Xm... 使用Pod环境变量中的Redis端口: 6379 --- 集群节点信息 --- 566610eaebef8ad78e4fa9a8957436093634de2c 172.31.15.205:31054@30545,rediscl-huzdsq-shard-tt9-1.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local slave 9a47e108282ae378589e88936924a2f36a944e1a 0 1750332046102 7 connected a5d4fc43276d727e0f162488944b68ba7c1e439d 172.31.5.137:32496@30676,rediscl-huzdsq-shard-bfc-0.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local slave f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 0 1750332047108 14 connected 9a47e108282ae378589e88936924a2f36a944e1a 172.31.9.102:30626@31966,rediscl-huzdsq-shard-tt9-0.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local master - 0 1750332046000 7 connected 9558-10922 12288-16383 f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 172.31.9.102:32508@31084,rediscl-huzdsq-shard-bfc-1.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local myself,master - 0 1750332046000 14 connected 0-1364 5461-8192 10923-12287 6805dfae60f82469d32f167a0762f10b9fe532dc 172.31.15.205:30964@30479,rediscl-huzdsq-shard-fwk-0.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local master - 0 1750332045098 6 connected 1365-5460 8193-9557 f1e5ba6810221fd9b7af42fc1ff2907eaed2b142 172.31.10.241:31209@30928,rediscl-huzdsq-shard-fwk-1.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local slave 6805dfae60f82469d32f167a0762f10b9fe532dc 0 1750332045599 6 connected --- 集群状态信息 --- cluster_state:ok cluster_slots_assigned:16384 cluster_slots_ok:16384 cluster_slots_pfail:0 cluster_slots_fail:0 cluster_known_nodes:6 cluster_size:3 cluster_current_epoch:14 cluster_my_epoch:14 cluster_stats_messages_ping_sent:1187 cluster_stats_messages_pong_sent:1210 cluster_stats_messages_meet_sent:1 cluster_stats_messages_fail_sent:10 cluster_stats_messages_auth-req_sent:5 cluster_stats_messages_sent:2413 cluster_stats_messages_ping_received:1205 cluster_stats_messages_pong_received:1185 cluster_stats_messages_fail_received:4 cluster_stats_messages_auth-ack_received:2 cluster_stats_messages_received:2396 total_cluster_links_buffer_limit_exceeded:0 ========== 节点: rediscl-huzdsq-shard-fwk-0 ========== 检测到基础名称: rediscl-huzdsq-shard-fwk, 分片编号: 0 使用 Secret: rediscl-huzdsq-shard-fwk-account-default 密码获取成功，前缀: Xm... 使用Pod环境变量中的Redis端口: 6379 --- 集群节点信息 --- a5d4fc43276d727e0f162488944b68ba7c1e439d 172.31.5.137:32496@30676,rediscl-huzdsq-shard-bfc-0.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local slave f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 0 1750332052902 14 connected 6805dfae60f82469d32f167a0762f10b9fe532dc 172.31.15.205:30964@30479,rediscl-huzdsq-shard-fwk-0.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local myself,master - 0 1750332053000 6 connected 1365-5460 8193-9557 566610eaebef8ad78e4fa9a8957436093634de2c 172.31.15.205:31054@30545,rediscl-huzdsq-shard-tt9-1.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local slave 9a47e108282ae378589e88936924a2f36a944e1a 0 1750332052600 7 connected f1e5ba6810221fd9b7af42fc1ff2907eaed2b142 172.31.10.241:31209@30928,rediscl-huzdsq-shard-fwk-1.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local slave 6805dfae60f82469d32f167a0762f10b9fe532dc 0 1750332052600 6 connected f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 172.31.9.102:32508@31084,rediscl-huzdsq-shard-bfc-1.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local master - 0 1750332053907 14 connected 0-1364 5461-8192 10923-12287 9a47e108282ae378589e88936924a2f36a944e1a 172.31.9.102:30626@31966,rediscl-huzdsq-shard-tt9-0.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local master - 0 1750332052000 7 connected 9558-10922 12288-16383 --- 集群状态信息 --- cluster_state:ok cluster_slots_assigned:16384 cluster_slots_ok:16384 cluster_slots_pfail:0 cluster_slots_fail:0 cluster_known_nodes:6 cluster_size:3 cluster_current_epoch:14 cluster_my_epoch:6 cluster_stats_messages_ping_sent:1267 cluster_stats_messages_pong_sent:1287 cluster_stats_messages_meet_sent:2 cluster_stats_messages_fail_sent:22 cluster_stats_messages_auth-ack_sent:1 cluster_stats_messages_sent:2579 cluster_stats_messages_ping_received:1284 cluster_stats_messages_pong_received:1264 cluster_stats_messages_meet_received:3 cluster_stats_messages_fail_received:15 cluster_stats_messages_auth-req_received:1 cluster_stats_messages_received:2567 total_cluster_links_buffer_limit_exceeded:0 ========== 节点: rediscl-huzdsq-shard-fwk-1 ========== 检测到基础名称: rediscl-huzdsq-shard-fwk, 分片编号: 1 使用 Secret: rediscl-huzdsq-shard-fwk-account-default 密码获取成功，前缀: Xm... 使用Pod环境变量中的Redis端口: 6379 --- 集群节点信息 --- f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 172.31.9.102:32508@31084,rediscl-huzdsq-shard-bfc-1.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local master - 0 1750332060110 14 connected 0-1364 5461-8192 10923-12287 566610eaebef8ad78e4fa9a8957436093634de2c 172.31.15.205:31054@30545,rediscl-huzdsq-shard-tt9-1.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local slave 9a47e108282ae378589e88936924a2f36a944e1a 0 1750332060000 7 connected f1e5ba6810221fd9b7af42fc1ff2907eaed2b142 172.31.10.241:31209@30928,rediscl-huzdsq-shard-fwk-1.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local myself,slave 6805dfae60f82469d32f167a0762f10b9fe532dc 0 1750332059000 6 connected 9a47e108282ae378589e88936924a2f36a944e1a 172.31.9.102:30626@31966,rediscl-huzdsq-shard-tt9-0.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local master - 0 1750332059606 7 connected 9558-10922 12288-16383 a5d4fc43276d727e0f162488944b68ba7c1e439d 172.31.5.137:32496@30676,rediscl-huzdsq-shard-bfc-0.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local slave f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 0 1750332058101 14 connected 6805dfae60f82469d32f167a0762f10b9fe532dc 172.31.15.205:30964@30479,rediscl-huzdsq-shard-fwk-0.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local master - 0 1750332059105 6 connected 1365-5460 8193-9557 --- 集群状态信息 --- cluster_state:ok cluster_slots_assigned:16384 cluster_slots_ok:16384 cluster_slots_pfail:0 cluster_slots_fail:0 cluster_known_nodes:6 cluster_size:3 cluster_current_epoch:14 cluster_my_epoch:6 cluster_stats_messages_ping_sent:1257 cluster_stats_messages_pong_sent:1259 cluster_stats_messages_meet_sent:1 cluster_stats_messages_fail_sent:10 cluster_stats_messages_sent:2527 cluster_stats_messages_ping_received:1259 cluster_stats_messages_pong_received:1256 cluster_stats_messages_fail_received:3 cluster_stats_messages_auth-req_received:1 cluster_stats_messages_received:2519 total_cluster_links_buffer_limit_exceeded:0 ========== 节点: rediscl-huzdsq-shard-tt9-0 ========== 检测到基础名称: rediscl-huzdsq-shard-tt9, 分片编号: 0 使用 Secret: rediscl-huzdsq-shard-tt9-account-default 密码获取成功，前缀: Xm... 使用Pod环境变量中的Redis端口: 6379 --- 集群节点信息 --- f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 172.31.9.102:32508@31084,rediscl-huzdsq-shard-bfc-1.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local master - 0 1750332065556 14 connected 0-1364 5461-8192 10923-12287 a5d4fc43276d727e0f162488944b68ba7c1e439d 172.31.5.137:32496@30676,rediscl-huzdsq-shard-bfc-0.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local slave f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 0 1750332065356 14 connected 566610eaebef8ad78e4fa9a8957436093634de2c 172.31.15.205:31054@30545,rediscl-huzdsq-shard-tt9-1.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local slave 9a47e108282ae378589e88936924a2f36a944e1a 0 1750332066000 7 connected 6805dfae60f82469d32f167a0762f10b9fe532dc 172.31.15.205:30964@30479,rediscl-huzdsq-shard-fwk-0.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local master - 0 1750332066362 6 connected 1365-5460 8193-9557 9a47e108282ae378589e88936924a2f36a944e1a 172.31.9.102:30626@31966,rediscl-huzdsq-shard-tt9-0.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local myself,master - 0 1750332064000 7 connected 9558-10922 12288-16383 f1e5ba6810221fd9b7af42fc1ff2907eaed2b142 172.31.10.241:31209@30928,rediscl-huzdsq-shard-fwk-1.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local slave 6805dfae60f82469d32f167a0762f10b9fe532dc 0 1750332065055 6 connected --- 集群状态信息 --- cluster_state:ok cluster_slots_assigned:16384 cluster_slots_ok:16384 cluster_slots_pfail:0 cluster_slots_fail:0 cluster_known_nodes:6 cluster_size:3 cluster_current_epoch:14 cluster_my_epoch:7 cluster_stats_messages_ping_sent:1277 cluster_stats_messages_pong_sent:1240 cluster_stats_messages_meet_sent:2 cluster_stats_messages_fail_sent:25 cluster_stats_messages_auth-ack_sent:1 cluster_stats_messages_sent:2545 cluster_stats_messages_ping_received:1237 cluster_stats_messages_pong_received:1274 cluster_stats_messages_meet_received:3 cluster_stats_messages_fail_received:7 cluster_stats_messages_auth-req_received:1 cluster_stats_messages_received:2522 total_cluster_links_buffer_limit_exceeded:0 ========== 节点: rediscl-huzdsq-shard-tt9-1 ========== 检测到基础名称: rediscl-huzdsq-shard-tt9, 分片编号: 1 使用 Secret: rediscl-huzdsq-shard-tt9-account-default 密码获取成功，前缀: Xm... 使用Pod环境变量中的Redis端口: 6379 --- 集群节点信息 --- 9a47e108282ae378589e88936924a2f36a944e1a 172.31.9.102:30626@31966,rediscl-huzdsq-shard-tt9-0.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local master - 0 1750332072000 7 connected 9558-10922 12288-16383 566610eaebef8ad78e4fa9a8957436093634de2c 172.31.15.205:31054@30545,rediscl-huzdsq-shard-tt9-1.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local myself,slave 9a47e108282ae378589e88936924a2f36a944e1a 0 1750332071000 7 connected 6805dfae60f82469d32f167a0762f10b9fe532dc 172.31.15.205:30964@30479,rediscl-huzdsq-shard-fwk-0.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local master - 0 1750332071924 6 connected 1365-5460 8193-9557 f1e5ba6810221fd9b7af42fc1ff2907eaed2b142 172.31.10.241:31209@30928,rediscl-huzdsq-shard-fwk-1.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local slave 6805dfae60f82469d32f167a0762f10b9fe532dc 0 1750332072426 6 connected a5d4fc43276d727e0f162488944b68ba7c1e439d 172.31.5.137:32496@30676,rediscl-huzdsq-shard-bfc-0.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local slave f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 0 1750332073432 14 connected f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 172.31.9.102:32508@31084,rediscl-huzdsq-shard-bfc-1.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local master - 0 1750332072527 14 connected 0-1364 5461-8192 10923-12287 --- 集群状态信息 --- cluster_state:ok cluster_slots_assigned:16384 cluster_slots_ok:16384 cluster_slots_pfail:0 cluster_slots_fail:0 cluster_known_nodes:6 cluster_size:3 cluster_current_epoch:14 cluster_my_epoch:7 cluster_stats_messages_ping_sent:1284 cluster_stats_messages_pong_sent:1267 cluster_stats_messages_meet_sent:1 cluster_stats_messages_fail_sent:10 cluster_stats_messages_sent:2562 cluster_stats_messages_ping_received:1267 cluster_stats_messages_pong_received:1283 cluster_stats_messages_fail_received:2 cluster_stats_messages_auth-req_received:1 cluster_stats_messages_received:2553 total_cluster_links_buffer_limit_exceeded:0 ========== 集群健康分析 ========== 使用节点 rediscl-huzdsq-shard-bfc-0 作为参考基准 检测到以下分片标识符: - bfc - fwk - tt9 参考节点观察到的拓扑结构: ID IP地址 状态 主节点ID 槽位 ---------------------------------------- ------------- ---------------- ---------------------------------------- -------------- 566610eaebef8ad78e4fa9a8957436093634de2c 172.31.15.205:31054 从节点 9a47e108282ae378589e88936924a2f36a944e1a a5d4fc43276d727e0f162488944b68ba7c1e439d 172.31.5.137:32496 从节点 f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 f1e5ba6810221fd9b7af42fc1ff2907eaed2b142 172.31.10.241:31209 从节点 6805dfae60f82469d32f167a0762f10b9fe532dc 9a47e108282ae378589e88936924a2f36a944e1a 172.31.9.102:30626 主节点 - 9558-10922 12288-16383 (共 0 个槽位) 6805dfae60f82469d32f167a0762f10b9fe532dc 172.31.15.205:30964 主节点 - 1365-5460 8193-9557 (共 0 个槽位) f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 172.31.9.102:32508 主节点 - 0-1364 5461-8192 10923-12287 (共 0 个槽位) 正在分析节点 rediscl-huzdsq-shard-bfc-1 的拓扑视图... 正在分析节点 rediscl-huzdsq-shard-fwk-0 的拓扑视图... 正在分析节点 rediscl-huzdsq-shard-fwk-1 的拓扑视图... 正在分析节点 rediscl-huzdsq-shard-tt9-0 的拓扑视图... 正在分析节点 rediscl-huzdsq-shard-tt9-1 的拓扑视图... 槽位分配统计: - 总槽位数: 16384 - 未覆盖槽位数: 0 - 重复覆盖槽位数: 0 - 正确覆盖槽位数: 16384 主节点槽位分配明细: 节点 9a47e108282ae378589e88936924a2f36a944e1a (172.31.9.102:30626) 负责 0 个槽位: 9558-10922 12288-16383 节点 6805dfae60f82469d32f167a0762f10b9fe532dc (172.31.15.205:30964) 负责 0 个槽位: 1365-5460 8193-9557 节点 f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 (172.31.9.102:32508) 负责 0 个槽位: 0-1364 5461-8192 10923-12287 总计分配槽位: 0 / 16384 警告: 分配的总槽位数 (0) 不等于 16384 缺少 16384 个槽位分配 分片分析: 分片 bfc: 1 个主节点, 1 个从节点 ✅ 分片 fwk: 1 个主节点, 1 个从节点 ✅ 分片 tt9: 1 个主节点, 1 个从节点 ✅ 集群分析总结: - 检测到 3 个主节点和 3 个从节点 - 检测到 0 个故障或疑似故障节点 - 集群状态统一显示为OK: 是 - 所有槽位正确分配: 是 - 所有节点看到一致的集群大小: 是 - 所有节点看到一致的拓扑结构: 是 - 所有槽位被正确覆盖: 是 - 集群中无故障或疑似故障节点: 是 集群健康状态: 健康 ✅ 所有检查均通过，Redis集群运行正常。 analyze cluster health success `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge TimeChaos test-chaos-mesh-timeoffset-rediscl-huzdsq --namespace ns-xqred ` Warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely. timechaos.chaos-mesh.org "test-chaos-mesh-timeoffset-rediscl-huzdsq" force deleted Error from server (NotFound): timechaos.chaos-mesh.org "test-chaos-mesh-timeoffset-rediscl-huzdsq" not found check failover pod name failover pod name:rediscl-huzdsq-shard-bfc-1 failover timeoffset Success test failover fullcpu check node drain check node drain success `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge StressChaos test-chaos-mesh-fullcpu-rediscl-huzdsq --namespace ns-xqred ` Warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely. Error from server (NotFound): stresschaos.chaos-mesh.org "test-chaos-mesh-fullcpu-rediscl-huzdsq" not found Error from server (NotFound): stresschaos.chaos-mesh.org "test-chaos-mesh-fullcpu-rediscl-huzdsq" not found apiVersion: chaos-mesh.org/v1alpha1 kind: StressChaos metadata: name: test-chaos-mesh-fullcpu-rediscl-huzdsq namespace: ns-xqred spec: selector: namespaces: - ns-xqred labelSelectors: apps.kubeblocks.io/pod-name: rediscl-huzdsq-shard-bfc-1 mode: all stressors: cpu: workers: 100 load: 100 duration: 2m `kubectl apply -f test-chaos-mesh-fullcpu-rediscl-huzdsq.yaml` stresschaos.chaos-mesh.org/test-chaos-mesh-fullcpu-rediscl-huzdsq created apply test-chaos-mesh-fullcpu-rediscl-huzdsq.yaml Success `rm -rf test-chaos-mesh-fullcpu-rediscl-huzdsq.yaml` fullcpu chaos test waiting 120 seconds check cluster status `kbcli cluster list rediscl-huzdsq --show-labels --namespace ns-xqred ` NAME NAMESPACE CLUSTER-DEFINITION VERSION TERMINATION-POLICY STATUS CREATED-TIME LABELS rediscl-huzdsq ns-xqred Halt Running Jun 19,2025 18:15 UTC+0800 app.kubernetes.io/instance=rediscl-huzdsq check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances rediscl-huzdsq --namespace ns-xqred ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME rediscl-huzdsq-shard-bfc-0 ns-xqred rediscl-huzdsq shard-bfc Running secondary us-west-2a 200m / 200m 644245094400m / 644245094400m ip-172-31-5-137.us-west-2.compute.internal/172.31.5.137 Jun 19,2025 19:15 UTC+0800 rediscl-huzdsq-shard-bfc-1 ns-xqred rediscl-huzdsq shard-bfc Running primary us-west-2a 200m / 200m 644245094400m / 644245094400m ip-172-31-9-102.us-west-2.compute.internal/172.31.9.102 Jun 19,2025 19:09 UTC+0800 rediscl-huzdsq-shard-fwk-0 ns-xqred rediscl-huzdsq shard-fwk Running primary us-west-2a 200m / 200m 644245094400m / 644245094400m ip-172-31-15-205.us-west-2.compute.internal/172.31.15.205 Jun 19,2025 19:09 UTC+0800 rediscl-huzdsq-shard-fwk-1 ns-xqred rediscl-huzdsq shard-fwk Running secondary us-west-2a 200m / 200m 644245094400m / 644245094400m ip-172-31-10-241.us-west-2.compute.internal/172.31.10.241 Jun 19,2025 19:09 UTC+0800 rediscl-huzdsq-shard-tt9-0 ns-xqred rediscl-huzdsq shard-tt9 Running primary us-west-2a 200m / 200m 644245094400m / 644245094400m ip-172-31-9-102.us-west-2.compute.internal/172.31.9.102 Jun 19,2025 19:09 UTC+0800 rediscl-huzdsq-shard-tt9-1 ns-xqred rediscl-huzdsq shard-tt9 Running secondary us-west-2a 200m / 200m 644245094400m / 644245094400m ip-172-31-15-205.us-west-2.compute.internal/172.31.15.205 Jun 19,2025 19:09 UTC+0800 check pod status done check cluster role check cluster role done primary: rediscl-huzdsq-shard-bfc-1 rediscl-huzdsq-shard-fwk-0 rediscl-huzdsq-shard-tt9-0;secondary: rediscl-huzdsq-shard-bfc-0 rediscl-huzdsq-shard-fwk-1 rediscl-huzdsq-shard-tt9-1 analyze cluster health check cluster connect `` ========== 节点: rediscl-huzdsq-shard-bfc-0 ========== 检测到基础名称: rediscl-huzdsq-shard-bfc, 分片编号: 0 使用 Secret: rediscl-huzdsq-shard-bfc-account-default 密码获取成功，前缀: Xm... 使用Pod环境变量中的Redis端口: 6379 --- 集群节点信息 --- 566610eaebef8ad78e4fa9a8957436093634de2c 172.31.15.205:31054@30545,rediscl-huzdsq-shard-tt9-1.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local slave 9a47e108282ae378589e88936924a2f36a944e1a 0 1750332287032 7 connected a5d4fc43276d727e0f162488944b68ba7c1e439d 172.31.5.137:32496@30676,rediscl-huzdsq-shard-bfc-0.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local myself,slave f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 0 1750332286000 14 connected f1e5ba6810221fd9b7af42fc1ff2907eaed2b142 172.31.10.241:31209@30928,rediscl-huzdsq-shard-fwk-1.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local slave 6805dfae60f82469d32f167a0762f10b9fe532dc 0 1750332287534 6 connected 9a47e108282ae378589e88936924a2f36a944e1a 172.31.9.102:30626@31966,rediscl-huzdsq-shard-tt9-0.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local master - 0 1750332288540 7 connected 9558-10922 12288-16383 6805dfae60f82469d32f167a0762f10b9fe532dc 172.31.15.205:30964@30479,rediscl-huzdsq-shard-fwk-0.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local master - 0 1750332288036 6 connected 1365-5460 8193-9557 f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 172.31.9.102:32508@31084,rediscl-huzdsq-shard-bfc-1.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local master - 0 1750332288540 14 connected 0-1364 5461-8192 10923-12287 --- 集群状态信息 --- cluster_state:ok cluster_slots_assigned:16384 cluster_slots_ok:16384 cluster_slots_pfail:0 cluster_slots_fail:0 cluster_known_nodes:6 cluster_size:3 cluster_current_epoch:14 cluster_my_epoch:14 cluster_stats_messages_ping_sent:999 cluster_stats_messages_pong_sent:960 cluster_stats_messages_meet_sent:1 cluster_stats_messages_sent:1960 cluster_stats_messages_ping_received:959 cluster_stats_messages_pong_received:1000 cluster_stats_messages_meet_received:1 cluster_stats_messages_received:1960 total_cluster_links_buffer_limit_exceeded:0 ========== 节点: rediscl-huzdsq-shard-bfc-1 ========== 检测到基础名称: rediscl-huzdsq-shard-bfc, 分片编号: 1 使用 Secret: rediscl-huzdsq-shard-bfc-account-default 密码获取成功，前缀: Xm... 使用Pod环境变量中的Redis端口: 6379 --- 集群节点信息 --- 566610eaebef8ad78e4fa9a8957436093634de2c 172.31.15.205:31054@30545,rediscl-huzdsq-shard-tt9-1.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local slave 9a47e108282ae378589e88936924a2f36a944e1a 0 1750332294000 7 connected a5d4fc43276d727e0f162488944b68ba7c1e439d 172.31.5.137:32496@30676,rediscl-huzdsq-shard-bfc-0.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local slave f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 0 1750332294471 14 connected 9a47e108282ae378589e88936924a2f36a944e1a 172.31.9.102:30626@31966,rediscl-huzdsq-shard-tt9-0.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local master - 0 1750332294000 7 connected 9558-10922 12288-16383 f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 172.31.9.102:32508@31084,rediscl-huzdsq-shard-bfc-1.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local myself,master - 0 1750332294000 14 connected 0-1364 5461-8192 10923-12287 6805dfae60f82469d32f167a0762f10b9fe532dc 172.31.15.205:30964@30479,rediscl-huzdsq-shard-fwk-0.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local master - 0 1750332295477 6 connected 1365-5460 8193-9557 f1e5ba6810221fd9b7af42fc1ff2907eaed2b142 172.31.10.241:31209@30928,rediscl-huzdsq-shard-fwk-1.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local slave 6805dfae60f82469d32f167a0762f10b9fe532dc 0 1750332294975 6 connected --- 集群状态信息 --- cluster_state:ok cluster_slots_assigned:16384 cluster_slots_ok:16384 cluster_slots_pfail:0 cluster_slots_fail:0 cluster_known_nodes:6 cluster_size:3 cluster_current_epoch:14 cluster_my_epoch:14 cluster_stats_messages_ping_sent:1617 cluster_stats_messages_pong_sent:1663 cluster_stats_messages_meet_sent:1 cluster_stats_messages_fail_sent:10 cluster_stats_messages_auth-req_sent:5 cluster_stats_messages_sent:3296 cluster_stats_messages_ping_received:1658 cluster_stats_messages_pong_received:1615 cluster_stats_messages_fail_received:4 cluster_stats_messages_auth-ack_received:2 cluster_stats_messages_received:3279 total_cluster_links_buffer_limit_exceeded:0 ========== 节点: rediscl-huzdsq-shard-fwk-0 ========== 检测到基础名称: rediscl-huzdsq-shard-fwk, 分片编号: 0 使用 Secret: rediscl-huzdsq-shard-fwk-account-default 密码获取成功，前缀: Xm... 使用Pod环境变量中的Redis端口: 6379 --- 集群节点信息 --- a5d4fc43276d727e0f162488944b68ba7c1e439d 172.31.5.137:32496@30676,rediscl-huzdsq-shard-bfc-0.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local slave f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 0 1750332302255 14 connected 6805dfae60f82469d32f167a0762f10b9fe532dc 172.31.15.205:30964@30479,rediscl-huzdsq-shard-fwk-0.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local myself,master - 0 1750332301000 6 connected 1365-5460 8193-9557 566610eaebef8ad78e4fa9a8957436093634de2c 172.31.15.205:31054@30545,rediscl-huzdsq-shard-tt9-1.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local slave 9a47e108282ae378589e88936924a2f36a944e1a 0 1750332302557 7 connected f1e5ba6810221fd9b7af42fc1ff2907eaed2b142 172.31.10.241:31209@30928,rediscl-huzdsq-shard-fwk-1.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local slave 6805dfae60f82469d32f167a0762f10b9fe532dc 0 1750332301250 6 connected f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 172.31.9.102:32508@31084,rediscl-huzdsq-shard-bfc-1.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local master - 0 1750332302000 14 connected 0-1364 5461-8192 10923-12287 9a47e108282ae378589e88936924a2f36a944e1a 172.31.9.102:30626@31966,rediscl-huzdsq-shard-tt9-0.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local master - 0 1750332301000 7 connected 9558-10922 12288-16383 --- 集群状态信息 --- cluster_state:ok cluster_slots_assigned:16384 cluster_slots_ok:16384 cluster_slots_pfail:0 cluster_slots_fail:0 cluster_known_nodes:6 cluster_size:3 cluster_current_epoch:14 cluster_my_epoch:6 cluster_stats_messages_ping_sent:1732 cluster_stats_messages_pong_sent:1739 cluster_stats_messages_meet_sent:2 cluster_stats_messages_fail_sent:22 cluster_stats_messages_auth-ack_sent:1 cluster_stats_messages_sent:3496 cluster_stats_messages_ping_received:1736 cluster_stats_messages_pong_received:1729 cluster_stats_messages_meet_received:3 cluster_stats_messages_fail_received:15 cluster_stats_messages_auth-req_received:1 cluster_stats_messages_received:3484 total_cluster_links_buffer_limit_exceeded:0 ========== 节点: rediscl-huzdsq-shard-fwk-1 ========== 检测到基础名称: rediscl-huzdsq-shard-fwk, 分片编号: 1 使用 Secret: rediscl-huzdsq-shard-fwk-account-default 密码获取成功，前缀: Xm... 使用Pod环境变量中的Redis端口: 6379 --- 集群节点信息 --- f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 172.31.9.102:32508@31084,rediscl-huzdsq-shard-bfc-1.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local master - 0 1750332308000 14 connected 0-1364 5461-8192 10923-12287 566610eaebef8ad78e4fa9a8957436093634de2c 172.31.15.205:31054@30545,rediscl-huzdsq-shard-tt9-1.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local slave 9a47e108282ae378589e88936924a2f36a944e1a 0 1750332308000 7 connected f1e5ba6810221fd9b7af42fc1ff2907eaed2b142 172.31.10.241:31209@30928,rediscl-huzdsq-shard-fwk-1.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local myself,slave 6805dfae60f82469d32f167a0762f10b9fe532dc 0 1750332307000 6 connected 9a47e108282ae378589e88936924a2f36a944e1a 172.31.9.102:30626@31966,rediscl-huzdsq-shard-tt9-0.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local master - 0 1750332308388 7 connected 9558-10922 12288-16383 a5d4fc43276d727e0f162488944b68ba7c1e439d 172.31.5.137:32496@30676,rediscl-huzdsq-shard-bfc-0.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local slave f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 0 1750332308890 14 connected 6805dfae60f82469d32f167a0762f10b9fe532dc 172.31.15.205:30964@30479,rediscl-huzdsq-shard-fwk-0.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local master - 0 1750332309393 6 connected 1365-5460 8193-9557 --- 集群状态信息 --- cluster_state:ok cluster_slots_assigned:16384 cluster_slots_ok:16384 cluster_slots_pfail:0 cluster_slots_fail:0 cluster_known_nodes:6 cluster_size:3 cluster_current_epoch:14 cluster_my_epoch:6 cluster_stats_messages_ping_sent:1710 cluster_stats_messages_pong_sent:1704 cluster_stats_messages_meet_sent:1 cluster_stats_messages_fail_sent:10 cluster_stats_messages_sent:3425 cluster_stats_messages_ping_received:1704 cluster_stats_messages_pong_received:1709 cluster_stats_messages_fail_received:3 cluster_stats_messages_auth-req_received:1 cluster_stats_messages_received:3417 total_cluster_links_buffer_limit_exceeded:0 ========== 节点: rediscl-huzdsq-shard-tt9-0 ========== 检测到基础名称: rediscl-huzdsq-shard-tt9, 分片编号: 0 使用 Secret: rediscl-huzdsq-shard-tt9-account-default 密码获取成功，前缀: Xm... 使用Pod环境变量中的Redis端口: 6379 --- 集群节点信息 --- f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 172.31.9.102:32508@31084,rediscl-huzdsq-shard-bfc-1.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local master - 0 1750332314000 14 connected 0-1364 5461-8192 10923-12287 a5d4fc43276d727e0f162488944b68ba7c1e439d 172.31.5.137:32496@30676,rediscl-huzdsq-shard-bfc-0.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local slave f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 0 1750332314000 14 connected 566610eaebef8ad78e4fa9a8957436093634de2c 172.31.15.205:31054@30545,rediscl-huzdsq-shard-tt9-1.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local slave 9a47e108282ae378589e88936924a2f36a944e1a 0 1750332315582 7 connected 6805dfae60f82469d32f167a0762f10b9fe532dc 172.31.15.205:30964@30479,rediscl-huzdsq-shard-fwk-0.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local master - 0 1750332314575 6 connected 1365-5460 8193-9557 9a47e108282ae378589e88936924a2f36a944e1a 172.31.9.102:30626@31966,rediscl-huzdsq-shard-tt9-0.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local myself,master - 0 1750332315000 7 connected 9558-10922 12288-16383 f1e5ba6810221fd9b7af42fc1ff2907eaed2b142 172.31.10.241:31209@30928,rediscl-huzdsq-shard-fwk-1.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local slave 6805dfae60f82469d32f167a0762f10b9fe532dc 0 1750332314575 6 connected --- 集群状态信息 --- cluster_state:ok cluster_slots_assigned:16384 cluster_slots_ok:16384 cluster_slots_pfail:0 cluster_slots_fail:0 cluster_known_nodes:6 cluster_size:3 cluster_current_epoch:14 cluster_my_epoch:7 cluster_stats_messages_ping_sent:1721 cluster_stats_messages_pong_sent:1698 cluster_stats_messages_meet_sent:2 cluster_stats_messages_fail_sent:25 cluster_stats_messages_auth-ack_sent:1 cluster_stats_messages_sent:3447 cluster_stats_messages_ping_received:1695 cluster_stats_messages_pong_received:1718 cluster_stats_messages_meet_received:3 cluster_stats_messages_fail_received:7 cluster_stats_messages_auth-req_received:1 cluster_stats_messages_received:3424 total_cluster_links_buffer_limit_exceeded:0 ========== 节点: rediscl-huzdsq-shard-tt9-1 ========== 检测到基础名称: rediscl-huzdsq-shard-tt9, 分片编号: 1 使用 Secret: rediscl-huzdsq-shard-tt9-account-default 密码获取成功，前缀: Xm... 使用Pod环境变量中的Redis端口: 6379 --- 集群节点信息 --- 9a47e108282ae378589e88936924a2f36a944e1a 172.31.9.102:30626@31966,rediscl-huzdsq-shard-tt9-0.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local master - 0 1750332321523 7 connected 9558-10922 12288-16383 566610eaebef8ad78e4fa9a8957436093634de2c 172.31.15.205:31054@30545,rediscl-huzdsq-shard-tt9-1.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local myself,slave 9a47e108282ae378589e88936924a2f36a944e1a 0 1750332320000 7 connected 6805dfae60f82469d32f167a0762f10b9fe532dc 172.31.15.205:30964@30479,rediscl-huzdsq-shard-fwk-0.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local master - 0 1750332321523 6 connected 1365-5460 8193-9557 f1e5ba6810221fd9b7af42fc1ff2907eaed2b142 172.31.10.241:31209@30928,rediscl-huzdsq-shard-fwk-1.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local slave 6805dfae60f82469d32f167a0762f10b9fe532dc 0 1750332321724 6 connected a5d4fc43276d727e0f162488944b68ba7c1e439d 172.31.5.137:32496@30676,rediscl-huzdsq-shard-bfc-0.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local slave f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 0 1750332321523 14 connected f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 172.31.9.102:32508@31084,rediscl-huzdsq-shard-bfc-1.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local master - 0 1750332321000 14 connected 0-1364 5461-8192 10923-12287 --- 集群状态信息 --- cluster_state:ok cluster_slots_assigned:16384 cluster_slots_ok:16384 cluster_slots_pfail:0 cluster_slots_fail:0 cluster_known_nodes:6 cluster_size:3 cluster_current_epoch:14 cluster_my_epoch:7 cluster_stats_messages_ping_sent:1742 cluster_stats_messages_pong_sent:1712 cluster_stats_messages_meet_sent:1 cluster_stats_messages_fail_sent:10 cluster_stats_messages_sent:3465 cluster_stats_messages_ping_received:1712 cluster_stats_messages_pong_received:1741 cluster_stats_messages_fail_received:2 cluster_stats_messages_auth-req_received:1 cluster_stats_messages_received:3456 total_cluster_links_buffer_limit_exceeded:0 ========== 集群健康分析 ========== 使用节点 rediscl-huzdsq-shard-bfc-0 作为参考基准 检测到以下分片标识符: - bfc - fwk - tt9 参考节点观察到的拓扑结构: ID IP地址 状态 主节点ID 槽位 ---------------------------------------- ------------- ---------------- ---------------------------------------- -------------- 566610eaebef8ad78e4fa9a8957436093634de2c 172.31.15.205:31054 从节点 9a47e108282ae378589e88936924a2f36a944e1a a5d4fc43276d727e0f162488944b68ba7c1e439d 172.31.5.137:32496 从节点 f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 f1e5ba6810221fd9b7af42fc1ff2907eaed2b142 172.31.10.241:31209 从节点 6805dfae60f82469d32f167a0762f10b9fe532dc 9a47e108282ae378589e88936924a2f36a944e1a 172.31.9.102:30626 主节点 - 9558-10922 12288-16383 (共 0 个槽位) 6805dfae60f82469d32f167a0762f10b9fe532dc 172.31.15.205:30964 主节点 - 1365-5460 8193-9557 (共 0 个槽位) f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 172.31.9.102:32508 主节点 - 0-1364 5461-8192 10923-12287 (共 0 个槽位) 正在分析节点 rediscl-huzdsq-shard-bfc-1 的拓扑视图... 正在分析节点 rediscl-huzdsq-shard-fwk-0 的拓扑视图... 正在分析节点 rediscl-huzdsq-shard-fwk-1 的拓扑视图... 正在分析节点 rediscl-huzdsq-shard-tt9-0 的拓扑视图... 正在分析节点 rediscl-huzdsq-shard-tt9-1 的拓扑视图... 槽位分配统计: - 总槽位数: 16384 - 未覆盖槽位数: 0 - 重复覆盖槽位数: 0 - 正确覆盖槽位数: 16384 主节点槽位分配明细: 节点 9a47e108282ae378589e88936924a2f36a944e1a (172.31.9.102:30626) 负责 0 个槽位: 9558-10922 12288-16383 节点 6805dfae60f82469d32f167a0762f10b9fe532dc (172.31.15.205:30964) 负责 0 个槽位: 1365-5460 8193-9557 节点 f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 (172.31.9.102:32508) 负责 0 个槽位: 0-1364 5461-8192 10923-12287 总计分配槽位: 0 / 16384 警告: 分配的总槽位数 (0) 不等于 16384 缺少 16384 个槽位分配 分片分析: 分片 bfc: 1 个主节点, 1 个从节点 ✅ 分片 fwk: 1 个主节点, 1 个从节点 ✅ 分片 tt9: 1 个主节点, 1 个从节点 ✅ 集群分析总结: - 检测到 3 个主节点和 3 个从节点 - 检测到 0 个故障或疑似故障节点 - 集群状态统一显示为OK: 是 - 所有槽位正确分配: 是 - 所有节点看到一致的集群大小: 是 - 所有节点看到一致的拓扑结构: 是 - 所有槽位被正确覆盖: 是 - 集群中无故障或疑似故障节点: 是 集群健康状态: 健康 ✅ 所有检查均通过，Redis集群运行正常。 analyze cluster health success `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge StressChaos test-chaos-mesh-fullcpu-rediscl-huzdsq --namespace ns-xqred ` Warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely. stresschaos.chaos-mesh.org "test-chaos-mesh-fullcpu-rediscl-huzdsq" force deleted Error from server (NotFound): stresschaos.chaos-mesh.org "test-chaos-mesh-fullcpu-rediscl-huzdsq" not found check failover pod name failover pod name:rediscl-huzdsq-shard-bfc-1 failover fullcpu Success test failover kill1 check node drain check node drain success `kill 1` Defaulted container "redis-cluster" out of: redis-cluster, metrics, lorry, init-lorry (init) Unable to use a TTY - input is not a terminal or the right kind of file exec return message: check cluster status `kbcli cluster list rediscl-huzdsq --show-labels --namespace ns-xqred ` NAME NAMESPACE CLUSTER-DEFINITION VERSION TERMINATION-POLICY STATUS CREATED-TIME LABELS rediscl-huzdsq ns-xqred Halt Updating Jun 19,2025 18:15 UTC+0800 app.kubernetes.io/instance=rediscl-huzdsq cluster_status:Updating check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances rediscl-huzdsq --namespace ns-xqred ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME rediscl-huzdsq-shard-bfc-0 ns-xqred rediscl-huzdsq shard-bfc Running secondary us-west-2a 200m / 200m 644245094400m / 644245094400m ip-172-31-5-137.us-west-2.compute.internal/172.31.5.137 Jun 19,2025 19:15 UTC+0800 rediscl-huzdsq-shard-bfc-1 ns-xqred rediscl-huzdsq shard-bfc Running primary us-west-2a 200m / 200m 644245094400m / 644245094400m ip-172-31-9-102.us-west-2.compute.internal/172.31.9.102 Jun 19,2025 19:09 UTC+0800 rediscl-huzdsq-shard-fwk-0 ns-xqred rediscl-huzdsq shard-fwk Running primary us-west-2a 200m / 200m 644245094400m / 644245094400m ip-172-31-15-205.us-west-2.compute.internal/172.31.15.205 Jun 19,2025 19:09 UTC+0800 rediscl-huzdsq-shard-fwk-1 ns-xqred rediscl-huzdsq shard-fwk Running secondary us-west-2a 200m / 200m 644245094400m / 644245094400m ip-172-31-10-241.us-west-2.compute.internal/172.31.10.241 Jun 19,2025 19:09 UTC+0800 rediscl-huzdsq-shard-tt9-0 ns-xqred rediscl-huzdsq shard-tt9 Running primary us-west-2a 200m / 200m 644245094400m / 644245094400m ip-172-31-9-102.us-west-2.compute.internal/172.31.9.102 Jun 19,2025 19:09 UTC+0800 rediscl-huzdsq-shard-tt9-1 ns-xqred rediscl-huzdsq shard-tt9 Running secondary us-west-2a 200m / 200m 644245094400m / 644245094400m ip-172-31-15-205.us-west-2.compute.internal/172.31.15.205 Jun 19,2025 19:09 UTC+0800 check pod status done check cluster role check cluster role done primary: rediscl-huzdsq-shard-bfc-1 rediscl-huzdsq-shard-fwk-0 rediscl-huzdsq-shard-tt9-0;secondary: rediscl-huzdsq-shard-bfc-0 rediscl-huzdsq-shard-fwk-1 rediscl-huzdsq-shard-tt9-1 analyze cluster health check cluster connect `` ========== 节点: rediscl-huzdsq-shard-bfc-0 ========== 检测到基础名称: rediscl-huzdsq-shard-bfc, 分片编号: 0 使用 Secret: rediscl-huzdsq-shard-bfc-account-default 密码获取成功，前缀: Xm... 使用Pod环境变量中的Redis端口: 6379 --- 集群节点信息 --- 566610eaebef8ad78e4fa9a8957436093634de2c 172.31.15.205:31054@30545,rediscl-huzdsq-shard-tt9-1.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local slave 9a47e108282ae378589e88936924a2f36a944e1a 0 1750332431000 7 connected a5d4fc43276d727e0f162488944b68ba7c1e439d 172.31.5.137:32496@30676,rediscl-huzdsq-shard-bfc-0.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local myself,slave f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 0 1750332431000 14 connected f1e5ba6810221fd9b7af42fc1ff2907eaed2b142 172.31.10.241:31209@30928,rediscl-huzdsq-shard-fwk-1.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local slave 6805dfae60f82469d32f167a0762f10b9fe532dc 0 1750332432293 6 connected 9a47e108282ae378589e88936924a2f36a944e1a 172.31.9.102:30626@31966,rediscl-huzdsq-shard-tt9-0.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local master - 0 1750332431289 7 connected 9558-10922 12288-16383 6805dfae60f82469d32f167a0762f10b9fe532dc 172.31.15.205:30964@30479,rediscl-huzdsq-shard-fwk-0.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local master - 0 1750332431791 6 connected 1365-5460 8193-9557 f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 172.31.9.102:32508@31084,rediscl-huzdsq-shard-bfc-1.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local master - 0 1750332432000 14 connected 0-1364 5461-8192 10923-12287 --- 集群状态信息 --- cluster_state:ok cluster_slots_assigned:16384 cluster_slots_ok:16384 cluster_slots_pfail:0 cluster_slots_fail:0 cluster_known_nodes:6 cluster_size:3 cluster_current_epoch:14 cluster_my_epoch:14 cluster_stats_messages_ping_sent:1262 cluster_stats_messages_pong_sent:1231 cluster_stats_messages_meet_sent:1 cluster_stats_messages_sent:2494 cluster_stats_messages_ping_received:1230 cluster_stats_messages_pong_received:1262 cluster_stats_messages_meet_received:1 cluster_stats_messages_received:2493 total_cluster_links_buffer_limit_exceeded:0 ========== 节点: rediscl-huzdsq-shard-bfc-1 ========== 检测到基础名称: rediscl-huzdsq-shard-bfc, 分片编号: 1 使用 Secret: rediscl-huzdsq-shard-bfc-account-default 密码获取成功，前缀: Xm... 使用Pod环境变量中的Redis端口: 6379 --- 集群节点信息 --- a5d4fc43276d727e0f162488944b68ba7c1e439d 172.31.5.137:32496@30676,rediscl-huzdsq-shard-bfc-0.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local slave f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 0 1750332438577 14 connected f1e5ba6810221fd9b7af42fc1ff2907eaed2b142 172.31.10.241:31209@30928,rediscl-huzdsq-shard-fwk-1.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local slave 6805dfae60f82469d32f167a0762f10b9fe532dc 0 1750332438000 6 connected 6805dfae60f82469d32f167a0762f10b9fe532dc 172.31.15.205:30964@30479,rediscl-huzdsq-shard-fwk-0.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local master - 0 1750332437570 6 connected 1365-5460 8193-9557 f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 172.31.9.102:32508@31084,rediscl-huzdsq-shard-bfc-1.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local myself,master - 0 1750332438000 14 connected 0-1364 5461-8192 10923-12287 566610eaebef8ad78e4fa9a8957436093634de2c 172.31.15.205:31054@30545,rediscl-huzdsq-shard-tt9-1.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local slave 9a47e108282ae378589e88936924a2f36a944e1a 0 1750332438982 7 connected 9a47e108282ae378589e88936924a2f36a944e1a 172.31.9.102:30626@31966,rediscl-huzdsq-shard-tt9-0.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local master - 0 1750332438000 7 connected 9558-10922 12288-16383 --- 集群状态信息 --- cluster_state:ok cluster_slots_assigned:16384 cluster_slots_ok:16384 cluster_slots_pfail:0 cluster_slots_fail:0 cluster_known_nodes:6 cluster_size:3 cluster_current_epoch:14 cluster_my_epoch:14 cluster_stats_messages_ping_sent:74 cluster_stats_messages_pong_sent:42 cluster_stats_messages_meet_sent:2 cluster_stats_messages_sent:118 cluster_stats_messages_ping_received:42 cluster_stats_messages_pong_received:76 cluster_stats_messages_received:118 total_cluster_links_buffer_limit_exceeded:0 ========== 节点: rediscl-huzdsq-shard-fwk-0 ========== 检测到基础名称: rediscl-huzdsq-shard-fwk, 分片编号: 0 使用 Secret: rediscl-huzdsq-shard-fwk-account-default 密码获取成功，前缀: Xm... 使用Pod环境变量中的Redis端口: 6379 --- 集群节点信息 --- a5d4fc43276d727e0f162488944b68ba7c1e439d 172.31.5.137:32496@30676,rediscl-huzdsq-shard-bfc-0.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local slave f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 0 1750332445036 14 connected 6805dfae60f82469d32f167a0762f10b9fe532dc 172.31.15.205:30964@30479,rediscl-huzdsq-shard-fwk-0.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local myself,master - 0 1750332444000 6 connected 1365-5460 8193-9557 566610eaebef8ad78e4fa9a8957436093634de2c 172.31.15.205:31054@30545,rediscl-huzdsq-shard-tt9-1.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local slave 9a47e108282ae378589e88936924a2f36a944e1a 0 1750332444534 7 connected f1e5ba6810221fd9b7af42fc1ff2907eaed2b142 172.31.10.241:31209@30928,rediscl-huzdsq-shard-fwk-1.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local slave 6805dfae60f82469d32f167a0762f10b9fe532dc 0 1750332446041 6 connected f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 172.31.9.102:32508@31084,rediscl-huzdsq-shard-bfc-1.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local master - 0 1750332445539 14 connected 0-1364 5461-8192 10923-12287 9a47e108282ae378589e88936924a2f36a944e1a 172.31.9.102:30626@31966,rediscl-huzdsq-shard-tt9-0.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local master - 0 1750332444000 7 connected 9558-10922 12288-16383 --- 集群状态信息 --- cluster_state:ok cluster_slots_assigned:16384 cluster_slots_ok:16384 cluster_slots_pfail:0 cluster_slots_fail:0 cluster_known_nodes:6 cluster_size:3 cluster_current_epoch:14 cluster_my_epoch:6 cluster_stats_messages_ping_sent:1992 cluster_stats_messages_pong_sent:2009 cluster_stats_messages_meet_sent:2 cluster_stats_messages_fail_sent:22 cluster_stats_messages_auth-ack_sent:1 cluster_stats_messages_sent:4026 cluster_stats_messages_ping_received:2005 cluster_stats_messages_pong_received:1988 cluster_stats_messages_meet_received:4 cluster_stats_messages_fail_received:15 cluster_stats_messages_auth-req_received:1 cluster_stats_messages_received:4013 total_cluster_links_buffer_limit_exceeded:0 ========== 节点: rediscl-huzdsq-shard-fwk-1 ========== 检测到基础名称: rediscl-huzdsq-shard-fwk, 分片编号: 1 使用 Secret: rediscl-huzdsq-shard-fwk-account-default 密码获取成功，前缀: Xm... 使用Pod环境变量中的Redis端口: 6379 --- 集群节点信息 --- f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 172.31.9.102:32508@31084,rediscl-huzdsq-shard-bfc-1.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local master - 0 1750332452000 14 connected 0-1364 5461-8192 10923-12287 566610eaebef8ad78e4fa9a8957436093634de2c 172.31.15.205:31054@30545,rediscl-huzdsq-shard-tt9-1.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local slave 9a47e108282ae378589e88936924a2f36a944e1a 0 1750332452677 7 connected f1e5ba6810221fd9b7af42fc1ff2907eaed2b142 172.31.10.241:31209@30928,rediscl-huzdsq-shard-fwk-1.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local myself,slave 6805dfae60f82469d32f167a0762f10b9fe532dc 0 1750332451000 6 connected 9a47e108282ae378589e88936924a2f36a944e1a 172.31.9.102:30626@31966,rediscl-huzdsq-shard-tt9-0.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local master - 0 1750332452000 7 connected 9558-10922 12288-16383 a5d4fc43276d727e0f162488944b68ba7c1e439d 172.31.5.137:32496@30676,rediscl-huzdsq-shard-bfc-0.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local slave f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 0 1750332452174 14 connected 6805dfae60f82469d32f167a0762f10b9fe532dc 172.31.15.205:30964@30479,rediscl-huzdsq-shard-fwk-0.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local master - 0 1750332451167 6 connected 1365-5460 8193-9557 --- 集群状态信息 --- cluster_state:ok cluster_slots_assigned:16384 cluster_slots_ok:16384 cluster_slots_pfail:0 cluster_slots_fail:0 cluster_known_nodes:6 cluster_size:3 cluster_current_epoch:14 cluster_my_epoch:6 cluster_stats_messages_ping_sent:1966 cluster_stats_messages_pong_sent:1971 cluster_stats_messages_meet_sent:1 cluster_stats_messages_fail_sent:10 cluster_stats_messages_sent:3948 cluster_stats_messages_ping_received:1971 cluster_stats_messages_pong_received:1964 cluster_stats_messages_fail_received:3 cluster_stats_messages_auth-req_received:1 cluster_stats_messages_received:3939 total_cluster_links_buffer_limit_exceeded:0 ========== 节点: rediscl-huzdsq-shard-tt9-0 ========== 检测到基础名称: rediscl-huzdsq-shard-tt9, 分片编号: 0 使用 Secret: rediscl-huzdsq-shard-tt9-account-default 密码获取成功，前缀: Xm... 使用Pod环境变量中的Redis端口: 6379 --- 集群节点信息 --- f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 172.31.9.102:32508@31084,rediscl-huzdsq-shard-bfc-1.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local master - 0 1750332458504 14 connected 0-1364 5461-8192 10923-12287 a5d4fc43276d727e0f162488944b68ba7c1e439d 172.31.5.137:32496@30676,rediscl-huzdsq-shard-bfc-0.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local slave f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 0 1750332457297 14 connected 566610eaebef8ad78e4fa9a8957436093634de2c 172.31.15.205:31054@30545,rediscl-huzdsq-shard-tt9-1.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local slave 9a47e108282ae378589e88936924a2f36a944e1a 0 1750332458807 7 connected 6805dfae60f82469d32f167a0762f10b9fe532dc 172.31.15.205:30964@30479,rediscl-huzdsq-shard-fwk-0.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local master - 0 1750332459309 6 connected 1365-5460 8193-9557 9a47e108282ae378589e88936924a2f36a944e1a 172.31.9.102:30626@31966,rediscl-huzdsq-shard-tt9-0.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local myself,master - 0 1750332457000 7 connected 9558-10922 12288-16383 f1e5ba6810221fd9b7af42fc1ff2907eaed2b142 172.31.10.241:31209@30928,rediscl-huzdsq-shard-fwk-1.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local slave 6805dfae60f82469d32f167a0762f10b9fe532dc 0 1750332459000 6 connected --- 集群状态信息 --- cluster_state:ok cluster_slots_assigned:16384 cluster_slots_ok:16384 cluster_slots_pfail:0 cluster_slots_fail:0 cluster_known_nodes:6 cluster_size:3 cluster_current_epoch:14 cluster_my_epoch:7 cluster_stats_messages_ping_sent:1984 cluster_stats_messages_pong_sent:1949 cluster_stats_messages_meet_sent:2 cluster_stats_messages_fail_sent:25 cluster_stats_messages_auth-ack_sent:1 cluster_stats_messages_sent:3961 cluster_stats_messages_ping_received:1945 cluster_stats_messages_pong_received:1980 cluster_stats_messages_meet_received:4 cluster_stats_messages_fail_received:7 cluster_stats_messages_auth-req_received:1 cluster_stats_messages_received:3937 total_cluster_links_buffer_limit_exceeded:0 ========== 节点: rediscl-huzdsq-shard-tt9-1 ========== 检测到基础名称: rediscl-huzdsq-shard-tt9, 分片编号: 1 使用 Secret: rediscl-huzdsq-shard-tt9-account-default 密码获取成功，前缀: Xm... 使用Pod环境变量中的Redis端口: 6379 --- 集群节点信息 --- 9a47e108282ae378589e88936924a2f36a944e1a 172.31.9.102:30626@31966,rediscl-huzdsq-shard-tt9-0.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local master - 0 1750332464000 7 connected 9558-10922 12288-16383 566610eaebef8ad78e4fa9a8957436093634de2c 172.31.15.205:31054@30545,rediscl-huzdsq-shard-tt9-1.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local myself,slave 9a47e108282ae378589e88936924a2f36a944e1a 0 1750332464000 7 connected 6805dfae60f82469d32f167a0762f10b9fe532dc 172.31.15.205:30964@30479,rediscl-huzdsq-shard-fwk-0.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local master - 0 1750332464588 6 connected 1365-5460 8193-9557 f1e5ba6810221fd9b7af42fc1ff2907eaed2b142 172.31.10.241:31209@30928,rediscl-huzdsq-shard-fwk-1.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local slave 6805dfae60f82469d32f167a0762f10b9fe532dc 0 1750332465496 6 connected a5d4fc43276d727e0f162488944b68ba7c1e439d 172.31.5.137:32496@30676,rediscl-huzdsq-shard-bfc-0.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local slave f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 0 1750332464487 14 connected f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 172.31.9.102:32508@31084,rediscl-huzdsq-shard-bfc-1.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local master - 0 1750332464990 14 connected 0-1364 5461-8192 10923-12287 --- 集群状态信息 --- cluster_state:ok cluster_slots_assigned:16384 cluster_slots_ok:16384 cluster_slots_pfail:0 cluster_slots_fail:0 cluster_known_nodes:6 cluster_size:3 cluster_current_epoch:14 cluster_my_epoch:7 cluster_stats_messages_ping_sent:1992 cluster_stats_messages_pong_sent:1975 cluster_stats_messages_meet_sent:1 cluster_stats_messages_fail_sent:10 cluster_stats_messages_sent:3978 cluster_stats_messages_ping_received:1975 cluster_stats_messages_pong_received:1990 cluster_stats_messages_fail_received:2 cluster_stats_messages_auth-req_received:1 cluster_stats_messages_received:3968 total_cluster_links_buffer_limit_exceeded:0 ========== 集群健康分析 ========== 使用节点 rediscl-huzdsq-shard-bfc-0 作为参考基准 检测到以下分片标识符: - bfc - fwk - tt9 参考节点观察到的拓扑结构: ID IP地址 状态 主节点ID 槽位 ---------------------------------------- ------------- ---------------- ---------------------------------------- -------------- 566610eaebef8ad78e4fa9a8957436093634de2c 172.31.15.205:31054 从节点 9a47e108282ae378589e88936924a2f36a944e1a a5d4fc43276d727e0f162488944b68ba7c1e439d 172.31.5.137:32496 从节点 f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 f1e5ba6810221fd9b7af42fc1ff2907eaed2b142 172.31.10.241:31209 从节点 6805dfae60f82469d32f167a0762f10b9fe532dc 9a47e108282ae378589e88936924a2f36a944e1a 172.31.9.102:30626 主节点 - 9558-10922 12288-16383 (共 0 个槽位) 6805dfae60f82469d32f167a0762f10b9fe532dc 172.31.15.205:30964 主节点 - 1365-5460 8193-9557 (共 0 个槽位) f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 172.31.9.102:32508 主节点 - 0-1364 5461-8192 10923-12287 (共 0 个槽位) 正在分析节点 rediscl-huzdsq-shard-bfc-1 的拓扑视图... 正在分析节点 rediscl-huzdsq-shard-fwk-0 的拓扑视图... 正在分析节点 rediscl-huzdsq-shard-fwk-1 的拓扑视图... 正在分析节点 rediscl-huzdsq-shard-tt9-0 的拓扑视图... 正在分析节点 rediscl-huzdsq-shard-tt9-1 的拓扑视图... 槽位分配统计: - 总槽位数: 16384 - 未覆盖槽位数: 0 - 重复覆盖槽位数: 0 - 正确覆盖槽位数: 16384 主节点槽位分配明细: 节点 9a47e108282ae378589e88936924a2f36a944e1a (172.31.9.102:30626) 负责 0 个槽位: 9558-10922 12288-16383 节点 6805dfae60f82469d32f167a0762f10b9fe532dc (172.31.15.205:30964) 负责 0 个槽位: 1365-5460 8193-9557 节点 f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 (172.31.9.102:32508) 负责 0 个槽位: 0-1364 5461-8192 10923-12287 总计分配槽位: 0 / 16384 警告: 分配的总槽位数 (0) 不等于 16384 缺少 16384 个槽位分配 分片分析: 分片 bfc: 1 个主节点, 1 个从节点 ✅ 分片 fwk: 1 个主节点, 1 个从节点 ✅ 分片 tt9: 1 个主节点, 1 个从节点 ✅ 集群分析总结: - 检测到 3 个主节点和 3 个从节点 - 检测到 0 个故障或疑似故障节点 - 集群状态统一显示为OK: 是 - 所有槽位正确分配: 是 - 所有节点看到一致的集群大小: 是 - 所有节点看到一致的拓扑结构: 是 - 所有槽位被正确覆盖: 是 - 集群中无故障或疑似故障节点: 是 集群健康状态: 健康 ✅ 所有检查均通过，Redis集群运行正常。 analyze cluster health success check failover pod name failover pod name:rediscl-huzdsq-shard-bfc-1 failover kill1 Success cluster hscale check cluster status before ops check cluster status done cluster_status:Running No resources found in rediscl-huzdsq namespace. `kbcli cluster hscale rediscl-huzdsq --auto-approve --force=true --components shard --replicas 3 --namespace ns-xqred ` OpsRequest rediscl-huzdsq-horizontalscaling-4nnnm created successfully, you can view the progress: kbcli cluster describe-ops rediscl-huzdsq-horizontalscaling-4nnnm -n ns-xqred check ops status `kbcli cluster list-ops rediscl-huzdsq --status all --namespace ns-xqred ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME rediscl-huzdsq-horizontalscaling-4nnnm ns-xqred HorizontalScaling rediscl-huzdsq shard Running 0/3 Jun 19,2025 19:29 UTC+0800 check cluster status `kbcli cluster list rediscl-huzdsq --show-labels --namespace ns-xqred ` NAME NAMESPACE CLUSTER-DEFINITION VERSION TERMINATION-POLICY STATUS CREATED-TIME LABELS rediscl-huzdsq ns-xqred Halt Updating Jun 19,2025 18:15 UTC+0800 app.kubernetes.io/instance=rediscl-huzdsq cluster_status:Updating cluster_status:Updating check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances rediscl-huzdsq --namespace ns-xqred ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME rediscl-huzdsq-shard-bfc-0 ns-xqred rediscl-huzdsq shard-bfc Running secondary us-west-2a 200m / 200m 644245094400m / 644245094400m ip-172-31-5-137.us-west-2.compute.internal/172.31.5.137 Jun 19,2025 19:15 UTC+0800 rediscl-huzdsq-shard-bfc-1 ns-xqred rediscl-huzdsq shard-bfc Running primary us-west-2a 200m / 200m 644245094400m / 644245094400m ip-172-31-9-102.us-west-2.compute.internal/172.31.9.102 Jun 19,2025 19:09 UTC+0800 rediscl-huzdsq-shard-bfc-2 ns-xqred rediscl-huzdsq shard-bfc Running secondary us-west-2a 200m / 200m 644245094400m / 644245094400m ip-172-31-2-115.us-west-2.compute.internal/172.31.2.115 Jun 19,2025 19:29 UTC+0800 rediscl-huzdsq-shard-fwk-0 ns-xqred rediscl-huzdsq shard-fwk Running primary us-west-2a 200m / 200m 644245094400m / 644245094400m ip-172-31-15-205.us-west-2.compute.internal/172.31.15.205 Jun 19,2025 19:09 UTC+0800 rediscl-huzdsq-shard-fwk-1 ns-xqred rediscl-huzdsq shard-fwk Running secondary us-west-2a 200m / 200m 644245094400m / 644245094400m ip-172-31-10-241.us-west-2.compute.internal/172.31.10.241 Jun 19,2025 19:09 UTC+0800 rediscl-huzdsq-shard-fwk-2 ns-xqred rediscl-huzdsq shard-fwk Running secondary us-west-2a 200m / 200m 644245094400m / 644245094400m ip-172-31-6-202.us-west-2.compute.internal/172.31.6.202 Jun 19,2025 19:29 UTC+0800 rediscl-huzdsq-shard-tt9-0 ns-xqred rediscl-huzdsq shard-tt9 Running primary us-west-2a 200m / 200m 644245094400m / 644245094400m ip-172-31-9-102.us-west-2.compute.internal/172.31.9.102 Jun 19,2025 19:09 UTC+0800 rediscl-huzdsq-shard-tt9-1 ns-xqred rediscl-huzdsq shard-tt9 Running secondary us-west-2a 200m / 200m 644245094400m / 644245094400m ip-172-31-15-205.us-west-2.compute.internal/172.31.15.205 Jun 19,2025 19:09 UTC+0800 rediscl-huzdsq-shard-tt9-2 ns-xqred rediscl-huzdsq shard-tt9 Running secondary us-west-2a 200m / 200m 644245094400m / 644245094400m ip-172-31-12-213.us-west-2.compute.internal/172.31.12.213 Jun 19,2025 19:29 UTC+0800 check pod status done check cluster role check cluster role done primary: rediscl-huzdsq-shard-bfc-1 rediscl-huzdsq-shard-fwk-0 rediscl-huzdsq-shard-tt9-0;secondary: rediscl-huzdsq-shard-bfc-0 rediscl-huzdsq-shard-bfc-2 rediscl-huzdsq-shard-fwk-1 rediscl-huzdsq-shard-fwk-2 rediscl-huzdsq-shard-tt9-1 rediscl-huzdsq-shard-tt9-2 analyze cluster health check cluster connect `` ========== 节点: rediscl-huzdsq-shard-bfc-0 ========== 检测到基础名称: rediscl-huzdsq-shard-bfc, 分片编号: 0 使用 Secret: rediscl-huzdsq-shard-bfc-account-default 密码获取成功，前缀: Xm... 使用Pod环境变量中的Redis端口: 6379 --- 集群节点信息 --- 566610eaebef8ad78e4fa9a8957436093634de2c 172.31.15.205:31054@30545,rediscl-huzdsq-shard-tt9-1.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local slave 9a47e108282ae378589e88936924a2f36a944e1a 0 1750332581064 7 connected a5d4fc43276d727e0f162488944b68ba7c1e439d 172.31.5.137:32496@30676,rediscl-huzdsq-shard-bfc-0.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local myself,slave f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 0 1750332579000 14 connected f1e5ba6810221fd9b7af42fc1ff2907eaed2b142 172.31.10.241:31209@30928,rediscl-huzdsq-shard-fwk-1.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local slave 6805dfae60f82469d32f167a0762f10b9fe532dc 0 1750332579556 6 connected 9a47e108282ae378589e88936924a2f36a944e1a 172.31.9.102:30626@31966,rediscl-huzdsq-shard-tt9-0.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local master - 0 1750332579053 7 connected 9558-10922 12288-16383 6805dfae60f82469d32f167a0762f10b9fe532dc 172.31.15.205:30964@30479,rediscl-huzdsq-shard-fwk-0.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local master - 0 1750332580560 6 connected 1365-5460 8193-9557 f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 172.31.9.102:32508@31084,rediscl-huzdsq-shard-bfc-1.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local master - 0 1750332580058 14 connected 0-1364 5461-8192 10923-12287 --- 集群状态信息 --- cluster_state:ok cluster_slots_assigned:16384 cluster_slots_ok:16384 cluster_slots_pfail:0 cluster_slots_fail:0 cluster_known_nodes:6 cluster_size:3 cluster_current_epoch:14 cluster_my_epoch:14 cluster_stats_messages_ping_sent:1530 cluster_stats_messages_pong_sent:1538 cluster_stats_messages_meet_sent:1 cluster_stats_messages_sent:3069 cluster_stats_messages_ping_received:1537 cluster_stats_messages_pong_received:1530 cluster_stats_messages_meet_received:1 cluster_stats_messages_received:3068 total_cluster_links_buffer_limit_exceeded:0 ========== 节点: rediscl-huzdsq-shard-bfc-1 ========== 检测到基础名称: rediscl-huzdsq-shard-bfc, 分片编号: 1 使用 Secret: rediscl-huzdsq-shard-bfc-account-default 密码获取成功，前缀: Xm... 使用Pod环境变量中的Redis端口: 6379 --- 集群节点信息 --- a5d4fc43276d727e0f162488944b68ba7c1e439d 172.31.5.137:32496@30676,rediscl-huzdsq-shard-bfc-0.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local slave f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 0 1750332587544 14 connected f1e5ba6810221fd9b7af42fc1ff2907eaed2b142 172.31.10.241:31209@30928,rediscl-huzdsq-shard-fwk-1.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local slave 6805dfae60f82469d32f167a0762f10b9fe532dc 0 1750332587545 6 connected 6805dfae60f82469d32f167a0762f10b9fe532dc 172.31.15.205:30964@30479,rediscl-huzdsq-shard-fwk-0.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local master - 0 1750332586000 6 connected 1365-5460 8193-9557 f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 172.31.9.102:32508@31084,rediscl-huzdsq-shard-bfc-1.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local myself,master - 0 1750332586000 14 connected 0-1364 5461-8192 10923-12287 566610eaebef8ad78e4fa9a8957436093634de2c 172.31.15.205:31054@30545,rediscl-huzdsq-shard-tt9-1.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local slave 9a47e108282ae378589e88936924a2f36a944e1a 0 1750332587000 7 connected 9a47e108282ae378589e88936924a2f36a944e1a 172.31.9.102:30626@31966,rediscl-huzdsq-shard-tt9-0.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local master - 0 1750332586841 7 connected 9558-10922 12288-16383 --- 集群状态信息 --- cluster_state:ok cluster_slots_assigned:16384 cluster_slots_ok:16384 cluster_slots_pfail:0 cluster_slots_fail:0 cluster_known_nodes:6 cluster_size:3 cluster_current_epoch:14 cluster_my_epoch:14 cluster_stats_messages_ping_sent:346 cluster_stats_messages_pong_sent:350 cluster_stats_messages_meet_sent:2 cluster_stats_messages_sent:698 cluster_stats_messages_ping_received:349 cluster_stats_messages_pong_received:348 cluster_stats_messages_meet_received:1 cluster_stats_messages_received:698 total_cluster_links_buffer_limit_exceeded:0 ========== 节点: rediscl-huzdsq-shard-bfc-2 ========== 检测到基础名称: rediscl-huzdsq-shard-bfc, 分片编号: 2 使用 Secret: rediscl-huzdsq-shard-bfc-account-default 密码获取成功，前缀: Xm... 使用Pod环境变量中的Redis端口: 6379 --- 集群节点信息 --- f1e5ba6810221fd9b7af42fc1ff2907eaed2b142 172.31.10.241:31209@30928 slave 6805dfae60f82469d32f167a0762f10b9fe532dc 0 1750332593129 6 connected 566610eaebef8ad78e4fa9a8957436093634de2c 172.31.15.205:31054@30545 slave 9a47e108282ae378589e88936924a2f36a944e1a 0 1750332594134 7 connected f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 172.31.9.102:32508@31084 master - 0 1750332594535 14 connected 0-1364 5461-8192 10923-12287 c6058467dfda4315243b459a9b0b2f392e4be33d 172.31.2.115:30697@30538,rediscl-huzdsq-shard-bfc-2.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local myself,slave f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 0 0 14 connected a5d4fc43276d727e0f162488944b68ba7c1e439d 172.31.5.137:32496@30676 slave f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 0 1750332593000 14 connected 6805dfae60f82469d32f167a0762f10b9fe532dc 172.31.15.205:30964@30479 master - 0 1750332594000 6 connected 1365-5460 8193-9557 9a47e108282ae378589e88936924a2f36a944e1a 172.31.9.102:30626@31966 master - 0 1750332593000 7 connected 9558-10922 12288-16383 --- 集群状态信息 --- cluster_state:ok cluster_slots_assigned:16384 cluster_slots_ok:16384 cluster_slots_pfail:0 cluster_slots_fail:0 cluster_known_nodes:7 cluster_size:3 cluster_current_epoch:14 cluster_my_epoch:14 cluster_stats_messages_ping_sent:88 cluster_stats_messages_meet_sent:1 cluster_stats_messages_sent:89 cluster_stats_messages_pong_received:89 cluster_stats_messages_received:89 total_cluster_links_buffer_limit_exceeded:0 ========== 节点: rediscl-huzdsq-shard-fwk-0 ========== 检测到基础名称: rediscl-huzdsq-shard-fwk, 分片编号: 0 使用 Secret: rediscl-huzdsq-shard-fwk-account-default 密码获取成功，前缀: Xm... 使用Pod环境变量中的Redis端口: 6379 --- 集群节点信息 --- a5d4fc43276d727e0f162488944b68ba7c1e439d 172.31.5.137:32496@30676,rediscl-huzdsq-shard-bfc-0.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local slave f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 0 1750332600600 14 connected 6805dfae60f82469d32f167a0762f10b9fe532dc 172.31.15.205:30964@30479,rediscl-huzdsq-shard-fwk-0.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local myself,master - 0 1750332599000 6 connected 1365-5460 8193-9557 566610eaebef8ad78e4fa9a8957436093634de2c 172.31.15.205:31054@30545,rediscl-huzdsq-shard-tt9-1.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local slave 9a47e108282ae378589e88936924a2f36a944e1a 0 1750332600600 7 connected f1e5ba6810221fd9b7af42fc1ff2907eaed2b142 172.31.10.241:31209@30928,rediscl-huzdsq-shard-fwk-1.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local slave 6805dfae60f82469d32f167a0762f10b9fe532dc 0 1750332600904 6 connected f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 172.31.9.102:32508@31084,rediscl-huzdsq-shard-bfc-1.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local master - 0 1750332600601 14 connected 0-1364 5461-8192 10923-12287 9a47e108282ae378589e88936924a2f36a944e1a 172.31.9.102:30626@31966,rediscl-huzdsq-shard-tt9-0.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local master - 0 1750332600000 7 connected 9558-10922 12288-16383 --- 集群状态信息 --- cluster_state:ok cluster_slots_assigned:16384 cluster_slots_ok:16384 cluster_slots_pfail:0 cluster_slots_fail:0 cluster_known_nodes:6 cluster_size:3 cluster_current_epoch:14 cluster_my_epoch:6 cluster_stats_messages_ping_sent:2283 cluster_stats_messages_pong_sent:2347 cluster_stats_messages_meet_sent:2 cluster_stats_messages_fail_sent:22 cluster_stats_messages_auth-ack_sent:1 cluster_stats_messages_sent:4655 cluster_stats_messages_ping_received:2342 cluster_stats_messages_pong_received:2279 cluster_stats_messages_meet_received:5 cluster_stats_messages_fail_received:15 cluster_stats_messages_auth-req_received:1 cluster_stats_messages_received:4642 total_cluster_links_buffer_limit_exceeded:0 ========== 节点: rediscl-huzdsq-shard-fwk-1 ========== 检测到基础名称: rediscl-huzdsq-shard-fwk, 分片编号: 1 使用 Secret: rediscl-huzdsq-shard-fwk-account-default 密码获取成功，前缀: Xm... 使用Pod环境变量中的Redis端口: 6379 --- 集群节点信息 --- f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 172.31.9.102:32508@31084,rediscl-huzdsq-shard-bfc-1.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local master - 0 1750332607016 14 connected 0-1364 5461-8192 10923-12287 566610eaebef8ad78e4fa9a8957436093634de2c 172.31.15.205:31054@30545,rediscl-huzdsq-shard-tt9-1.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local slave 9a47e108282ae378589e88936924a2f36a944e1a 0 1750332607519 7 connected f1e5ba6810221fd9b7af42fc1ff2907eaed2b142 172.31.10.241:31209@30928,rediscl-huzdsq-shard-fwk-1.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local myself,slave 6805dfae60f82469d32f167a0762f10b9fe532dc 0 1750332606000 6 connected 9a47e108282ae378589e88936924a2f36a944e1a 172.31.9.102:30626@31966,rediscl-huzdsq-shard-tt9-0.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local master - 0 1750332608022 7 connected 9558-10922 12288-16383 a5d4fc43276d727e0f162488944b68ba7c1e439d 172.31.5.137:32496@30676,rediscl-huzdsq-shard-bfc-0.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local slave f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 0 1750332607000 14 connected 6805dfae60f82469d32f167a0762f10b9fe532dc 172.31.15.205:30964@30479,rediscl-huzdsq-shard-fwk-0.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local master - 0 1750332606513 6 connected 1365-5460 8193-9557 --- 集群状态信息 --- cluster_state:ok cluster_slots_assigned:16384 cluster_slots_ok:16384 cluster_slots_pfail:0 cluster_slots_fail:0 cluster_known_nodes:6 cluster_size:3 cluster_current_epoch:14 cluster_my_epoch:6 cluster_stats_messages_ping_sent:2247 cluster_stats_messages_pong_sent:2306 cluster_stats_messages_meet_sent:1 cluster_stats_messages_fail_sent:10 cluster_stats_messages_sent:4564 cluster_stats_messages_ping_received:2306 cluster_stats_messages_pong_received:2245 cluster_stats_messages_fail_received:3 cluster_stats_messages_auth-req_received:1 cluster_stats_messages_received:4555 total_cluster_links_buffer_limit_exceeded:0 ========== 节点: rediscl-huzdsq-shard-fwk-2 ========== 检测到基础名称: rediscl-huzdsq-shard-fwk, 分片编号: 2 使用 Secret: rediscl-huzdsq-shard-fwk-account-default 密码获取成功，前缀: Xm... 使用Pod环境变量中的Redis端口: 6379 --- 集群节点信息 --- f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 172.31.9.102:32508@31084 master - 0 1750332613786 14 connected 0-1364 5461-8192 10923-12287 a5d4fc43276d727e0f162488944b68ba7c1e439d 172.31.5.137:32496@30676 slave f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 0 1750332613000 14 connected ef4cb9a37cce0d498339d5804acdb0568e884d03 172.31.6.202:30352@32524,rediscl-huzdsq-shard-fwk-2.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local myself,slave 6805dfae60f82469d32f167a0762f10b9fe532dc 0 0 6 connected 566610eaebef8ad78e4fa9a8957436093634de2c 172.31.15.205:31054@30545 slave 9a47e108282ae378589e88936924a2f36a944e1a 0 1750332612576 7 connected 6805dfae60f82469d32f167a0762f10b9fe532dc 172.31.15.205:30964@30479 master - 0 1750332612777 6 connected 1365-5460 8193-9557 9a47e108282ae378589e88936924a2f36a944e1a 172.31.9.102:30626@31966 master - 0 1750332613584 7 connected 9558-10922 12288-16383 f1e5ba6810221fd9b7af42fc1ff2907eaed2b142 172.31.10.241:31209@30928 slave 6805dfae60f82469d32f167a0762f10b9fe532dc 0 1750332612000 6 connected --- 集群状态信息 --- cluster_state:ok cluster_slots_assigned:16384 cluster_slots_ok:16384 cluster_slots_pfail:0 cluster_slots_fail:0 cluster_known_nodes:7 cluster_size:3 cluster_current_epoch:14 cluster_my_epoch:6 cluster_stats_messages_ping_sent:137 cluster_stats_messages_meet_sent:1 cluster_stats_messages_sent:138 cluster_stats_messages_pong_received:138 cluster_stats_messages_received:138 total_cluster_links_buffer_limit_exceeded:0 ========== 节点: rediscl-huzdsq-shard-tt9-0 ========== 检测到基础名称: rediscl-huzdsq-shard-tt9, 分片编号: 0 使用 Secret: rediscl-huzdsq-shard-tt9-account-default 密码获取成功，前缀: Xm... 使用Pod环境变量中的Redis端口: 6379 --- 集群节点信息 --- a5d4fc43276d727e0f162488944b68ba7c1e439d 172.31.5.137:32496@30676,rediscl-huzdsq-shard-bfc-0.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local slave f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 0 1750332620226 14 connected 566610eaebef8ad78e4fa9a8957436093634de2c 172.31.15.205:31054@30545,rediscl-huzdsq-shard-tt9-1.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local slave 9a47e108282ae378589e88936924a2f36a944e1a 0 1750332619000 7 connected ef4cb9a37cce0d498339d5804acdb0568e884d03 172.31.6.202:30352@32524,rediscl-huzdsq-shard-fwk-2.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local slave 6805dfae60f82469d32f167a0762f10b9fe532dc 0 1750332619000 6 connected 6805dfae60f82469d32f167a0762f10b9fe532dc 172.31.15.205:30964@30479,rediscl-huzdsq-shard-fwk-0.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local master - 0 1750332620527 6 connected 1365-5460 8193-9557 f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 172.31.9.102:32508@31084,rediscl-huzdsq-shard-bfc-1.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local master - 0 1750332619218 14 connected 0-1364 5461-8192 10923-12287 c6058467dfda4315243b459a9b0b2f392e4be33d 172.31.2.115:30697@30538 slave - 0 1750332620327 0 connected 9a47e108282ae378589e88936924a2f36a944e1a 172.31.9.102:30626@31966,rediscl-huzdsq-shard-tt9-0.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local myself,master - 0 1750332619000 7 connected 9558-10922 12288-16383 f1e5ba6810221fd9b7af42fc1ff2907eaed2b142 172.31.10.241:31209@30928,rediscl-huzdsq-shard-fwk-1.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local slave 6805dfae60f82469d32f167a0762f10b9fe532dc 0 1750332620000 6 connected 9951dde00cc9332b19e0d29ba02df6df5475ddb4 172.31.12.213:32418@31182 slave - 0 1750332620025 0 connected --- 集群状态信息 --- cluster_state:ok cluster_slots_assigned:16384 cluster_slots_ok:16384 cluster_slots_pfail:0 cluster_slots_fail:0 cluster_known_nodes:9 cluster_size:3 cluster_current_epoch:14 cluster_my_epoch:7 cluster_stats_messages_ping_sent:2285 cluster_stats_messages_pong_sent:2320 cluster_stats_messages_meet_sent:2 cluster_stats_messages_fail_sent:25 cluster_stats_messages_auth-ack_sent:1 cluster_stats_messages_sent:4633 cluster_stats_messages_ping_received:2312 cluster_stats_messages_pong_received:2281 cluster_stats_messages_meet_received:8 cluster_stats_messages_fail_received:7 cluster_stats_messages_auth-req_received:1 cluster_stats_messages_received:4609 total_cluster_links_buffer_limit_exceeded:0 ========== 节点: rediscl-huzdsq-shard-tt9-1 ========== 检测到基础名称: rediscl-huzdsq-shard-tt9, 分片编号: 1 使用 Secret: rediscl-huzdsq-shard-tt9-account-default 密码获取成功，前缀: Xm... 使用Pod环境变量中的Redis端口: 6379 --- 集群节点信息 --- 6805dfae60f82469d32f167a0762f10b9fe532dc 172.31.15.205:30964@30479,rediscl-huzdsq-shard-fwk-0.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local master - 0 1750332626000 6 connected 1365-5460 8193-9557 f1e5ba6810221fd9b7af42fc1ff2907eaed2b142 172.31.10.241:31209@30928,rediscl-huzdsq-shard-fwk-1.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local slave 6805dfae60f82469d32f167a0762f10b9fe532dc 0 1750332627520 6 connected 566610eaebef8ad78e4fa9a8957436093634de2c 172.31.15.205:31054@30545,rediscl-huzdsq-shard-tt9-1.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local myself,slave 9a47e108282ae378589e88936924a2f36a944e1a 0 1750332624000 7 connected 9a47e108282ae378589e88936924a2f36a944e1a 172.31.9.102:30626@31966,rediscl-huzdsq-shard-tt9-0.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local master - 0 1750332625911 7 connected 9558-10922 12288-16383 c6058467dfda4315243b459a9b0b2f392e4be33d 172.31.2.115:30697@30538,rediscl-huzdsq-shard-bfc-2.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local slave f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 0 1750332627000 14 connected ef4cb9a37cce0d498339d5804acdb0568e884d03 172.31.6.202:30352@32524,rediscl-huzdsq-shard-fwk-2.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local slave 6805dfae60f82469d32f167a0762f10b9fe532dc 0 1750332626112 6 connected 9951dde00cc9332b19e0d29ba02df6df5475ddb4 172.31.12.213:32418@31182,rediscl-huzdsq-shard-tt9-2.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local slave 9a47e108282ae378589e88936924a2f36a944e1a 0 1750332626414 7 connected a5d4fc43276d727e0f162488944b68ba7c1e439d 172.31.5.137:32496@30676,rediscl-huzdsq-shard-bfc-0.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local slave f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 0 1750332627419 14 connected f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 172.31.9.102:32508@31084,rediscl-huzdsq-shard-bfc-1.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local master - 0 1750332626000 14 connected 0-1364 5461-8192 10923-12287 --- 集群状态信息 --- cluster_state:ok cluster_slots_assigned:16384 cluster_slots_ok:16384 cluster_slots_pfail:0 cluster_slots_fail:0 cluster_known_nodes:9 cluster_size:3 cluster_current_epoch:14 cluster_my_epoch:7 cluster_stats_messages_ping_sent:2288 cluster_stats_messages_pong_sent:2345 cluster_stats_messages_meet_sent:1 cluster_stats_messages_fail_sent:10 cluster_stats_messages_sent:4644 cluster_stats_messages_ping_received:2345 cluster_stats_messages_pong_received:2286 cluster_stats_messages_fail_received:2 cluster_stats_messages_auth-req_received:1 cluster_stats_messages_received:4634 total_cluster_links_buffer_limit_exceeded:0 ========== 节点: rediscl-huzdsq-shard-tt9-2 ========== 检测到基础名称: rediscl-huzdsq-shard-tt9, 分片编号: 2 使用 Secret: rediscl-huzdsq-shard-tt9-account-default 密码获取成功，前缀: Xm... 使用Pod环境变量中的Redis端口: 6379 --- 集群节点信息 --- 566610eaebef8ad78e4fa9a8957436093634de2c 172.31.15.205:31054@30545,rediscl-huzdsq-shard-tt9-1.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local slave 9a47e108282ae378589e88936924a2f36a944e1a 0 1750332631719 7 connected a5d4fc43276d727e0f162488944b68ba7c1e439d 172.31.5.137:32496@30676,rediscl-huzdsq-shard-bfc-0.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local slave f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 0 1750332632000 14 connected f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 172.31.9.102:32508@31084,rediscl-huzdsq-shard-bfc-1.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local master - 0 1750332632726 14 connected 0-1364 5461-8192 10923-12287 ef4cb9a37cce0d498339d5804acdb0568e884d03 172.31.6.202:30352@32524,rediscl-huzdsq-shard-fwk-2.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local slave 6805dfae60f82469d32f167a0762f10b9fe532dc 0 1750332633730 6 connected 9951dde00cc9332b19e0d29ba02df6df5475ddb4 172.31.12.213:32418@31182,rediscl-huzdsq-shard-tt9-2.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local myself,slave 9a47e108282ae378589e88936924a2f36a944e1a 0 1750332630000 7 connected f1e5ba6810221fd9b7af42fc1ff2907eaed2b142 172.31.10.241:31209@30928,rediscl-huzdsq-shard-fwk-1.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local slave 6805dfae60f82469d32f167a0762f10b9fe532dc 0 1750332633528 6 connected 6805dfae60f82469d32f167a0762f10b9fe532dc 172.31.15.205:30964@30479,rediscl-huzdsq-shard-fwk-0.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local master - 0 1750332632523 6 connected 1365-5460 8193-9557 9a47e108282ae378589e88936924a2f36a944e1a 172.31.9.102:30626@31966,rediscl-huzdsq-shard-tt9-0.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local master - 0 1750332632523 7 connected 9558-10922 12288-16383 c6058467dfda4315243b459a9b0b2f392e4be33d 172.31.2.115:30697@30538,rediscl-huzdsq-shard-bfc-2.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local slave f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 0 1750332632000 14 connected --- 集群状态信息 --- cluster_state:ok cluster_slots_assigned:16384 cluster_slots_ok:16384 cluster_slots_pfail:0 cluster_slots_fail:0 cluster_known_nodes:9 cluster_size:3 cluster_current_epoch:14 cluster_my_epoch:7 cluster_stats_messages_ping_sent:180 cluster_stats_messages_pong_sent:49 cluster_stats_messages_meet_sent:4 cluster_stats_messages_sent:233 cluster_stats_messages_ping_received:49 cluster_stats_messages_pong_received:184 cluster_stats_messages_received:233 total_cluster_links_buffer_limit_exceeded:0 ========== 集群健康分析 ========== 使用节点 rediscl-huzdsq-shard-bfc-0 作为参考基准 检测到以下分片标识符: - bfc - fwk - tt9 警告: 节点 rediscl-huzdsq-shard-bfc-2 报告已知节点数为 '7'，与第一个节点报告的 '6' 不一致 警告: 节点 rediscl-huzdsq-shard-fwk-2 报告已知节点数为 '7'，与第一个节点报告的 '6' 不一致 警告: 节点 rediscl-huzdsq-shard-tt9-0 报告已知节点数为 '9'，与第一个节点报告的 '6' 不一致 警告: 节点 rediscl-huzdsq-shard-tt9-1 报告已知节点数为 '9'，与第一个节点报告的 '6' 不一致 警告: 节点 rediscl-huzdsq-shard-tt9-2 报告已知节点数为 '9'，与第一个节点报告的 '6' 不一致 参考节点观察到的拓扑结构: ID IP地址 状态 主节点ID 槽位 ---------------------------------------- ------------- ---------------- ---------------------------------------- -------------- 566610eaebef8ad78e4fa9a8957436093634de2c 172.31.15.205:31054 从节点 9a47e108282ae378589e88936924a2f36a944e1a a5d4fc43276d727e0f162488944b68ba7c1e439d 172.31.5.137:32496 从节点 f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 f1e5ba6810221fd9b7af42fc1ff2907eaed2b142 172.31.10.241:31209 从节点 6805dfae60f82469d32f167a0762f10b9fe532dc 9a47e108282ae378589e88936924a2f36a944e1a 172.31.9.102:30626 主节点 - 9558-10922 12288-16383 (共 0 个槽位) 6805dfae60f82469d32f167a0762f10b9fe532dc 172.31.15.205:30964 主节点 - 1365-5460 8193-9557 (共 0 个槽位) f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 172.31.9.102:32508 主节点 - 0-1364 5461-8192 10923-12287 (共 0 个槽位) 正在分析节点 rediscl-huzdsq-shard-bfc-1 的拓扑视图... 正在分析节点 rediscl-huzdsq-shard-bfc-2 的拓扑视图... 警告: 节点 rediscl-huzdsq-shard-bfc-2 看到 7 个节点，而参考节点看到 6 个节点 警告: 节点 rediscl-huzdsq-shard-bfc-2 看到 1 个节点，它们在参考节点视图中不存在 额外的节点详情: ID IP地址 状态 ---------------------------------------- ------------- ---------------- c6058467dfda4315243b459a9b0b2f392e4be33d 172.31.2.115:30697 从节点 正在分析节点 rediscl-huzdsq-shard-fwk-0 的拓扑视图... 正在分析节点 rediscl-huzdsq-shard-fwk-1 的拓扑视图... 正在分析节点 rediscl-huzdsq-shard-fwk-2 的拓扑视图... 警告: 节点 rediscl-huzdsq-shard-fwk-2 看到 7 个节点，而参考节点看到 6 个节点 警告: 节点 rediscl-huzdsq-shard-fwk-2 看到 1 个节点，它们在参考节点视图中不存在 额外的节点详情: ID IP地址 状态 ---------------------------------------- ------------- ---------------- ef4cb9a37cce0d498339d5804acdb0568e884d03 172.31.6.202:30352 从节点 正在分析节点 rediscl-huzdsq-shard-tt9-0 的拓扑视图... 警告: 节点 rediscl-huzdsq-shard-tt9-0 看到 9 个节点，而参考节点看到 6 个节点 警告: 节点 rediscl-huzdsq-shard-tt9-0 看到 3 个节点，它们在参考节点视图中不存在 额外的节点详情: ID IP地址 状态 ---------------------------------------- ------------- ---------------- ef4cb9a37cce0d498339d5804acdb0568e884d03 172.31.6.202:30352 从节点 c6058467dfda4315243b459a9b0b2f392e4be33d 172.31.2.115:30697 从节点 9951dde00cc9332b19e0d29ba02df6df5475ddb4 172.31.12.213:32418 从节点 正在分析节点 rediscl-huzdsq-shard-tt9-1 的拓扑视图... 警告: 节点 rediscl-huzdsq-shard-tt9-1 看到 9 个节点，而参考节点看到 6 个节点 警告: 节点 rediscl-huzdsq-shard-tt9-1 看到 3 个节点，它们在参考节点视图中不存在 额外的节点详情: ID IP地址 状态 ---------------------------------------- ------------- ---------------- c6058467dfda4315243b459a9b0b2f392e4be33d 172.31.2.115:30697 从节点 ef4cb9a37cce0d498339d5804acdb0568e884d03 172.31.6.202:30352 从节点 9951dde00cc9332b19e0d29ba02df6df5475ddb4 172.31.12.213:32418 从节点 正在分析节点 rediscl-huzdsq-shard-tt9-2 的拓扑视图... 警告: 节点 rediscl-huzdsq-shard-tt9-2 看到 9 个节点，而参考节点看到 6 个节点 警告: 节点 rediscl-huzdsq-shard-tt9-2 看到 3 个节点，它们在参考节点视图中不存在 额外的节点详情: ID IP地址 状态 ---------------------------------------- ------------- ---------------- ef4cb9a37cce0d498339d5804acdb0568e884d03 172.31.6.202:30352 从节点 9951dde00cc9332b19e0d29ba02df6df5475ddb4 172.31.12.213:32418 从节点 c6058467dfda4315243b459a9b0b2f392e4be33d 172.31.2.115:30697 从节点 槽位分配统计: - 总槽位数: 16384 - 未覆盖槽位数: 0 - 重复覆盖槽位数: 0 - 正确覆盖槽位数: 16384 主节点槽位分配明细: 节点 9a47e108282ae378589e88936924a2f36a944e1a (172.31.9.102:30626) 负责 0 个槽位: 9558-10922 12288-16383 节点 6805dfae60f82469d32f167a0762f10b9fe532dc (172.31.15.205:30964) 负责 0 个槽位: 1365-5460 8193-9557 节点 f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 (172.31.9.102:32508) 负责 0 个槽位: 0-1364 5461-8192 10923-12287 总计分配槽位: 0 / 16384 警告: 分配的总槽位数 (0) 不等于 16384 缺少 16384 个槽位分配 分片分析: 分片 bfc: 1 个主节点, 1 个从节点 ✅ 分片 fwk: 1 个主节点, 1 个从节点 ✅ 分片 tt9: 1 个主节点, 1 个从节点 ✅ 集群分析总结: - 检测到 3 个主节点和 3 个从节点 - 检测到 0 个故障或疑似故障节点 - 集群状态统一显示为OK: 是 - 所有槽位正确分配: 是 - 所有节点看到一致的集群大小: 否 - 所有节点看到一致的拓扑结构: 否 - 所有槽位被正确覆盖: 是 - 集群中无故障或疑似故障节点: 是 集群健康状态: 不健康 ❌ 检测到以下问题: - 集群视图不一致: 不同节点看到的集群大小或节点数量不同 - 拓扑结构不一致: 节点间对集群成员或角色的认知不一致 建议措施: 4. 使用 CLUSTER MEET 命令修复节点间的连接 5. 确保所有节点的配置(如cluster-announce-ip)正确 health analyzing... health analyzing... health analyzing... health analyzing... health analyzing... health analyzing... health analyzing... health analyzing... health analyzing... health analyzing... health analyzing... health analyzing... health analyzing... health analyzing... health analyzing... health analyzing... ========== 节点: rediscl-huzdsq-shard-bfc-0 ========== 检测到基础名称: rediscl-huzdsq-shard-bfc, 分片编号: 0 使用 Secret: rediscl-huzdsq-shard-bfc-account-default 密码获取成功，前缀: Xm... 使用Pod环境变量中的Redis端口: 6379 --- 集群节点信息 --- a5d4fc43276d727e0f162488944b68ba7c1e439d 172.31.5.137:32496@30676,rediscl-huzdsq-shard-bfc-0.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local myself,slave f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 0 1750332861000 14 connected 9951dde00cc9332b19e0d29ba02df6df5475ddb4 172.31.12.213:32418@31182,rediscl-huzdsq-shard-tt9-2.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local slave 9a47e108282ae378589e88936924a2f36a944e1a 0 1750332862509 7 connected f1e5ba6810221fd9b7af42fc1ff2907eaed2b142 172.31.10.241:31209@30928,rediscl-huzdsq-shard-fwk-1.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local slave 6805dfae60f82469d32f167a0762f10b9fe532dc 0 1750332860600 6 connected f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 172.31.9.102:32508@31084,rediscl-huzdsq-shard-bfc-1.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local master - 0 1750332862509 14 connected 0-1364 5461-8192 10923-12287 566610eaebef8ad78e4fa9a8957436093634de2c 172.31.15.205:31054@30545,rediscl-huzdsq-shard-tt9-1.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local slave 9a47e108282ae378589e88936924a2f36a944e1a 0 1750332862509 7 connected c6058467dfda4315243b459a9b0b2f392e4be33d 172.31.2.115:30697@30538,rediscl-huzdsq-shard-bfc-2.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local slave f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 0 1750332861505 14 connected ef4cb9a37cce0d498339d5804acdb0568e884d03 172.31.6.202:30352@32524,rediscl-huzdsq-shard-fwk-2.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local slave 6805dfae60f82469d32f167a0762f10b9fe532dc 0 1750332861606 6 connected 9a47e108282ae378589e88936924a2f36a944e1a 172.31.9.102:30626@31966,rediscl-huzdsq-shard-tt9-0.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local master - 0 1750332861000 7 connected 9558-10922 12288-16383 6805dfae60f82469d32f167a0762f10b9fe532dc 172.31.15.205:30964@30479,rediscl-huzdsq-shard-fwk-0.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local master - 0 1750332862610 6 connected 1365-5460 8193-9557 --- 集群状态信息 --- cluster_state:ok cluster_slots_assigned:16384 cluster_slots_ok:16384 cluster_slots_pfail:0 cluster_slots_fail:0 cluster_known_nodes:9 cluster_size:3 cluster_current_epoch:14 cluster_my_epoch:14 cluster_stats_messages_ping_sent:2272 cluster_stats_messages_pong_sent:2283 cluster_stats_messages_meet_sent:1 cluster_stats_messages_sent:4556 cluster_stats_messages_ping_received:2282 cluster_stats_messages_pong_received:2272 cluster_stats_messages_meet_received:1 cluster_stats_messages_received:4555 total_cluster_links_buffer_limit_exceeded:0 ========== 节点: rediscl-huzdsq-shard-bfc-1 ========== 检测到基础名称: rediscl-huzdsq-shard-bfc, 分片编号: 1 使用 Secret: rediscl-huzdsq-shard-bfc-account-default 密码获取成功，前缀: Xm... 使用Pod环境变量中的Redis端口: 6379 --- 集群节点信息 --- c6058467dfda4315243b459a9b0b2f392e4be33d 172.31.2.115:30697@30538,rediscl-huzdsq-shard-bfc-2.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local slave f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 0 1750332867000 14 connected f1e5ba6810221fd9b7af42fc1ff2907eaed2b142 172.31.10.241:31209@30928,rediscl-huzdsq-shard-fwk-1.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local slave 6805dfae60f82469d32f167a0762f10b9fe532dc 0 1750332867000 6 connected ef4cb9a37cce0d498339d5804acdb0568e884d03 172.31.6.202:30352@32524,rediscl-huzdsq-shard-fwk-2.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local slave 6805dfae60f82469d32f167a0762f10b9fe532dc 0 1750332867563 6 connected 9a47e108282ae378589e88936924a2f36a944e1a 172.31.9.102:30626@31966,rediscl-huzdsq-shard-tt9-0.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local master - 0 1750332868000 7 connected 9558-10922 12288-16383 a5d4fc43276d727e0f162488944b68ba7c1e439d 172.31.5.137:32496@30676,rediscl-huzdsq-shard-bfc-0.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local slave f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 0 1750332868568 14 connected 6805dfae60f82469d32f167a0762f10b9fe532dc 172.31.15.205:30964@30479,rediscl-huzdsq-shard-fwk-0.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local master - 0 1750332867563 6 connected 1365-5460 8193-9557 9951dde00cc9332b19e0d29ba02df6df5475ddb4 172.31.12.213:32418@31182,rediscl-huzdsq-shard-tt9-2.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local slave 9a47e108282ae378589e88936924a2f36a944e1a 0 1750332868066 7 connected f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 172.31.9.102:32508@31084,rediscl-huzdsq-shard-bfc-1.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local myself,master - 0 1750332867000 14 connected 0-1364 5461-8192 10923-12287 566610eaebef8ad78e4fa9a8957436093634de2c 172.31.15.205:31054@30545,rediscl-huzdsq-shard-tt9-1.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local slave 9a47e108282ae378589e88936924a2f36a944e1a 0 1750332867563 7 connected --- 集群状态信息 --- cluster_state:ok cluster_slots_assigned:16384 cluster_slots_ok:16384 cluster_slots_pfail:0 cluster_slots_fail:0 cluster_known_nodes:9 cluster_size:3 cluster_current_epoch:14 cluster_my_epoch:14 cluster_stats_messages_ping_sent:1078 cluster_stats_messages_pong_sent:1117 cluster_stats_messages_meet_sent:2 cluster_stats_messages_sent:2197 cluster_stats_messages_ping_received:1113 cluster_stats_messages_pong_received:1080 cluster_stats_messages_meet_received:4 cluster_stats_messages_received:2197 total_cluster_links_buffer_limit_exceeded:0 ========== 节点: rediscl-huzdsq-shard-bfc-2 ========== 检测到基础名称: rediscl-huzdsq-shard-bfc, 分片编号: 2 使用 Secret: rediscl-huzdsq-shard-bfc-account-default 密码获取成功，前缀: Xm... 使用Pod环境变量中的Redis端口: 6379 --- 集群节点信息 --- f1e5ba6810221fd9b7af42fc1ff2907eaed2b142 172.31.10.241:31209@30928,rediscl-huzdsq-shard-fwk-1.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local slave 6805dfae60f82469d32f167a0762f10b9fe532dc 0 1750332875000 6 connected f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 172.31.9.102:32508@31084,rediscl-huzdsq-shard-bfc-1.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local master - 0 1750332875510 14 connected 0-1364 5461-8192 10923-12287 c6058467dfda4315243b459a9b0b2f392e4be33d 172.31.2.115:30697@30538,rediscl-huzdsq-shard-bfc-2.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local myself,slave f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 0 1750332874000 14 connected a5d4fc43276d727e0f162488944b68ba7c1e439d 172.31.5.137:32496@30676,rediscl-huzdsq-shard-bfc-0.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local slave f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 0 1750332874000 14 connected 6805dfae60f82469d32f167a0762f10b9fe532dc 172.31.15.205:30964@30479,rediscl-huzdsq-shard-fwk-0.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local master - 0 1750332875000 6 connected 1365-5460 8193-9557 9951dde00cc9332b19e0d29ba02df6df5475ddb4 172.31.12.213:32418@31182,rediscl-huzdsq-shard-tt9-2.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local slave 9a47e108282ae378589e88936924a2f36a944e1a 0 1750332874303 7 connected 9a47e108282ae378589e88936924a2f36a944e1a 172.31.9.102:30626@31966,rediscl-huzdsq-shard-tt9-0.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local master - 0 1750332874000 7 connected 9558-10922 12288-16383 566610eaebef8ad78e4fa9a8957436093634de2c 172.31.15.205:31054@30545,rediscl-huzdsq-shard-tt9-1.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local slave 9a47e108282ae378589e88936924a2f36a944e1a 0 1750332874000 7 connected ef4cb9a37cce0d498339d5804acdb0568e884d03 172.31.6.202:30352@32524,rediscl-huzdsq-shard-fwk-2.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local slave 6805dfae60f82469d32f167a0762f10b9fe532dc 0 1750332875812 6 connected --- 集群状态信息 --- cluster_state:ok cluster_slots_assigned:16384 cluster_slots_ok:16384 cluster_slots_pfail:0 cluster_slots_fail:0 cluster_known_nodes:9 cluster_size:3 cluster_current_epoch:14 cluster_my_epoch:14 cluster_stats_messages_ping_sent:820 cluster_stats_messages_pong_sent:698 cluster_stats_messages_meet_sent:4 cluster_stats_messages_sent:1522 cluster_stats_messages_ping_received:698 cluster_stats_messages_pong_received:824 cluster_stats_messages_received:1522 total_cluster_links_buffer_limit_exceeded:0 ========== 节点: rediscl-huzdsq-shard-fwk-0 ========== 检测到基础名称: rediscl-huzdsq-shard-fwk, 分片编号: 0 使用 Secret: rediscl-huzdsq-shard-fwk-account-default 密码获取成功，前缀: Xm... 使用Pod环境变量中的Redis端口: 6379 --- 集群节点信息 --- 9951dde00cc9332b19e0d29ba02df6df5475ddb4 172.31.12.213:32418@31182,rediscl-huzdsq-shard-tt9-2.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local slave 9a47e108282ae378589e88936924a2f36a944e1a 0 1750332880542 7 connected 6805dfae60f82469d32f167a0762f10b9fe532dc 172.31.15.205:30964@30479,rediscl-huzdsq-shard-fwk-0.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local myself,master - 0 1750332880000 6 connected 1365-5460 8193-9557 f1e5ba6810221fd9b7af42fc1ff2907eaed2b142 172.31.10.241:31209@30928,rediscl-huzdsq-shard-fwk-1.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local slave 6805dfae60f82469d32f167a0762f10b9fe532dc 0 1750332881000 6 connected ef4cb9a37cce0d498339d5804acdb0568e884d03 172.31.6.202:30352@32524,rediscl-huzdsq-shard-fwk-2.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local slave 6805dfae60f82469d32f167a0762f10b9fe532dc 0 1750332881000 6 connected 9a47e108282ae378589e88936924a2f36a944e1a 172.31.9.102:30626@31966,rediscl-huzdsq-shard-tt9-0.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local master - 0 1750332881646 7 connected 9558-10922 12288-16383 f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 172.31.9.102:32508@31084,rediscl-huzdsq-shard-bfc-1.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local master - 0 1750332882048 14 connected 0-1364 5461-8192 10923-12287 a5d4fc43276d727e0f162488944b68ba7c1e439d 172.31.5.137:32496@30676,rediscl-huzdsq-shard-bfc-0.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local slave f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 0 1750332882551 14 connected 566610eaebef8ad78e4fa9a8957436093634de2c 172.31.15.205:31054@30545,rediscl-huzdsq-shard-tt9-1.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local slave 9a47e108282ae378589e88936924a2f36a944e1a 0 1750332881445 7 connected c6058467dfda4315243b459a9b0b2f392e4be33d 172.31.2.115:30697@30538,rediscl-huzdsq-shard-bfc-2.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local slave f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 0 1750332882453 14 connected --- 集群状态信息 --- cluster_state:ok cluster_slots_assigned:16384 cluster_slots_ok:16384 cluster_slots_pfail:0 cluster_slots_fail:0 cluster_known_nodes:9 cluster_size:3 cluster_current_epoch:14 cluster_my_epoch:6 cluster_stats_messages_ping_sent:3039 cluster_stats_messages_pong_sent:3082 cluster_stats_messages_meet_sent:2 cluster_stats_messages_fail_sent:22 cluster_stats_messages_auth-ack_sent:1 cluster_stats_messages_sent:6146 cluster_stats_messages_ping_received:3074 cluster_stats_messages_pong_received:3035 cluster_stats_messages_meet_received:8 cluster_stats_messages_fail_received:15 cluster_stats_messages_auth-req_received:1 cluster_stats_messages_received:6133 total_cluster_links_buffer_limit_exceeded:0 ========== 节点: rediscl-huzdsq-shard-fwk-1 ========== 检测到基础名称: rediscl-huzdsq-shard-fwk, 分片编号: 1 使用 Secret: rediscl-huzdsq-shard-fwk-account-default 密码获取成功，前缀: Xm... 使用Pod环境变量中的Redis端口: 6379 --- 集群节点信息 --- f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 172.31.9.102:32508@31084,rediscl-huzdsq-shard-bfc-1.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local master - 0 1750332888000 14 connected 0-1364 5461-8192 10923-12287 9a47e108282ae378589e88936924a2f36a944e1a 172.31.9.102:30626@31966,rediscl-huzdsq-shard-tt9-0.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local master - 0 1750332887545 7 connected 9558-10922 12288-16383 f1e5ba6810221fd9b7af42fc1ff2907eaed2b142 172.31.10.241:31209@30928,rediscl-huzdsq-shard-fwk-1.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local myself,slave 6805dfae60f82469d32f167a0762f10b9fe532dc 0 1750332886000 6 connected 9951dde00cc9332b19e0d29ba02df6df5475ddb4 172.31.12.213:32418@31182,rediscl-huzdsq-shard-tt9-2.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local slave 9a47e108282ae378589e88936924a2f36a944e1a 0 1750332888000 7 connected 566610eaebef8ad78e4fa9a8957436093634de2c 172.31.15.205:31054@30545,rediscl-huzdsq-shard-tt9-1.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local slave 9a47e108282ae378589e88936924a2f36a944e1a 0 1750332889054 7 connected c6058467dfda4315243b459a9b0b2f392e4be33d 172.31.2.115:30697@30538,rediscl-huzdsq-shard-bfc-2.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local slave f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 0 1750332888556 14 connected a5d4fc43276d727e0f162488944b68ba7c1e439d 172.31.5.137:32496@30676,rediscl-huzdsq-shard-bfc-0.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local slave f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 0 1750332887043 14 connected ef4cb9a37cce0d498339d5804acdb0568e884d03 172.31.6.202:30352@32524,rediscl-huzdsq-shard-fwk-2.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local slave 6805dfae60f82469d32f167a0762f10b9fe532dc 0 1750332888552 6 connected 6805dfae60f82469d32f167a0762f10b9fe532dc 172.31.15.205:30964@30479,rediscl-huzdsq-shard-fwk-0.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local master - 0 1750332889054 6 connected 1365-5460 8193-9557 --- 集群状态信息 --- cluster_state:ok cluster_slots_assigned:16384 cluster_slots_ok:16384 cluster_slots_pfail:0 cluster_slots_fail:0 cluster_known_nodes:9 cluster_size:3 cluster_current_epoch:14 cluster_my_epoch:6 cluster_stats_messages_ping_sent:2993 cluster_stats_messages_pong_sent:3053 cluster_stats_messages_meet_sent:1 cluster_stats_messages_fail_sent:10 cluster_stats_messages_sent:6057 cluster_stats_messages_ping_received:3053 cluster_stats_messages_pong_received:2991 cluster_stats_messages_fail_received:3 cluster_stats_messages_auth-req_received:1 cluster_stats_messages_received:6048 total_cluster_links_buffer_limit_exceeded:0 ========== 节点: rediscl-huzdsq-shard-fwk-2 ========== 检测到基础名称: rediscl-huzdsq-shard-fwk, 分片编号: 2 使用 Secret: rediscl-huzdsq-shard-fwk-account-default 密码获取成功，前缀: Xm... 使用Pod环境变量中的Redis端口: 6379 --- 集群节点信息 --- 9951dde00cc9332b19e0d29ba02df6df5475ddb4 172.31.12.213:32418@31182,rediscl-huzdsq-shard-tt9-2.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local slave 9a47e108282ae378589e88936924a2f36a944e1a 0 1750332895000 7 connected ef4cb9a37cce0d498339d5804acdb0568e884d03 172.31.6.202:30352@32524,rediscl-huzdsq-shard-fwk-2.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local myself,slave 6805dfae60f82469d32f167a0762f10b9fe532dc 0 1750332894000 6 connected 6805dfae60f82469d32f167a0762f10b9fe532dc 172.31.15.205:30964@30479,rediscl-huzdsq-shard-fwk-0.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local master - 0 1750332895048 6 connected 1365-5460 8193-9557 f1e5ba6810221fd9b7af42fc1ff2907eaed2b142 172.31.10.241:31209@30928,rediscl-huzdsq-shard-fwk-1.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local slave 6805dfae60f82469d32f167a0762f10b9fe532dc 0 1750332895051 6 connected f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 172.31.9.102:32508@31084,rediscl-huzdsq-shard-bfc-1.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local master - 0 1750332895550 14 connected 0-1364 5461-8192 10923-12287 a5d4fc43276d727e0f162488944b68ba7c1e439d 172.31.5.137:32496@30676,rediscl-huzdsq-shard-bfc-0.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local slave f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 0 1750332895048 14 connected 566610eaebef8ad78e4fa9a8957436093634de2c 172.31.15.205:31054@30545,rediscl-huzdsq-shard-tt9-1.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local slave 9a47e108282ae378589e88936924a2f36a944e1a 0 1750332894000 7 connected c6058467dfda4315243b459a9b0b2f392e4be33d 172.31.2.115:30697@30538,rediscl-huzdsq-shard-bfc-2.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local slave f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 0 1750332894000 14 connected 9a47e108282ae378589e88936924a2f36a944e1a 172.31.9.102:30626@31966,rediscl-huzdsq-shard-tt9-0.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local master - 0 1750332896052 7 connected 9558-10922 12288-16383 --- 集群状态信息 --- cluster_state:ok cluster_slots_assigned:16384 cluster_slots_ok:16384 cluster_slots_pfail:0 cluster_slots_fail:0 cluster_known_nodes:9 cluster_size:3 cluster_current_epoch:14 cluster_my_epoch:6 cluster_stats_messages_ping_sent:899 cluster_stats_messages_pong_sent:774 cluster_stats_messages_meet_sent:4 cluster_stats_messages_sent:1677 cluster_stats_messages_ping_received:774 cluster_stats_messages_pong_received:903 cluster_stats_messages_received:1677 total_cluster_links_buffer_limit_exceeded:0 ========== 节点: rediscl-huzdsq-shard-tt9-0 ========== 检测到基础名称: rediscl-huzdsq-shard-tt9, 分片编号: 0 使用 Secret: rediscl-huzdsq-shard-tt9-account-default 密码获取成功，前缀: Xm... 使用Pod环境变量中的Redis端口: 6379 --- 集群节点信息 --- a5d4fc43276d727e0f162488944b68ba7c1e439d 172.31.5.137:32496@30676,rediscl-huzdsq-shard-bfc-0.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local slave f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 0 1750332901000 14 connected 566610eaebef8ad78e4fa9a8957436093634de2c 172.31.15.205:31054@30545,rediscl-huzdsq-shard-tt9-1.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local slave 9a47e108282ae378589e88936924a2f36a944e1a 0 1750332901924 7 connected ef4cb9a37cce0d498339d5804acdb0568e884d03 172.31.6.202:30352@32524,rediscl-huzdsq-shard-fwk-2.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local slave 6805dfae60f82469d32f167a0762f10b9fe532dc 0 1750332901522 6 connected 6805dfae60f82469d32f167a0762f10b9fe532dc 172.31.15.205:30964@30479,rediscl-huzdsq-shard-fwk-0.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local master - 0 1750332902527 6 connected 1365-5460 8193-9557 f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 172.31.9.102:32508@31084,rediscl-huzdsq-shard-bfc-1.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local master - 0 1750332901000 14 connected 0-1364 5461-8192 10923-12287 c6058467dfda4315243b459a9b0b2f392e4be33d 172.31.2.115:30697@30538,rediscl-huzdsq-shard-bfc-2.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local slave f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 0 1750332901000 14 connected 9a47e108282ae378589e88936924a2f36a944e1a 172.31.9.102:30626@31966,rediscl-huzdsq-shard-tt9-0.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local myself,master - 0 1750332900000 7 connected 9558-10922 12288-16383 f1e5ba6810221fd9b7af42fc1ff2907eaed2b142 172.31.10.241:31209@30928,rediscl-huzdsq-shard-fwk-1.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local slave 6805dfae60f82469d32f167a0762f10b9fe532dc 0 1750332901000 6 connected 9951dde00cc9332b19e0d29ba02df6df5475ddb4 172.31.12.213:32418@31182,rediscl-huzdsq-shard-tt9-2.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local slave 9a47e108282ae378589e88936924a2f36a944e1a 0 1750332900515 7 connected --- 集群状态信息 --- cluster_state:ok cluster_slots_assigned:16384 cluster_slots_ok:16384 cluster_slots_pfail:0 cluster_slots_fail:0 cluster_known_nodes:9 cluster_size:3 cluster_current_epoch:14 cluster_my_epoch:7 cluster_stats_messages_ping_sent:3035 cluster_stats_messages_pong_sent:3087 cluster_stats_messages_meet_sent:2 cluster_stats_messages_fail_sent:25 cluster_stats_messages_auth-ack_sent:1 cluster_stats_messages_sent:6150 cluster_stats_messages_ping_received:3079 cluster_stats_messages_pong_received:3031 cluster_stats_messages_meet_received:8 cluster_stats_messages_fail_received:7 cluster_stats_messages_auth-req_received:1 cluster_stats_messages_received:6126 total_cluster_links_buffer_limit_exceeded:0 ========== 节点: rediscl-huzdsq-shard-tt9-1 ========== 检测到基础名称: rediscl-huzdsq-shard-tt9, 分片编号: 1 使用 Secret: rediscl-huzdsq-shard-tt9-account-default 密码获取成功，前缀: Xm... 使用Pod环境变量中的Redis端口: 6379 --- 集群节点信息 --- 6805dfae60f82469d32f167a0762f10b9fe532dc 172.31.15.205:30964@30479,rediscl-huzdsq-shard-fwk-0.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local master - 0 1750332907984 6 connected 1365-5460 8193-9557 f1e5ba6810221fd9b7af42fc1ff2907eaed2b142 172.31.10.241:31209@30928,rediscl-huzdsq-shard-fwk-1.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local slave 6805dfae60f82469d32f167a0762f10b9fe532dc 0 1750332908988 6 connected 566610eaebef8ad78e4fa9a8957436093634de2c 172.31.15.205:31054@30545,rediscl-huzdsq-shard-tt9-1.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local myself,slave 9a47e108282ae378589e88936924a2f36a944e1a 0 1750332907000 7 connected 9a47e108282ae378589e88936924a2f36a944e1a 172.31.9.102:30626@31966,rediscl-huzdsq-shard-tt9-0.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local master - 0 1750332908486 7 connected 9558-10922 12288-16383 c6058467dfda4315243b459a9b0b2f392e4be33d 172.31.2.115:30697@30538,rediscl-huzdsq-shard-bfc-2.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local slave f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 0 1750332909089 14 connected ef4cb9a37cce0d498339d5804acdb0568e884d03 172.31.6.202:30352@32524,rediscl-huzdsq-shard-fwk-2.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local slave 6805dfae60f82469d32f167a0762f10b9fe532dc 0 1750332908000 6 connected 9951dde00cc9332b19e0d29ba02df6df5475ddb4 172.31.12.213:32418@31182,rediscl-huzdsq-shard-tt9-2.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local slave 9a47e108282ae378589e88936924a2f36a944e1a 0 1750332908000 7 connected a5d4fc43276d727e0f162488944b68ba7c1e439d 172.31.5.137:32496@30676,rediscl-huzdsq-shard-bfc-0.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local slave f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 0 1750332908000 14 connected f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 172.31.9.102:32508@31084,rediscl-huzdsq-shard-bfc-1.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local master - 0 1750332908000 14 connected 0-1364 5461-8192 10923-12287 --- 集群状态信息 --- cluster_state:ok cluster_slots_assigned:16384 cluster_slots_ok:16384 cluster_slots_pfail:0 cluster_slots_fail:0 cluster_known_nodes:9 cluster_size:3 cluster_current_epoch:14 cluster_my_epoch:7 cluster_stats_messages_ping_sent:3049 cluster_stats_messages_pong_sent:3112 cluster_stats_messages_meet_sent:1 cluster_stats_messages_fail_sent:10 cluster_stats_messages_sent:6172 cluster_stats_messages_ping_received:3112 cluster_stats_messages_pong_received:3047 cluster_stats_messages_fail_received:2 cluster_stats_messages_auth-req_received:1 cluster_stats_messages_received:6162 total_cluster_links_buffer_limit_exceeded:0 ========== 节点: rediscl-huzdsq-shard-tt9-2 ========== 检测到基础名称: rediscl-huzdsq-shard-tt9, 分片编号: 2 使用 Secret: rediscl-huzdsq-shard-tt9-account-default 密码获取成功，前缀: Xm... 使用Pod环境变量中的Redis端口: 6379 --- 集群节点信息 --- 566610eaebef8ad78e4fa9a8957436093634de2c 172.31.15.205:31054@30545,rediscl-huzdsq-shard-tt9-1.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local slave 9a47e108282ae378589e88936924a2f36a944e1a 0 1750332914577 7 connected a5d4fc43276d727e0f162488944b68ba7c1e439d 172.31.5.137:32496@30676,rediscl-huzdsq-shard-bfc-0.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local slave f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 0 1750332914000 14 connected f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 172.31.9.102:32508@31084,rediscl-huzdsq-shard-bfc-1.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local master - 0 1750332914000 14 connected 0-1364 5461-8192 10923-12287 ef4cb9a37cce0d498339d5804acdb0568e884d03 172.31.6.202:30352@32524,rediscl-huzdsq-shard-fwk-2.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local slave 6805dfae60f82469d32f167a0762f10b9fe532dc 0 1750332914000 6 connected 9951dde00cc9332b19e0d29ba02df6df5475ddb4 172.31.12.213:32418@31182,rediscl-huzdsq-shard-tt9-2.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local myself,slave 9a47e108282ae378589e88936924a2f36a944e1a 0 1750332912000 7 connected f1e5ba6810221fd9b7af42fc1ff2907eaed2b142 172.31.10.241:31209@30928,rediscl-huzdsq-shard-fwk-1.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local slave 6805dfae60f82469d32f167a0762f10b9fe532dc 0 1750332915280 6 connected 6805dfae60f82469d32f167a0762f10b9fe532dc 172.31.15.205:30964@30479,rediscl-huzdsq-shard-fwk-0.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local master - 0 1750332914000 6 connected 1365-5460 8193-9557 9a47e108282ae378589e88936924a2f36a944e1a 172.31.9.102:30626@31966,rediscl-huzdsq-shard-tt9-0.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local master - 0 1750332913570 7 connected 9558-10922 12288-16383 c6058467dfda4315243b459a9b0b2f392e4be33d 172.31.2.115:30697@30538,rediscl-huzdsq-shard-bfc-2.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local slave f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 0 1750332914274 14 connected --- 集群状态信息 --- cluster_state:ok cluster_slots_assigned:16384 cluster_slots_ok:16384 cluster_slots_pfail:0 cluster_slots_fail:0 cluster_known_nodes:9 cluster_size:3 cluster_current_epoch:14 cluster_my_epoch:7 cluster_stats_messages_ping_sent:930 cluster_stats_messages_pong_sent:821 cluster_stats_messages_meet_sent:4 cluster_stats_messages_sent:1755 cluster_stats_messages_ping_received:821 cluster_stats_messages_pong_received:934 cluster_stats_messages_received:1755 total_cluster_links_buffer_limit_exceeded:0 ========== 集群健康分析 ========== 使用节点 rediscl-huzdsq-shard-bfc-0 作为参考基准 检测到以下分片标识符: - bfc - fwk - tt9 参考节点观察到的拓扑结构: ID IP地址 状态 主节点ID 槽位 ---------------------------------------- ------------- ---------------- ---------------------------------------- -------------- a5d4fc43276d727e0f162488944b68ba7c1e439d 172.31.5.137:32496 从节点 f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 9951dde00cc9332b19e0d29ba02df6df5475ddb4 172.31.12.213:32418 从节点 9a47e108282ae378589e88936924a2f36a944e1a f1e5ba6810221fd9b7af42fc1ff2907eaed2b142 172.31.10.241:31209 从节点 6805dfae60f82469d32f167a0762f10b9fe532dc f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 172.31.9.102:32508 主节点 - 0-1364 5461-8192 10923-12287 (共 0 个槽位) 566610eaebef8ad78e4fa9a8957436093634de2c 172.31.15.205:31054 从节点 9a47e108282ae378589e88936924a2f36a944e1a c6058467dfda4315243b459a9b0b2f392e4be33d 172.31.2.115:30697 从节点 f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 ef4cb9a37cce0d498339d5804acdb0568e884d03 172.31.6.202:30352 从节点 6805dfae60f82469d32f167a0762f10b9fe532dc 9a47e108282ae378589e88936924a2f36a944e1a 172.31.9.102:30626 主节点 - 9558-10922 12288-16383 (共 0 个槽位) 6805dfae60f82469d32f167a0762f10b9fe532dc 172.31.15.205:30964 主节点 - 1365-5460 8193-9557 (共 0 个槽位) 正在分析节点 rediscl-huzdsq-shard-bfc-1 的拓扑视图... 正在分析节点 rediscl-huzdsq-shard-bfc-2 的拓扑视图... 正在分析节点 rediscl-huzdsq-shard-fwk-0 的拓扑视图... 正在分析节点 rediscl-huzdsq-shard-fwk-1 的拓扑视图... 正在分析节点 rediscl-huzdsq-shard-fwk-2 的拓扑视图... 正在分析节点 rediscl-huzdsq-shard-tt9-0 的拓扑视图... 正在分析节点 rediscl-huzdsq-shard-tt9-1 的拓扑视图... 正在分析节点 rediscl-huzdsq-shard-tt9-2 的拓扑视图... 槽位分配统计: - 总槽位数: 16384 - 未覆盖槽位数: 0 - 重复覆盖槽位数: 0 - 正确覆盖槽位数: 16384 主节点槽位分配明细: 节点 f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 (172.31.9.102:32508) 负责 0 个槽位: 0-1364 5461-8192 10923-12287 节点 9a47e108282ae378589e88936924a2f36a944e1a (172.31.9.102:30626) 负责 0 个槽位: 9558-10922 12288-16383 节点 6805dfae60f82469d32f167a0762f10b9fe532dc (172.31.15.205:30964) 负责 0 个槽位: 1365-5460 8193-9557 总计分配槽位: 0 / 16384 警告: 分配的总槽位数 (0) 不等于 16384 缺少 16384 个槽位分配 分片分析: 分片 bfc: 1 个主节点, 2 个从节点 ✅ 分片 fwk: 1 个主节点, 2 个从节点 ✅ 分片 tt9: 1 个主节点, 2 个从节点 ✅ 集群分析总结: - 检测到 3 个主节点和 6 个从节点 - 检测到 0 个故障或疑似故障节点 - 集群状态统一显示为OK: 是 - 所有槽位正确分配: 是 - 所有节点看到一致的集群大小: 是 - 所有节点看到一致的拓扑结构: 是 - 所有槽位被正确覆盖: 是 - 集群中无故障或疑似故障节点: 是 集群健康状态: 健康 ✅ 所有检查均通过，Redis集群运行正常。 analyze cluster health success No resources found in rediscl-huzdsq namespace. check ops status `kbcli cluster list-ops rediscl-huzdsq --status all --namespace ns-xqred ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME rediscl-huzdsq-horizontalscaling-4nnnm ns-xqred HorizontalScaling rediscl-huzdsq shard Succeed 3/3 Jun 19,2025 19:29 UTC+0800 check ops status done ops_status:rediscl-huzdsq-horizontalscaling-4nnnm ns-xqred HorizontalScaling rediscl-huzdsq shard Succeed 3/3 Jun 19,2025 19:29 UTC+0800 `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge opsrequests rediscl-huzdsq-horizontalscaling-4nnnm --namespace ns-xqred ` opsrequest.apps.kubeblocks.io/rediscl-huzdsq-horizontalscaling-4nnnm patched `kbcli cluster delete-ops --name rediscl-huzdsq-horizontalscaling-4nnnm --force --auto-approve --namespace ns-xqred ` OpsRequest rediscl-huzdsq-horizontalscaling-4nnnm deleted cluster hscale check cluster status before ops check cluster status done cluster_status:Running No resources found in rediscl-huzdsq namespace. `kbcli cluster hscale rediscl-huzdsq --auto-approve --force=true --components shard --replicas 2 --namespace ns-xqred ` OpsRequest rediscl-huzdsq-horizontalscaling-xbr8z created successfully, you can view the progress: kbcli cluster describe-ops rediscl-huzdsq-horizontalscaling-xbr8z -n ns-xqred check ops status `kbcli cluster list-ops rediscl-huzdsq --status all --namespace ns-xqred ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME rediscl-huzdsq-horizontalscaling-xbr8z ns-xqred HorizontalScaling rediscl-huzdsq shard Running 0/3 Jun 19,2025 19:36 UTC+0800 check cluster status `kbcli cluster list rediscl-huzdsq --show-labels --namespace ns-xqred ` NAME NAMESPACE CLUSTER-DEFINITION VERSION TERMINATION-POLICY STATUS CREATED-TIME LABELS rediscl-huzdsq ns-xqred Halt Running Jun 19,2025 18:15 UTC+0800 app.kubernetes.io/instance=rediscl-huzdsq check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances rediscl-huzdsq --namespace ns-xqred ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME rediscl-huzdsq-shard-bfc-0 ns-xqred rediscl-huzdsq shard-bfc Running secondary us-west-2a 200m / 200m 644245094400m / 644245094400m ip-172-31-5-137.us-west-2.compute.internal/172.31.5.137 Jun 19,2025 19:15 UTC+0800 rediscl-huzdsq-shard-bfc-1 ns-xqred rediscl-huzdsq shard-bfc Running primary us-west-2a 200m / 200m 644245094400m / 644245094400m ip-172-31-9-102.us-west-2.compute.internal/172.31.9.102 Jun 19,2025 19:09 UTC+0800 rediscl-huzdsq-shard-fwk-0 ns-xqred rediscl-huzdsq shard-fwk Running primary us-west-2a 200m / 200m 644245094400m / 644245094400m ip-172-31-15-205.us-west-2.compute.internal/172.31.15.205 Jun 19,2025 19:09 UTC+0800 rediscl-huzdsq-shard-fwk-1 ns-xqred rediscl-huzdsq shard-fwk Running secondary us-west-2a 200m / 200m 644245094400m / 644245094400m ip-172-31-10-241.us-west-2.compute.internal/172.31.10.241 Jun 19,2025 19:09 UTC+0800 rediscl-huzdsq-shard-tt9-0 ns-xqred rediscl-huzdsq shard-tt9 Running primary us-west-2a 200m / 200m 644245094400m / 644245094400m ip-172-31-9-102.us-west-2.compute.internal/172.31.9.102 Jun 19,2025 19:09 UTC+0800 rediscl-huzdsq-shard-tt9-1 ns-xqred rediscl-huzdsq shard-tt9 Running secondary us-west-2a 200m / 200m 644245094400m / 644245094400m ip-172-31-15-205.us-west-2.compute.internal/172.31.15.205 Jun 19,2025 19:09 UTC+0800 check pod status done check cluster role check cluster role done primary: rediscl-huzdsq-shard-bfc-1 rediscl-huzdsq-shard-fwk-0 rediscl-huzdsq-shard-tt9-0;secondary: rediscl-huzdsq-shard-bfc-0 rediscl-huzdsq-shard-fwk-1 rediscl-huzdsq-shard-tt9-1 analyze cluster health check cluster connect `` ========== 节点: rediscl-huzdsq-shard-bfc-0 ========== 检测到基础名称: rediscl-huzdsq-shard-bfc, 分片编号: 0 使用 Secret: rediscl-huzdsq-shard-bfc-account-default 密码获取成功，前缀: Xm... 使用Pod环境变量中的Redis端口: 6379 --- 集群节点信息 --- a5d4fc43276d727e0f162488944b68ba7c1e439d 172.31.5.137:32496@30676,rediscl-huzdsq-shard-bfc-0.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local myself,slave f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 0 1750333014000 14 connected f1e5ba6810221fd9b7af42fc1ff2907eaed2b142 172.31.10.241:31209@30928,rediscl-huzdsq-shard-fwk-1.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local slave 6805dfae60f82469d32f167a0762f10b9fe532dc 0 1750333014545 6 connected f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 172.31.9.102:32508@31084,rediscl-huzdsq-shard-bfc-1.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local master - 0 1750333014444 14 connected 0-1364 5461-8192 10923-12287 566610eaebef8ad78e4fa9a8957436093634de2c 172.31.15.205:31054@30545,rediscl-huzdsq-shard-tt9-1.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local slave 9a47e108282ae378589e88936924a2f36a944e1a 0 1750333015450 7 connected 9a47e108282ae378589e88936924a2f36a944e1a 172.31.9.102:30626@31966,rediscl-huzdsq-shard-tt9-0.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local master - 0 1750333014042 7 connected 9558-10922 12288-16383 6805dfae60f82469d32f167a0762f10b9fe532dc 172.31.15.205:30964@30479,rediscl-huzdsq-shard-fwk-0.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local master - 0 1750333015000 6 connected 1365-5460 8193-9557 --- 集群状态信息 --- cluster_state:ok cluster_slots_assigned:16384 cluster_slots_ok:16384 cluster_slots_pfail:0 cluster_slots_fail:0 cluster_known_nodes:6 cluster_size:3 cluster_current_epoch:14 cluster_my_epoch:14 cluster_stats_messages_ping_sent:2662 cluster_stats_messages_pong_sent:2663 cluster_stats_messages_meet_sent:1 cluster_stats_messages_sent:5326 cluster_stats_messages_ping_received:2662 cluster_stats_messages_pong_received:2662 cluster_stats_messages_meet_received:1 cluster_stats_messages_received:5325 total_cluster_links_buffer_limit_exceeded:0 ========== 节点: rediscl-huzdsq-shard-bfc-1 ========== 检测到基础名称: rediscl-huzdsq-shard-bfc, 分片编号: 1 使用 Secret: rediscl-huzdsq-shard-bfc-account-default 密码获取成功，前缀: Xm... 使用Pod环境变量中的Redis端口: 6379 --- 集群节点信息 --- f1e5ba6810221fd9b7af42fc1ff2907eaed2b142 172.31.10.241:31209@30928,rediscl-huzdsq-shard-fwk-1.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local slave 6805dfae60f82469d32f167a0762f10b9fe532dc 0 1750333022000 6 connected 9a47e108282ae378589e88936924a2f36a944e1a 172.31.9.102:30626@31966,rediscl-huzdsq-shard-tt9-0.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local master - 0 1750333022564 7 connected 9558-10922 12288-16383 a5d4fc43276d727e0f162488944b68ba7c1e439d 172.31.5.137:32496@30676,rediscl-huzdsq-shard-bfc-0.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local slave f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 0 1750333020454 14 connected 6805dfae60f82469d32f167a0762f10b9fe532dc 172.31.15.205:30964@30479,rediscl-huzdsq-shard-fwk-0.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local master - 0 1750333022464 6 connected 1365-5460 8193-9557 f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 172.31.9.102:32508@31084,rediscl-huzdsq-shard-bfc-1.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local myself,master - 0 1750333022000 14 connected 0-1364 5461-8192 10923-12287 566610eaebef8ad78e4fa9a8957436093634de2c 172.31.15.205:31054@30545,rediscl-huzdsq-shard-tt9-1.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local slave 9a47e108282ae378589e88936924a2f36a944e1a 0 1750333022000 7 connected --- 集群状态信息 --- cluster_state:ok cluster_slots_assigned:16384 cluster_slots_ok:16384 cluster_slots_pfail:0 cluster_slots_fail:0 cluster_known_nodes:6 cluster_size:3 cluster_current_epoch:14 cluster_my_epoch:14 cluster_stats_messages_ping_sent:1463 cluster_stats_messages_pong_sent:1498 cluster_stats_messages_meet_sent:2 cluster_stats_messages_sent:2963 cluster_stats_messages_ping_received:1494 cluster_stats_messages_pong_received:1465 cluster_stats_messages_meet_received:4 cluster_stats_messages_received:2963 total_cluster_links_buffer_limit_exceeded:0 ========== 节点: rediscl-huzdsq-shard-fwk-0 ========== 检测到基础名称: rediscl-huzdsq-shard-fwk, 分片编号: 0 使用 Secret: rediscl-huzdsq-shard-fwk-account-default 密码获取成功，前缀: Xm... 使用Pod环境变量中的Redis端口: 6379 --- 集群节点信息 --- 6805dfae60f82469d32f167a0762f10b9fe532dc 172.31.15.205:30964@30479,rediscl-huzdsq-shard-fwk-0.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local myself,master - 0 1750333027000 6 connected 1365-5460 8193-9557 f1e5ba6810221fd9b7af42fc1ff2907eaed2b142 172.31.10.241:31209@30928,rediscl-huzdsq-shard-fwk-1.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local slave 6805dfae60f82469d32f167a0762f10b9fe532dc 0 1750333028000 6 connected 9a47e108282ae378589e88936924a2f36a944e1a 172.31.9.102:30626@31966,rediscl-huzdsq-shard-tt9-0.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local master - 0 1750333029230 7 connected 9558-10922 12288-16383 f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 172.31.9.102:32508@31084,rediscl-huzdsq-shard-bfc-1.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local master - 0 1750333028226 14 connected 0-1364 5461-8192 10923-12287 a5d4fc43276d727e0f162488944b68ba7c1e439d 172.31.5.137:32496@30676,rediscl-huzdsq-shard-bfc-0.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local slave f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 0 1750333027622 14 connected 566610eaebef8ad78e4fa9a8957436093634de2c 172.31.15.205:31054@30545,rediscl-huzdsq-shard-tt9-1.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local slave 9a47e108282ae378589e88936924a2f36a944e1a 0 1750333029000 7 connected --- 集群状态信息 --- cluster_state:ok cluster_slots_assigned:16384 cluster_slots_ok:16384 cluster_slots_pfail:0 cluster_slots_fail:0 cluster_known_nodes:6 cluster_size:3 cluster_current_epoch:14 cluster_my_epoch:6 cluster_stats_messages_ping_sent:3406 cluster_stats_messages_pong_sent:3431 cluster_stats_messages_meet_sent:2 cluster_stats_messages_fail_sent:22 cluster_stats_messages_auth-ack_sent:1 cluster_stats_messages_sent:6862 cluster_stats_messages_ping_received:3423 cluster_stats_messages_pong_received:3402 cluster_stats_messages_meet_received:8 cluster_stats_messages_fail_received:15 cluster_stats_messages_auth-req_received:1 cluster_stats_messages_received:6849 total_cluster_links_buffer_limit_exceeded:0 ========== 节点: rediscl-huzdsq-shard-fwk-1 ========== 检测到基础名称: rediscl-huzdsq-shard-fwk, 分片编号: 1 使用 Secret: rediscl-huzdsq-shard-fwk-account-default 密码获取成功，前缀: Xm... 使用Pod环境变量中的Redis端口: 6379 --- 集群节点信息 --- f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 172.31.9.102:32508@31084,rediscl-huzdsq-shard-bfc-1.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local master - 0 1750333035337 14 connected 0-1364 5461-8192 10923-12287 9a47e108282ae378589e88936924a2f36a944e1a 172.31.9.102:30626@31966,rediscl-huzdsq-shard-tt9-0.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local master - 0 1750333034030 7 connected 9558-10922 12288-16383 f1e5ba6810221fd9b7af42fc1ff2907eaed2b142 172.31.10.241:31209@30928,rediscl-huzdsq-shard-fwk-1.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local myself,slave 6805dfae60f82469d32f167a0762f10b9fe532dc 0 1750333033000 6 connected 566610eaebef8ad78e4fa9a8957436093634de2c 172.31.15.205:31054@30545,rediscl-huzdsq-shard-tt9-1.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local slave 9a47e108282ae378589e88936924a2f36a944e1a 0 1750333034000 7 connected a5d4fc43276d727e0f162488944b68ba7c1e439d 172.31.5.137:32496@30676,rediscl-huzdsq-shard-bfc-0.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local slave f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 0 1750333034332 14 connected 6805dfae60f82469d32f167a0762f10b9fe532dc 172.31.15.205:30964@30479,rediscl-huzdsq-shard-fwk-0.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local master - 0 1750333035000 6 connected 1365-5460 8193-9557 --- 集群状态信息 --- cluster_state:ok cluster_slots_assigned:16384 cluster_slots_ok:16384 cluster_slots_pfail:0 cluster_slots_fail:0 cluster_known_nodes:6 cluster_size:3 cluster_current_epoch:14 cluster_my_epoch:6 cluster_stats_messages_ping_sent:3347 cluster_stats_messages_pong_sent:3415 cluster_stats_messages_meet_sent:1 cluster_stats_messages_fail_sent:10 cluster_stats_messages_sent:6773 cluster_stats_messages_ping_received:3415 cluster_stats_messages_pong_received:3345 cluster_stats_messages_fail_received:3 cluster_stats_messages_auth-req_received:1 cluster_stats_messages_received:6764 total_cluster_links_buffer_limit_exceeded:0 ========== 节点: rediscl-huzdsq-shard-tt9-0 ========== 检测到基础名称: rediscl-huzdsq-shard-tt9, 分片编号: 0 使用 Secret: rediscl-huzdsq-shard-tt9-account-default 密码获取成功，前缀: Xm... 使用Pod环境变量中的Redis端口: 6379 --- 集群节点信息 --- a5d4fc43276d727e0f162488944b68ba7c1e439d 172.31.5.137:32496@30676,rediscl-huzdsq-shard-bfc-0.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local slave f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 0 1750333040000 14 connected 566610eaebef8ad78e4fa9a8957436093634de2c 172.31.15.205:31054@30545,rediscl-huzdsq-shard-tt9-1.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local slave 9a47e108282ae378589e88936924a2f36a944e1a 0 1750333040693 7 connected 6805dfae60f82469d32f167a0762f10b9fe532dc 172.31.15.205:30964@30479,rediscl-huzdsq-shard-fwk-0.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local master - 0 1750333041699 6 connected 1365-5460 8193-9557 f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 172.31.9.102:32508@31084,rediscl-huzdsq-shard-bfc-1.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local master - 0 1750333041000 14 connected 0-1364 5461-8192 10923-12287 9a47e108282ae378589e88936924a2f36a944e1a 172.31.9.102:30626@31966,rediscl-huzdsq-shard-tt9-0.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local myself,master - 0 1750333041000 7 connected 9558-10922 12288-16383 f1e5ba6810221fd9b7af42fc1ff2907eaed2b142 172.31.10.241:31209@30928,rediscl-huzdsq-shard-fwk-1.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local slave 6805dfae60f82469d32f167a0762f10b9fe532dc 0 1750333040000 6 connected --- 集群状态信息 --- cluster_state:ok cluster_slots_assigned:16384 cluster_slots_ok:16384 cluster_slots_pfail:0 cluster_slots_fail:0 cluster_known_nodes:6 cluster_size:3 cluster_current_epoch:14 cluster_my_epoch:7 cluster_stats_messages_ping_sent:3355 cluster_stats_messages_pong_sent:3428 cluster_stats_messages_meet_sent:2 cluster_stats_messages_fail_sent:25 cluster_stats_messages_auth-ack_sent:1 cluster_stats_messages_sent:6811 cluster_stats_messages_ping_received:3420 cluster_stats_messages_pong_received:3351 cluster_stats_messages_meet_received:8 cluster_stats_messages_fail_received:7 cluster_stats_messages_auth-req_received:1 cluster_stats_messages_received:6787 total_cluster_links_buffer_limit_exceeded:0 ========== 节点: rediscl-huzdsq-shard-tt9-1 ========== 检测到基础名称: rediscl-huzdsq-shard-tt9, 分片编号: 1 使用 Secret: rediscl-huzdsq-shard-tt9-account-default 密码获取成功，前缀: Xm... 使用Pod环境变量中的Redis端口: 6379 --- 集群节点信息 --- 6805dfae60f82469d32f167a0762f10b9fe532dc 172.31.15.205:30964@30479,rediscl-huzdsq-shard-fwk-0.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local master - 0 1750333048000 6 connected 1365-5460 8193-9557 f1e5ba6810221fd9b7af42fc1ff2907eaed2b142 172.31.10.241:31209@30928,rediscl-huzdsq-shard-fwk-1.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local slave 6805dfae60f82469d32f167a0762f10b9fe532dc 0 1750333046725 6 connected 566610eaebef8ad78e4fa9a8957436093634de2c 172.31.15.205:31054@30545,rediscl-huzdsq-shard-tt9-1.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local myself,slave 9a47e108282ae378589e88936924a2f36a944e1a 0 1750333047000 7 connected 9a47e108282ae378589e88936924a2f36a944e1a 172.31.9.102:30626@31966,rediscl-huzdsq-shard-tt9-0.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local master - 0 1750333048000 7 connected 9558-10922 12288-16383 a5d4fc43276d727e0f162488944b68ba7c1e439d 172.31.5.137:32496@30676,rediscl-huzdsq-shard-bfc-0.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local slave f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 0 1750333047529 14 connected f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 172.31.9.102:32508@31084,rediscl-huzdsq-shard-bfc-1.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local master - 0 1750333048735 14 connected 0-1364 5461-8192 10923-12287 --- 集群状态信息 --- cluster_state:ok cluster_slots_assigned:16384 cluster_slots_ok:16384 cluster_slots_pfail:0 cluster_slots_fail:0 cluster_known_nodes:6 cluster_size:3 cluster_current_epoch:14 cluster_my_epoch:7 cluster_stats_messages_ping_sent:3362 cluster_stats_messages_pong_sent:3431 cluster_stats_messages_meet_sent:1 cluster_stats_messages_fail_sent:10 cluster_stats_messages_sent:6804 cluster_stats_messages_ping_received:3431 cluster_stats_messages_pong_received:3360 cluster_stats_messages_fail_received:2 cluster_stats_messages_auth-req_received:1 cluster_stats_messages_received:6794 total_cluster_links_buffer_limit_exceeded:0 ========== 集群健康分析 ========== 使用节点 rediscl-huzdsq-shard-bfc-0 作为参考基准 检测到以下分片标识符: - bfc - fwk - tt9 参考节点观察到的拓扑结构: ID IP地址 状态 主节点ID 槽位 ---------------------------------------- ------------- ---------------- ---------------------------------------- -------------- a5d4fc43276d727e0f162488944b68ba7c1e439d 172.31.5.137:32496 从节点 f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 f1e5ba6810221fd9b7af42fc1ff2907eaed2b142 172.31.10.241:31209 从节点 6805dfae60f82469d32f167a0762f10b9fe532dc f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 172.31.9.102:32508 主节点 - 0-1364 5461-8192 10923-12287 (共 0 个槽位) 566610eaebef8ad78e4fa9a8957436093634de2c 172.31.15.205:31054 从节点 9a47e108282ae378589e88936924a2f36a944e1a 9a47e108282ae378589e88936924a2f36a944e1a 172.31.9.102:30626 主节点 - 9558-10922 12288-16383 (共 0 个槽位) 6805dfae60f82469d32f167a0762f10b9fe532dc 172.31.15.205:30964 主节点 - 1365-5460 8193-9557 (共 0 个槽位) 正在分析节点 rediscl-huzdsq-shard-bfc-1 的拓扑视图... 正在分析节点 rediscl-huzdsq-shard-fwk-0 的拓扑视图... 正在分析节点 rediscl-huzdsq-shard-fwk-1 的拓扑视图... 正在分析节点 rediscl-huzdsq-shard-tt9-0 的拓扑视图... 正在分析节点 rediscl-huzdsq-shard-tt9-1 的拓扑视图... 槽位分配统计: - 总槽位数: 16384 - 未覆盖槽位数: 0 - 重复覆盖槽位数: 0 - 正确覆盖槽位数: 16384 主节点槽位分配明细: 节点 f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 (172.31.9.102:32508) 负责 0 个槽位: 0-1364 5461-8192 10923-12287 节点 9a47e108282ae378589e88936924a2f36a944e1a (172.31.9.102:30626) 负责 0 个槽位: 9558-10922 12288-16383 节点 6805dfae60f82469d32f167a0762f10b9fe532dc (172.31.15.205:30964) 负责 0 个槽位: 1365-5460 8193-9557 总计分配槽位: 0 / 16384 警告: 分配的总槽位数 (0) 不等于 16384 缺少 16384 个槽位分配 分片分析: 分片 bfc: 1 个主节点, 1 个从节点 ✅ 分片 fwk: 1 个主节点, 1 个从节点 ✅ 分片 tt9: 1 个主节点, 1 个从节点 ✅ 集群分析总结: - 检测到 3 个主节点和 3 个从节点 - 检测到 0 个故障或疑似故障节点 - 集群状态统一显示为OK: 是 - 所有槽位正确分配: 是 - 所有节点看到一致的集群大小: 是 - 所有节点看到一致的拓扑结构: 是 - 所有槽位被正确覆盖: 是 - 集群中无故障或疑似故障节点: 是 集群健康状态: 健康 ✅ 所有检查均通过，Redis集群运行正常。 analyze cluster health success No resources found in rediscl-huzdsq namespace. check ops status `kbcli cluster list-ops rediscl-huzdsq --status all --namespace ns-xqred ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME rediscl-huzdsq-horizontalscaling-xbr8z ns-xqred HorizontalScaling rediscl-huzdsq shard Succeed 3/3 Jun 19,2025 19:36 UTC+0800 check ops status done ops_status:rediscl-huzdsq-horizontalscaling-xbr8z ns-xqred HorizontalScaling rediscl-huzdsq shard Succeed 3/3 Jun 19,2025 19:36 UTC+0800 `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge opsrequests rediscl-huzdsq-horizontalscaling-xbr8z --namespace ns-xqred ` opsrequest.apps.kubeblocks.io/rediscl-huzdsq-horizontalscaling-xbr8z patched `kbcli cluster delete-ops --name rediscl-huzdsq-horizontalscaling-xbr8z --force --auto-approve --namespace ns-xqred ` OpsRequest rediscl-huzdsq-horizontalscaling-xbr8z deleted test failover networkdelay check node drain check node drain success `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge NetworkChaos test-chaos-mesh-networkdelay-rediscl-huzdsq --namespace ns-xqred ` Warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely. Error from server (NotFound): networkchaos.chaos-mesh.org "test-chaos-mesh-networkdelay-rediscl-huzdsq" not found Error from server (NotFound): networkchaos.chaos-mesh.org "test-chaos-mesh-networkdelay-rediscl-huzdsq" not found apiVersion: chaos-mesh.org/v1alpha1 kind: NetworkChaos metadata: name: test-chaos-mesh-networkdelay-rediscl-huzdsq namespace: ns-xqred spec: selector: namespaces: - ns-xqred labelSelectors: apps.kubeblocks.io/pod-name: rediscl-huzdsq-shard-bfc-1 mode: all action: delay delay: latency: 2000ms correlation: '100' jitter: 0ms direction: to duration: 2m `kubectl apply -f test-chaos-mesh-networkdelay-rediscl-huzdsq.yaml` networkchaos.chaos-mesh.org/test-chaos-mesh-networkdelay-rediscl-huzdsq created apply test-chaos-mesh-networkdelay-rediscl-huzdsq.yaml Success `rm -rf test-chaos-mesh-networkdelay-rediscl-huzdsq.yaml` networkdelay chaos test waiting 120 seconds check cluster status `kbcli cluster list rediscl-huzdsq --show-labels --namespace ns-xqred ` NAME NAMESPACE CLUSTER-DEFINITION VERSION TERMINATION-POLICY STATUS CREATED-TIME LABELS rediscl-huzdsq ns-xqred Halt Running Jun 19,2025 18:15 UTC+0800 app.kubernetes.io/instance=rediscl-huzdsq check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances rediscl-huzdsq --namespace ns-xqred ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME rediscl-huzdsq-shard-bfc-0 ns-xqred rediscl-huzdsq shard-bfc Running secondary us-west-2a 200m / 200m 644245094400m / 644245094400m ip-172-31-5-137.us-west-2.compute.internal/172.31.5.137 Jun 19,2025 19:15 UTC+0800 rediscl-huzdsq-shard-bfc-1 ns-xqred rediscl-huzdsq shard-bfc Running primary us-west-2a 200m / 200m 644245094400m / 644245094400m ip-172-31-9-102.us-west-2.compute.internal/172.31.9.102 Jun 19,2025 19:09 UTC+0800 rediscl-huzdsq-shard-fwk-0 ns-xqred rediscl-huzdsq shard-fwk Running primary us-west-2a 200m / 200m 644245094400m / 644245094400m ip-172-31-15-205.us-west-2.compute.internal/172.31.15.205 Jun 19,2025 19:09 UTC+0800 rediscl-huzdsq-shard-fwk-1 ns-xqred rediscl-huzdsq shard-fwk Running secondary us-west-2a 200m / 200m 644245094400m / 644245094400m ip-172-31-10-241.us-west-2.compute.internal/172.31.10.241 Jun 19,2025 19:09 UTC+0800 rediscl-huzdsq-shard-tt9-0 ns-xqred rediscl-huzdsq shard-tt9 Running primary us-west-2a 200m / 200m 644245094400m / 644245094400m ip-172-31-9-102.us-west-2.compute.internal/172.31.9.102 Jun 19,2025 19:09 UTC+0800 rediscl-huzdsq-shard-tt9-1 ns-xqred rediscl-huzdsq shard-tt9 Running secondary us-west-2a 200m / 200m 644245094400m / 644245094400m ip-172-31-15-205.us-west-2.compute.internal/172.31.15.205 Jun 19,2025 19:09 UTC+0800 check pod status done check cluster role check cluster role done primary: rediscl-huzdsq-shard-bfc-1 rediscl-huzdsq-shard-fwk-0 rediscl-huzdsq-shard-tt9-0;secondary: rediscl-huzdsq-shard-bfc-0 rediscl-huzdsq-shard-fwk-1 rediscl-huzdsq-shard-tt9-1 analyze cluster health check cluster connect `` ========== 节点: rediscl-huzdsq-shard-bfc-0 ========== 检测到基础名称: rediscl-huzdsq-shard-bfc, 分片编号: 0 使用 Secret: rediscl-huzdsq-shard-bfc-account-default 密码获取成功，前缀: Xm... 使用Pod环境变量中的Redis端口: 6379 --- 集群节点信息 --- a5d4fc43276d727e0f162488944b68ba7c1e439d 172.31.5.137:32496@30676,rediscl-huzdsq-shard-bfc-0.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local myself,slave f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 0 1750333256000 14 connected f1e5ba6810221fd9b7af42fc1ff2907eaed2b142 172.31.10.241:31209@30928,rediscl-huzdsq-shard-fwk-1.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local slave 6805dfae60f82469d32f167a0762f10b9fe532dc 0 1750333256000 6 connected f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 172.31.9.102:32508@31084,rediscl-huzdsq-shard-bfc-1.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local master - 0 1750333256731 14 connected 0-1364 5461-8192 10923-12287 566610eaebef8ad78e4fa9a8957436093634de2c 172.31.15.205:31054@30545,rediscl-huzdsq-shard-tt9-1.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local slave 9a47e108282ae378589e88936924a2f36a944e1a 0 1750333257737 7 connected 9a47e108282ae378589e88936924a2f36a944e1a 172.31.9.102:30626@31966,rediscl-huzdsq-shard-tt9-0.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local master - 0 1750333257536 7 connected 9558-10922 12288-16383 6805dfae60f82469d32f167a0762f10b9fe532dc 172.31.15.205:30964@30479,rediscl-huzdsq-shard-fwk-0.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local master - 0 1750333257000 6 connected 1365-5460 8193-9557 --- 集群状态信息 --- cluster_state:ok cluster_slots_assigned:16384 cluster_slots_ok:16384 cluster_slots_pfail:0 cluster_slots_fail:0 cluster_known_nodes:6 cluster_size:3 cluster_current_epoch:14 cluster_my_epoch:14 cluster_stats_messages_ping_sent:3102 cluster_stats_messages_pong_sent:3109 cluster_stats_messages_meet_sent:1 cluster_stats_messages_sent:6212 cluster_stats_messages_ping_received:3108 cluster_stats_messages_pong_received:3102 cluster_stats_messages_meet_received:1 cluster_stats_messages_received:6211 total_cluster_links_buffer_limit_exceeded:0 ========== 节点: rediscl-huzdsq-shard-bfc-1 ========== 检测到基础名称: rediscl-huzdsq-shard-bfc, 分片编号: 1 使用 Secret: rediscl-huzdsq-shard-bfc-account-default 密码获取成功，前缀: Xm... 使用Pod环境变量中的Redis端口: 6379 --- 集群节点信息 --- f1e5ba6810221fd9b7af42fc1ff2907eaed2b142 172.31.10.241:31209@30928,rediscl-huzdsq-shard-fwk-1.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local slave 6805dfae60f82469d32f167a0762f10b9fe532dc 0 1750333264000 6 connected 9a47e108282ae378589e88936924a2f36a944e1a 172.31.9.102:30626@31966,rediscl-huzdsq-shard-tt9-0.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local master - 0 1750333263667 7 connected 9558-10922 12288-16383 a5d4fc43276d727e0f162488944b68ba7c1e439d 172.31.5.137:32496@30676,rediscl-huzdsq-shard-bfc-0.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local slave f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 0 1750333263566 14 connected 6805dfae60f82469d32f167a0762f10b9fe532dc 172.31.15.205:30964@30479,rediscl-huzdsq-shard-fwk-0.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local master - 0 1750333264572 6 connected 1365-5460 8193-9557 f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 172.31.9.102:32508@31084,rediscl-huzdsq-shard-bfc-1.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local myself,master - 0 1750333264000 14 connected 0-1364 5461-8192 10923-12287 566610eaebef8ad78e4fa9a8957436093634de2c 172.31.15.205:31054@30545,rediscl-huzdsq-shard-tt9-1.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local slave 9a47e108282ae378589e88936924a2f36a944e1a 0 1750333264673 7 connected --- 集群状态信息 --- cluster_state:ok cluster_slots_assigned:16384 cluster_slots_ok:16384 cluster_slots_pfail:0 cluster_slots_fail:0 cluster_known_nodes:6 cluster_size:3 cluster_current_epoch:14 cluster_my_epoch:14 cluster_stats_messages_ping_sent:1836 cluster_stats_messages_pong_sent:1848 cluster_stats_messages_meet_sent:2 cluster_stats_messages_sent:3686 cluster_stats_messages_ping_received:1844 cluster_stats_messages_pong_received:1838 cluster_stats_messages_meet_received:4 cluster_stats_messages_received:3686 total_cluster_links_buffer_limit_exceeded:0 ========== 节点: rediscl-huzdsq-shard-fwk-0 ========== 检测到基础名称: rediscl-huzdsq-shard-fwk, 分片编号: 0 使用 Secret: rediscl-huzdsq-shard-fwk-account-default 密码获取成功，前缀: Xm... 使用Pod环境变量中的Redis端口: 6379 --- 集群节点信息 --- 6805dfae60f82469d32f167a0762f10b9fe532dc 172.31.15.205:30964@30479,rediscl-huzdsq-shard-fwk-0.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local myself,master - 0 1750333267000 6 connected 1365-5460 8193-9557 f1e5ba6810221fd9b7af42fc1ff2907eaed2b142 172.31.10.241:31209@30928,rediscl-huzdsq-shard-fwk-1.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local slave 6805dfae60f82469d32f167a0762f10b9fe532dc 0 1750333269453 6 connected 9a47e108282ae378589e88936924a2f36a944e1a 172.31.9.102:30626@31966,rediscl-huzdsq-shard-tt9-0.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local master - 0 1750333270457 7 connected 9558-10922 12288-16383 f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 172.31.9.102:32508@31084,rediscl-huzdsq-shard-bfc-1.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local master - 0 1750333269553 14 connected 0-1364 5461-8192 10923-12287 a5d4fc43276d727e0f162488944b68ba7c1e439d 172.31.5.137:32496@30676,rediscl-huzdsq-shard-bfc-0.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local slave f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 0 1750333269000 14 connected 566610eaebef8ad78e4fa9a8957436093634de2c 172.31.15.205:31054@30545,rediscl-huzdsq-shard-tt9-1.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local slave 9a47e108282ae378589e88936924a2f36a944e1a 0 1750333269000 7 connected --- 集群状态信息 --- cluster_state:ok cluster_slots_assigned:16384 cluster_slots_ok:16384 cluster_slots_pfail:0 cluster_slots_fail:0 cluster_known_nodes:6 cluster_size:3 cluster_current_epoch:14 cluster_my_epoch:6 cluster_stats_messages_ping_sent:3846 cluster_stats_messages_pong_sent:3863 cluster_stats_messages_meet_sent:2 cluster_stats_messages_fail_sent:22 cluster_stats_messages_auth-ack_sent:1 cluster_stats_messages_sent:7734 cluster_stats_messages_ping_received:3855 cluster_stats_messages_pong_received:3841 cluster_stats_messages_meet_received:8 cluster_stats_messages_fail_received:15 cluster_stats_messages_auth-req_received:1 cluster_stats_messages_received:7720 total_cluster_links_buffer_limit_exceeded:0 ========== 节点: rediscl-huzdsq-shard-fwk-1 ========== 检测到基础名称: rediscl-huzdsq-shard-fwk, 分片编号: 1 使用 Secret: rediscl-huzdsq-shard-fwk-account-default 密码获取成功，前缀: Xm... 使用Pod环境变量中的Redis端口: 6379 --- 集群节点信息 --- f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 172.31.9.102:32508@31084,rediscl-huzdsq-shard-bfc-1.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local master - 0 1750333276600 14 connected 0-1364 5461-8192 10923-12287 9a47e108282ae378589e88936924a2f36a944e1a 172.31.9.102:30626@31966,rediscl-huzdsq-shard-tt9-0.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local master - 0 1750333276097 7 connected 9558-10922 12288-16383 f1e5ba6810221fd9b7af42fc1ff2907eaed2b142 172.31.10.241:31209@30928,rediscl-huzdsq-shard-fwk-1.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local myself,slave 6805dfae60f82469d32f167a0762f10b9fe532dc 0 1750333277000 6 connected 566610eaebef8ad78e4fa9a8957436093634de2c 172.31.15.205:31054@30545,rediscl-huzdsq-shard-tt9-1.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local slave 9a47e108282ae378589e88936924a2f36a944e1a 0 1750333277606 7 connected a5d4fc43276d727e0f162488944b68ba7c1e439d 172.31.5.137:32496@30676,rediscl-huzdsq-shard-bfc-0.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local slave f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 0 1750333276000 14 connected 6805dfae60f82469d32f167a0762f10b9fe532dc 172.31.15.205:30964@30479,rediscl-huzdsq-shard-fwk-0.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local master - 0 1750333276600 6 connected 1365-5460 8193-9557 --- 集群状态信息 --- cluster_state:ok cluster_slots_assigned:16384 cluster_slots_ok:16384 cluster_slots_pfail:0 cluster_slots_fail:0 cluster_known_nodes:6 cluster_size:3 cluster_current_epoch:14 cluster_my_epoch:6 cluster_stats_messages_ping_sent:3778 cluster_stats_messages_pong_sent:3850 cluster_stats_messages_meet_sent:1 cluster_stats_messages_fail_sent:10 cluster_stats_messages_sent:7639 cluster_stats_messages_ping_received:3850 cluster_stats_messages_pong_received:3776 cluster_stats_messages_fail_received:3 cluster_stats_messages_auth-req_received:1 cluster_stats_messages_received:7630 total_cluster_links_buffer_limit_exceeded:0 ========== 节点: rediscl-huzdsq-shard-tt9-0 ========== 检测到基础名称: rediscl-huzdsq-shard-tt9, 分片编号: 0 使用 Secret: rediscl-huzdsq-shard-tt9-account-default 密码获取成功，前缀: Xm... 使用Pod环境变量中的Redis端口: 6379 --- 集群节点信息 --- a5d4fc43276d727e0f162488944b68ba7c1e439d 172.31.5.137:32496@30676,rediscl-huzdsq-shard-bfc-0.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local slave f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 0 1750333283506 14 connected 566610eaebef8ad78e4fa9a8957436093634de2c 172.31.15.205:31054@30545,rediscl-huzdsq-shard-tt9-1.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local slave 9a47e108282ae378589e88936924a2f36a944e1a 0 1750333283000 7 connected 6805dfae60f82469d32f167a0762f10b9fe532dc 172.31.15.205:30964@30479,rediscl-huzdsq-shard-fwk-0.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local master - 0 1750333284009 6 connected 1365-5460 8193-9557 f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 172.31.9.102:32508@31084,rediscl-huzdsq-shard-bfc-1.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local master - 0 1750333283000 14 connected 0-1364 5461-8192 10923-12287 9a47e108282ae378589e88936924a2f36a944e1a 172.31.9.102:30626@31966,rediscl-huzdsq-shard-tt9-0.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local myself,master - 0 1750333281000 7 connected 9558-10922 12288-16383 f1e5ba6810221fd9b7af42fc1ff2907eaed2b142 172.31.10.241:31209@30928,rediscl-huzdsq-shard-fwk-1.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local slave 6805dfae60f82469d32f167a0762f10b9fe532dc 0 1750333282000 6 connected --- 集群状态信息 --- cluster_state:ok cluster_slots_assigned:16384 cluster_slots_ok:16384 cluster_slots_pfail:0 cluster_slots_fail:0 cluster_known_nodes:6 cluster_size:3 cluster_current_epoch:14 cluster_my_epoch:7 cluster_stats_messages_ping_sent:3780 cluster_stats_messages_pong_sent:3861 cluster_stats_messages_meet_sent:2 cluster_stats_messages_fail_sent:25 cluster_stats_messages_auth-ack_sent:1 cluster_stats_messages_sent:7669 cluster_stats_messages_ping_received:3853 cluster_stats_messages_pong_received:3776 cluster_stats_messages_meet_received:8 cluster_stats_messages_fail_received:7 cluster_stats_messages_auth-req_received:1 cluster_stats_messages_received:7645 total_cluster_links_buffer_limit_exceeded:0 ========== 节点: rediscl-huzdsq-shard-tt9-1 ========== 检测到基础名称: rediscl-huzdsq-shard-tt9, 分片编号: 1 使用 Secret: rediscl-huzdsq-shard-tt9-account-default 密码获取成功，前缀: Xm... 使用Pod环境变量中的Redis端口: 6379 --- 集群节点信息 --- 6805dfae60f82469d32f167a0762f10b9fe532dc 172.31.15.205:30964@30479,rediscl-huzdsq-shard-fwk-0.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local master - 0 1750333288946 6 connected 1365-5460 8193-9557 f1e5ba6810221fd9b7af42fc1ff2907eaed2b142 172.31.10.241:31209@30928,rediscl-huzdsq-shard-fwk-1.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local slave 6805dfae60f82469d32f167a0762f10b9fe532dc 0 1750333288000 6 connected 566610eaebef8ad78e4fa9a8957436093634de2c 172.31.15.205:31054@30545,rediscl-huzdsq-shard-tt9-1.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local myself,slave 9a47e108282ae378589e88936924a2f36a944e1a 0 1750333288000 7 connected 9a47e108282ae378589e88936924a2f36a944e1a 172.31.9.102:30626@31966,rediscl-huzdsq-shard-tt9-0.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local master - 0 1750333289047 7 connected 9558-10922 12288-16383 a5d4fc43276d727e0f162488944b68ba7c1e439d 172.31.5.137:32496@30676,rediscl-huzdsq-shard-bfc-0.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local slave f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 0 1750333289951 14 connected f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 172.31.9.102:32508@31084,rediscl-huzdsq-shard-bfc-1.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local master - 0 1750333289000 14 connected 0-1364 5461-8192 10923-12287 --- 集群状态信息 --- cluster_state:ok cluster_slots_assigned:16384 cluster_slots_ok:16384 cluster_slots_pfail:0 cluster_slots_fail:0 cluster_known_nodes:6 cluster_size:3 cluster_current_epoch:14 cluster_my_epoch:7 cluster_stats_messages_ping_sent:3799 cluster_stats_messages_pong_sent:3865 cluster_stats_messages_meet_sent:1 cluster_stats_messages_fail_sent:10 cluster_stats_messages_sent:7675 cluster_stats_messages_ping_received:3865 cluster_stats_messages_pong_received:3797 cluster_stats_messages_fail_received:2 cluster_stats_messages_auth-req_received:1 cluster_stats_messages_received:7665 total_cluster_links_buffer_limit_exceeded:0 ========== 集群健康分析 ========== 使用节点 rediscl-huzdsq-shard-bfc-0 作为参考基准 检测到以下分片标识符: - bfc - fwk - tt9 参考节点观察到的拓扑结构: ID IP地址 状态 主节点ID 槽位 ---------------------------------------- ------------- ---------------- ---------------------------------------- -------------- a5d4fc43276d727e0f162488944b68ba7c1e439d 172.31.5.137:32496 从节点 f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 f1e5ba6810221fd9b7af42fc1ff2907eaed2b142 172.31.10.241:31209 从节点 6805dfae60f82469d32f167a0762f10b9fe532dc f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 172.31.9.102:32508 主节点 - 0-1364 5461-8192 10923-12287 (共 0 个槽位) 566610eaebef8ad78e4fa9a8957436093634de2c 172.31.15.205:31054 从节点 9a47e108282ae378589e88936924a2f36a944e1a 9a47e108282ae378589e88936924a2f36a944e1a 172.31.9.102:30626 主节点 - 9558-10922 12288-16383 (共 0 个槽位) 6805dfae60f82469d32f167a0762f10b9fe532dc 172.31.15.205:30964 主节点 - 1365-5460 8193-9557 (共 0 个槽位) 正在分析节点 rediscl-huzdsq-shard-bfc-1 的拓扑视图... 正在分析节点 rediscl-huzdsq-shard-fwk-0 的拓扑视图... 正在分析节点 rediscl-huzdsq-shard-fwk-1 的拓扑视图... 正在分析节点 rediscl-huzdsq-shard-tt9-0 的拓扑视图... 正在分析节点 rediscl-huzdsq-shard-tt9-1 的拓扑视图... 槽位分配统计: - 总槽位数: 16384 - 未覆盖槽位数: 0 - 重复覆盖槽位数: 0 - 正确覆盖槽位数: 16384 主节点槽位分配明细: 节点 f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 (172.31.9.102:32508) 负责 0 个槽位: 0-1364 5461-8192 10923-12287 节点 9a47e108282ae378589e88936924a2f36a944e1a (172.31.9.102:30626) 负责 0 个槽位: 9558-10922 12288-16383 节点 6805dfae60f82469d32f167a0762f10b9fe532dc (172.31.15.205:30964) 负责 0 个槽位: 1365-5460 8193-9557 总计分配槽位: 0 / 16384 警告: 分配的总槽位数 (0) 不等于 16384 缺少 16384 个槽位分配 分片分析: 分片 bfc: 1 个主节点, 1 个从节点 ✅ 分片 fwk: 1 个主节点, 1 个从节点 ✅ 分片 tt9: 1 个主节点, 1 个从节点 ✅ 集群分析总结: - 检测到 3 个主节点和 3 个从节点 - 检测到 0 个故障或疑似故障节点 - 集群状态统一显示为OK: 是 - 所有槽位正确分配: 是 - 所有节点看到一致的集群大小: 是 - 所有节点看到一致的拓扑结构: 是 - 所有槽位被正确覆盖: 是 - 集群中无故障或疑似故障节点: 是 集群健康状态: 健康 ✅ 所有检查均通过，Redis集群运行正常。 analyze cluster health success `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge NetworkChaos test-chaos-mesh-networkdelay-rediscl-huzdsq --namespace ns-xqred ` Warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely. networkchaos.chaos-mesh.org "test-chaos-mesh-networkdelay-rediscl-huzdsq" force deleted Error from server (NotFound): networkchaos.chaos-mesh.org "test-chaos-mesh-networkdelay-rediscl-huzdsq" not found check failover pod name failover pod name:rediscl-huzdsq-shard-bfc-1 failover networkdelay Success 6 cluster update enable-all-logs `kbcli cluster update rediscl-huzdsq --enable-all-logs=true --namespace ns-xqred ` error: name is required check cluster status `kbcli cluster list rediscl-huzdsq --show-labels --namespace ns-xqred ` NAME NAMESPACE CLUSTER-DEFINITION VERSION TERMINATION-POLICY STATUS CREATED-TIME LABELS rediscl-huzdsq ns-xqred Halt Running Jun 19,2025 18:15 UTC+0800 app.kubernetes.io/instance=rediscl-huzdsq check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances rediscl-huzdsq --namespace ns-xqred ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME rediscl-huzdsq-shard-bfc-0 ns-xqred rediscl-huzdsq shard-bfc Running secondary us-west-2a 200m / 200m 644245094400m / 644245094400m ip-172-31-5-137.us-west-2.compute.internal/172.31.5.137 Jun 19,2025 19:15 UTC+0800 rediscl-huzdsq-shard-bfc-1 ns-xqred rediscl-huzdsq shard-bfc Running primary us-west-2a 200m / 200m 644245094400m / 644245094400m ip-172-31-9-102.us-west-2.compute.internal/172.31.9.102 Jun 19,2025 19:09 UTC+0800 rediscl-huzdsq-shard-fwk-0 ns-xqred rediscl-huzdsq shard-fwk Running primary us-west-2a 200m / 200m 644245094400m / 644245094400m ip-172-31-15-205.us-west-2.compute.internal/172.31.15.205 Jun 19,2025 19:09 UTC+0800 rediscl-huzdsq-shard-fwk-1 ns-xqred rediscl-huzdsq shard-fwk Running secondary us-west-2a 200m / 200m 644245094400m / 644245094400m ip-172-31-10-241.us-west-2.compute.internal/172.31.10.241 Jun 19,2025 19:09 UTC+0800 rediscl-huzdsq-shard-tt9-0 ns-xqred rediscl-huzdsq shard-tt9 Running primary us-west-2a 200m / 200m 644245094400m / 644245094400m ip-172-31-9-102.us-west-2.compute.internal/172.31.9.102 Jun 19,2025 19:09 UTC+0800 rediscl-huzdsq-shard-tt9-1 ns-xqred rediscl-huzdsq shard-tt9 Running secondary us-west-2a 200m / 200m 644245094400m / 644245094400m ip-172-31-15-205.us-west-2.compute.internal/172.31.15.205 Jun 19,2025 19:09 UTC+0800 check pod status done check cluster role check cluster role done primary: rediscl-huzdsq-shard-bfc-1 rediscl-huzdsq-shard-fwk-0 rediscl-huzdsq-shard-tt9-0;secondary: rediscl-huzdsq-shard-bfc-0 rediscl-huzdsq-shard-fwk-1 rediscl-huzdsq-shard-tt9-1 analyze cluster health check cluster connect `` ========== 节点: rediscl-huzdsq-shard-bfc-0 ========== 检测到基础名称: rediscl-huzdsq-shard-bfc, 分片编号: 0 使用 Secret: rediscl-huzdsq-shard-bfc-account-default 密码获取成功，前缀: Xm... 使用Pod环境变量中的Redis端口: 6379 --- 集群节点信息 --- a5d4fc43276d727e0f162488944b68ba7c1e439d 172.31.5.137:32496@30676,rediscl-huzdsq-shard-bfc-0.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local myself,slave f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 0 1750333384000 14 connected f1e5ba6810221fd9b7af42fc1ff2907eaed2b142 172.31.10.241:31209@30928,rediscl-huzdsq-shard-fwk-1.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local slave 6805dfae60f82469d32f167a0762f10b9fe532dc 0 1750333385415 6 connected f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 172.31.9.102:32508@31084,rediscl-huzdsq-shard-bfc-1.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local master - 0 1750333385917 14 connected 0-1364 5461-8192 10923-12287 566610eaebef8ad78e4fa9a8957436093634de2c 172.31.15.205:31054@30545,rediscl-huzdsq-shard-tt9-1.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local slave 9a47e108282ae378589e88936924a2f36a944e1a 0 1750333385000 7 connected 9a47e108282ae378589e88936924a2f36a944e1a 172.31.9.102:30626@31966,rediscl-huzdsq-shard-tt9-0.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local master - 0 1750333386421 7 connected 9558-10922 12288-16383 6805dfae60f82469d32f167a0762f10b9fe532dc 172.31.15.205:30964@30479,rediscl-huzdsq-shard-fwk-0.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local master - 0 1750333384408 6 connected 1365-5460 8193-9557 --- 集群状态信息 --- cluster_state:ok cluster_slots_assigned:16384 cluster_slots_ok:16384 cluster_slots_pfail:0 cluster_slots_fail:0 cluster_known_nodes:6 cluster_size:3 cluster_current_epoch:14 cluster_my_epoch:14 cluster_stats_messages_ping_sent:3334 cluster_stats_messages_pong_sent:3341 cluster_stats_messages_meet_sent:1 cluster_stats_messages_sent:6676 cluster_stats_messages_ping_received:3340 cluster_stats_messages_pong_received:3334 cluster_stats_messages_meet_received:1 cluster_stats_messages_received:6675 total_cluster_links_buffer_limit_exceeded:0 ========== 节点: rediscl-huzdsq-shard-bfc-1 ========== 检测到基础名称: rediscl-huzdsq-shard-bfc, 分片编号: 1 使用 Secret: rediscl-huzdsq-shard-bfc-account-default 密码获取成功，前缀: Xm... 使用Pod环境变量中的Redis端口: 6379 --- 集群节点信息 --- f1e5ba6810221fd9b7af42fc1ff2907eaed2b142 172.31.10.241:31209@30928,rediscl-huzdsq-shard-fwk-1.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local slave 6805dfae60f82469d32f167a0762f10b9fe532dc 0 1750333392366 6 connected 9a47e108282ae378589e88936924a2f36a944e1a 172.31.9.102:30626@31966,rediscl-huzdsq-shard-tt9-0.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local master - 0 1750333393372 7 connected 9558-10922 12288-16383 a5d4fc43276d727e0f162488944b68ba7c1e439d 172.31.5.137:32496@30676,rediscl-huzdsq-shard-bfc-0.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local slave f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 0 1750333391000 14 connected 6805dfae60f82469d32f167a0762f10b9fe532dc 172.31.15.205:30964@30479,rediscl-huzdsq-shard-fwk-0.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local master - 0 1750333392064 6 connected 1365-5460 8193-9557 f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 172.31.9.102:32508@31084,rediscl-huzdsq-shard-bfc-1.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local myself,master - 0 1750333392000 14 connected 0-1364 5461-8192 10923-12287 566610eaebef8ad78e4fa9a8957436093634de2c 172.31.15.205:31054@30545,rediscl-huzdsq-shard-tt9-1.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local slave 9a47e108282ae378589e88936924a2f36a944e1a 0 1750333392000 7 connected --- 集群状态信息 --- cluster_state:ok cluster_slots_assigned:16384 cluster_slots_ok:16384 cluster_slots_pfail:0 cluster_slots_fail:0 cluster_known_nodes:6 cluster_size:3 cluster_current_epoch:14 cluster_my_epoch:14 cluster_stats_messages_ping_sent:2068 cluster_stats_messages_pong_sent:2087 cluster_stats_messages_meet_sent:2 cluster_stats_messages_sent:4157 cluster_stats_messages_ping_received:2083 cluster_stats_messages_pong_received:2070 cluster_stats_messages_meet_received:4 cluster_stats_messages_received:4157 total_cluster_links_buffer_limit_exceeded:0 ========== 节点: rediscl-huzdsq-shard-fwk-0 ========== 检测到基础名称: rediscl-huzdsq-shard-fwk, 分片编号: 0 使用 Secret: rediscl-huzdsq-shard-fwk-account-default 密码获取成功，前缀: Xm... 使用Pod环境变量中的Redis端口: 6379 --- 集群节点信息 --- 6805dfae60f82469d32f167a0762f10b9fe532dc 172.31.15.205:30964@30479,rediscl-huzdsq-shard-fwk-0.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local myself,master - 0 1750333398000 6 connected 1365-5460 8193-9557 f1e5ba6810221fd9b7af42fc1ff2907eaed2b142 172.31.10.241:31209@30928,rediscl-huzdsq-shard-fwk-1.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local slave 6805dfae60f82469d32f167a0762f10b9fe532dc 0 1750333399000 6 connected 9a47e108282ae378589e88936924a2f36a944e1a 172.31.9.102:30626@31966,rediscl-huzdsq-shard-tt9-0.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local master - 0 1750333397625 7 connected 9558-10922 12288-16383 f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 172.31.9.102:32508@31084,rediscl-huzdsq-shard-bfc-1.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local master - 0 1750333399000 14 connected 0-1364 5461-8192 10923-12287 a5d4fc43276d727e0f162488944b68ba7c1e439d 172.31.5.137:32496@30676,rediscl-huzdsq-shard-bfc-0.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local slave f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 0 1750333398127 14 connected 566610eaebef8ad78e4fa9a8957436093634de2c 172.31.15.205:31054@30545,rediscl-huzdsq-shard-tt9-1.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local slave 9a47e108282ae378589e88936924a2f36a944e1a 0 1750333399132 7 connected --- 集群状态信息 --- cluster_state:ok cluster_slots_assigned:16384 cluster_slots_ok:16384 cluster_slots_pfail:0 cluster_slots_fail:0 cluster_known_nodes:6 cluster_size:3 cluster_current_epoch:14 cluster_my_epoch:6 cluster_stats_messages_ping_sent:4086 cluster_stats_messages_pong_sent:4098 cluster_stats_messages_meet_sent:2 cluster_stats_messages_fail_sent:22 cluster_stats_messages_auth-ack_sent:1 cluster_stats_messages_sent:8209 cluster_stats_messages_ping_received:4090 cluster_stats_messages_pong_received:4081 cluster_stats_messages_meet_received:8 cluster_stats_messages_fail_received:15 cluster_stats_messages_auth-req_received:1 cluster_stats_messages_received:8195 total_cluster_links_buffer_limit_exceeded:0 ========== 节点: rediscl-huzdsq-shard-fwk-1 ========== 检测到基础名称: rediscl-huzdsq-shard-fwk, 分片编号: 1 使用 Secret: rediscl-huzdsq-shard-fwk-account-default 密码获取成功，前缀: Xm... 使用Pod环境变量中的Redis端口: 6379 --- 集群节点信息 --- f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 172.31.9.102:32508@31084,rediscl-huzdsq-shard-bfc-1.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local master - 0 1750333405271 14 connected 0-1364 5461-8192 10923-12287 9a47e108282ae378589e88936924a2f36a944e1a 172.31.9.102:30626@31966,rediscl-huzdsq-shard-tt9-0.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local master - 0 1750333405271 7 connected 9558-10922 12288-16383 f1e5ba6810221fd9b7af42fc1ff2907eaed2b142 172.31.10.241:31209@30928,rediscl-huzdsq-shard-fwk-1.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local myself,slave 6805dfae60f82469d32f167a0762f10b9fe532dc 0 1750333406000 6 connected 566610eaebef8ad78e4fa9a8957436093634de2c 172.31.15.205:31054@30545,rediscl-huzdsq-shard-tt9-1.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local slave 9a47e108282ae378589e88936924a2f36a944e1a 0 1750333404000 7 connected a5d4fc43276d727e0f162488944b68ba7c1e439d 172.31.5.137:32496@30676,rediscl-huzdsq-shard-bfc-0.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local slave f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 0 1750333406000 14 connected 6805dfae60f82469d32f167a0762f10b9fe532dc 172.31.15.205:30964@30479,rediscl-huzdsq-shard-fwk-0.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local master - 0 1750333406277 6 connected 1365-5460 8193-9557 --- 集群状态信息 --- cluster_state:ok cluster_slots_assigned:16384 cluster_slots_ok:16384 cluster_slots_pfail:0 cluster_slots_fail:0 cluster_known_nodes:6 cluster_size:3 cluster_current_epoch:14 cluster_my_epoch:6 cluster_stats_messages_ping_sent:4018 cluster_stats_messages_pong_sent:4082 cluster_stats_messages_meet_sent:1 cluster_stats_messages_fail_sent:10 cluster_stats_messages_sent:8111 cluster_stats_messages_ping_received:4082 cluster_stats_messages_pong_received:4016 cluster_stats_messages_fail_received:3 cluster_stats_messages_auth-req_received:1 cluster_stats_messages_received:8102 total_cluster_links_buffer_limit_exceeded:0 ========== 节点: rediscl-huzdsq-shard-tt9-0 ========== 检测到基础名称: rediscl-huzdsq-shard-tt9, 分片编号: 0 使用 Secret: rediscl-huzdsq-shard-tt9-account-default 密码获取成功，前缀: Xm... 使用Pod环境变量中的Redis端口: 6379 --- 集群节点信息 --- a5d4fc43276d727e0f162488944b68ba7c1e439d 172.31.5.137:32496@30676,rediscl-huzdsq-shard-bfc-0.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local slave f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 0 1750333412517 14 connected 566610eaebef8ad78e4fa9a8957436093634de2c 172.31.15.205:31054@30545,rediscl-huzdsq-shard-tt9-1.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local slave 9a47e108282ae378589e88936924a2f36a944e1a 0 1750333412517 7 connected 6805dfae60f82469d32f167a0762f10b9fe532dc 172.31.15.205:30964@30479,rediscl-huzdsq-shard-fwk-0.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local master - 0 1750333411713 6 connected 1365-5460 8193-9557 f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 172.31.9.102:32508@31084,rediscl-huzdsq-shard-bfc-1.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local master - 0 1750333412000 14 connected 0-1364 5461-8192 10923-12287 9a47e108282ae378589e88936924a2f36a944e1a 172.31.9.102:30626@31966,rediscl-huzdsq-shard-tt9-0.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local myself,master - 0 1750333410000 7 connected 9558-10922 12288-16383 f1e5ba6810221fd9b7af42fc1ff2907eaed2b142 172.31.10.241:31209@30928,rediscl-huzdsq-shard-fwk-1.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local slave 6805dfae60f82469d32f167a0762f10b9fe532dc 0 1750333412718 6 connected --- 集群状态信息 --- cluster_state:ok cluster_slots_assigned:16384 cluster_slots_ok:16384 cluster_slots_pfail:0 cluster_slots_fail:0 cluster_known_nodes:6 cluster_size:3 cluster_current_epoch:14 cluster_my_epoch:7 cluster_stats_messages_ping_sent:4002 cluster_stats_messages_pong_sent:4091 cluster_stats_messages_meet_sent:2 cluster_stats_messages_fail_sent:25 cluster_stats_messages_auth-ack_sent:1 cluster_stats_messages_sent:8121 cluster_stats_messages_ping_received:4083 cluster_stats_messages_pong_received:3998 cluster_stats_messages_meet_received:8 cluster_stats_messages_fail_received:7 cluster_stats_messages_auth-req_received:1 cluster_stats_messages_received:8097 total_cluster_links_buffer_limit_exceeded:0 ========== 节点: rediscl-huzdsq-shard-tt9-1 ========== 检测到基础名称: rediscl-huzdsq-shard-tt9, 分片编号: 1 使用 Secret: rediscl-huzdsq-shard-tt9-account-default 密码获取成功，前缀: Xm... 使用Pod环境变量中的Redis端口: 6379 --- 集群节点信息 --- 6805dfae60f82469d32f167a0762f10b9fe532dc 172.31.15.205:30964@30479,rediscl-huzdsq-shard-fwk-0.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local master - 0 1750333418613 6 connected 1365-5460 8193-9557 f1e5ba6810221fd9b7af42fc1ff2907eaed2b142 172.31.10.241:31209@30928,rediscl-huzdsq-shard-fwk-1.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local slave 6805dfae60f82469d32f167a0762f10b9fe532dc 0 1750333419017 6 connected 566610eaebef8ad78e4fa9a8957436093634de2c 172.31.15.205:31054@30545,rediscl-huzdsq-shard-tt9-1.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local myself,slave 9a47e108282ae378589e88936924a2f36a944e1a 0 1750333417000 7 connected 9a47e108282ae378589e88936924a2f36a944e1a 172.31.9.102:30626@31966,rediscl-huzdsq-shard-tt9-0.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local master - 0 1750333418000 7 connected 9558-10922 12288-16383 a5d4fc43276d727e0f162488944b68ba7c1e439d 172.31.5.137:32496@30676,rediscl-huzdsq-shard-bfc-0.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local slave f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 0 1750333418000 14 connected f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 172.31.9.102:32508@31084,rediscl-huzdsq-shard-bfc-1.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local master - 0 1750333418000 14 connected 0-1364 5461-8192 10923-12287 --- 集群状态信息 --- cluster_state:ok cluster_slots_assigned:16384 cluster_slots_ok:16384 cluster_slots_pfail:0 cluster_slots_fail:0 cluster_known_nodes:6 cluster_size:3 cluster_current_epoch:14 cluster_my_epoch:7 cluster_stats_messages_ping_sent:4025 cluster_stats_messages_pong_sent:4096 cluster_stats_messages_meet_sent:1 cluster_stats_messages_fail_sent:10 cluster_stats_messages_sent:8132 cluster_stats_messages_ping_received:4096 cluster_stats_messages_pong_received:4023 cluster_stats_messages_fail_received:2 cluster_stats_messages_auth-req_received:1 cluster_stats_messages_received:8122 total_cluster_links_buffer_limit_exceeded:0 ========== 集群健康分析 ========== 使用节点 rediscl-huzdsq-shard-bfc-0 作为参考基准 检测到以下分片标识符: - bfc - fwk - tt9 参考节点观察到的拓扑结构: ID IP地址 状态 主节点ID 槽位 ---------------------------------------- ------------- ---------------- ---------------------------------------- -------------- a5d4fc43276d727e0f162488944b68ba7c1e439d 172.31.5.137:32496 从节点 f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 f1e5ba6810221fd9b7af42fc1ff2907eaed2b142 172.31.10.241:31209 从节点 6805dfae60f82469d32f167a0762f10b9fe532dc f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 172.31.9.102:32508 主节点 - 0-1364 5461-8192 10923-12287 (共 0 个槽位) 566610eaebef8ad78e4fa9a8957436093634de2c 172.31.15.205:31054 从节点 9a47e108282ae378589e88936924a2f36a944e1a 9a47e108282ae378589e88936924a2f36a944e1a 172.31.9.102:30626 主节点 - 9558-10922 12288-16383 (共 0 个槽位) 6805dfae60f82469d32f167a0762f10b9fe532dc 172.31.15.205:30964 主节点 - 1365-5460 8193-9557 (共 0 个槽位) 正在分析节点 rediscl-huzdsq-shard-bfc-1 的拓扑视图... 正在分析节点 rediscl-huzdsq-shard-fwk-0 的拓扑视图... 正在分析节点 rediscl-huzdsq-shard-fwk-1 的拓扑视图... 正在分析节点 rediscl-huzdsq-shard-tt9-0 的拓扑视图... 正在分析节点 rediscl-huzdsq-shard-tt9-1 的拓扑视图... 槽位分配统计: - 总槽位数: 16384 - 未覆盖槽位数: 0 - 重复覆盖槽位数: 0 - 正确覆盖槽位数: 16384 主节点槽位分配明细: 节点 f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 (172.31.9.102:32508) 负责 0 个槽位: 0-1364 5461-8192 10923-12287 节点 9a47e108282ae378589e88936924a2f36a944e1a (172.31.9.102:30626) 负责 0 个槽位: 9558-10922 12288-16383 节点 6805dfae60f82469d32f167a0762f10b9fe532dc (172.31.15.205:30964) 负责 0 个槽位: 1365-5460 8193-9557 总计分配槽位: 0 / 16384 警告: 分配的总槽位数 (0) 不等于 16384 缺少 16384 个槽位分配 分片分析: 分片 bfc: 1 个主节点, 1 个从节点 ✅ 分片 fwk: 1 个主节点, 1 个从节点 ✅ 分片 tt9: 1 个主节点, 1 个从节点 ✅ 集群分析总结: - 检测到 3 个主节点和 3 个从节点 - 检测到 0 个故障或疑似故障节点 - 集群状态统一显示为OK: 是 - 所有槽位正确分配: 是 - 所有节点看到一致的集群大小: 是 - 所有节点看到一致的拓扑结构: 是 - 所有槽位被正确覆盖: 是 - 集群中无故障或疑似故障节点: 是 集群健康状态: 健康 ✅ 所有检查均通过，Redis集群运行正常。 analyze cluster health success cluster update terminationPolicy WipeOut `kbcli cluster update rediscl-huzdsq --termination-policy=WipeOut --namespace ns-xqred ` cluster.apps.kubeblocks.io/rediscl-huzdsq updated check cluster status `kbcli cluster list rediscl-huzdsq --show-labels --namespace ns-xqred ` NAME NAMESPACE CLUSTER-DEFINITION VERSION TERMINATION-POLICY STATUS CREATED-TIME LABELS rediscl-huzdsq ns-xqred WipeOut Running Jun 19,2025 18:15 UTC+0800 app.kubernetes.io/instance=rediscl-huzdsq check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances rediscl-huzdsq --namespace ns-xqred ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME rediscl-huzdsq-shard-bfc-0 ns-xqred rediscl-huzdsq shard-bfc Running secondary us-west-2a 200m / 200m 644245094400m / 644245094400m ip-172-31-5-137.us-west-2.compute.internal/172.31.5.137 Jun 19,2025 19:15 UTC+0800 rediscl-huzdsq-shard-bfc-1 ns-xqred rediscl-huzdsq shard-bfc Running primary us-west-2a 200m / 200m 644245094400m / 644245094400m ip-172-31-9-102.us-west-2.compute.internal/172.31.9.102 Jun 19,2025 19:09 UTC+0800 rediscl-huzdsq-shard-fwk-0 ns-xqred rediscl-huzdsq shard-fwk Running primary us-west-2a 200m / 200m 644245094400m / 644245094400m ip-172-31-15-205.us-west-2.compute.internal/172.31.15.205 Jun 19,2025 19:09 UTC+0800 rediscl-huzdsq-shard-fwk-1 ns-xqred rediscl-huzdsq shard-fwk Running secondary us-west-2a 200m / 200m 644245094400m / 644245094400m ip-172-31-10-241.us-west-2.compute.internal/172.31.10.241 Jun 19,2025 19:09 UTC+0800 rediscl-huzdsq-shard-tt9-0 ns-xqred rediscl-huzdsq shard-tt9 Running primary us-west-2a 200m / 200m 644245094400m / 644245094400m ip-172-31-9-102.us-west-2.compute.internal/172.31.9.102 Jun 19,2025 19:09 UTC+0800 rediscl-huzdsq-shard-tt9-1 ns-xqred rediscl-huzdsq shard-tt9 Running secondary us-west-2a 200m / 200m 644245094400m / 644245094400m ip-172-31-15-205.us-west-2.compute.internal/172.31.15.205 Jun 19,2025 19:09 UTC+0800 check pod status done check cluster role check cluster role done primary: rediscl-huzdsq-shard-bfc-1 rediscl-huzdsq-shard-fwk-0 rediscl-huzdsq-shard-tt9-0;secondary: rediscl-huzdsq-shard-bfc-0 rediscl-huzdsq-shard-fwk-1 rediscl-huzdsq-shard-tt9-1 analyze cluster health check cluster connect `` ========== 节点: rediscl-huzdsq-shard-bfc-0 ========== 检测到基础名称: rediscl-huzdsq-shard-bfc, 分片编号: 0 使用 Secret: rediscl-huzdsq-shard-bfc-account-default 密码获取成功，前缀: Xm... 使用Pod环境变量中的Redis端口: 6379 --- 集群节点信息 --- a5d4fc43276d727e0f162488944b68ba7c1e439d 172.31.5.137:32496@30676,rediscl-huzdsq-shard-bfc-0.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local myself,slave f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 0 1750333501000 14 connected f1e5ba6810221fd9b7af42fc1ff2907eaed2b142 172.31.10.241:31209@30928,rediscl-huzdsq-shard-fwk-1.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local slave 6805dfae60f82469d32f167a0762f10b9fe532dc 0 1750333502617 6 connected f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 172.31.9.102:32508@31084,rediscl-huzdsq-shard-bfc-1.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local master - 0 1750333501512 14 connected 0-1364 5461-8192 10923-12287 566610eaebef8ad78e4fa9a8957436093634de2c 172.31.15.205:31054@30545,rediscl-huzdsq-shard-tt9-1.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local slave 9a47e108282ae378589e88936924a2f36a944e1a 0 1750333503020 7 connected 9a47e108282ae378589e88936924a2f36a944e1a 172.31.9.102:30626@31966,rediscl-huzdsq-shard-tt9-0.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local master - 0 1750333502014 7 connected 9558-10922 12288-16383 6805dfae60f82469d32f167a0762f10b9fe532dc 172.31.15.205:30964@30479,rediscl-huzdsq-shard-fwk-0.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local master - 0 1750333502014 6 connected 1365-5460 8193-9557 --- 集群状态信息 --- cluster_state:ok cluster_slots_assigned:16384 cluster_slots_ok:16384 cluster_slots_pfail:0 cluster_slots_fail:0 cluster_known_nodes:6 cluster_size:3 cluster_current_epoch:14 cluster_my_epoch:14 cluster_stats_messages_ping_sent:3548 cluster_stats_messages_pong_sent:3551 cluster_stats_messages_meet_sent:1 cluster_stats_messages_sent:7100 cluster_stats_messages_ping_received:3550 cluster_stats_messages_pong_received:3548 cluster_stats_messages_meet_received:1 cluster_stats_messages_received:7099 total_cluster_links_buffer_limit_exceeded:0 ========== 节点: rediscl-huzdsq-shard-bfc-1 ========== 检测到基础名称: rediscl-huzdsq-shard-bfc, 分片编号: 1 使用 Secret: rediscl-huzdsq-shard-bfc-account-default 密码获取成功，前缀: Xm... 使用Pod环境变量中的Redis端口: 6379 --- 集群节点信息 --- f1e5ba6810221fd9b7af42fc1ff2907eaed2b142 172.31.10.241:31209@30928,rediscl-huzdsq-shard-fwk-1.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local slave 6805dfae60f82469d32f167a0762f10b9fe532dc 0 1750333509000 6 connected 9a47e108282ae378589e88936924a2f36a944e1a 172.31.9.102:30626@31966,rediscl-huzdsq-shard-tt9-0.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local master - 0 1750333507967 7 connected 9558-10922 12288-16383 a5d4fc43276d727e0f162488944b68ba7c1e439d 172.31.5.137:32496@30676,rediscl-huzdsq-shard-bfc-0.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local slave f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 0 1750333508570 14 connected 6805dfae60f82469d32f167a0762f10b9fe532dc 172.31.15.205:30964@30479,rediscl-huzdsq-shard-fwk-0.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local master - 0 1750333509575 6 connected 1365-5460 8193-9557 f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 172.31.9.102:32508@31084,rediscl-huzdsq-shard-bfc-1.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local myself,master - 0 1750333508000 14 connected 0-1364 5461-8192 10923-12287 566610eaebef8ad78e4fa9a8957436093634de2c 172.31.15.205:31054@30545,rediscl-huzdsq-shard-tt9-1.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local slave 9a47e108282ae378589e88936924a2f36a944e1a 0 1750333508973 7 connected --- 集群状态信息 --- cluster_state:ok cluster_slots_assigned:16384 cluster_slots_ok:16384 cluster_slots_pfail:0 cluster_slots_fail:0 cluster_known_nodes:6 cluster_size:3 cluster_current_epoch:14 cluster_my_epoch:14 cluster_stats_messages_ping_sent:2286 cluster_stats_messages_pong_sent:2294 cluster_stats_messages_meet_sent:2 cluster_stats_messages_sent:4582 cluster_stats_messages_ping_received:2290 cluster_stats_messages_pong_received:2288 cluster_stats_messages_meet_received:4 cluster_stats_messages_received:4582 total_cluster_links_buffer_limit_exceeded:0 ========== 节点: rediscl-huzdsq-shard-fwk-0 ========== 检测到基础名称: rediscl-huzdsq-shard-fwk, 分片编号: 0 使用 Secret: rediscl-huzdsq-shard-fwk-account-default 密码获取成功，前缀: Xm... 使用Pod环境变量中的Redis端口: 6379 --- 集群节点信息 --- 6805dfae60f82469d32f167a0762f10b9fe532dc 172.31.15.205:30964@30479,rediscl-huzdsq-shard-fwk-0.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local myself,master - 0 1750333514000 6 connected 1365-5460 8193-9557 f1e5ba6810221fd9b7af42fc1ff2907eaed2b142 172.31.10.241:31209@30928,rediscl-huzdsq-shard-fwk-1.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local slave 6805dfae60f82469d32f167a0762f10b9fe532dc 0 1750333516551 6 connected 9a47e108282ae378589e88936924a2f36a944e1a 172.31.9.102:30626@31966,rediscl-huzdsq-shard-tt9-0.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local master - 0 1750333516000 7 connected 9558-10922 12288-16383 f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 172.31.9.102:32508@31084,rediscl-huzdsq-shard-bfc-1.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local master - 0 1750333515000 14 connected 0-1364 5461-8192 10923-12287 a5d4fc43276d727e0f162488944b68ba7c1e439d 172.31.5.137:32496@30676,rediscl-huzdsq-shard-bfc-0.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local slave f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 0 1750333515000 14 connected 566610eaebef8ad78e4fa9a8957436093634de2c 172.31.15.205:31054@30545,rediscl-huzdsq-shard-tt9-1.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local slave 9a47e108282ae378589e88936924a2f36a944e1a 0 1750333515545 7 connected --- 集群状态信息 --- cluster_state:ok cluster_slots_assigned:16384 cluster_slots_ok:16384 cluster_slots_pfail:0 cluster_slots_fail:0 cluster_known_nodes:6 cluster_size:3 cluster_current_epoch:14 cluster_my_epoch:6 cluster_stats_messages_ping_sent:4297 cluster_stats_messages_pong_sent:4318 cluster_stats_messages_meet_sent:2 cluster_stats_messages_fail_sent:22 cluster_stats_messages_auth-ack_sent:1 cluster_stats_messages_sent:8640 cluster_stats_messages_ping_received:4310 cluster_stats_messages_pong_received:4292 cluster_stats_messages_meet_received:8 cluster_stats_messages_fail_received:15 cluster_stats_messages_auth-req_received:1 cluster_stats_messages_received:8626 total_cluster_links_buffer_limit_exceeded:0 ========== 节点: rediscl-huzdsq-shard-fwk-1 ========== 检测到基础名称: rediscl-huzdsq-shard-fwk, 分片编号: 1 使用 Secret: rediscl-huzdsq-shard-fwk-account-default 密码获取成功，前缀: Xm... 使用Pod环境变量中的Redis端口: 6379 --- 集群节点信息 --- f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 172.31.9.102:32508@31084,rediscl-huzdsq-shard-bfc-1.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local master - 0 1750333523000 14 connected 0-1364 5461-8192 10923-12287 9a47e108282ae378589e88936924a2f36a944e1a 172.31.9.102:30626@31966,rediscl-huzdsq-shard-tt9-0.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local master - 0 1750333522000 7 connected 9558-10922 12288-16383 f1e5ba6810221fd9b7af42fc1ff2907eaed2b142 172.31.10.241:31209@30928,rediscl-huzdsq-shard-fwk-1.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local myself,slave 6805dfae60f82469d32f167a0762f10b9fe532dc 0 1750333521000 6 connected 566610eaebef8ad78e4fa9a8957436093634de2c 172.31.15.205:31054@30545,rediscl-huzdsq-shard-tt9-1.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local slave 9a47e108282ae378589e88936924a2f36a944e1a 0 1750333523115 7 connected a5d4fc43276d727e0f162488944b68ba7c1e439d 172.31.5.137:32496@30676,rediscl-huzdsq-shard-bfc-0.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local slave f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 0 1750333522000 14 connected 6805dfae60f82469d32f167a0762f10b9fe532dc 172.31.15.205:30964@30479,rediscl-huzdsq-shard-fwk-0.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local master - 0 1750333521508 6 connected 1365-5460 8193-9557 --- 集群状态信息 --- cluster_state:ok cluster_slots_assigned:16384 cluster_slots_ok:16384 cluster_slots_pfail:0 cluster_slots_fail:0 cluster_known_nodes:6 cluster_size:3 cluster_current_epoch:14 cluster_my_epoch:6 cluster_stats_messages_ping_sent:4235 cluster_stats_messages_pong_sent:4306 cluster_stats_messages_meet_sent:1 cluster_stats_messages_fail_sent:10 cluster_stats_messages_sent:8552 cluster_stats_messages_ping_received:4306 cluster_stats_messages_pong_received:4233 cluster_stats_messages_fail_received:3 cluster_stats_messages_auth-req_received:1 cluster_stats_messages_received:8543 total_cluster_links_buffer_limit_exceeded:0 ========== 节点: rediscl-huzdsq-shard-tt9-0 ========== 检测到基础名称: rediscl-huzdsq-shard-tt9, 分片编号: 0 使用 Secret: rediscl-huzdsq-shard-tt9-account-default 密码获取成功，前缀: Xm... 使用Pod环境变量中的Redis端口: 6379 --- 集群节点信息 --- a5d4fc43276d727e0f162488944b68ba7c1e439d 172.31.5.137:32496@30676,rediscl-huzdsq-shard-bfc-0.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local slave f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 0 1750333529382 14 connected 566610eaebef8ad78e4fa9a8957436093634de2c 172.31.15.205:31054@30545,rediscl-huzdsq-shard-tt9-1.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local slave 9a47e108282ae378589e88936924a2f36a944e1a 0 1750333529584 7 connected 6805dfae60f82469d32f167a0762f10b9fe532dc 172.31.15.205:30964@30479,rediscl-huzdsq-shard-fwk-0.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local master - 0 1750333529000 6 connected 1365-5460 8193-9557 f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 172.31.9.102:32508@31084,rediscl-huzdsq-shard-bfc-1.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local master - 0 1750333527373 14 connected 0-1364 5461-8192 10923-12287 9a47e108282ae378589e88936924a2f36a944e1a 172.31.9.102:30626@31966,rediscl-huzdsq-shard-tt9-0.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local myself,master - 0 1750333528000 7 connected 9558-10922 12288-16383 f1e5ba6810221fd9b7af42fc1ff2907eaed2b142 172.31.10.241:31209@30928,rediscl-huzdsq-shard-fwk-1.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local slave 6805dfae60f82469d32f167a0762f10b9fe532dc 0 1750333528580 6 connected --- 集群状态信息 --- cluster_state:ok cluster_slots_assigned:16384 cluster_slots_ok:16384 cluster_slots_pfail:0 cluster_slots_fail:0 cluster_known_nodes:6 cluster_size:3 cluster_current_epoch:14 cluster_my_epoch:7 cluster_stats_messages_ping_sent:4217 cluster_stats_messages_pong_sent:4311 cluster_stats_messages_meet_sent:2 cluster_stats_messages_fail_sent:25 cluster_stats_messages_auth-ack_sent:1 cluster_stats_messages_sent:8556 cluster_stats_messages_ping_received:4303 cluster_stats_messages_pong_received:4213 cluster_stats_messages_meet_received:8 cluster_stats_messages_fail_received:7 cluster_stats_messages_auth-req_received:1 cluster_stats_messages_received:8532 total_cluster_links_buffer_limit_exceeded:0 ========== 节点: rediscl-huzdsq-shard-tt9-1 ========== 检测到基础名称: rediscl-huzdsq-shard-tt9, 分片编号: 1 使用 Secret: rediscl-huzdsq-shard-tt9-account-default 密码获取成功，前缀: Xm... 使用Pod环境变量中的Redis端口: 6379 --- 集群节点信息 --- 6805dfae60f82469d32f167a0762f10b9fe532dc 172.31.15.205:30964@30479,rediscl-huzdsq-shard-fwk-0.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local master - 0 1750333534000 6 connected 1365-5460 8193-9557 f1e5ba6810221fd9b7af42fc1ff2907eaed2b142 172.31.10.241:31209@30928,rediscl-huzdsq-shard-fwk-1.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local slave 6805dfae60f82469d32f167a0762f10b9fe532dc 0 1750333535000 6 connected 566610eaebef8ad78e4fa9a8957436093634de2c 172.31.15.205:31054@30545,rediscl-huzdsq-shard-tt9-1.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local myself,slave 9a47e108282ae378589e88936924a2f36a944e1a 0 1750333533000 7 connected 9a47e108282ae378589e88936924a2f36a944e1a 172.31.9.102:30626@31966,rediscl-huzdsq-shard-tt9-0.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local master - 0 1750333535212 7 connected 9558-10922 12288-16383 a5d4fc43276d727e0f162488944b68ba7c1e439d 172.31.5.137:32496@30676,rediscl-huzdsq-shard-bfc-0.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local slave f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 0 1750333534207 14 connected f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 172.31.9.102:32508@31084,rediscl-huzdsq-shard-bfc-1.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local master - 0 1750333534000 14 connected 0-1364 5461-8192 10923-12287 --- 集群状态信息 --- cluster_state:ok cluster_slots_assigned:16384 cluster_slots_ok:16384 cluster_slots_pfail:0 cluster_slots_fail:0 cluster_known_nodes:6 cluster_size:3 cluster_current_epoch:14 cluster_my_epoch:7 cluster_stats_messages_ping_sent:4238 cluster_stats_messages_pong_sent:4301 cluster_stats_messages_meet_sent:1 cluster_stats_messages_fail_sent:10 cluster_stats_messages_sent:8550 cluster_stats_messages_ping_received:4301 cluster_stats_messages_pong_received:4236 cluster_stats_messages_fail_received:2 cluster_stats_messages_auth-req_received:1 cluster_stats_messages_received:8540 total_cluster_links_buffer_limit_exceeded:0 ========== 集群健康分析 ========== 使用节点 rediscl-huzdsq-shard-bfc-0 作为参考基准 检测到以下分片标识符: - bfc - fwk - tt9 参考节点观察到的拓扑结构: ID IP地址 状态 主节点ID 槽位 ---------------------------------------- ------------- ---------------- ---------------------------------------- -------------- a5d4fc43276d727e0f162488944b68ba7c1e439d 172.31.5.137:32496 从节点 f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 f1e5ba6810221fd9b7af42fc1ff2907eaed2b142 172.31.10.241:31209 从节点 6805dfae60f82469d32f167a0762f10b9fe532dc f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 172.31.9.102:32508 主节点 - 0-1364 5461-8192 10923-12287 (共 0 个槽位) 566610eaebef8ad78e4fa9a8957436093634de2c 172.31.15.205:31054 从节点 9a47e108282ae378589e88936924a2f36a944e1a 9a47e108282ae378589e88936924a2f36a944e1a 172.31.9.102:30626 主节点 - 9558-10922 12288-16383 (共 0 个槽位) 6805dfae60f82469d32f167a0762f10b9fe532dc 172.31.15.205:30964 主节点 - 1365-5460 8193-9557 (共 0 个槽位) 正在分析节点 rediscl-huzdsq-shard-bfc-1 的拓扑视图... 正在分析节点 rediscl-huzdsq-shard-fwk-0 的拓扑视图... 正在分析节点 rediscl-huzdsq-shard-fwk-1 的拓扑视图... 正在分析节点 rediscl-huzdsq-shard-tt9-0 的拓扑视图... 正在分析节点 rediscl-huzdsq-shard-tt9-1 的拓扑视图... 槽位分配统计: - 总槽位数: 16384 - 未覆盖槽位数: 0 - 重复覆盖槽位数: 0 - 正确覆盖槽位数: 16384 主节点槽位分配明细: 节点 f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 (172.31.9.102:32508) 负责 0 个槽位: 0-1364 5461-8192 10923-12287 节点 9a47e108282ae378589e88936924a2f36a944e1a (172.31.9.102:30626) 负责 0 个槽位: 9558-10922 12288-16383 节点 6805dfae60f82469d32f167a0762f10b9fe532dc (172.31.15.205:30964) 负责 0 个槽位: 1365-5460 8193-9557 总计分配槽位: 0 / 16384 警告: 分配的总槽位数 (0) 不等于 16384 缺少 16384 个槽位分配 分片分析: 分片 bfc: 1 个主节点, 1 个从节点 ✅ 分片 fwk: 1 个主节点, 1 个从节点 ✅ 分片 tt9: 1 个主节点, 1 个从节点 ✅ 集群分析总结: - 检测到 3 个主节点和 3 个从节点 - 检测到 0 个故障或疑似故障节点 - 集群状态统一显示为OK: 是 - 所有槽位正确分配: 是 - 所有节点看到一致的集群大小: 是 - 所有节点看到一致的拓扑结构: 是 - 所有槽位被正确覆盖: 是 - 集群中无故障或疑似故障节点: 是 集群健康状态: 健康 ✅ 所有检查均通过，Redis集群运行正常。 analyze cluster health success `kubectl get backupschedule -l app.kubernetes.io/instance=rediscl-huzdsq ` `kubectl get backupschedule rediscl-huzdsq-shard-backup-schedule -ojsonpath='***.spec.schedules[*].backupMethod***' ` backupschedule.dataprotection.kubeblocks.io/rediscl-huzdsq-shard-backup-schedule patched backupschedule.dataprotection.kubeblocks.io/rediscl-huzdsq-shard-backup-schedule patched check backup status `kbcli cluster list-backups rediscl-huzdsq --namespace ns-xqred ` No backups found in ns-xqred namespace. No backups found in ns-xqred namespace. backup_status:-- No backups found in ns-xqred namespace. backup_status:-- No backups found in ns-xqred namespace. backup_status:-- `kubectl get backupschedule -l app.kubernetes.io/instance=rediscl-huzdsq ` `kubectl get backupschedule rediscl-huzdsq-shard-backup-schedule -ojsonpath='***.spec.schedules[*].backupMethod***' ` backupschedule.dataprotection.kubeblocks.io/rediscl-huzdsq-shard-backup-schedule patched backupschedule.dataprotection.kubeblocks.io/rediscl-huzdsq-shard-backup-schedule patched backup_status:rediscl-huzdsq-datafile-Running backup_status:rediscl-huzdsq-datafile-Running check backup status done backup_status:rediscl-huzdsq-datafile-20250619114700 ns-xqred rediscl-huzdsq datafile Completed 16517 13s Jun 19,2025 19:47 UTC+0800 Jun 19,2025 19:47 UTC+0800 Jun 26,2025 19:47 UTC+0800 `kubectl get backupschedule -l app.kubernetes.io/instance=rediscl-huzdsq ` `kubectl get backupschedule rediscl-huzdsq-shard-backup-schedule -ojsonpath='***.spec.schedules[*].backupMethod***' ` backupschedule.dataprotection.kubeblocks.io/rediscl-huzdsq-shard-backup-schedule patched (no change) backupschedule.dataprotection.kubeblocks.io/rediscl-huzdsq-shard-backup-schedule patched (no change) cluster restore backup Error from server (NotFound): opsrequests.apps.kubeblocks.io "rediscl-huzdsq-backup" not found `kbcli cluster describe-backup rediscl-huzdsq-datafile-20250619114700 --namespace ns-xqred ` Name: rediscl-huzdsq-datafile-20250619114700 Cluster: rediscl-huzdsq Namespace: ns-xqred Spec: Method: datafile Policy Name: rediscl-huzdsq-shard-backup-policy Status: Phase: Completed Total Size: 16517 ActionSet Name: redis-cluster-backup Repository: backuprepo-kbcli-test Duration: 13s Expiration Time: Jun 26,2025 19:47 UTC+0800 Start Time: Jun 19,2025 19:47 UTC+0800 Completion Time: Jun 19,2025 19:47 UTC+0800 Path: /ns-xqred/rediscl-huzdsq-0d3fa56d-98e0-4576-b860-c3f90731052e/shard/rediscl-huzdsq-datafile-20250619114700 Warning Events: `kbcli cluster restore rediscl-huzdsq-backup --backup rediscl-huzdsq-datafile-20250619114700 --namespace ns-xqred ` Cluster rediscl-huzdsq-backup created check cluster status `kbcli cluster list rediscl-huzdsq-backup --show-labels --namespace ns-xqred ` NAME NAMESPACE CLUSTER-DEFINITION VERSION TERMINATION-POLICY STATUS CREATED-TIME LABELS rediscl-huzdsq-backup ns-xqred WipeOut Jun 19,2025 19:47 UTC+0800 cluster_status: cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Updating cluster_status:Updating check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances rediscl-huzdsq-backup --namespace ns-xqred ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME rediscl-huzdsq-backup-shard-975-0 ns-xqred rediscl-huzdsq-backup shard-975 Running primary us-west-2a 200m / 200m 644245094400m / 644245094400m ip-172-31-6-202.us-west-2.compute.internal/172.31.6.202 Jun 19,2025 19:47 UTC+0800 rediscl-huzdsq-backup-shard-975-1 ns-xqred rediscl-huzdsq-backup shard-975 Running primary us-west-2a 200m / 200m 644245094400m / 644245094400m ip-172-31-2-115.us-west-2.compute.internal/172.31.2.115 Jun 19,2025 19:47 UTC+0800 rediscl-huzdsq-backup-shard-dzp-0 ns-xqred rediscl-huzdsq-backup shard-dzp Running primary us-west-2a 200m / 200m 644245094400m / 644245094400m ip-172-31-12-213.us-west-2.compute.internal/172.31.12.213 Jun 19,2025 19:47 UTC+0800 rediscl-huzdsq-backup-shard-dzp-1 ns-xqred rediscl-huzdsq-backup shard-dzp Running primary us-west-2a 200m / 200m 644245094400m / 644245094400m ip-172-31-0-176.us-west-2.compute.internal/172.31.0.176 Jun 19,2025 19:47 UTC+0800 rediscl-huzdsq-backup-shard-h6t-0 ns-xqred rediscl-huzdsq-backup shard-h6t Running primary us-west-2a 200m / 200m 644245094400m / 644245094400m ip-172-31-13-158.us-west-2.compute.internal/172.31.13.158 Jun 19,2025 19:47 UTC+0800 rediscl-huzdsq-backup-shard-h6t-1 ns-xqred rediscl-huzdsq-backup shard-h6t Running primary us-west-2a 200m / 200m 644245094400m / 644245094400m ip-172-31-6-202.us-west-2.compute.internal/172.31.6.202 Jun 19,2025 19:47 UTC+0800 check pod status done check cluster role check cluster role done primary: rediscl-huzdsq-backup-shard-975-0 rediscl-huzdsq-backup-shard-975-1 rediscl-huzdsq-backup-shard-dzp-0 rediscl-huzdsq-backup-shard-h6t-0 rediscl-huzdsq-backup-shard-h6t-1;secondary: rediscl-huzdsq-backup-shard-dzp-1 analyze cluster health check cluster connect `` ========== 节点: rediscl-huzdsq-shard-bfc-0 ========== 检测到基础名称: rediscl-huzdsq-shard-bfc, 分片编号: 0 使用 Secret: rediscl-huzdsq-shard-bfc-account-default 密码获取成功，前缀: Xm... 使用Pod环境变量中的Redis端口: 6379 --- 集群节点信息 --- a5d4fc43276d727e0f162488944b68ba7c1e439d 172.31.5.137:32496@30676,rediscl-huzdsq-shard-bfc-0.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local myself,slave f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 0 1750333722000 14 connected f1e5ba6810221fd9b7af42fc1ff2907eaed2b142 172.31.10.241:31209@30928,rediscl-huzdsq-shard-fwk-1.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local slave 6805dfae60f82469d32f167a0762f10b9fe532dc 0 1750333723142 6 connected f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 172.31.9.102:32508@31084,rediscl-huzdsq-shard-bfc-1.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local master - 0 1750333723000 14 connected 0-1364 5461-8192 10923-12287 566610eaebef8ad78e4fa9a8957436093634de2c 172.31.15.205:31054@30545,rediscl-huzdsq-shard-tt9-1.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local slave 9a47e108282ae378589e88936924a2f36a944e1a 0 1750333722136 7 connected 9a47e108282ae378589e88936924a2f36a944e1a 172.31.9.102:30626@31966,rediscl-huzdsq-shard-tt9-0.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local master - 0 1750333722000 7 connected 9558-10922 12288-16383 6805dfae60f82469d32f167a0762f10b9fe532dc 172.31.15.205:30964@30479,rediscl-huzdsq-shard-fwk-0.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local master - 0 1750333723645 6 connected 1365-5460 8193-9557 --- 集群状态信息 --- cluster_state:ok cluster_slots_assigned:16384 cluster_slots_ok:16384 cluster_slots_pfail:0 cluster_slots_fail:0 cluster_known_nodes:6 cluster_size:3 cluster_current_epoch:14 cluster_my_epoch:14 cluster_stats_messages_ping_sent:3946 cluster_stats_messages_pong_sent:3957 cluster_stats_messages_meet_sent:1 cluster_stats_messages_sent:7904 cluster_stats_messages_ping_received:3956 cluster_stats_messages_pong_received:3946 cluster_stats_messages_meet_received:1 cluster_stats_messages_received:7903 total_cluster_links_buffer_limit_exceeded:0 ========== 节点: rediscl-huzdsq-shard-bfc-1 ========== 检测到基础名称: rediscl-huzdsq-shard-bfc, 分片编号: 1 使用 Secret: rediscl-huzdsq-shard-bfc-account-default 密码获取成功，前缀: Xm... 使用Pod环境变量中的Redis端口: 6379 --- 集群节点信息 --- f1e5ba6810221fd9b7af42fc1ff2907eaed2b142 172.31.10.241:31209@30928,rediscl-huzdsq-shard-fwk-1.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local slave 6805dfae60f82469d32f167a0762f10b9fe532dc 0 1750333729127 6 connected 9a47e108282ae378589e88936924a2f36a944e1a 172.31.9.102:30626@31966,rediscl-huzdsq-shard-tt9-0.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local master - 0 1750333728000 7 connected 9558-10922 12288-16383 a5d4fc43276d727e0f162488944b68ba7c1e439d 172.31.5.137:32496@30676,rediscl-huzdsq-shard-bfc-0.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local slave f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 0 1750333730030 14 connected 6805dfae60f82469d32f167a0762f10b9fe532dc 172.31.15.205:30964@30479,rediscl-huzdsq-shard-fwk-0.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local master - 0 1750333729000 6 connected 1365-5460 8193-9557 f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 172.31.9.102:32508@31084,rediscl-huzdsq-shard-bfc-1.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local myself,master - 0 1750333729000 14 connected 0-1364 5461-8192 10923-12287 566610eaebef8ad78e4fa9a8957436093634de2c 172.31.15.205:31054@30545,rediscl-huzdsq-shard-tt9-1.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local slave 9a47e108282ae378589e88936924a2f36a944e1a 0 1750333730131 7 connected --- 集群状态信息 --- cluster_state:ok cluster_slots_assigned:16384 cluster_slots_ok:16384 cluster_slots_pfail:0 cluster_slots_fail:0 cluster_known_nodes:6 cluster_size:3 cluster_current_epoch:14 cluster_my_epoch:14 cluster_stats_messages_ping_sent:2682 cluster_stats_messages_pong_sent:2694 cluster_stats_messages_meet_sent:2 cluster_stats_messages_sent:5378 cluster_stats_messages_ping_received:2690 cluster_stats_messages_pong_received:2684 cluster_stats_messages_meet_received:4 cluster_stats_messages_received:5378 total_cluster_links_buffer_limit_exceeded:0 ========== 节点: rediscl-huzdsq-shard-fwk-0 ========== 检测到基础名称: rediscl-huzdsq-shard-fwk, 分片编号: 0 使用 Secret: rediscl-huzdsq-shard-fwk-account-default 密码获取成功，前缀: Xm... 使用Pod环境变量中的Redis端口: 6379 --- 集群节点信息 --- 6805dfae60f82469d32f167a0762f10b9fe532dc 172.31.15.205:30964@30479,rediscl-huzdsq-shard-fwk-0.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local myself,master - 0 1750333735000 6 connected 1365-5460 8193-9557 f1e5ba6810221fd9b7af42fc1ff2907eaed2b142 172.31.10.241:31209@30928,rediscl-huzdsq-shard-fwk-1.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local slave 6805dfae60f82469d32f167a0762f10b9fe532dc 0 1750333734511 6 connected 9a47e108282ae378589e88936924a2f36a944e1a 172.31.9.102:30626@31966,rediscl-huzdsq-shard-tt9-0.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local master - 0 1750333735516 7 connected 9558-10922 12288-16383 f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 172.31.9.102:32508@31084,rediscl-huzdsq-shard-bfc-1.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local master - 0 1750333736521 14 connected 0-1364 5461-8192 10923-12287 a5d4fc43276d727e0f162488944b68ba7c1e439d 172.31.5.137:32496@30676,rediscl-huzdsq-shard-bfc-0.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local slave f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 0 1750333736000 14 connected 566610eaebef8ad78e4fa9a8957436093634de2c 172.31.15.205:31054@30545,rediscl-huzdsq-shard-tt9-1.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local slave 9a47e108282ae378589e88936924a2f36a944e1a 0 1750333735919 7 connected --- 集群状态信息 --- cluster_state:ok cluster_slots_assigned:16384 cluster_slots_ok:16384 cluster_slots_pfail:0 cluster_slots_fail:0 cluster_known_nodes:6 cluster_size:3 cluster_current_epoch:14 cluster_my_epoch:6 cluster_stats_messages_ping_sent:4711 cluster_stats_messages_pong_sent:4716 cluster_stats_messages_meet_sent:2 cluster_stats_messages_fail_sent:22 cluster_stats_messages_auth-ack_sent:1 cluster_stats_messages_sent:9452 cluster_stats_messages_ping_received:4708 cluster_stats_messages_pong_received:4706 cluster_stats_messages_meet_received:8 cluster_stats_messages_fail_received:15 cluster_stats_messages_auth-req_received:1 cluster_stats_messages_received:9438 total_cluster_links_buffer_limit_exceeded:0 ========== 节点: rediscl-huzdsq-shard-fwk-1 ========== 检测到基础名称: rediscl-huzdsq-shard-fwk, 分片编号: 1 使用 Secret: rediscl-huzdsq-shard-fwk-account-default 密码获取成功，前缀: Xm... 使用Pod环境变量中的Redis端口: 6379 --- 集群节点信息 --- f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 172.31.9.102:32508@31084,rediscl-huzdsq-shard-bfc-1.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local master - 0 1750333741069 14 connected 0-1364 5461-8192 10923-12287 9a47e108282ae378589e88936924a2f36a944e1a 172.31.9.102:30626@31966,rediscl-huzdsq-shard-tt9-0.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local master - 0 1750333743079 7 connected 9558-10922 12288-16383 f1e5ba6810221fd9b7af42fc1ff2907eaed2b142 172.31.10.241:31209@30928,rediscl-huzdsq-shard-fwk-1.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local myself,slave 6805dfae60f82469d32f167a0762f10b9fe532dc 0 1750333740000 6 connected 566610eaebef8ad78e4fa9a8957436093634de2c 172.31.15.205:31054@30545,rediscl-huzdsq-shard-tt9-1.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local slave 9a47e108282ae378589e88936924a2f36a944e1a 0 1750333742576 7 connected a5d4fc43276d727e0f162488944b68ba7c1e439d 172.31.5.137:32496@30676,rediscl-huzdsq-shard-bfc-0.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local slave f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 0 1750333741571 14 connected 6805dfae60f82469d32f167a0762f10b9fe532dc 172.31.15.205:30964@30479,rediscl-huzdsq-shard-fwk-0.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local master - 0 1750333742074 6 connected 1365-5460 8193-9557 --- 集群状态信息 --- cluster_state:ok cluster_slots_assigned:16384 cluster_slots_ok:16384 cluster_slots_pfail:0 cluster_slots_fail:0 cluster_known_nodes:6 cluster_size:3 cluster_current_epoch:14 cluster_my_epoch:6 cluster_stats_messages_ping_sent:4647 cluster_stats_messages_pong_sent:4721 cluster_stats_messages_meet_sent:1 cluster_stats_messages_fail_sent:10 cluster_stats_messages_sent:9379 cluster_stats_messages_ping_received:4721 cluster_stats_messages_pong_received:4645 cluster_stats_messages_fail_received:3 cluster_stats_messages_auth-req_received:1 cluster_stats_messages_received:9370 total_cluster_links_buffer_limit_exceeded:0 ========== 节点: rediscl-huzdsq-shard-tt9-0 ========== 检测到基础名称: rediscl-huzdsq-shard-tt9, 分片编号: 0 使用 Secret: rediscl-huzdsq-shard-tt9-account-default 密码获取成功，前缀: Xm... 使用Pod环境变量中的Redis端口: 6379 --- 集群节点信息 --- a5d4fc43276d727e0f162488944b68ba7c1e439d 172.31.5.137:32496@30676,rediscl-huzdsq-shard-bfc-0.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local slave f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 0 1750333749000 14 connected 566610eaebef8ad78e4fa9a8957436093634de2c 172.31.15.205:31054@30545,rediscl-huzdsq-shard-tt9-1.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local slave 9a47e108282ae378589e88936924a2f36a944e1a 0 1750333749632 7 connected 6805dfae60f82469d32f167a0762f10b9fe532dc 172.31.15.205:30964@30479,rediscl-huzdsq-shard-fwk-0.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local master - 0 1750333748526 6 connected 1365-5460 8193-9557 f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 172.31.9.102:32508@31084,rediscl-huzdsq-shard-bfc-1.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local master - 0 1750333749000 14 connected 0-1364 5461-8192 10923-12287 9a47e108282ae378589e88936924a2f36a944e1a 172.31.9.102:30626@31966,rediscl-huzdsq-shard-tt9-0.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local myself,master - 0 1750333747000 7 connected 9558-10922 12288-16383 f1e5ba6810221fd9b7af42fc1ff2907eaed2b142 172.31.10.241:31209@30928,rediscl-huzdsq-shard-fwk-1.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local slave 6805dfae60f82469d32f167a0762f10b9fe532dc 0 1750333748000 6 connected --- 集群状态信息 --- cluster_state:ok cluster_slots_assigned:16384 cluster_slots_ok:16384 cluster_slots_pfail:0 cluster_slots_fail:0 cluster_known_nodes:6 cluster_size:3 cluster_current_epoch:14 cluster_my_epoch:7 cluster_stats_messages_ping_sent:4608 cluster_stats_messages_pong_sent:4705 cluster_stats_messages_meet_sent:2 cluster_stats_messages_fail_sent:25 cluster_stats_messages_auth-ack_sent:1 cluster_stats_messages_sent:9341 cluster_stats_messages_ping_received:4697 cluster_stats_messages_pong_received:4604 cluster_stats_messages_meet_received:8 cluster_stats_messages_fail_received:7 cluster_stats_messages_auth-req_received:1 cluster_stats_messages_received:9317 total_cluster_links_buffer_limit_exceeded:0 ========== 节点: rediscl-huzdsq-shard-tt9-1 ========== 检测到基础名称: rediscl-huzdsq-shard-tt9, 分片编号: 1 使用 Secret: rediscl-huzdsq-shard-tt9-account-default 密码获取成功，前缀: Xm... 使用Pod环境变量中的Redis端口: 6379 --- 集群节点信息 --- 6805dfae60f82469d32f167a0762f10b9fe532dc 172.31.15.205:30964@30479,rediscl-huzdsq-shard-fwk-0.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local master - 0 1750333756000 6 connected 1365-5460 8193-9557 f1e5ba6810221fd9b7af42fc1ff2907eaed2b142 172.31.10.241:31209@30928,rediscl-huzdsq-shard-fwk-1.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local slave 6805dfae60f82469d32f167a0762f10b9fe532dc 0 1750333755358 6 connected 566610eaebef8ad78e4fa9a8957436093634de2c 172.31.15.205:31054@30545,rediscl-huzdsq-shard-tt9-1.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local myself,slave 9a47e108282ae378589e88936924a2f36a944e1a 0 1750333754000 7 connected 9a47e108282ae378589e88936924a2f36a944e1a 172.31.9.102:30626@31966,rediscl-huzdsq-shard-tt9-0.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local master - 0 1750333755000 7 connected 9558-10922 12288-16383 a5d4fc43276d727e0f162488944b68ba7c1e439d 172.31.5.137:32496@30676,rediscl-huzdsq-shard-bfc-0.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local slave f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 0 1750333756364 14 connected f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 172.31.9.102:32508@31084,rediscl-huzdsq-shard-bfc-1.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local master - 0 1750333755559 14 connected 0-1364 5461-8192 10923-12287 --- 集群状态信息 --- cluster_state:ok cluster_slots_assigned:16384 cluster_slots_ok:16384 cluster_slots_pfail:0 cluster_slots_fail:0 cluster_known_nodes:6 cluster_size:3 cluster_current_epoch:14 cluster_my_epoch:7 cluster_stats_messages_ping_sent:4638 cluster_stats_messages_pong_sent:4705 cluster_stats_messages_meet_sent:1 cluster_stats_messages_fail_sent:10 cluster_stats_messages_sent:9354 cluster_stats_messages_ping_received:4705 cluster_stats_messages_pong_received:4636 cluster_stats_messages_fail_received:2 cluster_stats_messages_auth-req_received:1 cluster_stats_messages_received:9344 total_cluster_links_buffer_limit_exceeded:0 ========== 集群健康分析 ========== 使用节点 rediscl-huzdsq-shard-bfc-0 作为参考基准 检测到以下分片标识符: - bfc - fwk - tt9 参考节点观察到的拓扑结构: ID IP地址 状态 主节点ID 槽位 ---------------------------------------- ------------- ---------------- ---------------------------------------- -------------- a5d4fc43276d727e0f162488944b68ba7c1e439d 172.31.5.137:32496 从节点 f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 f1e5ba6810221fd9b7af42fc1ff2907eaed2b142 172.31.10.241:31209 从节点 6805dfae60f82469d32f167a0762f10b9fe532dc f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 172.31.9.102:32508 主节点 - 0-1364 5461-8192 10923-12287 (共 0 个槽位) 566610eaebef8ad78e4fa9a8957436093634de2c 172.31.15.205:31054 从节点 9a47e108282ae378589e88936924a2f36a944e1a 9a47e108282ae378589e88936924a2f36a944e1a 172.31.9.102:30626 主节点 - 9558-10922 12288-16383 (共 0 个槽位) 6805dfae60f82469d32f167a0762f10b9fe532dc 172.31.15.205:30964 主节点 - 1365-5460 8193-9557 (共 0 个槽位) 正在分析节点 rediscl-huzdsq-shard-bfc-1 的拓扑视图... 正在分析节点 rediscl-huzdsq-shard-fwk-0 的拓扑视图... 正在分析节点 rediscl-huzdsq-shard-fwk-1 的拓扑视图... 正在分析节点 rediscl-huzdsq-shard-tt9-0 的拓扑视图... 正在分析节点 rediscl-huzdsq-shard-tt9-1 的拓扑视图... 槽位分配统计: - 总槽位数: 16384 - 未覆盖槽位数: 0 - 重复覆盖槽位数: 0 - 正确覆盖槽位数: 16384 主节点槽位分配明细: 节点 f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 (172.31.9.102:32508) 负责 0 个槽位: 0-1364 5461-8192 10923-12287 节点 9a47e108282ae378589e88936924a2f36a944e1a (172.31.9.102:30626) 负责 0 个槽位: 9558-10922 12288-16383 节点 6805dfae60f82469d32f167a0762f10b9fe532dc (172.31.15.205:30964) 负责 0 个槽位: 1365-5460 8193-9557 总计分配槽位: 0 / 16384 警告: 分配的总槽位数 (0) 不等于 16384 缺少 16384 个槽位分配 分片分析: 分片 bfc: 1 个主节点, 1 个从节点 ✅ 分片 fwk: 1 个主节点, 1 个从节点 ✅ 分片 tt9: 1 个主节点, 1 个从节点 ✅ 集群分析总结: - 检测到 3 个主节点和 3 个从节点 - 检测到 0 个故障或疑似故障节点 - 集群状态统一显示为OK: 是 - 所有槽位正确分配: 是 - 所有节点看到一致的集群大小: 是 - 所有节点看到一致的拓扑结构: 是 - 所有槽位被正确覆盖: 是 - 集群中无故障或疑似故障节点: 是 集群健康状态: 健康 ✅ 所有检查均通过，Redis集群运行正常。 analyze cluster health success `kbcli cluster describe-backup rediscl-huzdsq-datafile-20250619114700 --namespace ns-xqred ` Name: rediscl-huzdsq-datafile-20250619114700 Cluster: rediscl-huzdsq Namespace: ns-xqred Spec: Method: datafile Policy Name: rediscl-huzdsq-shard-backup-policy Status: Phase: Completed Total Size: 16517 ActionSet Name: redis-cluster-backup Repository: backuprepo-kbcli-test Duration: 13s Expiration Time: Jun 26,2025 19:47 UTC+0800 Start Time: Jun 19,2025 19:47 UTC+0800 Completion Time: Jun 19,2025 19:47 UTC+0800 Path: /ns-xqred/rediscl-huzdsq-0d3fa56d-98e0-4576-b860-c3f90731052e/shard/rediscl-huzdsq-datafile-20250619114700 Warning Events: cluster connect kbcli unsupported engine type: shard-fwk delete cluster rediscl-huzdsq-backup `kbcli cluster delete rediscl-huzdsq-backup --auto-approve --namespace ns-xqred ` Cluster rediscl-huzdsq-backup deleted pod_info:rediscl-huzdsq-backup-shard-975-0 3/3 Running 0 2m50s rediscl-huzdsq-backup-shard-975-1 3/3 Running 0 2m26s rediscl-huzdsq-backup-shard-dzp-0 3/3 Running 0 2m49s rediscl-huzdsq-backup-shard-dzp-1 3/3 Running 0 2m25s rediscl-huzdsq-backup-shard-h6t-0 3/3 Running 0 2m48s rediscl-huzdsq-backup-shard-h6t-1 3/3 Running 0 2m26s No resources found in ns-xqred namespace. delete cluster pod done No resources found in ns-xqred namespace. check cluster resource non-exist OK: pvc No resources found in ns-xqred namespace. delete cluster done No resources found in ns-xqred namespace. No resources found in ns-xqred namespace. No resources found in ns-xqred namespace. cluster delete backup `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge backups rediscl-huzdsq-datafile-20250619114700 --namespace ns-xqred ` backup.dataprotection.kubeblocks.io/rediscl-huzdsq-datafile-20250619114700 patched `kbcli cluster delete-backup rediscl-huzdsq --name rediscl-huzdsq-datafile-20250619114700 --force --auto-approve --namespace ns-xqred ` Backup rediscl-huzdsq-datafile-20250619114700 deleted No opsrequests found in ns-xqred namespace. cluster datafile backup `kubectl get backuprepo backuprepo-kbcli-test -o jsonpath="***.spec.credential.name***"` `kubectl get backuprepo backuprepo-kbcli-test -o jsonpath="***.spec.credential.namespace***"` `kubectl get secrets kb-backuprepo-btz8c -n kb-devqu -o jsonpath="***.data.accessKeyId***"` `kubectl get secrets kb-backuprepo-btz8c -n kb-devqu -o jsonpath="***.data.secretAccessKey***"` KUBEBLOCKS NAMESPACE:kb-devqu get kubeblocks namespace done `kubectl get secrets -l app.kubernetes.io/instance=kbcli-test-minio --namespace kb-devqu -o jsonpath="***.items[0].data.root-user***"` `kubectl get secrets -l app.kubernetes.io/instance=kbcli-test-minio --namespace kb-devqu -o jsonpath="***.items[0].data.root-password***"` minio_user:kbclitest,minio_password:kbclitest,minio_endpoint:kbcli-test-minio.kb-devqu.svc.cluster.local:9000 list minio bucket kbcli-test `echo 'mc config host add minioserver http://kbcli-test-minio.kb-devqu.svc.cluster.local:9000 kbclitest kbclitest;mc ls minioserver' | kubectl exec -it kbcli-test-minio-779456cf54-6xpw4 --namespace kb-devqu -- bash` Unable to use a TTY - input is not a terminal or the right kind of file list minio bucket done default backuprepo:backuprepo-kbcli-test exists `kbcli cluster backup rediscl-huzdsq --method datafile --namespace ns-xqred ` Backup backup-ns-xqred-rediscl-huzdsq-20250619195109 created successfully, you can view the progress: kbcli cluster list-backups --name=backup-ns-xqred-rediscl-huzdsq-20250619195109 -n ns-xqred check backup status `kbcli cluster list-backups rediscl-huzdsq --namespace ns-xqred ` NAME NAMESPACE SOURCE-CLUSTER METHOD STATUS TOTAL-SIZE DURATION CREATE-TIME COMPLETION-TIME EXPIRATION backup-ns-xqred-rediscl-huzdsq-20250619195109 ns-xqred rediscl-huzdsq datafile Running Jun 19,2025 19:51 UTC+0800 backup_status:rediscl-huzdsq-datafile-Running backup_status:rediscl-huzdsq-datafile-Running check backup status done backup_status:backup-ns-xqred-rediscl-huzdsq-20250619195109 ns-xqred rediscl-huzdsq datafile Completed 16513 11s Jun 19,2025 19:51 UTC+0800 Jun 19,2025 19:51 UTC+0800 cluster restore backup Error from server (NotFound): opsrequests.apps.kubeblocks.io "rediscl-huzdsq-backup" not found `kbcli cluster describe-backup backup-ns-xqred-rediscl-huzdsq-20250619195109 --namespace ns-xqred ` Name: backup-ns-xqred-rediscl-huzdsq-20250619195109 Cluster: rediscl-huzdsq Namespace: ns-xqred Spec: Method: datafile Policy Name: rediscl-huzdsq-shard-backup-policy Status: Phase: Completed Total Size: 16513 ActionSet Name: redis-cluster-backup Repository: backuprepo-kbcli-test Duration: 11s Start Time: Jun 19,2025 19:51 UTC+0800 Completion Time: Jun 19,2025 19:51 UTC+0800 Path: /ns-xqred/rediscl-huzdsq-0d3fa56d-98e0-4576-b860-c3f90731052e/shard/backup-ns-xqred-rediscl-huzdsq-20250619195109 Warning Events: `kbcli cluster restore rediscl-huzdsq-backup --backup backup-ns-xqred-rediscl-huzdsq-20250619195109 --namespace ns-xqred ` Cluster rediscl-huzdsq-backup created check cluster status `kbcli cluster list rediscl-huzdsq-backup --show-labels --namespace ns-xqred ` NAME NAMESPACE CLUSTER-DEFINITION VERSION TERMINATION-POLICY STATUS CREATED-TIME LABELS rediscl-huzdsq-backup ns-xqred WipeOut Jun 19,2025 19:51 UTC+0800 cluster_status: cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Updating check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances rediscl-huzdsq-backup --namespace ns-xqred ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME rediscl-huzdsq-backup-shard-62z-0 ns-xqred rediscl-huzdsq-backup shard-62z Running primary us-west-2a 200m / 200m 644245094400m / 644245094400m ip-172-31-0-176.us-west-2.compute.internal/172.31.0.176 Jun 19,2025 19:51 UTC+0800 rediscl-huzdsq-backup-shard-62z-1 ns-xqred rediscl-huzdsq-backup shard-62z Running secondary us-west-2a 200m / 200m 644245094400m / 644245094400m ip-172-31-13-158.us-west-2.compute.internal/172.31.13.158 Jun 19,2025 19:51 UTC+0800 rediscl-huzdsq-backup-shard-ncw-0 ns-xqred rediscl-huzdsq-backup shard-ncw Running primary us-west-2a 200m / 200m 644245094400m / 644245094400m ip-172-31-12-21.us-west-2.compute.internal/172.31.12.21 Jun 19,2025 19:51 UTC+0800 rediscl-huzdsq-backup-shard-ncw-1 ns-xqred rediscl-huzdsq-backup shard-ncw Running primary us-west-2a 200m / 200m 644245094400m / 644245094400m ip-172-31-10-126.us-west-2.compute.internal/172.31.10.126 Jun 19,2025 19:51 UTC+0800 rediscl-huzdsq-backup-shard-v98-0 ns-xqred rediscl-huzdsq-backup shard-v98 Running primary us-west-2a 200m / 200m 644245094400m / 644245094400m ip-172-31-6-202.us-west-2.compute.internal/172.31.6.202 Jun 19,2025 19:51 UTC+0800 rediscl-huzdsq-backup-shard-v98-1 ns-xqred rediscl-huzdsq-backup shard-v98 Running primary us-west-2a 200m / 200m 644245094400m / 644245094400m ip-172-31-12-213.us-west-2.compute.internal/172.31.12.213 Jun 19,2025 19:51 UTC+0800 check pod status done check cluster role check cluster role done primary: rediscl-huzdsq-backup-shard-62z-0 rediscl-huzdsq-backup-shard-ncw-0 rediscl-huzdsq-backup-shard-ncw-1 rediscl-huzdsq-backup-shard-v98-0;secondary: rediscl-huzdsq-backup-shard-62z-1 rediscl-huzdsq-backup-shard-v98-1 analyze cluster health check cluster connect `` ========== 节点: rediscl-huzdsq-shard-bfc-0 ========== 检测到基础名称: rediscl-huzdsq-shard-bfc, 分片编号: 0 使用 Secret: rediscl-huzdsq-shard-bfc-account-default 密码获取成功，前缀: Xm... 使用Pod环境变量中的Redis端口: 6379 --- 集群节点信息 --- a5d4fc43276d727e0f162488944b68ba7c1e439d 172.31.5.137:32496@30676,rediscl-huzdsq-shard-bfc-0.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local myself,slave f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 0 1750333950000 14 connected f1e5ba6810221fd9b7af42fc1ff2907eaed2b142 172.31.10.241:31209@30928,rediscl-huzdsq-shard-fwk-1.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local slave 6805dfae60f82469d32f167a0762f10b9fe532dc 0 1750333950262 6 connected f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 172.31.9.102:32508@31084,rediscl-huzdsq-shard-bfc-1.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local master - 0 1750333951568 14 connected 0-1364 5461-8192 10923-12287 566610eaebef8ad78e4fa9a8957436093634de2c 172.31.15.205:31054@30545,rediscl-huzdsq-shard-tt9-1.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local slave 9a47e108282ae378589e88936924a2f36a944e1a 0 1750333951265 7 connected 9a47e108282ae378589e88936924a2f36a944e1a 172.31.9.102:30626@31966,rediscl-huzdsq-shard-tt9-0.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local master - 0 1750333950262 7 connected 9558-10922 12288-16383 6805dfae60f82469d32f167a0762f10b9fe532dc 172.31.15.205:30964@30479,rediscl-huzdsq-shard-fwk-0.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local master - 0 1750333949760 6 connected 1365-5460 8193-9557 --- 集群状态信息 --- cluster_state:ok cluster_slots_assigned:16384 cluster_slots_ok:16384 cluster_slots_pfail:0 cluster_slots_fail:0 cluster_known_nodes:6 cluster_size:3 cluster_current_epoch:14 cluster_my_epoch:14 cluster_stats_messages_ping_sent:4363 cluster_stats_messages_pong_sent:4373 cluster_stats_messages_meet_sent:1 cluster_stats_messages_sent:8737 cluster_stats_messages_ping_received:4372 cluster_stats_messages_pong_received:4363 cluster_stats_messages_meet_received:1 cluster_stats_messages_received:8736 total_cluster_links_buffer_limit_exceeded:0 ========== 节点: rediscl-huzdsq-shard-bfc-1 ========== 检测到基础名称: rediscl-huzdsq-shard-bfc, 分片编号: 1 使用 Secret: rediscl-huzdsq-shard-bfc-account-default 密码获取成功，前缀: Xm... 使用Pod环境变量中的Redis端口: 6379 --- 集群节点信息 --- f1e5ba6810221fd9b7af42fc1ff2907eaed2b142 172.31.10.241:31209@30928,rediscl-huzdsq-shard-fwk-1.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local slave 6805dfae60f82469d32f167a0762f10b9fe532dc 0 1750333958000 6 connected 9a47e108282ae378589e88936924a2f36a944e1a 172.31.9.102:30626@31966,rediscl-huzdsq-shard-tt9-0.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local master - 0 1750333956297 7 connected 9558-10922 12288-16383 a5d4fc43276d727e0f162488944b68ba7c1e439d 172.31.5.137:32496@30676,rediscl-huzdsq-shard-bfc-0.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local slave f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 0 1750333957504 14 connected 6805dfae60f82469d32f167a0762f10b9fe532dc 172.31.15.205:30964@30479,rediscl-huzdsq-shard-fwk-0.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local master - 0 1750333958309 6 connected 1365-5460 8193-9557 f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 172.31.9.102:32508@31084,rediscl-huzdsq-shard-bfc-1.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local myself,master - 0 1750333957000 14 connected 0-1364 5461-8192 10923-12287 566610eaebef8ad78e4fa9a8957436093634de2c 172.31.15.205:31054@30545,rediscl-huzdsq-shard-tt9-1.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local slave 9a47e108282ae378589e88936924a2f36a944e1a 0 1750333956599 7 connected --- 集群状态信息 --- cluster_state:ok cluster_slots_assigned:16384 cluster_slots_ok:16384 cluster_slots_pfail:0 cluster_slots_fail:0 cluster_known_nodes:6 cluster_size:3 cluster_current_epoch:14 cluster_my_epoch:14 cluster_stats_messages_ping_sent:3092 cluster_stats_messages_pong_sent:3116 cluster_stats_messages_meet_sent:2 cluster_stats_messages_sent:6210 cluster_stats_messages_ping_received:3112 cluster_stats_messages_pong_received:3094 cluster_stats_messages_meet_received:4 cluster_stats_messages_received:6210 total_cluster_links_buffer_limit_exceeded:0 ========== 节点: rediscl-huzdsq-shard-fwk-0 ========== 检测到基础名称: rediscl-huzdsq-shard-fwk, 分片编号: 0 使用 Secret: rediscl-huzdsq-shard-fwk-account-default 密码获取成功，前缀: Xm... 使用Pod环境变量中的Redis端口: 6379 --- 集群节点信息 --- 6805dfae60f82469d32f167a0762f10b9fe532dc 172.31.15.205:30964@30479,rediscl-huzdsq-shard-fwk-0.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local myself,master - 0 1750333963000 6 connected 1365-5460 8193-9557 f1e5ba6810221fd9b7af42fc1ff2907eaed2b142 172.31.10.241:31209@30928,rediscl-huzdsq-shard-fwk-1.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local slave 6805dfae60f82469d32f167a0762f10b9fe532dc 0 1750333964000 6 connected 9a47e108282ae378589e88936924a2f36a944e1a 172.31.9.102:30626@31966,rediscl-huzdsq-shard-tt9-0.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local master - 0 1750333964126 7 connected 9558-10922 12288-16383 f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 172.31.9.102:32508@31084,rediscl-huzdsq-shard-bfc-1.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local master - 0 1750333964529 14 connected 0-1364 5461-8192 10923-12287 a5d4fc43276d727e0f162488944b68ba7c1e439d 172.31.5.137:32496@30676,rediscl-huzdsq-shard-bfc-0.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local slave f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 0 1750333965131 14 connected 566610eaebef8ad78e4fa9a8957436093634de2c 172.31.15.205:31054@30545,rediscl-huzdsq-shard-tt9-1.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local slave 9a47e108282ae378589e88936924a2f36a944e1a 0 1750333963120 7 connected --- 集群状态信息 --- cluster_state:ok cluster_slots_assigned:16384 cluster_slots_ok:16384 cluster_slots_pfail:0 cluster_slots_fail:0 cluster_known_nodes:6 cluster_size:3 cluster_current_epoch:14 cluster_my_epoch:6 cluster_stats_messages_ping_sent:5136 cluster_stats_messages_pong_sent:5129 cluster_stats_messages_meet_sent:2 cluster_stats_messages_fail_sent:22 cluster_stats_messages_auth-ack_sent:1 cluster_stats_messages_sent:10290 cluster_stats_messages_ping_received:5121 cluster_stats_messages_pong_received:5131 cluster_stats_messages_meet_received:8 cluster_stats_messages_fail_received:15 cluster_stats_messages_auth-req_received:1 cluster_stats_messages_received:10276 total_cluster_links_buffer_limit_exceeded:0 ========== 节点: rediscl-huzdsq-shard-fwk-1 ========== 检测到基础名称: rediscl-huzdsq-shard-fwk, 分片编号: 1 使用 Secret: rediscl-huzdsq-shard-fwk-account-default 密码获取成功，前缀: Xm... 使用Pod环境变量中的Redis端口: 6379 --- 集群节点信息 --- f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 172.31.9.102:32508@31084,rediscl-huzdsq-shard-bfc-1.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local master - 0 1750333971266 14 connected 0-1364 5461-8192 10923-12287 9a47e108282ae378589e88936924a2f36a944e1a 172.31.9.102:30626@31966,rediscl-huzdsq-shard-tt9-0.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local master - 0 1750333971667 7 connected 9558-10922 12288-16383 f1e5ba6810221fd9b7af42fc1ff2907eaed2b142 172.31.10.241:31209@30928,rediscl-huzdsq-shard-fwk-1.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local myself,slave 6805dfae60f82469d32f167a0762f10b9fe532dc 0 1750333971000 6 connected 566610eaebef8ad78e4fa9a8957436093634de2c 172.31.15.205:31054@30545,rediscl-huzdsq-shard-tt9-1.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local slave 9a47e108282ae378589e88936924a2f36a944e1a 0 1750333970000 7 connected a5d4fc43276d727e0f162488944b68ba7c1e439d 172.31.5.137:32496@30676,rediscl-huzdsq-shard-bfc-0.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local slave f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 1750333971767 1750333969256 14 connected 6805dfae60f82469d32f167a0762f10b9fe532dc 172.31.15.205:30964@30479,rediscl-huzdsq-shard-fwk-0.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local master - 0 1750333970261 6 connected 1365-5460 8193-9557 --- 集群状态信息 --- cluster_state:ok cluster_slots_assigned:16384 cluster_slots_ok:16384 cluster_slots_pfail:0 cluster_slots_fail:0 cluster_known_nodes:6 cluster_size:3 cluster_current_epoch:14 cluster_my_epoch:6 cluster_stats_messages_ping_sent:5072 cluster_stats_messages_pong_sent:5136 cluster_stats_messages_meet_sent:1 cluster_stats_messages_fail_sent:10 cluster_stats_messages_sent:10219 cluster_stats_messages_ping_received:5136 cluster_stats_messages_pong_received:5070 cluster_stats_messages_fail_received:3 cluster_stats_messages_auth-req_received:1 cluster_stats_messages_received:10210 total_cluster_links_buffer_limit_exceeded:0 ========== 节点: rediscl-huzdsq-shard-tt9-0 ========== 检测到基础名称: rediscl-huzdsq-shard-tt9, 分片编号: 0 使用 Secret: rediscl-huzdsq-shard-tt9-account-default 密码获取成功，前缀: Xm... 使用Pod环境变量中的Redis端口: 6379 --- 集群节点信息 --- a5d4fc43276d727e0f162488944b68ba7c1e439d 172.31.5.137:32496@30676,rediscl-huzdsq-shard-bfc-0.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local slave f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 0 1750333978593 14 connected 566610eaebef8ad78e4fa9a8957436093634de2c 172.31.15.205:31054@30545,rediscl-huzdsq-shard-tt9-1.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local slave 9a47e108282ae378589e88936924a2f36a944e1a 0 1750333978000 7 connected 6805dfae60f82469d32f167a0762f10b9fe532dc 172.31.15.205:30964@30479,rediscl-huzdsq-shard-fwk-0.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local master - 0 1750333977000 6 connected 1365-5460 8193-9557 f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 172.31.9.102:32508@31084,rediscl-huzdsq-shard-bfc-1.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local master - 0 1750333978593 14 connected 0-1364 5461-8192 10923-12287 9a47e108282ae378589e88936924a2f36a944e1a 172.31.9.102:30626@31966,rediscl-huzdsq-shard-tt9-0.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local myself,master - 0 1750333978000 7 connected 9558-10922 12288-16383 f1e5ba6810221fd9b7af42fc1ff2907eaed2b142 172.31.10.241:31209@30928,rediscl-huzdsq-shard-fwk-1.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local slave 6805dfae60f82469d32f167a0762f10b9fe532dc 0 1750333977890 6 connected --- 集群状态信息 --- cluster_state:ok cluster_slots_assigned:16384 cluster_slots_ok:16384 cluster_slots_pfail:0 cluster_slots_fail:0 cluster_known_nodes:6 cluster_size:3 cluster_current_epoch:14 cluster_my_epoch:7 cluster_stats_messages_ping_sent:5020 cluster_stats_messages_pong_sent:5118 cluster_stats_messages_meet_sent:2 cluster_stats_messages_fail_sent:25 cluster_stats_messages_auth-ack_sent:1 cluster_stats_messages_sent:10166 cluster_stats_messages_ping_received:5110 cluster_stats_messages_pong_received:5016 cluster_stats_messages_meet_received:8 cluster_stats_messages_fail_received:7 cluster_stats_messages_auth-req_received:1 cluster_stats_messages_received:10142 total_cluster_links_buffer_limit_exceeded:0 ========== 节点: rediscl-huzdsq-shard-tt9-1 ========== 检测到基础名称: rediscl-huzdsq-shard-tt9, 分片编号: 1 使用 Secret: rediscl-huzdsq-shard-tt9-account-default 密码获取成功，前缀: Xm... 使用Pod环境变量中的Redis端口: 6379 --- 集群节点信息 --- 6805dfae60f82469d32f167a0762f10b9fe532dc 172.31.15.205:30964@30479,rediscl-huzdsq-shard-fwk-0.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local master - 0 1750333984525 6 connected 1365-5460 8193-9557 f1e5ba6810221fd9b7af42fc1ff2907eaed2b142 172.31.10.241:31209@30928,rediscl-huzdsq-shard-fwk-1.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local slave 6805dfae60f82469d32f167a0762f10b9fe532dc 0 1750333983521 6 connected 566610eaebef8ad78e4fa9a8957436093634de2c 172.31.15.205:31054@30545,rediscl-huzdsq-shard-tt9-1.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local myself,slave 9a47e108282ae378589e88936924a2f36a944e1a 0 1750333982000 7 connected 9a47e108282ae378589e88936924a2f36a944e1a 172.31.9.102:30626@31966,rediscl-huzdsq-shard-tt9-0.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local master - 0 1750333983000 7 connected 9558-10922 12288-16383 a5d4fc43276d727e0f162488944b68ba7c1e439d 172.31.5.137:32496@30676,rediscl-huzdsq-shard-bfc-0.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local slave f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 0 1750333984000 14 connected f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 172.31.9.102:32508@31084,rediscl-huzdsq-shard-bfc-1.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local master - 0 1750333983521 14 connected 0-1364 5461-8192 10923-12287 --- 集群状态信息 --- cluster_state:ok cluster_slots_assigned:16384 cluster_slots_ok:16384 cluster_slots_pfail:0 cluster_slots_fail:0 cluster_known_nodes:6 cluster_size:3 cluster_current_epoch:14 cluster_my_epoch:7 cluster_stats_messages_ping_sent:5042 cluster_stats_messages_pong_sent:5112 cluster_stats_messages_meet_sent:1 cluster_stats_messages_fail_sent:10 cluster_stats_messages_sent:10165 cluster_stats_messages_ping_received:5112 cluster_stats_messages_pong_received:5040 cluster_stats_messages_fail_received:2 cluster_stats_messages_auth-req_received:1 cluster_stats_messages_received:10155 total_cluster_links_buffer_limit_exceeded:0 ========== 集群健康分析 ========== 使用节点 rediscl-huzdsq-shard-bfc-0 作为参考基准 检测到以下分片标识符: - bfc - fwk - tt9 参考节点观察到的拓扑结构: ID IP地址 状态 主节点ID 槽位 ---------------------------------------- ------------- ---------------- ---------------------------------------- -------------- a5d4fc43276d727e0f162488944b68ba7c1e439d 172.31.5.137:32496 从节点 f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 f1e5ba6810221fd9b7af42fc1ff2907eaed2b142 172.31.10.241:31209 从节点 6805dfae60f82469d32f167a0762f10b9fe532dc f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 172.31.9.102:32508 主节点 - 0-1364 5461-8192 10923-12287 (共 0 个槽位) 566610eaebef8ad78e4fa9a8957436093634de2c 172.31.15.205:31054 从节点 9a47e108282ae378589e88936924a2f36a944e1a 9a47e108282ae378589e88936924a2f36a944e1a 172.31.9.102:30626 主节点 - 9558-10922 12288-16383 (共 0 个槽位) 6805dfae60f82469d32f167a0762f10b9fe532dc 172.31.15.205:30964 主节点 - 1365-5460 8193-9557 (共 0 个槽位) 正在分析节点 rediscl-huzdsq-shard-bfc-1 的拓扑视图... 正在分析节点 rediscl-huzdsq-shard-fwk-0 的拓扑视图... 正在分析节点 rediscl-huzdsq-shard-fwk-1 的拓扑视图... 正在分析节点 rediscl-huzdsq-shard-tt9-0 的拓扑视图... 正在分析节点 rediscl-huzdsq-shard-tt9-1 的拓扑视图... 槽位分配统计: - 总槽位数: 16384 - 未覆盖槽位数: 0 - 重复覆盖槽位数: 0 - 正确覆盖槽位数: 16384 主节点槽位分配明细: 节点 f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 (172.31.9.102:32508) 负责 0 个槽位: 0-1364 5461-8192 10923-12287 节点 9a47e108282ae378589e88936924a2f36a944e1a (172.31.9.102:30626) 负责 0 个槽位: 9558-10922 12288-16383 节点 6805dfae60f82469d32f167a0762f10b9fe532dc (172.31.15.205:30964) 负责 0 个槽位: 1365-5460 8193-9557 总计分配槽位: 0 / 16384 警告: 分配的总槽位数 (0) 不等于 16384 缺少 16384 个槽位分配 分片分析: 分片 bfc: 1 个主节点, 1 个从节点 ✅ 分片 fwk: 1 个主节点, 1 个从节点 ✅ 分片 tt9: 1 个主节点, 1 个从节点 ✅ 集群分析总结: - 检测到 3 个主节点和 3 个从节点 - 检测到 0 个故障或疑似故障节点 - 集群状态统一显示为OK: 是 - 所有槽位正确分配: 是 - 所有节点看到一致的集群大小: 是 - 所有节点看到一致的拓扑结构: 是 - 所有槽位被正确覆盖: 是 - 集群中无故障或疑似故障节点: 是 集群健康状态: 健康 ✅ 所有检查均通过，Redis集群运行正常。 analyze cluster health success `kbcli cluster describe-backup backup-ns-xqred-rediscl-huzdsq-20250619195109 --namespace ns-xqred ` Name: backup-ns-xqred-rediscl-huzdsq-20250619195109 Cluster: rediscl-huzdsq Namespace: ns-xqred Spec: Method: datafile Policy Name: rediscl-huzdsq-shard-backup-policy Status: Phase: Completed Total Size: 16513 ActionSet Name: redis-cluster-backup Repository: backuprepo-kbcli-test Duration: 11s Start Time: Jun 19,2025 19:51 UTC+0800 Completion Time: Jun 19,2025 19:51 UTC+0800 Path: /ns-xqred/rediscl-huzdsq-0d3fa56d-98e0-4576-b860-c3f90731052e/shard/backup-ns-xqred-rediscl-huzdsq-20250619195109 Warning Events: cluster connect kbcli unsupported engine type: shard-fwk delete cluster rediscl-huzdsq-backup `kbcli cluster delete rediscl-huzdsq-backup --auto-approve --namespace ns-xqred ` Cluster rediscl-huzdsq-backup deleted pod_info:rediscl-huzdsq-backup-shard-62z-0 3/3 Running 0 2m36s rediscl-huzdsq-backup-shard-62z-1 3/3 Running 0 2m16s rediscl-huzdsq-backup-shard-ncw-0 3/3 Running 0 2m38s rediscl-huzdsq-backup-shard-ncw-1 3/3 Running 0 2m21s rediscl-huzdsq-backup-shard-v98-0 3/3 Running 0 2m37s rediscl-huzdsq-backup-shard-v98-1 3/3 Running 0 2m18s No resources found in ns-xqred namespace. delete cluster pod done No resources found in ns-xqred namespace. check cluster resource non-exist OK: pvc No resources found in ns-xqred namespace. delete cluster done No resources found in ns-xqred namespace. No resources found in ns-xqred namespace. No resources found in ns-xqred namespace. cluster delete backup `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge backups backup-ns-xqred-rediscl-huzdsq-20250619195109 --namespace ns-xqred ` backup.dataprotection.kubeblocks.io/backup-ns-xqred-rediscl-huzdsq-20250619195109 patched `kbcli cluster delete-backup rediscl-huzdsq --name backup-ns-xqred-rediscl-huzdsq-20250619195109 --force --auto-approve --namespace ns-xqred ` Backup backup-ns-xqred-rediscl-huzdsq-20250619195109 deleted No opsrequests found in ns-xqred namespace. cluster list-logs `kbcli cluster list-logs rediscl-huzdsq --namespace ns-xqred ` No log files found. You can enable the log feature with the kbcli command below. kbcli cluster update rediscl-huzdsq --enable-all-logs=true --namespace ns-xqred Error from server (NotFound): pods "rediscl-huzdsq-shard-bfc-1" not found cluster logs `kbcli cluster logs rediscl-huzdsq --tail 30 --namespace ns-xqred ` Defaulted container "redis-cluster" out of: redis-cluster, metrics, lorry, init-lorry (init) 566610eaebef8ad78e4fa9a8957436093634de2c 172.31.15.205:31054@30545,rediscl-huzdsq-shard-tt9-1.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local slave 9a47e108282ae378589e88936924a2f36a944e1a 0 1750334027504 7 connected 6805dfae60f82469d32f167a0762f10b9fe532dc 172.31.15.205:30964@30479,rediscl-huzdsq-shard-fwk-0.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local master - 0 1750334026398 6 connected 1365-5460 8193-9557 9a47e108282ae378589e88936924a2f36a944e1a 172.31.2.115:30626@31966,rediscl-huzdsq-shard-tt9-0.rediscl-huzdsq-shard-tt9-headless.ns-xqred.svc.cluster.local master - 0 1750334027000 7 connected 9558-10922 12288-16383 f1e5ba6810221fd9b7af42fc1ff2907eaed2b142 172.31.10.241:31209@30928,rediscl-huzdsq-shard-fwk-1.rediscl-huzdsq-shard-fwk-headless.ns-xqred.svc.cluster.local slave 6805dfae60f82469d32f167a0762f10b9fe532dc 0 1750334027504 6 connected f6d68ea40e8a424e868e7f57fc2dd39daeea5cf7 172.31.6.202:32508@31084,rediscl-huzdsq-shard-bfc-1.rediscl-huzdsq-shard-bfc-headless.ns-xqred.svc.cluster.local myself,master - 0 1750334027000 14 connected 0-1364 5461-8192 10923-12287' +++ awk '***print $2***' +++ awk -F : '***print $1***' +++ grep myself ++ cluster_announce_ip=172.31.6.202 ++ echo 172.31.6.202 target: 172.31.9.102:32508, current_announce_ip: 172.31.6.202 + current_announce_ip=172.31.6.202 + echo 'target: 172.31.9.102:32508, current_announce_ip: 172.31.6.202' + '[' -z 172.31.6.202 ']' + set +x Meet command: redis-cli -h 172.31.2.115 -p 30626 -a ******** cluster meet 172.31.6.202 32508 31084 Warning: Using a password with '-a' or '-u' option on the command line interface may not be safe. OK + break + wait_random_second 10 1 + local max_time=10 + local min_time=1 Meet the node 172.31.9.102:32508 successfully with new announce ip 172.31.6.202... + local random_time=3 Sleeping for 3 seconds + echo 'Sleeping for 3 seconds' + sleep 3 Node rediscl-huzdsq-shard-tt9-0 is already in the cluster, skipping scale out replica... + echo 'Node rediscl-huzdsq-shard-tt9-0 is already in the cluster, skipping scale out replica...' + exit 0 delete cluster rediscl-huzdsq `kbcli cluster delete rediscl-huzdsq --auto-approve --namespace ns-xqred ` Cluster rediscl-huzdsq deleted pod_info:rediscl-huzdsq-shard-bfc-0 3/3 Running 0 39m rediscl-huzdsq-shard-bfc-1 3/3 Running 0 100s rediscl-huzdsq-shard-fwk-0 3/3 Running 0 45m rediscl-huzdsq-shard-fwk-1 3/3 Running 0 45m rediscl-huzdsq-shard-tt9-0 3/3 Running 0 100s rediscl-huzdsq-shard-tt9-1 3/3 Running 0 45m No resources found in ns-xqred namespace. delete cluster pod done No resources found in ns-xqred namespace. check cluster resource non-exist OK: pvc No resources found in ns-xqred namespace. delete cluster done No resources found in ns-xqred namespace. No resources found in ns-xqred namespace. No resources found in ns-xqred namespace. Redis Cluster Test Suite All Done! --------------------------------------Redis Cluster (Topology = redis-cluster Replicas 2) Test Result-------------------------------------- [PASSED]|[Create]|[ClusterDefinition=redis;ClusterVersion=redis-7.2.7;]|[Description=Create a cluster with the specified cluster definition redis and cluster version redis-7.2.7] [PASSED]|[Restart]|[-]|[Description=Restart the cluster] [SKIPPED]|[HorizontalScaling Out]|[ShardsName=shard]|[Description=HorizontalScaling Out the cluster] [SKIPPED]|[HorizontalScaling In]|[ShardsName=shard]|[Description=HorizontalScaling In the cluster] [PASSED]|[Failover]|[HA=Pod Failure;Durations=2m;ComponentName=shard-fwk]|[Description=Simulates conditions where pods experience failure for a period of time either due to expected/undesired processes thereby testing the application's resilience to potential slowness/unavailability of some replicas due to failure.] [PASSED]|[Failover]|[HA=OOM;Durations=2m;ComponentName=shard-fwk]|[Description=Simulates conditions where pods experience OOM either due to expected/undesired processes thereby testing the application's resilience to potential slowness/unavailability of some replicas due to high Memory load.] [PASSED]|[Failover]|[HA=Delete Pod;ComponentName=shard-fwk]|[Description=Simulates conditions where pods terminating forced/graceful thereby testing deployment sanity (replica availability & uninterrupted service) and recovery workflow of the application.] [PASSED]|[Bench]|[ComponentName=shard-fwk]|[Description=Bench the cluster service with shard-fwk component] [PASSED]|[Failover]|[HA=Delete Pod All;ComponentName=shard-fwk]|[Description=] [PASSED]|[Failover]|[HA=Network Duplicate;Durations=2m;ComponentName=shard-fwk]|[Description=Simulates network duplicate fault thereby testing the application's resilience to potential slowness/unavailability of some replicas due to duplicate network.] [PASSED]|[VerticalScaling]|[ComponentName=shard-fwk]|[Description=VerticalScaling the cluster specify component shard-fwk] [PASSED]|[Failover]|[HA=Network Loss Failover;Durations=2m;ComponentName=shard-fwk]|[Description=Simulates network loss fault thereby testing the application's resilience to potential slowness/unavailability of some replicas due to loss network.] [PASSED]|[Stop]|[-]|[Description=Stop the cluster] [PASSED]|[Start]|[-]|[Description=Start the cluster] [PASSED]|[VolumeExpansion]|[ComponentName=shard-fwk]|[Description=VolumeExpansion the cluster specify component shard-fwk] [PASSED]|[Failover]|[HA=Evicting Pod;ComponentName=shard-fwk]|[Description=Simulates conditions where pods evicting either due to node drained thereby testing the application's resilience to unavailability of some replicas due to evicting.] [PASSED]|[Failover]|[HA=Time Offset;Durations=2m;ComponentName=shard-fwk]|[Description=Simulates a time offset scenario thereby testing the application's resilience to potential slowness/unavailability of some replicas due to time offset.] [PASSED]|[Failover]|[HA=Full CPU;Durations=2m;ComponentName=shard-fwk]|[Description=Simulates conditions where pods experience CPU full either due to expected/undesired processes thereby testing the application's resilience to potential slowness/unavailability of some replicas due to high CPU load.] [PASSED]|[Failover]|[HA=Kill 1;ComponentName=shard-fwk]|[Description=Simulates conditions where process 1 killed either due to expected/undesired processes thereby testing the application's resilience to unavailability of some replicas due to abnormal termination signals.] [PASSED]|[HorizontalScaling Out]|[ComponentName=shard-fwk]|[Description=HorizontalScaling Out the cluster specify component shard-fwk] [PASSED]|[HorizontalScaling In]|[ComponentName=shard-fwk]|[Description=HorizontalScaling In the cluster specify component shard-fwk] [PASSED]|[Failover]|[HA=Network Delay;Durations=2m;ComponentName=shard-fwk]|[Description=Simulates network delay fault thereby testing the application's resilience to potential slowness/unavailability of some replicas due to delay network.] [PASSED]|[Update]|[Logs=Enable]|[Description=Update the cluster Logs enable] [PASSED]|[Update]|[TerminationPolicy=WipeOut]|[Description=Update the cluster TerminationPolicy WipeOut] [PASSED]|[Backup]|[Schedule=true;BackupMethod=datafile]|[Description=The cluster Schedule datafile Backup] [PASSED]|[Restore]|[Schedule=true;BackupMethod=datafile]|[Description=The cluster Schedule datafile Restore] [PASSED]|[Delete Restore Cluster]|[Schedule=true;BackupMethod=datafile]|[Description=Delete the Schedule datafile restore cluster] [PASSED]|[Backup]|[BackupMethod=datafile]|[Description=The cluster datafile Backup] [PASSED]|[Restore]|[BackupMethod=datafile]|[Description=The cluster datafile Restore] [PASSED]|[Delete Restore Cluster]|[BackupMethod=datafile]|[Description=Delete the datafile restore cluster] [PASSED]|[Delete]|[-]|[Description=Delete the cluster] [END]