source commons files source engines files source kubeblocks files `kubectl get namespace | grep ns-imzlz ` `kubectl create namespace ns-imzlz` namespace/ns-imzlz created create namespace ns-imzlz done download kbcli `gh release list --repo apecloud/kbcli --limit 100 | (grep "0.9" || true)` `curl -fsSL https://kubeblocks.io/installer/install_cli.sh | bash -s v0.9.4-beta.1` Your system is linux_amd64 Installing kbcli ... Downloading ... % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 32.1M 100 32.1M 0 0 123M 0 --:--:-- --:--:-- --:--:-- 123M kbcli installed successfully. Kubernetes: v1.32.5-eks-5d4a308 KubeBlocks: 0.9.4 kbcli: 0.9.4-beta.1 WARNING: version difference between kbcli (0.9.4-beta.1) and kubeblocks (0.9.4) Make sure your docker service is running and begin your journey with kbcli: kbcli playground init For more information on how to get started, please visit: https://kubeblocks.io download kbcli v0.9.4-beta.1 done Kubernetes: v1.32.5-eks-5d4a308 KubeBlocks: 0.9.4 kbcli: 0.9.4-beta.1 WARNING: version difference between kbcli (0.9.4-beta.1) and kubeblocks (0.9.4) Kubernetes Env: v1.32.5-eks-5d4a308 POD_RESOURCES: No resources found found default storage class: gp3 kubeblocks version is:0.9.4 skip upgrade kubeblocks Error: no repositories to show helm repo add chaos-mesh https://charts.chaos-mesh.org "chaos-mesh" has been added to your repositories add helm chart repo chaos-mesh success chaos mesh already installed check cluster definition set component name:rocketmq-namesrv set component version set component version:rocketmq-broker set service versions:4.9.6 set service versions sorted:4.9.6 no cluster version found set rocketmq component definition set rocketmq component definition rocketmq-exporter set replicas first:2,4.9.6 set replicas third:2,4.9.6 set replicas fourth:2,4.9.6 set minimum cmpv service version set minimum cmpv service version replicas:2,4.9.6 REPORT_COUNT:1 CLUSTER_TOPOLOGY: set cluster topology: master-slave LIMIT_CPU:0.1 LIMIT_MEMORY:0.5 storage size: 1 No resources found in ns-imzlz namespace. termination_policy:WipeOut create 2 replica WipeOut rocketmq cluster check cluster definition check component definition set component definition by component version check cmpd by labels set component definition1: rocketmq-broker-4 by component version:rocketmq-broker apiVersion: apps.kubeblocks.io/v1alpha1 kind: Cluster metadata: name: rocketmq-camunf namespace: ns-imzlz annotations: "kubeblocks.io/extra-env": "***\"ENABLE_ACL\":\"false\"***" spec: terminationPolicy: WipeOut componentSpecs: - name: namesrv componentDef: rocketmq-namesrv-4 serviceVersion: 4.9.6 replicas: 1 resources: requests: cpu: 100m memory: 0.5Gi limits: cpu: 100m memory: 0.5Gi - name: exporter componentDef: rocketmq-exporter serviceVersion: 0.0.2 replicas: 1 monitor: true env: - name: ROCKETMQ_VERSION value: 4.9.6 resources: requests: cpu: 100m memory: 0.5Gi limits: cpu: 100m memory: 0.5Gi - name: dashboard componentDef: rocketmq-dashboard serviceVersion: 2.0.0 replicas: 1 resources: requests: cpu: 100m memory: 0.5Gi limits: cpu: 100m memory: 0.5Gi shardingSpecs: - name: broker shards: 1 template: name: rocketmq-broker componentDef: rocketmq-broker-4 serviceVersion: 4.9.6 replicas: 2 systemAccounts: - name: rocketmq-admin passwordConfig: length: 8 numDigits: 6 letterCase: MixedCases seed: rocketmq-camunf resources: requests: cpu: 100m memory: 0.5Gi limits: cpu: 100m memory: 0.5Gi volumeClaimTemplates: - name: data spec: storageClassName: accessModes: - ReadWriteOnce resources: requests: storage: 1Gi `kubectl apply -f test_create_rocketmq-camunf.yaml` cluster.apps.kubeblocks.io/rocketmq-camunf created apply test_create_rocketmq-camunf.yaml Success `rm -rf test_create_rocketmq-camunf.yaml` check cluster status `kbcli cluster list rocketmq-camunf --show-labels --namespace ns-imzlz ` NAME NAMESPACE CLUSTER-DEFINITION VERSION TERMINATION-POLICY STATUS CREATED-TIME LABELS rocketmq-camunf ns-imzlz WipeOut Jun 19,2025 18:15 UTC+0800 cluster_status: cluster_status:Creating cluster_status:Updating cluster_status:Updating cluster_status:Updating check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances rocketmq-camunf --namespace ns-imzlz ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME rocketmq-camunf-broker-gds-0 ns-imzlz rocketmq-camunf broker-gds Running master us-west-2a 100m / 100m 512Mi / 512Mi ip-172-31-9-241.us-west-2.compute.internal/172.31.9.241 Jun 19,2025 18:15 UTC+0800 rocketmq-camunf-broker-gds-1 ns-imzlz rocketmq-camunf broker-gds Running slave us-west-2a 100m / 100m 512Mi / 512Mi ip-172-31-10-126.us-west-2.compute.internal/172.31.10.126 Jun 19,2025 18:15 UTC+0800 rocketmq-camunf-dashboard-0 ns-imzlz rocketmq-camunf dashboard Running us-west-2a 100m / 100m 512Mi / 512Mi ip-172-31-7-169.us-west-2.compute.internal/172.31.7.169 Jun 19,2025 18:15 UTC+0800 rocketmq-camunf-exporter-0 ns-imzlz rocketmq-camunf exporter Running us-west-2a 100m / 100m 512Mi / 512Mi ip-172-31-12-213.us-west-2.compute.internal/172.31.12.213 Jun 19,2025 18:15 UTC+0800 rocketmq-camunf-namesrv-0 ns-imzlz rocketmq-camunf namesrv Running us-west-2a 100m / 100m 512Mi / 512Mi ip-172-31-15-192.us-west-2.compute.internal/172.31.15.192 Jun 19,2025 18:15 UTC+0800 check pod status done check cluster role check cluster role done master: rocketmq-camunf-broker-gds-0;slave: rocketmq-camunf-broker-gds-1 connect unsupported engine type: rocketmq rocketmq-broker-4 get rocketmq-namesrv master pod name... get rocketmq-namesrv master pod name... get rocketmq-namesrv master pod name... get rocketmq-namesrv master pod name... get rocketmq-namesrv master pod name... get rocketmq-namesrv master pod name... get rocketmq-namesrv master pod name... get rocketmq-namesrv master pod name... get rocketmq-namesrv master pod name... get rocketmq-namesrv master pod name... get rocketmq-namesrv master pod name... get rocketmq-namesrv master pod name... get rocketmq-namesrv master pod name... get rocketmq-namesrv master pod name... get rocketmq-namesrv master pod name... get rocketmq-namesrv master pod name... get rocketmq-namesrv master pod name... get rocketmq-namesrv master pod name... get rocketmq-namesrv master pod name... get rocketmq-namesrv master pod name... get rocketmq-namesrv master pod name... get rocketmq-namesrv master pod name... get rocketmq-namesrv master pod name... get rocketmq-namesrv master pod name... get rocketmq-namesrv master pod name... get rocketmq-namesrv master pod name... get rocketmq-namesrv master pod name... get rocketmq-namesrv master pod name... get rocketmq-namesrv master pod name... get rocketmq-namesrv master pod name... get pod name timeout `kubectl get secrets -l app.kubernetes.io/instance=rocketmq-camunf` `kubectl get secrets rocketmq-camunf-broker-gds-account-rocketmq-admin -o jsonpath="***.data.username***"` `kubectl get secrets rocketmq-camunf-broker-gds-account-rocketmq-admin -o jsonpath="***.data.password***"` `kubectl get secrets rocketmq-camunf-broker-gds-account-rocketmq-admin -o jsonpath="***.data.port***"` DB_USERNAME:rocketmq-admin;DB_PASSWORD:715g1S92;DB_PORT:;DB_DATABASE: There are no pods gotten. describe cluster `kbcli cluster describe rocketmq-camunf --namespace ns-imzlz ` Name: rocketmq-camunf Created Time: Jun 19,2025 18:15 UTC+0800 NAMESPACE CLUSTER-DEFINITION VERSION STATUS TERMINATION-POLICY ns-imzlz Running WipeOut Endpoints: COMPONENT MODE INTERNAL EXTERNAL namesrv ReadWrite rocketmq-camunf-namesrv.ns-imzlz.svc.cluster.local:9876 dashboard ReadWrite rocketmq-camunf-dashboard.ns-imzlz.svc.cluster.local:8080 Topology: COMPONENT INSTANCE ROLE STATUS AZ NODE CREATED-TIME broker-gds rocketmq-camunf-broker-gds-0 master Running us-west-2a ip-172-31-9-241.us-west-2.compute.internal/172.31.9.241 Jun 19,2025 18:15 UTC+0800 broker-gds rocketmq-camunf-broker-gds-1 slave Running us-west-2a ip-172-31-10-126.us-west-2.compute.internal/172.31.10.126 Jun 19,2025 18:15 UTC+0800 dashboard rocketmq-camunf-dashboard-0 Running us-west-2a ip-172-31-7-169.us-west-2.compute.internal/172.31.7.169 Jun 19,2025 18:15 UTC+0800 exporter rocketmq-camunf-exporter-0 Running us-west-2a ip-172-31-12-213.us-west-2.compute.internal/172.31.12.213 Jun 19,2025 18:15 UTC+0800 namesrv rocketmq-camunf-namesrv-0 Running us-west-2a ip-172-31-15-192.us-west-2.compute.internal/172.31.15.192 Jun 19,2025 18:15 UTC+0800 Resources Allocation: COMPONENT DEDICATED CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE-SIZE STORAGE-CLASS namesrv false 100m / 100m 512Mi / 512Mi exporter false 100m / 100m 512Mi / 512Mi dashboard false 100m / 100m 512Mi / 512Mi Images: COMPONENT TYPE IMAGE namesrv docker.io/apecloud/rocketmq:4.9.6 exporter docker.io/apecloud/rocketmq-exporter:0.0.2 dashboard docker.io/apecloud/rocketmq-dashboard:2.0.0 Show cluster events: kbcli cluster list-events -n ns-imzlz rocketmq-camunf get shard component name set shard component name:broker-gds `kbcli cluster label rocketmq-camunf app.kubernetes.io/instance- --namespace ns-imzlz ` label "app.kubernetes.io/instance" not found. `kbcli cluster label rocketmq-camunf app.kubernetes.io/instance=rocketmq-camunf --namespace ns-imzlz ` `kbcli cluster label rocketmq-camunf --list --namespace ns-imzlz ` NAME NAMESPACE LABELS rocketmq-camunf ns-imzlz app.kubernetes.io/instance=rocketmq-camunf label cluster app.kubernetes.io/instance=rocketmq-camunf Success `kbcli cluster label case.name=kbcli.test1 -l app.kubernetes.io/instance=rocketmq-camunf --namespace ns-imzlz ` `kbcli cluster label rocketmq-camunf --list --namespace ns-imzlz ` NAME NAMESPACE LABELS rocketmq-camunf ns-imzlz app.kubernetes.io/instance=rocketmq-camunf case.name=kbcli.test1 label cluster case.name=kbcli.test1 Success `kbcli cluster label rocketmq-camunf case.name=kbcli.test2 --overwrite --namespace ns-imzlz ` `kbcli cluster label rocketmq-camunf --list --namespace ns-imzlz ` NAME NAMESPACE LABELS rocketmq-camunf ns-imzlz app.kubernetes.io/instance=rocketmq-camunf case.name=kbcli.test2 label cluster case.name=kbcli.test2 Success `kbcli cluster label rocketmq-camunf case.name- --namespace ns-imzlz ` `kbcli cluster label rocketmq-camunf --list --namespace ns-imzlz ` NAME NAMESPACE LABELS rocketmq-camunf ns-imzlz app.kubernetes.io/instance=rocketmq-camunf delete cluster label case.name Success cluster connect kbcli unsupported engine type: broker-gds patch rocketmq-camunf shards 2 `kubectl patch cluster rocketmq-camunf --namespace ns-imzlz --type json -p '[***"op": "replace", "path": "/spec/shardingSpecs/0/shards", "value": '2'***]'` cluster.apps.kubeblocks.io/rocketmq-camunf patched check cluster status `kbcli cluster list rocketmq-camunf --show-labels --namespace ns-imzlz ` NAME NAMESPACE CLUSTER-DEFINITION VERSION TERMINATION-POLICY STATUS CREATED-TIME LABELS rocketmq-camunf ns-imzlz WipeOut Running Jun 19,2025 18:15 UTC+0800 app.kubernetes.io/instance=rocketmq-camunf check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances rocketmq-camunf --namespace ns-imzlz ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME rocketmq-camunf-broker-gds-0 ns-imzlz rocketmq-camunf broker-gds Running master us-west-2a 100m / 100m 512Mi / 512Mi ip-172-31-9-241.us-west-2.compute.internal/172.31.9.241 Jun 19,2025 18:15 UTC+0800 rocketmq-camunf-broker-gds-1 ns-imzlz rocketmq-camunf broker-gds Running slave us-west-2a 100m / 100m 512Mi / 512Mi ip-172-31-10-126.us-west-2.compute.internal/172.31.10.126 Jun 19,2025 18:15 UTC+0800 rocketmq-camunf-broker-qgt-0 ns-imzlz rocketmq-camunf broker-qgt Pending 100m / 100m 512Mi / 512Mi Jun 19,2025 18:19 UTC+0800 rocketmq-camunf-broker-qgt-1 ns-imzlz rocketmq-camunf broker-qgt Pending 100m / 100m 512Mi / 512Mi Jun 19,2025 18:19 UTC+0800 rocketmq-camunf-dashboard-0 ns-imzlz rocketmq-camunf dashboard Terminating us-west-2a 100m / 100m 512Mi / 512Mi ip-172-31-7-169.us-west-2.compute.internal/172.31.7.169 Jun 19,2025 18:15 UTC+0800 rocketmq-camunf-exporter-0 ns-imzlz rocketmq-camunf exporter Terminating us-west-2a 100m / 100m 512Mi / 512Mi ip-172-31-12-213.us-west-2.compute.internal/172.31.12.213 Jun 19,2025 18:15 UTC+0800 rocketmq-camunf-namesrv-0 ns-imzlz rocketmq-camunf namesrv Running us-west-2a 100m / 100m 512Mi / 512Mi ip-172-31-15-192.us-west-2.compute.internal/172.31.15.192 Jun 19,2025 18:15 UTC+0800 pod_status:Init:0/2 Init:0/2 Terminating Terminating pod_status:Init:0/2 Terminating Terminating pod_status:PodInitializing Terminating Terminating pod_status:PodInitializing Terminating Terminating pod_status:PodInitializing Terminating Terminating pod_status:PodInitializing Terminating Terminating pod_status:ContainerCreating ContainerCreating pod_status:ContainerCreating check pod status done check cluster role check cluster role done master: rocketmq-camunf-broker-gds-0 rocketmq-camunf-broker-qgt-0;slave: rocketmq-camunf-broker-gds-1 rocketmq-camunf-broker-qgt-1 connect unsupported engine type: rocketmq rocketmq-broker-4 patch rocketmq-camunf shards 1 `kubectl patch cluster rocketmq-camunf --namespace ns-imzlz --type json -p '[***"op": "replace", "path": "/spec/shardingSpecs/0/shards", "value": '1'***]'` cluster.apps.kubeblocks.io/rocketmq-camunf patched check cluster status `kbcli cluster list rocketmq-camunf --show-labels --namespace ns-imzlz ` NAME NAMESPACE CLUSTER-DEFINITION VERSION TERMINATION-POLICY STATUS CREATED-TIME LABELS rocketmq-camunf ns-imzlz WipeOut Updating Jun 19,2025 18:15 UTC+0800 app.kubernetes.io/instance=rocketmq-camunf cluster_status:Updating check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances rocketmq-camunf --namespace ns-imzlz ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME rocketmq-camunf-broker-gds-0 ns-imzlz rocketmq-camunf broker-gds Running master us-west-2a 100m / 100m 512Mi / 512Mi ip-172-31-9-241.us-west-2.compute.internal/172.31.9.241 Jun 19,2025 18:15 UTC+0800 rocketmq-camunf-broker-gds-1 ns-imzlz rocketmq-camunf broker-gds Running slave us-west-2a 100m / 100m 512Mi / 512Mi ip-172-31-10-126.us-west-2.compute.internal/172.31.10.126 Jun 19,2025 18:15 UTC+0800 rocketmq-camunf-broker-qgt-0 ns-imzlz rocketmq-camunf broker-qgt Terminating master us-west-2a 100m / 100m 512Mi / 512Mi ip-172-31-12-213.us-west-2.compute.internal/172.31.12.213 Jun 19,2025 18:19 UTC+0800 rocketmq-camunf-broker-qgt-1 ns-imzlz rocketmq-camunf broker-qgt Terminating slave us-west-2a 100m / 100m 512Mi / 512Mi ip-172-31-10-126.us-west-2.compute.internal/172.31.10.126 Jun 19,2025 18:19 UTC+0800 rocketmq-camunf-dashboard-0 ns-imzlz rocketmq-camunf dashboard Running us-west-2a 100m / 100m 512Mi / 512Mi ip-172-31-5-137.us-west-2.compute.internal/172.31.5.137 Jun 19,2025 18:20 UTC+0800 rocketmq-camunf-exporter-0 ns-imzlz rocketmq-camunf exporter Running us-west-2a 100m / 100m 512Mi / 512Mi ip-172-31-5-67.us-west-2.compute.internal/172.31.5.67 Jun 19,2025 18:20 UTC+0800 rocketmq-camunf-namesrv-0 ns-imzlz rocketmq-camunf namesrv Running us-west-2a 100m / 100m 512Mi / 512Mi ip-172-31-15-192.us-west-2.compute.internal/172.31.15.192 Jun 19,2025 18:15 UTC+0800 pod_status:Terminating Terminating pod_status:Terminating Terminating pod_status:Terminating Terminating pod_status:Terminating Terminating check pod status done check cluster role check cluster role done master: rocketmq-camunf-broker-gds-0;slave: rocketmq-camunf-broker-gds-1 connect unsupported engine type: rocketmq rocketmq-broker-4 get shard component name set shard component name:broker-gds cluster restart check cluster status before ops check cluster status done cluster_status:Running `kbcli cluster restart rocketmq-camunf --auto-approve --force=true --namespace ns-imzlz ` OpsRequest rocketmq-camunf-restart-8b585 created successfully, you can view the progress: kbcli cluster describe-ops rocketmq-camunf-restart-8b585 -n ns-imzlz check ops status `kbcli cluster list-ops rocketmq-camunf --status all --namespace ns-imzlz ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME rocketmq-camunf-restart-8b585 ns-imzlz Restart rocketmq-camunf namesrv,exporter,dashboard,broker Running 0/5 Jun 19,2025 18:21 UTC+0800 check cluster status `kbcli cluster list rocketmq-camunf --show-labels --namespace ns-imzlz ` NAME NAMESPACE CLUSTER-DEFINITION VERSION TERMINATION-POLICY STATUS CREATED-TIME LABELS rocketmq-camunf ns-imzlz WipeOut Updating Jun 19,2025 18:15 UTC+0800 app.kubernetes.io/instance=rocketmq-camunf cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Abnormal cluster_status:Abnormal cluster_status:Abnormal cluster_status:Abnormal cluster_status:Abnormal cluster_status:Abnormal cluster_status:Abnormal cluster_status:Abnormal cluster_status:Abnormal cluster_status:Abnormal cluster_status:Abnormal cluster_status:Abnormal cluster_status:Abnormal cluster_status:Abnormal [Error] check cluster status timeout --------------------------------------get cluster rocketmq-camunf yaml-------------------------------------- `kubectl get cluster rocketmq-camunf -o yaml --namespace ns-imzlz ` apiVersion: apps.kubeblocks.io/v1alpha1 kind: Cluster metadata: annotations: kubeblocks.io/extra-env: '***"ENABLE_ACL":"false"***' kubeblocks.io/reconcile: "2025-06-19T10:29:55.049611085Z" kubectl.kubernetes.io/last-applied-configuration: | ***"apiVersion":"apps.kubeblocks.io/v1alpha1","kind":"Cluster","metadata":***"annotations":***"kubeblocks.io/extra-env":"***\"ENABLE_ACL\":\"false\"***"***,"name":"rocketmq-camunf","namespace":"ns-imzlz"***,"spec":***"componentSpecs":[***"componentDef":"rocketmq-namesrv-4","name":"namesrv","replicas":1,"resources":***"limits":***"cpu":"100m","memory":"0.5Gi"***,"requests":***"cpu":"100m","memory":"0.5Gi"***,"serviceVersion":"4.9.6"***,***"componentDef":"rocketmq-exporter","env":[***"name":"ROCKETMQ_VERSION","value":"4.9.6"***],"monitor":true,"name":"exporter","replicas":1,"resources":***"limits":***"cpu":"100m","memory":"0.5Gi"***,"requests":***"cpu":"100m","memory":"0.5Gi"***,"serviceVersion":"0.0.2"***,***"componentDef":"rocketmq-dashboard","name":"dashboard","replicas":1,"resources":***"limits":***"cpu":"100m","memory":"0.5Gi"***,"requests":***"cpu":"100m","memory":"0.5Gi"***,"serviceVersion":"2.0.0"***],"shardingSpecs":[***"name":"broker","shards":1,"template":***"componentDef":"rocketmq-broker-4","name":"rocketmq-broker","replicas":2,"resources":***"limits":***"cpu":"100m","memory":"0.5Gi"***,"requests":***"cpu":"100m","memory":"0.5Gi"***,"serviceVersion":"4.9.6","systemAccounts":[***"name":"rocketmq-admin","passwordConfig":***"length":8,"letterCase":"MixedCases","numDigits":6,"seed":"rocketmq-camunf"***],"volumeClaimTemplates":[***"name":"data","spec":***"accessModes":["ReadWriteOnce"],"resources":***"requests":***"storage":"1Gi"***,"storageClassName":null***]***],"terminationPolicy":"WipeOut"*** creationTimestamp: "2025-06-19T10:15:27Z" finalizers: - cluster.kubeblocks.io/finalizer generation: 5 labels: app.kubernetes.io/instance: rocketmq-camunf name: rocketmq-camunf namespace: ns-imzlz resourceVersion: "34151" uid: 1192d276-3a28-4e74-bd83-1dd87a100637 spec: componentSpecs: - componentDef: rocketmq-namesrv-4 name: namesrv replicas: 1 resources: limits: cpu: 100m memory: 512Mi requests: cpu: 100m memory: 512Mi serviceVersion: 4.9.6 - componentDef: rocketmq-exporter env: - name: ROCKETMQ_VERSION value: 4.9.6 monitor: true name: exporter replicas: 1 resources: limits: cpu: 100m memory: 512Mi requests: cpu: 100m memory: 512Mi serviceVersion: 0.0.2 - componentDef: rocketmq-dashboard name: dashboard replicas: 1 resources: limits: cpu: 100m memory: 512Mi requests: cpu: 100m memory: 512Mi serviceVersion: 2.0.0 resources: cpu: "0" memory: "0" shardingSpecs: - name: broker shards: 1 template: componentDef: rocketmq-broker-4 name: rocketmq-broker replicas: 2 resources: limits: cpu: 100m memory: 512Mi requests: cpu: 100m memory: 512Mi serviceVersion: 4.9.6 systemAccounts: - name: rocketmq-admin passwordConfig: length: 8 letterCase: MixedCases numDigits: 6 numSymbols: 0 seed: rocketmq-camunf secretRef: name: rocketmq-camunf-broker-rocketmq-admin namespace: ns-imzlz volumeClaimTemplates: - name: data spec: accessModes: - ReadWriteOnce resources: requests: storage: 1Gi storage: size: "0" terminationPolicy: WipeOut status: components: dashboard: phase: Running podsReady: true podsReadyTime: "2025-06-19T10:22:25Z" exporter: message: InstanceSet/rocketmq-camunf-exporter: '["rocketmq-camunf-exporter-0"]' phase: Running podsReady: true podsReadyTime: "2025-06-19T10:28:22Z" namesrv: message: InstanceSet/rocketmq-camunf-namesrv: '["rocketmq-camunf-namesrv-0"]' phase: Failed podsReady: false podsReadyTime: "2025-06-19T10:16:27Z" conditions: - lastTransitionTime: "2025-06-19T10:15:28Z" message: 'The operator has started the provisioning of Cluster: rocketmq-camunf' observedGeneration: 5 reason: PreCheckSucceed status: "True" type: ProvisioningStarted - lastTransitionTime: "2025-06-19T10:15:28Z" message: Successfully applied for resources observedGeneration: 5 reason: ApplyResourcesSucceed status: "True" type: ApplyResources - lastTransitionTime: "2025-06-19T10:21:32Z" message: 'pods are not ready in Components: [namesrv], refer to related component message in Cluster.status.components' reason: ReplicasNotReady status: "False" type: ReplicasReady - lastTransitionTime: "2025-06-19T10:21:32Z" message: 'pods are unavailable in Components: [namesrv], refer to related component message in Cluster.status.components' reason: ComponentsNotReady status: "False" type: Ready observedGeneration: 5 phase: Abnormal ------------------------------------------------------------------------------------------------------------------ --------------------------------------describe cluster rocketmq-camunf-------------------------------------- `kubectl describe cluster rocketmq-camunf --namespace ns-imzlz ` Name: rocketmq-camunf Namespace: ns-imzlz Labels: app.kubernetes.io/instance=rocketmq-camunf Annotations: kubeblocks.io/extra-env: ***"ENABLE_ACL":"false"*** kubeblocks.io/reconcile: 2025-06-19T10:29:55.049611085Z API Version: apps.kubeblocks.io/v1alpha1 Kind: Cluster Metadata: Creation Timestamp: 2025-06-19T10:15:27Z Finalizers: cluster.kubeblocks.io/finalizer Generation: 5 Resource Version: 34545 UID: 1192d276-3a28-4e74-bd83-1dd87a100637 Spec: Component Specs: Component Def: rocketmq-namesrv-4 Name: namesrv Replicas: 1 Resources: Limits: Cpu: 100m Memory: 512Mi Requests: Cpu: 100m Memory: 512Mi Service Version: 4.9.6 Component Def: rocketmq-exporter Env: Name: ROCKETMQ_VERSION Value: 4.9.6 Monitor: true Name: exporter Replicas: 1 Resources: Limits: Cpu: 100m Memory: 512Mi Requests: Cpu: 100m Memory: 512Mi Service Version: 0.0.2 Component Def: rocketmq-dashboard Name: dashboard Replicas: 1 Resources: Limits: Cpu: 100m Memory: 512Mi Requests: Cpu: 100m Memory: 512Mi Service Version: 2.0.0 Resources: Cpu: 0 Memory: 0 Sharding Specs: Name: broker Shards: 1 Template: Component Def: rocketmq-broker-4 Name: rocketmq-broker Replicas: 2 Resources: Limits: Cpu: 100m Memory: 512Mi Requests: Cpu: 100m Memory: 512Mi Service Version: 4.9.6 System Accounts: Name: rocketmq-admin Password Config: Length: 8 Letter Case: MixedCases Num Digits: 6 Num Symbols: 0 Seed: rocketmq-camunf Secret Ref: Name: rocketmq-camunf-broker-rocketmq-admin Namespace: ns-imzlz Volume Claim Templates: Name: data Spec: Access Modes: ReadWriteOnce Resources: Requests: Storage: 1Gi Storage: Size: 0 Termination Policy: WipeOut Status: Components: Dashboard: Phase: Running Pods Ready: true Pods Ready Time: 2025-06-19T10:22:25Z Exporter: Message: InstanceSet/rocketmq-camunf-exporter: ["rocketmq-camunf-exporter-0"] Phase: Running Pods Ready: true Pods Ready Time: 2025-06-19T10:28:22Z Namesrv: Message: InstanceSet/rocketmq-camunf-namesrv: ["rocketmq-camunf-namesrv-0"] Phase: Updating Pods Ready: false Pods Ready Time: 2025-06-19T10:16:27Z Conditions: Last Transition Time: 2025-06-19T10:15:28Z Message: The operator has started the provisioning of Cluster: rocketmq-camunf Observed Generation: 5 Reason: PreCheckSucceed Status: True Type: ProvisioningStarted Last Transition Time: 2025-06-19T10:15:28Z Message: Successfully applied for resources Observed Generation: 5 Reason: ApplyResourcesSucceed Status: True Type: ApplyResources Last Transition Time: 2025-06-19T10:21:32Z Message: pods are not ready in Components: [namesrv], refer to related component message in Cluster.status.components Reason: ReplicasNotReady Status: False Type: ReplicasReady Last Transition Time: 2025-06-19T10:21:32Z Message: pods are unavailable in Components: [namesrv], refer to related component message in Cluster.status.components Reason: ComponentsNotReady Status: False Type: Ready Observed Generation: 5 Phase: Updating Events: Type Reason Age From Message ---- ------ ---- ---- ------- Normal ApplyResourcesSucceed 14m (x2 over 14m) cluster-controller Successfully applied for resources Normal PreCheckSucceed 14m (x2 over 14m) cluster-controller The operator has started the provisioning of Cluster: rocketmq-camunf Warning ReplicasNotReady 14m cluster-controller pods are not ready in Components: [broker-gds dashboard namesrv], refer to related component message in Cluster.status.components Warning ComponentsNotReady 14m cluster-controller pods are unavailable in Components: [broker-gds dashboard namesrv], refer to related component message in Cluster.status.components Warning ReplicasNotReady 14m cluster-controller pods are not ready in Components: [broker-gds namesrv], refer to related component message in Cluster.status.components Warning ComponentsNotReady 14m cluster-controller pods are unavailable in Components: [broker-gds namesrv], refer to related component message in Cluster.status.components Warning ComponentsNotReady 13m cluster-controller pods are unavailable in Components: [broker-gds], refer to related component message in Cluster.status.components Warning ReplicasNotReady 13m cluster-controller pods are not ready in Components: [broker-gds], refer to related component message in Cluster.status.components Normal ComponentPhaseTransition 13m (x11 over 14m) cluster-controller component is Creating Normal ComponentPhaseTransition 9m47s (x20 over 14m) cluster-controller component is Running Normal ComponentPhaseTransition 4m16s (x24 over 10m) cluster-controller component is Updating Warning Unhealthy 115s (x15 over 6m25s) event-controller Pod rocketmq-camunf-namesrv-0: Startup probe failed: dial tcp 172.31.11.205:9876: connect: connection refused Warning BackOff 24s (x3 over 48s) event-controller Pod rocketmq-camunf-namesrv-0: Back-off restarting failed container rocketmq-namesrv in pod rocketmq-camunf-namesrv-0_ns-imzlz(6a744048-87c8-4bc5-b81c-f79218c4e6dd) ------------------------------------------------------------------------------------------------------------------ check pod status `kbcli cluster list-instances rocketmq-camunf --namespace ns-imzlz ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME rocketmq-camunf-broker-gds-0 ns-imzlz rocketmq-camunf broker-gds Running master us-west-2a 100m / 100m 512Mi / 512Mi ip-172-31-12-213.us-west-2.compute.internal/172.31.12.213 Jun 19,2025 18:24 UTC+0800 rocketmq-camunf-broker-gds-1 ns-imzlz rocketmq-camunf broker-gds Running slave us-west-2a 100m / 100m 512Mi / 512Mi ip-172-31-14-226.us-west-2.compute.internal/172.31.14.226 Jun 19,2025 18:22 UTC+0800 rocketmq-camunf-dashboard-0 ns-imzlz rocketmq-camunf dashboard Running us-west-2a 100m / 100m 512Mi / 512Mi ip-172-31-15-192.us-west-2.compute.internal/172.31.15.192 Jun 19,2025 18:22 UTC+0800 rocketmq-camunf-exporter-0 ns-imzlz rocketmq-camunf exporter Running us-west-2a 100m / 100m 512Mi / 512Mi ip-172-31-14-226.us-west-2.compute.internal/172.31.14.226 Jun 19,2025 18:22 UTC+0800 rocketmq-camunf-namesrv-0 ns-imzlz rocketmq-camunf namesrv Running us-west-2a 100m / 100m 512Mi / 512Mi ip-172-31-15-192.us-west-2.compute.internal/172.31.15.192 Jun 19,2025 18:22 UTC+0800 check pod status done check ops status `kbcli cluster list-ops rocketmq-camunf --status all --namespace ns-imzlz ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME rocketmq-camunf-restart-8b585 ns-imzlz Restart rocketmq-camunf namesrv,exporter,dashboard,broker Failed 5/5 Jun 19,2025 18:21 UTC+0800 check ops status done --------------------------------------get cluster rocketmq-camunf yaml-------------------------------------- `kubectl get cluster rocketmq-camunf -o yaml --namespace ns-imzlz ` apiVersion: apps.kubeblocks.io/v1alpha1 kind: Cluster metadata: annotations: kubeblocks.io/extra-env: '***"ENABLE_ACL":"false"***' kubeblocks.io/reconcile: "2025-06-19T10:29:55.049611085Z" kubectl.kubernetes.io/last-applied-configuration: | ***"apiVersion":"apps.kubeblocks.io/v1alpha1","kind":"Cluster","metadata":***"annotations":***"kubeblocks.io/extra-env":"***\"ENABLE_ACL\":\"false\"***"***,"name":"rocketmq-camunf","namespace":"ns-imzlz"***,"spec":***"componentSpecs":[***"componentDef":"rocketmq-namesrv-4","name":"namesrv","replicas":1,"resources":***"limits":***"cpu":"100m","memory":"0.5Gi"***,"requests":***"cpu":"100m","memory":"0.5Gi"***,"serviceVersion":"4.9.6"***,***"componentDef":"rocketmq-exporter","env":[***"name":"ROCKETMQ_VERSION","value":"4.9.6"***],"monitor":true,"name":"exporter","replicas":1,"resources":***"limits":***"cpu":"100m","memory":"0.5Gi"***,"requests":***"cpu":"100m","memory":"0.5Gi"***,"serviceVersion":"0.0.2"***,***"componentDef":"rocketmq-dashboard","name":"dashboard","replicas":1,"resources":***"limits":***"cpu":"100m","memory":"0.5Gi"***,"requests":***"cpu":"100m","memory":"0.5Gi"***,"serviceVersion":"2.0.0"***],"shardingSpecs":[***"name":"broker","shards":1,"template":***"componentDef":"rocketmq-broker-4","name":"rocketmq-broker","replicas":2,"resources":***"limits":***"cpu":"100m","memory":"0.5Gi"***,"requests":***"cpu":"100m","memory":"0.5Gi"***,"serviceVersion":"4.9.6","systemAccounts":[***"name":"rocketmq-admin","passwordConfig":***"length":8,"letterCase":"MixedCases","numDigits":6,"seed":"rocketmq-camunf"***],"volumeClaimTemplates":[***"name":"data","spec":***"accessModes":["ReadWriteOnce"],"resources":***"requests":***"storage":"1Gi"***,"storageClassName":null***]***],"terminationPolicy":"WipeOut"*** creationTimestamp: "2025-06-19T10:15:27Z" finalizers: - cluster.kubeblocks.io/finalizer generation: 5 labels: app.kubernetes.io/instance: rocketmq-camunf name: rocketmq-camunf namespace: ns-imzlz resourceVersion: "34545" uid: 1192d276-3a28-4e74-bd83-1dd87a100637 spec: componentSpecs: - componentDef: rocketmq-namesrv-4 name: namesrv replicas: 1 resources: limits: cpu: 100m memory: 512Mi requests: cpu: 100m memory: 512Mi serviceVersion: 4.9.6 - componentDef: rocketmq-exporter env: - name: ROCKETMQ_VERSION value: 4.9.6 monitor: true name: exporter replicas: 1 resources: limits: cpu: 100m memory: 512Mi requests: cpu: 100m memory: 512Mi serviceVersion: 0.0.2 - componentDef: rocketmq-dashboard name: dashboard replicas: 1 resources: limits: cpu: 100m memory: 512Mi requests: cpu: 100m memory: 512Mi serviceVersion: 2.0.0 resources: cpu: "0" memory: "0" shardingSpecs: - name: broker shards: 1 template: componentDef: rocketmq-broker-4 name: rocketmq-broker replicas: 2 resources: limits: cpu: 100m memory: 512Mi requests: cpu: 100m memory: 512Mi serviceVersion: 4.9.6 systemAccounts: - name: rocketmq-admin passwordConfig: length: 8 letterCase: MixedCases numDigits: 6 numSymbols: 0 seed: rocketmq-camunf secretRef: name: rocketmq-camunf-broker-rocketmq-admin namespace: ns-imzlz volumeClaimTemplates: - name: data spec: accessModes: - ReadWriteOnce resources: requests: storage: 1Gi storage: size: "0" terminationPolicy: WipeOut status: components: dashboard: phase: Running podsReady: true podsReadyTime: "2025-06-19T10:22:25Z" exporter: message: InstanceSet/rocketmq-camunf-exporter: '["rocketmq-camunf-exporter-0"]' phase: Running podsReady: true podsReadyTime: "2025-06-19T10:28:22Z" namesrv: message: InstanceSet/rocketmq-camunf-namesrv: '["rocketmq-camunf-namesrv-0"]' phase: Updating podsReady: false podsReadyTime: "2025-06-19T10:16:27Z" conditions: - lastTransitionTime: "2025-06-19T10:15:28Z" message: 'The operator has started the provisioning of Cluster: rocketmq-camunf' observedGeneration: 5 reason: PreCheckSucceed status: "True" type: ProvisioningStarted - lastTransitionTime: "2025-06-19T10:15:28Z" message: Successfully applied for resources observedGeneration: 5 reason: ApplyResourcesSucceed status: "True" type: ApplyResources - lastTransitionTime: "2025-06-19T10:21:32Z" message: 'pods are not ready in Components: [namesrv], refer to related component message in Cluster.status.components' reason: ReplicasNotReady status: "False" type: ReplicasReady - lastTransitionTime: "2025-06-19T10:21:32Z" message: 'pods are unavailable in Components: [namesrv], refer to related component message in Cluster.status.components' reason: ComponentsNotReady status: "False" type: Ready observedGeneration: 5 phase: Updating ------------------------------------------------------------------------------------------------------------------ --------------------------------------describe cluster rocketmq-camunf-------------------------------------- `kubectl describe cluster rocketmq-camunf --namespace ns-imzlz ` Name: rocketmq-camunf Namespace: ns-imzlz Labels: app.kubernetes.io/instance=rocketmq-camunf Annotations: kubeblocks.io/extra-env: ***"ENABLE_ACL":"false"*** kubeblocks.io/reconcile: 2025-06-19T10:29:55.049611085Z API Version: apps.kubeblocks.io/v1alpha1 Kind: Cluster Metadata: Creation Timestamp: 2025-06-19T10:15:27Z Finalizers: cluster.kubeblocks.io/finalizer Generation: 5 Resource Version: 34545 UID: 1192d276-3a28-4e74-bd83-1dd87a100637 Spec: Component Specs: Component Def: rocketmq-namesrv-4 Name: namesrv Replicas: 1 Resources: Limits: Cpu: 100m Memory: 512Mi Requests: Cpu: 100m Memory: 512Mi Service Version: 4.9.6 Component Def: rocketmq-exporter Env: Name: ROCKETMQ_VERSION Value: 4.9.6 Monitor: true Name: exporter Replicas: 1 Resources: Limits: Cpu: 100m Memory: 512Mi Requests: Cpu: 100m Memory: 512Mi Service Version: 0.0.2 Component Def: rocketmq-dashboard Name: dashboard Replicas: 1 Resources: Limits: Cpu: 100m Memory: 512Mi Requests: Cpu: 100m Memory: 512Mi Service Version: 2.0.0 Resources: Cpu: 0 Memory: 0 Sharding Specs: Name: broker Shards: 1 Template: Component Def: rocketmq-broker-4 Name: rocketmq-broker Replicas: 2 Resources: Limits: Cpu: 100m Memory: 512Mi Requests: Cpu: 100m Memory: 512Mi Service Version: 4.9.6 System Accounts: Name: rocketmq-admin Password Config: Length: 8 Letter Case: MixedCases Num Digits: 6 Num Symbols: 0 Seed: rocketmq-camunf Secret Ref: Name: rocketmq-camunf-broker-rocketmq-admin Namespace: ns-imzlz Volume Claim Templates: Name: data Spec: Access Modes: ReadWriteOnce Resources: Requests: Storage: 1Gi Storage: Size: 0 Termination Policy: WipeOut Status: Components: Dashboard: Phase: Running Pods Ready: true Pods Ready Time: 2025-06-19T10:22:25Z Exporter: Message: InstanceSet/rocketmq-camunf-exporter: ["rocketmq-camunf-exporter-0"] Phase: Running Pods Ready: true Pods Ready Time: 2025-06-19T10:28:22Z Namesrv: Message: InstanceSet/rocketmq-camunf-namesrv: ["rocketmq-camunf-namesrv-0"] Phase: Updating Pods Ready: false Pods Ready Time: 2025-06-19T10:16:27Z Conditions: Last Transition Time: 2025-06-19T10:15:28Z Message: The operator has started the provisioning of Cluster: rocketmq-camunf Observed Generation: 5 Reason: PreCheckSucceed Status: True Type: ProvisioningStarted Last Transition Time: 2025-06-19T10:15:28Z Message: Successfully applied for resources Observed Generation: 5 Reason: ApplyResourcesSucceed Status: True Type: ApplyResources Last Transition Time: 2025-06-19T10:21:32Z Message: pods are not ready in Components: [namesrv], refer to related component message in Cluster.status.components Reason: ReplicasNotReady Status: False Type: ReplicasReady Last Transition Time: 2025-06-19T10:21:32Z Message: pods are unavailable in Components: [namesrv], refer to related component message in Cluster.status.components Reason: ComponentsNotReady Status: False Type: Ready Observed Generation: 5 Phase: Updating Events: Type Reason Age From Message ---- ------ ---- ---- ------- Normal ApplyResourcesSucceed 14m (x2 over 14m) cluster-controller Successfully applied for resources Normal PreCheckSucceed 14m (x2 over 14m) cluster-controller The operator has started the provisioning of Cluster: rocketmq-camunf Warning ReplicasNotReady 14m cluster-controller pods are not ready in Components: [broker-gds dashboard namesrv], refer to related component message in Cluster.status.components Warning ComponentsNotReady 14m cluster-controller pods are unavailable in Components: [broker-gds dashboard namesrv], refer to related component message in Cluster.status.components Warning ReplicasNotReady 14m cluster-controller pods are not ready in Components: [broker-gds namesrv], refer to related component message in Cluster.status.components Warning ComponentsNotReady 14m cluster-controller pods are unavailable in Components: [broker-gds namesrv], refer to related component message in Cluster.status.components Warning ComponentsNotReady 14m cluster-controller pods are unavailable in Components: [broker-gds], refer to related component message in Cluster.status.components Warning ReplicasNotReady 14m cluster-controller pods are not ready in Components: [broker-gds], refer to related component message in Cluster.status.components Normal ComponentPhaseTransition 14m (x11 over 14m) cluster-controller component is Creating Normal ComponentPhaseTransition 9m56s (x20 over 14m) cluster-controller component is Running Normal ComponentPhaseTransition 4m25s (x24 over 10m) cluster-controller component is Updating Warning Unhealthy 2m4s (x15 over 6m34s) event-controller Pod rocketmq-camunf-namesrv-0: Startup probe failed: dial tcp 172.31.11.205:9876: connect: connection refused Warning BackOff 33s (x3 over 57s) event-controller Pod rocketmq-camunf-namesrv-0: Back-off restarting failed container rocketmq-namesrv in pod rocketmq-camunf-namesrv-0_ns-imzlz(6a744048-87c8-4bc5-b81c-f79218c4e6dd) ------------------------------------------------------------------------------------------------------------------ --------------------------------------get opsrequest rocketmq-camunf-restart-8b585 yaml-------------------------------------- `kubectl get opsrequest rocketmq-camunf-restart-8b585 -o yaml --namespace ns-imzlz ` apiVersion: apps.kubeblocks.io/v1alpha1 kind: OpsRequest metadata: creationTimestamp: "2025-06-19T10:21:31Z" finalizers: - opsrequest.kubeblocks.io/finalizer generateName: rocketmq-camunf-restart- generation: 2 labels: app.kubernetes.io/instance: rocketmq-camunf app.kubernetes.io/managed-by: kubeblocks ops.kubeblocks.io/ops-type: Restart name: rocketmq-camunf-restart-8b585 namespace: ns-imzlz ownerReferences: - apiVersion: apps.kubeblocks.io/v1alpha1 kind: Cluster name: rocketmq-camunf uid: 1192d276-3a28-4e74-bd83-1dd87a100637 resourceVersion: "33241" uid: 5d188cd2-3afb-479b-9ccc-0ebe6b731241 spec: clusterName: rocketmq-camunf enqueueOnForce: false force: true preConditionDeadlineSeconds: 0 restart: - componentName: namesrv - componentName: exporter - componentName: dashboard - componentName: broker type: Restart status: clusterGeneration: 5 completionTimestamp: "2025-06-19T10:28:54Z" components: broker: phase: Running progressDetails: - endTime: "2025-06-19T10:23:30Z" message: 'Successfully restart: Pod/rocketmq-camunf-broker-gds-1 in Component: rocketmq-broker' objectKey: Pod/rocketmq-camunf-broker-gds-1 startTime: "2025-06-19T10:21:32Z" status: Succeed - endTime: "2025-06-19T10:26:24Z" message: 'Successfully restart: Pod/rocketmq-camunf-broker-gds-0 in Component: rocketmq-broker' objectKey: Pod/rocketmq-camunf-broker-gds-0 startTime: "2025-06-19T10:23:40Z" status: Succeed dashboard: phase: Running progressDetails: - endTime: "2025-06-19T10:22:25Z" message: 'Successfully restart: Pod/rocketmq-camunf-dashboard-0 in Component: dashboard' objectKey: Pod/rocketmq-camunf-dashboard-0 startTime: "2025-06-19T10:21:32Z" status: Succeed exporter: phase: Running progressDetails: - endTime: "2025-06-19T10:22:27Z" message: 'Successfully restart: Pod/rocketmq-camunf-exporter-0 in Component: exporter' objectKey: Pod/rocketmq-camunf-exporter-0 startTime: "2025-06-19T10:21:32Z" status: Succeed namesrv: phase: Failed progressDetails: - endTime: "2025-06-19T10:28:54Z" message: 'Failed to restart: Pod/rocketmq-camunf-namesrv-0 in Component: namesrv, message: ' objectKey: Pod/rocketmq-camunf-namesrv-0 startTime: "2025-06-19T10:21:32Z" status: Failed conditions: - lastTransitionTime: "2025-06-19T10:21:31Z" message: 'wait for the controller to process the OpsRequest: rocketmq-camunf-restart-8b585 in Cluster: rocketmq-camunf' reason: WaitForProgressing status: "True" type: WaitForProgressing - lastTransitionTime: "2025-06-19T10:21:31Z" message: 'OpsRequest: rocketmq-camunf-restart-8b585 is validated' reason: ValidateOpsRequestPassed status: "True" type: Validated - lastTransitionTime: "2025-06-19T10:21:31Z" message: 'Start to restart database in Cluster: rocketmq-camunf' reason: RestartStarted status: "True" type: Restarting - lastTransitionTime: "2025-06-19T10:28:54Z" message: 'Failed to process OpsRequest: rocketmq-camunf-restart-8b585 in cluster: rocketmq-camunf, more detailed informations in status.components' reason: OpsRequestFailed status: "False" type: Failed phase: Failed progress: 5/5 startTimestamp: "2025-06-19T10:21:31Z" ------------------------------------------------------------------------------------------------------------------ --------------------------------------describe opsrequest rocketmq-camunf-restart-8b585-------------------------------------- `kubectl describe opsrequest rocketmq-camunf-restart-8b585 --namespace ns-imzlz ` Name: rocketmq-camunf-restart-8b585 Namespace: ns-imzlz Labels: app.kubernetes.io/instance=rocketmq-camunf app.kubernetes.io/managed-by=kubeblocks ops.kubeblocks.io/ops-type=Restart Annotations: API Version: apps.kubeblocks.io/v1alpha1 Kind: OpsRequest Metadata: Creation Timestamp: 2025-06-19T10:21:31Z Finalizers: opsrequest.kubeblocks.io/finalizer Generate Name: rocketmq-camunf-restart- Generation: 2 Owner References: API Version: apps.kubeblocks.io/v1alpha1 Kind: Cluster Name: rocketmq-camunf UID: 1192d276-3a28-4e74-bd83-1dd87a100637 Resource Version: 33241 UID: 5d188cd2-3afb-479b-9ccc-0ebe6b731241 Spec: Cluster Name: rocketmq-camunf Enqueue On Force: false Force: true Pre Condition Deadline Seconds: 0 Restart: Component Name: namesrv Component Name: exporter Component Name: dashboard Component Name: broker Type: Restart Status: Cluster Generation: 5 Completion Timestamp: 2025-06-19T10:28:54Z Components: Broker: Phase: Running Progress Details: End Time: 2025-06-19T10:23:30Z Message: Successfully restart: Pod/rocketmq-camunf-broker-gds-1 in Component: rocketmq-broker Object Key: Pod/rocketmq-camunf-broker-gds-1 Start Time: 2025-06-19T10:21:32Z Status: Succeed End Time: 2025-06-19T10:26:24Z Message: Successfully restart: Pod/rocketmq-camunf-broker-gds-0 in Component: rocketmq-broker Object Key: Pod/rocketmq-camunf-broker-gds-0 Start Time: 2025-06-19T10:23:40Z Status: Succeed Dashboard: Phase: Running Progress Details: End Time: 2025-06-19T10:22:25Z Message: Successfully restart: Pod/rocketmq-camunf-dashboard-0 in Component: dashboard Object Key: Pod/rocketmq-camunf-dashboard-0 Start Time: 2025-06-19T10:21:32Z Status: Succeed Exporter: Phase: Running Progress Details: End Time: 2025-06-19T10:22:27Z Message: Successfully restart: Pod/rocketmq-camunf-exporter-0 in Component: exporter Object Key: Pod/rocketmq-camunf-exporter-0 Start Time: 2025-06-19T10:21:32Z Status: Succeed Namesrv: Phase: Failed Progress Details: End Time: 2025-06-19T10:28:54Z Message: Failed to restart: Pod/rocketmq-camunf-namesrv-0 in Component: namesrv, message: Object Key: Pod/rocketmq-camunf-namesrv-0 Start Time: 2025-06-19T10:21:32Z Status: Failed Conditions: Last Transition Time: 2025-06-19T10:21:31Z Message: wait for the controller to process the OpsRequest: rocketmq-camunf-restart-8b585 in Cluster: rocketmq-camunf Reason: WaitForProgressing Status: True Type: WaitForProgressing Last Transition Time: 2025-06-19T10:21:31Z Message: OpsRequest: rocketmq-camunf-restart-8b585 is validated Reason: ValidateOpsRequestPassed Status: True Type: Validated Last Transition Time: 2025-06-19T10:21:31Z Message: Start to restart database in Cluster: rocketmq-camunf Reason: RestartStarted Status: True Type: Restarting Last Transition Time: 2025-06-19T10:28:54Z Message: Failed to process OpsRequest: rocketmq-camunf-restart-8b585 in cluster: rocketmq-camunf, more detailed informations in status.components Reason: OpsRequestFailed Status: False Type: Failed Phase: Failed Progress: 5/5 Start Timestamp: 2025-06-19T10:21:31Z Events: Type Reason Age From Message ---- ------ ---- ---- ------- Normal ValidateOpsRequestPassed 9m1s ops-request-controller OpsRequest: rocketmq-camunf-restart-8b585 is validated Normal RestartStarted 9m1s ops-request-controller Start to restart database in Cluster: rocketmq-camunf Normal WaitForProgressing 9m1s ops-request-controller wait for the controller to process the OpsRequest: rocketmq-camunf-restart-8b585 in Cluster: rocketmq-camunf Normal Processing 9m (x2 over 9m1s) ops-request-controller Start to restart: Pod/rocketmq-camunf-dashboard-0 in Component: dashboard Normal Processing 9m (x2 over 9m1s) ops-request-controller Start to restart: Pod/rocketmq-camunf-broker-gds-1 in Component: rocketmq-broker Normal Processing 9m ops-request-controller Start to restart: Pod/rocketmq-camunf-namesrv-0 in Component: namesrv Normal Succeed 8m7s ops-request-controller Successfully restart: Pod/rocketmq-camunf-dashboard-0 in Component: dashboard Normal Succeed 7m2s ops-request-controller Successfully restart: Pod/rocketmq-camunf-broker-gds-1 in Component: rocketmq-broker Normal Processing 6m52s ops-request-controller Start to restart: Pod/rocketmq-camunf-broker-gds-0 in Component: rocketmq-broker Normal Succeed 4m8s ops-request-controller Successfully restart: Pod/rocketmq-camunf-broker-gds-0 in Component: rocketmq-broker Normal Processing 2m33s (x4 over 9m1s) ops-request-controller Start to restart: Pod/rocketmq-camunf-exporter-0 in Component: exporter Warning Failed 2m21s ops-request-controller Failed to restart: Pod/rocketmq-camunf-exporter-0 in Component: exporter, message: Normal Succeed 2m11s (x3 over 8m5s) ops-request-controller Successfully restart: Pod/rocketmq-camunf-exporter-0 in Component: exporter Warning Failed 98s ops-request-controller Failed to restart: Pod/rocketmq-camunf-namesrv-0 in Component: namesrv, message: Warning OpsRequestFailed 98s (x2 over 98s) ops-request-controller Failed to process OpsRequest: rocketmq-camunf-restart-8b585 in cluster: rocketmq-camunf, more detailed informations in status.components ------------------------------------------------------------------------------------------------------------------ `kubectl get jobs -l ops.kubeblocks.io/ops-name=rocketmq-camunf-restart-8b585 --namespace ns-imzlz` No resources found in ns-imzlz namespace. ops_status:rocketmq-camunf-restart-8b585 ns-imzlz Restart rocketmq-camunf namesrv,exporter,dashboard,broker Failed 5/5 Jun 19,2025 18:21 UTC+0800 `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge opsrequests rocketmq-camunf-restart-8b585 --namespace ns-imzlz ` opsrequest.apps.kubeblocks.io/rocketmq-camunf-restart-8b585 patched `kbcli cluster delete-ops --name rocketmq-camunf-restart-8b585 --force --auto-approve --namespace ns-imzlz ` OpsRequest rocketmq-camunf-restart-8b585 deleted cluster hscale check cluster status before ops cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Abnormal cluster_status:Abnormal cluster_status:Abnormal cluster_status:Abnormal cluster_status:Abnormal cluster_status:Abnormal cluster_status:Abnormal cluster_status:Abnormal cluster_status:Abnormal cluster_status:Abnormal cluster_status:Abnormal cluster_status:Abnormal cluster_status:Abnormal cluster_status:Abnormal cluster_status:Abnormal cluster_status:Abnormal cluster_status:Abnormal Warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely. pod "rocketmq-camunf-namesrv-0" force deleted cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Abnormal cluster_status:Abnormal cluster_status:Abnormal cluster_status:Abnormal cluster_status:Abnormal cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Abnormal cluster_status:Abnormal cluster_status:Abnormal cluster_status:Abnormal cluster_status:Abnormal cluster_status:Abnormal cluster_status:Abnormal cluster_status:Abnormal cluster_status:Abnormal [Error] check cluster status timeout --------------------------------------get cluster rocketmq-camunf yaml-------------------------------------- `kubectl get cluster rocketmq-camunf -o yaml --namespace ns-imzlz ` apiVersion: apps.kubeblocks.io/v1alpha1 kind: Cluster metadata: annotations: kubeblocks.io/extra-env: '***"ENABLE_ACL":"false"***' kubeblocks.io/reconcile: "2025-06-19T10:39:13.274751163Z" kubectl.kubernetes.io/last-applied-configuration: | ***"apiVersion":"apps.kubeblocks.io/v1alpha1","kind":"Cluster","metadata":***"annotations":***"kubeblocks.io/extra-env":"***\"ENABLE_ACL\":\"false\"***"***,"name":"rocketmq-camunf","namespace":"ns-imzlz"***,"spec":***"componentSpecs":[***"componentDef":"rocketmq-namesrv-4","name":"namesrv","replicas":1,"resources":***"limits":***"cpu":"100m","memory":"0.5Gi"***,"requests":***"cpu":"100m","memory":"0.5Gi"***,"serviceVersion":"4.9.6"***,***"componentDef":"rocketmq-exporter","env":[***"name":"ROCKETMQ_VERSION","value":"4.9.6"***],"monitor":true,"name":"exporter","replicas":1,"resources":***"limits":***"cpu":"100m","memory":"0.5Gi"***,"requests":***"cpu":"100m","memory":"0.5Gi"***,"serviceVersion":"0.0.2"***,***"componentDef":"rocketmq-dashboard","name":"dashboard","replicas":1,"resources":***"limits":***"cpu":"100m","memory":"0.5Gi"***,"requests":***"cpu":"100m","memory":"0.5Gi"***,"serviceVersion":"2.0.0"***],"shardingSpecs":[***"name":"broker","shards":1,"template":***"componentDef":"rocketmq-broker-4","name":"rocketmq-broker","replicas":2,"resources":***"limits":***"cpu":"100m","memory":"0.5Gi"***,"requests":***"cpu":"100m","memory":"0.5Gi"***,"serviceVersion":"4.9.6","systemAccounts":[***"name":"rocketmq-admin","passwordConfig":***"length":8,"letterCase":"MixedCases","numDigits":6,"seed":"rocketmq-camunf"***],"volumeClaimTemplates":[***"name":"data","spec":***"accessModes":["ReadWriteOnce"],"resources":***"requests":***"storage":"1Gi"***,"storageClassName":null***]***],"terminationPolicy":"WipeOut"*** creationTimestamp: "2025-06-19T10:15:27Z" finalizers: - cluster.kubeblocks.io/finalizer generation: 5 labels: app.kubernetes.io/instance: rocketmq-camunf name: rocketmq-camunf namespace: ns-imzlz resourceVersion: "42605" uid: 1192d276-3a28-4e74-bd83-1dd87a100637 spec: componentSpecs: - componentDef: rocketmq-namesrv-4 name: namesrv replicas: 1 resources: limits: cpu: 100m memory: 512Mi requests: cpu: 100m memory: 512Mi serviceVersion: 4.9.6 - componentDef: rocketmq-exporter env: - name: ROCKETMQ_VERSION value: 4.9.6 monitor: true name: exporter replicas: 1 resources: limits: cpu: 100m memory: 512Mi requests: cpu: 100m memory: 512Mi serviceVersion: 0.0.2 - componentDef: rocketmq-dashboard name: dashboard replicas: 1 resources: limits: cpu: 100m memory: 512Mi requests: cpu: 100m memory: 512Mi serviceVersion: 2.0.0 resources: cpu: "0" memory: "0" shardingSpecs: - name: broker shards: 1 template: componentDef: rocketmq-broker-4 name: rocketmq-broker replicas: 2 resources: limits: cpu: 100m memory: 512Mi requests: cpu: 100m memory: 512Mi serviceVersion: 4.9.6 systemAccounts: - name: rocketmq-admin passwordConfig: length: 8 letterCase: MixedCases numDigits: 6 numSymbols: 0 seed: rocketmq-camunf secretRef: name: rocketmq-camunf-broker-rocketmq-admin namespace: ns-imzlz volumeClaimTemplates: - name: data spec: accessModes: - ReadWriteOnce resources: requests: storage: 1Gi storage: size: "0" terminationPolicy: WipeOut status: components: dashboard: phase: Running podsReady: true podsReadyTime: "2025-06-19T10:22:25Z" exporter: message: InstanceSet/rocketmq-camunf-exporter: '["rocketmq-camunf-exporter-0"]' phase: Failed podsReady: false podsReadyTime: "2025-06-19T10:35:24Z" namesrv: message: InstanceSet/rocketmq-camunf-namesrv: '["rocketmq-camunf-namesrv-0"]' phase: Failed podsReady: false podsReadyTime: "2025-06-19T10:16:27Z" conditions: - lastTransitionTime: "2025-06-19T10:15:28Z" message: 'The operator has started the provisioning of Cluster: rocketmq-camunf' observedGeneration: 5 reason: PreCheckSucceed status: "True" type: ProvisioningStarted - lastTransitionTime: "2025-06-19T10:15:28Z" message: Successfully applied for resources observedGeneration: 5 reason: ApplyResourcesSucceed status: "True" type: ApplyResources - lastTransitionTime: "2025-06-19T10:21:32Z" message: 'pods are not ready in Components: [exporter namesrv], refer to related component message in Cluster.status.components' reason: ReplicasNotReady status: "False" type: ReplicasReady - lastTransitionTime: "2025-06-19T10:21:32Z" message: 'pods are unavailable in Components: [exporter namesrv], refer to related component message in Cluster.status.components' reason: ComponentsNotReady status: "False" type: Ready observedGeneration: 5 phase: Abnormal ------------------------------------------------------------------------------------------------------------------ --------------------------------------describe cluster rocketmq-camunf-------------------------------------- `kubectl describe cluster rocketmq-camunf --namespace ns-imzlz ` Name: rocketmq-camunf Namespace: ns-imzlz Labels: app.kubernetes.io/instance=rocketmq-camunf Annotations: kubeblocks.io/extra-env: ***"ENABLE_ACL":"false"*** kubeblocks.io/reconcile: 2025-06-19T10:39:13.274751163Z API Version: apps.kubeblocks.io/v1alpha1 Kind: Cluster Metadata: Creation Timestamp: 2025-06-19T10:15:27Z Finalizers: cluster.kubeblocks.io/finalizer Generation: 5 Resource Version: 42605 UID: 1192d276-3a28-4e74-bd83-1dd87a100637 Spec: Component Specs: Component Def: rocketmq-namesrv-4 Name: namesrv Replicas: 1 Resources: Limits: Cpu: 100m Memory: 512Mi Requests: Cpu: 100m Memory: 512Mi Service Version: 4.9.6 Component Def: rocketmq-exporter Env: Name: ROCKETMQ_VERSION Value: 4.9.6 Monitor: true Name: exporter Replicas: 1 Resources: Limits: Cpu: 100m Memory: 512Mi Requests: Cpu: 100m Memory: 512Mi Service Version: 0.0.2 Component Def: rocketmq-dashboard Name: dashboard Replicas: 1 Resources: Limits: Cpu: 100m Memory: 512Mi Requests: Cpu: 100m Memory: 512Mi Service Version: 2.0.0 Resources: Cpu: 0 Memory: 0 Sharding Specs: Name: broker Shards: 1 Template: Component Def: rocketmq-broker-4 Name: rocketmq-broker Replicas: 2 Resources: Limits: Cpu: 100m Memory: 512Mi Requests: Cpu: 100m Memory: 512Mi Service Version: 4.9.6 System Accounts: Name: rocketmq-admin Password Config: Length: 8 Letter Case: MixedCases Num Digits: 6 Num Symbols: 0 Seed: rocketmq-camunf Secret Ref: Name: rocketmq-camunf-broker-rocketmq-admin Namespace: ns-imzlz Volume Claim Templates: Name: data Spec: Access Modes: ReadWriteOnce Resources: Requests: Storage: 1Gi Storage: Size: 0 Termination Policy: WipeOut Status: Components: Dashboard: Phase: Running Pods Ready: true Pods Ready Time: 2025-06-19T10:22:25Z Exporter: Message: InstanceSet/rocketmq-camunf-exporter: ["rocketmq-camunf-exporter-0"] Phase: Failed Pods Ready: false Pods Ready Time: 2025-06-19T10:35:24Z Namesrv: Message: InstanceSet/rocketmq-camunf-namesrv: ["rocketmq-camunf-namesrv-0"] Phase: Failed Pods Ready: false Pods Ready Time: 2025-06-19T10:16:27Z Conditions: Last Transition Time: 2025-06-19T10:15:28Z Message: The operator has started the provisioning of Cluster: rocketmq-camunf Observed Generation: 5 Reason: PreCheckSucceed Status: True Type: ProvisioningStarted Last Transition Time: 2025-06-19T10:15:28Z Message: Successfully applied for resources Observed Generation: 5 Reason: ApplyResourcesSucceed Status: True Type: ApplyResources Last Transition Time: 2025-06-19T10:21:32Z Message: pods are not ready in Components: [exporter namesrv], refer to related component message in Cluster.status.components Reason: ReplicasNotReady Status: False Type: ReplicasReady Last Transition Time: 2025-06-19T10:21:32Z Message: pods are unavailable in Components: [exporter namesrv], refer to related component message in Cluster.status.components Reason: ComponentsNotReady Status: False Type: Ready Observed Generation: 5 Phase: Abnormal Events: Type Reason Age From Message ---- ------ ---- ---- ------- Normal ApplyResourcesSucceed 23m (x2 over 23m) cluster-controller Successfully applied for resources Normal PreCheckSucceed 23m (x2 over 23m) cluster-controller The operator has started the provisioning of Cluster: rocketmq-camunf Warning ReplicasNotReady 23m cluster-controller pods are not ready in Components: [broker-gds dashboard namesrv], refer to related component message in Cluster.status.components Warning ComponentsNotReady 23m cluster-controller pods are unavailable in Components: [broker-gds dashboard namesrv], refer to related component message in Cluster.status.components Warning ReplicasNotReady 23m cluster-controller pods are not ready in Components: [broker-gds namesrv], refer to related component message in Cluster.status.components Warning ComponentsNotReady 23m cluster-controller pods are unavailable in Components: [broker-gds namesrv], refer to related component message in Cluster.status.components Warning ComponentsNotReady 22m cluster-controller pods are unavailable in Components: [broker-gds], refer to related component message in Cluster.status.components Warning ReplicasNotReady 22m cluster-controller pods are not ready in Components: [broker-gds], refer to related component message in Cluster.status.components Normal ComponentPhaseTransition 22m (x11 over 23m) cluster-controller component is Creating Normal ComponentPhaseTransition 13m (x24 over 19m) cluster-controller component is Updating Warning Unhealthy 10m (x15 over 15m) event-controller Pod rocketmq-camunf-namesrv-0: Startup probe failed: dial tcp 172.31.11.205:9876: connect: connection refused Warning BackOff 6m53s (x4 over 9m47s) event-controller Pod rocketmq-camunf-namesrv-0: Back-off restarting failed container rocketmq-namesrv in pod rocketmq-camunf-namesrv-0_ns-imzlz(6a744048-87c8-4bc5-b81c-f79218c4e6dd) Warning Unhealthy 4m42s (x3 over 4m52s) event-controller Pod rocketmq-camunf-namesrv-0: Startup probe failed: dial tcp 172.31.1.55:9876: connect: connection refused Normal ComponentPhaseTransition 3m47s (x90 over 23m) cluster-controller component is Running Warning BackOff 19s (x10 over 8m10s) event-controller Pod rocketmq-camunf-exporter-0: Back-off restarting failed container rocketmq-exporter in pod rocketmq-camunf-exporter-0_ns-imzlz(7fee89e8-8790-4930-8795-281385d8d229) ------------------------------------------------------------------------------------------------------------------ cluster hscale check cluster status before ops cluster_status:Abnormal cluster_status:Abnormal cluster_status:Abnormal cluster_status:Abnormal cluster_status:Abnormal cluster_status:Abnormal cluster_status:Abnormal cluster_status:Abnormal cluster_status:Abnormal cluster_status:Abnormal cluster_status:Abnormal cluster_status:Abnormal cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Abnormal cluster_status:Abnormal cluster_status:Abnormal Warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely. pod "rocketmq-camunf-namesrv-0" force deleted cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Abnormal cluster_status:Abnormal cluster_status:Abnormal cluster_status:Abnormal cluster_status:Abnormal cluster_status:Abnormal cluster_status:Abnormal cluster_status:Abnormal cluster_status:Abnormal cluster_status:Abnormal cluster_status:Abnormal cluster_status:Abnormal cluster_status:Abnormal cluster_status:Abnormal cluster_status:Abnormal cluster_status:Abnormal Warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely. pod "rocketmq-camunf-exporter-0" force deleted cluster_status:Updating cluster_status:Updating check cluster status done cluster_status:Running No resources found in rocketmq-camunf namespace. `kbcli cluster hscale rocketmq-camunf --auto-approve --force=true --components broker --replicas 2 --namespace ns-imzlz ` OpsRequest rocketmq-camunf-horizontalscaling-7zcxn created successfully, you can view the progress: kbcli cluster describe-ops rocketmq-camunf-horizontalscaling-7zcxn -n ns-imzlz check ops status `kbcli cluster list-ops rocketmq-camunf --status all --namespace ns-imzlz ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME rocketmq-camunf-horizontalscaling-7zcxn ns-imzlz HorizontalScaling rocketmq-camunf broker Succeed 0/0 Jun 19,2025 18:44 UTC+0800 ops_status:rocketmq-camunf-horizontalscaling-7zcxn ns-imzlz HorizontalScaling rocketmq-camunf broker Succeed 0/0 Jun 19,2025 18:44 UTC+0800 ops HorizontalScaling Succeed or Failed Soon check cluster status `kbcli cluster list rocketmq-camunf --show-labels --namespace ns-imzlz ` NAME NAMESPACE CLUSTER-DEFINITION VERSION TERMINATION-POLICY STATUS CREATED-TIME LABELS rocketmq-camunf ns-imzlz WipeOut Running Jun 19,2025 18:15 UTC+0800 app.kubernetes.io/instance=rocketmq-camunf check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances rocketmq-camunf --namespace ns-imzlz ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME rocketmq-camunf-broker-gds-0 ns-imzlz rocketmq-camunf broker-gds Running master us-west-2a 100m / 100m 512Mi / 512Mi ip-172-31-12-213.us-west-2.compute.internal/172.31.12.213 Jun 19,2025 18:24 UTC+0800 rocketmq-camunf-broker-gds-1 ns-imzlz rocketmq-camunf broker-gds Running slave us-west-2a 100m / 100m 512Mi / 512Mi ip-172-31-14-226.us-west-2.compute.internal/172.31.14.226 Jun 19,2025 18:22 UTC+0800 rocketmq-camunf-dashboard-0 ns-imzlz rocketmq-camunf dashboard Running us-west-2a 100m / 100m 512Mi / 512Mi ip-172-31-15-192.us-west-2.compute.internal/172.31.15.192 Jun 19,2025 18:22 UTC+0800 rocketmq-camunf-exporter-0 ns-imzlz rocketmq-camunf exporter Running us-west-2a 100m / 100m 512Mi / 512Mi ip-172-31-9-102.us-west-2.compute.internal/172.31.9.102 Jun 19,2025 18:44 UTC+0800 rocketmq-camunf-namesrv-0 ns-imzlz rocketmq-camunf namesrv Running us-west-2a 100m / 100m 512Mi / 512Mi ip-172-31-2-11.us-west-2.compute.internal/172.31.2.11 Jun 19,2025 18:41 UTC+0800 check pod status done check cluster role check cluster role done master: rocketmq-camunf-broker-gds-0;slave: rocketmq-camunf-broker-gds-1 connect unsupported engine type: rocketmq rocketmq-broker-4 No resources found in rocketmq-camunf namespace. check ops status `kbcli cluster list-ops rocketmq-camunf --status all --namespace ns-imzlz ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME rocketmq-camunf-horizontalscaling-7zcxn ns-imzlz HorizontalScaling rocketmq-camunf broker Succeed 0/0 Jun 19,2025 18:44 UTC+0800 check ops status done ops_status:rocketmq-camunf-horizontalscaling-7zcxn ns-imzlz HorizontalScaling rocketmq-camunf broker Succeed 0/0 Jun 19,2025 18:44 UTC+0800 `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge opsrequests rocketmq-camunf-horizontalscaling-7zcxn --namespace ns-imzlz ` opsrequest.apps.kubeblocks.io/rocketmq-camunf-horizontalscaling-7zcxn patched `kbcli cluster delete-ops --name rocketmq-camunf-horizontalscaling-7zcxn --force --auto-approve --namespace ns-imzlz ` OpsRequest rocketmq-camunf-horizontalscaling-7zcxn deleted cluster vscale check cluster status before ops check cluster status done cluster_status:Running `kbcli cluster vscale rocketmq-camunf --auto-approve --force=true --components broker --cpu 600m --memory 0.6Gi --namespace ns-imzlz ` OpsRequest rocketmq-camunf-verticalscaling-8lbq6 created successfully, you can view the progress: kbcli cluster describe-ops rocketmq-camunf-verticalscaling-8lbq6 -n ns-imzlz check ops status `kbcli cluster list-ops rocketmq-camunf --status all --namespace ns-imzlz ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME rocketmq-camunf-verticalscaling-8lbq6 ns-imzlz VerticalScaling rocketmq-camunf broker Running 0/2 Jun 19,2025 18:45 UTC+0800 check cluster status `kbcli cluster list rocketmq-camunf --show-labels --namespace ns-imzlz ` NAME NAMESPACE CLUSTER-DEFINITION VERSION TERMINATION-POLICY STATUS CREATED-TIME LABELS rocketmq-camunf ns-imzlz WipeOut Updating Jun 19,2025 18:15 UTC+0800 app.kubernetes.io/instance=rocketmq-camunf cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances rocketmq-camunf --namespace ns-imzlz ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME rocketmq-camunf-broker-gds-0 ns-imzlz rocketmq-camunf broker-gds Running master us-west-2a 600m / 600m 644245094400m / 644245094400m ip-172-31-5-157.us-west-2.compute.internal/172.31.5.157 Jun 19,2025 18:47 UTC+0800 rocketmq-camunf-broker-gds-1 ns-imzlz rocketmq-camunf broker-gds Running slave us-west-2a 600m / 600m 644245094400m / 644245094400m ip-172-31-9-241.us-west-2.compute.internal/172.31.9.241 Jun 19,2025 18:45 UTC+0800 rocketmq-camunf-dashboard-0 ns-imzlz rocketmq-camunf dashboard Running us-west-2a 100m / 100m 512Mi / 512Mi ip-172-31-15-192.us-west-2.compute.internal/172.31.15.192 Jun 19,2025 18:22 UTC+0800 rocketmq-camunf-exporter-0 ns-imzlz rocketmq-camunf exporter Running us-west-2a 100m / 100m 512Mi / 512Mi ip-172-31-9-102.us-west-2.compute.internal/172.31.9.102 Jun 19,2025 18:44 UTC+0800 rocketmq-camunf-namesrv-0 ns-imzlz rocketmq-camunf namesrv Running us-west-2a 100m / 100m 512Mi / 512Mi ip-172-31-2-11.us-west-2.compute.internal/172.31.2.11 Jun 19,2025 18:41 UTC+0800 check pod status done check cluster role check cluster role done master: rocketmq-camunf-broker-gds-0;slave: rocketmq-camunf-broker-gds-1 connect unsupported engine type: rocketmq rocketmq-broker-4 check ops status `kbcli cluster list-ops rocketmq-camunf --status all --namespace ns-imzlz ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME rocketmq-camunf-verticalscaling-8lbq6 ns-imzlz VerticalScaling rocketmq-camunf broker Succeed 2/2 Jun 19,2025 18:45 UTC+0800 check ops status done ops_status:rocketmq-camunf-verticalscaling-8lbq6 ns-imzlz VerticalScaling rocketmq-camunf broker Succeed 2/2 Jun 19,2025 18:45 UTC+0800 `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge opsrequests rocketmq-camunf-verticalscaling-8lbq6 --namespace ns-imzlz ` opsrequest.apps.kubeblocks.io/rocketmq-camunf-verticalscaling-8lbq6 patched `kbcli cluster delete-ops --name rocketmq-camunf-verticalscaling-8lbq6 --force --auto-approve --namespace ns-imzlz ` OpsRequest rocketmq-camunf-verticalscaling-8lbq6 deleted cluster stop check cluster status before ops check cluster status done cluster_status:Running `kbcli cluster stop rocketmq-camunf --auto-approve --force=true --namespace ns-imzlz ` OpsRequest rocketmq-camunf-stop-m8m5x created successfully, you can view the progress: kbcli cluster describe-ops rocketmq-camunf-stop-m8m5x -n ns-imzlz check ops status `kbcli cluster list-ops rocketmq-camunf --status all --namespace ns-imzlz ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME rocketmq-camunf-stop-m8m5x ns-imzlz Stop rocketmq-camunf broker,dashboard,exporter,namesrv Running 0/5 Jun 19,2025 18:49 UTC+0800 check cluster status `kbcli cluster list rocketmq-camunf --show-labels --namespace ns-imzlz ` NAME NAMESPACE CLUSTER-DEFINITION VERSION TERMINATION-POLICY STATUS CREATED-TIME LABELS rocketmq-camunf ns-imzlz WipeOut Stopping Jun 19,2025 18:15 UTC+0800 app.kubernetes.io/instance=rocketmq-camunf cluster_status:Stopping cluster_status:Stopping cluster_status:Stopping cluster_status:Stopping cluster_status:Stopping cluster_status:Stopping cluster_status:Stopping cluster_status:Stopping cluster_status:Stopping check cluster status done cluster_status:Stopped check pod status `kbcli cluster list-instances rocketmq-camunf --namespace ns-imzlz ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME check pod status done check ops status `kbcli cluster list-ops rocketmq-camunf --status all --namespace ns-imzlz ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME rocketmq-camunf-stop-m8m5x ns-imzlz Stop rocketmq-camunf broker,dashboard,exporter,namesrv Succeed 5/5 Jun 19,2025 18:49 UTC+0800 check ops status done ops_status:rocketmq-camunf-stop-m8m5x ns-imzlz Stop rocketmq-camunf broker,dashboard,exporter,namesrv Succeed 5/5 Jun 19,2025 18:49 UTC+0800 `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge opsrequests rocketmq-camunf-stop-m8m5x --namespace ns-imzlz ` opsrequest.apps.kubeblocks.io/rocketmq-camunf-stop-m8m5x patched `kbcli cluster delete-ops --name rocketmq-camunf-stop-m8m5x --force --auto-approve --namespace ns-imzlz ` OpsRequest rocketmq-camunf-stop-m8m5x deleted cluster start check cluster status before ops check cluster status done cluster_status:Stopped `kbcli cluster start rocketmq-camunf --force=true --namespace ns-imzlz ` OpsRequest rocketmq-camunf-start-7kx7t created successfully, you can view the progress: kbcli cluster describe-ops rocketmq-camunf-start-7kx7t -n ns-imzlz check ops status `kbcli cluster list-ops rocketmq-camunf --status all --namespace ns-imzlz ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME rocketmq-camunf-start-7kx7t ns-imzlz Start rocketmq-camunf broker,dashboard,exporter,namesrv Running 0/5 Jun 19,2025 18:51 UTC+0800 check cluster status `kbcli cluster list rocketmq-camunf --show-labels --namespace ns-imzlz ` NAME NAMESPACE CLUSTER-DEFINITION VERSION TERMINATION-POLICY STATUS CREATED-TIME LABELS rocketmq-camunf ns-imzlz WipeOut Updating Jun 19,2025 18:15 UTC+0800 app.kubernetes.io/instance=rocketmq-camunf cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances rocketmq-camunf --namespace ns-imzlz ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME rocketmq-camunf-broker-gds-0 ns-imzlz rocketmq-camunf broker-gds Running master us-west-2a 600m / 600m 644245094400m / 644245094400m ip-172-31-9-241.us-west-2.compute.internal/172.31.9.241 Jun 19,2025 18:51 UTC+0800 rocketmq-camunf-broker-gds-1 ns-imzlz rocketmq-camunf broker-gds Running slave us-west-2a 600m / 600m 644245094400m / 644245094400m ip-172-31-5-157.us-west-2.compute.internal/172.31.5.157 Jun 19,2025 18:51 UTC+0800 rocketmq-camunf-dashboard-0 ns-imzlz rocketmq-camunf dashboard Running us-west-2a 100m / 100m 512Mi / 512Mi ip-172-31-7-169.us-west-2.compute.internal/172.31.7.169 Jun 19,2025 18:51 UTC+0800 rocketmq-camunf-exporter-0 ns-imzlz rocketmq-camunf exporter Running us-west-2a 100m / 100m 512Mi / 512Mi ip-172-31-2-11.us-west-2.compute.internal/172.31.2.11 Jun 19,2025 18:51 UTC+0800 rocketmq-camunf-namesrv-0 ns-imzlz rocketmq-camunf namesrv Running us-west-2a 100m / 100m 512Mi / 512Mi ip-172-31-9-241.us-west-2.compute.internal/172.31.9.241 Jun 19,2025 18:51 UTC+0800 check pod status done check cluster role check cluster role done master: rocketmq-camunf-broker-gds-0;slave: rocketmq-camunf-broker-gds-1 connect unsupported engine type: rocketmq rocketmq-broker-4 check ops status `kbcli cluster list-ops rocketmq-camunf --status all --namespace ns-imzlz ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME rocketmq-camunf-start-7kx7t ns-imzlz Start rocketmq-camunf broker,dashboard,exporter,namesrv Succeed 5/5 Jun 19,2025 18:51 UTC+0800 check ops status done ops_status:rocketmq-camunf-start-7kx7t ns-imzlz Start rocketmq-camunf broker,dashboard,exporter,namesrv Succeed 5/5 Jun 19,2025 18:51 UTC+0800 `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge opsrequests rocketmq-camunf-start-7kx7t --namespace ns-imzlz ` opsrequest.apps.kubeblocks.io/rocketmq-camunf-start-7kx7t patched `kbcli cluster delete-ops --name rocketmq-camunf-start-7kx7t --force --auto-approve --namespace ns-imzlz ` OpsRequest rocketmq-camunf-start-7kx7t deleted `kubectl get pvc -l app.kubernetes.io/instance=rocketmq-camunf,apps.kubeblocks.io/component-name=broker,apps.kubeblocks.io/vct-name=data --namespace ns-imzlz ` No resources found in ns-imzlz namespace. rocketmq-camunf broker data pvc is empty cluster volume-expand check cluster status before ops check cluster status done cluster_status:Running No resources found in rocketmq-camunf namespace. `kbcli cluster volume-expand rocketmq-camunf --auto-approve --force=true --components broker --volume-claim-templates data --storage 5Gi --namespace ns-imzlz ` OpsRequest rocketmq-camunf-volumeexpansion-sc485 created successfully, you can view the progress: kbcli cluster describe-ops rocketmq-camunf-volumeexpansion-sc485 -n ns-imzlz check ops status `kbcli cluster list-ops rocketmq-camunf --status all --namespace ns-imzlz ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME rocketmq-camunf-volumeexpansion-sc485 ns-imzlz VolumeExpansion rocketmq-camunf broker Running 0/2 Jun 19,2025 18:52 UTC+0800 check cluster status `kbcli cluster list rocketmq-camunf --show-labels --namespace ns-imzlz ` NAME NAMESPACE CLUSTER-DEFINITION VERSION TERMINATION-POLICY STATUS CREATED-TIME LABELS rocketmq-camunf ns-imzlz WipeOut Updating Jun 19,2025 18:15 UTC+0800 app.kubernetes.io/instance=rocketmq-camunf cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances rocketmq-camunf --namespace ns-imzlz ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME rocketmq-camunf-broker-gds-0 ns-imzlz rocketmq-camunf broker-gds Running master us-west-2a 600m / 600m 644245094400m / 644245094400m ip-172-31-9-241.us-west-2.compute.internal/172.31.9.241 Jun 19,2025 18:51 UTC+0800 rocketmq-camunf-broker-gds-1 ns-imzlz rocketmq-camunf broker-gds Running slave us-west-2a 600m / 600m 644245094400m / 644245094400m ip-172-31-5-157.us-west-2.compute.internal/172.31.5.157 Jun 19,2025 18:51 UTC+0800 rocketmq-camunf-dashboard-0 ns-imzlz rocketmq-camunf dashboard Running us-west-2a 100m / 100m 512Mi / 512Mi ip-172-31-7-169.us-west-2.compute.internal/172.31.7.169 Jun 19,2025 18:51 UTC+0800 rocketmq-camunf-exporter-0 ns-imzlz rocketmq-camunf exporter Running us-west-2a 100m / 100m 512Mi / 512Mi ip-172-31-2-11.us-west-2.compute.internal/172.31.2.11 Jun 19,2025 18:51 UTC+0800 rocketmq-camunf-namesrv-0 ns-imzlz rocketmq-camunf namesrv Running us-west-2a 100m / 100m 512Mi / 512Mi ip-172-31-9-241.us-west-2.compute.internal/172.31.9.241 Jun 19,2025 18:51 UTC+0800 check pod status done check cluster role check cluster role done master: rocketmq-camunf-broker-gds-0;slave: rocketmq-camunf-broker-gds-1 connect unsupported engine type: rocketmq rocketmq-broker-4 No resources found in rocketmq-camunf namespace. check ops status `kbcli cluster list-ops rocketmq-camunf --status all --namespace ns-imzlz ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME rocketmq-camunf-volumeexpansion-sc485 ns-imzlz VolumeExpansion rocketmq-camunf broker Succeed 2/2 Jun 19,2025 18:52 UTC+0800 check ops status done ops_status:rocketmq-camunf-volumeexpansion-sc485 ns-imzlz VolumeExpansion rocketmq-camunf broker Succeed 2/2 Jun 19,2025 18:52 UTC+0800 `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge opsrequests rocketmq-camunf-volumeexpansion-sc485 --namespace ns-imzlz ` opsrequest.apps.kubeblocks.io/rocketmq-camunf-volumeexpansion-sc485 patched `kbcli cluster delete-ops --name rocketmq-camunf-volumeexpansion-sc485 --force --auto-approve --namespace ns-imzlz ` OpsRequest rocketmq-camunf-volumeexpansion-sc485 deleted cluster update terminationPolicy WipeOut `kbcli cluster update rocketmq-camunf --termination-policy=WipeOut --namespace ns-imzlz ` cluster.apps.kubeblocks.io/rocketmq-camunf updated (no change) check cluster status `kbcli cluster list rocketmq-camunf --show-labels --namespace ns-imzlz ` NAME NAMESPACE CLUSTER-DEFINITION VERSION TERMINATION-POLICY STATUS CREATED-TIME LABELS rocketmq-camunf ns-imzlz WipeOut Running Jun 19,2025 18:15 UTC+0800 app.kubernetes.io/instance=rocketmq-camunf check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances rocketmq-camunf --namespace ns-imzlz ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME rocketmq-camunf-broker-gds-0 ns-imzlz rocketmq-camunf broker-gds Running master us-west-2a 600m / 600m 644245094400m / 644245094400m ip-172-31-9-241.us-west-2.compute.internal/172.31.9.241 Jun 19,2025 18:51 UTC+0800 rocketmq-camunf-broker-gds-1 ns-imzlz rocketmq-camunf broker-gds Running slave us-west-2a 600m / 600m 644245094400m / 644245094400m ip-172-31-5-157.us-west-2.compute.internal/172.31.5.157 Jun 19,2025 18:51 UTC+0800 rocketmq-camunf-dashboard-0 ns-imzlz rocketmq-camunf dashboard Running us-west-2a 100m / 100m 512Mi / 512Mi ip-172-31-7-169.us-west-2.compute.internal/172.31.7.169 Jun 19,2025 18:51 UTC+0800 rocketmq-camunf-exporter-0 ns-imzlz rocketmq-camunf exporter Running us-west-2a 100m / 100m 512Mi / 512Mi ip-172-31-2-11.us-west-2.compute.internal/172.31.2.11 Jun 19,2025 18:51 UTC+0800 rocketmq-camunf-namesrv-0 ns-imzlz rocketmq-camunf namesrv Running us-west-2a 100m / 100m 512Mi / 512Mi ip-172-31-9-241.us-west-2.compute.internal/172.31.9.241 Jun 19,2025 18:51 UTC+0800 check pod status done check cluster role check cluster role done master: rocketmq-camunf-broker-gds-0;slave: rocketmq-camunf-broker-gds-1 connect unsupported engine type: rocketmq rocketmq-broker-4 cluster list-logs `kbcli cluster list-logs rocketmq-camunf --namespace ns-imzlz ` No log files found. You can enable the log feature with the kbcli command below. kbcli cluster update rocketmq-camunf --enable-all-logs=true --namespace ns-imzlz Error from server (NotFound): pods "rocketmq-camunf-broker-gds-0" not found cluster logs `kbcli cluster logs rocketmq-camunf --tail 30 --namespace ns-imzlz ` Defaulted container "rocketmq-broker" out of: rocketmq-broker, jmx-exporter, lorry, config-manager, init-lorry (init), install-config-manager-tool (init) OpenJDK 64-Bit Server VM warning: If the number of processors is expected to increase from one, then you should configure the number of parallel GC threads appropriately using -XX:ParallelGCThreads=N The broker[broker-gds, 172.31.3.31:10911] boot success. serializeType=JSON and name server is rocketmq-camunf-namesrv-0.rocketmq-camunf-namesrv-headless.ns-imzlz.svc.cluster.local:9876 RocketMQ Test Suite All Done! --------------------------------------RocketMQ (Topology = master-slave Replicas 2) Test Result-------------------------------------- [PASSED]|[Create]|[Topology=master-slave;ComponentVersion=rocketmq-broker;ServiceVersion=4.9.6;]|[Description=Create a cluster with the specified topology master-slave and component version rocketmq-broker and service version 4.9.6] [PASSED]|[HorizontalScaling Out]|[ShardsName=broker]|[Description=HorizontalScaling Out the cluster] [PASSED]|[HorizontalScaling In]|[ShardsName=broker]|[Description=HorizontalScaling In the cluster] [FAILED]|[Restart]|[-]|[Description=Restart the cluster] [FAILED]|[HorizontalScaling Out]|[ComponentName=broker-gds]|[Description=HorizontalScaling Out the cluster specify component broker-gds] [WARNING]|[Operation]|[Succeed Or Failed Soon]|[Description=-] [PASSED]|[HorizontalScaling In]|[ComponentName=broker-gds]|[Description=HorizontalScaling In the cluster specify component broker-gds] [PASSED]|[VerticalScaling]|[ComponentName=broker-gds]|[Description=VerticalScaling the cluster specify component broker-gds] [PASSED]|[Stop]|[-]|[Description=Stop the cluster] [PASSED]|[Start]|[-]|[Description=Start the cluster] [PASSED]|[VolumeExpansion]|[ComponentName=broker-gds]|[Description=VolumeExpansion the cluster specify component broker-gds] [PASSED]|[Update]|[TerminationPolicy=WipeOut]|[Description=Update the cluster TerminationPolicy WipeOut] [END]