bash test/kbcli/test_kbcli_0.9.sh --type 53 --version 0.9.5 --generate-output true --chaos-mesh true --drain-node true --random-namespace true --region eastus --cloud-provider aks CURRENT_TEST_DIR:test/kbcli source commons files source engines files source kubeblocks files `kubectl get namespace | grep ns-lhngm ` `kubectl create namespace ns-lhngm` namespace/ns-lhngm created create namespace ns-lhngm done download kbcli `gh release list --repo apecloud/kbcli --limit 100 | (grep "0.9" || true)` `curl -fsSL https://kubeblocks.io/installer/install_cli.sh | bash -s v0.9.5-beta.8` Your system is linux_amd64 Installing kbcli ... Downloading ... % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 32.1M 100 32.1M 0 0 110M 0 --:--:-- --:--:-- --:--:-- 110M kbcli installed successfully. Kubernetes: v1.32.6 KubeBlocks: 0.9.5 kbcli: 0.9.5-beta.8 WARNING: version difference between kbcli (0.9.5-beta.8) and kubeblocks (0.9.5) Make sure your docker service is running and begin your journey with kbcli: kbcli playground init For more information on how to get started, please visit: https://kubeblocks.io download kbcli v0.9.5-beta.8 done Kubernetes: v1.32.6 KubeBlocks: 0.9.5 kbcli: 0.9.5-beta.8 WARNING: version difference between kbcli (0.9.5-beta.8) and kubeblocks (0.9.5) Kubernetes Env: v1.32.6 POD_RESOURCES: aks kb-default-sc found aks default-vsc found found default storage class: default kubeblocks version is:0.9.5 skip upgrade kubeblocks Error: no repositories to show helm repo add chaos-mesh https://charts.chaos-mesh.org "chaos-mesh" has been added to your repositories add helm chart repo chaos-mesh success chaos mesh already installed set component name:rabbitmq set component version No resources found no component version found no cluster version found No resources found set rabbitmq component definition REPORT_COUNT 0:0 not found component version set replicas first:3 set replicas third:3 set minimum cmpv service version set minimum cmpv service version replicas:3 REPORT_COUNT:1 CLUSTER_TOPOLOGY: Error from server (NotFound): clusterdefinitions.apps.kubeblocks.io "rabbitmq" not found Not found topology in cluster definition rabbitmq LIMIT_CPU:0.5 LIMIT_MEMORY:0.5 storage size: 1 No resources found in ns-lhngm namespace. termination_policy:WipeOut create 3 replica WipeOut rabbitmq cluster check component definition No resources found KUBEBLOCKS NAMESPACE:kb-hmwej get kubeblocks namespace done annotate rabbitmq cmpd apps.kubeblocks.io/skip-immutable-check=true No resources found get helm repo list success `helm repo remove kbcli-test-addons ` Error: no repo named "kbcli-test-addons" found `helm repo add kbcli-test-addons https://apecloud.github.io/helm-charts` "kbcli-test-addons" has been added to your repositories add helm chart repo success `helm repo update kbcli-test-addons ` Hang tight while we grab the latest from your chart repositories... ...Successfully got an update from the "kbcli-test-addons" chart repository Update Complete. ⎈Happy Helming!⎈ KUBEBLOCKS NAMESPACE:kb-hmwej get kubeblocks namespace done `helm upgrade --install --namespace kb-hmwej kb-addon-rabbitmq kbcli-test-addons/rabbitmq --version 0.9.0 --set image.registry=docker.io --set images.registry=docker.io ` Release "kb-addon-rabbitmq" does not exist. Installing it now. NAME: kb-addon-rabbitmq LAST DEPLOYED: Mon Sep 1 11:23:43 2025 NAMESPACE: kb-hmwej STATUS: deployed REVISION: 1 TEST SUITE: None NOTES: Release Information: Commit ID: "7be7b35390fcdbc24ea945384ba6da1bbdac4874" Commit Time: "2025-08-21 16:41:56 +0800" Release Branch: "v0.9.5" Release Time: "2025-09-01 10:47:16 +0800" Enterprise: "false" set component version set component version:rabbitmq set service versions:3.10.25,3.11.28,3.12.14,3.13.2,3.13.7,3.8.14,3.9.29 set service versions sorted:3.8.14,3.9.29,3.10.25,3.11.28,3.12.14,3.13.2,3.13.7 check component definition rabbitmq status done set component definition by component version check cmpd by labels set component definition2: rabbitmq by component version:rabbitmq apiVersion: apps.kubeblocks.io/v1alpha1 kind: Cluster metadata: name: rabbitmq-kefier namespace: ns-lhngm spec: terminationPolicy: WipeOut componentSpecs: - name: rabbitmq componentDef: rabbitmq serviceVersion: replicas: 3 resources: requests: cpu: 500m memory: 0.5Gi limits: cpu: 500m memory: 0.5Gi serviceAccountName: kb-rabbitmq-kefier volumeClaimTemplates: - name: data spec: storageClassName: accessModes: - ReadWriteOnce resources: requests: storage: 1Gi `kubectl apply -f test_create_rabbitmq-kefier.yaml` cluster.apps.kubeblocks.io/rabbitmq-kefier created apply test_create_rabbitmq-kefier.yaml Success `rm -rf test_create_rabbitmq-kefier.yaml` check cluster status `kbcli cluster list rabbitmq-kefier --show-labels --namespace ns-lhngm ` NAME NAMESPACE CLUSTER-DEFINITION VERSION TERMINATION-POLICY STATUS CREATED-TIME LABELS rabbitmq-kefier ns-lhngm WipeOut Sep 01,2025 11:24 UTC+0800 cluster_status: cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances rabbitmq-kefier --namespace ns-lhngm ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME rabbitmq-kefier-rabbitmq-0 ns-lhngm rabbitmq-kefier rabbitmq Running 0 500m / 500m 512Mi / 512Mi data:1Gi aks-cicdamdpool-38368475-vmss000000/10.224.0.5 Sep 01,2025 11:24 UTC+0800 rabbitmq-kefier-rabbitmq-1 ns-lhngm rabbitmq-kefier rabbitmq Running 0 500m / 500m 512Mi / 512Mi data:1Gi aks-cicdamdpool-38368475-vmss000006/10.224.0.10 Sep 01,2025 11:26 UTC+0800 rabbitmq-kefier-rabbitmq-2 ns-lhngm rabbitmq-kefier rabbitmq Running 0 500m / 500m 512Mi / 512Mi data:1Gi aks-cicdamdpool-38368475-vmss000006/10.224.0.10 Sep 01,2025 11:28 UTC+0800 check pod status done `kubectl get secrets -l app.kubernetes.io/instance=rabbitmq-kefier` `kubectl get secrets rabbitmq-kefier-rabbitmq-account-root -o jsonpath="***.data.username***"` `kubectl get secrets rabbitmq-kefier-rabbitmq-account-root -o jsonpath="***.data.password***"` `kubectl get secrets rabbitmq-kefier-rabbitmq-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:3MQm57K36H2P7i3d;DB_PORT:15672;DB_DATABASE: check cluster connect `echo "rabbitmqadmin -H rabbitmq-kefier-rabbitmq.ns-lhngm.svc.cluster.local -u root -p '3MQm57K36H2P7i3d' -P 15672 show overview " | kubectl exec -it rabbitmq-kefier-rabbitmq-0 --namespace ns-lhngm -- bash` check cluster connect done `kubectl get secrets -l app.kubernetes.io/instance=rabbitmq-kefier` `kubectl get secrets rabbitmq-kefier-rabbitmq-account-root -o jsonpath="***.data.username***"` `kubectl get secrets rabbitmq-kefier-rabbitmq-account-root -o jsonpath="***.data.password***"` `kubectl get secrets rabbitmq-kefier-rabbitmq-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:3MQm57K36H2P7i3d;DB_PORT:15672;DB_DATABASE: check pod rabbitmq-kefier-rabbitmq-0 container_name rabbitmq exist password 3MQm57K36H2P7i3d check pod rabbitmq-kefier-rabbitmq-0 container_name lorry exist password 3MQm57K36H2P7i3d No container logs contain secret password. describe cluster `kbcli cluster describe rabbitmq-kefier --namespace ns-lhngm ` Name: rabbitmq-kefier Created Time: Sep 01,2025 11:24 UTC+0800 NAMESPACE CLUSTER-DEFINITION VERSION STATUS TERMINATION-POLICY ns-lhngm Running WipeOut Endpoints: COMPONENT MODE INTERNAL EXTERNAL rabbitmq ReadWrite rabbitmq-kefier-rabbitmq.ns-lhngm.svc.cluster.local:5672 rabbitmq-kefier-rabbitmq.ns-lhngm.svc.cluster.local:15672 Topology: COMPONENT INSTANCE ROLE STATUS AZ NODE CREATED-TIME rabbitmq rabbitmq-kefier-rabbitmq-0 Running 0 aks-cicdamdpool-38368475-vmss000000/10.224.0.5 Sep 01,2025 11:24 UTC+0800 rabbitmq rabbitmq-kefier-rabbitmq-1 Running 0 aks-cicdamdpool-38368475-vmss000006/10.224.0.10 Sep 01,2025 11:26 UTC+0800 rabbitmq rabbitmq-kefier-rabbitmq-2 Running 0 aks-cicdamdpool-38368475-vmss000006/10.224.0.10 Sep 01,2025 11:28 UTC+0800 Resources Allocation: COMPONENT DEDICATED CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE-SIZE STORAGE-CLASS rabbitmq false 500m / 500m 512Mi / 512Mi data:1Gi default Images: COMPONENT TYPE IMAGE rabbitmq docker.io/apecloud/rabbitmq:3.13.7-management Show cluster events: kbcli cluster list-events -n ns-lhngm rabbitmq-kefier `kbcli cluster label rabbitmq-kefier app.kubernetes.io/instance- --namespace ns-lhngm ` label "app.kubernetes.io/instance" not found. `kbcli cluster label rabbitmq-kefier app.kubernetes.io/instance=rabbitmq-kefier --namespace ns-lhngm ` `kbcli cluster label rabbitmq-kefier --list --namespace ns-lhngm ` NAME NAMESPACE LABELS rabbitmq-kefier ns-lhngm app.kubernetes.io/instance=rabbitmq-kefier label cluster app.kubernetes.io/instance=rabbitmq-kefier Success `kbcli cluster label case.name=kbcli.test1 -l app.kubernetes.io/instance=rabbitmq-kefier --namespace ns-lhngm ` `kbcli cluster label rabbitmq-kefier --list --namespace ns-lhngm ` NAME NAMESPACE LABELS rabbitmq-kefier ns-lhngm app.kubernetes.io/instance=rabbitmq-kefier case.name=kbcli.test1 label cluster case.name=kbcli.test1 Success `kbcli cluster label rabbitmq-kefier case.name=kbcli.test2 --overwrite --namespace ns-lhngm ` `kbcli cluster label rabbitmq-kefier --list --namespace ns-lhngm ` NAME NAMESPACE LABELS rabbitmq-kefier ns-lhngm app.kubernetes.io/instance=rabbitmq-kefier case.name=kbcli.test2 label cluster case.name=kbcli.test2 Success `kbcli cluster label rabbitmq-kefier case.name- --namespace ns-lhngm ` `kbcli cluster label rabbitmq-kefier --list --namespace ns-lhngm ` NAME NAMESPACE LABELS rabbitmq-kefier ns-lhngm app.kubernetes.io/instance=rabbitmq-kefier delete cluster label case.name Success cluster connect `kubectl get secrets -l app.kubernetes.io/instance=rabbitmq-kefier` `kubectl get secrets rabbitmq-kefier-rabbitmq-account-root -o jsonpath="***.data.username***"` `kubectl get secrets rabbitmq-kefier-rabbitmq-account-root -o jsonpath="***.data.password***"` `kubectl get secrets rabbitmq-kefier-rabbitmq-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:3MQm57K36H2P7i3d;DB_PORT:15672;DB_DATABASE: `echo "rabbitmqadmin -H rabbitmq-kefier-rabbitmq.ns-lhngm.svc.cluster.local -u root -p '3MQm57K36H2P7i3d' -P 15672 list nodes" | kubectl exec -it rabbitmq-kefier-rabbitmq-0 --namespace ns-lhngm -- bash ` Defaulted container "rabbitmq" out of: rabbitmq, lorry, init-lorry (init) Unable to use a TTY - input is not a terminal or the right kind of file +------------------------------------------------------------------------------+------+-----------+ | name | type | mem_used | +------------------------------------------------------------------------------+------+-----------+ | rabbit@rabbitmq-kefier-rabbitmq-0.rabbitmq-kefier-rabbitmq-headless.ns-lhngm | disc | 165236736 | | rabbit@rabbitmq-kefier-rabbitmq-1.rabbitmq-kefier-rabbitmq-headless.ns-lhngm | disc | 162947072 | | rabbit@rabbitmq-kefier-rabbitmq-2.rabbitmq-kefier-rabbitmq-headless.ns-lhngm | disc | 166334464 | +------------------------------------------------------------------------------+------+-----------+ connect cluster Success insert batch data by db client Error from server (NotFound): pods "test-db-client-executionloop-rabbitmq-kefier" not found DB_CLIENT_BATCH_DATA_COUNT: `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge pods test-db-client-executionloop-rabbitmq-kefier --namespace ns-lhngm ` Error from server (NotFound): pods "test-db-client-executionloop-rabbitmq-kefier" not found Warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely. Error from server (NotFound): pods "test-db-client-executionloop-rabbitmq-kefier" not found `kubectl get secrets -l app.kubernetes.io/instance=rabbitmq-kefier` `kubectl get secrets rabbitmq-kefier-rabbitmq-account-root -o jsonpath="***.data.username***"` `kubectl get secrets rabbitmq-kefier-rabbitmq-account-root -o jsonpath="***.data.password***"` `kubectl get secrets rabbitmq-kefier-rabbitmq-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:3MQm57K36H2P7i3d;DB_PORT:15672;DB_DATABASE: apiVersion: v1 kind: Pod metadata: name: test-db-client-executionloop-rabbitmq-kefier namespace: ns-lhngm spec: containers: - name: test-dbclient imagePullPolicy: IfNotPresent image: docker.io/apecloud/dbclient:test args: - "--host" - "rabbitmq-kefier-rabbitmq.ns-lhngm.svc.cluster.local" - "--user" - "root" - "--password" - "3MQm57K36H2P7i3d" - "--port" - "5672" - "--dbtype" - "rabbitmq" - "--test" - "executionloop" - "--duration" - "60" - "--interval" - "1" restartPolicy: Never `kubectl apply -f test-db-client-executionloop-rabbitmq-kefier.yaml` pod/test-db-client-executionloop-rabbitmq-kefier created apply test-db-client-executionloop-rabbitmq-kefier.yaml Success `rm -rf test-db-client-executionloop-rabbitmq-kefier.yaml` check pod status pod_status:NAME READY STATUS RESTARTS AGE test-db-client-executionloop-rabbitmq-kefier 1/1 Running 0 6s pod_status:NAME READY STATUS RESTARTS AGE test-db-client-executionloop-rabbitmq-kefier 1/1 Running 0 10s pod_status:NAME READY STATUS RESTARTS AGE test-db-client-executionloop-rabbitmq-kefier 1/1 Running 0 15s pod_status:NAME READY STATUS RESTARTS AGE test-db-client-executionloop-rabbitmq-kefier 1/1 Running 0 20s pod_status:NAME READY STATUS RESTARTS AGE test-db-client-executionloop-rabbitmq-kefier 1/1 Running 0 25s pod_status:NAME READY STATUS RESTARTS AGE test-db-client-executionloop-rabbitmq-kefier 1/1 Running 0 30s pod_status:NAME READY STATUS RESTARTS AGE test-db-client-executionloop-rabbitmq-kefier 1/1 Running 0 35s pod_status:NAME READY STATUS RESTARTS AGE test-db-client-executionloop-rabbitmq-kefier 1/1 Running 0 41s pod_status:NAME READY STATUS RESTARTS AGE test-db-client-executionloop-rabbitmq-kefier 1/1 Running 0 46s pod_status:NAME READY STATUS RESTARTS AGE test-db-client-executionloop-rabbitmq-kefier 1/1 Running 0 51s pod_status:NAME READY STATUS RESTARTS AGE test-db-client-executionloop-rabbitmq-kefier 1/1 Running 0 56s pod_status:NAME READY STATUS RESTARTS AGE test-db-client-executionloop-rabbitmq-kefier 1/1 Running 0 61s pod_status:NAME READY STATUS RESTARTS AGE test-db-client-executionloop-rabbitmq-kefier 1/1 Running 0 66s pod_status:NAME READY STATUS RESTARTS AGE test-db-client-executionloop-rabbitmq-kefier 1/1 Running 0 71s pod_status:NAME READY STATUS RESTARTS AGE test-db-client-executionloop-rabbitmq-kefier 1/1 Running 0 76s pod_status:NAME READY STATUS RESTARTS AGE test-db-client-executionloop-rabbitmq-kefier 1/1 Running 0 82s pod_status:NAME READY STATUS RESTARTS AGE test-db-client-executionloop-rabbitmq-kefier 1/1 Running 0 87s pod_status:NAME READY STATUS RESTARTS AGE test-db-client-executionloop-rabbitmq-kefier 1/1 Running 0 92s pod_status:NAME READY STATUS RESTARTS AGE test-db-client-executionloop-rabbitmq-kefier 1/1 Running 0 97s pod_status:NAME READY STATUS RESTARTS AGE test-db-client-executionloop-rabbitmq-kefier 1/1 Running 0 102s pod_status:NAME READY STATUS RESTARTS AGE test-db-client-executionloop-rabbitmq-kefier 1/1 Running 0 107s pod_status:NAME READY STATUS RESTARTS AGE test-db-client-executionloop-rabbitmq-kefier 1/1 Running 0 112s pod_status:NAME READY STATUS RESTARTS AGE test-db-client-executionloop-rabbitmq-kefier 1/1 Running 0 118s pod_status:NAME READY STATUS RESTARTS AGE test-db-client-executionloop-rabbitmq-kefier 1/1 Running 0 2m3s pod_status:NAME READY STATUS RESTARTS AGE test-db-client-executionloop-rabbitmq-kefier 1/1 Running 0 2m8s pod_status:NAME READY STATUS RESTARTS AGE test-db-client-executionloop-rabbitmq-kefier 1/1 Running 0 2m13s pod_status:NAME READY STATUS RESTARTS AGE test-db-client-executionloop-rabbitmq-kefier 1/1 Running 0 2m18s pod_status:NAME READY STATUS RESTARTS AGE test-db-client-executionloop-rabbitmq-kefier 1/1 Running 0 2m23s pod_status:NAME READY STATUS RESTARTS AGE test-db-client-executionloop-rabbitmq-kefier 1/1 Running 0 2m28s pod_status:NAME READY STATUS RESTARTS AGE test-db-client-executionloop-rabbitmq-kefier 1/1 Running 0 2m34s pod_status:NAME READY STATUS RESTARTS AGE test-db-client-executionloop-rabbitmq-kefier 1/1 Running 0 2m39s pod_status:NAME READY STATUS RESTARTS AGE test-db-client-executionloop-rabbitmq-kefier 1/1 Running 0 2m44s pod_status:NAME READY STATUS RESTARTS AGE test-db-client-executionloop-rabbitmq-kefier 1/1 Running 0 2m49s pod_status:NAME READY STATUS RESTARTS AGE test-db-client-executionloop-rabbitmq-kefier 1/1 Running 0 2m54s pod_status:NAME READY STATUS RESTARTS AGE test-db-client-executionloop-rabbitmq-kefier 1/1 Running 0 2m59s pod_status:NAME READY STATUS RESTARTS AGE test-db-client-executionloop-rabbitmq-kefier 1/1 Running 0 3m4s pod_status:NAME READY STATUS RESTARTS AGE test-db-client-executionloop-rabbitmq-kefier 1/1 Running 0 3m10s pod_status:NAME READY STATUS RESTARTS AGE test-db-client-executionloop-rabbitmq-kefier 1/1 Running 0 3m15s pod_status:NAME READY STATUS RESTARTS AGE test-db-client-executionloop-rabbitmq-kefier 1/1 Running 0 3m20s pod_status:NAME READY STATUS RESTARTS AGE test-db-client-executionloop-rabbitmq-kefier 1/1 Running 0 3m25s pod_status:NAME READY STATUS RESTARTS AGE test-db-client-executionloop-rabbitmq-kefier 1/1 Running 0 3m30s pod_status:NAME READY STATUS RESTARTS AGE test-db-client-executionloop-rabbitmq-kefier 1/1 Running 0 3m35s pod_status:NAME READY STATUS RESTARTS AGE test-db-client-executionloop-rabbitmq-kefier 1/1 Running 0 3m41s pod_status:NAME READY STATUS RESTARTS AGE test-db-client-executionloop-rabbitmq-kefier 1/1 Running 0 3m46s pod_status:NAME READY STATUS RESTARTS AGE test-db-client-executionloop-rabbitmq-kefier 1/1 Running 0 3m51s pod_status:NAME READY STATUS RESTARTS AGE test-db-client-executionloop-rabbitmq-kefier 1/1 Running 0 3m56s pod_status:NAME READY STATUS RESTARTS AGE test-db-client-executionloop-rabbitmq-kefier 1/1 Running 0 4m1s pod_status:NAME READY STATUS RESTARTS AGE test-db-client-executionloop-rabbitmq-kefier 1/1 Running 0 4m6s pod_status:NAME READY STATUS RESTARTS AGE test-db-client-executionloop-rabbitmq-kefier 1/1 Running 0 4m11s pod_status:NAME READY STATUS RESTARTS AGE test-db-client-executionloop-rabbitmq-kefier 1/1 Running 0 4m17s pod_status:NAME READY STATUS RESTARTS AGE test-db-client-executionloop-rabbitmq-kefier 1/1 Running 0 4m22s pod_status:NAME READY STATUS RESTARTS AGE test-db-client-executionloop-rabbitmq-kefier 1/1 Running 0 4m27s pod_status:NAME READY STATUS RESTARTS AGE test-db-client-executionloop-rabbitmq-kefier 1/1 Running 0 4m32s pod_status:NAME READY STATUS RESTARTS AGE test-db-client-executionloop-rabbitmq-kefier 1/1 Running 0 4m37s pod_status:NAME READY STATUS RESTARTS AGE test-db-client-executionloop-rabbitmq-kefier 1/1 Running 0 4m42s pod_status:NAME READY STATUS RESTARTS AGE test-db-client-executionloop-rabbitmq-kefier 1/1 Running 0 4m47s pod_status:NAME READY STATUS RESTARTS AGE test-db-client-executionloop-rabbitmq-kefier 1/1 Running 0 4m53s pod_status:NAME READY STATUS RESTARTS AGE test-db-client-executionloop-rabbitmq-kefier 1/1 Running 0 4m58s pod_status:NAME READY STATUS RESTARTS AGE test-db-client-executionloop-rabbitmq-kefier 1/1 Running 0 5m3s pod_status:NAME READY STATUS RESTARTS AGE test-db-client-executionloop-rabbitmq-kefier 1/1 Running 0 5m8s pod_status:NAME READY STATUS RESTARTS AGE test-db-client-executionloop-rabbitmq-kefier 1/1 Running 0 5m13s check pod test-db-client-executionloop-rabbitmq-kefier status timeout --------------------------------------get pod test-db-client-executionloop-rabbitmq-kefier yaml-------------------------------------- `kubectl get pod test-db-client-executionloop-rabbitmq-kefier -o yaml --namespace ns-lhngm ` apiVersion: v1 kind: Pod metadata: annotations: kubectl.kubernetes.io/last-applied-configuration: | ***"apiVersion":"v1","kind":"Pod","metadata":***"annotations":***,"name":"test-db-client-executionloop-rabbitmq-kefier","namespace":"ns-lhngm"***,"spec":***"containers":[***"args":["--host","rabbitmq-kefier-rabbitmq.ns-lhngm.svc.cluster.local","--user","root","--password","3MQm57K36H2P7i3d","--port","5672","--dbtype","rabbitmq","--test","executionloop","--duration","60","--interval","1"],"image":"docker.io/apecloud/dbclient:test","imagePullPolicy":"IfNotPresent","name":"test-dbclient"***],"restartPolicy":"Never"*** creationTimestamp: "2025-09-01T03:30:24Z" name: test-db-client-executionloop-rabbitmq-kefier namespace: ns-lhngm resourceVersion: "23420" uid: f4f70029-7e22-4d05-9b37-7af6b4fb321b spec: containers: - args: - --host - rabbitmq-kefier-rabbitmq.ns-lhngm.svc.cluster.local - --user - root - --password - 3MQm57K36H2P7i3d - --port - "5672" - --dbtype - rabbitmq - --test - executionloop - --duration - "60" - --interval - "1" image: docker.io/apecloud/dbclient:test imagePullPolicy: IfNotPresent name: test-dbclient resources: *** terminationMessagePath: /dev/termination-log terminationMessagePolicy: File volumeMounts: - mountPath: /var/run/secrets/kubernetes.io/serviceaccount name: kube-api-access-zkkhs readOnly: true dnsPolicy: ClusterFirst enableServiceLinks: true nodeName: aks-cicdamdpool-38368475-vmss000006 preemptionPolicy: PreemptLowerPriority priority: 0 restartPolicy: Never schedulerName: default-scheduler securityContext: *** serviceAccount: default serviceAccountName: default terminationGracePeriodSeconds: 30 tolerations: - effect: NoExecute key: node.kubernetes.io/not-ready operator: Exists tolerationSeconds: 300 - effect: NoExecute key: node.kubernetes.io/unreachable operator: Exists tolerationSeconds: 300 volumes: - name: kube-api-access-zkkhs projected: defaultMode: 420 sources: - serviceAccountToken: expirationSeconds: 3607 path: token - configMap: items: - key: ca.crt path: ca.crt name: kube-root-ca.crt - downwardAPI: items: - fieldRef: apiVersion: v1 fieldPath: metadata.namespace path: namespace status: conditions: - lastProbeTime: null lastTransitionTime: "2025-09-01T03:30:26Z" status: "True" type: PodReadyToStartContainers - lastProbeTime: null lastTransitionTime: "2025-09-01T03:30:24Z" status: "True" type: Initialized - lastProbeTime: null lastTransitionTime: "2025-09-01T03:30:26Z" status: "True" type: Ready - lastProbeTime: null lastTransitionTime: "2025-09-01T03:30:26Z" status: "True" type: ContainersReady - lastProbeTime: null lastTransitionTime: "2025-09-01T03:30:24Z" status: "True" type: PodScheduled containerStatuses: - containerID: containerd://ea2f02e00125fb2446c40975c7708629059bc657ceffeede21fe5ada77cbf931 image: docker.io/apecloud/dbclient:test imageID: docker.io/apecloud/dbclient@sha256:6d32d449788e773a6752c7d724e94a02514804c479bdb5947621426175339bd0 lastState: *** name: test-dbclient ready: true restartCount: 0 started: true state: running: startedAt: "2025-09-01T03:30:25Z" volumeMounts: - mountPath: /var/run/secrets/kubernetes.io/serviceaccount name: kube-api-access-zkkhs readOnly: true recursiveReadOnly: Disabled hostIP: 10.224.0.10 hostIPs: - ip: 10.224.0.10 phase: Running podIP: 10.244.1.49 podIPs: - ip: 10.244.1.49 qosClass: BestEffort startTime: "2025-09-01T03:30:24Z" ------------------------------------------------------------------------------------------------------------------ --------------------------------------describe pod test-db-client-executionloop-rabbitmq-kefier-------------------------------------- `kubectl describe pod test-db-client-executionloop-rabbitmq-kefier --namespace ns-lhngm ` Name: test-db-client-executionloop-rabbitmq-kefier Namespace: ns-lhngm Priority: 0 Service Account: default Node: aks-cicdamdpool-38368475-vmss000006/10.224.0.10 Start Time: Mon, 01 Sep 2025 11:30:24 +0800 Labels: Annotations: Status: Running IP: 10.244.1.49 IPs: IP: 10.244.1.49 Containers: test-dbclient: Container ID: containerd://ea2f02e00125fb2446c40975c7708629059bc657ceffeede21fe5ada77cbf931 Image: docker.io/apecloud/dbclient:test Image ID: docker.io/apecloud/dbclient@sha256:6d32d449788e773a6752c7d724e94a02514804c479bdb5947621426175339bd0 Port: Host Port: Args: --host rabbitmq-kefier-rabbitmq.ns-lhngm.svc.cluster.local --user root --password 3MQm57K36H2P7i3d --port 5672 --dbtype rabbitmq --test executionloop --duration 60 --interval 1 State: Running Started: Mon, 01 Sep 2025 11:30:25 +0800 Ready: True Restart Count: 0 Environment: Mounts: /var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-zkkhs (ro) Conditions: Type Status PodReadyToStartContainers True Initialized True Ready True ContainersReady True PodScheduled True Volumes: kube-api-access-zkkhs: Type: Projected (a volume that contains injected data from multiple sources) TokenExpirationSeconds: 3607 ConfigMapName: kube-root-ca.crt ConfigMapOptional: DownwardAPI: true QoS Class: BestEffort Node-Selectors: Tolerations: node.kubernetes.io/not-ready:NoExecute op=Exists for 300s node.kubernetes.io/unreachable:NoExecute op=Exists for 300s Events: Type Reason Age From Message ---- ------ ---- ---- ------- Normal Scheduled 5m14s default-scheduler Successfully assigned ns-lhngm/test-db-client-executionloop-rabbitmq-kefier to aks-cicdamdpool-38368475-vmss000006 Normal Pulled 5m13s kubelet Container image "docker.io/apecloud/dbclient:test" already present on machine Normal Created 5m13s kubelet Created container: test-dbclient Normal Started 5m13s kubelet Started container test-dbclient ------------------------------------------------------------------------------------------------------------------ --------------------------------------pod test-db-client-executionloop-rabbitmq-kefier-------------------------------------- `kubectl logs test-db-client-executionloop-rabbitmq-kefier --namespace ns-lhngm --tail 500` --host rabbitmq-kefier-rabbitmq.ns-lhngm.svc.cluster.local --user root --password 3MQm57K36H2P7i3d --port 5672 --dbtype rabbitmq --test executionloop --duration 60 --interval 1 SLF4J(I): Connected with provider of type [ch.qos.logback.classic.spi.LogbackServiceProvider] Execution loop start: Queue executions_loop_queue created successfully. Queue executions_loop_queue deleted successfully. Queue executions_loop_queue recreated successfully. Execution loop start:***"operation":"publish","queue":"executions_loop_queue","message":"executions_loop_message_1"*** [ 1s ] executions total: 12648 successful: 12648 failed: 0 disconnect: 0 ------------------------------------------------------------------------------------------------------------------ check cluster status `kbcli cluster list rabbitmq-kefier --show-labels --namespace ns-lhngm ` NAME NAMESPACE CLUSTER-DEFINITION VERSION TERMINATION-POLICY STATUS CREATED-TIME LABELS rabbitmq-kefier ns-lhngm WipeOut Running Sep 01,2025 11:24 UTC+0800 app.kubernetes.io/instance=rabbitmq-kefier check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances rabbitmq-kefier --namespace ns-lhngm ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME rabbitmq-kefier-rabbitmq-0 ns-lhngm rabbitmq-kefier rabbitmq Running 0 500m / 500m 512Mi / 512Mi data:1Gi aks-cicdamdpool-38368475-vmss000000/10.224.0.5 Sep 01,2025 11:24 UTC+0800 rabbitmq-kefier-rabbitmq-1 ns-lhngm rabbitmq-kefier rabbitmq Running 0 500m / 500m 512Mi / 512Mi data:1Gi aks-cicdamdpool-38368475-vmss000006/10.224.0.10 Sep 01,2025 11:26 UTC+0800 rabbitmq-kefier-rabbitmq-2 ns-lhngm rabbitmq-kefier rabbitmq Running 0 500m / 500m 512Mi / 512Mi data:1Gi aks-cicdamdpool-38368475-vmss000006/10.224.0.10 Sep 01,2025 11:28 UTC+0800 check pod status done `kubectl get secrets -l app.kubernetes.io/instance=rabbitmq-kefier` `kubectl get secrets rabbitmq-kefier-rabbitmq-account-root -o jsonpath="***.data.username***"` `kubectl get secrets rabbitmq-kefier-rabbitmq-account-root -o jsonpath="***.data.password***"` `kubectl get secrets rabbitmq-kefier-rabbitmq-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:3MQm57K36H2P7i3d;DB_PORT:15672;DB_DATABASE: check cluster connect `echo "rabbitmqadmin -H rabbitmq-kefier-rabbitmq.ns-lhngm.svc.cluster.local -u root -p '3MQm57K36H2P7i3d' -P 15672 show overview " | kubectl exec -it rabbitmq-kefier-rabbitmq-0 --namespace ns-lhngm -- bash` check cluster connect done --host rabbitmq-kefier-rabbitmq.ns-lhngm.svc.cluster.local --user root --password 3MQm57K36H2P7i3d --port 5672 --dbtype rabbitmq --test executionloop --duration 60 --interval 1 SLF4J(I): Connected with provider of type [ch.qos.logback.classic.spi.LogbackServiceProvider] Execution loop start: Queue executions_loop_queue created successfully. Queue executions_loop_queue deleted successfully. Queue executions_loop_queue recreated successfully. Execution loop start:***"operation":"publish","queue":"executions_loop_queue","message":"executions_loop_message_1"*** [ 1s ] executions total: 12648 successful: 12648 failed: 0 disconnect: 0 DB_CLIENT_BATCH_DATA_COUNT: `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge pods test-db-client-executionloop-rabbitmq-kefier --namespace ns-lhngm ` pod/test-db-client-executionloop-rabbitmq-kefier patched (no change) Warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely. pod "test-db-client-executionloop-rabbitmq-kefier" force deleted cluster vscale check cluster status before ops check cluster status done cluster_status:Running `kbcli cluster vscale rabbitmq-kefier --auto-approve --force=true --components rabbitmq --cpu 600m --memory 0.6Gi --namespace ns-lhngm ` OpsRequest rabbitmq-kefier-verticalscaling-c4k2q created successfully, you can view the progress: kbcli cluster describe-ops rabbitmq-kefier-verticalscaling-c4k2q -n ns-lhngm check ops status `kbcli cluster list-ops rabbitmq-kefier --status all --namespace ns-lhngm ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME rabbitmq-kefier-verticalscaling-c4k2q ns-lhngm VerticalScaling rabbitmq-kefier rabbitmq Pending -/- Sep 01,2025 11:35 UTC+0800 check cluster status `kbcli cluster list rabbitmq-kefier --show-labels --namespace ns-lhngm ` NAME NAMESPACE CLUSTER-DEFINITION VERSION TERMINATION-POLICY STATUS CREATED-TIME LABELS rabbitmq-kefier ns-lhngm WipeOut Updating Sep 01,2025 11:24 UTC+0800 app.kubernetes.io/instance=rabbitmq-kefier cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Abnormal cluster_status:Abnormal cluster_status:Abnormal cluster_status:Abnormal cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances rabbitmq-kefier --namespace ns-lhngm ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME rabbitmq-kefier-rabbitmq-0 ns-lhngm rabbitmq-kefier rabbitmq Running 0 600m / 600m 644245094400m / 644245094400m data:1Gi aks-cicdamdpool-38368475-vmss000000/10.224.0.5 Sep 01,2025 11:38 UTC+0800 rabbitmq-kefier-rabbitmq-1 ns-lhngm rabbitmq-kefier rabbitmq Running 0 600m / 600m 644245094400m / 644245094400m data:1Gi aks-cicdamdpool-38368475-vmss000006/10.224.0.10 Sep 01,2025 11:37 UTC+0800 rabbitmq-kefier-rabbitmq-2 ns-lhngm rabbitmq-kefier rabbitmq Running 0 600m / 600m 644245094400m / 644245094400m data:1Gi aks-default-25371978-vmss000000/10.224.0.4 Sep 01,2025 11:35 UTC+0800 check pod status done `kubectl get secrets -l app.kubernetes.io/instance=rabbitmq-kefier` `kubectl get secrets rabbitmq-kefier-rabbitmq-account-root -o jsonpath="***.data.username***"` `kubectl get secrets rabbitmq-kefier-rabbitmq-account-root -o jsonpath="***.data.password***"` `kubectl get secrets rabbitmq-kefier-rabbitmq-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:3MQm57K36H2P7i3d;DB_PORT:15672;DB_DATABASE: check cluster connect `echo "rabbitmqadmin -H rabbitmq-kefier-rabbitmq.ns-lhngm.svc.cluster.local -u root -p '3MQm57K36H2P7i3d' -P 15672 show overview " | kubectl exec -it rabbitmq-kefier-rabbitmq-0 --namespace ns-lhngm -- bash` check cluster connect done check ops status `kbcli cluster list-ops rabbitmq-kefier --status all --namespace ns-lhngm ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME rabbitmq-kefier-verticalscaling-c4k2q ns-lhngm VerticalScaling rabbitmq-kefier rabbitmq Failed 3/3 Sep 01,2025 11:35 UTC+0800 check ops status done check opsrequest progress ops_status:rabbitmq-kefier-verticalscaling-c4k2q ns-lhngm VerticalScaling rabbitmq-kefier rabbitmq Failed 3/3 Sep 01,2025 11:35 UTC+0800 `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge opsrequests rabbitmq-kefier-verticalscaling-c4k2q --namespace ns-lhngm ` opsrequest.apps.kubeblocks.io/rabbitmq-kefier-verticalscaling-c4k2q patched `kbcli cluster delete-ops --name rabbitmq-kefier-verticalscaling-c4k2q --force --auto-approve --namespace ns-lhngm ` OpsRequest rabbitmq-kefier-verticalscaling-c4k2q deleted cluster update monitor cluster does not need to check monitor currently check cluster status `kbcli cluster list rabbitmq-kefier --show-labels --namespace ns-lhngm ` NAME NAMESPACE CLUSTER-DEFINITION VERSION TERMINATION-POLICY STATUS CREATED-TIME LABELS rabbitmq-kefier ns-lhngm WipeOut Running Sep 01,2025 11:24 UTC+0800 app.kubernetes.io/instance=rabbitmq-kefier check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances rabbitmq-kefier --namespace ns-lhngm ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME rabbitmq-kefier-rabbitmq-0 ns-lhngm rabbitmq-kefier rabbitmq Running 0 600m / 600m 644245094400m / 644245094400m data:1Gi aks-cicdamdpool-38368475-vmss000000/10.224.0.5 Sep 01,2025 11:38 UTC+0800 rabbitmq-kefier-rabbitmq-1 ns-lhngm rabbitmq-kefier rabbitmq Running 0 600m / 600m 644245094400m / 644245094400m data:1Gi aks-cicdamdpool-38368475-vmss000006/10.224.0.10 Sep 01,2025 11:37 UTC+0800 rabbitmq-kefier-rabbitmq-2 ns-lhngm rabbitmq-kefier rabbitmq Running 0 600m / 600m 644245094400m / 644245094400m data:1Gi aks-default-25371978-vmss000000/10.224.0.4 Sep 01,2025 11:35 UTC+0800 check pod status done `kubectl get secrets -l app.kubernetes.io/instance=rabbitmq-kefier` `kubectl get secrets rabbitmq-kefier-rabbitmq-account-root -o jsonpath="***.data.username***"` `kubectl get secrets rabbitmq-kefier-rabbitmq-account-root -o jsonpath="***.data.password***"` `kubectl get secrets rabbitmq-kefier-rabbitmq-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:3MQm57K36H2P7i3d;DB_PORT:15672;DB_DATABASE: check cluster connect `echo "rabbitmqadmin -H rabbitmq-kefier-rabbitmq.ns-lhngm.svc.cluster.local -u root -p '3MQm57K36H2P7i3d' -P 15672 show overview " | kubectl exec -it rabbitmq-kefier-rabbitmq-0 --namespace ns-lhngm -- bash` check cluster connect done test failover connectionstress check cluster status before cluster-failover-connectionstress check cluster status done cluster_status:Running check node drain check node drain success Error from server (NotFound): pods "test-db-client-connectionstress-rabbitmq-kefier" not found `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge pods test-db-client-connectionstress-rabbitmq-kefier --namespace ns-lhngm ` Error from server (NotFound): pods "test-db-client-connectionstress-rabbitmq-kefier" not found Warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely. Error from server (NotFound): pods "test-db-client-connectionstress-rabbitmq-kefier" not found `kubectl get secrets -l app.kubernetes.io/instance=rabbitmq-kefier` `kubectl get secrets rabbitmq-kefier-rabbitmq-account-root -o jsonpath="***.data.username***"` `kubectl get secrets rabbitmq-kefier-rabbitmq-account-root -o jsonpath="***.data.password***"` `kubectl get secrets rabbitmq-kefier-rabbitmq-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:3MQm57K36H2P7i3d;DB_PORT:15672;DB_DATABASE: apiVersion: v1 kind: Pod metadata: name: test-db-client-connectionstress-rabbitmq-kefier namespace: ns-lhngm spec: containers: - name: test-dbclient imagePullPolicy: IfNotPresent image: docker.io/apecloud/dbclient:test args: - "--host" - "rabbitmq-kefier-rabbitmq.ns-lhngm.svc.cluster.local" - "--user" - "root" - "--password" - "3MQm57K36H2P7i3d" - "--port" - "5672" - "--database" - "" - "--dbtype" - "rabbitmq" - "--test" - "connectionstress" - "--connections" - "5000" - "--duration" - "60" restartPolicy: Never `kubectl apply -f test-db-client-connectionstress-rabbitmq-kefier.yaml` pod/test-db-client-connectionstress-rabbitmq-kefier created apply test-db-client-connectionstress-rabbitmq-kefier.yaml Success `rm -rf test-db-client-connectionstress-rabbitmq-kefier.yaml` check pod status pod_status:NAME READY STATUS RESTARTS AGE test-db-client-connectionstress-rabbitmq-kefier 1/1 Running 0 5s pod_status:NAME READY STATUS RESTARTS AGE test-db-client-connectionstress-rabbitmq-kefier 1/1 Running 0 10s pod_status:NAME READY STATUS RESTARTS AGE test-db-client-connectionstress-rabbitmq-kefier 1/1 Running 0 15s pod_status:NAME READY STATUS RESTARTS AGE test-db-client-connectionstress-rabbitmq-kefier 1/1 Running 0 20s pod_status:NAME READY STATUS RESTARTS AGE test-db-client-connectionstress-rabbitmq-kefier 1/1 Running 0 25s pod_status:NAME READY STATUS RESTARTS AGE test-db-client-connectionstress-rabbitmq-kefier 1/1 Running 0 30s pod_status:NAME READY STATUS RESTARTS AGE test-db-client-connectionstress-rabbitmq-kefier 1/1 Running 0 35s pod_status:NAME READY STATUS RESTARTS AGE test-db-client-connectionstress-rabbitmq-kefier 1/1 Running 0 40s pod_status:NAME READY STATUS RESTARTS AGE test-db-client-connectionstress-rabbitmq-kefier 1/1 Running 0 46s pod_status:NAME READY STATUS RESTARTS AGE test-db-client-connectionstress-rabbitmq-kefier 1/1 Running 0 51s pod_status:NAME READY STATUS RESTARTS AGE test-db-client-connectionstress-rabbitmq-kefier 1/1 Running 0 56s pod_status:NAME READY STATUS RESTARTS AGE test-db-client-connectionstress-rabbitmq-kefier 1/1 Running 0 61s pod_status:NAME READY STATUS RESTARTS AGE test-db-client-connectionstress-rabbitmq-kefier 1/1 Running 0 66s pod_status:NAME READY STATUS RESTARTS AGE test-db-client-connectionstress-rabbitmq-kefier 1/1 Running 0 71s pod_status:NAME READY STATUS RESTARTS AGE test-db-client-connectionstress-rabbitmq-kefier 1/1 Running 0 76s pod_status:NAME READY STATUS RESTARTS AGE test-db-client-connectionstress-rabbitmq-kefier 1/1 Running 0 82s pod_status:NAME READY STATUS RESTARTS AGE test-db-client-connectionstress-rabbitmq-kefier 1/1 Running 0 87s pod_status:NAME READY STATUS RESTARTS AGE test-db-client-connectionstress-rabbitmq-kefier 1/1 Running 0 92s check pod test-db-client-connectionstress-rabbitmq-kefier status done pod_status:NAME READY STATUS RESTARTS AGE test-db-client-connectionstress-rabbitmq-kefier 0/1 Completed 0 97s check cluster status `kbcli cluster list rabbitmq-kefier --show-labels --namespace ns-lhngm ` NAME NAMESPACE CLUSTER-DEFINITION VERSION TERMINATION-POLICY STATUS CREATED-TIME LABELS rabbitmq-kefier ns-lhngm WipeOut Running Sep 01,2025 11:24 UTC+0800 app.kubernetes.io/instance=rabbitmq-kefier check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances rabbitmq-kefier --namespace ns-lhngm ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME rabbitmq-kefier-rabbitmq-0 ns-lhngm rabbitmq-kefier rabbitmq Running 0 600m / 600m 644245094400m / 644245094400m data:1Gi aks-cicdamdpool-38368475-vmss000000/10.224.0.5 Sep 01,2025 11:38 UTC+0800 rabbitmq-kefier-rabbitmq-1 ns-lhngm rabbitmq-kefier rabbitmq Running 0 600m / 600m 644245094400m / 644245094400m data:1Gi aks-cicdamdpool-38368475-vmss000006/10.224.0.10 Sep 01,2025 11:37 UTC+0800 rabbitmq-kefier-rabbitmq-2 ns-lhngm rabbitmq-kefier rabbitmq Running 0 600m / 600m 644245094400m / 644245094400m data:1Gi aks-default-25371978-vmss000000/10.224.0.4 Sep 01,2025 11:35 UTC+0800 check pod status done `kubectl get secrets -l app.kubernetes.io/instance=rabbitmq-kefier` `kubectl get secrets rabbitmq-kefier-rabbitmq-account-root -o jsonpath="***.data.username***"` `kubectl get secrets rabbitmq-kefier-rabbitmq-account-root -o jsonpath="***.data.password***"` `kubectl get secrets rabbitmq-kefier-rabbitmq-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:3MQm57K36H2P7i3d;DB_PORT:15672;DB_DATABASE: check cluster connect `echo "rabbitmqadmin -H rabbitmq-kefier-rabbitmq.ns-lhngm.svc.cluster.local -u root -p '3MQm57K36H2P7i3d' -P 15672 show overview " | kubectl exec -it rabbitmq-kefier-rabbitmq-0 --namespace ns-lhngm -- bash` check cluster connect done --host rabbitmq-kefier-rabbitmq.ns-lhngm.svc.cluster.local --user root --password 3MQm57K36H2P7i3d --port 5672 --database --dbtype rabbitmq --test connectionstress --connections 5000 --duration 60 SLF4J(I): Connected with provider of type [ch.qos.logback.classic.spi.LogbackServiceProvider] Test Result: Connection stress test results: Duration: 60 seconds Successful connections: 5000 Failed connections: 0 Connection Information: Database Type: rabbitmq Host: rabbitmq-kefier-rabbitmq.ns-lhngm.svc.cluster.local Port: 5672 Database: Table: User: root Org: Access Mode: mysql Test Type: connectionstress Connection Count: 5000 Duration: 60 seconds `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge pods test-db-client-connectionstress-rabbitmq-kefier --namespace ns-lhngm ` pod/test-db-client-connectionstress-rabbitmq-kefier patched (no change) Warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely. pod "test-db-client-connectionstress-rabbitmq-kefier" force deleted check failover pod name failover pod name:rabbitmq-kefier-rabbitmq-0 failover connectionstress Success cluster stop check cluster status before ops check cluster status done cluster_status:Running `kbcli cluster stop rabbitmq-kefier --auto-approve --force=true --namespace ns-lhngm ` OpsRequest rabbitmq-kefier-stop-65qnl created successfully, you can view the progress: kbcli cluster describe-ops rabbitmq-kefier-stop-65qnl -n ns-lhngm check ops status `kbcli cluster list-ops rabbitmq-kefier --status all --namespace ns-lhngm ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME rabbitmq-kefier-stop-65qnl ns-lhngm Stop rabbitmq-kefier Pending -/- Sep 01,2025 11:40 UTC+0800 check cluster status `kbcli cluster list rabbitmq-kefier --show-labels --namespace ns-lhngm ` NAME NAMESPACE CLUSTER-DEFINITION VERSION TERMINATION-POLICY STATUS CREATED-TIME LABELS rabbitmq-kefier ns-lhngm WipeOut Stopping Sep 01,2025 11:24 UTC+0800 app.kubernetes.io/instance=rabbitmq-kefier cluster_status:Stopping cluster_status:Stopping check cluster status done cluster_status:Stopped check pod status `kbcli cluster list-instances rabbitmq-kefier --namespace ns-lhngm ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME check pod status done check ops status `kbcli cluster list-ops rabbitmq-kefier --status all --namespace ns-lhngm ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME rabbitmq-kefier-stop-65qnl ns-lhngm Stop rabbitmq-kefier rabbitmq Succeed 3/3 Sep 01,2025 11:40 UTC+0800 check ops status done ops_status:rabbitmq-kefier-stop-65qnl ns-lhngm Stop rabbitmq-kefier rabbitmq Succeed 3/3 Sep 01,2025 11:40 UTC+0800 `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge opsrequests rabbitmq-kefier-stop-65qnl --namespace ns-lhngm ` opsrequest.apps.kubeblocks.io/rabbitmq-kefier-stop-65qnl patched `kbcli cluster delete-ops --name rabbitmq-kefier-stop-65qnl --force --auto-approve --namespace ns-lhngm ` OpsRequest rabbitmq-kefier-stop-65qnl deleted cluster start check cluster status before ops check cluster status done cluster_status:Stopped `kbcli cluster start rabbitmq-kefier --force=true --namespace ns-lhngm ` OpsRequest rabbitmq-kefier-start-rtkxp created successfully, you can view the progress: kbcli cluster describe-ops rabbitmq-kefier-start-rtkxp -n ns-lhngm check ops status `kbcli cluster list-ops rabbitmq-kefier --status all --namespace ns-lhngm ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME rabbitmq-kefier-start-rtkxp ns-lhngm Start rabbitmq-kefier Sep 01,2025 11:41 UTC+0800 ops_status:rabbitmq-kefier-start-rtkxp ns-lhngm Start rabbitmq-kefier Creating -/- Sep 01,2025 11:41 UTC+0800 check cluster status `kbcli cluster list rabbitmq-kefier --show-labels --namespace ns-lhngm ` NAME NAMESPACE CLUSTER-DEFINITION VERSION TERMINATION-POLICY STATUS CREATED-TIME LABELS rabbitmq-kefier ns-lhngm WipeOut Updating Sep 01,2025 11:24 UTC+0800 app.kubernetes.io/instance=rabbitmq-kefier cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances rabbitmq-kefier --namespace ns-lhngm ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME rabbitmq-kefier-rabbitmq-0 ns-lhngm rabbitmq-kefier rabbitmq Running 0 600m / 600m 644245094400m / 644245094400m data:1Gi aks-cicdamdpool-38368475-vmss000007/10.224.0.9 Sep 01,2025 11:44 UTC+0800 rabbitmq-kefier-rabbitmq-1 ns-lhngm rabbitmq-kefier rabbitmq Running 0 600m / 600m 644245094400m / 644245094400m data:1Gi aks-cicdamdpool-38368475-vmss000006/10.224.0.10 Sep 01,2025 11:43 UTC+0800 rabbitmq-kefier-rabbitmq-2 ns-lhngm rabbitmq-kefier rabbitmq Running 0 600m / 600m 644245094400m / 644245094400m data:1Gi aks-cicdamdpool-38368475-vmss000000/10.224.0.5 Sep 01,2025 11:48 UTC+0800 check pod status done `kubectl get secrets -l app.kubernetes.io/instance=rabbitmq-kefier` `kubectl get secrets rabbitmq-kefier-rabbitmq-account-root -o jsonpath="***.data.username***"` `kubectl get secrets rabbitmq-kefier-rabbitmq-account-root -o jsonpath="***.data.password***"` `kubectl get secrets rabbitmq-kefier-rabbitmq-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:3MQm57K36H2P7i3d;DB_PORT:15672;DB_DATABASE: check cluster connect `echo "rabbitmqadmin -H rabbitmq-kefier-rabbitmq.ns-lhngm.svc.cluster.local -u root -p '3MQm57K36H2P7i3d' -P 15672 show overview " | kubectl exec -it rabbitmq-kefier-rabbitmq-0 --namespace ns-lhngm -- bash` check cluster connect done check ops status `kbcli cluster list-ops rabbitmq-kefier --status all --namespace ns-lhngm ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME rabbitmq-kefier-start-rtkxp ns-lhngm Start rabbitmq-kefier rabbitmq Succeed 3/3 Sep 01,2025 11:41 UTC+0800 check ops status done ops_status:rabbitmq-kefier-start-rtkxp ns-lhngm Start rabbitmq-kefier rabbitmq Succeed 3/3 Sep 01,2025 11:41 UTC+0800 `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge opsrequests rabbitmq-kefier-start-rtkxp --namespace ns-lhngm ` opsrequest.apps.kubeblocks.io/rabbitmq-kefier-start-rtkxp patched `kbcli cluster delete-ops --name rabbitmq-kefier-start-rtkxp --force --auto-approve --namespace ns-lhngm ` OpsRequest rabbitmq-kefier-start-rtkxp deleted cluster restart check cluster status before ops check cluster status done cluster_status:Running `kbcli cluster restart rabbitmq-kefier --auto-approve --force=true --namespace ns-lhngm ` OpsRequest rabbitmq-kefier-restart-clxfn created successfully, you can view the progress: kbcli cluster describe-ops rabbitmq-kefier-restart-clxfn -n ns-lhngm check ops status `kbcli cluster list-ops rabbitmq-kefier --status all --namespace ns-lhngm ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME rabbitmq-kefier-restart-clxfn ns-lhngm Restart rabbitmq-kefier rabbitmq Pending -/- Sep 01,2025 11:48 UTC+0800 check cluster status `kbcli cluster list rabbitmq-kefier --show-labels --namespace ns-lhngm ` NAME NAMESPACE CLUSTER-DEFINITION VERSION TERMINATION-POLICY STATUS CREATED-TIME LABELS rabbitmq-kefier ns-lhngm WipeOut Updating Sep 01,2025 11:24 UTC+0800 app.kubernetes.io/instance=rabbitmq-kefier cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Abnormal cluster_status:Abnormal cluster_status:Abnormal cluster_status:Abnormal cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances rabbitmq-kefier --namespace ns-lhngm ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME rabbitmq-kefier-rabbitmq-0 ns-lhngm rabbitmq-kefier rabbitmq Running 0 600m / 600m 644245094400m / 644245094400m data:1Gi aks-cicdamdpool-38368475-vmss000007/10.224.0.9 Sep 01,2025 11:50 UTC+0800 rabbitmq-kefier-rabbitmq-1 ns-lhngm rabbitmq-kefier rabbitmq Running 0 600m / 600m 644245094400m / 644245094400m data:1Gi aks-cicdamdpool-38368475-vmss000006/10.224.0.10 Sep 01,2025 11:50 UTC+0800 rabbitmq-kefier-rabbitmq-2 ns-lhngm rabbitmq-kefier rabbitmq Running 0 600m / 600m 644245094400m / 644245094400m data:1Gi aks-cicdamdpool-38368475-vmss000000/10.224.0.5 Sep 01,2025 11:49 UTC+0800 check pod status done `kubectl get secrets -l app.kubernetes.io/instance=rabbitmq-kefier` `kubectl get secrets rabbitmq-kefier-rabbitmq-account-root -o jsonpath="***.data.username***"` `kubectl get secrets rabbitmq-kefier-rabbitmq-account-root -o jsonpath="***.data.password***"` `kubectl get secrets rabbitmq-kefier-rabbitmq-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:3MQm57K36H2P7i3d;DB_PORT:15672;DB_DATABASE: check cluster connect `echo "rabbitmqadmin -H rabbitmq-kefier-rabbitmq.ns-lhngm.svc.cluster.local -u root -p '3MQm57K36H2P7i3d' -P 15672 show overview " | kubectl exec -it rabbitmq-kefier-rabbitmq-0 --namespace ns-lhngm -- bash` check cluster connect done check ops status `kbcli cluster list-ops rabbitmq-kefier --status all --namespace ns-lhngm ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME rabbitmq-kefier-restart-clxfn ns-lhngm Restart rabbitmq-kefier rabbitmq Failed 3/3 Sep 01,2025 11:48 UTC+0800 check ops status done check opsrequest progress ops_status:rabbitmq-kefier-restart-clxfn ns-lhngm Restart rabbitmq-kefier rabbitmq Failed 3/3 Sep 01,2025 11:48 UTC+0800 `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge opsrequests rabbitmq-kefier-restart-clxfn --namespace ns-lhngm ` opsrequest.apps.kubeblocks.io/rabbitmq-kefier-restart-clxfn patched `kbcli cluster delete-ops --name rabbitmq-kefier-restart-clxfn --force --auto-approve --namespace ns-lhngm ` OpsRequest rabbitmq-kefier-restart-clxfn deleted `kubectl get pvc -l app.kubernetes.io/instance=rabbitmq-kefier,apps.kubeblocks.io/component-name=rabbitmq,apps.kubeblocks.io/vct-name=data --namespace ns-lhngm ` cluster volume-expand check cluster status before ops check cluster status done cluster_status:Running No resources found in rabbitmq-kefier namespace. `kbcli cluster volume-expand rabbitmq-kefier --auto-approve --force=true --components rabbitmq --volume-claim-templates data --storage 4Gi --namespace ns-lhngm ` OpsRequest rabbitmq-kefier-volumeexpansion-dhzpd created successfully, you can view the progress: kbcli cluster describe-ops rabbitmq-kefier-volumeexpansion-dhzpd -n ns-lhngm check ops status `kbcli cluster list-ops rabbitmq-kefier --status all --namespace ns-lhngm ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME rabbitmq-kefier-volumeexpansion-dhzpd ns-lhngm VolumeExpansion rabbitmq-kefier rabbitmq Pending -/- Sep 01,2025 11:52 UTC+0800 check cluster status `kbcli cluster list rabbitmq-kefier --show-labels --namespace ns-lhngm ` NAME NAMESPACE CLUSTER-DEFINITION VERSION TERMINATION-POLICY STATUS CREATED-TIME LABELS rabbitmq-kefier ns-lhngm WipeOut Updating Sep 01,2025 11:24 UTC+0800 app.kubernetes.io/instance=rabbitmq-kefier cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances rabbitmq-kefier --namespace ns-lhngm ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME rabbitmq-kefier-rabbitmq-0 ns-lhngm rabbitmq-kefier rabbitmq Running 0 600m / 600m 644245094400m / 644245094400m data:4Gi aks-cicdamdpool-38368475-vmss000007/10.224.0.9 Sep 01,2025 11:50 UTC+0800 rabbitmq-kefier-rabbitmq-1 ns-lhngm rabbitmq-kefier rabbitmq Running 0 600m / 600m 644245094400m / 644245094400m data:4Gi aks-cicdamdpool-38368475-vmss000006/10.224.0.10 Sep 01,2025 11:50 UTC+0800 rabbitmq-kefier-rabbitmq-2 ns-lhngm rabbitmq-kefier rabbitmq Running 0 600m / 600m 644245094400m / 644245094400m data:4Gi aks-cicdamdpool-38368475-vmss000007/10.224.0.9 Sep 01,2025 11:55 UTC+0800 check pod status done `kubectl get secrets -l app.kubernetes.io/instance=rabbitmq-kefier` `kubectl get secrets rabbitmq-kefier-rabbitmq-account-root -o jsonpath="***.data.username***"` `kubectl get secrets rabbitmq-kefier-rabbitmq-account-root -o jsonpath="***.data.password***"` `kubectl get secrets rabbitmq-kefier-rabbitmq-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:3MQm57K36H2P7i3d;DB_PORT:15672;DB_DATABASE: check cluster connect `echo "rabbitmqadmin -H rabbitmq-kefier-rabbitmq.ns-lhngm.svc.cluster.local -u root -p '3MQm57K36H2P7i3d' -P 15672 show overview " | kubectl exec -it rabbitmq-kefier-rabbitmq-0 --namespace ns-lhngm -- bash` check cluster connect done No resources found in rabbitmq-kefier namespace. check ops status `kbcli cluster list-ops rabbitmq-kefier --status all --namespace ns-lhngm ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME rabbitmq-kefier-volumeexpansion-dhzpd ns-lhngm VolumeExpansion rabbitmq-kefier rabbitmq Succeed 3/3 Sep 01,2025 11:52 UTC+0800 check ops status done ops_status:rabbitmq-kefier-volumeexpansion-dhzpd ns-lhngm VolumeExpansion rabbitmq-kefier rabbitmq Succeed 3/3 Sep 01,2025 11:52 UTC+0800 `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge opsrequests rabbitmq-kefier-volumeexpansion-dhzpd --namespace ns-lhngm ` opsrequest.apps.kubeblocks.io/rabbitmq-kefier-volumeexpansion-dhzpd patched `kbcli cluster delete-ops --name rabbitmq-kefier-volumeexpansion-dhzpd --force --auto-approve --namespace ns-lhngm ` OpsRequest rabbitmq-kefier-volumeexpansion-dhzpd deleted cluster hscale check cluster status before ops check cluster status done cluster_status:Running No resources found in rabbitmq-kefier namespace. `kbcli cluster hscale rabbitmq-kefier --auto-approve --force=true --components rabbitmq --replicas 4 --namespace ns-lhngm ` OpsRequest rabbitmq-kefier-horizontalscaling-9jntt created successfully, you can view the progress: kbcli cluster describe-ops rabbitmq-kefier-horizontalscaling-9jntt -n ns-lhngm check ops status `kbcli cluster list-ops rabbitmq-kefier --status all --namespace ns-lhngm ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME rabbitmq-kefier-horizontalscaling-9jntt ns-lhngm HorizontalScaling rabbitmq-kefier rabbitmq Sep 01,2025 11:58 UTC+0800 ops_status:rabbitmq-kefier-horizontalscaling-9jntt ns-lhngm HorizontalScaling rabbitmq-kefier rabbitmq Creating -/- Sep 01,2025 11:58 UTC+0800 check cluster status `kbcli cluster list rabbitmq-kefier --show-labels --namespace ns-lhngm ` NAME NAMESPACE CLUSTER-DEFINITION VERSION TERMINATION-POLICY STATUS CREATED-TIME LABELS rabbitmq-kefier ns-lhngm WipeOut Updating Sep 01,2025 11:24 UTC+0800 app.kubernetes.io/instance=rabbitmq-kefier cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances rabbitmq-kefier --namespace ns-lhngm ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME rabbitmq-kefier-rabbitmq-0 ns-lhngm rabbitmq-kefier rabbitmq Running 0 600m / 600m 644245094400m / 644245094400m data:4Gi aks-cicdamdpool-38368475-vmss000007/10.224.0.9 Sep 01,2025 11:50 UTC+0800 rabbitmq-kefier-rabbitmq-1 ns-lhngm rabbitmq-kefier rabbitmq Running 0 600m / 600m 644245094400m / 644245094400m data:4Gi aks-cicdamdpool-38368475-vmss000006/10.224.0.10 Sep 01,2025 11:50 UTC+0800 rabbitmq-kefier-rabbitmq-2 ns-lhngm rabbitmq-kefier rabbitmq Running 0 600m / 600m 644245094400m / 644245094400m data:4Gi aks-cicdamdpool-38368475-vmss000007/10.224.0.9 Sep 01,2025 11:55 UTC+0800 rabbitmq-kefier-rabbitmq-3 ns-lhngm rabbitmq-kefier rabbitmq Running 0 600m / 600m 644245094400m / 644245094400m data:4Gi aks-cicdamdpool-38368475-vmss000006/10.224.0.10 Sep 01,2025 11:58 UTC+0800 check pod status done `kubectl get secrets -l app.kubernetes.io/instance=rabbitmq-kefier` `kubectl get secrets rabbitmq-kefier-rabbitmq-account-root -o jsonpath="***.data.username***"` `kubectl get secrets rabbitmq-kefier-rabbitmq-account-root -o jsonpath="***.data.password***"` `kubectl get secrets rabbitmq-kefier-rabbitmq-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:3MQm57K36H2P7i3d;DB_PORT:15672;DB_DATABASE: check cluster connect `echo "rabbitmqadmin -H rabbitmq-kefier-rabbitmq.ns-lhngm.svc.cluster.local -u root -p '3MQm57K36H2P7i3d' -P 15672 show overview " | kubectl exec -it rabbitmq-kefier-rabbitmq-0 --namespace ns-lhngm -- bash` check cluster connect done No resources found in rabbitmq-kefier namespace. check ops status `kbcli cluster list-ops rabbitmq-kefier --status all --namespace ns-lhngm ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME rabbitmq-kefier-horizontalscaling-9jntt ns-lhngm HorizontalScaling rabbitmq-kefier rabbitmq Succeed 1/1 Sep 01,2025 11:58 UTC+0800 check ops status done ops_status:rabbitmq-kefier-horizontalscaling-9jntt ns-lhngm HorizontalScaling rabbitmq-kefier rabbitmq Succeed 1/1 Sep 01,2025 11:58 UTC+0800 `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge opsrequests rabbitmq-kefier-horizontalscaling-9jntt --namespace ns-lhngm ` opsrequest.apps.kubeblocks.io/rabbitmq-kefier-horizontalscaling-9jntt patched `kbcli cluster delete-ops --name rabbitmq-kefier-horizontalscaling-9jntt --force --auto-approve --namespace ns-lhngm ` OpsRequest rabbitmq-kefier-horizontalscaling-9jntt deleted cluster hscale check cluster status before ops check cluster status done cluster_status:Running No resources found in rabbitmq-kefier namespace. `kbcli cluster hscale rabbitmq-kefier --auto-approve --force=true --components rabbitmq --replicas 3 --namespace ns-lhngm ` OpsRequest rabbitmq-kefier-horizontalscaling-9p5pk created successfully, you can view the progress: kbcli cluster describe-ops rabbitmq-kefier-horizontalscaling-9p5pk -n ns-lhngm check ops status `kbcli cluster list-ops rabbitmq-kefier --status all --namespace ns-lhngm ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME rabbitmq-kefier-horizontalscaling-9p5pk ns-lhngm HorizontalScaling rabbitmq-kefier rabbitmq Creating -/- Sep 01,2025 11:59 UTC+0800 check cluster status `kbcli cluster list rabbitmq-kefier --show-labels --namespace ns-lhngm ` NAME NAMESPACE CLUSTER-DEFINITION VERSION TERMINATION-POLICY STATUS CREATED-TIME LABELS rabbitmq-kefier ns-lhngm WipeOut Running Sep 01,2025 11:24 UTC+0800 app.kubernetes.io/instance=rabbitmq-kefier check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances rabbitmq-kefier --namespace ns-lhngm ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME rabbitmq-kefier-rabbitmq-0 ns-lhngm rabbitmq-kefier rabbitmq Running 0 600m / 600m 644245094400m / 644245094400m data:4Gi aks-cicdamdpool-38368475-vmss000007/10.224.0.9 Sep 01,2025 11:50 UTC+0800 rabbitmq-kefier-rabbitmq-1 ns-lhngm rabbitmq-kefier rabbitmq Running 0 600m / 600m 644245094400m / 644245094400m data:4Gi aks-cicdamdpool-38368475-vmss000006/10.224.0.10 Sep 01,2025 11:50 UTC+0800 rabbitmq-kefier-rabbitmq-2 ns-lhngm rabbitmq-kefier rabbitmq Running 0 600m / 600m 644245094400m / 644245094400m data:4Gi aks-cicdamdpool-38368475-vmss000007/10.224.0.9 Sep 01,2025 11:55 UTC+0800 check pod status done `kubectl get secrets -l app.kubernetes.io/instance=rabbitmq-kefier` `kubectl get secrets rabbitmq-kefier-rabbitmq-account-root -o jsonpath="***.data.username***"` `kubectl get secrets rabbitmq-kefier-rabbitmq-account-root -o jsonpath="***.data.password***"` `kubectl get secrets rabbitmq-kefier-rabbitmq-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:3MQm57K36H2P7i3d;DB_PORT:15672;DB_DATABASE: check cluster connect `echo "rabbitmqadmin -H rabbitmq-kefier-rabbitmq.ns-lhngm.svc.cluster.local -u root -p '3MQm57K36H2P7i3d' -P 15672 show overview " | kubectl exec -it rabbitmq-kefier-rabbitmq-0 --namespace ns-lhngm -- bash` check cluster connect done No resources found in rabbitmq-kefier namespace. check ops status `kbcli cluster list-ops rabbitmq-kefier --status all --namespace ns-lhngm ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME rabbitmq-kefier-horizontalscaling-9p5pk ns-lhngm HorizontalScaling rabbitmq-kefier rabbitmq Succeed 1/1 Sep 01,2025 11:59 UTC+0800 check ops status done ops_status:rabbitmq-kefier-horizontalscaling-9p5pk ns-lhngm HorizontalScaling rabbitmq-kefier rabbitmq Succeed 1/1 Sep 01,2025 11:59 UTC+0800 `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge opsrequests rabbitmq-kefier-horizontalscaling-9p5pk --namespace ns-lhngm ` opsrequest.apps.kubeblocks.io/rabbitmq-kefier-horizontalscaling-9p5pk patched `kbcli cluster delete-ops --name rabbitmq-kefier-horizontalscaling-9p5pk --force --auto-approve --namespace ns-lhngm ` OpsRequest rabbitmq-kefier-horizontalscaling-9p5pk deleted cluster update terminationPolicy WipeOut `kbcli cluster update rabbitmq-kefier --termination-policy=WipeOut --namespace ns-lhngm ` cluster.apps.kubeblocks.io/rabbitmq-kefier updated (no change) check cluster status `kbcli cluster list rabbitmq-kefier --show-labels --namespace ns-lhngm ` NAME NAMESPACE CLUSTER-DEFINITION VERSION TERMINATION-POLICY STATUS CREATED-TIME LABELS rabbitmq-kefier ns-lhngm WipeOut Running Sep 01,2025 11:24 UTC+0800 app.kubernetes.io/instance=rabbitmq-kefier check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances rabbitmq-kefier --namespace ns-lhngm ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME rabbitmq-kefier-rabbitmq-0 ns-lhngm rabbitmq-kefier rabbitmq Running 0 600m / 600m 644245094400m / 644245094400m data:4Gi aks-cicdamdpool-38368475-vmss000007/10.224.0.9 Sep 01,2025 11:50 UTC+0800 rabbitmq-kefier-rabbitmq-1 ns-lhngm rabbitmq-kefier rabbitmq Running 0 600m / 600m 644245094400m / 644245094400m data:4Gi aks-cicdamdpool-38368475-vmss000006/10.224.0.10 Sep 01,2025 11:50 UTC+0800 rabbitmq-kefier-rabbitmq-2 ns-lhngm rabbitmq-kefier rabbitmq Running 0 600m / 600m 644245094400m / 644245094400m data:4Gi aks-cicdamdpool-38368475-vmss000007/10.224.0.9 Sep 01,2025 11:55 UTC+0800 check pod status done `kubectl get secrets -l app.kubernetes.io/instance=rabbitmq-kefier` `kubectl get secrets rabbitmq-kefier-rabbitmq-account-root -o jsonpath="***.data.username***"` `kubectl get secrets rabbitmq-kefier-rabbitmq-account-root -o jsonpath="***.data.password***"` `kubectl get secrets rabbitmq-kefier-rabbitmq-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:3MQm57K36H2P7i3d;DB_PORT:15672;DB_DATABASE: check cluster connect `echo "rabbitmqadmin -H rabbitmq-kefier-rabbitmq.ns-lhngm.svc.cluster.local -u root -p '3MQm57K36H2P7i3d' -P 15672 show overview " | kubectl exec -it rabbitmq-kefier-rabbitmq-0 --namespace ns-lhngm -- bash` check cluster connect done cluster list-logs `kbcli cluster list-logs rabbitmq-kefier --namespace ns-lhngm ` No log files found. You can enable the log feature with the kbcli command below. kbcli cluster update rabbitmq-kefier --enable-all-logs=true --namespace ns-lhngm Error from server (NotFound): pods "rabbitmq-kefier-rabbitmq-0" not found cluster logs `kbcli cluster logs rabbitmq-kefier --tail 30 --namespace ns-lhngm ` Defaulted container "rabbitmq" out of: rabbitmq, lorry, init-lorry (init) Notice: 01 03:51:42.535914+00:00 [notice] <0.44.0> Application syslog exited with reason: stopped Notice: 01 03:51:42.540667+00:00 [notice] <0.262.0> Logging: switching to configured handler(s); following messages may not be visible in this log output ## ## RabbitMQ 3.13.7 ## ## ########## Copyright (c) 2007-2024 Broadcom Inc and/or its subsidiaries ###### ## ########## Licensed under the MPL 2.0. Website: https://rabbitmq.com Erlang: 26.2.5.5 [jit] TLS Library: OpenSSL - OpenSSL 3.1.7 3 Sep 2024 Release series support status: see https://www.rabbitmq.com/release-information Doc guides: https://www.rabbitmq.com/docs Support: https://www.rabbitmq.com/docs/contact Tutorials: https://www.rabbitmq.com/tutorials Monitoring: https://www.rabbitmq.com/docs/monitoring Upgrading: https://www.rabbitmq.com/docs/upgrade Logs: /var/lib/rabbitmq/log/rabbit.log Config file(s): /etc/rabbitmq/conf.d/10-defaults.conf /etc/rabbitmq/conf.d/12-kubeblocks.conf Starting broker... completed with 5 plugins. delete cluster rabbitmq-kefier `kbcli cluster delete rabbitmq-kefier --auto-approve --namespace ns-lhngm ` Cluster rabbitmq-kefier deleted pod_info:rabbitmq-kefier-rabbitmq-0 2/2 Running 2 (8m58s ago) 9m23s rabbitmq-kefier-rabbitmq-1 2/2 Running 1 (9m50s ago) 10m rabbitmq-kefier-rabbitmq-2 2/2 Running 0 5m3s pod_info:rabbitmq-kefier-rabbitmq-0 2/2 Terminating 2 (9m18s ago) 9m43s rabbitmq-kefier-rabbitmq-1 2/2 Terminating 1 (10m ago) 10m rabbitmq-kefier-rabbitmq-2 2/2 Terminating 0 5m23s No resources found in ns-lhngm namespace. delete cluster pod done No resources found in ns-lhngm namespace. check cluster resource non-exist OK: pvc No resources found in ns-lhngm namespace. delete cluster done No resources found in ns-lhngm namespace. No resources found in ns-lhngm namespace. No resources found in ns-lhngm namespace. Rabbitmq Test Suite All Done! --------------------------------------Rabbitmq (Topology = Replicas 3) Test Result-------------------------------------- [PASSED]|[Create]|[ComponentVersion=rabbitmq;]|[Description=Create a cluster and component version rabbitmq] [PASSED]|[Connect]|[ComponentName=rabbitmq]|[Description=Connect to the cluster] [WARNING]|[VerticalScaling]|[ComponentName=rabbitmq]|[Description=VerticalScaling the cluster specify component rabbitmq] [PASSED]|[Update]|[Monitor=true]|[Description=Update the cluster Monitor enable] [PASSED]|[No-Failover]|[HA=Connection Stress;ComponentName=rabbitmq]|[Description=Simulates conditions where pods experience connection stress either due to expected/undesired processes thereby testing the application's resilience to potential slowness/unavailability of some replicas due to high Connection load.] [PASSED]|[Stop]|[-]|[Description=Stop the cluster] [PASSED]|[Start]|[-]|[Description=Start the cluster] [WARNING]|[Restart]|[-]|[Description=Restart the cluster] [PASSED]|[VolumeExpansion]|[ComponentName=rabbitmq]|[Description=VolumeExpansion the cluster specify component rabbitmq] [PASSED]|[HorizontalScaling Out]|[ComponentName=rabbitmq]|[Description=HorizontalScaling Out the cluster specify component rabbitmq] [PASSED]|[HorizontalScaling In]|[ComponentName=rabbitmq]|[Description=HorizontalScaling In the cluster specify component rabbitmq] [PASSED]|[Update]|[TerminationPolicy=WipeOut]|[Description=Update the cluster TerminationPolicy WipeOut] [PASSED]|[Delete]|[-]|[Description=Delete the cluster] [END]