https://github.com/apecloud/apecloud-cd/actions/runs/21930219260 previous_version: kubeblocks_version:1.0.2 bash test/kbcli/test_kbcli_1.0.sh --type 15 --version 1.0.2 --service-version 3.5 --generate-output true --aws-access-key-id *** --aws-secret-access-key *** --jihulab-token *** --random-namespace true --region eastus --cloud-provider aks CURRENT_TEST_DIR:test/kbcli source commons files source engines files source kubeblocks files source kubedb files CLUSTER_NAME:  `kubectl get namespace | grep ns-uvpun `(B   `kubectl create namespace ns-uvpun`(B  namespace/ns-uvpun created create namespace ns-uvpun done(B download kbcli  `gh release list --repo apecloud/kbcli --limit 100 | (grep "1.0" || true)`(B   `curl -fsSL https://kubeblocks.io/installer/install_cli.sh | bash -s v1.0.2`(B  Your system is linux_amd64 Installing kbcli ... Downloading ... kbcli installed successfully. Kubernetes: v1.32.10 KubeBlocks: 1.0.2 kbcli: 1.0.2 Make sure your docker service is running and begin your journey with kbcli: kbcli playground init For more information on how to get started, please visit: https://kubeblocks.io download kbcli v1.0.2 done(B Kubernetes: v1.32.10 KubeBlocks: 1.0.2 kbcli: 1.0.2 Kubernetes Env: v1.32.10 check snapshot controller check snapshot controller done(B POD_RESOURCES: aks kb-default-sc found aks default-vsc found found default storage class: default (B KubeBlocks version is:1.0.2 skip upgrade KubeBlocks(B current KubeBlocks version: 1.0.2 check component definition set component name:etcd set component version set component version:etcd set service versions:3.6.1,3.5.15,3.5.6 set service versions sorted:3.5.6,3.5.15,3.6.1 set etcd component definition set etcd component definition etcd-3-1.0.2 REPORT_COUNT 0:0 set replicas first:3,3.5.6|3,3.5.15|3,3.6.1 set replicas second max again:3,3.5.6 set replicas second max again:3,3.5.15 REPORT_COUNT 2:1 CLUSTER_TOPOLOGY:cluster set etcd component definition set etcd component definition etcd-3-1.0.2 LIMIT_CPU:0.1 LIMIT_MEMORY:0.5 storage size: 1 CLUSTER_NAME:etcd-rrsmex pod_info: termination_policy:Delete create 3 replica Delete etcd cluster check component definition set component definition by component version check cmpd by labels set component definition1: etcd-3-1.0.2 by component version:etcd apiVersion: apps.kubeblocks.io/v1 kind: Cluster metadata: name: etcd-rrsmex namespace: ns-uvpun spec: terminationPolicy: Delete componentSpecs: - name: etcd componentDef: etcd-3-1.0.2 tls: false replicas: 3 resources: requests: cpu: 100m memory: 0.5Gi limits: cpu: 100m memory: 0.5Gi volumeClaimTemplates: - name: data spec: storageClassName: accessModes: - ReadWriteOnce resources: requests: storage: 1Gi services: - name: client serviceName: client spec: type: NodePort ports: - port: 2379 targetPort: 2379 componentSelector: etcd roleSelector: leader  `kubectl apply -f test_create_etcd-rrsmex.yaml`(B  cluster.apps.kubeblocks.io/etcd-rrsmex created apply test_create_etcd-rrsmex.yaml Success(B  `rm -rf test_create_etcd-rrsmex.yaml`(B  check cluster status  `kbcli cluster list etcd-rrsmex --show-labels --namespace ns-uvpun `(B  NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS etcd-rrsmex ns-uvpun Delete Creating Feb 12,2026 10:05 UTC+0800 cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B check cluster status done(B cluster_status:Running(B check pod status  `kbcli cluster list-instances etcd-rrsmex --namespace ns-uvpun `(B  NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME etcd-rrsmex-etcd-0 ns-uvpun etcd-rrsmex etcd Running leader 0 100m / 100m 512Mi / 512Mi data:1Gi aks-cicdamdpool-17242166-vmss000001/10.224.0.8 Feb 12,2026 10:05 UTC+0800 etcd-rrsmex-etcd-1 ns-uvpun etcd-rrsmex etcd Running follower 0 100m / 100m 512Mi / 512Mi data:1Gi aks-cicdamdpool-17242166-vmss000000/10.224.0.9 Feb 12,2026 10:08 UTC+0800 etcd-rrsmex-etcd-2 ns-uvpun etcd-rrsmex etcd Running follower 0 100m / 100m 512Mi / 512Mi data:1Gi aks-default-27607381-vmss000000/10.224.0.4 Feb 12,2026 10:09 UTC+0800 check pod status done(B check cluster role check cluster role done(B leader(B: etcd-rrsmex-etcd-0;follower(B: etcd-rrsmex-etcd-1 etcd-rrsmex-etcd-2 check cluster connect  `echo 'etcdctl --endpoints=http://etcd-rrsmex-client.ns-uvpun.svc.cluster.local:2379 endpoint health' | kubectl exec -it etcd-rrsmex-etcd-0 --namespace ns-uvpun -- bash`(B  check cluster connect done(B  `kubectl get secrets -l app.kubernetes.io/instance=etcd-rrsmex`(B  Not found cluster secret(B DB_USERNAME:;DB_PASSWORD:;DB_PORT:2379;DB_DATABASE:(B There is no password in Type: 15.(B describe cluster  `kbcli cluster describe etcd-rrsmex --namespace ns-uvpun `(B  Name: etcd-rrsmex Created Time: Feb 12,2026 10:05 UTC+0800 NAMESPACE CLUSTER-DEFINITION TOPOLOGY STATUS TERMINATION-POLICY ns-uvpun Running Delete Endpoints: COMPONENT INTERNAL EXTERNAL Topology: COMPONENT SERVICE-VERSION INSTANCE ROLE STATUS AZ NODE CREATED-TIME etcd 3.6.1 etcd-rrsmex-etcd-0 leader Running 0 aks-cicdamdpool-17242166-vmss000001/10.224.0.8 Feb 12,2026 10:05 UTC+0800 etcd 3.6.1 etcd-rrsmex-etcd-1 follower Running 0 aks-cicdamdpool-17242166-vmss000000/10.224.0.9 Feb 12,2026 10:08 UTC+0800 etcd 3.6.1 etcd-rrsmex-etcd-2 follower Running 0 aks-default-27607381-vmss000000/10.224.0.4 Feb 12,2026 10:09 UTC+0800 Resources Allocation: COMPONENT INSTANCE-TEMPLATE CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE-SIZE STORAGE-CLASS etcd 100m / 100m 512Mi / 512Mi data:1Gi default Images: COMPONENT COMPONENT-DEFINITION IMAGE etcd etcd-3-1.0.2 docker.io/apecloud/etcd:v3.6.1 Data Protection: BACKUP-REPO AUTO-BACKUP BACKUP-SCHEDULE BACKUP-METHOD BACKUP-RETENTION RECOVERABLE-TIME Show cluster events: kbcli cluster list-events -n ns-uvpun etcd-rrsmex  `kbcli cluster label etcd-rrsmex app.kubernetes.io/instance- --namespace ns-uvpun `(B  label "app.kubernetes.io/instance" not found.  `kbcli cluster label etcd-rrsmex app.kubernetes.io/instance=etcd-rrsmex --namespace ns-uvpun `(B   `kbcli cluster label etcd-rrsmex --list --namespace ns-uvpun `(B  NAME NAMESPACE LABELS etcd-rrsmex ns-uvpun app.kubernetes.io/instance=etcd-rrsmex label cluster app.kubernetes.io/instance=etcd-rrsmex Success(B  `kbcli cluster label case.name=kbcli.test1 -l app.kubernetes.io/instance=etcd-rrsmex --namespace ns-uvpun `(B   `kbcli cluster label etcd-rrsmex --list --namespace ns-uvpun `(B  NAME NAMESPACE LABELS etcd-rrsmex ns-uvpun app.kubernetes.io/instance=etcd-rrsmex case.name=kbcli.test1 label cluster case.name=kbcli.test1 Success(B  `kbcli cluster label etcd-rrsmex case.name=kbcli.test2 --overwrite --namespace ns-uvpun `(B   `kbcli cluster label etcd-rrsmex --list --namespace ns-uvpun `(B  NAME NAMESPACE LABELS etcd-rrsmex ns-uvpun app.kubernetes.io/instance=etcd-rrsmex case.name=kbcli.test2 label cluster case.name=kbcli.test2 Success(B  `kbcli cluster label etcd-rrsmex case.name- --namespace ns-uvpun `(B   `kbcli cluster label etcd-rrsmex --list --namespace ns-uvpun `(B  NAME NAMESPACE LABELS etcd-rrsmex ns-uvpun app.kubernetes.io/instance=etcd-rrsmex delete cluster label case.name Success(B cluster connect  `echo "etcdctl --endpoints=http://etcd-rrsmex-client.ns-uvpun.svc.cluster.local:2379 member list" | kubectl exec -it etcd-rrsmex-etcd-0 --namespace ns-uvpun -- bash `(B  10d3c5bda296da0b, started, etcd-rrsmex-etcd-1, http://etcd-rrsmex-etcd-1.etcd-rrsmex-etcd-headless.ns-uvpun.svc.cluster.local:2380, http://etcd-rrsmex-etcd-1.etcd-rrsmex-etcd-headless.ns-uvpun.svc.cluster.local:2379, false 7ccfd22ced6060d4, started, etcd-rrsmex-etcd-0, http://etcd-rrsmex-etcd-0.etcd-rrsmex-etcd-headless.ns-uvpun.svc.cluster.local:2380, http://etcd-rrsmex-etcd-0.etcd-rrsmex-etcd-headless.ns-uvpun.svc.cluster.local:2379, false 9664f478870ac9ba, started, etcd-rrsmex-etcd-2, http://etcd-rrsmex-etcd-2.etcd-rrsmex-etcd-headless.ns-uvpun.svc.cluster.local:2380, http://etcd-rrsmex-etcd-2.etcd-rrsmex-etcd-headless.ns-uvpun.svc.cluster.local:2379, false connect cluster Success(B insert batch data by db client  `kubectl patch -p '{"metadata":{"finalizers":[]}}' --type=merge pods test-db-client-executionloop-etcd-rrsmex --namespace ns-uvpun `(B   `kubectl get secrets -l app.kubernetes.io/instance=etcd-rrsmex`(B  Not found cluster secret(B DB_USERNAME:;DB_PASSWORD:;DB_PORT:2379;DB_DATABASE:(B apiVersion: v1 kind: Pod metadata: name: test-db-client-executionloop-etcd-rrsmex namespace: ns-uvpun spec: containers: - name: test-dbclient imagePullPolicy: IfNotPresent image: docker.io/apecloud/dbclient:test args: - "--host" - "etcd-rrsmex-client.ns-uvpun.svc.cluster.local" - "--user" - "" - "--password" - "" - "--port" - "2379" - "--dbtype" - "etcd" - "--test" - "executionloop" - "--duration" - "60" - "--interval" - "1" restartPolicy: Never  `kubectl apply -f test-db-client-executionloop-etcd-rrsmex.yaml`(B  pod/test-db-client-executionloop-etcd-rrsmex created apply test-db-client-executionloop-etcd-rrsmex.yaml Success(B  `rm -rf test-db-client-executionloop-etcd-rrsmex.yaml`(B  check pod status pod_status:NAME READY STATUS RESTARTS AGE test-db-client-executionloop-etcd-rrsmex 1/1 Running 0 5s(B pod_status:NAME READY STATUS RESTARTS AGE test-db-client-executionloop-etcd-rrsmex 1/1 Running 0 9s(B pod_status:NAME READY STATUS RESTARTS AGE test-db-client-executionloop-etcd-rrsmex 1/1 Running 0 14s(B pod_status:NAME READY STATUS RESTARTS AGE test-db-client-executionloop-etcd-rrsmex 1/1 Running 0 19s(B pod_status:NAME READY STATUS RESTARTS AGE test-db-client-executionloop-etcd-rrsmex 1/1 Running 0 24s(B pod_status:NAME READY STATUS RESTARTS AGE test-db-client-executionloop-etcd-rrsmex 1/1 Running 0 29s(B pod_status:NAME READY STATUS RESTARTS AGE test-db-client-executionloop-etcd-rrsmex 1/1 Running 0 34s(B pod_status:NAME READY STATUS RESTARTS AGE test-db-client-executionloop-etcd-rrsmex 1/1 Running 0 39s(B pod_status:NAME READY STATUS RESTARTS AGE test-db-client-executionloop-etcd-rrsmex 1/1 Running 0 44s(B pod_status:NAME READY STATUS RESTARTS AGE test-db-client-executionloop-etcd-rrsmex 1/1 Running 0 50s(B pod_status:NAME READY STATUS RESTARTS AGE test-db-client-executionloop-etcd-rrsmex 1/1 Running 0 55s(B pod_status:NAME READY STATUS RESTARTS AGE test-db-client-executionloop-etcd-rrsmex 1/1 Running 0 60s(B check pod test-db-client-executionloop-etcd-rrsmex status done(B pod_status:NAME READY STATUS RESTARTS AGE test-db-client-executionloop-etcd-rrsmex 0/1 Completed 0 65s(B check cluster status  `kbcli cluster list etcd-rrsmex --show-labels --namespace ns-uvpun `(B  NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS etcd-rrsmex ns-uvpun Delete Running Feb 12,2026 10:05 UTC+0800 app.kubernetes.io/instance=etcd-rrsmex check cluster status done(B cluster_status:Running(B check pod status  `kbcli cluster list-instances etcd-rrsmex --namespace ns-uvpun `(B  NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME etcd-rrsmex-etcd-0 ns-uvpun etcd-rrsmex etcd Running leader 0 100m / 100m 512Mi / 512Mi data:1Gi aks-cicdamdpool-17242166-vmss000001/10.224.0.8 Feb 12,2026 10:05 UTC+0800 etcd-rrsmex-etcd-1 ns-uvpun etcd-rrsmex etcd Running follower 0 100m / 100m 512Mi / 512Mi data:1Gi aks-cicdamdpool-17242166-vmss000000/10.224.0.9 Feb 12,2026 10:08 UTC+0800 etcd-rrsmex-etcd-2 ns-uvpun etcd-rrsmex etcd Running follower 0 100m / 100m 512Mi / 512Mi data:1Gi aks-default-27607381-vmss000000/10.224.0.4 Feb 12,2026 10:09 UTC+0800 check pod status done(B check cluster role check cluster role done(B leader(B: etcd-rrsmex-etcd-0;follower(B: etcd-rrsmex-etcd-1 etcd-rrsmex-etcd-2 check cluster connect  `echo 'etcdctl --endpoints=http://etcd-rrsmex-client.ns-uvpun.svc.cluster.local:2379 endpoint health' | kubectl exec -it etcd-rrsmex-etcd-0 --namespace ns-uvpun -- bash`(B  check cluster connect done(B --host etcd-rrsmex-client.ns-uvpun.svc.cluster.local --user --password --port 2379 --dbtype etcd --test executionloop --duration 60 --interval 1 Using no auth SLF4J(I): Connected with provider of type [ch.qos.logback.classic.spi.LogbackServiceProvider] Execution loop start: Get key prefix:executions_loop_key Execution loop start:PUT:executions_loop_key_1:executions_loop_value_1 [ 1s ] executions total: 50 successful: 50 failed: 0 disconnect: 0 [ 2s ] executions total: 122 successful: 122 failed: 0 disconnect: 0 [ 3s ] executions total: 189 successful: 189 failed: 0 disconnect: 0 [ 4s ] executions total: 268 successful: 268 failed: 0 disconnect: 0 [ 5s ] executions total: 341 successful: 341 failed: 0 disconnect: 0 [ 6s ] executions total: 405 successful: 405 failed: 0 disconnect: 0 [ 7s ] executions total: 482 successful: 482 failed: 0 disconnect: 0 [ 8s ] executions total: 555 successful: 555 failed: 0 disconnect: 0 [ 9s ] executions total: 630 successful: 630 failed: 0 disconnect: 0 [ 10s ] executions total: 705 successful: 705 failed: 0 disconnect: 0 [ 11s ] executions total: 772 successful: 772 failed: 0 disconnect: 0 [ 12s ] executions total: 839 successful: 839 failed: 0 disconnect: 0 [ 13s ] executions total: 915 successful: 915 failed: 0 disconnect: 0 [ 14s ] executions total: 991 successful: 991 failed: 0 disconnect: 0 [ 15s ] executions total: 1069 successful: 1069 failed: 0 disconnect: 0 [ 16s ] executions total: 1140 successful: 1140 failed: 0 disconnect: 0 [ 17s ] executions total: 1213 successful: 1213 failed: 0 disconnect: 0 [ 18s ] executions total: 1291 successful: 1291 failed: 0 disconnect: 0 [ 19s ] executions total: 1368 successful: 1368 failed: 0 disconnect: 0 [ 20s ] executions total: 1439 successful: 1439 failed: 0 disconnect: 0 [ 21s ] executions total: 1518 successful: 1518 failed: 0 disconnect: 0 [ 22s ] executions total: 1582 successful: 1582 failed: 0 disconnect: 0 [ 23s ] executions total: 1653 successful: 1653 failed: 0 disconnect: 0 [ 24s ] executions total: 1731 successful: 1731 failed: 0 disconnect: 0 [ 25s ] executions total: 1800 successful: 1800 failed: 0 disconnect: 0 [ 26s ] executions total: 1868 successful: 1868 failed: 0 disconnect: 0 [ 27s ] executions total: 1940 successful: 1940 failed: 0 disconnect: 0 [ 28s ] executions total: 2018 successful: 2018 failed: 0 disconnect: 0 [ 29s ] executions total: 2089 successful: 2089 failed: 0 disconnect: 0 [ 30s ] executions total: 2160 successful: 2160 failed: 0 disconnect: 0 [ 31s ] executions total: 2223 successful: 2223 failed: 0 disconnect: 0 [ 32s ] executions total: 2305 successful: 2305 failed: 0 disconnect: 0 [ 33s ] executions total: 2382 successful: 2382 failed: 0 disconnect: 0 [ 34s ] executions total: 2462 successful: 2462 failed: 0 disconnect: 0 [ 35s ] executions total: 2542 successful: 2542 failed: 0 disconnect: 0 [ 36s ] executions total: 2617 successful: 2617 failed: 0 disconnect: 0 [ 37s ] executions total: 2697 successful: 2697 failed: 0 disconnect: 0 [ 38s ] executions total: 2777 successful: 2777 failed: 0 disconnect: 0 [ 39s ] executions total: 2849 successful: 2849 failed: 0 disconnect: 0 [ 40s ] executions total: 2935 successful: 2935 failed: 0 disconnect: 0 [ 41s ] executions total: 3014 successful: 3014 failed: 0 disconnect: 0 [ 42s ] executions total: 3084 successful: 3084 failed: 0 disconnect: 0 [ 43s ] executions total: 3154 successful: 3154 failed: 0 disconnect: 0 [ 44s ] executions total: 3222 successful: 3222 failed: 0 disconnect: 0 [ 45s ] executions total: 3301 successful: 3301 failed: 0 disconnect: 0 [ 46s ] executions total: 3377 successful: 3377 failed: 0 disconnect: 0 [ 47s ] executions total: 3455 successful: 3455 failed: 0 disconnect: 0 [ 48s ] executions total: 3513 successful: 3513 failed: 0 disconnect: 0 [ 49s ] executions total: 3590 successful: 3590 failed: 0 disconnect: 0 [ 50s ] executions total: 3668 successful: 3668 failed: 0 disconnect: 0 [ 51s ] executions total: 3748 successful: 3748 failed: 0 disconnect: 0 [ 52s ] executions total: 3825 successful: 3825 failed: 0 disconnect: 0 [ 53s ] executions total: 3904 successful: 3904 failed: 0 disconnect: 0 [ 54s ] executions total: 3987 successful: 3987 failed: 0 disconnect: 0 [ 55s ] executions total: 4071 successful: 4071 failed: 0 disconnect: 0 [ 56s ] executions total: 4143 successful: 4143 failed: 0 disconnect: 0 [ 57s ] executions total: 4220 successful: 4220 failed: 0 disconnect: 0 [ 58s ] executions total: 4294 successful: 4294 failed: 0 disconnect: 0 [ 59s ] executions total: 4370 successful: 4370 failed: 0 disconnect: 0 [ 60s ] executions total: 4404 successful: 4404 failed: 0 disconnect: 0 Test Result: Total Executions: 4404 Successful Executions: 4404 Failed Executions: 0 Disconnection Counts: 0 Connection Information: Database Type: etcd Host: etcd-rrsmex-client.ns-uvpun.svc.cluster.local Port: 2379 Database: Table: User: Org: Access Mode: mysql Test Type: executionloop Query: Duration: 60 seconds Interval: 1 seconds DB_CLIENT_BATCH_DATA_COUNT: 4404  `kubectl patch -p '{"metadata":{"finalizers":[]}}' --type=merge pods test-db-client-executionloop-etcd-rrsmex --namespace ns-uvpun `(B  pod/test-db-client-executionloop-etcd-rrsmex patched (no change) pod "test-db-client-executionloop-etcd-rrsmex" force deleted test failover kill1(B check cluster status before cluster-failover-kill1 check cluster status done(B cluster_status:Running(B  `kill 1`(B  exec return message: check cluster status  `kbcli cluster list etcd-rrsmex --show-labels --namespace ns-uvpun `(B  NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS etcd-rrsmex ns-uvpun Delete Running Feb 12,2026 10:05 UTC+0800 app.kubernetes.io/instance=etcd-rrsmex check cluster status done(B cluster_status:Running(B check pod status  `kbcli cluster list-instances etcd-rrsmex --namespace ns-uvpun `(B  NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME etcd-rrsmex-etcd-0 ns-uvpun etcd-rrsmex etcd Running leader 0 100m / 100m 512Mi / 512Mi data:1Gi aks-cicdamdpool-17242166-vmss000001/10.224.0.8 Feb 12,2026 10:05 UTC+0800 etcd-rrsmex-etcd-1 ns-uvpun etcd-rrsmex etcd Running follower 0 100m / 100m 512Mi / 512Mi data:1Gi aks-cicdamdpool-17242166-vmss000000/10.224.0.9 Feb 12,2026 10:08 UTC+0800 etcd-rrsmex-etcd-2 ns-uvpun etcd-rrsmex etcd Running follower 0 100m / 100m 512Mi / 512Mi data:1Gi aks-default-27607381-vmss000000/10.224.0.4 Feb 12,2026 10:09 UTC+0800 check pod status done(B check cluster role check cluster role done(B leader(B: etcd-rrsmex-etcd-0;follower(B: etcd-rrsmex-etcd-1 etcd-rrsmex-etcd-2 check cluster connect  `echo 'etcdctl --endpoints=http://etcd-rrsmex-client.ns-uvpun.svc.cluster.local:2379 endpoint health' | kubectl exec -it etcd-rrsmex-etcd-0 --namespace ns-uvpun -- bash`(B  check cluster connect done(B check failover pod name failover pod name:etcd-rrsmex-etcd-0 checking failover...(B  `kill 1`(B  exec return message: check cluster status  `kbcli cluster list etcd-rrsmex --show-labels --namespace ns-uvpun `(B  NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS etcd-rrsmex ns-uvpun Delete Running Feb 12,2026 10:05 UTC+0800 app.kubernetes.io/instance=etcd-rrsmex check cluster status done(B cluster_status:Running(B check pod status  `kbcli cluster list-instances etcd-rrsmex --namespace ns-uvpun `(B  NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME etcd-rrsmex-etcd-0 ns-uvpun etcd-rrsmex etcd Running leader 0 100m / 100m 512Mi / 512Mi data:1Gi aks-cicdamdpool-17242166-vmss000001/10.224.0.8 Feb 12,2026 10:05 UTC+0800 etcd-rrsmex-etcd-1 ns-uvpun etcd-rrsmex etcd Running follower 0 100m / 100m 512Mi / 512Mi data:1Gi aks-cicdamdpool-17242166-vmss000000/10.224.0.9 Feb 12,2026 10:08 UTC+0800 etcd-rrsmex-etcd-2 ns-uvpun etcd-rrsmex etcd Running follower 0 100m / 100m 512Mi / 512Mi data:1Gi aks-default-27607381-vmss000000/10.224.0.4 Feb 12,2026 10:09 UTC+0800 check pod status done(B check cluster role check cluster role done(B leader(B: etcd-rrsmex-etcd-0;follower(B: etcd-rrsmex-etcd-1 etcd-rrsmex-etcd-2 check cluster connect  `echo 'etcdctl --endpoints=http://etcd-rrsmex-client.ns-uvpun.svc.cluster.local:2379 endpoint health' | kubectl exec -it etcd-rrsmex-etcd-0 --namespace ns-uvpun -- bash`(B  connect checking...(B connect checking...(B connect checking...(B connect checking...(B connect checking...(B check cluster connect done(B failover pod name:etcd-rrsmex-etcd-1 failover kill1 Success(B check db_client batch data count  `echo "etcdctl --endpoints=http://etcd-rrsmex-client.ns-uvpun.svc.cluster.local:2379 get --prefix \"executions_loop_key\" --keys-only | (grep executions_loop_key || true) | wc -l " | kubectl exec -it etcd-rrsmex-etcd-1 --namespace ns-uvpun -- bash `(B  check db_client batch [4404] equal [4404] data Success(B check readonly db_client batch data count  `echo "etcdctl --endpoints=http://etcd-rrsmex-client.ns-uvpun.svc.cluster.local:2379 get --prefix \"executions_loop_key\" --keys-only | (grep executions_loop_key || true) | wc -l " | kubectl exec -it etcd-rrsmex-etcd-2 --namespace ns-uvpun -- bash `(B  check readonly db_client batch data [4404] equal [4404] Success(B cluster restart check cluster status before ops cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B check cluster status done(B cluster_status:Running(B  `kbcli cluster restart etcd-rrsmex --auto-approve --force=true --namespace ns-uvpun `(B  OpsRequest etcd-rrsmex-restart-tjxdl created successfully, you can view the progress: kbcli cluster describe-ops etcd-rrsmex-restart-tjxdl -n ns-uvpun check ops status  `kbcli cluster list-ops etcd-rrsmex --status all --namespace ns-uvpun `(B  NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME etcd-rrsmex-restart-tjxdl ns-uvpun Restart etcd-rrsmex etcd Running -/- Feb 12,2026 10:13 UTC+0800 check cluster status  `kbcli cluster list etcd-rrsmex --show-labels --namespace ns-uvpun `(B  NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS etcd-rrsmex ns-uvpun Delete Updating Feb 12,2026 10:05 UTC+0800 app.kubernetes.io/instance=etcd-rrsmex cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B [Error] check cluster status timeout(B --------------------------------------get cluster etcd-rrsmex yaml--------------------------------------  `kubectl get cluster etcd-rrsmex -o yaml --namespace ns-uvpun `(B  apiVersion: apps.kubeblocks.io/v1 kind: Cluster metadata: annotations: kubeblocks.io/crd-api-version: apps.kubeblocks.io/v1 kubeblocks.io/ops-request: '[{"name":"etcd-rrsmex-restart-tjxdl","type":"Restart"}]' kubectl.kubernetes.io/last-applied-configuration: | {"apiVersion":"apps.kubeblocks.io/v1","kind":"Cluster","metadata":{"annotations":{},"name":"etcd-rrsmex","namespace":"ns-uvpun"},"spec":{"componentSpecs":[{"componentDef":"etcd-3-1.0.2","name":"etcd","replicas":3,"resources":{"limits":{"cpu":"100m","memory":"0.5Gi"},"requests":{"cpu":"100m","memory":"0.5Gi"}},"tls":false,"volumeClaimTemplates":[{"name":"data","spec":{"accessModes":["ReadWriteOnce"],"resources":{"requests":{"storage":"1Gi"}},"storageClassName":null}}]}],"services":[{"componentSelector":"etcd","name":"client","roleSelector":"leader","serviceName":"client","spec":{"ports":[{"port":2379,"targetPort":2379}],"type":"NodePort"}}],"terminationPolicy":"Delete"}} creationTimestamp: "2026-02-12T02:05:03Z" finalizers: - cluster.kubeblocks.io/finalizer generation: 4 labels: app.kubernetes.io/instance: etcd-rrsmex name: etcd-rrsmex namespace: ns-uvpun resourceVersion: "30014" uid: 6f05c9d1-9372-4fc8-b975-8e1d00f5c7f3 spec: componentSpecs: - annotations: kubeblocks.io/restart: "2026-02-12T02:13:23Z" componentDef: etcd-3-1.0.2 name: etcd podUpdatePolicy: PreferInPlace replicas: 3 resources: limits: cpu: 100m memory: 512Mi requests: cpu: 100m memory: 512Mi serviceVersion: 3.6.1 volumeClaimTemplates: - name: data spec: accessModes: - ReadWriteOnce resources: requests: storage: 1Gi services: - componentSelector: etcd name: client roleSelector: leader serviceName: client spec: ports: - nodePort: 31881 port: 2379 protocol: TCP targetPort: 2379 type: NodePort terminationPolicy: Delete status: components: etcd: observedGeneration: 4 phase: Updating upToDate: true conditions: - lastTransitionTime: "2026-02-12T02:05:04Z" message: 'The operator has started the provisioning of Cluster: etcd-rrsmex' observedGeneration: 4 reason: PreCheckSucceed status: "True" type: ProvisioningStarted - lastTransitionTime: "2026-02-12T02:05:04Z" message: Successfully applied for resources observedGeneration: 4 reason: ApplyResourcesSucceed status: "True" type: ApplyResources - lastTransitionTime: "2026-02-12T02:10:45Z" message: cluster etcd-rrsmex is ready reason: ClusterReady status: "True" type: Ready observedGeneration: 4 phase: Updating ------------------------------------------------------------------------------------------------------------------ --------------------------------------describe cluster etcd-rrsmex--------------------------------------  `kubectl describe cluster etcd-rrsmex --namespace ns-uvpun `(B  Name: etcd-rrsmex Namespace: ns-uvpun Labels: app.kubernetes.io/instance=etcd-rrsmex Annotations: kubeblocks.io/crd-api-version: apps.kubeblocks.io/v1 kubeblocks.io/ops-request: [{"name":"etcd-rrsmex-restart-tjxdl","type":"Restart"}] API Version: apps.kubeblocks.io/v1 Kind: Cluster Metadata: Creation Timestamp: 2026-02-12T02:05:03Z Finalizers: cluster.kubeblocks.io/finalizer Generation: 4 Resource Version: 30014 UID: 6f05c9d1-9372-4fc8-b975-8e1d00f5c7f3 Spec: Component Specs: Annotations: kubeblocks.io/restart: 2026-02-12T02:13:23Z Component Def: etcd-3-1.0.2 Name: etcd Pod Update Policy: PreferInPlace Replicas: 3 Resources: Limits: Cpu: 100m Memory: 512Mi Requests: Cpu: 100m Memory: 512Mi Service Version: 3.6.1 Volume Claim Templates: Name: data Spec: Access Modes: ReadWriteOnce Resources: Requests: Storage: 1Gi Services: Component Selector: etcd Name: client Role Selector: leader Service Name: client Spec: Ports: Node Port: 31881 Port: 2379 Protocol: TCP Target Port: 2379 Type: NodePort Termination Policy: Delete Status: Components: Etcd: Observed Generation: 4 Phase: Updating Up To Date: true Conditions: Last Transition Time: 2026-02-12T02:05:04Z Message: The operator has started the provisioning of Cluster: etcd-rrsmex Observed Generation: 4 Reason: PreCheckSucceed Status: True Type: ProvisioningStarted Last Transition Time: 2026-02-12T02:05:04Z Message: Successfully applied for resources Observed Generation: 4 Reason: ApplyResourcesSucceed Status: True Type: ApplyResources Last Transition Time: 2026-02-12T02:10:45Z Message: cluster etcd-rrsmex is ready Reason: ClusterReady Status: True Type: Ready Observed Generation: 4 Phase: Updating Events: Type Reason Age From Message ---- ------ ---- ---- ------- Normal PreCheckSucceed 15m (x3 over 15m) cluster-controller The operator has started the provisioning of Cluster: etcd-rrsmex Normal ApplyResourcesSucceed 15m (x3 over 15m) cluster-controller Successfully applied for resources Normal ClusterComponentPhaseTransition 15m (x2 over 15m) cluster-controller cluster component etcd is Creating Normal ClusterReady 9m57s cluster-controller cluster etcd-rrsmex is ready Normal ClusterComponentPhaseTransition 8m22s (x4 over 8m36s) cluster-controller cluster component etcd is Updating Normal ClusterComponentPhaseTransition 7m22s (x10 over 9m57s) cluster-controller cluster component etcd is Running Normal Running 7m22s (x3 over 9m57s) cluster-controller Cluster: etcd-rrsmex is ready, current phase is Running ------------------------------------------------------------------------------------------------------------------ check pod status  `kbcli cluster list-instances etcd-rrsmex --namespace ns-uvpun `(B  NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME etcd-rrsmex-etcd-0 ns-uvpun etcd-rrsmex etcd Running follower 0 100m / 100m 512Mi / 512Mi data:1Gi aks-cicdamdpool-17242166-vmss000001/10.224.0.8 Feb 12,2026 10:18 UTC+0800 etcd-rrsmex-etcd-1 ns-uvpun etcd-rrsmex etcd Running 0 100m / 100m 512Mi / 512Mi data:1Gi aks-cicdamdpool-17242166-vmss000000/10.224.0.9 Feb 12,2026 10:20 UTC+0800 etcd-rrsmex-etcd-2 ns-uvpun etcd-rrsmex etcd Running follower 0 100m / 100m 512Mi / 512Mi data:1Gi aks-cicdamdpool-17242166-vmss000003/10.224.0.6 Feb 12,2026 10:13 UTC+0800 check pod status done(B check cluster status again cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B check cluster status again done(B check cluster role check cluster role done(B leader(B: etcd-rrsmex-etcd-0;follower(B: etcd-rrsmex-etcd-1 etcd-rrsmex-etcd-2 check cluster connect  `echo 'etcdctl --endpoints=http://etcd-rrsmex-client.ns-uvpun.svc.cluster.local:2379 endpoint health' | kubectl exec -it etcd-rrsmex-etcd-0 --namespace ns-uvpun -- bash`(B  check cluster connect done(B check ops status  `kbcli cluster list-ops etcd-rrsmex --status all --namespace ns-uvpun `(B  NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME etcd-rrsmex-restart-tjxdl ns-uvpun Restart etcd-rrsmex etcd Succeed 3/3 Feb 12,2026 10:13 UTC+0800 check ops status done(B ops_status:etcd-rrsmex-restart-tjxdl ns-uvpun Restart etcd-rrsmex etcd Succeed 3/3 Feb 12,2026 10:13 UTC+0800 (B  `kubectl patch -p '{"metadata":{"finalizers":[]}}' --type=merge opsrequests.operations etcd-rrsmex-restart-tjxdl --namespace ns-uvpun `(B  opsrequest.operations.kubeblocks.io/etcd-rrsmex-restart-tjxdl patched  `kbcli cluster delete-ops --name etcd-rrsmex-restart-tjxdl --force --auto-approve --namespace ns-uvpun `(B  OpsRequest etcd-rrsmex-restart-tjxdl deleted check db_client batch data count  `echo "etcdctl --endpoints=http://etcd-rrsmex-client.ns-uvpun.svc.cluster.local:2379 get --prefix \"executions_loop_key\" --keys-only | (grep executions_loop_key || true) | wc -l " | kubectl exec -it etcd-rrsmex-etcd-0 --namespace ns-uvpun -- bash `(B  check db_client batch [4404] equal [4404] data Success(B check readonly db_client batch data count  `echo "etcdctl --endpoints=http://etcd-rrsmex-client.ns-uvpun.svc.cluster.local:2379 get --prefix \"executions_loop_key\" --keys-only | (grep executions_loop_key || true) | wc -l " | kubectl exec -it etcd-rrsmex-etcd-1 --namespace ns-uvpun -- bash `(B  check readonly db_client batch data [4404] equal [4404] Success(B check cluster status before ops check cluster status done(B cluster_status:Running(B  `kbcli cluster vscale etcd-rrsmex --auto-approve --force=true --components etcd --cpu 200m --memory 0.6Gi --namespace ns-uvpun `(B  OpsRequest etcd-rrsmex-verticalscaling-lrmrh created successfully, you can view the progress: kbcli cluster describe-ops etcd-rrsmex-verticalscaling-lrmrh -n ns-uvpun check ops status  `kbcli cluster list-ops etcd-rrsmex --status all --namespace ns-uvpun `(B  NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME etcd-rrsmex-verticalscaling-lrmrh ns-uvpun VerticalScaling etcd-rrsmex etcd Running -/- Feb 12,2026 10:21 UTC+0800 check cluster status  `kbcli cluster list etcd-rrsmex --show-labels --namespace ns-uvpun `(B  NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS etcd-rrsmex ns-uvpun Delete Updating Feb 12,2026 10:05 UTC+0800 app.kubernetes.io/instance=etcd-rrsmex cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B check cluster status done(B cluster_status:Running(B check pod status  `kbcli cluster list-instances etcd-rrsmex --namespace ns-uvpun `(B  NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME etcd-rrsmex-etcd-0 ns-uvpun etcd-rrsmex etcd Running follower 0 200m / 200m 644245094400m / 644245094400m data:1Gi aks-cicdamdpool-17242166-vmss000001/10.224.0.8 Feb 12,2026 10:24 UTC+0800 etcd-rrsmex-etcd-1 ns-uvpun etcd-rrsmex etcd Running leader 0 200m / 200m 644245094400m / 644245094400m data:1Gi aks-cicdamdpool-17242166-vmss000000/10.224.0.9 Feb 12,2026 10:23 UTC+0800 etcd-rrsmex-etcd-2 ns-uvpun etcd-rrsmex etcd Running follower 0 200m / 200m 644245094400m / 644245094400m data:1Gi aks-cicdamdpool-17242166-vmss000003/10.224.0.6 Feb 12,2026 10:21 UTC+0800 check pod status done(B check cluster role check cluster role done(B leader(B: etcd-rrsmex-etcd-1;follower(B: etcd-rrsmex-etcd-0 etcd-rrsmex-etcd-2 check cluster connect  `echo 'etcdctl --endpoints=http://etcd-rrsmex-client.ns-uvpun.svc.cluster.local:2379 endpoint health' | kubectl exec -it etcd-rrsmex-etcd-1 --namespace ns-uvpun -- bash`(B  check cluster connect done(B check ops status  `kbcli cluster list-ops etcd-rrsmex --status all --namespace ns-uvpun `(B  NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME etcd-rrsmex-verticalscaling-lrmrh ns-uvpun VerticalScaling etcd-rrsmex etcd Succeed 3/3 Feb 12,2026 10:21 UTC+0800 check ops status done(B ops_status:etcd-rrsmex-verticalscaling-lrmrh ns-uvpun VerticalScaling etcd-rrsmex etcd Succeed 3/3 Feb 12,2026 10:21 UTC+0800 (B  `kubectl patch -p '{"metadata":{"finalizers":[]}}' --type=merge opsrequests.operations etcd-rrsmex-verticalscaling-lrmrh --namespace ns-uvpun `(B  opsrequest.operations.kubeblocks.io/etcd-rrsmex-verticalscaling-lrmrh patched  `kbcli cluster delete-ops --name etcd-rrsmex-verticalscaling-lrmrh --force --auto-approve --namespace ns-uvpun `(B  OpsRequest etcd-rrsmex-verticalscaling-lrmrh deleted check db_client batch data count  `echo "etcdctl --endpoints=http://etcd-rrsmex-client.ns-uvpun.svc.cluster.local:2379 get --prefix \"executions_loop_key\" --keys-only | (grep executions_loop_key || true) | wc -l " | kubectl exec -it etcd-rrsmex-etcd-1 --namespace ns-uvpun -- bash `(B  check db_client batch [4404] equal [4404] data Success(B check readonly db_client batch data count  `echo "etcdctl --endpoints=http://etcd-rrsmex-client.ns-uvpun.svc.cluster.local:2379 get --prefix \"executions_loop_key\" --keys-only | (grep executions_loop_key || true) | wc -l " | kubectl exec -it etcd-rrsmex-etcd-0 --namespace ns-uvpun -- bash `(B  check readonly db_client batch data [4404] equal [4404] Success(B test failover connectionstress(B check cluster status before cluster-failover-connectionstress check cluster status done(B cluster_status:Running(B  `kubectl patch -p '{"metadata":{"finalizers":[]}}' --type=merge pods test-db-client-connectionstress-etcd-rrsmex --namespace ns-uvpun `(B   `kubectl get secrets -l app.kubernetes.io/instance=etcd-rrsmex`(B  Not found cluster secret(B DB_USERNAME:;DB_PASSWORD:;DB_PORT:2379;DB_DATABASE:(B apiVersion: v1 kind: Pod metadata: name: test-db-client-connectionstress-etcd-rrsmex namespace: ns-uvpun spec: containers: - name: test-dbclient imagePullPolicy: IfNotPresent image: docker.io/apecloud/dbclient:test args: - "--host" - "etcd-rrsmex-client.ns-uvpun.svc.cluster.local" - "--user" - "" - "--password" - "" - "--port" - "2379" - "--database" - "" - "--dbtype" - "etcd" - "--test" - "connectionstress" - "--connections" - "5000" - "--duration" - "60" restartPolicy: Never  `kubectl apply -f test-db-client-connectionstress-etcd-rrsmex.yaml`(B  pod/test-db-client-connectionstress-etcd-rrsmex created apply test-db-client-connectionstress-etcd-rrsmex.yaml Success(B  `rm -rf test-db-client-connectionstress-etcd-rrsmex.yaml`(B  check pod status pod_status:NAME READY STATUS RESTARTS AGE test-db-client-connectionstress-etcd-rrsmex 1/1 Running 0 5s(B pod_status:NAME READY STATUS RESTARTS AGE test-db-client-connectionstress-etcd-rrsmex 1/1 Running 0 10s(B pod_status:NAME READY STATUS RESTARTS AGE test-db-client-connectionstress-etcd-rrsmex 1/1 Running 0 15s(B pod_status:NAME READY STATUS RESTARTS AGE test-db-client-connectionstress-etcd-rrsmex 1/1 Running 0 20s(B pod_status:NAME READY STATUS RESTARTS AGE test-db-client-connectionstress-etcd-rrsmex 1/1 Running 0 25s(B pod_status:NAME READY STATUS RESTARTS AGE test-db-client-connectionstress-etcd-rrsmex 1/1 Running 0 30s(B pod_status:NAME READY STATUS RESTARTS AGE test-db-client-connectionstress-etcd-rrsmex 1/1 Running 0 35s(B pod_status:NAME READY STATUS RESTARTS AGE test-db-client-connectionstress-etcd-rrsmex 1/1 Running 0 40s(B pod_status:NAME READY STATUS RESTARTS AGE test-db-client-connectionstress-etcd-rrsmex 1/1 Running 0 45s(B pod_status:NAME READY STATUS RESTARTS AGE test-db-client-connectionstress-etcd-rrsmex 1/1 Running 0 50s(B pod_status:NAME READY STATUS RESTARTS AGE test-db-client-connectionstress-etcd-rrsmex 1/1 Running 0 55s(B pod_status:NAME READY STATUS RESTARTS AGE test-db-client-connectionstress-etcd-rrsmex 1/1 Running 0 61s(B pod_status:NAME READY STATUS RESTARTS AGE test-db-client-connectionstress-etcd-rrsmex 1/1 Running 0 66s(B pod_status:NAME READY STATUS RESTARTS AGE test-db-client-connectionstress-etcd-rrsmex 1/1 Running 0 71s(B pod_status:NAME READY STATUS RESTARTS AGE test-db-client-connectionstress-etcd-rrsmex 1/1 Running 0 76s(B pod_status:NAME READY STATUS RESTARTS AGE test-db-client-connectionstress-etcd-rrsmex 1/1 Running 0 81s(B pod_status:NAME READY STATUS RESTARTS AGE test-db-client-connectionstress-etcd-rrsmex 1/1 Running 0 86s(B pod_status:NAME READY STATUS RESTARTS AGE test-db-client-connectionstress-etcd-rrsmex 1/1 Running 0 91s(B check pod test-db-client-connectionstress-etcd-rrsmex status done(B pod_status:NAME READY STATUS RESTARTS AGE test-db-client-connectionstress-etcd-rrsmex 0/1 Completed 0 96s(B check cluster status  `kbcli cluster list etcd-rrsmex --show-labels --namespace ns-uvpun `(B  NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS etcd-rrsmex ns-uvpun Delete Running Feb 12,2026 10:05 UTC+0800 app.kubernetes.io/instance=etcd-rrsmex check cluster status done(B cluster_status:Running(B check pod status  `kbcli cluster list-instances etcd-rrsmex --namespace ns-uvpun `(B  NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME etcd-rrsmex-etcd-0 ns-uvpun etcd-rrsmex etcd Running follower 0 200m / 200m 644245094400m / 644245094400m data:1Gi aks-cicdamdpool-17242166-vmss000001/10.224.0.8 Feb 12,2026 10:24 UTC+0800 etcd-rrsmex-etcd-1 ns-uvpun etcd-rrsmex etcd Running leader 0 200m / 200m 644245094400m / 644245094400m data:1Gi aks-cicdamdpool-17242166-vmss000000/10.224.0.9 Feb 12,2026 10:23 UTC+0800 etcd-rrsmex-etcd-2 ns-uvpun etcd-rrsmex etcd Running follower 0 200m / 200m 644245094400m / 644245094400m data:1Gi aks-cicdamdpool-17242166-vmss000003/10.224.0.6 Feb 12,2026 10:21 UTC+0800 check pod status done(B check cluster role check cluster role done(B leader(B: etcd-rrsmex-etcd-1;follower(B: etcd-rrsmex-etcd-0 etcd-rrsmex-etcd-2 check cluster connect  `echo 'etcdctl --endpoints=http://etcd-rrsmex-client.ns-uvpun.svc.cluster.local:2379 endpoint health' | kubectl exec -it etcd-rrsmex-etcd-1 --namespace ns-uvpun -- bash`(B  check cluster connect done(B Failed to establish connection 4916: Failed to execute command:java.lang.OutOfMemoryError: unable to create native thread: possibly out of memory or process/resource limits reached Failed to establish connection 4917: Failed to execute command:java.lang.OutOfMemoryError: unable to create native thread: possibly out of memory or process/resource limits reached Failed to establish connection 4918: Failed to execute command:java.lang.OutOfMemoryError: unable to create native thread: possibly out of memory or process/resource limits reached Failed to establish connection 4919: Failed to execute command:java.lang.OutOfMemoryError: unable to create native thread: possibly out of memory or process/resource limits reached Failed to establish connection 4920: Failed to execute command:java.lang.OutOfMemoryError: unable to create native thread: possibly out of memory or process/resource limits reached Failed to establish connection 4921: Failed to execute command:java.lang.OutOfMemoryError: unable to create native thread: possibly out of memory or process/resource limits reached Failed to establish connection 4922: Failed to execute command:java.lang.OutOfMemoryError: unable to create native thread: possibly out of memory or process/resource limits reached Failed to establish connection 4923: Failed to execute command:java.lang.OutOfMemoryError: unable to create native thread: possibly out of memory or process/resource limits reached Failed to establish connection 4924: Failed to execute command:java.lang.OutOfMemoryError: unable to create native thread: possibly out of memory or process/resource limits reached Failed to establish connection 4925: Failed to execute command:java.lang.OutOfMemoryError: unable to create native thread: possibly out of memory or process/resource limits reached Failed to establish connection 4926: Failed to execute command:java.lang.OutOfMemoryError: unable to create native thread: possibly out of memory or process/resource limits reached Failed to establish connection 4927: Failed to execute command:java.lang.OutOfMemoryError: unable to create native thread: possibly out of memory or process/resource limits reached Failed to establish connection 4928: Failed to execute command:java.lang.OutOfMemoryError: unable to create native thread: possibly out of memory or process/resource limits reached Failed to establish connection 4929: Failed to execute command:java.lang.OutOfMemoryError: unable to create native thread: possibly out of memory or process/resource limits reached Failed to establish connection 4930: Failed to execute command:java.lang.OutOfMemoryError: unable to create native thread: possibly out of memory or process/resource limits reached Failed to establish connection 4931: Failed to execute command:java.lang.OutOfMemoryError: unable to create native thread: possibly out of memory or process/resource limits reached Failed to establish connection 4932: Failed to execute command:java.lang.OutOfMemoryError: unable to create native thread: possibly out of memory or process/resource limits reached Failed to establish connection 4933: Failed to execute command:java.lang.OutOfMemoryError: unable to create native thread: possibly out of memory or process/resource limits reached Failed to establish connection 4934: Failed to execute command:java.lang.OutOfMemoryError: unable to create native thread: possibly out of memory or process/resource limits reached Failed to establish connection 4935: Failed to execute command:java.lang.OutOfMemoryError: unable to create native thread: possibly out of memory or process/resource limits reached Failed to establish connection 4936: Failed to execute command:java.lang.OutOfMemoryError: unable to create native thread: possibly out of memory or process/resource limits reached Failed to establish connection 4937: Failed to execute command:java.lang.OutOfMemoryError: unable to create native thread: possibly out of memory or process/resource limits reached Failed to establish connection 4938: Failed to execute command:java.lang.OutOfMemoryError: unable to create native thread: possibly out of memory or process/resource limits reached Failed to establish connection 4939: Failed to execute command:java.lang.OutOfMemoryError: unable to create native thread: possibly out of memory or process/resource limits reached Failed to establish connection 4940: Failed to execute command:java.lang.OutOfMemoryError: unable to create native thread: possibly out of memory or process/resource limits reached Failed to establish connection 4941: Failed to execute command:java.lang.OutOfMemoryError: unable to create native thread: possibly out of memory or process/resource limits reached Failed to establish connection 4942: Failed to execute command:java.lang.OutOfMemoryError: unable to create native thread: possibly out of memory or process/resource limits reached Failed to establish connection 4943: Failed to execute command:java.lang.OutOfMemoryError: unable to create native thread: possibly out of memory or process/resource limits reached Failed to establish connection 4944: Failed to execute command:java.lang.OutOfMemoryError: unable to create native thread: possibly out of memory or process/resource limits reached Failed to establish connection 4945: Failed to execute command:java.lang.OutOfMemoryError: unable to create native thread: possibly out of memory or process/resource limits reached Failed to establish connection 4946: Failed to execute command:java.lang.OutOfMemoryError: unable to create native thread: possibly out of memory or process/resource limits reached Failed to establish connection 4947: Failed to execute command:java.lang.OutOfMemoryError: unable to create native thread: possibly out of memory or process/resource limits reached Failed to establish connection 4948: Failed to execute command:java.lang.OutOfMemoryError: unable to create native thread: possibly out of memory or process/resource limits reached Failed to establish connection 4949: Failed to execute command:java.lang.OutOfMemoryError: unable to create native thread: possibly out of memory or process/resource limits reached Failed to establish connection 4950: Failed to execute command:java.lang.OutOfMemoryError: unable to create native thread: possibly out of memory or process/resource limits reached Failed to establish connection 4951: Failed to execute command:java.lang.OutOfMemoryError: unable to create native thread: possibly out of memory or process/resource limits reached Failed to establish connection 4952: Failed to execute command:java.lang.OutOfMemoryError: unable to create native thread: possibly out of memory or process/resource limits reached Failed to establish connection 4953: Failed to execute command:java.lang.OutOfMemoryError: unable to create native thread: possibly out of memory or process/resource limits reached Failed to establish connection 4954: Failed to execute command:java.lang.OutOfMemoryError: unable to create native thread: possibly out of memory or process/resource limits reached Failed to establish connection 4955: Failed to execute command:java.lang.OutOfMemoryError: unable to create native thread: possibly out of memory or process/resource limits reached Failed to establish connection 4956: Failed to execute command:java.lang.OutOfMemoryError: unable to create native thread: possibly out of memory or process/resource limits reached Failed to establish connection 4957: Failed to execute command:java.lang.OutOfMemoryError: unable to create native thread: possibly out of memory or process/resource limits reached Failed to establish connection 4958: Failed to execute command:java.lang.OutOfMemoryError: unable to create native thread: possibly out of memory or process/resource limits reached Failed to establish connection 4959: Failed to execute command:java.lang.OutOfMemoryError: unable to create native thread: possibly out of memory or process/resource limits reached Failed to establish connection 4960: Failed to execute command:java.lang.OutOfMemoryError: unable to create native thread: possibly out of memory or process/resource limits reached Failed to establish connection 4961: Failed to execute command:java.lang.OutOfMemoryError: unable to create native thread: possibly out of memory or process/resource limits reached Failed to establish connection 4962: Failed to execute command:java.lang.OutOfMemoryError: unable to create native thread: possibly out of memory or process/resource limits reached Failed to establish connection 4963: Failed to execute command:java.lang.OutOfMemoryError: unable to create native thread: possibly out of memory or process/resource limits reached Failed to establish connection 4964: Failed to execute command:java.lang.OutOfMemoryError: unable to create native thread: possibly out of memory or process/resource limits reached Failed to establish connection 4965: Failed to execute command:java.lang.OutOfMemoryError: unable to create native thread: possibly out of memory or process/resource limits reached Failed to establish connection 4966: Failed to execute command:java.lang.OutOfMemoryError: unable to create native thread: possibly out of memory or process/resource limits reached Failed to establish connection 4967: Failed to execute command:java.lang.OutOfMemoryError: unable to create native thread: possibly out of memory or process/resource limits reached Failed to establish connection 4968: Failed to execute command:java.lang.OutOfMemoryError: unable to create native thread: possibly out of memory or process/resource limits reached Failed to establish connection 4969: Failed to execute command:java.lang.OutOfMemoryError: unable to create native thread: possibly out of memory or process/resource limits reached Failed to establish connection 4970: Failed to execute command:java.lang.OutOfMemoryError: unable to create native thread: possibly out of memory or process/resource limits reached Failed to establish connection 4971: Failed to execute command:java.lang.OutOfMemoryError: unable to create native thread: possibly out of memory or process/resource limits reached Failed to establish connection 4972: Failed to execute command:java.lang.OutOfMemoryError: unable to create native thread: possibly out of memory or process/resource limits reached Failed to establish connection 4973: Failed to execute command:java.lang.OutOfMemoryError: unable to create native thread: possibly out of memory or process/resource limits reached Failed to establish connection 4974: Failed to execute command:java.lang.OutOfMemoryError: unable to create native thread: possibly out of memory or process/resource limits reached Failed to establish connection 4975: Failed to execute command:java.lang.OutOfMemoryError: unable to create native thread: possibly out of memory or process/resource limits reached Failed to establish connection 4976: Failed to execute command:java.lang.OutOfMemoryError: unable to create native thread: possibly out of memory or process/resource limits reached Failed to establish connection 4977: Failed to execute command:java.lang.OutOfMemoryError: unable to create native thread: possibly out of memory or process/resource limits reached Failed to establish connection 4978: Failed to execute command:java.lang.OutOfMemoryError: unable to create native thread: possibly out of memory or process/resource limits reached Failed to establish connection 4979: Failed to execute command:java.lang.OutOfMemoryError: unable to create native thread: possibly out of memory or process/resource limits reached Failed to establish connection 4980: Failed to execute command:java.lang.OutOfMemoryError: unable to create native thread: possibly out of memory or process/resource limits reached Failed to establish connection 4981: Failed to execute command:java.lang.OutOfMemoryError: unable to create native thread: possibly out of memory or process/resource limits reached Failed to establish connection 4982: Failed to execute command:java.lang.OutOfMemoryError: unable to create native thread: possibly out of memory or process/resource limits reached Failed to establish connection 4983: Failed to execute command:java.lang.OutOfMemoryError: unable to create native thread: possibly out of memory or process/resource limits reached Failed to establish connection 4984: Failed to execute command:java.lang.OutOfMemoryError: unable to create native thread: possibly out of memory or process/resource limits reached Failed to establish connection 4985: Failed to execute command:java.lang.OutOfMemoryError: unable to create native thread: possibly out of memory or process/resource limits reached Failed to establish connection 4986: Failed to execute command:java.lang.OutOfMemoryError: unable to create native thread: possibly out of memory or process/resource limits reached Failed to establish connection 4987: Failed to execute command:java.lang.OutOfMemoryError: unable to create native thread: possibly out of memory or process/resource limits reached Failed to establish connection 4988: Failed to execute command:java.lang.OutOfMemoryError: unable to create native thread: possibly out of memory or process/resource limits reached Failed to establish connection 4989: Failed to execute command:java.lang.OutOfMemoryError: unable to create native thread: possibly out of memory or process/resource limits reached Failed to establish connection 4990: Failed to execute command:java.lang.OutOfMemoryError: unable to create native thread: possibly out of memory or process/resource limits reached Failed to establish connection 4991: Failed to execute command:java.lang.OutOfMemoryError: unable to create native thread: possibly out of memory or process/resource limits reached Failed to establish connection 4992: Failed to execute command:java.lang.OutOfMemoryError: unable to create native thread: possibly out of memory or process/resource limits reached Failed to establish connection 4993: Failed to execute command:java.lang.OutOfMemoryError: unable to create native thread: possibly out of memory or process/resource limits reached Failed to establish connection 4994: Failed to execute command:java.lang.OutOfMemoryError: unable to create native thread: possibly out of memory or process/resource limits reached Failed to establish connection 4995: Failed to execute command:java.lang.OutOfMemoryError: unable to create native thread: possibly out of memory or process/resource limits reached Failed to establish connection 4996: Failed to execute command:java.lang.OutOfMemoryError: unable to create native thread: possibly out of memory or process/resource limits reached Failed to establish connection 4997: Failed to execute command:java.lang.OutOfMemoryError: unable to create native thread: possibly out of memory or process/resource limits reached Failed to establish connection 4998: Failed to execute command:java.lang.OutOfMemoryError: unable to create native thread: possibly out of memory or process/resource limits reached Failed to establish connection 4999: Failed to execute command:java.lang.OutOfMemoryError: unable to create native thread: possibly out of memory or process/resource limits reached Connection stress test completed: Successful connections: 5000 Duration: 30 seconds Connection Information: Database Type: etcd Host: etcd-rrsmex-client.ns-uvpun.svc.cluster.local Port: 2379 Database: Table: User: Org: Access Mode: mysql Test Type: connectionstress Connection Count: 5000 Duration: 60 seconds  `kubectl patch -p '{"metadata":{"finalizers":[]}}' --type=merge pods test-db-client-connectionstress-etcd-rrsmex --namespace ns-uvpun `(B  pod/test-db-client-connectionstress-etcd-rrsmex patched (no change) pod "test-db-client-connectionstress-etcd-rrsmex" force deleted check failover pod name failover pod name:etcd-rrsmex-etcd-1 failover connectionstress Success(B check db_client batch data count  `echo "etcdctl --endpoints=http://etcd-rrsmex-client.ns-uvpun.svc.cluster.local:2379 get --prefix \"executions_loop_key\" --keys-only | (grep executions_loop_key || true) | wc -l " | kubectl exec -it etcd-rrsmex-etcd-1 --namespace ns-uvpun -- bash `(B  check db_client batch [4404] equal [4404] data Success(B check readonly db_client batch data count  `echo "etcdctl --endpoints=http://etcd-rrsmex-client.ns-uvpun.svc.cluster.local:2379 get --prefix \"executions_loop_key\" --keys-only | (grep executions_loop_key || true) | wc -l " | kubectl exec -it etcd-rrsmex-etcd-0 --namespace ns-uvpun -- bash `(B  check readonly db_client batch data [4404] equal [4404] Success(B cluster etcd scale-out cluster etcd scale-out replicas: 3 check cluster status before ops check cluster status done(B cluster_status:Running(B  `kbcli cluster scale-out etcd-rrsmex --auto-approve --force=true --components etcd --replicas 1 --namespace ns-uvpun `(B  OpsRequest etcd-rrsmex-horizontalscaling-nkf57 created successfully, you can view the progress: kbcli cluster describe-ops etcd-rrsmex-horizontalscaling-nkf57 -n ns-uvpun check ops status  `kbcli cluster list-ops etcd-rrsmex --status all --namespace ns-uvpun `(B  NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME etcd-rrsmex-horizontalscaling-nkf57 ns-uvpun HorizontalScaling etcd-rrsmex etcd Running 0/1 Feb 12,2026 10:28 UTC+0800 check cluster status  `kbcli cluster list etcd-rrsmex --show-labels --namespace ns-uvpun `(B  NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS etcd-rrsmex ns-uvpun Delete Updating Feb 12,2026 10:05 UTC+0800 app.kubernetes.io/instance=etcd-rrsmex cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B check cluster status done(B cluster_status:Running(B check pod status  `kbcli cluster list-instances etcd-rrsmex --namespace ns-uvpun `(B  NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME etcd-rrsmex-etcd-0 ns-uvpun etcd-rrsmex etcd Running follower 0 200m / 200m 644245094400m / 644245094400m data:1Gi aks-cicdamdpool-17242166-vmss000001/10.224.0.8 Feb 12,2026 10:24 UTC+0800 etcd-rrsmex-etcd-1 ns-uvpun etcd-rrsmex etcd Running leader 0 200m / 200m 644245094400m / 644245094400m data:1Gi aks-cicdamdpool-17242166-vmss000000/10.224.0.9 Feb 12,2026 10:23 UTC+0800 etcd-rrsmex-etcd-2 ns-uvpun etcd-rrsmex etcd Running follower 0 200m / 200m 644245094400m / 644245094400m data:1Gi aks-cicdamdpool-17242166-vmss000003/10.224.0.6 Feb 12,2026 10:21 UTC+0800 etcd-rrsmex-etcd-3 ns-uvpun etcd-rrsmex etcd Running follower 0 200m / 200m 644245094400m / 644245094400m data:1Gi aks-default-27607381-vmss000000/10.224.0.4 Feb 12,2026 10:28 UTC+0800 check pod status done(B check cluster role check cluster role done(B leader(B: etcd-rrsmex-etcd-1;follower(B: etcd-rrsmex-etcd-0 etcd-rrsmex-etcd-2 etcd-rrsmex-etcd-3 check cluster connect  `echo 'etcdctl --endpoints=http://etcd-rrsmex-client.ns-uvpun.svc.cluster.local:2379 endpoint health' | kubectl exec -it etcd-rrsmex-etcd-1 --namespace ns-uvpun -- bash`(B  check cluster connect done(B check ops status  `kbcli cluster list-ops etcd-rrsmex --status all --namespace ns-uvpun `(B  NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME etcd-rrsmex-horizontalscaling-nkf57 ns-uvpun HorizontalScaling etcd-rrsmex etcd Succeed 1/1 Feb 12,2026 10:28 UTC+0800 check ops status done(B ops_status:etcd-rrsmex-horizontalscaling-nkf57 ns-uvpun HorizontalScaling etcd-rrsmex etcd Succeed 1/1 Feb 12,2026 10:28 UTC+0800 (B  `kubectl patch -p '{"metadata":{"finalizers":[]}}' --type=merge opsrequests.operations etcd-rrsmex-horizontalscaling-nkf57 --namespace ns-uvpun `(B  opsrequest.operations.kubeblocks.io/etcd-rrsmex-horizontalscaling-nkf57 patched  `kbcli cluster delete-ops --name etcd-rrsmex-horizontalscaling-nkf57 --force --auto-approve --namespace ns-uvpun `(B  OpsRequest etcd-rrsmex-horizontalscaling-nkf57 deleted check db_client batch data count  `echo "etcdctl --endpoints=http://etcd-rrsmex-client.ns-uvpun.svc.cluster.local:2379 get --prefix \"executions_loop_key\" --keys-only | (grep executions_loop_key || true) | wc -l " | kubectl exec -it etcd-rrsmex-etcd-1 --namespace ns-uvpun -- bash `(B  check db_client batch [4404] equal [4404] data Success(B check readonly db_client batch data count  `echo "etcdctl --endpoints=http://etcd-rrsmex-client.ns-uvpun.svc.cluster.local:2379 get --prefix \"executions_loop_key\" --keys-only | (grep executions_loop_key || true) | wc -l " | kubectl exec -it etcd-rrsmex-etcd-0 --namespace ns-uvpun -- bash `(B  check readonly db_client batch data [4404] equal [4404] Success(B cluster etcd scale-in cluster etcd scale-in replicas: 2 check cluster status before ops check cluster status done(B cluster_status:Running(B  `kbcli cluster scale-in etcd-rrsmex --auto-approve --force=true --components etcd --replicas 1 --namespace ns-uvpun `(B  OpsRequest etcd-rrsmex-horizontalscaling-6lbtg created successfully, you can view the progress: kbcli cluster describe-ops etcd-rrsmex-horizontalscaling-6lbtg -n ns-uvpun check ops status  `kbcli cluster list-ops etcd-rrsmex --status all --namespace ns-uvpun `(B  NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME etcd-rrsmex-horizontalscaling-6lbtg ns-uvpun HorizontalScaling etcd-rrsmex etcd Creating -/- Feb 12,2026 10:29 UTC+0800 check cluster status  `kbcli cluster list etcd-rrsmex --show-labels --namespace ns-uvpun `(B  NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS etcd-rrsmex ns-uvpun Delete Running Feb 12,2026 10:05 UTC+0800 app.kubernetes.io/instance=etcd-rrsmex check cluster status done(B cluster_status:Running(B check pod status  `kbcli cluster list-instances etcd-rrsmex --namespace ns-uvpun `(B  NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME etcd-rrsmex-etcd-0 ns-uvpun etcd-rrsmex etcd Running follower 0 200m / 200m 644245094400m / 644245094400m data:1Gi aks-cicdamdpool-17242166-vmss000001/10.224.0.8 Feb 12,2026 10:24 UTC+0800 etcd-rrsmex-etcd-1 ns-uvpun etcd-rrsmex etcd Running leader 0 200m / 200m 644245094400m / 644245094400m data:1Gi aks-cicdamdpool-17242166-vmss000000/10.224.0.9 Feb 12,2026 10:23 UTC+0800 etcd-rrsmex-etcd-2 ns-uvpun etcd-rrsmex etcd Running follower 0 200m / 200m 644245094400m / 644245094400m data:1Gi aks-cicdamdpool-17242166-vmss000003/10.224.0.6 Feb 12,2026 10:21 UTC+0800 check pod status done(B check cluster role check cluster role done(B leader(B: etcd-rrsmex-etcd-1;follower(B: etcd-rrsmex-etcd-0 etcd-rrsmex-etcd-2 check cluster connect  `echo 'etcdctl --endpoints=http://etcd-rrsmex-client.ns-uvpun.svc.cluster.local:2379 endpoint health' | kubectl exec -it etcd-rrsmex-etcd-1 --namespace ns-uvpun -- bash`(B  check cluster connect done(B check ops status  `kbcli cluster list-ops etcd-rrsmex --status all --namespace ns-uvpun `(B  NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME etcd-rrsmex-horizontalscaling-6lbtg ns-uvpun HorizontalScaling etcd-rrsmex etcd Succeed 1/1 Feb 12,2026 10:29 UTC+0800 check ops status done(B ops_status:etcd-rrsmex-horizontalscaling-6lbtg ns-uvpun HorizontalScaling etcd-rrsmex etcd Succeed 1/1 Feb 12,2026 10:29 UTC+0800 (B  `kubectl patch -p '{"metadata":{"finalizers":[]}}' --type=merge opsrequests.operations etcd-rrsmex-horizontalscaling-6lbtg --namespace ns-uvpun `(B  opsrequest.operations.kubeblocks.io/etcd-rrsmex-horizontalscaling-6lbtg patched  `kbcli cluster delete-ops --name etcd-rrsmex-horizontalscaling-6lbtg --force --auto-approve --namespace ns-uvpun `(B  OpsRequest etcd-rrsmex-horizontalscaling-6lbtg deleted check db_client batch data count  `echo "etcdctl --endpoints=http://etcd-rrsmex-client.ns-uvpun.svc.cluster.local:2379 get --prefix \"executions_loop_key\" --keys-only | (grep executions_loop_key || true) | wc -l " | kubectl exec -it etcd-rrsmex-etcd-1 --namespace ns-uvpun -- bash `(B  check db_client batch [4404] equal [4404] data Success(B check readonly db_client batch data count  `echo "etcdctl --endpoints=http://etcd-rrsmex-client.ns-uvpun.svc.cluster.local:2379 get --prefix \"executions_loop_key\" --keys-only | (grep executions_loop_key || true) | wc -l " | kubectl exec -it etcd-rrsmex-etcd-0 --namespace ns-uvpun -- bash `(B  check readonly db_client batch data [4404] equal [4404] Success(B cluster stop check cluster status before ops check cluster status done(B cluster_status:Running(B  `kbcli cluster stop etcd-rrsmex --auto-approve --force=true --namespace ns-uvpun `(B  OpsRequest etcd-rrsmex-stop-sxffj created successfully, you can view the progress: kbcli cluster describe-ops etcd-rrsmex-stop-sxffj -n ns-uvpun check ops status  `kbcli cluster list-ops etcd-rrsmex --status all --namespace ns-uvpun `(B  NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME etcd-rrsmex-stop-sxffj ns-uvpun Stop etcd-rrsmex etcd Running 0/3 Feb 12,2026 10:30 UTC+0800 check cluster status  `kbcli cluster list etcd-rrsmex --show-labels --namespace ns-uvpun `(B  NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS etcd-rrsmex ns-uvpun Delete Stopped Feb 12,2026 10:05 UTC+0800 app.kubernetes.io/instance=etcd-rrsmex check cluster status done(B cluster_status:Stopped(B check pod status  `kbcli cluster list-instances etcd-rrsmex --namespace ns-uvpun `(B  NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME check pod status done(B check ops status  `kbcli cluster list-ops etcd-rrsmex --status all --namespace ns-uvpun `(B  NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME etcd-rrsmex-stop-sxffj ns-uvpun Stop etcd-rrsmex etcd Succeed 3/3 Feb 12,2026 10:30 UTC+0800 check ops status done(B ops_status:etcd-rrsmex-stop-sxffj ns-uvpun Stop etcd-rrsmex etcd Succeed 3/3 Feb 12,2026 10:30 UTC+0800 (B  `kubectl patch -p '{"metadata":{"finalizers":[]}}' --type=merge opsrequests.operations etcd-rrsmex-stop-sxffj --namespace ns-uvpun `(B  opsrequest.operations.kubeblocks.io/etcd-rrsmex-stop-sxffj patched  `kbcli cluster delete-ops --name etcd-rrsmex-stop-sxffj --force --auto-approve --namespace ns-uvpun `(B  OpsRequest etcd-rrsmex-stop-sxffj deleted cluster start check cluster status before ops check cluster status done(B cluster_status:Stopped(B  `kbcli cluster start etcd-rrsmex --force=true --namespace ns-uvpun `(B  OpsRequest etcd-rrsmex-start-swn8z created successfully, you can view the progress: kbcli cluster describe-ops etcd-rrsmex-start-swn8z -n ns-uvpun check ops status  `kbcli cluster list-ops etcd-rrsmex --status all --namespace ns-uvpun `(B  NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME etcd-rrsmex-start-swn8z ns-uvpun Start etcd-rrsmex etcd Running 0/3 Feb 12,2026 10:30 UTC+0800 check cluster status  `kbcli cluster list etcd-rrsmex --show-labels --namespace ns-uvpun `(B  NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS etcd-rrsmex ns-uvpun Delete Updating Feb 12,2026 10:05 UTC+0800 app.kubernetes.io/instance=etcd-rrsmex cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B check cluster status done(B cluster_status:Running(B check pod status  `kbcli cluster list-instances etcd-rrsmex --namespace ns-uvpun `(B  NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME etcd-rrsmex-etcd-0 ns-uvpun etcd-rrsmex etcd Running follower 0 200m / 200m 644245094400m / 644245094400m data:1Gi aks-cicdamdpool-17242166-vmss000003/10.224.0.6 Feb 12,2026 10:30 UTC+0800 etcd-rrsmex-etcd-1 ns-uvpun etcd-rrsmex etcd Running leader 0 200m / 200m 644245094400m / 644245094400m data:1Gi aks-cicdamdpool-17242166-vmss000000/10.224.0.9 Feb 12,2026 10:34 UTC+0800 etcd-rrsmex-etcd-2 ns-uvpun etcd-rrsmex etcd Running follower 0 200m / 200m 644245094400m / 644245094400m data:1Gi aks-cicdamdpool-17242166-vmss000001/10.224.0.8 Feb 12,2026 10:36 UTC+0800 check pod status done(B check cluster role check cluster role done(B leader(B: etcd-rrsmex-etcd-1;follower(B: etcd-rrsmex-etcd-0 etcd-rrsmex-etcd-2 check cluster connect  `echo 'etcdctl --endpoints=http://etcd-rrsmex-client.ns-uvpun.svc.cluster.local:2379 endpoint health' | kubectl exec -it etcd-rrsmex-etcd-1 --namespace ns-uvpun -- bash`(B  check cluster connect done(B check ops status  `kbcli cluster list-ops etcd-rrsmex --status all --namespace ns-uvpun `(B  NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME etcd-rrsmex-start-swn8z ns-uvpun Start etcd-rrsmex etcd Succeed 3/3 Feb 12,2026 10:30 UTC+0800 check ops status done(B ops_status:etcd-rrsmex-start-swn8z ns-uvpun Start etcd-rrsmex etcd Succeed 3/3 Feb 12,2026 10:30 UTC+0800 (B  `kubectl patch -p '{"metadata":{"finalizers":[]}}' --type=merge opsrequests.operations etcd-rrsmex-start-swn8z --namespace ns-uvpun `(B  opsrequest.operations.kubeblocks.io/etcd-rrsmex-start-swn8z patched  `kbcli cluster delete-ops --name etcd-rrsmex-start-swn8z --force --auto-approve --namespace ns-uvpun `(B  OpsRequest etcd-rrsmex-start-swn8z deleted check db_client batch data count  `echo "etcdctl --endpoints=http://etcd-rrsmex-client.ns-uvpun.svc.cluster.local:2379 get --prefix \"executions_loop_key\" --keys-only | (grep executions_loop_key || true) | wc -l " | kubectl exec -it etcd-rrsmex-etcd-1 --namespace ns-uvpun -- bash `(B  check db_client batch [4404] equal [4404] data Success(B check readonly db_client batch data count  `echo "etcdctl --endpoints=http://etcd-rrsmex-client.ns-uvpun.svc.cluster.local:2379 get --prefix \"executions_loop_key\" --keys-only | (grep executions_loop_key || true) | wc -l " | kubectl exec -it etcd-rrsmex-etcd-0 --namespace ns-uvpun -- bash `(B  check readonly db_client batch data [4404] equal [4404] Success(B  `kubectl get pvc -l app.kubernetes.io/instance=etcd-rrsmex,apps.kubeblocks.io/component-name=etcd,apps.kubeblocks.io/vct-name=data --namespace ns-uvpun `(B  cluster volume-expand check cluster status before ops check cluster status done(B cluster_status:Running(B  `kbcli cluster volume-expand etcd-rrsmex --auto-approve --force=true --components etcd --volume-claim-templates data --storage 3Gi --namespace ns-uvpun `(B  OpsRequest etcd-rrsmex-volumeexpansion-zhtj4 created successfully, you can view the progress: kbcli cluster describe-ops etcd-rrsmex-volumeexpansion-zhtj4 -n ns-uvpun check ops status  `kbcli cluster list-ops etcd-rrsmex --status all --namespace ns-uvpun `(B  NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME etcd-rrsmex-volumeexpansion-zhtj4 ns-uvpun VolumeExpansion etcd-rrsmex etcd Running -/- Feb 12,2026 10:38 UTC+0800 check cluster status  `kbcli cluster list etcd-rrsmex --show-labels --namespace ns-uvpun `(B  NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS etcd-rrsmex ns-uvpun Delete Updating Feb 12,2026 10:05 UTC+0800 app.kubernetes.io/instance=etcd-rrsmex cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B check cluster status done(B cluster_status:Running(B check pod status  `kbcli cluster list-instances etcd-rrsmex --namespace ns-uvpun `(B  NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME etcd-rrsmex-etcd-0 ns-uvpun etcd-rrsmex etcd Running follower 0 200m / 200m 644245094400m / 644245094400m data:3Gi aks-cicdamdpool-17242166-vmss000003/10.224.0.6 Feb 12,2026 10:30 UTC+0800 etcd-rrsmex-etcd-1 ns-uvpun etcd-rrsmex etcd Running leader 0 200m / 200m 644245094400m / 644245094400m data:3Gi aks-cicdamdpool-17242166-vmss000000/10.224.0.9 Feb 12,2026 10:34 UTC+0800 etcd-rrsmex-etcd-2 ns-uvpun etcd-rrsmex etcd Running follower 0 200m / 200m 644245094400m / 644245094400m data:3Gi aks-cicdamdpool-17242166-vmss000001/10.224.0.8 Feb 12,2026 10:36 UTC+0800 check pod status done(B check cluster role check cluster role done(B leader(B: etcd-rrsmex-etcd-1;follower(B: etcd-rrsmex-etcd-0 etcd-rrsmex-etcd-2 check cluster connect  `echo 'etcdctl --endpoints=http://etcd-rrsmex-client.ns-uvpun.svc.cluster.local:2379 endpoint health' | kubectl exec -it etcd-rrsmex-etcd-1 --namespace ns-uvpun -- bash`(B  check cluster connect done(B check ops status  `kbcli cluster list-ops etcd-rrsmex --status all --namespace ns-uvpun `(B  NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME etcd-rrsmex-volumeexpansion-zhtj4 ns-uvpun VolumeExpansion etcd-rrsmex etcd Succeed 3/3 Feb 12,2026 10:38 UTC+0800 check ops status done(B ops_status:etcd-rrsmex-volumeexpansion-zhtj4 ns-uvpun VolumeExpansion etcd-rrsmex etcd Succeed 3/3 Feb 12,2026 10:38 UTC+0800 (B  `kubectl patch -p '{"metadata":{"finalizers":[]}}' --type=merge opsrequests.operations etcd-rrsmex-volumeexpansion-zhtj4 --namespace ns-uvpun `(B  opsrequest.operations.kubeblocks.io/etcd-rrsmex-volumeexpansion-zhtj4 patched  `kbcli cluster delete-ops --name etcd-rrsmex-volumeexpansion-zhtj4 --force --auto-approve --namespace ns-uvpun `(B  OpsRequest etcd-rrsmex-volumeexpansion-zhtj4 deleted check db_client batch data count  `echo "etcdctl --endpoints=http://etcd-rrsmex-client.ns-uvpun.svc.cluster.local:2379 get --prefix \"executions_loop_key\" --keys-only | (grep executions_loop_key || true) | wc -l " | kubectl exec -it etcd-rrsmex-etcd-1 --namespace ns-uvpun -- bash `(B  check db_client batch [4404] equal [4404] data Success(B check readonly db_client batch data count  `echo "etcdctl --endpoints=http://etcd-rrsmex-client.ns-uvpun.svc.cluster.local:2379 get --prefix \"executions_loop_key\" --keys-only | (grep executions_loop_key || true) | wc -l " | kubectl exec -it etcd-rrsmex-etcd-0 --namespace ns-uvpun -- bash `(B  check readonly db_client batch data [4404] equal [4404] Success(B test failover (B check cluster status before cluster-failover- check cluster status done(B cluster_status:Running(B delete pod:etcd-rrsmex-etcd-1  `kubectl delete pod etcd-rrsmex-etcd-1 --force --namespace ns-uvpun `(B  pod "etcd-rrsmex-etcd-1" force deleted check cluster status  `kbcli cluster list etcd-rrsmex --show-labels --namespace ns-uvpun `(B  NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS etcd-rrsmex ns-uvpun Delete Running Feb 12,2026 10:05 UTC+0800 app.kubernetes.io/instance=etcd-rrsmex check cluster status done(B cluster_status:Running(B check pod status  `kbcli cluster list-instances etcd-rrsmex --namespace ns-uvpun `(B  NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME etcd-rrsmex-etcd-0 ns-uvpun etcd-rrsmex etcd Running follower 0 200m / 200m 644245094400m / 644245094400m data:3Gi aks-cicdamdpool-17242166-vmss000003/10.224.0.6 Feb 12,2026 10:30 UTC+0800 etcd-rrsmex-etcd-1 ns-uvpun etcd-rrsmex etcd Init:0/3 0 200m / 200m 644245094400m / 644245094400m data:3Gi aks-cicdamdpool-17242166-vmss000000/10.224.0.9 Feb 12,2026 11:05 UTC+0800 etcd-rrsmex-etcd-2 ns-uvpun etcd-rrsmex etcd Running follower 0 200m / 200m 644245094400m / 644245094400m data:3Gi aks-cicdamdpool-17242166-vmss000001/10.224.0.8 Feb 12,2026 10:36 UTC+0800 pod_status:Init:0/3(B pod_status:PodInitializing(B check pod status done(B check cluster role check cluster role done(B leader(B: etcd-rrsmex-etcd-0;follower(B: etcd-rrsmex-etcd-2 check cluster connect  `echo 'etcdctl --endpoints=http://etcd-rrsmex-client.ns-uvpun.svc.cluster.local:2379 endpoint health' | kubectl exec -it etcd-rrsmex-etcd-0 --namespace ns-uvpun -- bash`(B  check cluster connect done(B check failover pod name failover pod name:etcd-rrsmex-etcd-0 failover Success(B check db_client batch data count  `echo "etcdctl --endpoints=http://etcd-rrsmex-client.ns-uvpun.svc.cluster.local:2379 get --prefix \"executions_loop_key\" --keys-only | (grep executions_loop_key || true) | wc -l " | kubectl exec -it etcd-rrsmex-etcd-0 --namespace ns-uvpun -- bash `(B  check db_client batch [4404] equal [4404] data Success(B check readonly db_client batch data count  `echo "etcdctl --endpoints=http://etcd-rrsmex-client.ns-uvpun.svc.cluster.local:2379 get --prefix \"executions_loop_key\" --keys-only | (grep executions_loop_key || true) | wc -l " | kubectl exec -it etcd-rrsmex-etcd-2 --namespace ns-uvpun -- bash `(B  check readonly db_client batch data [4404] equal [4404] Success(B test switchover(B cluster promote check cluster status before ops cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B check cluster status done(B cluster_status:Running(B  `kbcli cluster promote etcd-rrsmex --auto-approve --force=true --instance etcd-rrsmex-etcd-0 --candidate etcd-rrsmex-etcd-2 --namespace ns-uvpun `(B  OpsRequest etcd-rrsmex-switchover-ddl2r created successfully, you can view the progress: kbcli cluster describe-ops etcd-rrsmex-switchover-ddl2r -n ns-uvpun check ops status  `kbcli cluster list-ops etcd-rrsmex --status all --namespace ns-uvpun `(B  NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME etcd-rrsmex-switchover-ddl2r ns-uvpun Switchover etcd-rrsmex etcd-rrsmex-etcd Running -/- Feb 12,2026 11:06 UTC+0800 check cluster status  `kbcli cluster list etcd-rrsmex --show-labels --namespace ns-uvpun `(B  NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS etcd-rrsmex ns-uvpun Delete Running Feb 12,2026 10:05 UTC+0800 app.kubernetes.io/instance=etcd-rrsmex check cluster status done(B cluster_status:Running(B check pod status  `kbcli cluster list-instances etcd-rrsmex --namespace ns-uvpun `(B  NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME etcd-rrsmex-etcd-0 ns-uvpun etcd-rrsmex etcd Running leader 0 200m / 200m 644245094400m / 644245094400m data:3Gi aks-cicdamdpool-17242166-vmss000003/10.224.0.6 Feb 12,2026 10:30 UTC+0800 etcd-rrsmex-etcd-1 ns-uvpun etcd-rrsmex etcd Running follower 0 200m / 200m 644245094400m / 644245094400m data:3Gi aks-cicdamdpool-17242166-vmss000000/10.224.0.9 Feb 12,2026 11:05 UTC+0800 etcd-rrsmex-etcd-2 ns-uvpun etcd-rrsmex etcd Running follower 0 200m / 200m 644245094400m / 644245094400m data:3Gi aks-cicdamdpool-17242166-vmss000001/10.224.0.8 Feb 12,2026 10:36 UTC+0800 check pod status done(B check cluster role check cluster role done(B leader(B: etcd-rrsmex-etcd-0;follower(B: etcd-rrsmex-etcd-1 etcd-rrsmex-etcd-2 check cluster connect  `echo 'etcdctl --endpoints=http://etcd-rrsmex-client.ns-uvpun.svc.cluster.local:2379 endpoint health' | kubectl exec -it etcd-rrsmex-etcd-0 --namespace ns-uvpun -- bash`(B  check cluster connect done(B check ops status  `kbcli cluster list-ops etcd-rrsmex --status all --namespace ns-uvpun `(B  NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME etcd-rrsmex-switchover-ddl2r ns-uvpun Switchover etcd-rrsmex etcd-rrsmex-etcd Running 0/1 Feb 12,2026 11:06 UTC+0800 ops_status:etcd-rrsmex-switchover-ddl2r ns-uvpun Switchover etcd-rrsmex etcd-rrsmex-etcd Running 0/1 Feb 12,2026 11:06 UTC+0800 (B check ops status done(B ops_status:etcd-rrsmex-switchover-ddl2r ns-uvpun Switchover etcd-rrsmex etcd-rrsmex-etcd Succeed 1/1 Feb 12,2026 11:06 UTC+0800 (B  `kubectl patch -p '{"metadata":{"finalizers":[]}}' --type=merge opsrequests.operations etcd-rrsmex-switchover-ddl2r --namespace ns-uvpun `(B  opsrequest.operations.kubeblocks.io/etcd-rrsmex-switchover-ddl2r patched  `kbcli cluster delete-ops --name etcd-rrsmex-switchover-ddl2r --force --auto-approve --namespace ns-uvpun `(B  OpsRequest etcd-rrsmex-switchover-ddl2r deleted check db_client batch data count  `echo "etcdctl --endpoints=http://etcd-rrsmex-client.ns-uvpun.svc.cluster.local:2379 get --prefix \"executions_loop_key\" --keys-only | (grep executions_loop_key || true) | wc -l " | kubectl exec -it etcd-rrsmex-etcd-0 --namespace ns-uvpun -- bash `(B  check db_client batch [4404] equal [4404] data Success(B check readonly db_client batch data count  `echo "etcdctl --endpoints=http://etcd-rrsmex-client.ns-uvpun.svc.cluster.local:2379 get --prefix \"executions_loop_key\" --keys-only | (grep executions_loop_key || true) | wc -l " | kubectl exec -it etcd-rrsmex-etcd-1 --namespace ns-uvpun -- bash `(B  check readonly db_client batch data [4404] equal [4404] Success(B switchover pod:etcd-rrsmex-etcd-0 checking switchover...(B switchover pod:etcd-rrsmex-etcd-0 checking switchover...(B switchover pod:etcd-rrsmex-etcd-0 checking switchover...(B switchover pod:etcd-rrsmex-etcd-0 checking switchover...(B switchover pod:etcd-rrsmex-etcd-0 checking switchover...(B switchover pod:etcd-rrsmex-etcd-0 checking switchover...(B switchover pod:etcd-rrsmex-etcd-0 checking switchover...(B switchover pod:etcd-rrsmex-etcd-0 checking switchover...(B switchover pod:etcd-rrsmex-etcd-0 checking switchover...(B switchover pod:etcd-rrsmex-etcd-0 checking switchover...(B switchover pod:etcd-rrsmex-etcd-0 checking switchover...(B switchover pod:etcd-rrsmex-etcd-0 checking switchover...(B switchover pod:etcd-rrsmex-etcd-0 checking switchover...(B switchover pod:etcd-rrsmex-etcd-0 checking switchover...(B switchover pod:etcd-rrsmex-etcd-0 checking switchover...(B switchover pod:etcd-rrsmex-etcd-0 checking switchover...(B switchover pod:etcd-rrsmex-etcd-0 checking switchover...(B switchover pod:etcd-rrsmex-etcd-0 checking switchover...(B switchover pod:etcd-rrsmex-etcd-0 checking switchover...(B switchover pod:etcd-rrsmex-etcd-0 checking switchover...(B switchover pod:etcd-rrsmex-etcd-0 checking switchover...(B switchover pod:etcd-rrsmex-etcd-0 checking switchover...(B switchover pod:etcd-rrsmex-etcd-0 checking switchover...(B switchover pod:etcd-rrsmex-etcd-0 checking switchover...(B switchover pod:etcd-rrsmex-etcd-0 checking switchover...(B switchover pod:etcd-rrsmex-etcd-0 checking switchover...(B switchover pod:etcd-rrsmex-etcd-0 checking switchover...(B switchover pod:etcd-rrsmex-etcd-0 checking switchover...(B switchover pod:etcd-rrsmex-etcd-0 checking switchover...(B switchover pod:etcd-rrsmex-etcd-0 checking switchover...(B switchover pod:etcd-rrsmex-etcd-0 checking switchover...(B switchover pod:etcd-rrsmex-etcd-0 checking switchover...(B switchover pod:etcd-rrsmex-etcd-2 switchover success(B cluster update terminationPolicy WipeOut  `kbcli cluster update etcd-rrsmex --termination-policy=WipeOut --namespace ns-uvpun `(B  cluster.apps.kubeblocks.io/etcd-rrsmex updated check cluster status  `kbcli cluster list etcd-rrsmex --show-labels --namespace ns-uvpun `(B  NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS etcd-rrsmex ns-uvpun WipeOut Running Feb 12,2026 10:05 UTC+0800 app.kubernetes.io/instance=etcd-rrsmex check cluster status done(B cluster_status:Running(B check pod status  `kbcli cluster list-instances etcd-rrsmex --namespace ns-uvpun `(B  NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME etcd-rrsmex-etcd-0 ns-uvpun etcd-rrsmex etcd Running follower 0 200m / 200m 644245094400m / 644245094400m data:3Gi aks-cicdamdpool-17242166-vmss000003/10.224.0.6 Feb 12,2026 10:30 UTC+0800 etcd-rrsmex-etcd-1 ns-uvpun etcd-rrsmex etcd Running follower 0 200m / 200m 644245094400m / 644245094400m data:3Gi aks-cicdamdpool-17242166-vmss000000/10.224.0.9 Feb 12,2026 11:05 UTC+0800 etcd-rrsmex-etcd-2 ns-uvpun etcd-rrsmex etcd Running leader 0 200m / 200m 644245094400m / 644245094400m data:3Gi aks-cicdamdpool-17242166-vmss000001/10.224.0.8 Feb 12,2026 10:36 UTC+0800 check pod status done(B check cluster role check cluster role done(B leader(B: etcd-rrsmex-etcd-2;follower(B: etcd-rrsmex-etcd-0 etcd-rrsmex-etcd-1 check cluster connect  `echo 'etcdctl --endpoints=http://etcd-rrsmex-client.ns-uvpun.svc.cluster.local:2379 endpoint health' | kubectl exec -it etcd-rrsmex-etcd-2 --namespace ns-uvpun -- bash`(B  check cluster connect done(B cluster datafile backup  `kubectl get backuprepo backuprepo-kbcli-test -o jsonpath="{.spec.credential.name}"`(B   `kubectl get backuprepo backuprepo-kbcli-test -o jsonpath="{.spec.credential.namespace}"`(B   `kubectl get secrets kb-backuprepo-njfcd -n kb-qqsns -o jsonpath="{.data.accessKeyId}"`(B   `kubectl get secrets kb-backuprepo-njfcd -n kb-qqsns -o jsonpath="{.data.secretAccessKey}"`(B  KUBEBLOCKS NAMESPACE:kb-qqsns get kubeblocks namespace done(B  `kubectl get secrets -l app.kubernetes.io/instance=kbcli-test-minio --namespace kb-qqsns -o jsonpath="{.items[0].data.root-user}"`(B   `kubectl get secrets -l app.kubernetes.io/instance=kbcli-test-minio --namespace kb-qqsns -o jsonpath="{.items[0].data.root-password}"`(B  minio_user:kbclitest,minio_password:kbclitest,minio_endpoint:kbcli-test-minio.kb-qqsns.svc.cluster.local:9000 list minio bucket kbcli-test  `echo 'mc alias set minioserver http://kbcli-test-minio.kb-qqsns.svc.cluster.local:9000 kbclitest kbclitest;mc ls minioserver' | kubectl exec -it kbcli-test-minio-557dc6b665-8qwr5 --namespace kb-qqsns -- bash`(B  list minio bucket done(B default backuprepo:backuprepo-kbcli-test exists(B  `kbcli cluster backup etcd-rrsmex --method datafile --namespace ns-uvpun `(B  Backup backup-ns-uvpun-etcd-rrsmex-20260212110802 created successfully, you can view the progress: kbcli cluster list-backups --names=backup-ns-uvpun-etcd-rrsmex-20260212110802 -n ns-uvpun check backup status  `kbcli cluster list-backups etcd-rrsmex --namespace ns-uvpun `(B  NAME NAMESPACE SOURCE-CLUSTER METHOD STATUS TOTAL-SIZE DURATION DELETION-POLICY CREATE-TIME COMPLETION-TIME EXPIRATION backup-ns-uvpun-etcd-rrsmex-20260212110802 ns-uvpun etcd-rrsmex datafile Delete Feb 12,2026 11:08 UTC+0800 backup_status:etcd-rrsmex-datafile-Running(B backup_status:etcd-rrsmex-datafile-Running(B backup_status:etcd-rrsmex-datafile-Running(B check backup status done(B backup_status:backup-ns-uvpun-etcd-rrsmex-20260212110802 ns-uvpun etcd-rrsmex datafile Completed 51626 10s Delete Feb 12,2026 11:08 UTC+0800 Feb 12,2026 11:08 UTC+0800 (B cluster restore backup  `kbcli cluster describe-backup --names backup-ns-uvpun-etcd-rrsmex-20260212110802 --namespace ns-uvpun `(B  Name: backup-ns-uvpun-etcd-rrsmex-20260212110802 Cluster: etcd-rrsmex Namespace: ns-uvpun Spec: Method: datafile Policy Name: etcd-rrsmex-etcd-backup-policy Actions: dp-backup-0: ActionType: Job WorkloadName: dp-backup-0-backup-ns-uvpun-etcd-rrsmex-20260212110802-b685adea TargetPodName: etcd-rrsmex-etcd-2 Phase: Completed Start Time: Feb 12,2026 11:08 UTC+0800 Completion Time: Feb 12,2026 11:08 UTC+0800 Status: Phase: Completed Total Size: 51626 ActionSet Name: etcdctl-br Repository: backuprepo-kbcli-test Duration: 10s Start Time: Feb 12,2026 11:08 UTC+0800 Completion Time: Feb 12,2026 11:08 UTC+0800 Path: /ns-uvpun/etcd-rrsmex-6f05c9d1-9372-4fc8-b975-8e1d00f5c7f3/etcd/backup-ns-uvpun-etcd-rrsmex-20260212110802 Warning Events:  `kbcli cluster restore etcd-rrsmex-backup --backup backup-ns-uvpun-etcd-rrsmex-20260212110802 --namespace ns-uvpun `(B  Cluster etcd-rrsmex-backup created check cluster status  `kbcli cluster list etcd-rrsmex-backup --show-labels --namespace ns-uvpun `(B  NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS etcd-rrsmex-backup ns-uvpun WipeOut Creating Feb 12,2026 11:08 UTC+0800 cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B [Error] check cluster status timeout(B --------------------------------------get cluster etcd-rrsmex-backup yaml--------------------------------------  `kubectl get cluster etcd-rrsmex-backup -o yaml --namespace ns-uvpun `(B  apiVersion: apps.kubeblocks.io/v1 kind: Cluster metadata: annotations: kubeblocks.io/crd-api-version: apps.kubeblocks.io/v1 kubeblocks.io/ops-request: '[{"name":"etcd-rrsmex-backup","type":"Restore"}]' kubeblocks.io/restore-from-backup: '{"etcd":{"doReadyRestoreAfterClusterRunning":"false","name":"backup-ns-uvpun-etcd-rrsmex-20260212110802","namespace":"ns-uvpun","volumeRestorePolicy":"Parallel"}}' creationTimestamp: "2026-02-12T03:08:17Z" finalizers: - cluster.kubeblocks.io/finalizer generation: 2 name: etcd-rrsmex-backup namespace: ns-uvpun resourceVersion: "94402" uid: e1bf2864-59e5-4e78-b50d-eff8197f9b83 spec: componentSpecs: - annotations: kubeblocks.io/restart: "2026-02-12T02:13:23Z" componentDef: etcd-3-1.0.2 name: etcd podUpdatePolicy: PreferInPlace replicas: 3 resources: limits: cpu: 200m memory: 644245094400m requests: cpu: 200m memory: 644245094400m serviceVersion: 3.6.1 volumeClaimTemplates: - name: data spec: accessModes: - ReadWriteOnce resources: requests: storage: 3Gi services: - componentSelector: etcd name: client roleSelector: leader serviceName: client spec: ports: - nodePort: 30727 port: 2379 protocol: TCP targetPort: 2379 type: NodePort terminationPolicy: WipeOut status: components: etcd: observedGeneration: 2 phase: Creating upToDate: true conditions: - lastTransitionTime: "2026-02-12T03:08:17Z" message: 'The operator has started the provisioning of Cluster: etcd-rrsmex-backup' observedGeneration: 2 reason: PreCheckSucceed status: "True" type: ProvisioningStarted - lastTransitionTime: "2026-02-12T03:08:17Z" message: Successfully applied for resources observedGeneration: 2 reason: ApplyResourcesSucceed status: "True" type: ApplyResources observedGeneration: 2 phase: Creating ------------------------------------------------------------------------------------------------------------------ --------------------------------------describe cluster etcd-rrsmex-backup--------------------------------------  `kubectl describe cluster etcd-rrsmex-backup --namespace ns-uvpun `(B  Name: etcd-rrsmex-backup Namespace: ns-uvpun Labels: Annotations: kubeblocks.io/crd-api-version: apps.kubeblocks.io/v1 kubeblocks.io/ops-request: [{"name":"etcd-rrsmex-backup","type":"Restore"}] kubeblocks.io/restore-from-backup: {"etcd":{"doReadyRestoreAfterClusterRunning":"false","name":"backup-ns-uvpun-etcd-rrsmex-20260212110802","namespace":"ns-uvpun","volumeRes... API Version: apps.kubeblocks.io/v1 Kind: Cluster Metadata: Creation Timestamp: 2026-02-12T03:08:17Z Finalizers: cluster.kubeblocks.io/finalizer Generation: 2 Resource Version: 94402 UID: e1bf2864-59e5-4e78-b50d-eff8197f9b83 Spec: Component Specs: Annotations: kubeblocks.io/restart: 2026-02-12T02:13:23Z Component Def: etcd-3-1.0.2 Name: etcd Pod Update Policy: PreferInPlace Replicas: 3 Resources: Limits: Cpu: 200m Memory: 644245094400m Requests: Cpu: 200m Memory: 644245094400m Service Version: 3.6.1 Volume Claim Templates: Name: data Spec: Access Modes: ReadWriteOnce Resources: Requests: Storage: 3Gi Services: Component Selector: etcd Name: client Role Selector: leader Service Name: client Spec: Ports: Node Port: 30727 Port: 2379 Protocol: TCP Target Port: 2379 Type: NodePort Termination Policy: WipeOut Status: Components: Etcd: Observed Generation: 2 Phase: Creating Up To Date: true Conditions: Last Transition Time: 2026-02-12T03:08:17Z Message: The operator has started the provisioning of Cluster: etcd-rrsmex-backup Observed Generation: 2 Reason: PreCheckSucceed Status: True Type: ProvisioningStarted Last Transition Time: 2026-02-12T03:08:17Z Message: Successfully applied for resources Observed Generation: 2 Reason: ApplyResourcesSucceed Status: True Type: ApplyResources Observed Generation: 2 Phase: Creating Events: Type Reason Age From Message ---- ------ ---- ---- ------- Normal PreCheckSucceed 7m9s (x2 over 7m10s) cluster-controller The operator has started the provisioning of Cluster: etcd-rrsmex-backup Normal ApplyResourcesSucceed 7m9s (x2 over 7m10s) cluster-controller Successfully applied for resources Normal ClusterComponentPhaseTransition 103s (x2 over 103s) cluster-controller cluster component etcd is Creating ------------------------------------------------------------------------------------------------------------------ check pod status  `kbcli cluster list-instances etcd-rrsmex-backup --namespace ns-uvpun `(B  NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME etcd-rrsmex-backup-etcd-0 ns-uvpun etcd-rrsmex-backup etcd Init:0/3 0 200m / 200m 644245094400m / 644245094400m data:3Gi aks-cicdamdpool-17242166-vmss000001/10.224.0.8 Feb 12,2026 11:13 UTC+0800 pod_status:Init:0/3(B pod_status:Init:0/3(B pod_status:Init:0/3(B pod_status:Init:0/3(B pod_status:Init:0/3(B pod_status:Init:0/3(B pod_status:Init:0/3(B pod_status:Init:0/3(B pod_status:Init:0/3(B pod_status:Init:0/3(B pod_status:Init:0/3(B pod_status:Init:0/3(B pod_status:Init:0/3(B pod_status:Init:0/3(B pod_status:Init:0/3(B pod_status:Init:0/3(B pod_status:Init:0/3(B pod_status:Init:0/3(B pod_status:Init:0/3(B pod_status:Init:0/3(B pod_status:Init:0/3(B pod_status:Init:0/3(B pod_status:Init:0/3(B pod_status:Init:0/3(B pod_status:Init:0/3(B pod_status:Init:0/3(B pod_status:Init:0/3(B pod_status:Init:0/3(B pod_status:Init:0/3(B pod_status:Init:0/3(B pod_status:Init:0/3(B pod_status:Init:0/3(B pod_status:Init:0/3(B pod_status:Init:0/3(B pod_status:Init:0/3(B pod_status:Init:0/3(B pod_status:Init:0/3(B pod_status:Init:0/3(B pod_status:Init:0/3(B pod_status:Init:0/3(B pod_status:Init:0/3(B pod_status:Init:0/3(B pod_status:Init:0/3(B pod_status:Init:0/3(B pod_status:Init:0/3(B pod_status:Init:0/3(B pod_status:Init:0/3(B pod_status:Init:0/3(B pod_status:Init:0/3(B pod_status:Init:0/3(B pod_status:Init:0/3(B pod_status:Init:0/3(B pod_status:Init:0/3(B pod_status:Init:0/3(B pod_status:Init:0/3(B pod_status:Init:0/3(B pod_status:Init:1/3(B check pod status done(B check cluster status again cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B check cluster status again timeout(B  `kbcli cluster describe-backup --names backup-ns-uvpun-etcd-rrsmex-20260212110802 --namespace ns-uvpun `(B  Name: backup-ns-uvpun-etcd-rrsmex-20260212110802 Cluster: etcd-rrsmex Namespace: ns-uvpun Spec: Method: datafile Policy Name: etcd-rrsmex-etcd-backup-policy Actions: dp-backup-0: ActionType: Job WorkloadName: dp-backup-0-backup-ns-uvpun-etcd-rrsmex-20260212110802-b685adea TargetPodName: etcd-rrsmex-etcd-2 Phase: Completed Start Time: Feb 12,2026 11:08 UTC+0800 Completion Time: Feb 12,2026 11:08 UTC+0800 Status: Phase: Completed Total Size: 51626 ActionSet Name: etcdctl-br Repository: backuprepo-kbcli-test Duration: 10s Start Time: Feb 12,2026 11:08 UTC+0800 Completion Time: Feb 12,2026 11:08 UTC+0800 Path: /ns-uvpun/etcd-rrsmex-6f05c9d1-9372-4fc8-b975-8e1d00f5c7f3/etcd/backup-ns-uvpun-etcd-rrsmex-20260212110802 Warning Events: delete cluster etcd-rrsmex-backup  `kbcli cluster delete etcd-rrsmex-backup --auto-approve --namespace ns-uvpun `(B  pod_info:etcd-rrsmex-backup-etcd-0 2/2 Running 0 7m45s etcd-rrsmex-backup-etcd-1 0/2 Init:0/3 0 62s Cluster etcd-rrsmex-backup deleted delete cluster pod done(B check cluster resource non-exist OK: pvc(B delete cluster done(B cluster delete backup  `kubectl patch -p '{"metadata":{"finalizers":[]}}' --type=merge backups backup-ns-uvpun-etcd-rrsmex-20260212110802 --namespace ns-uvpun `(B  backup.dataprotection.kubeblocks.io/backup-ns-uvpun-etcd-rrsmex-20260212110802 patched  `kbcli cluster delete-backup etcd-rrsmex --name backup-ns-uvpun-etcd-rrsmex-20260212110802 --force --auto-approve --namespace ns-uvpun `(B  Backup backup-ns-uvpun-etcd-rrsmex-20260212110802 deleted cluster list-logs  `kbcli cluster list-logs etcd-rrsmex --namespace ns-uvpun `(B  cluster logs  `kbcli cluster logs etcd-rrsmex --tail 30 --namespace ns-uvpun `(B  {"level":"info","ts":"2026-02-12T03:05:21.696345Z","caller":"rafthttp/stream.go:248","msg":"set message encoder","from":"9664f478870ac9ba","to":"10d3c5bda296da0b","stream-type":"stream Message"} {"level":"info","ts":"2026-02-12T03:05:21.696394Z","caller":"rafthttp/peer_status.go:53","msg":"peer became active","peer-id":"10d3c5bda296da0b"} {"level":"warn","ts":"2026-02-12T03:05:21.696424Z","caller":"rafthttp/stream.go:264","msg":"closed TCP streaming connection with remote peer","stream-writer-type":"stream Message","local-member-id":"9664f478870ac9ba","remote-peer-id":"10d3c5bda296da0b"} {"level":"info","ts":"2026-02-12T03:05:21.696441Z","caller":"rafthttp/stream.go:273","msg":"established TCP streaming connection with remote peer","stream-writer-type":"stream Message","local-member-id":"9664f478870ac9ba","remote-peer-id":"10d3c5bda296da0b"} {"level":"info","ts":"2026-02-12T03:05:21.697219Z","caller":"rafthttp/stream.go:248","msg":"set message encoder","from":"9664f478870ac9ba","to":"10d3c5bda296da0b","stream-type":"stream MsgApp v2"} {"level":"warn","ts":"2026-02-12T03:05:21.697251Z","caller":"rafthttp/stream.go:264","msg":"closed TCP streaming connection with remote peer","stream-writer-type":"stream MsgApp v2","local-member-id":"9664f478870ac9ba","remote-peer-id":"10d3c5bda296da0b"} {"level":"info","ts":"2026-02-12T03:05:21.697262Z","caller":"rafthttp/stream.go:273","msg":"established TCP streaming connection with remote peer","stream-writer-type":"stream MsgApp v2","local-member-id":"9664f478870ac9ba","remote-peer-id":"10d3c5bda296da0b"} {"level":"warn","ts":"2026-02-12T03:05:22.081003Z","caller":"rafthttp/peer_status.go:66","msg":"peer became inactive (message send to peer failed)","peer-id":"10d3c5bda296da0b","error":"failed to dial 10d3c5bda296da0b on stream MsgApp v2 (dial tcp 10.244.4.130:2380: i/o timeout)"} {"level":"info","ts":"2026-02-12T03:05:32.787570Z","caller":"rafthttp/peer_status.go:53","msg":"peer became active","peer-id":"10d3c5bda296da0b"} {"level":"info","ts":"2026-02-12T03:05:32.787621Z","caller":"rafthttp/stream.go:411","msg":"established TCP streaming connection with remote peer","stream-reader-type":"stream MsgApp v2","local-member-id":"9664f478870ac9ba","remote-peer-id":"10d3c5bda296da0b"} {"level":"warn","ts":"2026-02-12T03:05:33.812815Z","caller":"rafthttp/peer_status.go:66","msg":"peer became inactive (message send to peer failed)","peer-id":"10d3c5bda296da0b","error":"failed to dial 10d3c5bda296da0b on stream Message (dial tcp 10.244.4.130:2380: i/o timeout)"} {"level":"info","ts":"2026-02-12T03:05:33.815041Z","caller":"rafthttp/peer_status.go:53","msg":"peer became active","peer-id":"10d3c5bda296da0b"} {"level":"info","ts":"2026-02-12T03:05:33.815093Z","caller":"rafthttp/stream.go:411","msg":"established TCP streaming connection with remote peer","stream-reader-type":"stream Message","local-member-id":"9664f478870ac9ba","remote-peer-id":"10d3c5bda296da0b"} {"level":"warn","ts":"2026-02-12T03:05:43.661767Z","caller":"rafthttp/probing_status.go:68","msg":"prober detected unhealthy status","round-tripper-name":"ROUND_TRIPPER_RAFT_MESSAGE","remote-peer-id":"10d3c5bda296da0b","rtt":"3.112813ms","error":"dial tcp: lookup etcd-rrsmex-etcd-1.etcd-rrsmex-etcd-headless.ns-uvpun.svc.cluster.local on 10.0.0.10:53: no such host"} {"level":"warn","ts":"2026-02-12T03:05:48.662611Z","caller":"rafthttp/probing_status.go:68","msg":"prober detected unhealthy status","round-tripper-name":"ROUND_TRIPPER_RAFT_MESSAGE","remote-peer-id":"10d3c5bda296da0b","rtt":"3.112813ms","error":"dial tcp: lookup etcd-rrsmex-etcd-1.etcd-rrsmex-etcd-headless.ns-uvpun.svc.cluster.local on 10.0.0.10:53: no such host"} {"level":"info","ts":"2026-02-12T03:06:25.766260Z","logger":"raft","caller":"v3@v3.6.0/raft.go:1754","msg":"9664f478870ac9ba [term 8] received MsgTimeoutNow from 7ccfd22ced6060d4 and starts an election to get leadership."} {"level":"info","ts":"2026-02-12T03:06:25.766315Z","logger":"raft","caller":"v3@v3.6.0/raft.go:988","msg":"9664f478870ac9ba is starting a new election at term 8"} {"level":"info","ts":"2026-02-12T03:06:25.766335Z","logger":"raft","caller":"v3@v3.6.0/raft.go:912","msg":"9664f478870ac9ba became candidate at term 9"} {"level":"info","ts":"2026-02-12T03:06:25.766350Z","logger":"raft","caller":"v3@v3.6.0/raft.go:1064","msg":"9664f478870ac9ba [logterm: 8, index: 4448] sent MsgVote request to 10d3c5bda296da0b at term 9"} {"level":"info","ts":"2026-02-12T03:06:25.766359Z","logger":"raft","caller":"v3@v3.6.0/raft.go:1064","msg":"9664f478870ac9ba [logterm: 8, index: 4448] sent MsgVote request to 7ccfd22ced6060d4 at term 9"} {"level":"info","ts":"2026-02-12T03:06:25.766370Z","logger":"raft","caller":"v3@v3.6.0/node.go:376","msg":"raft.node: 9664f478870ac9ba lost leader 7ccfd22ced6060d4 at term 9"} {"level":"info","ts":"2026-02-12T03:06:25.769669Z","logger":"raft","caller":"v3@v3.6.0/raft.go:1077","msg":"9664f478870ac9ba received MsgVoteResp from 9664f478870ac9ba at term 9"} {"level":"info","ts":"2026-02-12T03:06:25.769708Z","logger":"raft","caller":"v3@v3.6.0/raft.go:1693","msg":"9664f478870ac9ba has received 1 MsgVoteResp votes and 0 vote rejections"} {"level":"info","ts":"2026-02-12T03:06:25.771755Z","logger":"raft","caller":"v3@v3.6.0/raft.go:1077","msg":"9664f478870ac9ba received MsgVoteResp from 10d3c5bda296da0b at term 9"} {"level":"info","ts":"2026-02-12T03:06:25.771786Z","logger":"raft","caller":"v3@v3.6.0/raft.go:1693","msg":"9664f478870ac9ba has received 2 MsgVoteResp votes and 0 vote rejections"} {"level":"info","ts":"2026-02-12T03:06:25.771810Z","logger":"raft","caller":"v3@v3.6.0/raft.go:970","msg":"9664f478870ac9ba became leader at term 9"} {"level":"info","ts":"2026-02-12T03:06:25.771824Z","logger":"raft","caller":"v3@v3.6.0/node.go:370","msg":"raft.node: 9664f478870ac9ba elected leader 9664f478870ac9ba at term 9"} {"level":"info","ts":"2026-02-12T03:08:04.011372Z","caller":"v3rpc/maintenance.go:153","msg":"sending database snapshot to client","total-bytes":499712,"size":"500 kB","storage-version":"3.6.0"} {"level":"info","ts":"2026-02-12T03:08:04.021070Z","caller":"v3rpc/maintenance.go:195","msg":"sending database sha256 checksum to client","total-bytes":499712,"checksum-size":32} {"level":"info","ts":"2026-02-12T03:08:04.021139Z","caller":"v3rpc/maintenance.go:204","msg":"successfully sent database snapshot to client","total-bytes":499712,"size":"500 kB","took":"9.767626ms","storage-version":"3.6.0"} delete cluster etcd-rrsmex  `kbcli cluster delete etcd-rrsmex --auto-approve --namespace ns-uvpun `(B  pod_info:etcd-rrsmex-etcd-0 2/2 Running 0 51m etcd-rrsmex-etcd-1 2/2 Running 0 16m etcd-rrsmex-etcd-2 2/2 Running 0 44m Cluster etcd-rrsmex deleted delete cluster pod done(B check cluster resource non-exist OK: pvc(B delete cluster done(B Etcd Test Suite All Done!(B Test Engine: etcd Test Type: 15 --------------------------------------Etcd 3.5.15 (Topology = cluster Replicas 3) Test Result-------------------------------------- [PASSED]|[Create]|[Topology=cluster;ComponentDefinition=etcd-3-1.0.2;ComponentVersion=etcd;ServiceVersion=3.5.15;]|[Description=Create a cluster with the specified topology cluster with the specified component definition etcd-3-1.0.2 and component version etcd and service version 3.5.15](B [PASSED]|[Connect]|[ComponentName=etcd]|[Description=Connect to the cluster](B [PASSED]|[Failover]|[HA=Kill 1;ComponentName=etcd]|[Description=Simulates conditions where process 1 killed either due to expected/undesired processes thereby testing the application's resilience to unavailability of some replicas due to abnormal termination signals.](B [PASSED]|[Restart]|[-]|[Description=Restart the cluster](B [PASSED]|[VerticalScaling]|[ComponentName=etcd]|[Description=VerticalScaling the cluster specify component etcd](B [PASSED]|[NoFailover]|[HA=Connection Stress;ComponentName=etcd]|[Description=Simulates conditions where pods experience connection stress either due to expected/undesired processes thereby testing the application's resilience to potential slowness/unavailability of some replicas due to high Connection load.](B [PASSED]|[HorizontalScaling Out]|[ComponentName=etcd]|[Description=HorizontalScaling Out the cluster specify component etcd](B [PASSED]|[HorizontalScaling In]|[ComponentName=etcd]|[Description=HorizontalScaling In the cluster specify component etcd](B [PASSED]|[Stop]|[-]|[Description=Stop the cluster](B [PASSED]|[Start]|[-]|[Description=Start the cluster](B [PASSED]|[VolumeExpansion]|[ComponentName=etcd]|[Description=VolumeExpansion the cluster specify component etcd](B [PASSED]|[Failover]|[HA=Delete Pod;ComponentName=etcd]|[Description=Simulates conditions where pods terminating forced/graceful thereby testing deployment sanity (replica availability & uninterrupted service) and recovery workflow of the application.](B [PASSED]|[SwitchOver]|[ComponentName=etcd]|[Description=SwitchOver the cluster specify component etcd](B [PASSED]|[Update]|[TerminationPolicy=WipeOut]|[Description=Update the cluster TerminationPolicy WipeOut](B [PASSED]|[Backup]|[BackupMethod=datafile]|[Description=The cluster datafile Backup](B [FAILED]|[Restore]|[BackupMethod=datafile]|[Description=The cluster datafile Restore](B [PASSED]|[Delete Restore Cluster]|[BackupMethod=datafile]|[Description=Delete the datafile restore cluster](B [PASSED]|[Delete]|[-]|[Description=Delete the cluster](B [END]