https://github.com/apecloud/kubeblocks/actions/runs/21898070903 previous_version: kubeblocks_version:1.0.2 bash test/kbcli/test_kbcli_1.0.sh --type 15 --version 1.0.2 --generate-output true --chaos-mesh true --aws-access-key-id *** --aws-secret-access-key *** --jihulab-token *** --random-namespace true --region eastus --cloud-provider aks CURRENT_TEST_DIR:test/kbcli source commons files source engines files source kubeblocks files source kubedb files CLUSTER_NAME:  `kubectl get namespace | grep ns-owddk `(B   `kubectl create namespace ns-owddk`(B  namespace/ns-owddk created create namespace ns-owddk done(B download kbcli  `gh release list --repo apecloud/kbcli --limit 100 | (grep "1.0" || true)`(B   `curl -fsSL https://kubeblocks.io/installer/install_cli.sh | bash -s v1.0.2`(B  Your system is linux_amd64 Installing kbcli ... Downloading ... kbcli installed successfully. Kubernetes: v1.32.10 KubeBlocks: 1.0.2 kbcli: 1.0.2 Make sure your docker service is running and begin your journey with kbcli: kbcli playground init For more information on how to get started, please visit: https://kubeblocks.io download kbcli v1.0.2 done(B Kubernetes: v1.32.10 KubeBlocks: 1.0.2 kbcli: 1.0.2 Kubernetes Env: v1.32.10 check snapshot controller check snapshot controller done(B POD_RESOURCES: aks kb-default-sc found aks default-vsc found found default storage class: default (B KubeBlocks version is:1.0.2 skip upgrade KubeBlocks(B current KubeBlocks version: 1.0.2 helm repo add chaos-mesh https://charts.chaos-mesh.org "chaos-mesh" has been added to your repositories add helm chart repo chaos-mesh success chaos mesh already installed check component definition set component name:etcd set component version set component version:etcd set service versions:3.6.1,3.5.15,3.5.6 set service versions sorted:3.5.6,3.5.15,3.6.1 set etcd component definition set etcd component definition etcd-3-1.0.2 REPORT_COUNT 0:0 set replicas first:3,3.5.6|3,3.5.15|3,3.6.1 set replicas third:3,3.5.15 set replicas fourth:3,3.5.6 set minimum cmpv service version set minimum cmpv service version replicas:3,3.5.6 set replicas end:3,3.5.6 REPORT_COUNT:1 CLUSTER_TOPOLOGY:cluster set etcd component definition set etcd component definition etcd-3-1.0.2 LIMIT_CPU:0.1 LIMIT_MEMORY:0.5 storage size: 1 CLUSTER_NAME:etcd-bwezhs pod_info: termination_policy:DoNotTerminate create 3 replica DoNotTerminate etcd cluster check component definition set component definition by component version check cmpd by labels set component definition1: etcd-3-1.0.2 by component version:etcd apiVersion: apps.kubeblocks.io/v1 kind: Cluster metadata: name: etcd-bwezhs namespace: ns-owddk spec: terminationPolicy: DoNotTerminate componentSpecs: - name: etcd componentDef: etcd-3-1.0.2 tls: false replicas: 3 resources: requests: cpu: 100m memory: 0.5Gi limits: cpu: 100m memory: 0.5Gi volumeClaimTemplates: - name: data spec: storageClassName: accessModes: - ReadWriteOnce resources: requests: storage: 1Gi services: - name: client serviceName: client spec: type: NodePort ports: - port: 2379 targetPort: 2379 componentSelector: etcd roleSelector: leader  `kubectl apply -f test_create_etcd-bwezhs.yaml`(B  cluster.apps.kubeblocks.io/etcd-bwezhs created apply test_create_etcd-bwezhs.yaml Success(B  `rm -rf test_create_etcd-bwezhs.yaml`(B  check cluster status  `kbcli cluster list etcd-bwezhs --show-labels --namespace ns-owddk `(B  NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS etcd-bwezhs ns-owddk DoNotTerminate Creating Feb 11,2026 17:32 UTC+0800 cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B check cluster status done(B cluster_status:Running(B check pod status  `kbcli cluster list-instances etcd-bwezhs --namespace ns-owddk `(B  NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME etcd-bwezhs-etcd-0 ns-owddk etcd-bwezhs etcd Running leader 0 100m / 100m 512Mi / 512Mi data:1Gi aks-cicdamdpool-55976491-vmss000001/10.224.0.7 Feb 11,2026 17:32 UTC+0800 etcd-bwezhs-etcd-1 ns-owddk etcd-bwezhs etcd Running follower 0 100m / 100m 512Mi / 512Mi data:1Gi aks-cicdamdpool-55976491-vmss000002/10.224.0.9 Feb 11,2026 17:32 UTC+0800 etcd-bwezhs-etcd-2 ns-owddk etcd-bwezhs etcd Running follower 0 100m / 100m 512Mi / 512Mi data:1Gi aks-cicdamdpool-55976491-vmss000003/10.224.0.5 Feb 11,2026 17:34 UTC+0800 check pod status done(B check cluster role check cluster role done(B leader(B: etcd-bwezhs-etcd-0;follower(B: etcd-bwezhs-etcd-1 etcd-bwezhs-etcd-2 check cluster connect  `echo 'etcdctl --endpoints=http://etcd-bwezhs-client.ns-owddk.svc.cluster.local:2379 endpoint health' | kubectl exec -it etcd-bwezhs-etcd-0 --namespace ns-owddk -- bash`(B  check cluster connect done(B  `kubectl get secrets -l app.kubernetes.io/instance=etcd-bwezhs`(B  Not found cluster secret(B DB_USERNAME:;DB_PASSWORD:;DB_PORT:2379;DB_DATABASE:(B There is no password in Type: 15.(B describe cluster  `kbcli cluster describe etcd-bwezhs --namespace ns-owddk `(B  Name: etcd-bwezhs Created Time: Feb 11,2026 17:32 UTC+0800 NAMESPACE CLUSTER-DEFINITION TOPOLOGY STATUS TERMINATION-POLICY ns-owddk Running DoNotTerminate Endpoints: COMPONENT INTERNAL EXTERNAL Topology: COMPONENT SERVICE-VERSION INSTANCE ROLE STATUS AZ NODE CREATED-TIME etcd 3.6.1 etcd-bwezhs-etcd-0 leader Running 0 aks-cicdamdpool-55976491-vmss000001/10.224.0.7 Feb 11,2026 17:32 UTC+0800 etcd 3.6.1 etcd-bwezhs-etcd-1 follower Running 0 aks-cicdamdpool-55976491-vmss000002/10.224.0.9 Feb 11,2026 17:32 UTC+0800 etcd 3.6.1 etcd-bwezhs-etcd-2 follower Running 0 aks-cicdamdpool-55976491-vmss000003/10.224.0.5 Feb 11,2026 17:34 UTC+0800 Resources Allocation: COMPONENT INSTANCE-TEMPLATE CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE-SIZE STORAGE-CLASS etcd 100m / 100m 512Mi / 512Mi data:1Gi default Images: COMPONENT COMPONENT-DEFINITION IMAGE etcd etcd-3-1.0.2 docker.io/apecloud/etcd:v3.6.1 Data Protection: BACKUP-REPO AUTO-BACKUP BACKUP-SCHEDULE BACKUP-METHOD BACKUP-RETENTION RECOVERABLE-TIME Show cluster events: kbcli cluster list-events -n ns-owddk etcd-bwezhs  `kbcli cluster label etcd-bwezhs app.kubernetes.io/instance- --namespace ns-owddk `(B  label "app.kubernetes.io/instance" not found.  `kbcli cluster label etcd-bwezhs app.kubernetes.io/instance=etcd-bwezhs --namespace ns-owddk `(B   `kbcli cluster label etcd-bwezhs --list --namespace ns-owddk `(B  NAME NAMESPACE LABELS etcd-bwezhs ns-owddk app.kubernetes.io/instance=etcd-bwezhs label cluster app.kubernetes.io/instance=etcd-bwezhs Success(B  `kbcli cluster label case.name=kbcli.test1 -l app.kubernetes.io/instance=etcd-bwezhs --namespace ns-owddk `(B   `kbcli cluster label etcd-bwezhs --list --namespace ns-owddk `(B  NAME NAMESPACE LABELS etcd-bwezhs ns-owddk app.kubernetes.io/instance=etcd-bwezhs case.name=kbcli.test1 label cluster case.name=kbcli.test1 Success(B  `kbcli cluster label etcd-bwezhs case.name=kbcli.test2 --overwrite --namespace ns-owddk `(B   `kbcli cluster label etcd-bwezhs --list --namespace ns-owddk `(B  NAME NAMESPACE LABELS etcd-bwezhs ns-owddk app.kubernetes.io/instance=etcd-bwezhs case.name=kbcli.test2 label cluster case.name=kbcli.test2 Success(B  `kbcli cluster label etcd-bwezhs case.name- --namespace ns-owddk `(B   `kbcli cluster label etcd-bwezhs --list --namespace ns-owddk `(B  NAME NAMESPACE LABELS etcd-bwezhs ns-owddk app.kubernetes.io/instance=etcd-bwezhs delete cluster label case.name Success(B cluster connect  `echo "etcdctl --endpoints=http://etcd-bwezhs-client.ns-owddk.svc.cluster.local:2379 member list" | kubectl exec -it etcd-bwezhs-etcd-0 --namespace ns-owddk -- bash `(B  9137f093f420a61a, started, etcd-bwezhs-etcd-0, http://etcd-bwezhs-etcd-0.etcd-bwezhs-etcd-headless.ns-owddk.svc.cluster.local:2380, http://etcd-bwezhs-etcd-0.etcd-bwezhs-etcd-headless.ns-owddk.svc.cluster.local:2379, false e8f0c5d2e19133c5, started, etcd-bwezhs-etcd-2, http://etcd-bwezhs-etcd-2.etcd-bwezhs-etcd-headless.ns-owddk.svc.cluster.local:2380, http://etcd-bwezhs-etcd-2.etcd-bwezhs-etcd-headless.ns-owddk.svc.cluster.local:2379, false f7e0f4cedd591794, started, etcd-bwezhs-etcd-1, http://etcd-bwezhs-etcd-1.etcd-bwezhs-etcd-headless.ns-owddk.svc.cluster.local:2380, http://etcd-bwezhs-etcd-1.etcd-bwezhs-etcd-headless.ns-owddk.svc.cluster.local:2379, false connect cluster Success(B insert batch data by db client  `kubectl patch -p '{"metadata":{"finalizers":[]}}' --type=merge pods test-db-client-executionloop-etcd-bwezhs --namespace ns-owddk `(B   `kubectl get secrets -l app.kubernetes.io/instance=etcd-bwezhs`(B  Not found cluster secret(B DB_USERNAME:;DB_PASSWORD:;DB_PORT:2379;DB_DATABASE:(B apiVersion: v1 kind: Pod metadata: name: test-db-client-executionloop-etcd-bwezhs namespace: ns-owddk spec: containers: - name: test-dbclient imagePullPolicy: IfNotPresent image: docker.io/apecloud/dbclient:test args: - "--host" - "etcd-bwezhs-client.ns-owddk.svc.cluster.local" - "--user" - "" - "--password" - "" - "--port" - "2379" - "--dbtype" - "etcd" - "--test" - "executionloop" - "--duration" - "60" - "--interval" - "1" restartPolicy: Never  `kubectl apply -f test-db-client-executionloop-etcd-bwezhs.yaml`(B  pod/test-db-client-executionloop-etcd-bwezhs created apply test-db-client-executionloop-etcd-bwezhs.yaml Success(B  `rm -rf test-db-client-executionloop-etcd-bwezhs.yaml`(B  check pod status pod_status:NAME READY STATUS RESTARTS AGE test-db-client-executionloop-etcd-bwezhs 1/1 Running 0 5s(B pod_status:NAME READY STATUS RESTARTS AGE test-db-client-executionloop-etcd-bwezhs 1/1 Running 0 9s(B pod_status:NAME READY STATUS RESTARTS AGE test-db-client-executionloop-etcd-bwezhs 1/1 Running 0 15s(B pod_status:NAME READY STATUS RESTARTS AGE test-db-client-executionloop-etcd-bwezhs 1/1 Running 0 20s(B pod_status:NAME READY STATUS RESTARTS AGE test-db-client-executionloop-etcd-bwezhs 1/1 Running 0 25s(B pod_status:NAME READY STATUS RESTARTS AGE test-db-client-executionloop-etcd-bwezhs 1/1 Running 0 30s(B pod_status:NAME READY STATUS RESTARTS AGE test-db-client-executionloop-etcd-bwezhs 1/1 Running 0 36s(B pod_status:NAME READY STATUS RESTARTS AGE test-db-client-executionloop-etcd-bwezhs 1/1 Running 0 41s(B pod_status:NAME READY STATUS RESTARTS AGE test-db-client-executionloop-etcd-bwezhs 1/1 Running 0 46s(B pod_status:NAME READY STATUS RESTARTS AGE test-db-client-executionloop-etcd-bwezhs 1/1 Running 0 52s(B pod_status:NAME READY STATUS RESTARTS AGE test-db-client-executionloop-etcd-bwezhs 1/1 Running 0 57s(B pod_status:NAME READY STATUS RESTARTS AGE test-db-client-executionloop-etcd-bwezhs 1/1 Running 0 62s(B pod_status:NAME READY STATUS RESTARTS AGE test-db-client-executionloop-etcd-bwezhs 1/1 Running 0 68s(B check pod test-db-client-executionloop-etcd-bwezhs status done(B pod_status:NAME READY STATUS RESTARTS AGE test-db-client-executionloop-etcd-bwezhs 0/1 Completed 0 73s(B check cluster status  `kbcli cluster list etcd-bwezhs --show-labels --namespace ns-owddk `(B  NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS etcd-bwezhs ns-owddk DoNotTerminate Running Feb 11,2026 17:32 UTC+0800 app.kubernetes.io/instance=etcd-bwezhs check cluster status done(B cluster_status:Running(B check pod status  `kbcli cluster list-instances etcd-bwezhs --namespace ns-owddk `(B  NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME etcd-bwezhs-etcd-0 ns-owddk etcd-bwezhs etcd Running leader 0 100m / 100m 512Mi / 512Mi data:1Gi aks-cicdamdpool-55976491-vmss000001/10.224.0.7 Feb 11,2026 17:32 UTC+0800 etcd-bwezhs-etcd-1 ns-owddk etcd-bwezhs etcd Running follower 0 100m / 100m 512Mi / 512Mi data:1Gi aks-cicdamdpool-55976491-vmss000002/10.224.0.9 Feb 11,2026 17:32 UTC+0800 etcd-bwezhs-etcd-2 ns-owddk etcd-bwezhs etcd Running follower 0 100m / 100m 512Mi / 512Mi data:1Gi aks-cicdamdpool-55976491-vmss000003/10.224.0.5 Feb 11,2026 17:34 UTC+0800 check pod status done(B check cluster role check cluster role done(B leader(B: etcd-bwezhs-etcd-0;follower(B: etcd-bwezhs-etcd-1 etcd-bwezhs-etcd-2 check cluster connect  `echo 'etcdctl --endpoints=http://etcd-bwezhs-client.ns-owddk.svc.cluster.local:2379 endpoint health' | kubectl exec -it etcd-bwezhs-etcd-0 --namespace ns-owddk -- bash`(B  check cluster connect done(B --host etcd-bwezhs-client.ns-owddk.svc.cluster.local --user --password --port 2379 --dbtype etcd --test executionloop --duration 60 --interval 1 Using no auth SLF4J(I): Connected with provider of type [ch.qos.logback.classic.spi.LogbackServiceProvider] Execution loop start: Get key prefix:executions_loop_key Execution loop start:PUT:executions_loop_key_1:executions_loop_value_1 [ 1s ] executions total: 56 successful: 56 failed: 0 disconnect: 0 [ 2s ] executions total: 134 successful: 134 failed: 0 disconnect: 0 [ 3s ] executions total: 208 successful: 208 failed: 0 disconnect: 0 [ 4s ] executions total: 273 successful: 273 failed: 0 disconnect: 0 [ 5s ] executions total: 348 successful: 348 failed: 0 disconnect: 0 [ 6s ] executions total: 415 successful: 415 failed: 0 disconnect: 0 [ 7s ] executions total: 485 successful: 485 failed: 0 disconnect: 0 [ 8s ] executions total: 550 successful: 550 failed: 0 disconnect: 0 [ 9s ] executions total: 613 successful: 613 failed: 0 disconnect: 0 [ 10s ] executions total: 678 successful: 678 failed: 0 disconnect: 0 [ 11s ] executions total: 753 successful: 753 failed: 0 disconnect: 0 [ 12s ] executions total: 833 successful: 833 failed: 0 disconnect: 0 [ 13s ] executions total: 901 successful: 901 failed: 0 disconnect: 0 [ 14s ] executions total: 979 successful: 979 failed: 0 disconnect: 0 [ 15s ] executions total: 1047 successful: 1047 failed: 0 disconnect: 0 [ 16s ] executions total: 1118 successful: 1118 failed: 0 disconnect: 0 [ 17s ] executions total: 1190 successful: 1190 failed: 0 disconnect: 0 [ 18s ] executions total: 1261 successful: 1261 failed: 0 disconnect: 0 [ 19s ] executions total: 1337 successful: 1337 failed: 0 disconnect: 0 [ 20s ] executions total: 1407 successful: 1407 failed: 0 disconnect: 0 [ 21s ] executions total: 1488 successful: 1488 failed: 0 disconnect: 0 [ 22s ] executions total: 1567 successful: 1567 failed: 0 disconnect: 0 [ 23s ] executions total: 1652 successful: 1652 failed: 0 disconnect: 0 [ 24s ] executions total: 1730 successful: 1730 failed: 0 disconnect: 0 [ 25s ] executions total: 1811 successful: 1811 failed: 0 disconnect: 0 [ 26s ] executions total: 1894 successful: 1894 failed: 0 disconnect: 0 [ 27s ] executions total: 1966 successful: 1966 failed: 0 disconnect: 0 [ 28s ] executions total: 2027 successful: 2027 failed: 0 disconnect: 0 [ 29s ] executions total: 2107 successful: 2107 failed: 0 disconnect: 0 [ 30s ] executions total: 2175 successful: 2175 failed: 0 disconnect: 0 [ 31s ] executions total: 2247 successful: 2247 failed: 0 disconnect: 0 [ 32s ] executions total: 2324 successful: 2324 failed: 0 disconnect: 0 [ 33s ] executions total: 2397 successful: 2397 failed: 0 disconnect: 0 [ 34s ] executions total: 2474 successful: 2474 failed: 0 disconnect: 0 [ 35s ] executions total: 2538 successful: 2538 failed: 0 disconnect: 0 [ 36s ] executions total: 2606 successful: 2606 failed: 0 disconnect: 0 [ 37s ] executions total: 2683 successful: 2683 failed: 0 disconnect: 0 [ 38s ] executions total: 2755 successful: 2755 failed: 0 disconnect: 0 [ 39s ] executions total: 2820 successful: 2820 failed: 0 disconnect: 0 [ 40s ] executions total: 2895 successful: 2895 failed: 0 disconnect: 0 [ 41s ] executions total: 2965 successful: 2965 failed: 0 disconnect: 0 [ 42s ] executions total: 3030 successful: 3030 failed: 0 disconnect: 0 [ 43s ] executions total: 3106 successful: 3106 failed: 0 disconnect: 0 [ 44s ] executions total: 3170 successful: 3170 failed: 0 disconnect: 0 [ 45s ] executions total: 3254 successful: 3254 failed: 0 disconnect: 0 [ 46s ] executions total: 3338 successful: 3338 failed: 0 disconnect: 0 [ 47s ] executions total: 3417 successful: 3417 failed: 0 disconnect: 0 [ 48s ] executions total: 3486 successful: 3486 failed: 0 disconnect: 0 [ 49s ] executions total: 3565 successful: 3565 failed: 0 disconnect: 0 [ 50s ] executions total: 3647 successful: 3647 failed: 0 disconnect: 0 [ 51s ] executions total: 3725 successful: 3725 failed: 0 disconnect: 0 [ 52s ] executions total: 3812 successful: 3812 failed: 0 disconnect: 0 [ 53s ] executions total: 3883 successful: 3883 failed: 0 disconnect: 0 [ 54s ] executions total: 3962 successful: 3962 failed: 0 disconnect: 0 [ 55s ] executions total: 4031 successful: 4031 failed: 0 disconnect: 0 [ 56s ] executions total: 4107 successful: 4107 failed: 0 disconnect: 0 [ 57s ] executions total: 4177 successful: 4177 failed: 0 disconnect: 0 [ 58s ] executions total: 4261 successful: 4261 failed: 0 disconnect: 0 [ 59s ] executions total: 4333 successful: 4333 failed: 0 disconnect: 0 [ 60s ] executions total: 4386 successful: 4386 failed: 0 disconnect: 0 Test Result: Total Executions: 4386 Successful Executions: 4386 Failed Executions: 0 Disconnection Counts: 0 Connection Information: Database Type: etcd Host: etcd-bwezhs-client.ns-owddk.svc.cluster.local Port: 2379 Database: Table: User: Org: Access Mode: mysql Test Type: executionloop Query: Duration: 60 seconds Interval: 1 seconds DB_CLIENT_BATCH_DATA_COUNT: 4386  `kubectl patch -p '{"metadata":{"finalizers":[]}}' --type=merge pods test-db-client-executionloop-etcd-bwezhs --namespace ns-owddk `(B  pod/test-db-client-executionloop-etcd-bwezhs patched (no change) pod "test-db-client-executionloop-etcd-bwezhs" force deleted test failover networkdelayover(B check cluster status before cluster-failover-networkdelayover check cluster status done(B cluster_status:Running(B  `kubectl patch -p '{"metadata":{"finalizers":[]}}' --type=merge NetworkChaos test-chaos-mesh-networkdelayover-etcd-bwezhs --namespace ns-owddk `(B  apiVersion: chaos-mesh.org/v1alpha1 kind: NetworkChaos metadata: name: test-chaos-mesh-networkdelayover-etcd-bwezhs namespace: ns-owddk spec: selector: namespaces: - ns-owddk labelSelectors: apps.kubeblocks.io/pod-name: etcd-bwezhs-etcd-0 mode: all action: delay delay: latency: 2000ms correlation: '100' jitter: 0ms direction: to duration: 2m  `kubectl apply -f test-chaos-mesh-networkdelayover-etcd-bwezhs.yaml`(B  networkchaos.chaos-mesh.org/test-chaos-mesh-networkdelayover-etcd-bwezhs created apply test-chaos-mesh-networkdelayover-etcd-bwezhs.yaml Success(B  `rm -rf test-chaos-mesh-networkdelayover-etcd-bwezhs.yaml`(B  networkdelayover chaos test waiting 120 seconds check cluster status  `kbcli cluster list etcd-bwezhs --show-labels --namespace ns-owddk `(B  NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS etcd-bwezhs ns-owddk DoNotTerminate Running Feb 11,2026 17:32 UTC+0800 app.kubernetes.io/instance=etcd-bwezhs check cluster status done(B cluster_status:Running(B check pod status  `kbcli cluster list-instances etcd-bwezhs --namespace ns-owddk `(B  NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME etcd-bwezhs-etcd-0 ns-owddk etcd-bwezhs etcd Running follower 0 100m / 100m 512Mi / 512Mi data:1Gi aks-cicdamdpool-55976491-vmss000001/10.224.0.7 Feb 11,2026 17:32 UTC+0800 etcd-bwezhs-etcd-1 ns-owddk etcd-bwezhs etcd Running leader 0 100m / 100m 512Mi / 512Mi data:1Gi aks-cicdamdpool-55976491-vmss000002/10.224.0.9 Feb 11,2026 17:32 UTC+0800 etcd-bwezhs-etcd-2 ns-owddk etcd-bwezhs etcd Running follower 0 100m / 100m 512Mi / 512Mi data:1Gi aks-cicdamdpool-55976491-vmss000003/10.224.0.5 Feb 11,2026 17:34 UTC+0800 check pod status done(B check cluster role check cluster role done(B leader(B: etcd-bwezhs-etcd-1;follower(B: etcd-bwezhs-etcd-0 etcd-bwezhs-etcd-2 check cluster connect  `echo 'etcdctl --endpoints=http://etcd-bwezhs-client.ns-owddk.svc.cluster.local:2379 endpoint health' | kubectl exec -it etcd-bwezhs-etcd-1 --namespace ns-owddk -- bash`(B  check cluster connect done(B  `kubectl patch -p '{"metadata":{"finalizers":[]}}' --type=merge NetworkChaos test-chaos-mesh-networkdelayover-etcd-bwezhs --namespace ns-owddk `(B  networkchaos.chaos-mesh.org "test-chaos-mesh-networkdelayover-etcd-bwezhs" force deleted check failover pod name failover pod name:etcd-bwezhs-etcd-1 failover networkdelayover Success(B check db_client batch data count  `echo "etcdctl --endpoints=http://etcd-bwezhs-client.ns-owddk.svc.cluster.local:2379 get --prefix \"executions_loop_key\" --keys-only | (grep executions_loop_key || true) | wc -l " | kubectl exec -it etcd-bwezhs-etcd-1 --namespace ns-owddk -- bash `(B  check db_client batch [4386] equal [4386] data Success(B check readonly db_client batch data count  `echo "etcdctl --endpoints=http://etcd-bwezhs-client.ns-owddk.svc.cluster.local:2379 get --prefix \"executions_loop_key\" --keys-only | (grep executions_loop_key || true) | wc -l " | kubectl exec -it etcd-bwezhs-etcd-0 --namespace ns-owddk -- bash `(B  check readonly db_client batch data [4386] equal [4386] Success(B test failover networkcorruptover(B check cluster status before cluster-failover-networkcorruptover check cluster status done(B cluster_status:Running(B  `kubectl patch -p '{"metadata":{"finalizers":[]}}' --type=merge NetworkChaos test-chaos-mesh-networkcorruptover-etcd-bwezhs --namespace ns-owddk `(B  apiVersion: chaos-mesh.org/v1alpha1 kind: NetworkChaos metadata: name: test-chaos-mesh-networkcorruptover-etcd-bwezhs namespace: ns-owddk spec: selector: namespaces: - ns-owddk labelSelectors: apps.kubeblocks.io/pod-name: etcd-bwezhs-etcd-1 mode: all action: corrupt corrupt: corrupt: '100' correlation: '100' direction: to duration: 2m  `kubectl apply -f test-chaos-mesh-networkcorruptover-etcd-bwezhs.yaml`(B  networkchaos.chaos-mesh.org/test-chaos-mesh-networkcorruptover-etcd-bwezhs created apply test-chaos-mesh-networkcorruptover-etcd-bwezhs.yaml Success(B  `rm -rf test-chaos-mesh-networkcorruptover-etcd-bwezhs.yaml`(B  networkcorruptover chaos test waiting 120 seconds check cluster status  `kbcli cluster list etcd-bwezhs --show-labels --namespace ns-owddk `(B  NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS etcd-bwezhs ns-owddk DoNotTerminate Running Feb 11,2026 17:32 UTC+0800 app.kubernetes.io/instance=etcd-bwezhs check cluster status done(B cluster_status:Running(B check pod status  `kbcli cluster list-instances etcd-bwezhs --namespace ns-owddk `(B  NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME etcd-bwezhs-etcd-0 ns-owddk etcd-bwezhs etcd Running leader 0 100m / 100m 512Mi / 512Mi data:1Gi aks-cicdamdpool-55976491-vmss000001/10.224.0.7 Feb 11,2026 17:32 UTC+0800 etcd-bwezhs-etcd-1 ns-owddk etcd-bwezhs etcd Running leader 0 100m / 100m 512Mi / 512Mi data:1Gi aks-cicdamdpool-55976491-vmss000002/10.224.0.9 Feb 11,2026 17:32 UTC+0800 etcd-bwezhs-etcd-2 ns-owddk etcd-bwezhs etcd Running follower 0 100m / 100m 512Mi / 512Mi data:1Gi aks-cicdamdpool-55976491-vmss000003/10.224.0.5 Feb 11,2026 17:34 UTC+0800 check pod status done(B check cluster role leader(B: etcd-bwezhs-etcd-0 etcd-bwezhs-etcd-1;follower(B: etcd-bwezhs-etcd-2 leader(B: etcd-bwezhs-etcd-0 etcd-bwezhs-etcd-1;follower(B: etcd-bwezhs-etcd-2 leader(B: etcd-bwezhs-etcd-0 etcd-bwezhs-etcd-1;follower(B: etcd-bwezhs-etcd-2 check cluster role done(B leader(B: etcd-bwezhs-etcd-0;follower(B: etcd-bwezhs-etcd-1 etcd-bwezhs-etcd-2 check cluster connect  `echo 'etcdctl --endpoints=http://etcd-bwezhs-client.ns-owddk.svc.cluster.local:2379 endpoint health' | kubectl exec -it etcd-bwezhs-etcd-0 --namespace ns-owddk -- bash`(B  check cluster connect done(B  `kubectl patch -p '{"metadata":{"finalizers":[]}}' --type=merge NetworkChaos test-chaos-mesh-networkcorruptover-etcd-bwezhs --namespace ns-owddk `(B  networkchaos.chaos-mesh.org "test-chaos-mesh-networkcorruptover-etcd-bwezhs" force deleted check failover pod name failover pod name:etcd-bwezhs-etcd-0 failover networkcorruptover Success(B check db_client batch data count  `echo "etcdctl --endpoints=http://etcd-bwezhs-client.ns-owddk.svc.cluster.local:2379 get --prefix \"executions_loop_key\" --keys-only | (grep executions_loop_key || true) | wc -l " | kubectl exec -it etcd-bwezhs-etcd-0 --namespace ns-owddk -- bash `(B  check db_client batch [4386] equal [4386] data Success(B check readonly db_client batch data count  `echo "etcdctl --endpoints=http://etcd-bwezhs-client.ns-owddk.svc.cluster.local:2379 get --prefix \"executions_loop_key\" --keys-only | (grep executions_loop_key || true) | wc -l " | kubectl exec -it etcd-bwezhs-etcd-1 --namespace ns-owddk -- bash `(B  check readonly db_client batch data [4386] equal [4386] Success(B  `kubectl get pvc -l app.kubernetes.io/instance=etcd-bwezhs,apps.kubeblocks.io/component-name=etcd,apps.kubeblocks.io/vct-name=data --namespace ns-owddk `(B  cluster volume-expand check cluster status before ops check cluster status done(B cluster_status:Running(B  `kbcli cluster volume-expand etcd-bwezhs --auto-approve --force=true --components etcd --volume-claim-templates data --storage 2Gi --namespace ns-owddk `(B  OpsRequest etcd-bwezhs-volumeexpansion-q9cb7 created successfully, you can view the progress: kbcli cluster describe-ops etcd-bwezhs-volumeexpansion-q9cb7 -n ns-owddk check ops status  `kbcli cluster list-ops etcd-bwezhs --status all --namespace ns-owddk `(B  NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME etcd-bwezhs-volumeexpansion-q9cb7 ns-owddk VolumeExpansion etcd-bwezhs etcd Running 0/3 Feb 11,2026 17:43 UTC+0800 check cluster status  `kbcli cluster list etcd-bwezhs --show-labels --namespace ns-owddk `(B  NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS etcd-bwezhs ns-owddk DoNotTerminate Updating Feb 11,2026 17:32 UTC+0800 app.kubernetes.io/instance=etcd-bwezhs cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B check cluster status done(B cluster_status:Running(B check pod status  `kbcli cluster list-instances etcd-bwezhs --namespace ns-owddk `(B  NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME etcd-bwezhs-etcd-0 ns-owddk etcd-bwezhs etcd Running leader 0 100m / 100m 512Mi / 512Mi data:2Gi aks-cicdamdpool-55976491-vmss000001/10.224.0.7 Feb 11,2026 17:32 UTC+0800 etcd-bwezhs-etcd-1 ns-owddk etcd-bwezhs etcd Running follower 0 100m / 100m 512Mi / 512Mi data:2Gi aks-cicdamdpool-55976491-vmss000002/10.224.0.9 Feb 11,2026 17:32 UTC+0800 etcd-bwezhs-etcd-2 ns-owddk etcd-bwezhs etcd Running follower 0 100m / 100m 512Mi / 512Mi data:2Gi aks-cicdamdpool-55976491-vmss000003/10.224.0.5 Feb 11,2026 17:34 UTC+0800 check pod status done(B check cluster role check cluster role done(B leader(B: etcd-bwezhs-etcd-0;follower(B: etcd-bwezhs-etcd-1 etcd-bwezhs-etcd-2 check cluster connect  `echo 'etcdctl --endpoints=http://etcd-bwezhs-client.ns-owddk.svc.cluster.local:2379 endpoint health' | kubectl exec -it etcd-bwezhs-etcd-0 --namespace ns-owddk -- bash`(B  check cluster connect done(B check ops status  `kbcli cluster list-ops etcd-bwezhs --status all --namespace ns-owddk `(B  NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME etcd-bwezhs-volumeexpansion-q9cb7 ns-owddk VolumeExpansion etcd-bwezhs etcd Succeed 3/3 Feb 11,2026 17:43 UTC+0800 check ops status done(B ops_status:etcd-bwezhs-volumeexpansion-q9cb7 ns-owddk VolumeExpansion etcd-bwezhs etcd Succeed 3/3 Feb 11,2026 17:43 UTC+0800 (B  `kubectl patch -p '{"metadata":{"finalizers":[]}}' --type=merge opsrequests.operations etcd-bwezhs-volumeexpansion-q9cb7 --namespace ns-owddk `(B  opsrequest.operations.kubeblocks.io/etcd-bwezhs-volumeexpansion-q9cb7 patched  `kbcli cluster delete-ops --name etcd-bwezhs-volumeexpansion-q9cb7 --force --auto-approve --namespace ns-owddk `(B  OpsRequest etcd-bwezhs-volumeexpansion-q9cb7 deleted check db_client batch data count  `echo "etcdctl --endpoints=http://etcd-bwezhs-client.ns-owddk.svc.cluster.local:2379 get --prefix \"executions_loop_key\" --keys-only | (grep executions_loop_key || true) | wc -l " | kubectl exec -it etcd-bwezhs-etcd-0 --namespace ns-owddk -- bash `(B  check db_client batch [4386] equal [4386] data Success(B check readonly db_client batch data count  `echo "etcdctl --endpoints=http://etcd-bwezhs-client.ns-owddk.svc.cluster.local:2379 get --prefix \"executions_loop_key\" --keys-only | (grep executions_loop_key || true) | wc -l " | kubectl exec -it etcd-bwezhs-etcd-1 --namespace ns-owddk -- bash `(B  check readonly db_client batch data [4386] equal [4386] Success(B check cluster status before ops check cluster status done(B cluster_status:Running(B  `kbcli cluster vscale etcd-bwezhs --auto-approve --force=true --components etcd --cpu 200m --memory 0.6Gi --namespace ns-owddk `(B  OpsRequest etcd-bwezhs-verticalscaling-2f29j created successfully, you can view the progress: kbcli cluster describe-ops etcd-bwezhs-verticalscaling-2f29j -n ns-owddk check ops status  `kbcli cluster list-ops etcd-bwezhs --status all --namespace ns-owddk `(B  NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME etcd-bwezhs-verticalscaling-2f29j ns-owddk VerticalScaling etcd-bwezhs etcd Running 0/3 Feb 11,2026 17:49 UTC+0800 check cluster status  `kbcli cluster list etcd-bwezhs --show-labels --namespace ns-owddk `(B  NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS etcd-bwezhs ns-owddk DoNotTerminate Updating Feb 11,2026 17:32 UTC+0800 app.kubernetes.io/instance=etcd-bwezhs cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B check cluster status done(B cluster_status:Running(B check pod status  `kbcli cluster list-instances etcd-bwezhs --namespace ns-owddk `(B  NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME etcd-bwezhs-etcd-0 ns-owddk etcd-bwezhs etcd Running follower 0 200m / 200m 644245094400m / 644245094400m data:2Gi aks-cicdamdpool-55976491-vmss000001/10.224.0.7 Feb 11,2026 17:52 UTC+0800 etcd-bwezhs-etcd-1 ns-owddk etcd-bwezhs etcd Running follower 0 200m / 200m 644245094400m / 644245094400m data:2Gi aks-cicdamdpool-55976491-vmss000002/10.224.0.9 Feb 11,2026 17:51 UTC+0800 etcd-bwezhs-etcd-2 ns-owddk etcd-bwezhs etcd Running leader 0 200m / 200m 644245094400m / 644245094400m data:2Gi aks-cicdamdpool-55976491-vmss000003/10.224.0.5 Feb 11,2026 17:49 UTC+0800 check pod status done(B check cluster role check cluster role done(B leader(B: etcd-bwezhs-etcd-2;follower(B: etcd-bwezhs-etcd-0 etcd-bwezhs-etcd-1 check cluster connect  `echo 'etcdctl --endpoints=http://etcd-bwezhs-client.ns-owddk.svc.cluster.local:2379 endpoint health' | kubectl exec -it etcd-bwezhs-etcd-2 --namespace ns-owddk -- bash`(B  check cluster connect done(B check ops status  `kbcli cluster list-ops etcd-bwezhs --status all --namespace ns-owddk `(B  NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME etcd-bwezhs-verticalscaling-2f29j ns-owddk VerticalScaling etcd-bwezhs etcd Succeed 3/3 Feb 11,2026 17:49 UTC+0800 check ops status done(B ops_status:etcd-bwezhs-verticalscaling-2f29j ns-owddk VerticalScaling etcd-bwezhs etcd Succeed 3/3 Feb 11,2026 17:49 UTC+0800 (B  `kubectl patch -p '{"metadata":{"finalizers":[]}}' --type=merge opsrequests.operations etcd-bwezhs-verticalscaling-2f29j --namespace ns-owddk `(B  opsrequest.operations.kubeblocks.io/etcd-bwezhs-verticalscaling-2f29j patched  `kbcli cluster delete-ops --name etcd-bwezhs-verticalscaling-2f29j --force --auto-approve --namespace ns-owddk `(B  OpsRequest etcd-bwezhs-verticalscaling-2f29j deleted check db_client batch data count  `echo "etcdctl --endpoints=http://etcd-bwezhs-client.ns-owddk.svc.cluster.local:2379 get --prefix \"executions_loop_key\" --keys-only | (grep executions_loop_key || true) | wc -l " | kubectl exec -it etcd-bwezhs-etcd-2 --namespace ns-owddk -- bash `(B  check db_client batch [4386] equal [4386] data Success(B check readonly db_client batch data count  `echo "etcdctl --endpoints=http://etcd-bwezhs-client.ns-owddk.svc.cluster.local:2379 get --prefix \"executions_loop_key\" --keys-only | (grep executions_loop_key || true) | wc -l " | kubectl exec -it etcd-bwezhs-etcd-0 --namespace ns-owddk -- bash `(B  check readonly db_client batch data [4386] equal [4386] Success(B test failover dnsrandom(B check cluster status before cluster-failover-dnsrandom check cluster status done(B cluster_status:Running(B  `kubectl patch -p '{"metadata":{"finalizers":[]}}' --type=merge DNSChaos test-chaos-mesh-dnsrandom-etcd-bwezhs --namespace ns-owddk `(B  apiVersion: chaos-mesh.org/v1alpha1 kind: DNSChaos metadata: name: test-chaos-mesh-dnsrandom-etcd-bwezhs namespace: ns-owddk spec: selector: namespaces: - ns-owddk labelSelectors: apps.kubeblocks.io/pod-name: etcd-bwezhs-etcd-2 mode: all action: random duration: 2m  `kubectl apply -f test-chaos-mesh-dnsrandom-etcd-bwezhs.yaml`(B  dnschaos.chaos-mesh.org/test-chaos-mesh-dnsrandom-etcd-bwezhs created apply test-chaos-mesh-dnsrandom-etcd-bwezhs.yaml Success(B  `rm -rf test-chaos-mesh-dnsrandom-etcd-bwezhs.yaml`(B  dnsrandom chaos test waiting 120 seconds check cluster status  `kbcli cluster list etcd-bwezhs --show-labels --namespace ns-owddk `(B  NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS etcd-bwezhs ns-owddk DoNotTerminate Running Feb 11,2026 17:32 UTC+0800 app.kubernetes.io/instance=etcd-bwezhs check cluster status done(B cluster_status:Running(B check pod status  `kbcli cluster list-instances etcd-bwezhs --namespace ns-owddk `(B  NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME etcd-bwezhs-etcd-0 ns-owddk etcd-bwezhs etcd Running follower 0 200m / 200m 644245094400m / 644245094400m data:2Gi aks-cicdamdpool-55976491-vmss000001/10.224.0.7 Feb 11,2026 17:52 UTC+0800 etcd-bwezhs-etcd-1 ns-owddk etcd-bwezhs etcd Running follower 0 200m / 200m 644245094400m / 644245094400m data:2Gi aks-cicdamdpool-55976491-vmss000002/10.224.0.9 Feb 11,2026 17:51 UTC+0800 etcd-bwezhs-etcd-2 ns-owddk etcd-bwezhs etcd Running leader 0 200m / 200m 644245094400m / 644245094400m data:2Gi aks-cicdamdpool-55976491-vmss000003/10.224.0.5 Feb 11,2026 17:49 UTC+0800 check pod status done(B check cluster role check cluster role done(B leader(B: etcd-bwezhs-etcd-2;follower(B: etcd-bwezhs-etcd-0 etcd-bwezhs-etcd-1 check cluster connect  `echo 'etcdctl --endpoints=http://etcd-bwezhs-client.ns-owddk.svc.cluster.local:2379 endpoint health' | kubectl exec -it etcd-bwezhs-etcd-2 --namespace ns-owddk -- bash`(B  check cluster connect done(B  `kubectl patch -p '{"metadata":{"finalizers":[]}}' --type=merge DNSChaos test-chaos-mesh-dnsrandom-etcd-bwezhs --namespace ns-owddk `(B  dnschaos.chaos-mesh.org "test-chaos-mesh-dnsrandom-etcd-bwezhs" force deleted check failover pod name failover pod name:etcd-bwezhs-etcd-2 failover dnsrandom Success(B check db_client batch data count  `echo "etcdctl --endpoints=http://etcd-bwezhs-client.ns-owddk.svc.cluster.local:2379 get --prefix \"executions_loop_key\" --keys-only | (grep executions_loop_key || true) | wc -l " | kubectl exec -it etcd-bwezhs-etcd-2 --namespace ns-owddk -- bash `(B  check db_client batch [4386] equal [4386] data Success(B check readonly db_client batch data count  `echo "etcdctl --endpoints=http://etcd-bwezhs-client.ns-owddk.svc.cluster.local:2379 get --prefix \"executions_loop_key\" --keys-only | (grep executions_loop_key || true) | wc -l " | kubectl exec -it etcd-bwezhs-etcd-0 --namespace ns-owddk -- bash `(B  check readonly db_client batch data [4386] equal [4386] Success(B test failover connectionstress(B check cluster status before cluster-failover-connectionstress check cluster status done(B cluster_status:Running(B  `kubectl patch -p '{"metadata":{"finalizers":[]}}' --type=merge pods test-db-client-connectionstress-etcd-bwezhs --namespace ns-owddk `(B   `kubectl get secrets -l app.kubernetes.io/instance=etcd-bwezhs`(B  Not found cluster secret(B DB_USERNAME:;DB_PASSWORD:;DB_PORT:2379;DB_DATABASE:(B apiVersion: v1 kind: Pod metadata: name: test-db-client-connectionstress-etcd-bwezhs namespace: ns-owddk spec: containers: - name: test-dbclient imagePullPolicy: IfNotPresent image: docker.io/apecloud/dbclient:test args: - "--host" - "etcd-bwezhs-client.ns-owddk.svc.cluster.local" - "--user" - "" - "--password" - "" - "--port" - "2379" - "--database" - "" - "--dbtype" - "etcd" - "--test" - "connectionstress" - "--connections" - "5000" - "--duration" - "60" restartPolicy: Never  `kubectl apply -f test-db-client-connectionstress-etcd-bwezhs.yaml`(B  pod/test-db-client-connectionstress-etcd-bwezhs created apply test-db-client-connectionstress-etcd-bwezhs.yaml Success(B  `rm -rf test-db-client-connectionstress-etcd-bwezhs.yaml`(B  check pod status pod_status:NAME READY STATUS RESTARTS AGE test-db-client-connectionstress-etcd-bwezhs 1/1 Running 0 6s(B pod_status:NAME READY STATUS RESTARTS AGE test-db-client-connectionstress-etcd-bwezhs 1/1 Running 0 10s(B pod_status:NAME READY STATUS RESTARTS AGE test-db-client-connectionstress-etcd-bwezhs 1/1 Running 0 15s(B pod_status:NAME READY STATUS RESTARTS AGE test-db-client-connectionstress-etcd-bwezhs 1/1 Running 0 21s(B pod_status:NAME READY STATUS RESTARTS AGE test-db-client-connectionstress-etcd-bwezhs 1/1 Running 0 26s(B pod_status:NAME READY STATUS RESTARTS AGE test-db-client-connectionstress-etcd-bwezhs 1/1 Running 0 31s(B pod_status:NAME READY STATUS RESTARTS AGE test-db-client-connectionstress-etcd-bwezhs 1/1 Running 0 36s(B pod_status:NAME READY STATUS RESTARTS AGE test-db-client-connectionstress-etcd-bwezhs 1/1 Running 0 42s(B pod_status:NAME READY STATUS RESTARTS AGE test-db-client-connectionstress-etcd-bwezhs 1/1 Running 0 47s(B pod_status:NAME READY STATUS RESTARTS AGE test-db-client-connectionstress-etcd-bwezhs 1/1 Running 0 52s(B pod_status:NAME READY STATUS RESTARTS AGE test-db-client-connectionstress-etcd-bwezhs 1/1 Running 0 58s(B pod_status:NAME READY STATUS RESTARTS AGE test-db-client-connectionstress-etcd-bwezhs 1/1 Running 0 63s(B pod_status:NAME READY STATUS RESTARTS AGE test-db-client-connectionstress-etcd-bwezhs 1/1 Running 0 68s(B pod_status:NAME READY STATUS RESTARTS AGE test-db-client-connectionstress-etcd-bwezhs 1/1 Running 0 73s(B pod_status:NAME READY STATUS RESTARTS AGE test-db-client-connectionstress-etcd-bwezhs 1/1 Running 0 79s(B pod_status:NAME READY STATUS RESTARTS AGE test-db-client-connectionstress-etcd-bwezhs 1/1 Running 0 84s(B pod_status:NAME READY STATUS RESTARTS AGE test-db-client-connectionstress-etcd-bwezhs 1/1 Running 0 89s(B check pod test-db-client-connectionstress-etcd-bwezhs status done(B pod_status:NAME READY STATUS RESTARTS AGE test-db-client-connectionstress-etcd-bwezhs 0/1 Completed 0 95s(B check cluster status  `kbcli cluster list etcd-bwezhs --show-labels --namespace ns-owddk `(B  NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS etcd-bwezhs ns-owddk DoNotTerminate Running Feb 11,2026 17:32 UTC+0800 app.kubernetes.io/instance=etcd-bwezhs check cluster status done(B cluster_status:Running(B check pod status  `kbcli cluster list-instances etcd-bwezhs --namespace ns-owddk `(B  NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME etcd-bwezhs-etcd-0 ns-owddk etcd-bwezhs etcd Running follower 0 200m / 200m 644245094400m / 644245094400m data:2Gi aks-cicdamdpool-55976491-vmss000001/10.224.0.7 Feb 11,2026 17:52 UTC+0800 etcd-bwezhs-etcd-1 ns-owddk etcd-bwezhs etcd Running follower 0 200m / 200m 644245094400m / 644245094400m data:2Gi aks-cicdamdpool-55976491-vmss000002/10.224.0.9 Feb 11,2026 17:51 UTC+0800 etcd-bwezhs-etcd-2 ns-owddk etcd-bwezhs etcd Running leader 0 200m / 200m 644245094400m / 644245094400m data:2Gi aks-cicdamdpool-55976491-vmss000003/10.224.0.5 Feb 11,2026 17:49 UTC+0800 check pod status done(B check cluster role check cluster role done(B leader(B: etcd-bwezhs-etcd-2;follower(B: etcd-bwezhs-etcd-0 etcd-bwezhs-etcd-1 check cluster connect  `echo 'etcdctl --endpoints=http://etcd-bwezhs-client.ns-owddk.svc.cluster.local:2379 endpoint health' | kubectl exec -it etcd-bwezhs-etcd-2 --namespace ns-owddk -- bash`(B  check cluster connect done(B Connection 4958: Get operation successful Using no auth Connection 4959: Get operation successful Using no auth Connection 4960: Get operation successful Using no auth Connection 4961: Get operation successful Using no auth Connection 4962: Get operation successful Using no auth Connection 4963: Get operation successful Using no auth Connection 4964: Get operation successful Using no auth Connection 4965: Get operation successful Using no auth Connection 4966: Get operation successful Using no auth Connection 4967: Get operation successful Using no auth Connection 4968: Get operation successful Using no auth Connection 4969: Get operation successful Using no auth Connection 4970: Get operation successful Using no auth Connection 4971: Get operation successful Using no auth Connection 4972: Get operation successful Using no auth Connection 4973: Get operation successful Using no auth Connection 4974: Get operation successful Using no auth Connection 4975: Get operation successful Using no auth Connection 4976: Get operation successful Using no auth Connection 4977: Get operation successful Using no auth Connection 4978: Get operation successful Using no auth Connection 4979: Get operation successful Using no auth Connection 4980: Get operation successful Using no auth Connection 4981: Get operation successful Using no auth Connection 4982: Get operation successful Using no auth Connection 4983: Get operation successful Using no auth Connection 4984: Get operation successful Using no auth Connection 4985: Get operation successful Using no auth Connection 4986: Get operation successful Using no auth Connection 4987: Get operation successful Using no auth Connection 4988: Get operation successful Using no auth Connection 4989: Get operation successful Using no auth Connection 4990: Get operation successful Using no auth Connection 4991: Get operation successful Using no auth Connection 4992: Get operation successful Using no auth Connection 4993: Get operation successful Using no auth Connection 4994: Get operation successful Using no auth Connection 4995: Get operation successful Using no auth Connection 4996: Get operation successful Using no auth Connection 4997: Get operation successful Using no auth Connection 4998: Get operation successful Using no auth Connection 4999: Get operation successful Test Result: Connection stress test completed: Successful connections: 5000 Duration: 29 seconds Connection Information: Database Type: etcd Host: etcd-bwezhs-client.ns-owddk.svc.cluster.local Port: 2379 Database: Table: User: Org: Access Mode: mysql Test Type: connectionstress Connection Count: 5000 Duration: 60 seconds  `kubectl patch -p '{"metadata":{"finalizers":[]}}' --type=merge pods test-db-client-connectionstress-etcd-bwezhs --namespace ns-owddk `(B  pod/test-db-client-connectionstress-etcd-bwezhs patched (no change) pod "test-db-client-connectionstress-etcd-bwezhs" force deleted check failover pod name failover pod name:etcd-bwezhs-etcd-2 failover connectionstress Success(B check db_client batch data count  `echo "etcdctl --endpoints=http://etcd-bwezhs-client.ns-owddk.svc.cluster.local:2379 get --prefix \"executions_loop_key\" --keys-only | (grep executions_loop_key || true) | wc -l " | kubectl exec -it etcd-bwezhs-etcd-2 --namespace ns-owddk -- bash `(B  check db_client batch [4386] equal [4386] data Success(B check readonly db_client batch data count  `echo "etcdctl --endpoints=http://etcd-bwezhs-client.ns-owddk.svc.cluster.local:2379 get --prefix \"executions_loop_key\" --keys-only | (grep executions_loop_key || true) | wc -l " | kubectl exec -it etcd-bwezhs-etcd-0 --namespace ns-owddk -- bash `(B  check readonly db_client batch data [4386] equal [4386] Success(B cluster restart check cluster status before ops check cluster status done(B cluster_status:Running(B  `kbcli cluster restart etcd-bwezhs --auto-approve --force=true --namespace ns-owddk `(B  OpsRequest etcd-bwezhs-restart-2p7lt created successfully, you can view the progress: kbcli cluster describe-ops etcd-bwezhs-restart-2p7lt -n ns-owddk check ops status  `kbcli cluster list-ops etcd-bwezhs --status all --namespace ns-owddk `(B  NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME etcd-bwezhs-restart-2p7lt ns-owddk Restart etcd-bwezhs etcd Running 0/3 Feb 11,2026 17:57 UTC+0800 check cluster status  `kbcli cluster list etcd-bwezhs --show-labels --namespace ns-owddk `(B  NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS etcd-bwezhs ns-owddk DoNotTerminate Updating Feb 11,2026 17:32 UTC+0800 app.kubernetes.io/instance=etcd-bwezhs cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B check cluster status done(B cluster_status:Running(B check pod status  `kbcli cluster list-instances etcd-bwezhs --namespace ns-owddk `(B  NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME etcd-bwezhs-etcd-0 ns-owddk etcd-bwezhs etcd Running leader 0 200m / 200m 644245094400m / 644245094400m data:2Gi aks-cicdamdpool-55976491-vmss000001/10.224.0.7 Feb 11,2026 17:59 UTC+0800 etcd-bwezhs-etcd-1 ns-owddk etcd-bwezhs etcd Running follower 0 200m / 200m 644245094400m / 644245094400m data:2Gi aks-cicdamdpool-55976491-vmss000002/10.224.0.9 Feb 11,2026 17:57 UTC+0800 etcd-bwezhs-etcd-2 ns-owddk etcd-bwezhs etcd Running follower 0 200m / 200m 644245094400m / 644245094400m data:2Gi aks-cicdamdpool-55976491-vmss000003/10.224.0.5 Feb 11,2026 18:00 UTC+0800 check pod status done(B check cluster role check cluster role done(B leader(B: etcd-bwezhs-etcd-0;follower(B: etcd-bwezhs-etcd-1 etcd-bwezhs-etcd-2 check cluster connect  `echo 'etcdctl --endpoints=http://etcd-bwezhs-client.ns-owddk.svc.cluster.local:2379 endpoint health' | kubectl exec -it etcd-bwezhs-etcd-0 --namespace ns-owddk -- bash`(B  check cluster connect done(B check ops status  `kbcli cluster list-ops etcd-bwezhs --status all --namespace ns-owddk `(B  NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME etcd-bwezhs-restart-2p7lt ns-owddk Restart etcd-bwezhs etcd Succeed 3/3 Feb 11,2026 17:57 UTC+0800 check ops status done(B ops_status:etcd-bwezhs-restart-2p7lt ns-owddk Restart etcd-bwezhs etcd Succeed 3/3 Feb 11,2026 17:57 UTC+0800 (B  `kubectl patch -p '{"metadata":{"finalizers":[]}}' --type=merge opsrequests.operations etcd-bwezhs-restart-2p7lt --namespace ns-owddk `(B  opsrequest.operations.kubeblocks.io/etcd-bwezhs-restart-2p7lt patched  `kbcli cluster delete-ops --name etcd-bwezhs-restart-2p7lt --force --auto-approve --namespace ns-owddk `(B  OpsRequest etcd-bwezhs-restart-2p7lt deleted check db_client batch data count  `echo "etcdctl --endpoints=http://etcd-bwezhs-client.ns-owddk.svc.cluster.local:2379 get --prefix \"executions_loop_key\" --keys-only | (grep executions_loop_key || true) | wc -l " | kubectl exec -it etcd-bwezhs-etcd-0 --namespace ns-owddk -- bash `(B  check db_client batch [4386] equal [4386] data Success(B check readonly db_client batch data count  `echo "etcdctl --endpoints=http://etcd-bwezhs-client.ns-owddk.svc.cluster.local:2379 get --prefix \"executions_loop_key\" --keys-only | (grep executions_loop_key || true) | wc -l " | kubectl exec -it etcd-bwezhs-etcd-1 --namespace ns-owddk -- bash `(B  check readonly db_client batch data [4386] equal [4386] Success(B test switchover(B cluster promote check cluster status before ops check cluster status done(B cluster_status:Running(B  `kbcli cluster promote etcd-bwezhs --auto-approve --force=true --instance etcd-bwezhs-etcd-0 --candidate etcd-bwezhs-etcd-1 --namespace ns-owddk `(B  OpsRequest etcd-bwezhs-switchover-2v7g8 created successfully, you can view the progress: kbcli cluster describe-ops etcd-bwezhs-switchover-2v7g8 -n ns-owddk check ops status  `kbcli cluster list-ops etcd-bwezhs --status all --namespace ns-owddk `(B  NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME etcd-bwezhs-switchover-2v7g8 ns-owddk Switchover etcd-bwezhs etcd-bwezhs-etcd Running 0/1 Feb 11,2026 18:01 UTC+0800 check cluster status  `kbcli cluster list etcd-bwezhs --show-labels --namespace ns-owddk `(B  NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS etcd-bwezhs ns-owddk DoNotTerminate Running Feb 11,2026 17:32 UTC+0800 app.kubernetes.io/instance=etcd-bwezhs check cluster status done(B cluster_status:Running(B check pod status  `kbcli cluster list-instances etcd-bwezhs --namespace ns-owddk `(B  NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME etcd-bwezhs-etcd-0 ns-owddk etcd-bwezhs etcd Running leader 0 200m / 200m 644245094400m / 644245094400m data:2Gi aks-cicdamdpool-55976491-vmss000001/10.224.0.7 Feb 11,2026 17:59 UTC+0800 etcd-bwezhs-etcd-1 ns-owddk etcd-bwezhs etcd Running follower 0 200m / 200m 644245094400m / 644245094400m data:2Gi aks-cicdamdpool-55976491-vmss000002/10.224.0.9 Feb 11,2026 17:57 UTC+0800 etcd-bwezhs-etcd-2 ns-owddk etcd-bwezhs etcd Running follower 0 200m / 200m 644245094400m / 644245094400m data:2Gi aks-cicdamdpool-55976491-vmss000003/10.224.0.5 Feb 11,2026 18:00 UTC+0800 check pod status done(B check cluster role check cluster role done(B leader(B: etcd-bwezhs-etcd-0;follower(B: etcd-bwezhs-etcd-1 etcd-bwezhs-etcd-2 check cluster connect  `echo 'etcdctl --endpoints=http://etcd-bwezhs-client.ns-owddk.svc.cluster.local:2379 endpoint health' | kubectl exec -it etcd-bwezhs-etcd-0 --namespace ns-owddk -- bash`(B  check cluster connect done(B check ops status  `kbcli cluster list-ops etcd-bwezhs --status all --namespace ns-owddk `(B  NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME etcd-bwezhs-switchover-2v7g8 ns-owddk Switchover etcd-bwezhs etcd-bwezhs-etcd Running 0/1 Feb 11,2026 18:01 UTC+0800 ops_status:etcd-bwezhs-switchover-2v7g8 ns-owddk Switchover etcd-bwezhs etcd-bwezhs-etcd Running 0/1 Feb 11,2026 18:01 UTC+0800 (B check ops status done(B ops_status:etcd-bwezhs-switchover-2v7g8 ns-owddk Switchover etcd-bwezhs etcd-bwezhs-etcd Succeed 1/1 Feb 11,2026 18:01 UTC+0800 (B  `kubectl patch -p '{"metadata":{"finalizers":[]}}' --type=merge opsrequests.operations etcd-bwezhs-switchover-2v7g8 --namespace ns-owddk `(B  opsrequest.operations.kubeblocks.io/etcd-bwezhs-switchover-2v7g8 patched  `kbcli cluster delete-ops --name etcd-bwezhs-switchover-2v7g8 --force --auto-approve --namespace ns-owddk `(B  OpsRequest etcd-bwezhs-switchover-2v7g8 deleted check db_client batch data count  `echo "etcdctl --endpoints=http://etcd-bwezhs-client.ns-owddk.svc.cluster.local:2379 get --prefix \"executions_loop_key\" --keys-only | (grep executions_loop_key || true) | wc -l " | kubectl exec -it etcd-bwezhs-etcd-0 --namespace ns-owddk -- bash `(B  check db_client batch [4386] equal [4386] data Success(B check readonly db_client batch data count  `echo "etcdctl --endpoints=http://etcd-bwezhs-client.ns-owddk.svc.cluster.local:2379 get --prefix \"executions_loop_key\" --keys-only | (grep executions_loop_key || true) | wc -l " | kubectl exec -it etcd-bwezhs-etcd-2 --namespace ns-owddk -- bash `(B  check readonly db_client batch data [4386] equal [4386] Success(B switchover pod:etcd-bwezhs-etcd-1 switchover success(B test failover kill1(B check cluster status before cluster-failover-kill1 check cluster status done(B cluster_status:Running(B  `kill 1`(B  exec return message: check cluster status  `kbcli cluster list etcd-bwezhs --show-labels --namespace ns-owddk `(B  NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS etcd-bwezhs ns-owddk DoNotTerminate Running Feb 11,2026 17:32 UTC+0800 app.kubernetes.io/instance=etcd-bwezhs check cluster status done(B cluster_status:Running(B check pod status  `kbcli cluster list-instances etcd-bwezhs --namespace ns-owddk `(B  NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME etcd-bwezhs-etcd-0 ns-owddk etcd-bwezhs etcd Running follower 0 200m / 200m 644245094400m / 644245094400m data:2Gi aks-cicdamdpool-55976491-vmss000001/10.224.0.7 Feb 11,2026 17:59 UTC+0800 etcd-bwezhs-etcd-1 ns-owddk etcd-bwezhs etcd Running leader 0 200m / 200m 644245094400m / 644245094400m data:2Gi aks-cicdamdpool-55976491-vmss000002/10.224.0.9 Feb 11,2026 17:57 UTC+0800 etcd-bwezhs-etcd-2 ns-owddk etcd-bwezhs etcd Running follower 0 200m / 200m 644245094400m / 644245094400m data:2Gi aks-cicdamdpool-55976491-vmss000003/10.224.0.5 Feb 11,2026 18:00 UTC+0800 check pod status done(B check cluster role check cluster role done(B leader(B: etcd-bwezhs-etcd-1;follower(B: etcd-bwezhs-etcd-0 etcd-bwezhs-etcd-2 check cluster connect  `echo 'etcdctl --endpoints=http://etcd-bwezhs-client.ns-owddk.svc.cluster.local:2379 endpoint health' | kubectl exec -it etcd-bwezhs-etcd-1 --namespace ns-owddk -- bash`(B  check cluster connect done(B check failover pod name get etcd leader pod name... get etcd leader pod name... get etcd leader pod name... get etcd leader pod name... get etcd leader pod name... get etcd leader pod name... failover pod name:etcd-bwezhs-etcd-0 failover kill1 Success(B check db_client batch data count  `echo "etcdctl --endpoints=http://etcd-bwezhs-client.ns-owddk.svc.cluster.local:2379 get --prefix \"executions_loop_key\" --keys-only | (grep executions_loop_key || true) | wc -l " | kubectl exec -it etcd-bwezhs-etcd-0 --namespace ns-owddk -- bash `(B  check db_client batch [4386] equal [4386] data Success(B check readonly db_client batch data count  `echo "etcdctl --endpoints=http://etcd-bwezhs-client.ns-owddk.svc.cluster.local:2379 get --prefix \"executions_loop_key\" --keys-only | (grep executions_loop_key || true) | wc -l " | kubectl exec -it etcd-bwezhs-etcd-1 --namespace ns-owddk -- bash `(B  check readonly db_client batch data [4386] equal [4386] Success(B test failover podfailure(B check cluster status before cluster-failover-podfailure check cluster status done(B cluster_status:Running(B  `kubectl patch -p '{"metadata":{"finalizers":[]}}' --type=merge PodChaos test-chaos-mesh-podfailure-etcd-bwezhs --namespace ns-owddk `(B  apiVersion: chaos-mesh.org/v1alpha1 kind: PodChaos metadata: name: test-chaos-mesh-podfailure-etcd-bwezhs namespace: ns-owddk spec: selector: namespaces: - ns-owddk labelSelectors: apps.kubeblocks.io/pod-name: etcd-bwezhs-etcd-0 mode: all action: pod-failure duration: 2m  `kubectl apply -f test-chaos-mesh-podfailure-etcd-bwezhs.yaml`(B  podchaos.chaos-mesh.org/test-chaos-mesh-podfailure-etcd-bwezhs created apply test-chaos-mesh-podfailure-etcd-bwezhs.yaml Success(B  `rm -rf test-chaos-mesh-podfailure-etcd-bwezhs.yaml`(B  podfailure chaos test waiting 120 seconds check cluster status  `kbcli cluster list etcd-bwezhs --show-labels --namespace ns-owddk `(B  NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS etcd-bwezhs ns-owddk DoNotTerminate Failed Feb 11,2026 17:32 UTC+0800 app.kubernetes.io/instance=etcd-bwezhs cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B check cluster status done(B cluster_status:Running(B check pod status  `kbcli cluster list-instances etcd-bwezhs --namespace ns-owddk `(B  NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME etcd-bwezhs-etcd-0 ns-owddk etcd-bwezhs etcd Running follower 0 200m / 200m 644245094400m / 644245094400m data:2Gi aks-cicdamdpool-55976491-vmss000001/10.224.0.7 Feb 11,2026 17:59 UTC+0800 etcd-bwezhs-etcd-1 ns-owddk etcd-bwezhs etcd Running follower 0 200m / 200m 644245094400m / 644245094400m data:2Gi aks-cicdamdpool-55976491-vmss000002/10.224.0.9 Feb 11,2026 17:57 UTC+0800 etcd-bwezhs-etcd-2 ns-owddk etcd-bwezhs etcd Running leader 0 200m / 200m 644245094400m / 644245094400m data:2Gi aks-cicdamdpool-55976491-vmss000003/10.224.0.5 Feb 11,2026 18:00 UTC+0800 check pod status done(B check cluster role check cluster role done(B leader(B: etcd-bwezhs-etcd-2;follower(B: etcd-bwezhs-etcd-0 etcd-bwezhs-etcd-1 check cluster connect  `echo 'etcdctl --endpoints=http://etcd-bwezhs-client.ns-owddk.svc.cluster.local:2379 endpoint health' | kubectl exec -it etcd-bwezhs-etcd-2 --namespace ns-owddk -- bash`(B  check cluster connect done(B  `kubectl patch -p '{"metadata":{"finalizers":[]}}' --type=merge PodChaos test-chaos-mesh-podfailure-etcd-bwezhs --namespace ns-owddk `(B  podchaos.chaos-mesh.org "test-chaos-mesh-podfailure-etcd-bwezhs" force deleted podchaos.chaos-mesh.org/test-chaos-mesh-podfailure-etcd-bwezhs patched check failover pod name failover pod name:etcd-bwezhs-etcd-2 failover podfailure Success(B check db_client batch data count  `echo "etcdctl --endpoints=http://etcd-bwezhs-client.ns-owddk.svc.cluster.local:2379 get --prefix \"executions_loop_key\" --keys-only | (grep executions_loop_key || true) | wc -l " | kubectl exec -it etcd-bwezhs-etcd-2 --namespace ns-owddk -- bash `(B  check db_client batch [4386] equal [4386] data Success(B check readonly db_client batch data count  `echo "etcdctl --endpoints=http://etcd-bwezhs-client.ns-owddk.svc.cluster.local:2379 get --prefix \"executions_loop_key\" --keys-only | (grep executions_loop_key || true) | wc -l " | kubectl exec -it etcd-bwezhs-etcd-0 --namespace ns-owddk -- bash `(B  check readonly db_client batch data [4386] equal [4386] Success(B cluster stop check cluster status before ops check cluster status done(B cluster_status:Running(B  `kbcli cluster stop etcd-bwezhs --auto-approve --force=true --namespace ns-owddk `(B  OpsRequest etcd-bwezhs-stop-khbh7 created successfully, you can view the progress: kbcli cluster describe-ops etcd-bwezhs-stop-khbh7 -n ns-owddk check ops status  `kbcli cluster list-ops etcd-bwezhs --status all --namespace ns-owddk `(B  NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME etcd-bwezhs-stop-khbh7 ns-owddk Stop etcd-bwezhs etcd Running 0/3 Feb 11,2026 18:06 UTC+0800 check cluster status  `kbcli cluster list etcd-bwezhs --show-labels --namespace ns-owddk `(B  NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS etcd-bwezhs ns-owddk DoNotTerminate Stopped Feb 11,2026 17:32 UTC+0800 app.kubernetes.io/instance=etcd-bwezhs check cluster status done(B cluster_status:Stopped(B check pod status  `kbcli cluster list-instances etcd-bwezhs --namespace ns-owddk `(B  NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME check pod status done(B check ops status  `kbcli cluster list-ops etcd-bwezhs --status all --namespace ns-owddk `(B  NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME etcd-bwezhs-stop-khbh7 ns-owddk Stop etcd-bwezhs etcd Succeed 3/3 Feb 11,2026 18:06 UTC+0800 check ops status done(B ops_status:etcd-bwezhs-stop-khbh7 ns-owddk Stop etcd-bwezhs etcd Succeed 3/3 Feb 11,2026 18:06 UTC+0800 (B  `kubectl patch -p '{"metadata":{"finalizers":[]}}' --type=merge opsrequests.operations etcd-bwezhs-stop-khbh7 --namespace ns-owddk `(B  opsrequest.operations.kubeblocks.io/etcd-bwezhs-stop-khbh7 patched  `kbcli cluster delete-ops --name etcd-bwezhs-stop-khbh7 --force --auto-approve --namespace ns-owddk `(B  OpsRequest etcd-bwezhs-stop-khbh7 deleted cluster start check cluster status before ops check cluster status done(B cluster_status:Stopped(B  `kbcli cluster start etcd-bwezhs --force=true --namespace ns-owddk `(B  OpsRequest etcd-bwezhs-start-mw6dw created successfully, you can view the progress: kbcli cluster describe-ops etcd-bwezhs-start-mw6dw -n ns-owddk check ops status  `kbcli cluster list-ops etcd-bwezhs --status all --namespace ns-owddk `(B  NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME etcd-bwezhs-start-mw6dw ns-owddk Start etcd-bwezhs etcd Running 0/3 Feb 11,2026 18:07 UTC+0800 check cluster status  `kbcli cluster list etcd-bwezhs --show-labels --namespace ns-owddk `(B  NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS etcd-bwezhs ns-owddk DoNotTerminate Updating Feb 11,2026 17:32 UTC+0800 app.kubernetes.io/instance=etcd-bwezhs cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B check cluster status done(B cluster_status:Running(B check pod status  `kbcli cluster list-instances etcd-bwezhs --namespace ns-owddk `(B  NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME etcd-bwezhs-etcd-0 ns-owddk etcd-bwezhs etcd Running leader 0 200m / 200m 644245094400m / 644245094400m data:2Gi aks-cicdamdpool-55976491-vmss000003/10.224.0.5 Feb 11,2026 18:07 UTC+0800 etcd-bwezhs-etcd-1 ns-owddk etcd-bwezhs etcd Running follower 0 200m / 200m 644245094400m / 644245094400m data:2Gi aks-cicdamdpool-55976491-vmss000002/10.224.0.9 Feb 11,2026 18:10 UTC+0800 etcd-bwezhs-etcd-2 ns-owddk etcd-bwezhs etcd Running follower 0 200m / 200m 644245094400m / 644245094400m data:2Gi aks-cicdamdpool-55976491-vmss000001/10.224.0.7 Feb 11,2026 18:10 UTC+0800 check pod status done(B check cluster role check cluster role done(B leader(B: etcd-bwezhs-etcd-0;follower(B: etcd-bwezhs-etcd-1 etcd-bwezhs-etcd-2 check cluster connect  `echo 'etcdctl --endpoints=http://etcd-bwezhs-client.ns-owddk.svc.cluster.local:2379 endpoint health' | kubectl exec -it etcd-bwezhs-etcd-0 --namespace ns-owddk -- bash`(B  check cluster connect done(B check ops status  `kbcli cluster list-ops etcd-bwezhs --status all --namespace ns-owddk `(B  NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME etcd-bwezhs-start-mw6dw ns-owddk Start etcd-bwezhs etcd Succeed 3/3 Feb 11,2026 18:07 UTC+0800 check ops status done(B ops_status:etcd-bwezhs-start-mw6dw ns-owddk Start etcd-bwezhs etcd Succeed 3/3 Feb 11,2026 18:07 UTC+0800 (B  `kubectl patch -p '{"metadata":{"finalizers":[]}}' --type=merge opsrequests.operations etcd-bwezhs-start-mw6dw --namespace ns-owddk `(B  opsrequest.operations.kubeblocks.io/etcd-bwezhs-start-mw6dw patched  `kbcli cluster delete-ops --name etcd-bwezhs-start-mw6dw --force --auto-approve --namespace ns-owddk `(B  OpsRequest etcd-bwezhs-start-mw6dw deleted check db_client batch data count  `echo "etcdctl --endpoints=http://etcd-bwezhs-client.ns-owddk.svc.cluster.local:2379 get --prefix \"executions_loop_key\" --keys-only | (grep executions_loop_key || true) | wc -l " | kubectl exec -it etcd-bwezhs-etcd-0 --namespace ns-owddk -- bash `(B  check db_client batch [4386] equal [4386] data Success(B check readonly db_client batch data count  `echo "etcdctl --endpoints=http://etcd-bwezhs-client.ns-owddk.svc.cluster.local:2379 get --prefix \"executions_loop_key\" --keys-only | (grep executions_loop_key || true) | wc -l " | kubectl exec -it etcd-bwezhs-etcd-1 --namespace ns-owddk -- bash `(B  check readonly db_client batch data [4386] equal [4386] Success(B test failover oom(B check cluster status before cluster-failover-oom check cluster status done(B cluster_status:Running(B  `kubectl patch -p '{"metadata":{"finalizers":[]}}' --type=merge StressChaos test-chaos-mesh-oom-etcd-bwezhs --namespace ns-owddk `(B  apiVersion: chaos-mesh.org/v1alpha1 kind: StressChaos metadata: name: test-chaos-mesh-oom-etcd-bwezhs namespace: ns-owddk spec: selector: namespaces: - ns-owddk labelSelectors: apps.kubeblocks.io/pod-name: etcd-bwezhs-etcd-0 mode: all stressors: memory: workers: 1 size: "100GB" oomScoreAdj: -1000 duration: 2m  `kubectl apply -f test-chaos-mesh-oom-etcd-bwezhs.yaml`(B  stresschaos.chaos-mesh.org/test-chaos-mesh-oom-etcd-bwezhs created apply test-chaos-mesh-oom-etcd-bwezhs.yaml Success(B  `rm -rf test-chaos-mesh-oom-etcd-bwezhs.yaml`(B  check cluster status  `kbcli cluster list etcd-bwezhs --show-labels --namespace ns-owddk `(B  NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS etcd-bwezhs ns-owddk DoNotTerminate Running Feb 11,2026 17:32 UTC+0800 app.kubernetes.io/instance=etcd-bwezhs check cluster status done(B cluster_status:Running(B check pod status  `kbcli cluster list-instances etcd-bwezhs --namespace ns-owddk `(B  NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME etcd-bwezhs-etcd-0 ns-owddk etcd-bwezhs etcd Running leader 0 200m / 200m 644245094400m / 644245094400m data:2Gi aks-cicdamdpool-55976491-vmss000003/10.224.0.5 Feb 11,2026 18:07 UTC+0800 etcd-bwezhs-etcd-1 ns-owddk etcd-bwezhs etcd Running follower 0 200m / 200m 644245094400m / 644245094400m data:2Gi aks-cicdamdpool-55976491-vmss000002/10.224.0.9 Feb 11,2026 18:10 UTC+0800 etcd-bwezhs-etcd-2 ns-owddk etcd-bwezhs etcd Running follower 0 200m / 200m 644245094400m / 644245094400m data:2Gi aks-cicdamdpool-55976491-vmss000001/10.224.0.7 Feb 11,2026 18:10 UTC+0800 check pod status done(B check cluster role check cluster role done(B leader(B: etcd-bwezhs-etcd-0;follower(B: etcd-bwezhs-etcd-1 etcd-bwezhs-etcd-2 check cluster connect  `echo 'etcdctl --endpoints=http://etcd-bwezhs-client.ns-owddk.svc.cluster.local:2379 endpoint health' | kubectl exec -it etcd-bwezhs-etcd-0 --namespace ns-owddk -- bash`(B  check cluster connect done(B  `kubectl patch -p '{"metadata":{"finalizers":[]}}' --type=merge StressChaos test-chaos-mesh-oom-etcd-bwezhs --namespace ns-owddk `(B  stresschaos.chaos-mesh.org "test-chaos-mesh-oom-etcd-bwezhs" force deleted stresschaos.chaos-mesh.org/test-chaos-mesh-oom-etcd-bwezhs patched check failover pod name failover pod name:etcd-bwezhs-etcd-0 checking failover...(B  `kubectl patch -p '{"metadata":{"finalizers":[]}}' --type=merge StressChaos test-chaos-mesh-oom-etcd-bwezhs --namespace ns-owddk `(B   `kubectl patch -p '{"metadata":{"finalizers":[]}}' --type=merge StressChaos test-chaos-mesh-oom-etcd-bwezhs --namespace ns-owddk `(B  apiVersion: chaos-mesh.org/v1alpha1 kind: StressChaos metadata: name: test-chaos-mesh-oom-etcd-bwezhs namespace: ns-owddk spec: selector: namespaces: - ns-owddk labelSelectors: apps.kubeblocks.io/pod-name: etcd-bwezhs-etcd-0 mode: all stressors: memory: workers: 1 size: "100GB" oomScoreAdj: -1000 duration: 2m  `kubectl apply -f test-chaos-mesh-oom-etcd-bwezhs.yaml`(B  stresschaos.chaos-mesh.org/test-chaos-mesh-oom-etcd-bwezhs created apply test-chaos-mesh-oom-etcd-bwezhs.yaml Success(B  `rm -rf test-chaos-mesh-oom-etcd-bwezhs.yaml`(B  check cluster status  `kbcli cluster list etcd-bwezhs --show-labels --namespace ns-owddk `(B  NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS etcd-bwezhs ns-owddk DoNotTerminate Running Feb 11,2026 17:32 UTC+0800 app.kubernetes.io/instance=etcd-bwezhs check cluster status done(B cluster_status:Running(B check pod status  `kbcli cluster list-instances etcd-bwezhs --namespace ns-owddk `(B  NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME etcd-bwezhs-etcd-0 ns-owddk etcd-bwezhs etcd Running leader 0 200m / 200m 644245094400m / 644245094400m data:2Gi aks-cicdamdpool-55976491-vmss000003/10.224.0.5 Feb 11,2026 18:07 UTC+0800 etcd-bwezhs-etcd-1 ns-owddk etcd-bwezhs etcd Running follower 0 200m / 200m 644245094400m / 644245094400m data:2Gi aks-cicdamdpool-55976491-vmss000002/10.224.0.9 Feb 11,2026 18:10 UTC+0800 etcd-bwezhs-etcd-2 ns-owddk etcd-bwezhs etcd Running leader 0 200m / 200m 644245094400m / 644245094400m data:2Gi aks-cicdamdpool-55976491-vmss000001/10.224.0.7 Feb 11,2026 18:10 UTC+0800 check pod status done(B check cluster role leader(B: etcd-bwezhs-etcd-0 etcd-bwezhs-etcd-2;follower(B: etcd-bwezhs-etcd-1 check cluster role done(B leader(B: etcd-bwezhs-etcd-2;follower(B: etcd-bwezhs-etcd-0 etcd-bwezhs-etcd-1 check cluster connect  `echo 'etcdctl --endpoints=http://etcd-bwezhs-client.ns-owddk.svc.cluster.local:2379 endpoint health' | kubectl exec -it etcd-bwezhs-etcd-2 --namespace ns-owddk -- bash`(B  check cluster connect done(B  `kubectl patch -p '{"metadata":{"finalizers":[]}}' --type=merge StressChaos test-chaos-mesh-oom-etcd-bwezhs --namespace ns-owddk `(B  stresschaos.chaos-mesh.org "test-chaos-mesh-oom-etcd-bwezhs" force deleted stresschaos.chaos-mesh.org/test-chaos-mesh-oom-etcd-bwezhs patched check failover pod name:etcd-bwezhs-etcd-2 failover oom Success(B check db_client batch data count  `echo "etcdctl --endpoints=http://etcd-bwezhs-client.ns-owddk.svc.cluster.local:2379 get --prefix \"executions_loop_key\" --keys-only | (grep executions_loop_key || true) | wc -l " | kubectl exec -it etcd-bwezhs-etcd-2 --namespace ns-owddk -- bash `(B  check db_client batch [4386] equal [4386] data Success(B check readonly db_client batch data count  `echo "etcdctl --endpoints=http://etcd-bwezhs-client.ns-owddk.svc.cluster.local:2379 get --prefix \"executions_loop_key\" --keys-only | (grep executions_loop_key || true) | wc -l " | kubectl exec -it etcd-bwezhs-etcd-0 --namespace ns-owddk -- bash `(B  check readonly db_client batch data [4386] equal [4386] Success(B test failover podkill(B check cluster status before cluster-failover-podkill check cluster status done(B cluster_status:Running(B  `kubectl patch -p '{"metadata":{"finalizers":[]}}' --type=merge PodChaos test-chaos-mesh-podkill-etcd-bwezhs --namespace ns-owddk `(B  apiVersion: chaos-mesh.org/v1alpha1 kind: PodChaos metadata: name: test-chaos-mesh-podkill-etcd-bwezhs namespace: ns-owddk spec: selector: namespaces: - ns-owddk labelSelectors: apps.kubeblocks.io/pod-name: etcd-bwezhs-etcd-2 mode: all action: pod-kill  `kubectl apply -f test-chaos-mesh-podkill-etcd-bwezhs.yaml`(B  podchaos.chaos-mesh.org/test-chaos-mesh-podkill-etcd-bwezhs created apply test-chaos-mesh-podkill-etcd-bwezhs.yaml Success(B  `rm -rf test-chaos-mesh-podkill-etcd-bwezhs.yaml`(B  check cluster status  `kbcli cluster list etcd-bwezhs --show-labels --namespace ns-owddk `(B  NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS etcd-bwezhs ns-owddk DoNotTerminate Updating Feb 11,2026 17:32 UTC+0800 app.kubernetes.io/instance=etcd-bwezhs cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B check cluster status done(B cluster_status:Running(B check pod status  `kbcli cluster list-instances etcd-bwezhs --namespace ns-owddk `(B  NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME etcd-bwezhs-etcd-0 ns-owddk etcd-bwezhs etcd Running follower 0 200m / 200m 644245094400m / 644245094400m data:2Gi aks-cicdamdpool-55976491-vmss000003/10.224.0.5 Feb 11,2026 18:07 UTC+0800 etcd-bwezhs-etcd-1 ns-owddk etcd-bwezhs etcd Running leader 0 200m / 200m 644245094400m / 644245094400m data:2Gi aks-cicdamdpool-55976491-vmss000002/10.224.0.9 Feb 11,2026 18:10 UTC+0800 etcd-bwezhs-etcd-2 ns-owddk etcd-bwezhs etcd Running follower 0 200m / 200m 644245094400m / 644245094400m data:2Gi aks-cicdamdpool-55976491-vmss000001/10.224.0.7 Feb 11,2026 18:13 UTC+0800 check pod status done(B check cluster role check cluster role done(B leader(B: etcd-bwezhs-etcd-1;follower(B: etcd-bwezhs-etcd-0 etcd-bwezhs-etcd-2 check cluster connect  `echo 'etcdctl --endpoints=http://etcd-bwezhs-client.ns-owddk.svc.cluster.local:2379 endpoint health' | kubectl exec -it etcd-bwezhs-etcd-1 --namespace ns-owddk -- bash`(B  check cluster connect done(B  `kubectl patch -p '{"metadata":{"finalizers":[]}}' --type=merge PodChaos test-chaos-mesh-podkill-etcd-bwezhs --namespace ns-owddk `(B  podchaos.chaos-mesh.org "test-chaos-mesh-podkill-etcd-bwezhs" force deleted podchaos.chaos-mesh.org/test-chaos-mesh-podkill-etcd-bwezhs patched check failover pod name failover pod name:etcd-bwezhs-etcd-1 failover podkill Success(B check db_client batch data count  `echo "etcdctl --endpoints=http://etcd-bwezhs-client.ns-owddk.svc.cluster.local:2379 get --prefix \"executions_loop_key\" --keys-only | (grep executions_loop_key || true) | wc -l " | kubectl exec -it etcd-bwezhs-etcd-1 --namespace ns-owddk -- bash `(B  check db_client batch [4386] equal [4386] data Success(B check readonly db_client batch data count  `echo "etcdctl --endpoints=http://etcd-bwezhs-client.ns-owddk.svc.cluster.local:2379 get --prefix \"executions_loop_key\" --keys-only | (grep executions_loop_key || true) | wc -l " | kubectl exec -it etcd-bwezhs-etcd-0 --namespace ns-owddk -- bash `(B  check readonly db_client batch data [4386] equal [4386] Success(B cluster etcd scale-out cluster etcd scale-out replicas: 3 check cluster status before ops check cluster status done(B cluster_status:Running(B  `kbcli cluster scale-out etcd-bwezhs --auto-approve --force=true --components etcd --replicas 1 --namespace ns-owddk `(B  OpsRequest etcd-bwezhs-horizontalscaling-7m5kt created successfully, you can view the progress: kbcli cluster describe-ops etcd-bwezhs-horizontalscaling-7m5kt -n ns-owddk check ops status  `kbcli cluster list-ops etcd-bwezhs --status all --namespace ns-owddk `(B  NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME etcd-bwezhs-horizontalscaling-7m5kt ns-owddk HorizontalScaling etcd-bwezhs etcd Running 0/1 Feb 11,2026 18:14 UTC+0800 check cluster status  `kbcli cluster list etcd-bwezhs --show-labels --namespace ns-owddk `(B  NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS etcd-bwezhs ns-owddk DoNotTerminate Updating Feb 11,2026 17:32 UTC+0800 app.kubernetes.io/instance=etcd-bwezhs cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B check cluster status done(B cluster_status:Running(B check pod status  `kbcli cluster list-instances etcd-bwezhs --namespace ns-owddk `(B  NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME etcd-bwezhs-etcd-0 ns-owddk etcd-bwezhs etcd Running follower 0 200m / 200m 644245094400m / 644245094400m data:2Gi aks-cicdamdpool-55976491-vmss000003/10.224.0.5 Feb 11,2026 18:07 UTC+0800 etcd-bwezhs-etcd-1 ns-owddk etcd-bwezhs etcd Running leader 0 200m / 200m 644245094400m / 644245094400m data:2Gi aks-cicdamdpool-55976491-vmss000002/10.224.0.9 Feb 11,2026 18:10 UTC+0800 etcd-bwezhs-etcd-2 ns-owddk etcd-bwezhs etcd Running follower 0 200m / 200m 644245094400m / 644245094400m data:2Gi aks-cicdamdpool-55976491-vmss000001/10.224.0.7 Feb 11,2026 18:13 UTC+0800 etcd-bwezhs-etcd-3 ns-owddk etcd-bwezhs etcd Running follower 0 200m / 200m 644245094400m / 644245094400m data:2Gi aks-cicdamdpool-55976491-vmss000002/10.224.0.9 Feb 11,2026 18:14 UTC+0800 check pod status done(B check cluster role check cluster role done(B leader(B: etcd-bwezhs-etcd-1;follower(B: etcd-bwezhs-etcd-0 etcd-bwezhs-etcd-2 etcd-bwezhs-etcd-3 check cluster connect  `echo 'etcdctl --endpoints=http://etcd-bwezhs-client.ns-owddk.svc.cluster.local:2379 endpoint health' | kubectl exec -it etcd-bwezhs-etcd-1 --namespace ns-owddk -- bash`(B  check cluster connect done(B check ops status  `kbcli cluster list-ops etcd-bwezhs --status all --namespace ns-owddk `(B  NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME etcd-bwezhs-horizontalscaling-7m5kt ns-owddk HorizontalScaling etcd-bwezhs etcd Succeed 1/1 Feb 11,2026 18:14 UTC+0800 check ops status done(B ops_status:etcd-bwezhs-horizontalscaling-7m5kt ns-owddk HorizontalScaling etcd-bwezhs etcd Succeed 1/1 Feb 11,2026 18:14 UTC+0800 (B  `kubectl patch -p '{"metadata":{"finalizers":[]}}' --type=merge opsrequests.operations etcd-bwezhs-horizontalscaling-7m5kt --namespace ns-owddk `(B  opsrequest.operations.kubeblocks.io/etcd-bwezhs-horizontalscaling-7m5kt patched  `kbcli cluster delete-ops --name etcd-bwezhs-horizontalscaling-7m5kt --force --auto-approve --namespace ns-owddk `(B  OpsRequest etcd-bwezhs-horizontalscaling-7m5kt deleted check db_client batch data count  `echo "etcdctl --endpoints=http://etcd-bwezhs-client.ns-owddk.svc.cluster.local:2379 get --prefix \"executions_loop_key\" --keys-only | (grep executions_loop_key || true) | wc -l " | kubectl exec -it etcd-bwezhs-etcd-1 --namespace ns-owddk -- bash `(B  check db_client batch [4386] equal [4386] data Success(B check readonly db_client batch data count  `echo "etcdctl --endpoints=http://etcd-bwezhs-client.ns-owddk.svc.cluster.local:2379 get --prefix \"executions_loop_key\" --keys-only | (grep executions_loop_key || true) | wc -l " | kubectl exec -it etcd-bwezhs-etcd-0 --namespace ns-owddk -- bash `(B  check readonly db_client batch data [4386] equal [4386] Success(B cluster etcd scale-in cluster etcd scale-in replicas: 2 check cluster status before ops check cluster status done(B cluster_status:Running(B  `kbcli cluster scale-in etcd-bwezhs --auto-approve --force=true --components etcd --replicas 1 --namespace ns-owddk `(B  OpsRequest etcd-bwezhs-horizontalscaling-rshj5 created successfully, you can view the progress: kbcli cluster describe-ops etcd-bwezhs-horizontalscaling-rshj5 -n ns-owddk check ops status  `kbcli cluster list-ops etcd-bwezhs --status all --namespace ns-owddk `(B  NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME etcd-bwezhs-horizontalscaling-rshj5 ns-owddk HorizontalScaling etcd-bwezhs etcd Running 0/1 Feb 11,2026 18:20 UTC+0800 check cluster status  `kbcli cluster list etcd-bwezhs --show-labels --namespace ns-owddk `(B  NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS etcd-bwezhs ns-owddk DoNotTerminate Running Feb 11,2026 17:32 UTC+0800 app.kubernetes.io/instance=etcd-bwezhs check cluster status done(B cluster_status:Running(B check pod status  `kbcli cluster list-instances etcd-bwezhs --namespace ns-owddk `(B  NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME etcd-bwezhs-etcd-0 ns-owddk etcd-bwezhs etcd Running follower 0 200m / 200m 644245094400m / 644245094400m data:2Gi aks-cicdamdpool-55976491-vmss000003/10.224.0.5 Feb 11,2026 18:07 UTC+0800 etcd-bwezhs-etcd-1 ns-owddk etcd-bwezhs etcd Running leader 0 200m / 200m 644245094400m / 644245094400m data:2Gi aks-cicdamdpool-55976491-vmss000002/10.224.0.9 Feb 11,2026 18:10 UTC+0800 etcd-bwezhs-etcd-2 ns-owddk etcd-bwezhs etcd Running follower 0 200m / 200m 644245094400m / 644245094400m data:2Gi aks-cicdamdpool-55976491-vmss000001/10.224.0.7 Feb 11,2026 18:13 UTC+0800 check pod status done(B check cluster role check cluster role done(B leader(B: etcd-bwezhs-etcd-1;follower(B: etcd-bwezhs-etcd-0 etcd-bwezhs-etcd-2 check cluster connect  `echo 'etcdctl --endpoints=http://etcd-bwezhs-client.ns-owddk.svc.cluster.local:2379 endpoint health' | kubectl exec -it etcd-bwezhs-etcd-1 --namespace ns-owddk -- bash`(B  check cluster connect done(B check ops status  `kbcli cluster list-ops etcd-bwezhs --status all --namespace ns-owddk `(B  NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME etcd-bwezhs-horizontalscaling-rshj5 ns-owddk HorizontalScaling etcd-bwezhs etcd Succeed 1/1 Feb 11,2026 18:20 UTC+0800 check ops status done(B ops_status:etcd-bwezhs-horizontalscaling-rshj5 ns-owddk HorizontalScaling etcd-bwezhs etcd Succeed 1/1 Feb 11,2026 18:20 UTC+0800 (B  `kubectl patch -p '{"metadata":{"finalizers":[]}}' --type=merge opsrequests.operations etcd-bwezhs-horizontalscaling-rshj5 --namespace ns-owddk `(B  opsrequest.operations.kubeblocks.io/etcd-bwezhs-horizontalscaling-rshj5 patched  `kbcli cluster delete-ops --name etcd-bwezhs-horizontalscaling-rshj5 --force --auto-approve --namespace ns-owddk `(B  OpsRequest etcd-bwezhs-horizontalscaling-rshj5 deleted check db_client batch data count  `echo "etcdctl --endpoints=http://etcd-bwezhs-client.ns-owddk.svc.cluster.local:2379 get --prefix \"executions_loop_key\" --keys-only | (grep executions_loop_key || true) | wc -l " | kubectl exec -it etcd-bwezhs-etcd-1 --namespace ns-owddk -- bash `(B  check db_client batch [4386] equal [4386] data Success(B check readonly db_client batch data count  `echo "etcdctl --endpoints=http://etcd-bwezhs-client.ns-owddk.svc.cluster.local:2379 get --prefix \"executions_loop_key\" --keys-only | (grep executions_loop_key || true) | wc -l " | kubectl exec -it etcd-bwezhs-etcd-0 --namespace ns-owddk -- bash `(B  check readonly db_client batch data [4386] equal [4386] Success(B test failover networkbandwidthover(B check cluster status before cluster-failover-networkbandwidthover check cluster status done(B cluster_status:Running(B  `kubectl patch -p '{"metadata":{"finalizers":[]}}' --type=merge NetworkChaos test-chaos-mesh-networkbandwidthover-etcd-bwezhs --namespace ns-owddk `(B  apiVersion: chaos-mesh.org/v1alpha1 kind: NetworkChaos metadata: name: test-chaos-mesh-networkbandwidthover-etcd-bwezhs namespace: ns-owddk spec: selector: namespaces: - ns-owddk labelSelectors: apps.kubeblocks.io/pod-name: etcd-bwezhs-etcd-1 action: bandwidth mode: all bandwidth: rate: '1bps' limit: 20971520 buffer: 10000 duration: 2m  `kubectl apply -f test-chaos-mesh-networkbandwidthover-etcd-bwezhs.yaml`(B  networkchaos.chaos-mesh.org/test-chaos-mesh-networkbandwidthover-etcd-bwezhs created apply test-chaos-mesh-networkbandwidthover-etcd-bwezhs.yaml Success(B  `rm -rf test-chaos-mesh-networkbandwidthover-etcd-bwezhs.yaml`(B  networkbandwidthover chaos test waiting 120 seconds check cluster status  `kbcli cluster list etcd-bwezhs --show-labels --namespace ns-owddk `(B  NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS etcd-bwezhs ns-owddk DoNotTerminate Running Feb 11,2026 17:32 UTC+0800 app.kubernetes.io/instance=etcd-bwezhs check cluster status done(B cluster_status:Running(B check pod status  `kbcli cluster list-instances etcd-bwezhs --namespace ns-owddk `(B  NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME etcd-bwezhs-etcd-0 ns-owddk etcd-bwezhs etcd Running follower 0 200m / 200m 644245094400m / 644245094400m data:2Gi aks-cicdamdpool-55976491-vmss000003/10.224.0.5 Feb 11,2026 18:07 UTC+0800 etcd-bwezhs-etcd-1 ns-owddk etcd-bwezhs etcd Running leader 0 200m / 200m 644245094400m / 644245094400m data:2Gi aks-cicdamdpool-55976491-vmss000002/10.224.0.9 Feb 11,2026 18:10 UTC+0800 etcd-bwezhs-etcd-2 ns-owddk etcd-bwezhs etcd Running leader 0 200m / 200m 644245094400m / 644245094400m data:2Gi aks-cicdamdpool-55976491-vmss000001/10.224.0.7 Feb 11,2026 18:13 UTC+0800 check pod status done(B check cluster role leader(B: etcd-bwezhs-etcd-1 etcd-bwezhs-etcd-2;follower(B: etcd-bwezhs-etcd-0 leader(B: etcd-bwezhs-etcd-1 etcd-bwezhs-etcd-2;follower(B: etcd-bwezhs-etcd-0 leader(B: etcd-bwezhs-etcd-1 etcd-bwezhs-etcd-2;follower(B: etcd-bwezhs-etcd-0 leader(B: etcd-bwezhs-etcd-1 etcd-bwezhs-etcd-2;follower(B: etcd-bwezhs-etcd-0 leader(B: etcd-bwezhs-etcd-1 etcd-bwezhs-etcd-2;follower(B: etcd-bwezhs-etcd-0 leader(B: etcd-bwezhs-etcd-1 etcd-bwezhs-etcd-2;follower(B: etcd-bwezhs-etcd-0 leader(B: etcd-bwezhs-etcd-1 etcd-bwezhs-etcd-2;follower(B: etcd-bwezhs-etcd-0 leader(B: etcd-bwezhs-etcd-1 etcd-bwezhs-etcd-2;follower(B: etcd-bwezhs-etcd-0 leader(B: etcd-bwezhs-etcd-1 etcd-bwezhs-etcd-2;follower(B: etcd-bwezhs-etcd-0 leader(B: etcd-bwezhs-etcd-1 etcd-bwezhs-etcd-2;follower(B: etcd-bwezhs-etcd-0 check cluster role done(B leader(B: etcd-bwezhs-etcd-2;follower(B: etcd-bwezhs-etcd-0 etcd-bwezhs-etcd-1 check cluster connect  `echo 'etcdctl --endpoints=http://etcd-bwezhs-client.ns-owddk.svc.cluster.local:2379 endpoint health' | kubectl exec -it etcd-bwezhs-etcd-2 --namespace ns-owddk -- bash`(B  check cluster connect done(B  `kubectl patch -p '{"metadata":{"finalizers":[]}}' --type=merge NetworkChaos test-chaos-mesh-networkbandwidthover-etcd-bwezhs --namespace ns-owddk `(B  networkchaos.chaos-mesh.org "test-chaos-mesh-networkbandwidthover-etcd-bwezhs" force deleted check failover pod name failover pod name:etcd-bwezhs-etcd-2 failover networkbandwidthover Success(B check db_client batch data count  `echo "etcdctl --endpoints=http://etcd-bwezhs-client.ns-owddk.svc.cluster.local:2379 get --prefix \"executions_loop_key\" --keys-only | (grep executions_loop_key || true) | wc -l " | kubectl exec -it etcd-bwezhs-etcd-2 --namespace ns-owddk -- bash `(B  check db_client batch [4386] equal [4386] data Success(B check readonly db_client batch data count  `echo "etcdctl --endpoints=http://etcd-bwezhs-client.ns-owddk.svc.cluster.local:2379 get --prefix \"executions_loop_key\" --keys-only | (grep executions_loop_key || true) | wc -l " | kubectl exec -it etcd-bwezhs-etcd-0 --namespace ns-owddk -- bash `(B  check readonly db_client batch data [4386] equal [4386] Success(B test failover networkpartition(B check cluster status before cluster-failover-networkpartition check cluster status done(B cluster_status:Running(B  `kubectl patch -p '{"metadata":{"finalizers":[]}}' --type=merge NetworkChaos test-chaos-mesh-networkpartition-etcd-bwezhs --namespace ns-owddk `(B  apiVersion: chaos-mesh.org/v1alpha1 kind: NetworkChaos metadata: name: test-chaos-mesh-networkpartition-etcd-bwezhs namespace: ns-owddk spec: selector: namespaces: - ns-owddk labelSelectors: apps.kubeblocks.io/pod-name: etcd-bwezhs-etcd-2 action: partition mode: all target: mode: all selector: namespaces: - ns-owddk labelSelectors: apps.kubeblocks.io/pod-name: etcd-bwezhs-etcd-0 direction: to duration: 2m  `kubectl apply -f test-chaos-mesh-networkpartition-etcd-bwezhs.yaml`(B  networkchaos.chaos-mesh.org/test-chaos-mesh-networkpartition-etcd-bwezhs created apply test-chaos-mesh-networkpartition-etcd-bwezhs.yaml Success(B  `rm -rf test-chaos-mesh-networkpartition-etcd-bwezhs.yaml`(B  networkpartition chaos test waiting 120 seconds check cluster status  `kbcli cluster list etcd-bwezhs --show-labels --namespace ns-owddk `(B  NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS etcd-bwezhs ns-owddk DoNotTerminate Running Feb 11,2026 17:32 UTC+0800 app.kubernetes.io/instance=etcd-bwezhs check cluster status done(B cluster_status:Running(B check pod status  `kbcli cluster list-instances etcd-bwezhs --namespace ns-owddk `(B  NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME etcd-bwezhs-etcd-0 ns-owddk etcd-bwezhs etcd Running follower 0 200m / 200m 644245094400m / 644245094400m data:2Gi aks-cicdamdpool-55976491-vmss000003/10.224.0.5 Feb 11,2026 18:07 UTC+0800 etcd-bwezhs-etcd-1 ns-owddk etcd-bwezhs etcd Running follower 0 200m / 200m 644245094400m / 644245094400m data:2Gi aks-cicdamdpool-55976491-vmss000002/10.224.0.9 Feb 11,2026 18:10 UTC+0800 etcd-bwezhs-etcd-2 ns-owddk etcd-bwezhs etcd Running leader 0 200m / 200m 644245094400m / 644245094400m data:2Gi aks-cicdamdpool-55976491-vmss000001/10.224.0.7 Feb 11,2026 18:13 UTC+0800 check pod status done(B check cluster role check cluster role done(B leader(B: etcd-bwezhs-etcd-2;follower(B: etcd-bwezhs-etcd-0 etcd-bwezhs-etcd-1 check cluster connect  `echo 'etcdctl --endpoints=http://etcd-bwezhs-client.ns-owddk.svc.cluster.local:2379 endpoint health' | kubectl exec -it etcd-bwezhs-etcd-2 --namespace ns-owddk -- bash`(B  check cluster connect done(B  `kubectl patch -p '{"metadata":{"finalizers":[]}}' --type=merge NetworkChaos test-chaos-mesh-networkpartition-etcd-bwezhs --namespace ns-owddk `(B  networkchaos.chaos-mesh.org "test-chaos-mesh-networkpartition-etcd-bwezhs" force deleted check failover pod name failover pod name:etcd-bwezhs-etcd-2 failover networkpartition Success(B check db_client batch data count  `echo "etcdctl --endpoints=http://etcd-bwezhs-client.ns-owddk.svc.cluster.local:2379 get --prefix \"executions_loop_key\" --keys-only | (grep executions_loop_key || true) | wc -l " | kubectl exec -it etcd-bwezhs-etcd-2 --namespace ns-owddk -- bash `(B  check db_client batch [4386] equal [4386] data Success(B check readonly db_client batch data count  `echo "etcdctl --endpoints=http://etcd-bwezhs-client.ns-owddk.svc.cluster.local:2379 get --prefix \"executions_loop_key\" --keys-only | (grep executions_loop_key || true) | wc -l " | kubectl exec -it etcd-bwezhs-etcd-0 --namespace ns-owddk -- bash `(B  check readonly db_client batch data [4386] equal [4386] Success(B test failover timeoffset(B check cluster status before cluster-failover-timeoffset check cluster status done(B cluster_status:Running(B  `kubectl patch -p '{"metadata":{"finalizers":[]}}' --type=merge TimeChaos test-chaos-mesh-timeoffset-etcd-bwezhs --namespace ns-owddk `(B  apiVersion: chaos-mesh.org/v1alpha1 kind: TimeChaos metadata: name: test-chaos-mesh-timeoffset-etcd-bwezhs namespace: ns-owddk spec: selector: namespaces: - ns-owddk labelSelectors: apps.kubeblocks.io/pod-name: etcd-bwezhs-etcd-2 mode: all timeOffset: '-10m' clockIds: - CLOCK_REALTIME duration: 2m  `kubectl apply -f test-chaos-mesh-timeoffset-etcd-bwezhs.yaml`(B  timechaos.chaos-mesh.org/test-chaos-mesh-timeoffset-etcd-bwezhs created apply test-chaos-mesh-timeoffset-etcd-bwezhs.yaml Success(B  `rm -rf test-chaos-mesh-timeoffset-etcd-bwezhs.yaml`(B  timeoffset chaos test waiting 120 seconds check cluster status  `kbcli cluster list etcd-bwezhs --show-labels --namespace ns-owddk `(B  NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS etcd-bwezhs ns-owddk DoNotTerminate Running Feb 11,2026 17:32 UTC+0800 app.kubernetes.io/instance=etcd-bwezhs check cluster status done(B cluster_status:Running(B check pod status  `kbcli cluster list-instances etcd-bwezhs --namespace ns-owddk `(B  NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME etcd-bwezhs-etcd-0 ns-owddk etcd-bwezhs etcd Running follower 0 200m / 200m 644245094400m / 644245094400m data:2Gi aks-cicdamdpool-55976491-vmss000003/10.224.0.5 Feb 11,2026 18:07 UTC+0800 etcd-bwezhs-etcd-1 ns-owddk etcd-bwezhs etcd Running follower 0 200m / 200m 644245094400m / 644245094400m data:2Gi aks-cicdamdpool-55976491-vmss000002/10.224.0.9 Feb 11,2026 18:10 UTC+0800 etcd-bwezhs-etcd-2 ns-owddk etcd-bwezhs etcd Running leader 0 200m / 200m 644245094400m / 644245094400m data:2Gi aks-cicdamdpool-55976491-vmss000001/10.224.0.7 Feb 11,2026 18:13 UTC+0800 check pod status done(B check cluster role check cluster role done(B leader(B: etcd-bwezhs-etcd-2;follower(B: etcd-bwezhs-etcd-0 etcd-bwezhs-etcd-1 check cluster connect  `echo 'etcdctl --endpoints=http://etcd-bwezhs-client.ns-owddk.svc.cluster.local:2379 endpoint health' | kubectl exec -it etcd-bwezhs-etcd-2 --namespace ns-owddk -- bash`(B  check cluster connect done(B  `kubectl patch -p '{"metadata":{"finalizers":[]}}' --type=merge TimeChaos test-chaos-mesh-timeoffset-etcd-bwezhs --namespace ns-owddk `(B  timechaos.chaos-mesh.org "test-chaos-mesh-timeoffset-etcd-bwezhs" force deleted timechaos.chaos-mesh.org/test-chaos-mesh-timeoffset-etcd-bwezhs patched check failover pod name failover pod name:etcd-bwezhs-etcd-2 failover timeoffset Success(B check db_client batch data count  `echo "etcdctl --endpoints=http://etcd-bwezhs-client.ns-owddk.svc.cluster.local:2379 get --prefix \"executions_loop_key\" --keys-only | (grep executions_loop_key || true) | wc -l " | kubectl exec -it etcd-bwezhs-etcd-2 --namespace ns-owddk -- bash `(B  check db_client batch [4386] equal [4386] data Success(B check readonly db_client batch data count  `echo "etcdctl --endpoints=http://etcd-bwezhs-client.ns-owddk.svc.cluster.local:2379 get --prefix \"executions_loop_key\" --keys-only | (grep executions_loop_key || true) | wc -l " | kubectl exec -it etcd-bwezhs-etcd-0 --namespace ns-owddk -- bash `(B  check readonly db_client batch data [4386] equal [4386] Success(B test failover dnserror(B check cluster status before cluster-failover-dnserror check cluster status done(B cluster_status:Running(B  `kubectl patch -p '{"metadata":{"finalizers":[]}}' --type=merge DNSChaos test-chaos-mesh-dnserror-etcd-bwezhs --namespace ns-owddk `(B  apiVersion: chaos-mesh.org/v1alpha1 kind: DNSChaos metadata: name: test-chaos-mesh-dnserror-etcd-bwezhs namespace: ns-owddk spec: selector: namespaces: - ns-owddk labelSelectors: apps.kubeblocks.io/pod-name: etcd-bwezhs-etcd-2 mode: all action: error duration: 2m  `kubectl apply -f test-chaos-mesh-dnserror-etcd-bwezhs.yaml`(B  dnschaos.chaos-mesh.org/test-chaos-mesh-dnserror-etcd-bwezhs created apply test-chaos-mesh-dnserror-etcd-bwezhs.yaml Success(B  `rm -rf test-chaos-mesh-dnserror-etcd-bwezhs.yaml`(B  dnserror chaos test waiting 120 seconds check cluster status  `kbcli cluster list etcd-bwezhs --show-labels --namespace ns-owddk `(B  NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS etcd-bwezhs ns-owddk DoNotTerminate Running Feb 11,2026 17:32 UTC+0800 app.kubernetes.io/instance=etcd-bwezhs check cluster status done(B cluster_status:Running(B check pod status  `kbcli cluster list-instances etcd-bwezhs --namespace ns-owddk `(B  NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME etcd-bwezhs-etcd-0 ns-owddk etcd-bwezhs etcd Running follower 0 200m / 200m 644245094400m / 644245094400m data:2Gi aks-cicdamdpool-55976491-vmss000003/10.224.0.5 Feb 11,2026 18:07 UTC+0800 etcd-bwezhs-etcd-1 ns-owddk etcd-bwezhs etcd Running follower 0 200m / 200m 644245094400m / 644245094400m data:2Gi aks-cicdamdpool-55976491-vmss000002/10.224.0.9 Feb 11,2026 18:10 UTC+0800 etcd-bwezhs-etcd-2 ns-owddk etcd-bwezhs etcd Running leader 0 200m / 200m 644245094400m / 644245094400m data:2Gi aks-cicdamdpool-55976491-vmss000001/10.224.0.7 Feb 11,2026 18:13 UTC+0800 check pod status done(B check cluster role check cluster role done(B leader(B: etcd-bwezhs-etcd-2;follower(B: etcd-bwezhs-etcd-0 etcd-bwezhs-etcd-1 check cluster connect  `echo 'etcdctl --endpoints=http://etcd-bwezhs-client.ns-owddk.svc.cluster.local:2379 endpoint health' | kubectl exec -it etcd-bwezhs-etcd-2 --namespace ns-owddk -- bash`(B  check cluster connect done(B  `kubectl patch -p '{"metadata":{"finalizers":[]}}' --type=merge DNSChaos test-chaos-mesh-dnserror-etcd-bwezhs --namespace ns-owddk `(B  dnschaos.chaos-mesh.org "test-chaos-mesh-dnserror-etcd-bwezhs" force deleted check failover pod name failover pod name:etcd-bwezhs-etcd-2 failover dnserror Success(B check db_client batch data count  `echo "etcdctl --endpoints=http://etcd-bwezhs-client.ns-owddk.svc.cluster.local:2379 get --prefix \"executions_loop_key\" --keys-only | (grep executions_loop_key || true) | wc -l " | kubectl exec -it etcd-bwezhs-etcd-2 --namespace ns-owddk -- bash `(B  check db_client batch [4386] equal [4386] data Success(B check readonly db_client batch data count  `echo "etcdctl --endpoints=http://etcd-bwezhs-client.ns-owddk.svc.cluster.local:2379 get --prefix \"executions_loop_key\" --keys-only | (grep executions_loop_key || true) | wc -l " | kubectl exec -it etcd-bwezhs-etcd-0 --namespace ns-owddk -- bash `(B  check readonly db_client batch data [4386] equal [4386] Success(B test failover networkduplicate(B check cluster status before cluster-failover-networkduplicate check cluster status done(B cluster_status:Running(B  `kubectl patch -p '{"metadata":{"finalizers":[]}}' --type=merge NetworkChaos test-chaos-mesh-networkduplicate-etcd-bwezhs --namespace ns-owddk `(B  apiVersion: chaos-mesh.org/v1alpha1 kind: NetworkChaos metadata: name: test-chaos-mesh-networkduplicate-etcd-bwezhs namespace: ns-owddk spec: selector: namespaces: - ns-owddk labelSelectors: apps.kubeblocks.io/pod-name: etcd-bwezhs-etcd-2 mode: all action: duplicate duplicate: duplicate: '100' correlation: '100' direction: to duration: 2m  `kubectl apply -f test-chaos-mesh-networkduplicate-etcd-bwezhs.yaml`(B  networkchaos.chaos-mesh.org/test-chaos-mesh-networkduplicate-etcd-bwezhs created apply test-chaos-mesh-networkduplicate-etcd-bwezhs.yaml Success(B  `rm -rf test-chaos-mesh-networkduplicate-etcd-bwezhs.yaml`(B  networkduplicate chaos test waiting 120 seconds check cluster status  `kbcli cluster list etcd-bwezhs --show-labels --namespace ns-owddk `(B  NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS etcd-bwezhs ns-owddk DoNotTerminate Running Feb 11,2026 17:32 UTC+0800 app.kubernetes.io/instance=etcd-bwezhs check cluster status done(B cluster_status:Running(B check pod status  `kbcli cluster list-instances etcd-bwezhs --namespace ns-owddk `(B  NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME etcd-bwezhs-etcd-0 ns-owddk etcd-bwezhs etcd Running follower 0 200m / 200m 644245094400m / 644245094400m data:2Gi aks-cicdamdpool-55976491-vmss000003/10.224.0.5 Feb 11,2026 18:07 UTC+0800 etcd-bwezhs-etcd-1 ns-owddk etcd-bwezhs etcd Running follower 0 200m / 200m 644245094400m / 644245094400m data:2Gi aks-cicdamdpool-55976491-vmss000002/10.224.0.9 Feb 11,2026 18:10 UTC+0800 etcd-bwezhs-etcd-2 ns-owddk etcd-bwezhs etcd Running leader 0 200m / 200m 644245094400m / 644245094400m data:2Gi aks-cicdamdpool-55976491-vmss000001/10.224.0.7 Feb 11,2026 18:13 UTC+0800 check pod status done(B check cluster role check cluster role done(B leader(B: etcd-bwezhs-etcd-2;follower(B: etcd-bwezhs-etcd-0 etcd-bwezhs-etcd-1 check cluster connect  `echo 'etcdctl --endpoints=http://etcd-bwezhs-client.ns-owddk.svc.cluster.local:2379 endpoint health' | kubectl exec -it etcd-bwezhs-etcd-2 --namespace ns-owddk -- bash`(B  check cluster connect done(B  `kubectl patch -p '{"metadata":{"finalizers":[]}}' --type=merge NetworkChaos test-chaos-mesh-networkduplicate-etcd-bwezhs --namespace ns-owddk `(B  networkchaos.chaos-mesh.org "test-chaos-mesh-networkduplicate-etcd-bwezhs" force deleted check failover pod name failover pod name:etcd-bwezhs-etcd-2 failover networkduplicate Success(B check db_client batch data count  `echo "etcdctl --endpoints=http://etcd-bwezhs-client.ns-owddk.svc.cluster.local:2379 get --prefix \"executions_loop_key\" --keys-only | (grep executions_loop_key || true) | wc -l " | kubectl exec -it etcd-bwezhs-etcd-2 --namespace ns-owddk -- bash `(B  check db_client batch [4386] equal [4386] data Success(B check readonly db_client batch data count  `echo "etcdctl --endpoints=http://etcd-bwezhs-client.ns-owddk.svc.cluster.local:2379 get --prefix \"executions_loop_key\" --keys-only | (grep executions_loop_key || true) | wc -l " | kubectl exec -it etcd-bwezhs-etcd-0 --namespace ns-owddk -- bash `(B  check readonly db_client batch data [4386] equal [4386] Success(B test failover networklossover(B check cluster status before cluster-failover-networklossover check cluster status done(B cluster_status:Running(B  `kubectl patch -p '{"metadata":{"finalizers":[]}}' --type=merge NetworkChaos test-chaos-mesh-networklossover-etcd-bwezhs --namespace ns-owddk `(B  apiVersion: chaos-mesh.org/v1alpha1 kind: NetworkChaos metadata: name: test-chaos-mesh-networklossover-etcd-bwezhs namespace: ns-owddk spec: selector: namespaces: - ns-owddk labelSelectors: apps.kubeblocks.io/pod-name: etcd-bwezhs-etcd-2 mode: all action: loss loss: loss: '100' correlation: '100' direction: to duration: 2m  `kubectl apply -f test-chaos-mesh-networklossover-etcd-bwezhs.yaml`(B  networkchaos.chaos-mesh.org/test-chaos-mesh-networklossover-etcd-bwezhs created apply test-chaos-mesh-networklossover-etcd-bwezhs.yaml Success(B  `rm -rf test-chaos-mesh-networklossover-etcd-bwezhs.yaml`(B  networklossover chaos test waiting 120 seconds check cluster status  `kbcli cluster list etcd-bwezhs --show-labels --namespace ns-owddk `(B  NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS etcd-bwezhs ns-owddk DoNotTerminate Running Feb 11,2026 17:32 UTC+0800 app.kubernetes.io/instance=etcd-bwezhs check cluster status done(B cluster_status:Running(B check pod status  `kbcli cluster list-instances etcd-bwezhs --namespace ns-owddk `(B  NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME etcd-bwezhs-etcd-0 ns-owddk etcd-bwezhs etcd Running follower 0 200m / 200m 644245094400m / 644245094400m data:2Gi aks-cicdamdpool-55976491-vmss000003/10.224.0.5 Feb 11,2026 18:07 UTC+0800 etcd-bwezhs-etcd-1 ns-owddk etcd-bwezhs etcd Running leader 0 200m / 200m 644245094400m / 644245094400m data:2Gi aks-cicdamdpool-55976491-vmss000002/10.224.0.9 Feb 11,2026 18:10 UTC+0800 etcd-bwezhs-etcd-2 ns-owddk etcd-bwezhs etcd Running leader 0 200m / 200m 644245094400m / 644245094400m data:2Gi aks-cicdamdpool-55976491-vmss000001/10.224.0.7 Feb 11,2026 18:13 UTC+0800 check pod status done(B check cluster role leader(B: etcd-bwezhs-etcd-1 etcd-bwezhs-etcd-2;follower(B: etcd-bwezhs-etcd-0 leader(B: etcd-bwezhs-etcd-1 etcd-bwezhs-etcd-2;follower(B: etcd-bwezhs-etcd-0 leader(B: etcd-bwezhs-etcd-1 etcd-bwezhs-etcd-2;follower(B: etcd-bwezhs-etcd-0 leader(B: etcd-bwezhs-etcd-1 etcd-bwezhs-etcd-2;follower(B: etcd-bwezhs-etcd-0 leader(B: etcd-bwezhs-etcd-1 etcd-bwezhs-etcd-2;follower(B: etcd-bwezhs-etcd-0 leader(B: etcd-bwezhs-etcd-1 etcd-bwezhs-etcd-2;follower(B: etcd-bwezhs-etcd-0 leader(B: etcd-bwezhs-etcd-1 etcd-bwezhs-etcd-2;follower(B: etcd-bwezhs-etcd-0 leader(B: etcd-bwezhs-etcd-1 etcd-bwezhs-etcd-2;follower(B: etcd-bwezhs-etcd-0 leader(B: etcd-bwezhs-etcd-1 etcd-bwezhs-etcd-2;follower(B: etcd-bwezhs-etcd-0 leader(B: etcd-bwezhs-etcd-1 etcd-bwezhs-etcd-2;follower(B: etcd-bwezhs-etcd-0 leader(B: etcd-bwezhs-etcd-1 etcd-bwezhs-etcd-2;follower(B: etcd-bwezhs-etcd-0 leader(B: etcd-bwezhs-etcd-1 etcd-bwezhs-etcd-2;follower(B: etcd-bwezhs-etcd-0 leader(B: etcd-bwezhs-etcd-1 etcd-bwezhs-etcd-2;follower(B: etcd-bwezhs-etcd-0 leader(B: etcd-bwezhs-etcd-1 etcd-bwezhs-etcd-2;follower(B: etcd-bwezhs-etcd-0 leader(B: etcd-bwezhs-etcd-1 etcd-bwezhs-etcd-2;follower(B: etcd-bwezhs-etcd-0 leader(B: etcd-bwezhs-etcd-1 etcd-bwezhs-etcd-2;follower(B: etcd-bwezhs-etcd-0 leader(B: etcd-bwezhs-etcd-1 etcd-bwezhs-etcd-2;follower(B: etcd-bwezhs-etcd-0 leader(B: etcd-bwezhs-etcd-1 etcd-bwezhs-etcd-2;follower(B: etcd-bwezhs-etcd-0 leader(B: etcd-bwezhs-etcd-1 etcd-bwezhs-etcd-2;follower(B: etcd-bwezhs-etcd-0 leader(B: etcd-bwezhs-etcd-1 etcd-bwezhs-etcd-2;follower(B: etcd-bwezhs-etcd-0 leader(B: etcd-bwezhs-etcd-1 etcd-bwezhs-etcd-2;follower(B: etcd-bwezhs-etcd-0 leader(B: etcd-bwezhs-etcd-1 etcd-bwezhs-etcd-2;follower(B: etcd-bwezhs-etcd-0 leader(B: etcd-bwezhs-etcd-1 etcd-bwezhs-etcd-2;follower(B: etcd-bwezhs-etcd-0 check cluster role done(B leader(B: etcd-bwezhs-etcd-1;follower(B: etcd-bwezhs-etcd-0 etcd-bwezhs-etcd-2 check cluster connect  `echo 'etcdctl --endpoints=http://etcd-bwezhs-client.ns-owddk.svc.cluster.local:2379 endpoint health' | kubectl exec -it etcd-bwezhs-etcd-1 --namespace ns-owddk -- bash`(B  check cluster connect done(B  `kubectl patch -p '{"metadata":{"finalizers":[]}}' --type=merge NetworkChaos test-chaos-mesh-networklossover-etcd-bwezhs --namespace ns-owddk `(B  networkchaos.chaos-mesh.org "test-chaos-mesh-networklossover-etcd-bwezhs" force deleted check failover pod name failover pod name:etcd-bwezhs-etcd-1 failover networklossover Success(B check db_client batch data count  `echo "etcdctl --endpoints=http://etcd-bwezhs-client.ns-owddk.svc.cluster.local:2379 get --prefix \"executions_loop_key\" --keys-only | (grep executions_loop_key || true) | wc -l " | kubectl exec -it etcd-bwezhs-etcd-1 --namespace ns-owddk -- bash `(B  check db_client batch [4386] equal [4386] data Success(B check readonly db_client batch data count  `echo "etcdctl --endpoints=http://etcd-bwezhs-client.ns-owddk.svc.cluster.local:2379 get --prefix \"executions_loop_key\" --keys-only | (grep executions_loop_key || true) | wc -l " | kubectl exec -it etcd-bwezhs-etcd-0 --namespace ns-owddk -- bash `(B  check readonly db_client batch data [4386] equal [4386] Success(B test failover fullcpuover(B check cluster status before cluster-failover-fullcpuover check cluster status done(B cluster_status:Running(B  `kubectl patch -p '{"metadata":{"finalizers":[]}}' --type=merge StressChaos test-chaos-mesh-fullcpuover-etcd-bwezhs --namespace ns-owddk `(B  apiVersion: chaos-mesh.org/v1alpha1 kind: StressChaos metadata: name: test-chaos-mesh-fullcpuover-etcd-bwezhs namespace: ns-owddk spec: selector: namespaces: - ns-owddk labelSelectors: apps.kubeblocks.io/pod-name: etcd-bwezhs-etcd-1 mode: all stressors: cpu: workers: 100 load: 100 duration: 2m  `kubectl apply -f test-chaos-mesh-fullcpuover-etcd-bwezhs.yaml`(B  stresschaos.chaos-mesh.org/test-chaos-mesh-fullcpuover-etcd-bwezhs created apply test-chaos-mesh-fullcpuover-etcd-bwezhs.yaml Success(B  `rm -rf test-chaos-mesh-fullcpuover-etcd-bwezhs.yaml`(B  fullcpuover chaos test waiting 120 seconds check cluster status  `kbcli cluster list etcd-bwezhs --show-labels --namespace ns-owddk `(B  NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS etcd-bwezhs ns-owddk DoNotTerminate Failed Feb 11,2026 17:32 UTC+0800 app.kubernetes.io/instance=etcd-bwezhs cluster_status:Failed(B cluster_status:Failed(B cluster_status:Failed(B cluster_status:Failed(B cluster_status:Failed(B cluster_status:Failed(B cluster_status:Failed(B cluster_status:Failed(B cluster_status:Failed(B cluster_status:Failed(B check cluster status done(B cluster_status:Running(B check pod status  `kbcli cluster list-instances etcd-bwezhs --namespace ns-owddk `(B  NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME etcd-bwezhs-etcd-0 ns-owddk etcd-bwezhs etcd Running follower 0 200m / 200m 644245094400m / 644245094400m data:2Gi aks-cicdamdpool-55976491-vmss000003/10.224.0.5 Feb 11,2026 18:07 UTC+0800 etcd-bwezhs-etcd-1 ns-owddk etcd-bwezhs etcd Running follower 0 200m / 200m 644245094400m / 644245094400m data:2Gi aks-cicdamdpool-55976491-vmss000002/10.224.0.9 Feb 11,2026 18:10 UTC+0800 etcd-bwezhs-etcd-2 ns-owddk etcd-bwezhs etcd Running leader 0 200m / 200m 644245094400m / 644245094400m data:2Gi aks-cicdamdpool-55976491-vmss000001/10.224.0.7 Feb 11,2026 18:13 UTC+0800 check pod status done(B check cluster role check cluster role done(B leader(B: etcd-bwezhs-etcd-2;follower(B: etcd-bwezhs-etcd-0 etcd-bwezhs-etcd-1 check cluster connect  `echo 'etcdctl --endpoints=http://etcd-bwezhs-client.ns-owddk.svc.cluster.local:2379 endpoint health' | kubectl exec -it etcd-bwezhs-etcd-2 --namespace ns-owddk -- bash`(B  check cluster connect done(B  `kubectl patch -p '{"metadata":{"finalizers":[]}}' --type=merge StressChaos test-chaos-mesh-fullcpuover-etcd-bwezhs --namespace ns-owddk `(B  stresschaos.chaos-mesh.org "test-chaos-mesh-fullcpuover-etcd-bwezhs" force deleted check failover pod name failover pod name:etcd-bwezhs-etcd-2 failover fullcpuover Success(B check db_client batch data count  `echo "etcdctl --endpoints=http://etcd-bwezhs-client.ns-owddk.svc.cluster.local:2379 get --prefix \"executions_loop_key\" --keys-only | (grep executions_loop_key || true) | wc -l " | kubectl exec -it etcd-bwezhs-etcd-2 --namespace ns-owddk -- bash `(B  check db_client batch [4386] equal [4386] data Success(B check readonly db_client batch data count  `echo "etcdctl --endpoints=http://etcd-bwezhs-client.ns-owddk.svc.cluster.local:2379 get --prefix \"executions_loop_key\" --keys-only | (grep executions_loop_key || true) | wc -l " | kubectl exec -it etcd-bwezhs-etcd-0 --namespace ns-owddk -- bash `(B  check readonly db_client batch data [4386] equal [4386] Success(B cluster update terminationPolicy WipeOut  `kbcli cluster update etcd-bwezhs --termination-policy=WipeOut --namespace ns-owddk `(B  cluster.apps.kubeblocks.io/etcd-bwezhs updated check cluster status  `kbcli cluster list etcd-bwezhs --show-labels --namespace ns-owddk `(B  NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS etcd-bwezhs ns-owddk WipeOut Running Feb 11,2026 17:32 UTC+0800 app.kubernetes.io/instance=etcd-bwezhs check cluster status done(B cluster_status:Running(B check pod status  `kbcli cluster list-instances etcd-bwezhs --namespace ns-owddk `(B  NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME etcd-bwezhs-etcd-0 ns-owddk etcd-bwezhs etcd Running follower 0 200m / 200m 644245094400m / 644245094400m data:2Gi aks-cicdamdpool-55976491-vmss000003/10.224.0.5 Feb 11,2026 18:07 UTC+0800 etcd-bwezhs-etcd-1 ns-owddk etcd-bwezhs etcd Running follower 0 200m / 200m 644245094400m / 644245094400m data:2Gi aks-cicdamdpool-55976491-vmss000002/10.224.0.9 Feb 11,2026 18:10 UTC+0800 etcd-bwezhs-etcd-2 ns-owddk etcd-bwezhs etcd Running leader 0 200m / 200m 644245094400m / 644245094400m data:2Gi aks-cicdamdpool-55976491-vmss000001/10.224.0.7 Feb 11,2026 18:13 UTC+0800 check pod status done(B check cluster role check cluster role done(B leader(B: etcd-bwezhs-etcd-2;follower(B: etcd-bwezhs-etcd-0 etcd-bwezhs-etcd-1 check cluster connect  `echo 'etcdctl --endpoints=http://etcd-bwezhs-client.ns-owddk.svc.cluster.local:2379 endpoint health' | kubectl exec -it etcd-bwezhs-etcd-2 --namespace ns-owddk -- bash`(B  check cluster connect done(B cluster datafile backup  `kubectl get backuprepo backuprepo-kbcli-test -o jsonpath="{.spec.credential.name}"`(B   `kubectl get backuprepo backuprepo-kbcli-test -o jsonpath="{.spec.credential.namespace}"`(B   `kubectl get secrets kb-backuprepo-hnrh8 -n kb-qxtxx -o jsonpath="{.data.accessKeyId}"`(B   `kubectl get secrets kb-backuprepo-hnrh8 -n kb-qxtxx -o jsonpath="{.data.secretAccessKey}"`(B  KUBEBLOCKS NAMESPACE:kb-qxtxx get kubeblocks namespace done(B  `kubectl get secrets -l app.kubernetes.io/instance=kbcli-test-minio --namespace kb-qxtxx -o jsonpath="{.items[0].data.root-user}"`(B   `kubectl get secrets -l app.kubernetes.io/instance=kbcli-test-minio --namespace kb-qxtxx -o jsonpath="{.items[0].data.root-password}"`(B  minio_user:kbclitest,minio_password:kbclitest,minio_endpoint:kbcli-test-minio.kb-qxtxx.svc.cluster.local:9000 list minio bucket kbcli-test  `echo 'mc alias set minioserver http://kbcli-test-minio.kb-qxtxx.svc.cluster.local:9000 kbclitest kbclitest;mc ls minioserver' | kubectl exec -it kbcli-test-minio-6c77985d5f-55lsm --namespace kb-qxtxx -- bash`(B  list minio bucket done(B default backuprepo:backuprepo-kbcli-test exists(B  `kbcli cluster backup etcd-bwezhs --method datafile --namespace ns-owddk `(B  Backup backup-ns-owddk-etcd-bwezhs-20260211183916 created successfully, you can view the progress: kbcli cluster list-backups --names=backup-ns-owddk-etcd-bwezhs-20260211183916 -n ns-owddk check backup status  `kbcli cluster list-backups etcd-bwezhs --namespace ns-owddk `(B  NAME NAMESPACE SOURCE-CLUSTER METHOD STATUS TOTAL-SIZE DURATION DELETION-POLICY CREATE-TIME COMPLETION-TIME EXPIRATION backup-ns-owddk-etcd-bwezhs-20260211183916 ns-owddk etcd-bwezhs datafile Running Delete Feb 11,2026 18:39 UTC+0800 backup_status:etcd-bwezhs-datafile-Running(B backup_status:etcd-bwezhs-datafile-Running(B backup_status:etcd-bwezhs-datafile-Running(B check backup status done(B backup_status:backup-ns-owddk-etcd-bwezhs-20260211183916 ns-owddk etcd-bwezhs datafile Completed 51590 12s Delete Feb 11,2026 18:39 UTC+0800 Feb 11,2026 18:39 UTC+0800 (B cluster restore backup  `kbcli cluster describe-backup --names backup-ns-owddk-etcd-bwezhs-20260211183916 --namespace ns-owddk `(B  Name: backup-ns-owddk-etcd-bwezhs-20260211183916 Cluster: etcd-bwezhs Namespace: ns-owddk Spec: Method: datafile Policy Name: etcd-bwezhs-etcd-backup-policy Actions: dp-backup-0: ActionType: Job WorkloadName: dp-backup-0-backup-ns-owddk-etcd-bwezhs-20260211183916-66cfc0b7 TargetPodName: etcd-bwezhs-etcd-2 Phase: Completed Start Time: Feb 11,2026 18:39 UTC+0800 Completion Time: Feb 11,2026 18:39 UTC+0800 Status: Phase: Completed Total Size: 51590 ActionSet Name: etcdctl-br Repository: backuprepo-kbcli-test Duration: 12s Start Time: Feb 11,2026 18:39 UTC+0800 Completion Time: Feb 11,2026 18:39 UTC+0800 Path: /ns-owddk/etcd-bwezhs-5d6a4229-d663-4ad4-badb-673e0dfc65c6/etcd/backup-ns-owddk-etcd-bwezhs-20260211183916 Warning Events:  `kbcli cluster restore etcd-bwezhs-backup --backup backup-ns-owddk-etcd-bwezhs-20260211183916 --namespace ns-owddk `(B  Cluster etcd-bwezhs-backup created check cluster status  `kbcli cluster list etcd-bwezhs-backup --show-labels --namespace ns-owddk `(B  NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS etcd-bwezhs-backup ns-owddk WipeOut Creating Feb 11,2026 18:39 UTC+0800 cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B check cluster status done(B cluster_status:Running(B check pod status  `kbcli cluster list-instances etcd-bwezhs-backup --namespace ns-owddk `(B  NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME etcd-bwezhs-backup-etcd-0 ns-owddk etcd-bwezhs-backup etcd Running leader 0 200m / 200m 644245094400m / 644245094400m data:2Gi aks-cicdamdpool-55976491-vmss000002/10.224.0.9 Feb 11,2026 18:40 UTC+0800 etcd-bwezhs-backup-etcd-1 ns-owddk etcd-bwezhs-backup etcd Running follower 0 200m / 200m 644245094400m / 644245094400m data:2Gi aks-cicdamdpool-55976491-vmss000003/10.224.0.5 Feb 11,2026 18:41 UTC+0800 etcd-bwezhs-backup-etcd-2 ns-owddk etcd-bwezhs-backup etcd Running follower 0 200m / 200m 644245094400m / 644245094400m data:2Gi aks-cicdamdpool-55976491-vmss000001/10.224.0.7 Feb 11,2026 18:41 UTC+0800 check pod status done(B check cluster role check cluster role done(B leader(B: etcd-bwezhs-backup-etcd-0;follower(B: etcd-bwezhs-backup-etcd-1 etcd-bwezhs-backup-etcd-2 check cluster connect  `echo 'etcdctl --endpoints=http://etcd-bwezhs-backup-client.ns-owddk.svc.cluster.local:2379 endpoint health' | kubectl exec -it etcd-bwezhs-backup-etcd-0 --namespace ns-owddk -- bash`(B  check cluster connect done(B  `kbcli cluster describe-backup --names backup-ns-owddk-etcd-bwezhs-20260211183916 --namespace ns-owddk `(B  Name: backup-ns-owddk-etcd-bwezhs-20260211183916 Cluster: etcd-bwezhs Namespace: ns-owddk Spec: Method: datafile Policy Name: etcd-bwezhs-etcd-backup-policy Actions: dp-backup-0: ActionType: Job WorkloadName: dp-backup-0-backup-ns-owddk-etcd-bwezhs-20260211183916-66cfc0b7 TargetPodName: etcd-bwezhs-etcd-2 Phase: Completed Start Time: Feb 11,2026 18:39 UTC+0800 Completion Time: Feb 11,2026 18:39 UTC+0800 Status: Phase: Completed Total Size: 51590 ActionSet Name: etcdctl-br Repository: backuprepo-kbcli-test Duration: 12s Start Time: Feb 11,2026 18:39 UTC+0800 Completion Time: Feb 11,2026 18:39 UTC+0800 Path: /ns-owddk/etcd-bwezhs-5d6a4229-d663-4ad4-badb-673e0dfc65c6/etcd/backup-ns-owddk-etcd-bwezhs-20260211183916 Warning Events: cluster connect  `echo "etcdctl --endpoints=http://etcd-bwezhs-backup-client.ns-owddk.svc.cluster.local:2379 member list" | kubectl exec -it etcd-bwezhs-backup-etcd-0 --namespace ns-owddk -- bash `(B  b502e8dff95499e, started, etcd-bwezhs-backup-etcd-0, http://etcd-bwezhs-backup-etcd-0.etcd-bwezhs-backup-etcd-headless.ns-owddk.svc.cluster.local:2380, http://etcd-bwezhs-backup-etcd-0.etcd-bwezhs-backup-etcd-headless.ns-owddk.svc.cluster.local:2379, false 3f35f57c4e4358f5, started, etcd-bwezhs-backup-etcd-2, http://etcd-bwezhs-backup-etcd-2.etcd-bwezhs-backup-etcd-headless.ns-owddk.svc.cluster.local:2380, http://etcd-bwezhs-backup-etcd-2.etcd-bwezhs-backup-etcd-headless.ns-owddk.svc.cluster.local:2379, false e77160ba89397573, started, etcd-bwezhs-backup-etcd-1, http://etcd-bwezhs-backup-etcd-1.etcd-bwezhs-backup-etcd-headless.ns-owddk.svc.cluster.local:2380, http://etcd-bwezhs-backup-etcd-1.etcd-bwezhs-backup-etcd-headless.ns-owddk.svc.cluster.local:2379, false connect cluster Success(B delete cluster etcd-bwezhs-backup  `kbcli cluster delete etcd-bwezhs-backup --auto-approve --namespace ns-owddk `(B  pod_info:etcd-bwezhs-backup-etcd-0 2/2 Running 0 2m51s etcd-bwezhs-backup-etcd-1 2/2 Running 0 116s etcd-bwezhs-backup-etcd-2 2/2 Running 0 92s Cluster etcd-bwezhs-backup deleted delete cluster pod done(B check cluster resource non-exist OK: pvc(B delete cluster done(B cluster delete backup  `kubectl patch -p '{"metadata":{"finalizers":[]}}' --type=merge backups backup-ns-owddk-etcd-bwezhs-20260211183916 --namespace ns-owddk `(B  backup.dataprotection.kubeblocks.io/backup-ns-owddk-etcd-bwezhs-20260211183916 patched  `kbcli cluster delete-backup etcd-bwezhs --name backup-ns-owddk-etcd-bwezhs-20260211183916 --force --auto-approve --namespace ns-owddk `(B  Backup backup-ns-owddk-etcd-bwezhs-20260211183916 deleted cluster list-logs  `kbcli cluster list-logs etcd-bwezhs --namespace ns-owddk `(B  cluster logs  `kbcli cluster logs etcd-bwezhs --tail 30 --namespace ns-owddk `(B  {"level":"warn","ts":"2026-02-11T10:35:01.311147Z","caller":"rafthttp/peer_status.go:66","msg":"peer became inactive (message send to peer failed)","peer-id":"f7e0f4cedd591794","error":"failed to read f7e0f4cedd591794 on stream Message (read tcp 10.244.4.217:36218->10.244.2.163:2380: read: connection reset by peer)"} {"level":"info","ts":"2026-02-11T10:35:01.311683Z","logger":"raft","caller":"v3@v3.6.0/raft.go:1116","msg":"e8f0c5d2e19133c5 [term: 15] received a MsgHeartbeat message with higher term from f7e0f4cedd591794 [term: 16]"} {"level":"info","ts":"2026-02-11T10:35:01.311737Z","logger":"raft","caller":"v3@v3.6.0/raft.go:897","msg":"e8f0c5d2e19133c5 became follower at term 16"} {"level":"info","ts":"2026-02-11T10:35:01.311752Z","logger":"raft","caller":"v3@v3.6.0/node.go:370","msg":"raft.node: e8f0c5d2e19133c5 elected leader f7e0f4cedd591794 at term 16"} {"level":"info","ts":"2026-02-11T10:35:01.415091Z","caller":"rafthttp/peer_status.go:53","msg":"peer became active","peer-id":"f7e0f4cedd591794"} {"level":"info","ts":"2026-02-11T10:35:01.415138Z","caller":"rafthttp/stream.go:411","msg":"established TCP streaming connection with remote peer","stream-reader-type":"stream Message","local-member-id":"e8f0c5d2e19133c5","remote-peer-id":"f7e0f4cedd591794"} {"level":"info","ts":"2026-02-11T10:36:27.252634Z","logger":"raft","caller":"v3@v3.6.0/raft.go:1101","msg":"e8f0c5d2e19133c5 [logterm: 16, index: 4452, vote: 0] ignored MsgPreVote from 9137f093f420a61a [logterm: 16, index: 4452] at term 16: lease is not expired (remaining ticks: 1)"} {"level":"info","ts":"2026-02-11T10:37:23.778559Z","logger":"raft","caller":"v3@v3.6.0/raft.go:988","msg":"e8f0c5d2e19133c5 is starting a new election at term 16"} {"level":"info","ts":"2026-02-11T10:37:23.778628Z","logger":"raft","caller":"v3@v3.6.0/raft.go:930","msg":"e8f0c5d2e19133c5 became pre-candidate at term 16"} {"level":"info","ts":"2026-02-11T10:37:23.778661Z","logger":"raft","caller":"v3@v3.6.0/raft.go:1064","msg":"e8f0c5d2e19133c5 [logterm: 16, index: 4452] sent MsgPreVote request to 9137f093f420a61a at term 16"} {"level":"info","ts":"2026-02-11T10:37:23.778681Z","logger":"raft","caller":"v3@v3.6.0/raft.go:1064","msg":"e8f0c5d2e19133c5 [logterm: 16, index: 4452] sent MsgPreVote request to f7e0f4cedd591794 at term 16"} {"level":"info","ts":"2026-02-11T10:37:23.778697Z","logger":"raft","caller":"v3@v3.6.0/node.go:376","msg":"raft.node: e8f0c5d2e19133c5 lost leader f7e0f4cedd591794 at term 16"} {"level":"info","ts":"2026-02-11T10:37:23.778737Z","logger":"raft","caller":"v3@v3.6.0/raft.go:1077","msg":"e8f0c5d2e19133c5 received MsgPreVoteResp from e8f0c5d2e19133c5 at term 16"} {"level":"info","ts":"2026-02-11T10:37:23.778752Z","logger":"raft","caller":"v3@v3.6.0/raft.go:1693","msg":"e8f0c5d2e19133c5 has received 1 MsgPreVoteResp votes and 0 vote rejections"} {"level":"info","ts":"2026-02-11T10:37:23.779447Z","logger":"raft","caller":"v3@v3.6.0/raft.go:1077","msg":"e8f0c5d2e19133c5 received MsgPreVoteResp from 9137f093f420a61a at term 16"} {"level":"info","ts":"2026-02-11T10:37:23.779520Z","logger":"raft","caller":"v3@v3.6.0/raft.go:1693","msg":"e8f0c5d2e19133c5 has received 2 MsgPreVoteResp votes and 0 vote rejections"} {"level":"info","ts":"2026-02-11T10:37:23.779565Z","logger":"raft","caller":"v3@v3.6.0/raft.go:912","msg":"e8f0c5d2e19133c5 became candidate at term 17"} {"level":"info","ts":"2026-02-11T10:37:23.779599Z","logger":"raft","caller":"v3@v3.6.0/raft.go:1064","msg":"e8f0c5d2e19133c5 [logterm: 16, index: 4452] sent MsgVote request to 9137f093f420a61a at term 17"} {"level":"info","ts":"2026-02-11T10:37:23.779622Z","logger":"raft","caller":"v3@v3.6.0/raft.go:1064","msg":"e8f0c5d2e19133c5 [logterm: 16, index: 4452] sent MsgVote request to f7e0f4cedd591794 at term 17"} {"level":"info","ts":"2026-02-11T10:37:23.782562Z","logger":"raft","caller":"v3@v3.6.0/raft.go:1077","msg":"e8f0c5d2e19133c5 received MsgVoteResp from e8f0c5d2e19133c5 at term 17"} {"level":"info","ts":"2026-02-11T10:37:23.782699Z","logger":"raft","caller":"v3@v3.6.0/raft.go:1693","msg":"e8f0c5d2e19133c5 has received 1 MsgVoteResp votes and 0 vote rejections"} {"level":"info","ts":"2026-02-11T10:37:23.786310Z","logger":"raft","caller":"v3@v3.6.0/raft.go:1077","msg":"e8f0c5d2e19133c5 received MsgVoteResp from 9137f093f420a61a at term 17"} {"level":"info","ts":"2026-02-11T10:37:23.786373Z","logger":"raft","caller":"v3@v3.6.0/raft.go:1693","msg":"e8f0c5d2e19133c5 has received 2 MsgVoteResp votes and 0 vote rejections"} {"level":"info","ts":"2026-02-11T10:37:23.786419Z","logger":"raft","caller":"v3@v3.6.0/raft.go:970","msg":"e8f0c5d2e19133c5 became leader at term 17"} {"level":"info","ts":"2026-02-11T10:37:23.786446Z","logger":"raft","caller":"v3@v3.6.0/node.go:370","msg":"raft.node: e8f0c5d2e19133c5 elected leader e8f0c5d2e19133c5 at term 17"} {"level":"info","ts":"2026-02-11T10:37:41.880289Z","logger":"raft","caller":"v3@v3.6.0/raft.go:1101","msg":"e8f0c5d2e19133c5 [logterm: 17, index: 4453, vote: e8f0c5d2e19133c5] ignored MsgPreVote from f7e0f4cedd591794 [logterm: 17, index: 4453] at term 17: lease is not expired (remaining ticks: 9)"} {"level":"info","ts":"2026-02-11T10:37:43.580248Z","logger":"raft","caller":"v3@v3.6.0/raft.go:1101","msg":"e8f0c5d2e19133c5 [logterm: 17, index: 4453, vote: e8f0c5d2e19133c5] ignored MsgPreVote from f7e0f4cedd591794 [logterm: 17, index: 4453] at term 17: lease is not expired (remaining ticks: 2)"} {"level":"info","ts":"2026-02-11T10:39:19.984806Z","caller":"v3rpc/maintenance.go:153","msg":"sending database snapshot to client","total-bytes":499712,"size":"500 kB","storage-version":"3.6.0"} {"level":"info","ts":"2026-02-11T10:39:19.993791Z","caller":"v3rpc/maintenance.go:195","msg":"sending database sha256 checksum to client","total-bytes":499712,"checksum-size":32} {"level":"info","ts":"2026-02-11T10:39:19.993842Z","caller":"v3rpc/maintenance.go:204","msg":"successfully sent database snapshot to client","total-bytes":499712,"size":"500 kB","took":"9.037301ms","storage-version":"3.6.0"} delete cluster etcd-bwezhs  `kbcli cluster delete etcd-bwezhs --auto-approve --namespace ns-owddk `(B  pod_info:etcd-bwezhs-etcd-0 2/2 Running 2 (30m ago) 36m etcd-bwezhs-etcd-1 2/2 Running 0 33m etcd-bwezhs-etcd-2 2/2 Running 0 29m Cluster etcd-bwezhs deleted delete cluster pod done(B check cluster resource non-exist OK: pvc(B delete cluster done(B Etcd Test Suite All Done!(B Test Engine: etcd Test Type: 15 --------------------------------------Etcd (Topology = cluster Replicas 3) Test Result-------------------------------------- [PASSED]|[Create]|[Topology=cluster;ComponentDefinition=etcd-3-1.0.2;ComponentVersion=etcd;ServiceVersion=3.5.6;]|[Description=Create a cluster with the specified topology cluster with the specified component definition etcd-3-1.0.2 and component version etcd and service version 3.5.6](B [PASSED]|[Connect]|[ComponentName=etcd]|[Description=Connect to the cluster](B [PASSED]|[Failover]|[HA=Network Delay;Durations=2m;ComponentName=etcd]|[Description=Simulates network delay fault thereby testing the application's resilience to potential slowness/unavailability of some replicas due to delay network.](B [PASSED]|[Failover]|[HA=Network Corrupt;Durations=2m;ComponentName=etcd]|[Description=Simulates network corrupt fault thereby testing the application's resilience to potential slowness/unavailability of some replicas due to corrupt network.](B [PASSED]|[VolumeExpansion]|[ComponentName=etcd]|[Description=VolumeExpansion the cluster specify component etcd](B [PASSED]|[VerticalScaling]|[ComponentName=etcd]|[Description=VerticalScaling the cluster specify component etcd](B [PASSED]|[NoFailover]|[HA=DNS Random;Durations=2m;ComponentName=etcd]|[Description=Simulates conditions where pods experience random IP addresses being returned by the DNS service for a period of time either due to expected/undesired processes thereby testing the application's resilience to potential slowness/unavailability of some replicas due to the DNS service returning random IP addresses.](B [PASSED]|[NoFailover]|[HA=Connection Stress;ComponentName=etcd]|[Description=Simulates conditions where pods experience connection stress either due to expected/undesired processes thereby testing the application's resilience to potential slowness/unavailability of some replicas due to high Connection load.](B [PASSED]|[Restart]|[-]|[Description=Restart the cluster](B [PASSED]|[SwitchOver]|[ComponentName=etcd]|[Description=SwitchOver the cluster specify component etcd](B [PASSED]|[Failover]|[HA=Kill 1;ComponentName=etcd]|[Description=Simulates conditions where process 1 killed either due to expected/undesired processes thereby testing the application's resilience to unavailability of some replicas due to abnormal termination signals.](B [PASSED]|[Failover]|[HA=Pod Failure;Durations=2m;ComponentName=etcd]|[Description=Simulates conditions where pods experience failure for a period of time either due to expected/undesired processes thereby testing the application's resilience to potential slowness/unavailability of some replicas due to failure.](B [PASSED]|[Stop]|[-]|[Description=Stop the cluster](B [PASSED]|[Start]|[-]|[Description=Start the cluster](B [PASSED]|[Failover]|[HA=OOM;Durations=2m;ComponentName=etcd]|[Description=Simulates conditions where pods experience OOM either due to expected/undesired processes thereby testing the application's resilience to potential slowness/unavailability of some replicas due to high Memory load.](B [PASSED]|[Failover]|[HA=Pod Kill;ComponentName=etcd]|[Description=Simulates conditions where pods experience kill for a period of time either due to expected/undesired processes thereby testing the application's resilience to potential slowness/unavailability of some replicas due to kill.](B [PASSED]|[HorizontalScaling Out]|[ComponentName=etcd]|[Description=HorizontalScaling Out the cluster specify component etcd](B [PASSED]|[HorizontalScaling In]|[ComponentName=etcd]|[Description=HorizontalScaling In the cluster specify component etcd](B [PASSED]|[Failover]|[HA=Network Bandwidth;Durations=2m;ComponentName=etcd]|[Description=Simulates network bandwidth fault thereby testing the application's resilience to potential slowness/unavailability of some replicas due to bandwidth network.](B [PASSED]|[NoFailover]|[HA=Network Partition;Durations=2m;ComponentName=etcd]|[Description=Simulates network partition fault thereby testing the application's resilience to potential slowness/unavailability of some replicas due to partition network.](B [PASSED]|[NoFailover]|[HA=Time Offset;Durations=2m;ComponentName=etcd]|[Description=Simulates a time offset scenario thereby testing the application's resilience to potential slowness/unavailability of some replicas due to time offset.](B [PASSED]|[NoFailover]|[HA=DNS Error;Durations=2m;ComponentName=etcd]|[Description=Simulates conditions where pods experience DNS service errors for a period of time either due to expected/undesired processes thereby testing the application's resilience to potential slowness/unavailability of some replicas due to DNS service errors.](B [PASSED]|[NoFailover]|[HA=Network Duplicate;Durations=2m;ComponentName=etcd]|[Description=Simulates network duplicate fault thereby testing the application's resilience to potential slowness/unavailability of some replicas due to duplicate network.](B [PASSED]|[Failover]|[HA=Network Loss;Durations=2m;ComponentName=etcd]|[Description=Simulates network loss fault thereby testing the application's resilience to potential slowness/unavailability of some replicas due to loss network.](B [PASSED]|[Failover]|[HA=Full CPU;Durations=2m;ComponentName=etcd]|[Description=Simulates conditions where pods experience CPU full either due to expected/undesired processes thereby testing the application's resilience to potential slowness/unavailability of some replicas due to high CPU load.](B [PASSED]|[Update]|[TerminationPolicy=WipeOut]|[Description=Update the cluster TerminationPolicy WipeOut](B [PASSED]|[Backup]|[BackupMethod=datafile]|[Description=The cluster datafile Backup](B [PASSED]|[Restore]|[BackupMethod=datafile]|[Description=The cluster datafile Restore](B [PASSED]|[Connect]|[ComponentName=etcd]|[Description=Connect to the cluster](B [PASSED]|[Delete Restore Cluster]|[BackupMethod=datafile]|[Description=Delete the datafile restore cluster](B [PASSED]|[Delete]|[-]|[Description=Delete the cluster](B [END]