https://github.com/apecloud/apecloud-cd/actions/runs/21930219260 previous_version: kubeblocks_version:1.0.2 bash test/kbcli/test_kbcli_1.0.sh --type 29 --version 1.0.2 --service-version 25 --generate-output true --aws-access-key-id *** --aws-secret-access-key *** --jihulab-token *** --random-namespace true --region eastus --cloud-provider aks CURRENT_TEST_DIR:test/kbcli source commons files source engines files source kubeblocks files source kubedb files CLUSTER_NAME:  `kubectl get namespace | grep ns-ezujo `(B   `kubectl create namespace ns-ezujo`(B  namespace/ns-ezujo created create namespace ns-ezujo done(B download kbcli  `gh release list --repo apecloud/kbcli --limit 100 | (grep "1.0" || true)`(B   `curl -fsSL https://kubeblocks.io/installer/install_cli.sh | bash -s v1.0.2`(B  Your system is linux_amd64 Installing kbcli ... Downloading ... kbcli installed successfully. Kubernetes: v1.32.10 KubeBlocks: 1.0.2 kbcli: 1.0.2 Make sure your docker service is running and begin your journey with kbcli: kbcli playground init For more information on how to get started, please visit: https://kubeblocks.io download kbcli v1.0.2 done(B Kubernetes: v1.32.10 KubeBlocks: 1.0.2 kbcli: 1.0.2 Kubernetes Env: v1.32.10 check snapshot controller check snapshot controller done(B POD_RESOURCES: aks kb-default-sc found aks default-vsc found found default storage class: default (B KubeBlocks version is:1.0.2 skip upgrade KubeBlocks(B current KubeBlocks version: 1.0.2 check component definition set component name:clickhouse set component version set component version:clickhouse set service versions:25.9.7,25.4.4,24.8.3,22.8.21,22.3.20,22.3.18 set service versions sorted:22.3.18,22.3.20,22.8.21,24.8.3,25.4.4,25.9.7 set clickhouse component definition set clickhouse component definition clickhouse-keeper-1.0.2 REPORT_COUNT 0:0 set replicas first:2,22.3.18|2,22.3.20|2,22.8.21|2,24.8.3|2,25.4.4|2,25.9.7 set replicas second max again:2,25.4.4 set replicas second max again:2,25.9.7 REPORT_COUNT 2:1 CLUSTER_TOPOLOGY:cluster cluster definition topology: standalone cluster topology cluster found in cluster definition clickhouse set clickhouse component definition set clickhouse component definition clickhouse-keeper-1.0.2 LIMIT_CPU:0.2 LIMIT_MEMORY:2 storage size: 20 CLUSTER_NAME:clkhouse-ubczqv pod_info: termination_policy:WipeOut create 2 replica WipeOut clickhouse cluster check component definition set component definition by component version check cmpd by labels check cmpd by compDefs set component definition: clickhouse-1.0.2 by component version:clickhouse apiVersion: apps.kubeblocks.io/v1 kind: Cluster metadata: name: clkhouse-ubczqv namespace: ns-ezujo spec: clusterDef: clickhouse topology: cluster terminationPolicy: WipeOut componentSpecs: - name: ch-keeper serviceVersion: 25.9.7 replicas: 3 disableExporter: false services: - name: default serviceType: ClusterIP systemAccounts: - name: admin passwordConfig: length: 10 numDigits: 5 numSymbols: 0 letterCase: MixedCases seed: clkhouse-ubczqv resources: requests: cpu: 200m memory: 2Gi limits: cpu: 200m memory: 2Gi volumeClaimTemplates: - name: data spec: storageClassName: accessModes: - ReadWriteOnce resources: requests: storage: 20Gi shardings: - name: clickhouse shards: 2 template: name: clickhouse serviceVersion: 25.9.7 env: - name: "INIT_CLUSTER_NAME" value: "default" replicas: 2 disableExporter: false services: - name: default serviceType: ClusterIP systemAccounts: - name: admin passwordConfig: length: 10 numDigits: 5 numSymbols: 0 letterCase: MixedCases seed: clkhouse-ubczqv resources: requests: cpu: 200m memory: 2Gi limits: cpu: 200m memory: 2Gi volumeClaimTemplates: - name: data spec: storageClassName: accessModes: - ReadWriteOnce resources: requests: storage: 20Gi  `kubectl apply -f test_create_clkhouse-ubczqv.yaml`(B  cluster.apps.kubeblocks.io/clkhouse-ubczqv created apply test_create_clkhouse-ubczqv.yaml Success(B  `rm -rf test_create_clkhouse-ubczqv.yaml`(B  check cluster status  `kbcli cluster list clkhouse-ubczqv --show-labels --namespace ns-ezujo `(B  NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS clkhouse-ubczqv ns-ezujo clickhouse WipeOut Creating Feb 12,2026 10:05 UTC+0800 clusterdefinition.kubeblocks.io/name=clickhouse cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Updating(B cluster_status:Updating(B check cluster status done(B cluster_status:Running(B check pod status  `kbcli cluster list-instances clkhouse-ubczqv --namespace ns-ezujo `(B  NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME clkhouse-ubczqv-ch-keeper-0 ns-ezujo clkhouse-ubczqv ch-keeper Running leader 0 200m / 200m 2Gi / 2Gi data:20Gi aks-cicdamdpool-17242166-vmss000003/10.224.0.6 Feb 12,2026 10:05 UTC+0800 clkhouse-ubczqv-ch-keeper-1 ns-ezujo clkhouse-ubczqv ch-keeper Running follower 0 200m / 200m 2Gi / 2Gi data:20Gi aks-cicdamdpool-17242166-vmss000001/10.224.0.8 Feb 12,2026 10:05 UTC+0800 clkhouse-ubczqv-ch-keeper-2 ns-ezujo clkhouse-ubczqv ch-keeper Running follower 0 200m / 200m 2Gi / 2Gi data:20Gi aks-cicdamdpool-17242166-vmss000000/10.224.0.9 Feb 12,2026 10:05 UTC+0800 clkhouse-ubczqv-clickhouse-ffp-0 ns-ezujo clkhouse-ubczqv clickhouse(clickhouse-ffp) Running 0 200m / 200m 2Gi / 2Gi data:20Gi aks-cicdamdpool-17242166-vmss000003/10.224.0.6 Feb 12,2026 10:08 UTC+0800 clkhouse-ubczqv-clickhouse-ffp-1 ns-ezujo clkhouse-ubczqv clickhouse(clickhouse-ffp) Running 0 200m / 200m 2Gi / 2Gi data:20Gi aks-cicdamdpool-17242166-vmss000001/10.224.0.8 Feb 12,2026 10:08 UTC+0800 clkhouse-ubczqv-clickhouse-mhg-0 ns-ezujo clkhouse-ubczqv clickhouse(clickhouse-mhg) Running 0 200m / 200m 2Gi / 2Gi data:20Gi aks-cicdamdpool-17242166-vmss000001/10.224.0.8 Feb 12,2026 10:08 UTC+0800 clkhouse-ubczqv-clickhouse-mhg-1 ns-ezujo clkhouse-ubczqv clickhouse(clickhouse-mhg) Running 0 200m / 200m 2Gi / 2Gi data:20Gi aks-cicdamdpool-17242166-vmss000000/10.224.0.9 Feb 12,2026 10:08 UTC+0800 check pod status done(B  `kubectl get secrets -l app.kubernetes.io/instance=clkhouse-ubczqv`(B  set secret: clkhouse-ubczqv-clickhouse-mhg-account-admin  `kubectl get secrets clkhouse-ubczqv-clickhouse-mhg-account-admin -o jsonpath="{.data.username}"`(B   `kubectl get secrets clkhouse-ubczqv-clickhouse-mhg-account-admin -o jsonpath="{.data.password}"`(B   `kubectl get secrets clkhouse-ubczqv-clickhouse-mhg-account-admin -o jsonpath="{.data.port}"`(B  DB_USERNAME_PROXY:;DB_PASSWORD_PROXY:;DB_PORT_PROXY:8123(B DB_USERNAME:admin;DB_PASSWORD:6Jo7OC5Y67;DB_PORT:9000;DB_DATABASE:default(B check cluster connect  `echo 'clickhouse-client --host clkhouse-ubczqv-clickhouse-ffp.ns-ezujo.svc.cluster.local --port 9000 --user admin --password "6Jo7OC5Y67"' | kubectl exec -it clkhouse-ubczqv-clickhouse-ffp-0 --namespace ns-ezujo -- bash`(B  check cluster connect done(B  `kubectl get secrets -l app.kubernetes.io/instance=clkhouse-ubczqv`(B  set secret: clkhouse-ubczqv-clickhouse-mhg-account-admin  `kubectl get secrets clkhouse-ubczqv-clickhouse-mhg-account-admin -o jsonpath="{.data.username}"`(B   `kubectl get secrets clkhouse-ubczqv-clickhouse-mhg-account-admin -o jsonpath="{.data.password}"`(B   `kubectl get secrets clkhouse-ubczqv-clickhouse-mhg-account-admin -o jsonpath="{.data.port}"`(B  DB_USERNAME_PROXY:;DB_PASSWORD_PROXY:;DB_PORT_PROXY:8123(B DB_USERNAME:admin;DB_PASSWORD:6Jo7OC5Y67;DB_PORT:9000;DB_DATABASE:default(B check pod clkhouse-ubczqv-clickhouse-ffp-0 container_name clickhouse exist password 6Jo7OC5Y67(B check pod clkhouse-ubczqv-clickhouse-ffp-0 container_name kbagent exist password 6Jo7OC5Y67(B No container logs contain secret password.(B describe cluster  `kbcli cluster describe clkhouse-ubczqv --namespace ns-ezujo `(B  Name: clkhouse-ubczqv Created Time: Feb 12,2026 10:05 UTC+0800 NAMESPACE CLUSTER-DEFINITION TOPOLOGY STATUS TERMINATION-POLICY ns-ezujo clickhouse cluster Running WipeOut Endpoints: COMPONENT INTERNAL EXTERNAL ch-keeper clkhouse-ubczqv-ch-keeper.ns-ezujo.svc.cluster.local:8123 clkhouse-ubczqv-ch-keeper.ns-ezujo.svc.cluster.local:8443 clkhouse-ubczqv-ch-keeper.ns-ezujo.svc.cluster.local:9000 clkhouse-ubczqv-ch-keeper.ns-ezujo.svc.cluster.local:9009 clkhouse-ubczqv-ch-keeper.ns-ezujo.svc.cluster.local:9010 clkhouse-ubczqv-ch-keeper.ns-ezujo.svc.cluster.local:8001 clkhouse-ubczqv-ch-keeper.ns-ezujo.svc.cluster.local:9181 clkhouse-ubczqv-ch-keeper.ns-ezujo.svc.cluster.local:9234 clkhouse-ubczqv-ch-keeper.ns-ezujo.svc.cluster.local:9281 clkhouse-ubczqv-ch-keeper.ns-ezujo.svc.cluster.local:9440 clickhouse(clickhouse-ffp) clkhouse-ubczqv-clickhouse-ffp.ns-ezujo.svc.cluster.local:8001 clkhouse-ubczqv-clickhouse-ffp.ns-ezujo.svc.cluster.local:8123 clkhouse-ubczqv-clickhouse-ffp.ns-ezujo.svc.cluster.local:8443 clkhouse-ubczqv-clickhouse-ffp.ns-ezujo.svc.cluster.local:9000 clkhouse-ubczqv-clickhouse-ffp.ns-ezujo.svc.cluster.local:9004 clkhouse-ubczqv-clickhouse-ffp.ns-ezujo.svc.cluster.local:9005 clkhouse-ubczqv-clickhouse-ffp.ns-ezujo.svc.cluster.local:9009 clkhouse-ubczqv-clickhouse-ffp.ns-ezujo.svc.cluster.local:9010 clkhouse-ubczqv-clickhouse-ffp.ns-ezujo.svc.cluster.local:9440 clickhouse(clickhouse-mhg) clkhouse-ubczqv-clickhouse-mhg.ns-ezujo.svc.cluster.local:8001 clkhouse-ubczqv-clickhouse-mhg.ns-ezujo.svc.cluster.local:8123 clkhouse-ubczqv-clickhouse-mhg.ns-ezujo.svc.cluster.local:8443 clkhouse-ubczqv-clickhouse-mhg.ns-ezujo.svc.cluster.local:9000 clkhouse-ubczqv-clickhouse-mhg.ns-ezujo.svc.cluster.local:9004 clkhouse-ubczqv-clickhouse-mhg.ns-ezujo.svc.cluster.local:9005 clkhouse-ubczqv-clickhouse-mhg.ns-ezujo.svc.cluster.local:9009 clkhouse-ubczqv-clickhouse-mhg.ns-ezujo.svc.cluster.local:9010 clkhouse-ubczqv-clickhouse-mhg.ns-ezujo.svc.cluster.local:9440 Topology: COMPONENT SERVICE-VERSION INSTANCE ROLE STATUS AZ NODE CREATED-TIME ch-keeper 25.9.7 clkhouse-ubczqv-ch-keeper-0 leader Running 0 aks-cicdamdpool-17242166-vmss000003/10.224.0.6 Feb 12,2026 10:05 UTC+0800 ch-keeper 25.9.7 clkhouse-ubczqv-ch-keeper-1 follower Running 0 aks-cicdamdpool-17242166-vmss000001/10.224.0.8 Feb 12,2026 10:05 UTC+0800 ch-keeper 25.9.7 clkhouse-ubczqv-ch-keeper-2 follower Running 0 aks-cicdamdpool-17242166-vmss000000/10.224.0.9 Feb 12,2026 10:05 UTC+0800 clickhouse(clickhouse-ffp) 25.9.7 clkhouse-ubczqv-clickhouse-ffp-0 Running 0 aks-cicdamdpool-17242166-vmss000003/10.224.0.6 Feb 12,2026 10:08 UTC+0800 clickhouse(clickhouse-ffp) 25.9.7 clkhouse-ubczqv-clickhouse-ffp-1 Running 0 aks-cicdamdpool-17242166-vmss000001/10.224.0.8 Feb 12,2026 10:08 UTC+0800 clickhouse(clickhouse-mhg) 25.9.7 clkhouse-ubczqv-clickhouse-mhg-0 Running 0 aks-cicdamdpool-17242166-vmss000001/10.224.0.8 Feb 12,2026 10:08 UTC+0800 clickhouse(clickhouse-mhg) 25.9.7 clkhouse-ubczqv-clickhouse-mhg-1 Running 0 aks-cicdamdpool-17242166-vmss000000/10.224.0.9 Feb 12,2026 10:08 UTC+0800 Resources Allocation: COMPONENT INSTANCE-TEMPLATE CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE-SIZE STORAGE-CLASS ch-keeper 200m / 200m 2Gi / 2Gi data:20Gi default clickhouse 200m / 200m 2Gi / 2Gi data:20Gi default Images: COMPONENT COMPONENT-DEFINITION IMAGE ch-keeper clickhouse-keeper-1.0.2 docker.io/apecloud/clickhouse:25.9.7 clickhouse clickhouse-1.0.2 docker.io/apecloud/clickhouse:25.9.7 Data Protection: BACKUP-REPO AUTO-BACKUP BACKUP-SCHEDULE BACKUP-METHOD BACKUP-RETENTION RECOVERABLE-TIME Show cluster events: kbcli cluster list-events -n ns-ezujo clkhouse-ubczqv get cluster clkhouse-ubczqv shard clickhouse component name  `kubectl get component -l "app.kubernetes.io/instance=clkhouse-ubczqv,apps.kubeblocks.io/sharding-name=clickhouse" --namespace ns-ezujo`(B  set shard component name:clickhouse-ffp  `kbcli cluster label clkhouse-ubczqv app.kubernetes.io/instance- --namespace ns-ezujo `(B  label "app.kubernetes.io/instance" not found.  `kbcli cluster label clkhouse-ubczqv app.kubernetes.io/instance=clkhouse-ubczqv --namespace ns-ezujo `(B   `kbcli cluster label clkhouse-ubczqv --list --namespace ns-ezujo `(B  NAME NAMESPACE LABELS clkhouse-ubczqv ns-ezujo app.kubernetes.io/instance=clkhouse-ubczqv clusterdefinition.kubeblocks.io/name=clickhouse label cluster app.kubernetes.io/instance=clkhouse-ubczqv Success(B  `kbcli cluster label case.name=kbcli.test1 -l app.kubernetes.io/instance=clkhouse-ubczqv --namespace ns-ezujo `(B   `kbcli cluster label clkhouse-ubczqv --list --namespace ns-ezujo `(B  NAME NAMESPACE LABELS clkhouse-ubczqv ns-ezujo app.kubernetes.io/instance=clkhouse-ubczqv case.name=kbcli.test1 clusterdefinition.kubeblocks.io/name=clickhouse label cluster case.name=kbcli.test1 Success(B  `kbcli cluster label clkhouse-ubczqv case.name=kbcli.test2 --overwrite --namespace ns-ezujo `(B   `kbcli cluster label clkhouse-ubczqv --list --namespace ns-ezujo `(B  NAME NAMESPACE LABELS clkhouse-ubczqv ns-ezujo app.kubernetes.io/instance=clkhouse-ubczqv case.name=kbcli.test2 clusterdefinition.kubeblocks.io/name=clickhouse label cluster case.name=kbcli.test2 Success(B  `kbcli cluster label clkhouse-ubczqv case.name- --namespace ns-ezujo `(B   `kbcli cluster label clkhouse-ubczqv --list --namespace ns-ezujo `(B  NAME NAMESPACE LABELS clkhouse-ubczqv ns-ezujo app.kubernetes.io/instance=clkhouse-ubczqv clusterdefinition.kubeblocks.io/name=clickhouse delete cluster label case.name Success(B cluster connect  `kubectl get secrets -l app.kubernetes.io/instance=clkhouse-ubczqv`(B  set secret: clkhouse-ubczqv-clickhouse-ffp-account-admin  `kubectl get secrets clkhouse-ubczqv-clickhouse-ffp-account-admin -o jsonpath="{.data.username}"`(B   `kubectl get secrets clkhouse-ubczqv-clickhouse-ffp-account-admin -o jsonpath="{.data.password}"`(B   `kubectl get secrets clkhouse-ubczqv-clickhouse-ffp-account-admin -o jsonpath="{.data.port}"`(B  DB_USERNAME_PROXY:;DB_PASSWORD_PROXY:;DB_PORT_PROXY:8123(B DB_USERNAME:admin;DB_PASSWORD:6Jo7OC5Y67;DB_PORT:9000;DB_DATABASE:default(B  `echo 'clickhouse-client --host clkhouse-ubczqv-clickhouse-ffp.ns-ezujo.svc.cluster.local --port 9000 --user admin --password "6Jo7OC5Y67" --query "SELECT * FROM system.clusters"' | kubectl exec -it clkhouse-ubczqv-clickhouse-ffp-0 --namespace ns-ezujo -- bash `(B  default 1 1 1 1 clkhouse-ubczqv-clickhouse-ffp-0.clkhouse-ubczqv-clickhouse-ffp-headless.ns-ezujo.svc.cluster.local 10.244.2.91 9000 0 admin 0 0 0 \N \N \N \N default 1 1 1 2 clkhouse-ubczqv-clickhouse-ffp-1.clkhouse-ubczqv-clickhouse-ffp-headless.ns-ezujo.svc.cluster.local 10.244.3.63 9000 1 admin 0 0 0 \N \N \N \N default 2 1 1 1 clkhouse-ubczqv-clickhouse-mhg-0.clkhouse-ubczqv-clickhouse-mhg-headless.ns-ezujo.svc.cluster.local 10.244.3.211 9000 0 admin 0 0 0 \N \N \N \N default 2 1 1 2 clkhouse-ubczqv-clickhouse-mhg-1.clkhouse-ubczqv-clickhouse-mhg-headless.ns-ezujo.svc.cluster.local 10.244.4.238 9000 0 admin 0 0 0 \N \N \N \N connect cluster Success(B insert batch data by db client  `kubectl patch -p '{"metadata":{"finalizers":[]}}' --type=merge pods test-db-client-executionloop-clkhouse-ubczqv --namespace ns-ezujo `(B   `kubectl get secrets -l app.kubernetes.io/instance=clkhouse-ubczqv`(B  set secret: clkhouse-ubczqv-clickhouse-ffp-account-admin  `kubectl get secrets clkhouse-ubczqv-clickhouse-ffp-account-admin -o jsonpath="{.data.username}"`(B   `kubectl get secrets clkhouse-ubczqv-clickhouse-ffp-account-admin -o jsonpath="{.data.password}"`(B   `kubectl get secrets clkhouse-ubczqv-clickhouse-ffp-account-admin -o jsonpath="{.data.port}"`(B  DB_USERNAME_PROXY:;DB_PASSWORD_PROXY:;DB_PORT_PROXY:8123(B DB_USERNAME:admin;DB_PASSWORD:6Jo7OC5Y67;DB_PORT:9000;DB_DATABASE:default(B apiVersion: v1 kind: Pod metadata: name: test-db-client-executionloop-clkhouse-ubczqv namespace: ns-ezujo spec: containers: - name: test-dbclient imagePullPolicy: IfNotPresent image: docker.io/apecloud/dbclient:test args: - "--host" - "clkhouse-ubczqv-clickhouse-ffp.ns-ezujo.svc.cluster.local" - "--user" - "admin" - "--password" - "6Jo7OC5Y67" - "--port" - "8123" - "--dbtype" - "clickhouse" - "--test" - "executionloop" - "--duration" - "20" - "--interval" - "1" - "--cluster" - "default" restartPolicy: Never  `kubectl apply -f test-db-client-executionloop-clkhouse-ubczqv.yaml`(B  pod/test-db-client-executionloop-clkhouse-ubczqv created apply test-db-client-executionloop-clkhouse-ubczqv.yaml Success(B  `rm -rf test-db-client-executionloop-clkhouse-ubczqv.yaml`(B  check pod status pod_status:NAME READY STATUS RESTARTS AGE test-db-client-executionloop-clkhouse-ubczqv 0/1 ContainerCreating 0 5s(B pod_status:NAME READY STATUS RESTARTS AGE test-db-client-executionloop-clkhouse-ubczqv 0/1 ContainerCreating 0 9s(B pod_status:NAME READY STATUS RESTARTS AGE test-db-client-executionloop-clkhouse-ubczqv 1/1 Running 0 14s(B pod_status:NAME READY STATUS RESTARTS AGE test-db-client-executionloop-clkhouse-ubczqv 1/1 Running 0 19s(B pod_status:NAME READY STATUS RESTARTS AGE test-db-client-executionloop-clkhouse-ubczqv 1/1 Running 0 24s(B pod_status:NAME READY STATUS RESTARTS AGE test-db-client-executionloop-clkhouse-ubczqv 1/1 Running 0 29s(B pod_status:NAME READY STATUS RESTARTS AGE test-db-client-executionloop-clkhouse-ubczqv 1/1 Running 0 35s(B check pod test-db-client-executionloop-clkhouse-ubczqv status done(B pod_status:NAME READY STATUS RESTARTS AGE test-db-client-executionloop-clkhouse-ubczqv 0/1 Completed 0 40s(B check cluster status  `kbcli cluster list clkhouse-ubczqv --show-labels --namespace ns-ezujo `(B  NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS clkhouse-ubczqv ns-ezujo clickhouse WipeOut Running Feb 12,2026 10:05 UTC+0800 app.kubernetes.io/instance=clkhouse-ubczqv,clusterdefinition.kubeblocks.io/name=clickhouse check cluster status done(B cluster_status:Running(B check pod status  `kbcli cluster list-instances clkhouse-ubczqv --namespace ns-ezujo `(B  NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME clkhouse-ubczqv-ch-keeper-0 ns-ezujo clkhouse-ubczqv ch-keeper Running leader 0 200m / 200m 2Gi / 2Gi data:20Gi aks-cicdamdpool-17242166-vmss000003/10.224.0.6 Feb 12,2026 10:05 UTC+0800 clkhouse-ubczqv-ch-keeper-1 ns-ezujo clkhouse-ubczqv ch-keeper Running follower 0 200m / 200m 2Gi / 2Gi data:20Gi aks-cicdamdpool-17242166-vmss000001/10.224.0.8 Feb 12,2026 10:05 UTC+0800 clkhouse-ubczqv-ch-keeper-2 ns-ezujo clkhouse-ubczqv ch-keeper Running follower 0 200m / 200m 2Gi / 2Gi data:20Gi aks-cicdamdpool-17242166-vmss000000/10.224.0.9 Feb 12,2026 10:05 UTC+0800 clkhouse-ubczqv-clickhouse-ffp-0 ns-ezujo clkhouse-ubczqv clickhouse(clickhouse-ffp) Running 0 200m / 200m 2Gi / 2Gi data:20Gi aks-cicdamdpool-17242166-vmss000003/10.224.0.6 Feb 12,2026 10:08 UTC+0800 clkhouse-ubczqv-clickhouse-ffp-1 ns-ezujo clkhouse-ubczqv clickhouse(clickhouse-ffp) Running 0 200m / 200m 2Gi / 2Gi data:20Gi aks-cicdamdpool-17242166-vmss000001/10.224.0.8 Feb 12,2026 10:08 UTC+0800 clkhouse-ubczqv-clickhouse-mhg-0 ns-ezujo clkhouse-ubczqv clickhouse(clickhouse-mhg) Running 0 200m / 200m 2Gi / 2Gi data:20Gi aks-cicdamdpool-17242166-vmss000001/10.224.0.8 Feb 12,2026 10:08 UTC+0800 clkhouse-ubczqv-clickhouse-mhg-1 ns-ezujo clkhouse-ubczqv clickhouse(clickhouse-mhg) Running 0 200m / 200m 2Gi / 2Gi data:20Gi aks-cicdamdpool-17242166-vmss000000/10.224.0.9 Feb 12,2026 10:08 UTC+0800 check pod status done(B  `kubectl get secrets -l app.kubernetes.io/instance=clkhouse-ubczqv`(B  set secret: clkhouse-ubczqv-clickhouse-ffp-account-admin  `kubectl get secrets clkhouse-ubczqv-clickhouse-ffp-account-admin -o jsonpath="{.data.username}"`(B   `kubectl get secrets clkhouse-ubczqv-clickhouse-ffp-account-admin -o jsonpath="{.data.password}"`(B   `kubectl get secrets clkhouse-ubczqv-clickhouse-ffp-account-admin -o jsonpath="{.data.port}"`(B  DB_USERNAME_PROXY:;DB_PASSWORD_PROXY:;DB_PORT_PROXY:8123(B DB_USERNAME:admin;DB_PASSWORD:6Jo7OC5Y67;DB_PORT:9000;DB_DATABASE:default(B check cluster connect  `echo 'clickhouse-client --host clkhouse-ubczqv-clickhouse-ffp.ns-ezujo.svc.cluster.local --port 9000 --user admin --password "6Jo7OC5Y67"' | kubectl exec -it clkhouse-ubczqv-clickhouse-ffp-0 --namespace ns-ezujo -- bash`(B  check cluster connect done(B --host clkhouse-ubczqv-clickhouse-ffp.ns-ezujo.svc.cluster.local --user admin --password 6Jo7OC5Y67 --port 8123 --dbtype clickhouse --test executionloop --duration 20 --interval 1 --cluster default SLF4J(I): Connected with provider of type [ch.qos.logback.classic.spi.LogbackServiceProvider] 02:10:12.919 [main] WARN r.yandex.clickhouse.ClickHouseDriver - ****************************************************************************************** 02:10:12.921 [main] WARN r.yandex.clickhouse.ClickHouseDriver - * This driver is DEPRECATED. Please use [com.clickhouse.jdbc.ClickHouseDriver] instead. * 02:10:12.921 [main] WARN r.yandex.clickhouse.ClickHouseDriver - * Also everything in package [ru.yandex.clickhouse] will be removed starting from 0.4.0. * 02:10:12.921 [main] WARN r.yandex.clickhouse.ClickHouseDriver - ****************************************************************************************** Execution loop start: create database executions_loop CREATE DATABASE IF NOT EXISTS executions_loop ON CLUSTER default; drop distributed table executions_loop_table_distributed DROP TABLE IF EXISTS executions_loop.executions_loop_table_distributed ON CLUSTER default SYNC; drop table executions_loop_table DROP TABLE IF EXISTS executions_loop.executions_loop_table ON CLUSTER default SYNC; create table executions_loop_table CREATE TABLE IF NOT EXISTS executions_loop.executions_loop_table ON CLUSTER default (id UInt32, value String) ENGINE = ReplicatedMergeTree() ORDER BY id; create distributed table executions_loop_table_distributed CREATE TABLE IF NOT EXISTS executions_loop.executions_loop_table_distributed ON CLUSTER default AS executions_loop.executions_loop_table ENGINE = Distributed('default', 'executions_loop', 'executions_loop_table', rand()); Execution loop start:INSERT INTO executions_loop.executions_loop_table_distributed (id, value) VALUES (1, 'executions_loop_test_1'); [ 1s ] executions total: 1 successful: 1 failed: 0 disconnect: 0 [ 2s ] executions total: 9 successful: 9 failed: 0 disconnect: 0 [ 3s ] executions total: 17 successful: 17 failed: 0 disconnect: 0 [ 4s ] executions total: 25 successful: 25 failed: 0 disconnect: 0 [ 5s ] executions total: 49 successful: 49 failed: 0 disconnect: 0 [ 6s ] executions total: 72 successful: 72 failed: 0 disconnect: 0 [ 7s ] executions total: 98 successful: 98 failed: 0 disconnect: 0 [ 8s ] executions total: 113 successful: 113 failed: 0 disconnect: 0 [ 9s ] executions total: 126 successful: 126 failed: 0 disconnect: 0 [ 10s ] executions total: 150 successful: 150 failed: 0 disconnect: 0 [ 11s ] executions total: 177 successful: 177 failed: 0 disconnect: 0 [ 12s ] executions total: 200 successful: 200 failed: 0 disconnect: 0 [ 13s ] executions total: 222 successful: 222 failed: 0 disconnect: 0 [ 14s ] executions total: 254 successful: 254 failed: 0 disconnect: 0 [ 15s ] executions total: 275 successful: 275 failed: 0 disconnect: 0 [ 16s ] executions total: 302 successful: 302 failed: 0 disconnect: 0 [ 17s ] executions total: 311 successful: 311 failed: 0 disconnect: 0 [ 20s ] executions total: 337 successful: 337 failed: 0 disconnect: 0 Test Result: Total Executions: 337 Successful Executions: 337 Failed Executions: 0 Disconnection Counts: 0 Connection Information: Database Type: clickhouse Host: clkhouse-ubczqv-clickhouse-ffp.ns-ezujo.svc.cluster.local Port: 8123 Database: Table: User: admin Org: Access Mode: mysql Test Type: executionloop Query: Duration: 20 seconds Interval: 1 seconds Cluster: default DB_CLIENT_BATCH_DATA_COUNT: 337  `kubectl patch -p '{"metadata":{"finalizers":[]}}' --type=merge pods test-db-client-executionloop-clkhouse-ubczqv --namespace ns-ezujo `(B  pod/test-db-client-executionloop-clkhouse-ubczqv patched (no change) pod "test-db-client-executionloop-clkhouse-ubczqv" force deleted  `kubectl get secrets -l app.kubernetes.io/instance=clkhouse-ubczqv`(B  set secret: clkhouse-ubczqv-clickhouse-ffp-account-admin  `kubectl get secrets clkhouse-ubczqv-clickhouse-ffp-account-admin -o jsonpath="{.data.username}"`(B   `kubectl get secrets clkhouse-ubczqv-clickhouse-ffp-account-admin -o jsonpath="{.data.password}"`(B   `kubectl get secrets clkhouse-ubczqv-clickhouse-ffp-account-admin -o jsonpath="{.data.port}"`(B  DB_USERNAME_PROXY:;DB_PASSWORD_PROXY:;DB_PORT_PROXY:8123(B DB_USERNAME:admin;DB_PASSWORD:6Jo7OC5Y67;DB_PORT:9000;DB_DATABASE:default(B set db_client batch data count  `echo 'clickhouse-client --host clkhouse-ubczqv-clickhouse-ffp.ns-ezujo.svc.cluster.local --port 9000 --user admin --password "6Jo7OC5Y67" --query "SELECT count(*) FROM executions_loop.executions_loop_table;"' | kubectl exec -it clkhouse-ubczqv-clickhouse-ffp-0 --namespace ns-ezujo -- bash`(B  set db_client batch data Success(B test failover connectionstress(B check cluster status before cluster-failover-connectionstress check cluster status done(B cluster_status:Running(B  `kubectl patch -p '{"metadata":{"finalizers":[]}}' --type=merge pods test-db-client-connectionstress-clkhouse-ubczqv --namespace ns-ezujo `(B   `kubectl get secrets -l app.kubernetes.io/instance=clkhouse-ubczqv`(B  set secret: clkhouse-ubczqv-clickhouse-ffp-account-admin  `kubectl get secrets clkhouse-ubczqv-clickhouse-ffp-account-admin -o jsonpath="{.data.username}"`(B   `kubectl get secrets clkhouse-ubczqv-clickhouse-ffp-account-admin -o jsonpath="{.data.password}"`(B   `kubectl get secrets clkhouse-ubczqv-clickhouse-ffp-account-admin -o jsonpath="{.data.port}"`(B  DB_USERNAME_PROXY:;DB_PASSWORD_PROXY:;DB_PORT_PROXY:8123(B DB_USERNAME:admin;DB_PASSWORD:6Jo7OC5Y67;DB_PORT:9000;DB_DATABASE:default(B apiVersion: v1 kind: Pod metadata: name: test-db-client-connectionstress-clkhouse-ubczqv namespace: ns-ezujo spec: containers: - name: test-dbclient imagePullPolicy: IfNotPresent image: docker.io/apecloud/dbclient:test args: - "--host" - "clkhouse-ubczqv-clickhouse-ffp.ns-ezujo.svc.cluster.local" - "--user" - "admin" - "--password" - "6Jo7OC5Y67" - "--port" - "8123" - "--database" - "default" - "--dbtype" - "clickhouse" - "--test" - "connectionstress" - "--connections" - "4096" - "--duration" - "20" - "--cluster" - "default" restartPolicy: Never  `kubectl apply -f test-db-client-connectionstress-clkhouse-ubczqv.yaml`(B  pod/test-db-client-connectionstress-clkhouse-ubczqv created apply test-db-client-connectionstress-clkhouse-ubczqv.yaml Success(B  `rm -rf test-db-client-connectionstress-clkhouse-ubczqv.yaml`(B  check pod status pod_status:NAME READY STATUS RESTARTS AGE test-db-client-connectionstress-clkhouse-ubczqv 1/1 Running 0 5s(B pod_status:NAME READY STATUS RESTARTS AGE test-db-client-connectionstress-clkhouse-ubczqv 1/1 Running 0 10s(B pod_status:NAME READY STATUS RESTARTS AGE test-db-client-connectionstress-clkhouse-ubczqv 1/1 Running 0 15s(B pod_status:NAME READY STATUS RESTARTS AGE test-db-client-connectionstress-clkhouse-ubczqv 1/1 Running 0 20s(B pod_status:NAME READY STATUS RESTARTS AGE test-db-client-connectionstress-clkhouse-ubczqv 1/1 Running 0 25s(B pod_status:NAME READY STATUS RESTARTS AGE test-db-client-connectionstress-clkhouse-ubczqv 1/1 Running 0 30s(B pod_status:NAME READY STATUS RESTARTS AGE test-db-client-connectionstress-clkhouse-ubczqv 1/1 Running 0 36s(B pod_status:NAME READY STATUS RESTARTS AGE test-db-client-connectionstress-clkhouse-ubczqv 1/1 Running 0 41s(B pod_status:NAME READY STATUS RESTARTS AGE test-db-client-connectionstress-clkhouse-ubczqv 1/1 Running 0 46s(B pod_status:NAME READY STATUS RESTARTS AGE test-db-client-connectionstress-clkhouse-ubczqv 1/1 Running 0 51s(B pod_status:NAME READY STATUS RESTARTS AGE test-db-client-connectionstress-clkhouse-ubczqv 1/1 Running 0 56s(B pod_status:NAME READY STATUS RESTARTS AGE test-db-client-connectionstress-clkhouse-ubczqv 1/1 Running 0 61s(B pod_status:NAME READY STATUS RESTARTS AGE test-db-client-connectionstress-clkhouse-ubczqv 1/1 Running 0 67s(B pod_status:NAME READY STATUS RESTARTS AGE test-db-client-connectionstress-clkhouse-ubczqv 1/1 Running 0 72s(B check pod test-db-client-connectionstress-clkhouse-ubczqv status done(B pod_status:NAME READY STATUS RESTARTS AGE test-db-client-connectionstress-clkhouse-ubczqv 0/1 Completed 0 77s(B check cluster status  `kbcli cluster list clkhouse-ubczqv --show-labels --namespace ns-ezujo `(B  NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS clkhouse-ubczqv ns-ezujo clickhouse WipeOut Running Feb 12,2026 10:05 UTC+0800 app.kubernetes.io/instance=clkhouse-ubczqv,clusterdefinition.kubeblocks.io/name=clickhouse check cluster status done(B cluster_status:Running(B check pod status  `kbcli cluster list-instances clkhouse-ubczqv --namespace ns-ezujo `(B  NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME clkhouse-ubczqv-ch-keeper-0 ns-ezujo clkhouse-ubczqv ch-keeper Running leader 0 200m / 200m 2Gi / 2Gi data:20Gi aks-cicdamdpool-17242166-vmss000003/10.224.0.6 Feb 12,2026 10:05 UTC+0800 clkhouse-ubczqv-ch-keeper-1 ns-ezujo clkhouse-ubczqv ch-keeper Running follower 0 200m / 200m 2Gi / 2Gi data:20Gi aks-cicdamdpool-17242166-vmss000001/10.224.0.8 Feb 12,2026 10:05 UTC+0800 clkhouse-ubczqv-ch-keeper-2 ns-ezujo clkhouse-ubczqv ch-keeper Running follower 0 200m / 200m 2Gi / 2Gi data:20Gi aks-cicdamdpool-17242166-vmss000000/10.224.0.9 Feb 12,2026 10:05 UTC+0800 clkhouse-ubczqv-clickhouse-ffp-0 ns-ezujo clkhouse-ubczqv clickhouse(clickhouse-ffp) Running 0 200m / 200m 2Gi / 2Gi data:20Gi aks-cicdamdpool-17242166-vmss000003/10.224.0.6 Feb 12,2026 10:08 UTC+0800 clkhouse-ubczqv-clickhouse-ffp-1 ns-ezujo clkhouse-ubczqv clickhouse(clickhouse-ffp) Running 0 200m / 200m 2Gi / 2Gi data:20Gi aks-cicdamdpool-17242166-vmss000001/10.224.0.8 Feb 12,2026 10:08 UTC+0800 clkhouse-ubczqv-clickhouse-mhg-0 ns-ezujo clkhouse-ubczqv clickhouse(clickhouse-mhg) Running 0 200m / 200m 2Gi / 2Gi data:20Gi aks-cicdamdpool-17242166-vmss000001/10.224.0.8 Feb 12,2026 10:08 UTC+0800 clkhouse-ubczqv-clickhouse-mhg-1 ns-ezujo clkhouse-ubczqv clickhouse(clickhouse-mhg) Running 0 200m / 200m 2Gi / 2Gi data:20Gi aks-cicdamdpool-17242166-vmss000000/10.224.0.9 Feb 12,2026 10:08 UTC+0800 check pod status done(B  `kubectl get secrets -l app.kubernetes.io/instance=clkhouse-ubczqv`(B  set secret: clkhouse-ubczqv-clickhouse-ffp-account-admin  `kubectl get secrets clkhouse-ubczqv-clickhouse-ffp-account-admin -o jsonpath="{.data.username}"`(B   `kubectl get secrets clkhouse-ubczqv-clickhouse-ffp-account-admin -o jsonpath="{.data.password}"`(B   `kubectl get secrets clkhouse-ubczqv-clickhouse-ffp-account-admin -o jsonpath="{.data.port}"`(B  DB_USERNAME_PROXY:;DB_PASSWORD_PROXY:;DB_PORT_PROXY:8123(B DB_USERNAME:admin;DB_PASSWORD:6Jo7OC5Y67;DB_PORT:9000;DB_DATABASE:default(B check cluster connect  `echo 'clickhouse-client --host clkhouse-ubczqv-clickhouse-ffp.ns-ezujo.svc.cluster.local --port 9000 --user admin --password "6Jo7OC5Y67"' | kubectl exec -it clkhouse-ubczqv-clickhouse-ffp-0 --namespace ns-ezujo -- bash`(B  check cluster connect done(B --host clkhouse-ubczqv-clickhouse-ffp.ns-ezujo.svc.cluster.local --user admin --password 6Jo7OC5Y67 --port 8123 --database default --dbtype clickhouse --test connectionstress --connections 4096 --duration 20 --cluster default SLF4J(I): Connected with provider of type [ch.qos.logback.classic.spi.LogbackServiceProvider] 02:10:52.176 [main] WARN r.yandex.clickhouse.ClickHouseDriver - ****************************************************************************************** 02:10:52.178 [main] WARN r.yandex.clickhouse.ClickHouseDriver - * This driver is DEPRECATED. Please use [com.clickhouse.jdbc.ClickHouseDriver] instead. * 02:10:52.180 [main] WARN r.yandex.clickhouse.ClickHouseDriver - * Also everything in package [ru.yandex.clickhouse] will be removed starting from 0.4.0. * 02:10:52.180 [main] WARN r.yandex.clickhouse.ClickHouseDriver - ****************************************************************************************** Test Result: null Connection Information: Database Type: clickhouse Host: clkhouse-ubczqv-clickhouse-ffp.ns-ezujo.svc.cluster.local Port: 8123 Database: default Table: User: admin Org: Access Mode: mysql Test Type: connectionstress Connection Count: 4096 Duration: 20 seconds  `kubectl patch -p '{"metadata":{"finalizers":[]}}' --type=merge pods test-db-client-connectionstress-clkhouse-ubczqv --namespace ns-ezujo `(B  pod/test-db-client-connectionstress-clkhouse-ubczqv patched (no change) pod "test-db-client-connectionstress-clkhouse-ubczqv" force deleted check failover pod name failover pod name:clkhouse-ubczqv-clickhouse-ffp-0 failover connectionstress Success(B  `kubectl get secrets -l app.kubernetes.io/instance=clkhouse-ubczqv`(B  set secret: clkhouse-ubczqv-clickhouse-ffp-account-admin  `kubectl get secrets clkhouse-ubczqv-clickhouse-ffp-account-admin -o jsonpath="{.data.username}"`(B   `kubectl get secrets clkhouse-ubczqv-clickhouse-ffp-account-admin -o jsonpath="{.data.password}"`(B   `kubectl get secrets clkhouse-ubczqv-clickhouse-ffp-account-admin -o jsonpath="{.data.port}"`(B  DB_USERNAME_PROXY:;DB_PASSWORD_PROXY:;DB_PORT_PROXY:8123(B DB_USERNAME:admin;DB_PASSWORD:6Jo7OC5Y67;DB_PORT:9000;DB_DATABASE:default(B check db_client batch data count  `echo 'clickhouse-client --host clkhouse-ubczqv-clickhouse-ffp.ns-ezujo.svc.cluster.local --port 9000 --user admin --password "6Jo7OC5Y67" --query "SELECT count(*) FROM executions_loop.executions_loop_table;"' | kubectl exec -it clkhouse-ubczqv-clickhouse-ffp-0 --namespace ns-ezujo -- bash`(B  check db_client batch [337] equal [337] data Success(B  `kubectl get pvc -l app.kubernetes.io/instance=clkhouse-ubczqv,apps.kubeblocks.io/component-name=ch-keeper,apps.kubeblocks.io/vct-name=data --namespace ns-ezujo `(B  cluster volume-expand check cluster status before ops check cluster status done(B cluster_status:Running(B  `kbcli cluster volume-expand clkhouse-ubczqv --auto-approve --force=true --components ch-keeper --volume-claim-templates data --storage 25Gi --namespace ns-ezujo `(B  OpsRequest clkhouse-ubczqv-volumeexpansion-whchx created successfully, you can view the progress: kbcli cluster describe-ops clkhouse-ubczqv-volumeexpansion-whchx -n ns-ezujo check ops status  `kbcli cluster list-ops clkhouse-ubczqv --status all --namespace ns-ezujo `(B  NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME clkhouse-ubczqv-volumeexpansion-whchx ns-ezujo VolumeExpansion clkhouse-ubczqv ch-keeper Running 0/3 Feb 12,2026 10:12 UTC+0800 check cluster status  `kbcli cluster list clkhouse-ubczqv --show-labels --namespace ns-ezujo `(B  NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS clkhouse-ubczqv ns-ezujo clickhouse WipeOut Updating Feb 12,2026 10:05 UTC+0800 app.kubernetes.io/instance=clkhouse-ubczqv,clusterdefinition.kubeblocks.io/name=clickhouse cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B check cluster status done(B cluster_status:Running(B check pod status  `kbcli cluster list-instances clkhouse-ubczqv --namespace ns-ezujo `(B  NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME clkhouse-ubczqv-ch-keeper-0 ns-ezujo clkhouse-ubczqv ch-keeper Running leader 0 200m / 200m 2Gi / 2Gi data:25Gi aks-cicdamdpool-17242166-vmss000003/10.224.0.6 Feb 12,2026 10:05 UTC+0800 clkhouse-ubczqv-ch-keeper-1 ns-ezujo clkhouse-ubczqv ch-keeper Running follower 0 200m / 200m 2Gi / 2Gi data:25Gi aks-cicdamdpool-17242166-vmss000001/10.224.0.8 Feb 12,2026 10:05 UTC+0800 clkhouse-ubczqv-ch-keeper-2 ns-ezujo clkhouse-ubczqv ch-keeper Running follower 0 200m / 200m 2Gi / 2Gi data:25Gi aks-cicdamdpool-17242166-vmss000000/10.224.0.9 Feb 12,2026 10:05 UTC+0800 clkhouse-ubczqv-clickhouse-ffp-0 ns-ezujo clkhouse-ubczqv clickhouse(clickhouse-ffp) Running 0 200m / 200m 2Gi / 2Gi data:20Gi aks-cicdamdpool-17242166-vmss000003/10.224.0.6 Feb 12,2026 10:08 UTC+0800 clkhouse-ubczqv-clickhouse-ffp-1 ns-ezujo clkhouse-ubczqv clickhouse(clickhouse-ffp) Running 0 200m / 200m 2Gi / 2Gi data:20Gi aks-cicdamdpool-17242166-vmss000001/10.224.0.8 Feb 12,2026 10:08 UTC+0800 clkhouse-ubczqv-clickhouse-mhg-0 ns-ezujo clkhouse-ubczqv clickhouse(clickhouse-mhg) Running 0 200m / 200m 2Gi / 2Gi data:20Gi aks-cicdamdpool-17242166-vmss000001/10.224.0.8 Feb 12,2026 10:08 UTC+0800 clkhouse-ubczqv-clickhouse-mhg-1 ns-ezujo clkhouse-ubczqv clickhouse(clickhouse-mhg) Running 0 200m / 200m 2Gi / 2Gi data:20Gi aks-cicdamdpool-17242166-vmss000000/10.224.0.9 Feb 12,2026 10:08 UTC+0800 check pod status done(B  `kubectl get secrets -l app.kubernetes.io/instance=clkhouse-ubczqv`(B  set secret: clkhouse-ubczqv-clickhouse-ffp-account-admin  `kubectl get secrets clkhouse-ubczqv-clickhouse-ffp-account-admin -o jsonpath="{.data.username}"`(B   `kubectl get secrets clkhouse-ubczqv-clickhouse-ffp-account-admin -o jsonpath="{.data.password}"`(B   `kubectl get secrets clkhouse-ubczqv-clickhouse-ffp-account-admin -o jsonpath="{.data.port}"`(B  DB_USERNAME_PROXY:;DB_PASSWORD_PROXY:;DB_PORT_PROXY:8123(B DB_USERNAME:admin;DB_PASSWORD:6Jo7OC5Y67;DB_PORT:9000;DB_DATABASE:default(B check cluster connect  `echo 'clickhouse-client --host clkhouse-ubczqv-clickhouse-ffp.ns-ezujo.svc.cluster.local --port 9000 --user admin --password "6Jo7OC5Y67"' | kubectl exec -it clkhouse-ubczqv-clickhouse-ffp-0 --namespace ns-ezujo -- bash`(B  check cluster connect done(B check ops status  `kbcli cluster list-ops clkhouse-ubczqv --status all --namespace ns-ezujo `(B  NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME clkhouse-ubczqv-volumeexpansion-whchx ns-ezujo VolumeExpansion clkhouse-ubczqv ch-keeper Succeed 3/3 Feb 12,2026 10:12 UTC+0800 check ops status done(B ops_status:clkhouse-ubczqv-volumeexpansion-whchx ns-ezujo VolumeExpansion clkhouse-ubczqv ch-keeper Succeed 3/3 Feb 12,2026 10:12 UTC+0800 (B  `kubectl patch -p '{"metadata":{"finalizers":[]}}' --type=merge opsrequests.operations clkhouse-ubczqv-volumeexpansion-whchx --namespace ns-ezujo `(B  opsrequest.operations.kubeblocks.io/clkhouse-ubczqv-volumeexpansion-whchx patched  `kbcli cluster delete-ops --name clkhouse-ubczqv-volumeexpansion-whchx --force --auto-approve --namespace ns-ezujo `(B  OpsRequest clkhouse-ubczqv-volumeexpansion-whchx deleted  `kubectl get secrets -l app.kubernetes.io/instance=clkhouse-ubczqv`(B  set secret: clkhouse-ubczqv-clickhouse-ffp-account-admin  `kubectl get secrets clkhouse-ubczqv-clickhouse-ffp-account-admin -o jsonpath="{.data.username}"`(B   `kubectl get secrets clkhouse-ubczqv-clickhouse-ffp-account-admin -o jsonpath="{.data.password}"`(B   `kubectl get secrets clkhouse-ubczqv-clickhouse-ffp-account-admin -o jsonpath="{.data.port}"`(B  DB_USERNAME_PROXY:;DB_PASSWORD_PROXY:;DB_PORT_PROXY:8123(B DB_USERNAME:admin;DB_PASSWORD:6Jo7OC5Y67;DB_PORT:9000;DB_DATABASE:default(B check db_client batch data count  `echo 'clickhouse-client --host clkhouse-ubczqv-clickhouse-ffp.ns-ezujo.svc.cluster.local --port 9000 --user admin --password "6Jo7OC5Y67" --query "SELECT count(*) FROM executions_loop.executions_loop_table;"' | kubectl exec -it clkhouse-ubczqv-clickhouse-ffp-0 --namespace ns-ezujo -- bash`(B  check db_client batch [337] equal [337] data Success(B check cluster status before ops check cluster status done(B cluster_status:Running(B  `kbcli cluster vscale clkhouse-ubczqv --auto-approve --force=true --components clickhouse --cpu 300m --memory 2.1Gi --namespace ns-ezujo `(B  OpsRequest clkhouse-ubczqv-verticalscaling-l972f created successfully, you can view the progress: kbcli cluster describe-ops clkhouse-ubczqv-verticalscaling-l972f -n ns-ezujo check ops status  `kbcli cluster list-ops clkhouse-ubczqv --status all --namespace ns-ezujo `(B  NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME clkhouse-ubczqv-verticalscaling-l972f ns-ezujo VerticalScaling clkhouse-ubczqv clickhouse Running 0/4 Feb 12,2026 10:26 UTC+0800 check cluster status  `kbcli cluster list clkhouse-ubczqv --show-labels --namespace ns-ezujo `(B  NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS clkhouse-ubczqv ns-ezujo clickhouse WipeOut Updating Feb 12,2026 10:05 UTC+0800 app.kubernetes.io/instance=clkhouse-ubczqv,clusterdefinition.kubeblocks.io/name=clickhouse cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B check cluster status done(B cluster_status:Running(B check pod status  `kbcli cluster list-instances clkhouse-ubczqv --namespace ns-ezujo `(B  NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME clkhouse-ubczqv-ch-keeper-0 ns-ezujo clkhouse-ubczqv ch-keeper Running leader 0 200m / 200m 2Gi / 2Gi data:25Gi aks-cicdamdpool-17242166-vmss000003/10.224.0.6 Feb 12,2026 10:05 UTC+0800 clkhouse-ubczqv-ch-keeper-1 ns-ezujo clkhouse-ubczqv ch-keeper Running follower 0 200m / 200m 2Gi / 2Gi data:25Gi aks-cicdamdpool-17242166-vmss000001/10.224.0.8 Feb 12,2026 10:05 UTC+0800 clkhouse-ubczqv-ch-keeper-2 ns-ezujo clkhouse-ubczqv ch-keeper Running follower 0 200m / 200m 2Gi / 2Gi data:25Gi aks-cicdamdpool-17242166-vmss000000/10.224.0.9 Feb 12,2026 10:05 UTC+0800 clkhouse-ubczqv-clickhouse-ffp-0 ns-ezujo clkhouse-ubczqv clickhouse(clickhouse-ffp) Running 0 300m / 300m 2254857830400m / 2254857830400m data:20Gi aks-cicdamdpool-17242166-vmss000003/10.224.0.6 Feb 12,2026 10:27 UTC+0800 clkhouse-ubczqv-clickhouse-ffp-1 ns-ezujo clkhouse-ubczqv clickhouse(clickhouse-ffp) Running 0 300m / 300m 2254857830400m / 2254857830400m data:20Gi aks-cicdamdpool-17242166-vmss000001/10.224.0.8 Feb 12,2026 10:26 UTC+0800 clkhouse-ubczqv-clickhouse-mhg-0 ns-ezujo clkhouse-ubczqv clickhouse(clickhouse-mhg) Running 0 300m / 300m 2254857830400m / 2254857830400m data:20Gi aks-cicdamdpool-17242166-vmss000001/10.224.0.8 Feb 12,2026 10:27 UTC+0800 clkhouse-ubczqv-clickhouse-mhg-1 ns-ezujo clkhouse-ubczqv clickhouse(clickhouse-mhg) Running 0 300m / 300m 2254857830400m / 2254857830400m data:20Gi aks-cicdamdpool-17242166-vmss000000/10.224.0.9 Feb 12,2026 10:26 UTC+0800 check pod status done(B  `kubectl get secrets -l app.kubernetes.io/instance=clkhouse-ubczqv`(B  set secret: clkhouse-ubczqv-clickhouse-ffp-account-admin  `kubectl get secrets clkhouse-ubczqv-clickhouse-ffp-account-admin -o jsonpath="{.data.username}"`(B   `kubectl get secrets clkhouse-ubczqv-clickhouse-ffp-account-admin -o jsonpath="{.data.password}"`(B   `kubectl get secrets clkhouse-ubczqv-clickhouse-ffp-account-admin -o jsonpath="{.data.port}"`(B  DB_USERNAME_PROXY:;DB_PASSWORD_PROXY:;DB_PORT_PROXY:8123(B DB_USERNAME:admin;DB_PASSWORD:6Jo7OC5Y67;DB_PORT:9000;DB_DATABASE:default(B check cluster connect  `echo 'clickhouse-client --host clkhouse-ubczqv-clickhouse-ffp.ns-ezujo.svc.cluster.local --port 9000 --user admin --password "6Jo7OC5Y67"' | kubectl exec -it clkhouse-ubczqv-clickhouse-ffp-0 --namespace ns-ezujo -- bash`(B  check cluster connect done(B check ops status  `kbcli cluster list-ops clkhouse-ubczqv --status all --namespace ns-ezujo `(B  NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME clkhouse-ubczqv-verticalscaling-l972f ns-ezujo VerticalScaling clkhouse-ubczqv clickhouse Succeed 4/4 Feb 12,2026 10:26 UTC+0800 check ops status done(B ops_status:clkhouse-ubczqv-verticalscaling-l972f ns-ezujo VerticalScaling clkhouse-ubczqv clickhouse Succeed 4/4 Feb 12,2026 10:26 UTC+0800 (B  `kubectl patch -p '{"metadata":{"finalizers":[]}}' --type=merge opsrequests.operations clkhouse-ubczqv-verticalscaling-l972f --namespace ns-ezujo `(B  opsrequest.operations.kubeblocks.io/clkhouse-ubczqv-verticalscaling-l972f patched  `kbcli cluster delete-ops --name clkhouse-ubczqv-verticalscaling-l972f --force --auto-approve --namespace ns-ezujo `(B  OpsRequest clkhouse-ubczqv-verticalscaling-l972f deleted  `kubectl get secrets -l app.kubernetes.io/instance=clkhouse-ubczqv`(B  set secret: clkhouse-ubczqv-clickhouse-ffp-account-admin  `kubectl get secrets clkhouse-ubczqv-clickhouse-ffp-account-admin -o jsonpath="{.data.username}"`(B   `kubectl get secrets clkhouse-ubczqv-clickhouse-ffp-account-admin -o jsonpath="{.data.password}"`(B   `kubectl get secrets clkhouse-ubczqv-clickhouse-ffp-account-admin -o jsonpath="{.data.port}"`(B  DB_USERNAME_PROXY:;DB_PASSWORD_PROXY:;DB_PORT_PROXY:8123(B DB_USERNAME:admin;DB_PASSWORD:6Jo7OC5Y67;DB_PORT:9000;DB_DATABASE:default(B check db_client batch data count  `echo 'clickhouse-client --host clkhouse-ubczqv-clickhouse-ffp.ns-ezujo.svc.cluster.local --port 9000 --user admin --password "6Jo7OC5Y67" --query "SELECT count(*) FROM executions_loop.executions_loop_table;"' | kubectl exec -it clkhouse-ubczqv-clickhouse-ffp-0 --namespace ns-ezujo -- bash`(B  check db_client batch [337] equal [337] data Success(B cluster restart check cluster status before ops check cluster status done(B cluster_status:Running(B  `kbcli cluster restart clkhouse-ubczqv --auto-approve --force=true --namespace ns-ezujo `(B  OpsRequest clkhouse-ubczqv-restart-gbm74 created successfully, you can view the progress: kbcli cluster describe-ops clkhouse-ubczqv-restart-gbm74 -n ns-ezujo check ops status  `kbcli cluster list-ops clkhouse-ubczqv --status all --namespace ns-ezujo `(B  NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME clkhouse-ubczqv-restart-gbm74 ns-ezujo Restart clkhouse-ubczqv ch-keeper,clickhouse Running 0/7 Feb 12,2026 10:28 UTC+0800 check cluster status  `kbcli cluster list clkhouse-ubczqv --show-labels --namespace ns-ezujo `(B  NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS clkhouse-ubczqv ns-ezujo clickhouse WipeOut Updating Feb 12,2026 10:05 UTC+0800 app.kubernetes.io/instance=clkhouse-ubczqv,clusterdefinition.kubeblocks.io/name=clickhouse cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B  `kubectl get pods -l app.kubernetes.io/instance=clkhouse-ubczqv -n ns-ezujo | (grep 'clkhouse-ubczqv-ch-keeper' || true)`(B  pod "clkhouse-ubczqv-ch-keeper-0" force deleted pod "clkhouse-ubczqv-ch-keeper-1" force deleted pod "clkhouse-ubczqv-ch-keeper-2" force deleted cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B check cluster status done(B cluster_status:Running(B check pod status  `kbcli cluster list-instances clkhouse-ubczqv --namespace ns-ezujo `(B  NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME clkhouse-ubczqv-ch-keeper-0 ns-ezujo clkhouse-ubczqv ch-keeper Running follower 0 200m / 200m 2Gi / 2Gi data:25Gi aks-cicdamdpool-17242166-vmss000003/10.224.0.6 Feb 12,2026 10:33 UTC+0800 clkhouse-ubczqv-ch-keeper-1 ns-ezujo clkhouse-ubczqv ch-keeper Running leader 0 200m / 200m 2Gi / 2Gi data:25Gi aks-cicdamdpool-17242166-vmss000001/10.224.0.8 Feb 12,2026 10:33 UTC+0800 clkhouse-ubczqv-ch-keeper-2 ns-ezujo clkhouse-ubczqv ch-keeper Running follower 0 200m / 200m 2Gi / 2Gi data:25Gi aks-cicdamdpool-17242166-vmss000000/10.224.0.9 Feb 12,2026 10:33 UTC+0800 clkhouse-ubczqv-clickhouse-ffp-0 ns-ezujo clkhouse-ubczqv clickhouse(clickhouse-ffp) Running 0 300m / 300m 2254857830400m / 2254857830400m data:20Gi aks-cicdamdpool-17242166-vmss000001/10.224.0.8 Feb 12,2026 10:31 UTC+0800 clkhouse-ubczqv-clickhouse-ffp-1 ns-ezujo clkhouse-ubczqv clickhouse(clickhouse-ffp) Running 0 300m / 300m 2254857830400m / 2254857830400m data:20Gi aks-cicdamdpool-17242166-vmss000000/10.224.0.9 Feb 12,2026 10:28 UTC+0800 clkhouse-ubczqv-clickhouse-mhg-0 ns-ezujo clkhouse-ubczqv clickhouse(clickhouse-mhg) Running 0 300m / 300m 2254857830400m / 2254857830400m data:20Gi aks-cicdamdpool-17242166-vmss000001/10.224.0.8 Feb 12,2026 10:29 UTC+0800 clkhouse-ubczqv-clickhouse-mhg-1 ns-ezujo clkhouse-ubczqv clickhouse(clickhouse-mhg) Running 0 300m / 300m 2254857830400m / 2254857830400m data:20Gi aks-cicdamdpool-17242166-vmss000000/10.224.0.9 Feb 12,2026 10:28 UTC+0800 check pod status done(B  `kubectl get secrets -l app.kubernetes.io/instance=clkhouse-ubczqv`(B  set secret: clkhouse-ubczqv-clickhouse-ffp-account-admin  `kubectl get secrets clkhouse-ubczqv-clickhouse-ffp-account-admin -o jsonpath="{.data.username}"`(B   `kubectl get secrets clkhouse-ubczqv-clickhouse-ffp-account-admin -o jsonpath="{.data.password}"`(B   `kubectl get secrets clkhouse-ubczqv-clickhouse-ffp-account-admin -o jsonpath="{.data.port}"`(B  DB_USERNAME_PROXY:;DB_PASSWORD_PROXY:;DB_PORT_PROXY:8123(B DB_USERNAME:admin;DB_PASSWORD:6Jo7OC5Y67;DB_PORT:9000;DB_DATABASE:default(B check cluster connect  `echo 'clickhouse-client --host clkhouse-ubczqv-clickhouse-ffp.ns-ezujo.svc.cluster.local --port 9000 --user admin --password "6Jo7OC5Y67"' | kubectl exec -it clkhouse-ubczqv-clickhouse-ffp-0 --namespace ns-ezujo -- bash`(B  check cluster connect done(B check ops status  `kbcli cluster list-ops clkhouse-ubczqv --status all --namespace ns-ezujo `(B  NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME clkhouse-ubczqv-restart-gbm74 ns-ezujo Restart clkhouse-ubczqv ch-keeper,clickhouse Succeed 7/7 Feb 12,2026 10:28 UTC+0800 check ops status done(B ops_status:clkhouse-ubczqv-restart-gbm74 ns-ezujo Restart clkhouse-ubczqv ch-keeper,clickhouse Succeed 7/7 Feb 12,2026 10:28 UTC+0800 (B  `kubectl patch -p '{"metadata":{"finalizers":[]}}' --type=merge opsrequests.operations clkhouse-ubczqv-restart-gbm74 --namespace ns-ezujo `(B  opsrequest.operations.kubeblocks.io/clkhouse-ubczqv-restart-gbm74 patched  `kbcli cluster delete-ops --name clkhouse-ubczqv-restart-gbm74 --force --auto-approve --namespace ns-ezujo `(B  OpsRequest clkhouse-ubczqv-restart-gbm74 deleted  `kubectl get secrets -l app.kubernetes.io/instance=clkhouse-ubczqv`(B  set secret: clkhouse-ubczqv-clickhouse-ffp-account-admin  `kubectl get secrets clkhouse-ubczqv-clickhouse-ffp-account-admin -o jsonpath="{.data.username}"`(B   `kubectl get secrets clkhouse-ubczqv-clickhouse-ffp-account-admin -o jsonpath="{.data.password}"`(B   `kubectl get secrets clkhouse-ubczqv-clickhouse-ffp-account-admin -o jsonpath="{.data.port}"`(B  DB_USERNAME_PROXY:;DB_PASSWORD_PROXY:;DB_PORT_PROXY:8123(B DB_USERNAME:admin;DB_PASSWORD:6Jo7OC5Y67;DB_PORT:9000;DB_DATABASE:default(B check db_client batch data count  `echo 'clickhouse-client --host clkhouse-ubczqv-clickhouse-ffp.ns-ezujo.svc.cluster.local --port 9000 --user admin --password "6Jo7OC5Y67" --query "SELECT count(*) FROM executions_loop.executions_loop_table;"' | kubectl exec -it clkhouse-ubczqv-clickhouse-ffp-0 --namespace ns-ezujo -- bash`(B  check db_client batch [337] equal [337] data Success(B test failover (B check cluster status before cluster-failover- check cluster status done(B cluster_status:Running(B delete pod:clkhouse-ubczqv-clickhouse-ffp-0  `kubectl delete pod clkhouse-ubczqv-clickhouse-ffp-0 --force --namespace ns-ezujo `(B  pod "clkhouse-ubczqv-clickhouse-ffp-0" force deleted check cluster status  `kbcli cluster list clkhouse-ubczqv --show-labels --namespace ns-ezujo `(B  NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS clkhouse-ubczqv ns-ezujo clickhouse WipeOut Updating Feb 12,2026 10:05 UTC+0800 app.kubernetes.io/instance=clkhouse-ubczqv,clusterdefinition.kubeblocks.io/name=clickhouse cluster_status:Updating(B cluster_status:Updating(B check cluster status done(B cluster_status:Running(B check pod status  `kbcli cluster list-instances clkhouse-ubczqv --namespace ns-ezujo `(B  NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME clkhouse-ubczqv-ch-keeper-0 ns-ezujo clkhouse-ubczqv ch-keeper Running follower 0 200m / 200m 2Gi / 2Gi data:25Gi aks-cicdamdpool-17242166-vmss000003/10.224.0.6 Feb 12,2026 10:33 UTC+0800 clkhouse-ubczqv-ch-keeper-1 ns-ezujo clkhouse-ubczqv ch-keeper Running leader 0 200m / 200m 2Gi / 2Gi data:25Gi aks-cicdamdpool-17242166-vmss000001/10.224.0.8 Feb 12,2026 10:33 UTC+0800 clkhouse-ubczqv-ch-keeper-2 ns-ezujo clkhouse-ubczqv ch-keeper Running follower 0 200m / 200m 2Gi / 2Gi data:25Gi aks-cicdamdpool-17242166-vmss000000/10.224.0.9 Feb 12,2026 10:33 UTC+0800 clkhouse-ubczqv-clickhouse-ffp-0 ns-ezujo clkhouse-ubczqv clickhouse(clickhouse-ffp) Running 0 300m / 300m 2254857830400m / 2254857830400m data:20Gi aks-cicdamdpool-17242166-vmss000001/10.224.0.8 Feb 12,2026 10:34 UTC+0800 clkhouse-ubczqv-clickhouse-ffp-1 ns-ezujo clkhouse-ubczqv clickhouse(clickhouse-ffp) Running 0 300m / 300m 2254857830400m / 2254857830400m data:20Gi aks-cicdamdpool-17242166-vmss000000/10.224.0.9 Feb 12,2026 10:28 UTC+0800 clkhouse-ubczqv-clickhouse-mhg-0 ns-ezujo clkhouse-ubczqv clickhouse(clickhouse-mhg) Running 0 300m / 300m 2254857830400m / 2254857830400m data:20Gi aks-cicdamdpool-17242166-vmss000001/10.224.0.8 Feb 12,2026 10:29 UTC+0800 clkhouse-ubczqv-clickhouse-mhg-1 ns-ezujo clkhouse-ubczqv clickhouse(clickhouse-mhg) Running 0 300m / 300m 2254857830400m / 2254857830400m data:20Gi aks-cicdamdpool-17242166-vmss000000/10.224.0.9 Feb 12,2026 10:28 UTC+0800 check pod status done(B  `kubectl get secrets -l app.kubernetes.io/instance=clkhouse-ubczqv`(B  set secret: clkhouse-ubczqv-clickhouse-ffp-account-admin  `kubectl get secrets clkhouse-ubczqv-clickhouse-ffp-account-admin -o jsonpath="{.data.username}"`(B   `kubectl get secrets clkhouse-ubczqv-clickhouse-ffp-account-admin -o jsonpath="{.data.password}"`(B   `kubectl get secrets clkhouse-ubczqv-clickhouse-ffp-account-admin -o jsonpath="{.data.port}"`(B  DB_USERNAME_PROXY:;DB_PASSWORD_PROXY:;DB_PORT_PROXY:8123(B DB_USERNAME:admin;DB_PASSWORD:6Jo7OC5Y67;DB_PORT:9000;DB_DATABASE:default(B check cluster connect  `echo 'clickhouse-client --host clkhouse-ubczqv-clickhouse-ffp.ns-ezujo.svc.cluster.local --port 9000 --user admin --password "6Jo7OC5Y67"' | kubectl exec -it clkhouse-ubczqv-clickhouse-ffp-0 --namespace ns-ezujo -- bash`(B  check cluster connect done(B check failover pod name failover pod name:clkhouse-ubczqv-clickhouse-ffp-0 failover Success(B  `kubectl get secrets -l app.kubernetes.io/instance=clkhouse-ubczqv`(B  set secret: clkhouse-ubczqv-clickhouse-ffp-account-admin  `kubectl get secrets clkhouse-ubczqv-clickhouse-ffp-account-admin -o jsonpath="{.data.username}"`(B   `kubectl get secrets clkhouse-ubczqv-clickhouse-ffp-account-admin -o jsonpath="{.data.password}"`(B   `kubectl get secrets clkhouse-ubczqv-clickhouse-ffp-account-admin -o jsonpath="{.data.port}"`(B  DB_USERNAME_PROXY:;DB_PASSWORD_PROXY:;DB_PORT_PROXY:8123(B DB_USERNAME:admin;DB_PASSWORD:6Jo7OC5Y67;DB_PORT:9000;DB_DATABASE:default(B check db_client batch data count  `echo 'clickhouse-client --host clkhouse-ubczqv-clickhouse-ffp.ns-ezujo.svc.cluster.local --port 9000 --user admin --password "6Jo7OC5Y67" --query "SELECT count(*) FROM executions_loop.executions_loop_table;"' | kubectl exec -it clkhouse-ubczqv-clickhouse-ffp-0 --namespace ns-ezujo -- bash`(B  check db_client batch [337] equal [337] data Success(B cluster restart check cluster status before ops check cluster status done(B cluster_status:Running(B  `kbcli cluster restart clkhouse-ubczqv --auto-approve --force=true --components clickhouse --namespace ns-ezujo `(B  OpsRequest clkhouse-ubczqv-restart-r68zc created successfully, you can view the progress: kbcli cluster describe-ops clkhouse-ubczqv-restart-r68zc -n ns-ezujo check ops status  `kbcli cluster list-ops clkhouse-ubczqv --status all --namespace ns-ezujo `(B  NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME clkhouse-ubczqv-restart-r68zc ns-ezujo Restart clkhouse-ubczqv clickhouse Running 0/4 Feb 12,2026 10:35 UTC+0800 check cluster status  `kbcli cluster list clkhouse-ubczqv --show-labels --namespace ns-ezujo `(B  NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS clkhouse-ubczqv ns-ezujo clickhouse WipeOut Updating Feb 12,2026 10:05 UTC+0800 app.kubernetes.io/instance=clkhouse-ubczqv,clusterdefinition.kubeblocks.io/name=clickhouse cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B check cluster status done(B cluster_status:Running(B check pod status  `kbcli cluster list-instances clkhouse-ubczqv --namespace ns-ezujo `(B  NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME clkhouse-ubczqv-ch-keeper-0 ns-ezujo clkhouse-ubczqv ch-keeper Running follower 0 200m / 200m 2Gi / 2Gi data:25Gi aks-cicdamdpool-17242166-vmss000003/10.224.0.6 Feb 12,2026 10:33 UTC+0800 clkhouse-ubczqv-ch-keeper-1 ns-ezujo clkhouse-ubczqv ch-keeper Running leader 0 200m / 200m 2Gi / 2Gi data:25Gi aks-cicdamdpool-17242166-vmss000001/10.224.0.8 Feb 12,2026 10:33 UTC+0800 clkhouse-ubczqv-ch-keeper-2 ns-ezujo clkhouse-ubczqv ch-keeper Running follower 0 200m / 200m 2Gi / 2Gi data:25Gi aks-cicdamdpool-17242166-vmss000000/10.224.0.9 Feb 12,2026 10:33 UTC+0800 clkhouse-ubczqv-clickhouse-ffp-0 ns-ezujo clkhouse-ubczqv clickhouse(clickhouse-ffp) Running 0 300m / 300m 2254857830400m / 2254857830400m data:20Gi aks-cicdamdpool-17242166-vmss000001/10.224.0.8 Feb 12,2026 10:36 UTC+0800 clkhouse-ubczqv-clickhouse-ffp-1 ns-ezujo clkhouse-ubczqv clickhouse(clickhouse-ffp) Running 0 300m / 300m 2254857830400m / 2254857830400m data:20Gi aks-cicdamdpool-17242166-vmss000000/10.224.0.9 Feb 12,2026 10:35 UTC+0800 clkhouse-ubczqv-clickhouse-mhg-0 ns-ezujo clkhouse-ubczqv clickhouse(clickhouse-mhg) Running 0 300m / 300m 2254857830400m / 2254857830400m data:20Gi aks-cicdamdpool-17242166-vmss000001/10.224.0.8 Feb 12,2026 10:36 UTC+0800 clkhouse-ubczqv-clickhouse-mhg-1 ns-ezujo clkhouse-ubczqv clickhouse(clickhouse-mhg) Running 0 300m / 300m 2254857830400m / 2254857830400m data:20Gi aks-cicdamdpool-17242166-vmss000000/10.224.0.9 Feb 12,2026 10:35 UTC+0800 check pod status done(B  `kubectl get secrets -l app.kubernetes.io/instance=clkhouse-ubczqv`(B  set secret: clkhouse-ubczqv-clickhouse-ffp-account-admin  `kubectl get secrets clkhouse-ubczqv-clickhouse-ffp-account-admin -o jsonpath="{.data.username}"`(B   `kubectl get secrets clkhouse-ubczqv-clickhouse-ffp-account-admin -o jsonpath="{.data.password}"`(B   `kubectl get secrets clkhouse-ubczqv-clickhouse-ffp-account-admin -o jsonpath="{.data.port}"`(B  DB_USERNAME_PROXY:;DB_PASSWORD_PROXY:;DB_PORT_PROXY:8123(B DB_USERNAME:admin;DB_PASSWORD:6Jo7OC5Y67;DB_PORT:9000;DB_DATABASE:default(B check cluster connect  `echo 'clickhouse-client --host clkhouse-ubczqv-clickhouse-ffp.ns-ezujo.svc.cluster.local --port 9000 --user admin --password "6Jo7OC5Y67"' | kubectl exec -it clkhouse-ubczqv-clickhouse-ffp-0 --namespace ns-ezujo -- bash`(B  check cluster connect done(B check ops status  `kbcli cluster list-ops clkhouse-ubczqv --status all --namespace ns-ezujo `(B  NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME clkhouse-ubczqv-restart-r68zc ns-ezujo Restart clkhouse-ubczqv clickhouse Succeed 4/4 Feb 12,2026 10:35 UTC+0800 check ops status done(B ops_status:clkhouse-ubczqv-restart-r68zc ns-ezujo Restart clkhouse-ubczqv clickhouse Succeed 4/4 Feb 12,2026 10:35 UTC+0800 (B  `kubectl patch -p '{"metadata":{"finalizers":[]}}' --type=merge opsrequests.operations clkhouse-ubczqv-restart-r68zc --namespace ns-ezujo `(B  opsrequest.operations.kubeblocks.io/clkhouse-ubczqv-restart-r68zc patched  `kbcli cluster delete-ops --name clkhouse-ubczqv-restart-r68zc --force --auto-approve --namespace ns-ezujo `(B  OpsRequest clkhouse-ubczqv-restart-r68zc deleted  `kubectl get secrets -l app.kubernetes.io/instance=clkhouse-ubczqv`(B  set secret: clkhouse-ubczqv-clickhouse-ffp-account-admin  `kubectl get secrets clkhouse-ubczqv-clickhouse-ffp-account-admin -o jsonpath="{.data.username}"`(B   `kubectl get secrets clkhouse-ubczqv-clickhouse-ffp-account-admin -o jsonpath="{.data.password}"`(B   `kubectl get secrets clkhouse-ubczqv-clickhouse-ffp-account-admin -o jsonpath="{.data.port}"`(B  DB_USERNAME_PROXY:;DB_PASSWORD_PROXY:;DB_PORT_PROXY:8123(B DB_USERNAME:admin;DB_PASSWORD:6Jo7OC5Y67;DB_PORT:9000;DB_DATABASE:default(B check db_client batch data count  `echo 'clickhouse-client --host clkhouse-ubczqv-clickhouse-ffp.ns-ezujo.svc.cluster.local --port 9000 --user admin --password "6Jo7OC5Y67" --query "SELECT count(*) FROM executions_loop.executions_loop_table;"' | kubectl exec -it clkhouse-ubczqv-clickhouse-ffp-0 --namespace ns-ezujo -- bash`(B  check db_client batch [337] equal [337] data Success(B cluster restart check cluster status before ops check cluster status done(B cluster_status:Running(B  `kbcli cluster restart clkhouse-ubczqv --auto-approve --force=true --components ch-keeper --namespace ns-ezujo `(B  OpsRequest clkhouse-ubczqv-restart-xmhjm created successfully, you can view the progress: kbcli cluster describe-ops clkhouse-ubczqv-restart-xmhjm -n ns-ezujo check ops status  `kbcli cluster list-ops clkhouse-ubczqv --status all --namespace ns-ezujo `(B  NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME clkhouse-ubczqv-restart-xmhjm ns-ezujo Restart clkhouse-ubczqv ch-keeper Running 0/3 Feb 12,2026 10:37 UTC+0800 check cluster status  `kbcli cluster list clkhouse-ubczqv --show-labels --namespace ns-ezujo `(B  NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS clkhouse-ubczqv ns-ezujo clickhouse WipeOut Updating Feb 12,2026 10:05 UTC+0800 app.kubernetes.io/instance=clkhouse-ubczqv,clusterdefinition.kubeblocks.io/name=clickhouse cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B check cluster status done(B cluster_status:Running(B check pod status  `kbcli cluster list-instances clkhouse-ubczqv --namespace ns-ezujo `(B  NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME clkhouse-ubczqv-ch-keeper-0 ns-ezujo clkhouse-ubczqv ch-keeper Running follower 0 200m / 200m 2Gi / 2Gi data:25Gi aks-cicdamdpool-17242166-vmss000003/10.224.0.6 Feb 12,2026 10:38 UTC+0800 clkhouse-ubczqv-ch-keeper-1 ns-ezujo clkhouse-ubczqv ch-keeper Running follower 0 200m / 200m 2Gi / 2Gi data:25Gi aks-cicdamdpool-17242166-vmss000001/10.224.0.8 Feb 12,2026 10:38 UTC+0800 clkhouse-ubczqv-ch-keeper-2 ns-ezujo clkhouse-ubczqv ch-keeper Running leader 0 200m / 200m 2Gi / 2Gi data:25Gi aks-cicdamdpool-17242166-vmss000000/10.224.0.9 Feb 12,2026 10:37 UTC+0800 clkhouse-ubczqv-clickhouse-ffp-0 ns-ezujo clkhouse-ubczqv clickhouse(clickhouse-ffp) Running 0 300m / 300m 2254857830400m / 2254857830400m data:20Gi aks-cicdamdpool-17242166-vmss000001/10.224.0.8 Feb 12,2026 10:36 UTC+0800 clkhouse-ubczqv-clickhouse-ffp-1 ns-ezujo clkhouse-ubczqv clickhouse(clickhouse-ffp) Running 0 300m / 300m 2254857830400m / 2254857830400m data:20Gi aks-cicdamdpool-17242166-vmss000000/10.224.0.9 Feb 12,2026 10:35 UTC+0800 clkhouse-ubczqv-clickhouse-mhg-0 ns-ezujo clkhouse-ubczqv clickhouse(clickhouse-mhg) Running 0 300m / 300m 2254857830400m / 2254857830400m data:20Gi aks-cicdamdpool-17242166-vmss000001/10.224.0.8 Feb 12,2026 10:36 UTC+0800 clkhouse-ubczqv-clickhouse-mhg-1 ns-ezujo clkhouse-ubczqv clickhouse(clickhouse-mhg) Running 0 300m / 300m 2254857830400m / 2254857830400m data:20Gi aks-cicdamdpool-17242166-vmss000000/10.224.0.9 Feb 12,2026 10:35 UTC+0800 check pod status done(B  `kubectl get secrets -l app.kubernetes.io/instance=clkhouse-ubczqv`(B  set secret: clkhouse-ubczqv-clickhouse-ffp-account-admin  `kubectl get secrets clkhouse-ubczqv-clickhouse-ffp-account-admin -o jsonpath="{.data.username}"`(B   `kubectl get secrets clkhouse-ubczqv-clickhouse-ffp-account-admin -o jsonpath="{.data.password}"`(B   `kubectl get secrets clkhouse-ubczqv-clickhouse-ffp-account-admin -o jsonpath="{.data.port}"`(B  DB_USERNAME_PROXY:;DB_PASSWORD_PROXY:;DB_PORT_PROXY:8123(B DB_USERNAME:admin;DB_PASSWORD:6Jo7OC5Y67;DB_PORT:9000;DB_DATABASE:default(B check cluster connect  `echo 'clickhouse-client --host clkhouse-ubczqv-clickhouse-ffp.ns-ezujo.svc.cluster.local --port 9000 --user admin --password "6Jo7OC5Y67"' | kubectl exec -it clkhouse-ubczqv-clickhouse-ffp-0 --namespace ns-ezujo -- bash`(B  check cluster connect done(B check ops status  `kbcli cluster list-ops clkhouse-ubczqv --status all --namespace ns-ezujo `(B  NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME clkhouse-ubczqv-restart-xmhjm ns-ezujo Restart clkhouse-ubczqv ch-keeper Succeed 3/3 Feb 12,2026 10:37 UTC+0800 check ops status done(B ops_status:clkhouse-ubczqv-restart-xmhjm ns-ezujo Restart clkhouse-ubczqv ch-keeper Succeed 3/3 Feb 12,2026 10:37 UTC+0800 (B  `kubectl patch -p '{"metadata":{"finalizers":[]}}' --type=merge opsrequests.operations clkhouse-ubczqv-restart-xmhjm --namespace ns-ezujo `(B  opsrequest.operations.kubeblocks.io/clkhouse-ubczqv-restart-xmhjm patched  `kbcli cluster delete-ops --name clkhouse-ubczqv-restart-xmhjm --force --auto-approve --namespace ns-ezujo `(B  OpsRequest clkhouse-ubczqv-restart-xmhjm deleted  `kubectl get secrets -l app.kubernetes.io/instance=clkhouse-ubczqv`(B  set secret: clkhouse-ubczqv-clickhouse-ffp-account-admin  `kubectl get secrets clkhouse-ubczqv-clickhouse-ffp-account-admin -o jsonpath="{.data.username}"`(B   `kubectl get secrets clkhouse-ubczqv-clickhouse-ffp-account-admin -o jsonpath="{.data.password}"`(B   `kubectl get secrets clkhouse-ubczqv-clickhouse-ffp-account-admin -o jsonpath="{.data.port}"`(B  DB_USERNAME_PROXY:;DB_PASSWORD_PROXY:;DB_PORT_PROXY:8123(B DB_USERNAME:admin;DB_PASSWORD:6Jo7OC5Y67;DB_PORT:9000;DB_DATABASE:default(B check db_client batch data count  `echo 'clickhouse-client --host clkhouse-ubczqv-clickhouse-ffp.ns-ezujo.svc.cluster.local --port 9000 --user admin --password "6Jo7OC5Y67" --query "SELECT count(*) FROM executions_loop.executions_loop_table;"' | kubectl exec -it clkhouse-ubczqv-clickhouse-ffp-0 --namespace ns-ezujo -- bash`(B  check db_client batch [337] equal [337] data Success(B cluster stop check cluster status before ops check cluster status done(B cluster_status:Running(B  `kbcli cluster stop clkhouse-ubczqv --auto-approve --force=true --namespace ns-ezujo `(B  OpsRequest clkhouse-ubczqv-stop-tmzbl created successfully, you can view the progress: kbcli cluster describe-ops clkhouse-ubczqv-stop-tmzbl -n ns-ezujo check ops status  `kbcli cluster list-ops clkhouse-ubczqv --status all --namespace ns-ezujo `(B  NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME clkhouse-ubczqv-stop-tmzbl ns-ezujo Stop clkhouse-ubczqv ch-keeper,clickhouse Running 0/7 Feb 12,2026 10:39 UTC+0800 check cluster status  `kbcli cluster list clkhouse-ubczqv --show-labels --namespace ns-ezujo `(B  NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS clkhouse-ubczqv ns-ezujo clickhouse WipeOut Stopping Feb 12,2026 10:05 UTC+0800 app.kubernetes.io/instance=clkhouse-ubczqv,clusterdefinition.kubeblocks.io/name=clickhouse cluster_status:Stopping(B cluster_status:Stopping(B cluster_status:Stopping(B cluster_status:Stopping(B cluster_status:Stopping(B cluster_status:Stopping(B cluster_status:Stopping(B cluster_status:Stopping(B cluster_status:Stopping(B cluster_status:Stopping(B check cluster status done(B cluster_status:Stopped(B check pod status  `kbcli cluster list-instances clkhouse-ubczqv --namespace ns-ezujo `(B  NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME check pod status done(B check ops status  `kbcli cluster list-ops clkhouse-ubczqv --status all --namespace ns-ezujo `(B  NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME clkhouse-ubczqv-stop-tmzbl ns-ezujo Stop clkhouse-ubczqv ch-keeper,clickhouse Succeed 7/7 Feb 12,2026 10:39 UTC+0800 check ops status done(B ops_status:clkhouse-ubczqv-stop-tmzbl ns-ezujo Stop clkhouse-ubczqv ch-keeper,clickhouse Succeed 7/7 Feb 12,2026 10:39 UTC+0800 (B  `kubectl patch -p '{"metadata":{"finalizers":[]}}' --type=merge opsrequests.operations clkhouse-ubczqv-stop-tmzbl --namespace ns-ezujo `(B  opsrequest.operations.kubeblocks.io/clkhouse-ubczqv-stop-tmzbl patched  `kbcli cluster delete-ops --name clkhouse-ubczqv-stop-tmzbl --force --auto-approve --namespace ns-ezujo `(B  OpsRequest clkhouse-ubczqv-stop-tmzbl deleted cluster start check cluster status before ops check cluster status done(B cluster_status:Stopped(B  `kbcli cluster start clkhouse-ubczqv --force=true --namespace ns-ezujo `(B  OpsRequest clkhouse-ubczqv-start-jdqcf created successfully, you can view the progress: kbcli cluster describe-ops clkhouse-ubczqv-start-jdqcf -n ns-ezujo check ops status  `kbcli cluster list-ops clkhouse-ubczqv --status all --namespace ns-ezujo `(B  NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME clkhouse-ubczqv-start-jdqcf ns-ezujo Start clkhouse-ubczqv ch-keeper,clickhouse Running 0/7 Feb 12,2026 10:40 UTC+0800 check cluster status  `kbcli cluster list clkhouse-ubczqv --show-labels --namespace ns-ezujo `(B  NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS clkhouse-ubczqv ns-ezujo clickhouse WipeOut Updating Feb 12,2026 10:05 UTC+0800 app.kubernetes.io/instance=clkhouse-ubczqv,clusterdefinition.kubeblocks.io/name=clickhouse cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B check cluster status done(B cluster_status:Running(B check pod status  `kbcli cluster list-instances clkhouse-ubczqv --namespace ns-ezujo `(B  NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME clkhouse-ubczqv-ch-keeper-0 ns-ezujo clkhouse-ubczqv ch-keeper Running follower 0 200m / 200m 2Gi / 2Gi data:25Gi aks-cicdamdpool-17242166-vmss000003/10.224.0.6 Feb 12,2026 10:40 UTC+0800 clkhouse-ubczqv-ch-keeper-1 ns-ezujo clkhouse-ubczqv ch-keeper Running leader 0 200m / 200m 2Gi / 2Gi data:25Gi aks-cicdamdpool-17242166-vmss000000/10.224.0.9 Feb 12,2026 10:40 UTC+0800 clkhouse-ubczqv-ch-keeper-2 ns-ezujo clkhouse-ubczqv ch-keeper Running follower 0 200m / 200m 2Gi / 2Gi data:25Gi aks-cicdamdpool-17242166-vmss000001/10.224.0.8 Feb 12,2026 10:40 UTC+0800 clkhouse-ubczqv-clickhouse-ffp-0 ns-ezujo clkhouse-ubczqv clickhouse(clickhouse-ffp) Running 0 300m / 300m 2254857830400m / 2254857830400m data:20Gi aks-cicdamdpool-17242166-vmss000001/10.224.0.8 Feb 12,2026 10:40 UTC+0800 clkhouse-ubczqv-clickhouse-ffp-1 ns-ezujo clkhouse-ubczqv clickhouse(clickhouse-ffp) Running 0 300m / 300m 2254857830400m / 2254857830400m data:20Gi aks-cicdamdpool-17242166-vmss000000/10.224.0.9 Feb 12,2026 10:40 UTC+0800 clkhouse-ubczqv-clickhouse-mhg-0 ns-ezujo clkhouse-ubczqv clickhouse(clickhouse-mhg) Running 0 300m / 300m 2254857830400m / 2254857830400m data:20Gi aks-cicdamdpool-17242166-vmss000000/10.224.0.9 Feb 12,2026 10:40 UTC+0800 clkhouse-ubczqv-clickhouse-mhg-1 ns-ezujo clkhouse-ubczqv clickhouse(clickhouse-mhg) Running 0 300m / 300m 2254857830400m / 2254857830400m data:20Gi aks-cicdamdpool-17242166-vmss000001/10.224.0.8 Feb 12,2026 10:40 UTC+0800 check pod status done(B  `kubectl get secrets -l app.kubernetes.io/instance=clkhouse-ubczqv`(B  set secret: clkhouse-ubczqv-clickhouse-ffp-account-admin  `kubectl get secrets clkhouse-ubczqv-clickhouse-ffp-account-admin -o jsonpath="{.data.username}"`(B   `kubectl get secrets clkhouse-ubczqv-clickhouse-ffp-account-admin -o jsonpath="{.data.password}"`(B   `kubectl get secrets clkhouse-ubczqv-clickhouse-ffp-account-admin -o jsonpath="{.data.port}"`(B  DB_USERNAME_PROXY:;DB_PASSWORD_PROXY:;DB_PORT_PROXY:8123(B DB_USERNAME:admin;DB_PASSWORD:6Jo7OC5Y67;DB_PORT:9000;DB_DATABASE:default(B check cluster connect  `echo 'clickhouse-client --host clkhouse-ubczqv-clickhouse-ffp.ns-ezujo.svc.cluster.local --port 9000 --user admin --password "6Jo7OC5Y67"' | kubectl exec -it clkhouse-ubczqv-clickhouse-ffp-0 --namespace ns-ezujo -- bash`(B  check cluster connect done(B check ops status  `kbcli cluster list-ops clkhouse-ubczqv --status all --namespace ns-ezujo `(B  NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME clkhouse-ubczqv-start-jdqcf ns-ezujo Start clkhouse-ubczqv ch-keeper,clickhouse Succeed 7/7 Feb 12,2026 10:40 UTC+0800 check ops status done(B ops_status:clkhouse-ubczqv-start-jdqcf ns-ezujo Start clkhouse-ubczqv ch-keeper,clickhouse Succeed 7/7 Feb 12,2026 10:40 UTC+0800 (B  `kubectl patch -p '{"metadata":{"finalizers":[]}}' --type=merge opsrequests.operations clkhouse-ubczqv-start-jdqcf --namespace ns-ezujo `(B  opsrequest.operations.kubeblocks.io/clkhouse-ubczqv-start-jdqcf patched  `kbcli cluster delete-ops --name clkhouse-ubczqv-start-jdqcf --force --auto-approve --namespace ns-ezujo `(B  OpsRequest clkhouse-ubczqv-start-jdqcf deleted  `kubectl get secrets -l app.kubernetes.io/instance=clkhouse-ubczqv`(B  set secret: clkhouse-ubczqv-clickhouse-ffp-account-admin  `kubectl get secrets clkhouse-ubczqv-clickhouse-ffp-account-admin -o jsonpath="{.data.username}"`(B   `kubectl get secrets clkhouse-ubczqv-clickhouse-ffp-account-admin -o jsonpath="{.data.password}"`(B   `kubectl get secrets clkhouse-ubczqv-clickhouse-ffp-account-admin -o jsonpath="{.data.port}"`(B  DB_USERNAME_PROXY:;DB_PASSWORD_PROXY:;DB_PORT_PROXY:8123(B DB_USERNAME:admin;DB_PASSWORD:6Jo7OC5Y67;DB_PORT:9000;DB_DATABASE:default(B check db_client batch data count  `echo 'clickhouse-client --host clkhouse-ubczqv-clickhouse-ffp.ns-ezujo.svc.cluster.local --port 9000 --user admin --password "6Jo7OC5Y67" --query "SELECT count(*) FROM executions_loop.executions_loop_table;"' | kubectl exec -it clkhouse-ubczqv-clickhouse-ffp-0 --namespace ns-ezujo -- bash`(B  check db_client batch [337] equal [337] data Success(B cluster clickhouse scale-out cluster clickhouse scale-out replicas: 4 check cluster status before ops check cluster status done(B cluster_status:Running(B  `kbcli cluster scale-out clkhouse-ubczqv --auto-approve --force=true --components clickhouse --replicas 2 --namespace ns-ezujo `(B  OpsRequest clkhouse-ubczqv-horizontalscaling-pr4jn created successfully, you can view the progress: kbcli cluster describe-ops clkhouse-ubczqv-horizontalscaling-pr4jn -n ns-ezujo check ops status  `kbcli cluster list-ops clkhouse-ubczqv --status all --namespace ns-ezujo `(B  NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME clkhouse-ubczqv-horizontalscaling-pr4jn ns-ezujo HorizontalScaling clkhouse-ubczqv clickhouse Running 0/4 Feb 12,2026 10:53 UTC+0800 check cluster status  `kbcli cluster list clkhouse-ubczqv --show-labels --namespace ns-ezujo `(B  NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS clkhouse-ubczqv ns-ezujo clickhouse WipeOut Updating Feb 12,2026 10:05 UTC+0800 app.kubernetes.io/instance=clkhouse-ubczqv,clusterdefinition.kubeblocks.io/name=clickhouse cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B check cluster status done(B cluster_status:Running(B check pod status  `kbcli cluster list-instances clkhouse-ubczqv --namespace ns-ezujo `(B  NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME clkhouse-ubczqv-ch-keeper-0 ns-ezujo clkhouse-ubczqv ch-keeper Running follower 0 200m / 200m 2Gi / 2Gi data:25Gi aks-cicdamdpool-17242166-vmss000003/10.224.0.6 Feb 12,2026 10:40 UTC+0800 clkhouse-ubczqv-ch-keeper-1 ns-ezujo clkhouse-ubczqv ch-keeper Running leader 0 200m / 200m 2Gi / 2Gi data:25Gi aks-cicdamdpool-17242166-vmss000000/10.224.0.9 Feb 12,2026 10:40 UTC+0800 clkhouse-ubczqv-ch-keeper-2 ns-ezujo clkhouse-ubczqv ch-keeper Running follower 0 200m / 200m 2Gi / 2Gi data:25Gi aks-cicdamdpool-17242166-vmss000001/10.224.0.8 Feb 12,2026 10:40 UTC+0800 clkhouse-ubczqv-clickhouse-ffp-0 ns-ezujo clkhouse-ubczqv clickhouse(clickhouse-ffp) Running 0 300m / 300m 2254857830400m / 2254857830400m data:20Gi aks-cicdamdpool-17242166-vmss000001/10.224.0.8 Feb 12,2026 10:40 UTC+0800 clkhouse-ubczqv-clickhouse-ffp-1 ns-ezujo clkhouse-ubczqv clickhouse(clickhouse-ffp) Running 0 300m / 300m 2254857830400m / 2254857830400m data:20Gi aks-cicdamdpool-17242166-vmss000000/10.224.0.9 Feb 12,2026 10:40 UTC+0800 clkhouse-ubczqv-clickhouse-ffp-2 ns-ezujo clkhouse-ubczqv clickhouse(clickhouse-ffp) Running 0 300m / 300m 2254857830400m / 2254857830400m data:20Gi aks-cicdamdpool-17242166-vmss000003/10.224.0.6 Feb 12,2026 10:53 UTC+0800 clkhouse-ubczqv-clickhouse-ffp-3 ns-ezujo clkhouse-ubczqv clickhouse(clickhouse-ffp) Running 0 300m / 300m 2254857830400m / 2254857830400m data:20Gi aks-cicdamdpool-17242166-vmss000000/10.224.0.9 Feb 12,2026 10:53 UTC+0800 clkhouse-ubczqv-clickhouse-mhg-0 ns-ezujo clkhouse-ubczqv clickhouse(clickhouse-mhg) Running 0 300m / 300m 2254857830400m / 2254857830400m data:20Gi aks-cicdamdpool-17242166-vmss000000/10.224.0.9 Feb 12,2026 10:40 UTC+0800 clkhouse-ubczqv-clickhouse-mhg-1 ns-ezujo clkhouse-ubczqv clickhouse(clickhouse-mhg) Running 0 300m / 300m 2254857830400m / 2254857830400m data:20Gi aks-cicdamdpool-17242166-vmss000001/10.224.0.8 Feb 12,2026 10:40 UTC+0800 clkhouse-ubczqv-clickhouse-mhg-2 ns-ezujo clkhouse-ubczqv clickhouse(clickhouse-mhg) Running 0 300m / 300m 2254857830400m / 2254857830400m data:20Gi aks-cicdamdpool-17242166-vmss000003/10.224.0.6 Feb 12,2026 10:53 UTC+0800 clkhouse-ubczqv-clickhouse-mhg-3 ns-ezujo clkhouse-ubczqv clickhouse(clickhouse-mhg) Running 0 300m / 300m 2254857830400m / 2254857830400m data:20Gi aks-cicdamdpool-17242166-vmss000003/10.224.0.6 Feb 12,2026 10:53 UTC+0800 check pod status done(B  `kubectl get secrets -l app.kubernetes.io/instance=clkhouse-ubczqv`(B  set secret: clkhouse-ubczqv-clickhouse-ffp-account-admin  `kubectl get secrets clkhouse-ubczqv-clickhouse-ffp-account-admin -o jsonpath="{.data.username}"`(B   `kubectl get secrets clkhouse-ubczqv-clickhouse-ffp-account-admin -o jsonpath="{.data.password}"`(B   `kubectl get secrets clkhouse-ubczqv-clickhouse-ffp-account-admin -o jsonpath="{.data.port}"`(B  DB_USERNAME_PROXY:;DB_PASSWORD_PROXY:;DB_PORT_PROXY:8123(B DB_USERNAME:admin;DB_PASSWORD:6Jo7OC5Y67;DB_PORT:9000;DB_DATABASE:default(B check cluster connect  `echo 'clickhouse-client --host clkhouse-ubczqv-clickhouse-ffp.ns-ezujo.svc.cluster.local --port 9000 --user admin --password "6Jo7OC5Y67"' | kubectl exec -it clkhouse-ubczqv-clickhouse-ffp-0 --namespace ns-ezujo -- bash`(B  check cluster connect done(B check ops status  `kbcli cluster list-ops clkhouse-ubczqv --status all --namespace ns-ezujo `(B  NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME clkhouse-ubczqv-horizontalscaling-pr4jn ns-ezujo HorizontalScaling clkhouse-ubczqv clickhouse Succeed 4/4 Feb 12,2026 10:53 UTC+0800 check ops status done(B ops_status:clkhouse-ubczqv-horizontalscaling-pr4jn ns-ezujo HorizontalScaling clkhouse-ubczqv clickhouse Succeed 4/4 Feb 12,2026 10:53 UTC+0800 (B  `kubectl patch -p '{"metadata":{"finalizers":[]}}' --type=merge opsrequests.operations clkhouse-ubczqv-horizontalscaling-pr4jn --namespace ns-ezujo `(B  opsrequest.operations.kubeblocks.io/clkhouse-ubczqv-horizontalscaling-pr4jn patched  `kbcli cluster delete-ops --name clkhouse-ubczqv-horizontalscaling-pr4jn --force --auto-approve --namespace ns-ezujo `(B  OpsRequest clkhouse-ubczqv-horizontalscaling-pr4jn deleted  `kubectl get secrets -l app.kubernetes.io/instance=clkhouse-ubczqv`(B  set secret: clkhouse-ubczqv-clickhouse-ffp-account-admin  `kubectl get secrets clkhouse-ubczqv-clickhouse-ffp-account-admin -o jsonpath="{.data.username}"`(B   `kubectl get secrets clkhouse-ubczqv-clickhouse-ffp-account-admin -o jsonpath="{.data.password}"`(B   `kubectl get secrets clkhouse-ubczqv-clickhouse-ffp-account-admin -o jsonpath="{.data.port}"`(B  DB_USERNAME_PROXY:;DB_PASSWORD_PROXY:;DB_PORT_PROXY:8123(B DB_USERNAME:admin;DB_PASSWORD:6Jo7OC5Y67;DB_PORT:9000;DB_DATABASE:default(B check db_client batch data count  `echo 'clickhouse-client --host clkhouse-ubczqv-clickhouse-ffp.ns-ezujo.svc.cluster.local --port 9000 --user admin --password "6Jo7OC5Y67" --query "SELECT count(*) FROM executions_loop.executions_loop_table;"' | kubectl exec -it clkhouse-ubczqv-clickhouse-ffp-0 --namespace ns-ezujo -- bash`(B  check db_client batch [337] equal [337] data Success(B cluster clickhouse scale-in cluster clickhouse scale-in replicas: 2 check cluster status before ops check cluster status done(B cluster_status:Running(B  `kbcli cluster scale-in clkhouse-ubczqv --auto-approve --force=true --components clickhouse --replicas 2 --namespace ns-ezujo `(B  OpsRequest clkhouse-ubczqv-horizontalscaling-lf9ww created successfully, you can view the progress: kbcli cluster describe-ops clkhouse-ubczqv-horizontalscaling-lf9ww -n ns-ezujo check ops status  `kbcli cluster list-ops clkhouse-ubczqv --status all --namespace ns-ezujo `(B  NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME clkhouse-ubczqv-horizontalscaling-lf9ww ns-ezujo HorizontalScaling clkhouse-ubczqv clickhouse Running 0/4 Feb 12,2026 10:54 UTC+0800 check cluster status  `kbcli cluster list clkhouse-ubczqv --show-labels --namespace ns-ezujo `(B  NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS clkhouse-ubczqv ns-ezujo clickhouse WipeOut Running Feb 12,2026 10:05 UTC+0800 app.kubernetes.io/instance=clkhouse-ubczqv,clusterdefinition.kubeblocks.io/name=clickhouse check cluster status done(B cluster_status:Running(B check pod status  `kbcli cluster list-instances clkhouse-ubczqv --namespace ns-ezujo `(B  NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME clkhouse-ubczqv-ch-keeper-0 ns-ezujo clkhouse-ubczqv ch-keeper Running follower 0 200m / 200m 2Gi / 2Gi data:25Gi aks-cicdamdpool-17242166-vmss000003/10.224.0.6 Feb 12,2026 10:40 UTC+0800 clkhouse-ubczqv-ch-keeper-1 ns-ezujo clkhouse-ubczqv ch-keeper Running leader 0 200m / 200m 2Gi / 2Gi data:25Gi aks-cicdamdpool-17242166-vmss000000/10.224.0.9 Feb 12,2026 10:40 UTC+0800 clkhouse-ubczqv-ch-keeper-2 ns-ezujo clkhouse-ubczqv ch-keeper Running follower 0 200m / 200m 2Gi / 2Gi data:25Gi aks-cicdamdpool-17242166-vmss000001/10.224.0.8 Feb 12,2026 10:40 UTC+0800 clkhouse-ubczqv-clickhouse-ffp-0 ns-ezujo clkhouse-ubczqv clickhouse(clickhouse-ffp) Running 0 300m / 300m 2254857830400m / 2254857830400m data:20Gi aks-cicdamdpool-17242166-vmss000001/10.224.0.8 Feb 12,2026 10:40 UTC+0800 clkhouse-ubczqv-clickhouse-ffp-1 ns-ezujo clkhouse-ubczqv clickhouse(clickhouse-ffp) Running 0 300m / 300m 2254857830400m / 2254857830400m data:20Gi aks-cicdamdpool-17242166-vmss000000/10.224.0.9 Feb 12,2026 10:40 UTC+0800 clkhouse-ubczqv-clickhouse-mhg-0 ns-ezujo clkhouse-ubczqv clickhouse(clickhouse-mhg) Running 0 300m / 300m 2254857830400m / 2254857830400m data:20Gi aks-cicdamdpool-17242166-vmss000000/10.224.0.9 Feb 12,2026 10:40 UTC+0800 clkhouse-ubczqv-clickhouse-mhg-1 ns-ezujo clkhouse-ubczqv clickhouse(clickhouse-mhg) Running 0 300m / 300m 2254857830400m / 2254857830400m data:20Gi aks-cicdamdpool-17242166-vmss000001/10.224.0.8 Feb 12,2026 10:40 UTC+0800 check pod status done(B  `kubectl get secrets -l app.kubernetes.io/instance=clkhouse-ubczqv`(B  set secret: clkhouse-ubczqv-clickhouse-ffp-account-admin  `kubectl get secrets clkhouse-ubczqv-clickhouse-ffp-account-admin -o jsonpath="{.data.username}"`(B   `kubectl get secrets clkhouse-ubczqv-clickhouse-ffp-account-admin -o jsonpath="{.data.password}"`(B   `kubectl get secrets clkhouse-ubczqv-clickhouse-ffp-account-admin -o jsonpath="{.data.port}"`(B  DB_USERNAME_PROXY:;DB_PASSWORD_PROXY:;DB_PORT_PROXY:8123(B DB_USERNAME:admin;DB_PASSWORD:6Jo7OC5Y67;DB_PORT:9000;DB_DATABASE:default(B check cluster connect  `echo 'clickhouse-client --host clkhouse-ubczqv-clickhouse-ffp.ns-ezujo.svc.cluster.local --port 9000 --user admin --password "6Jo7OC5Y67"' | kubectl exec -it clkhouse-ubczqv-clickhouse-ffp-0 --namespace ns-ezujo -- bash`(B  check cluster connect done(B check ops status  `kbcli cluster list-ops clkhouse-ubczqv --status all --namespace ns-ezujo `(B  NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME clkhouse-ubczqv-horizontalscaling-lf9ww ns-ezujo HorizontalScaling clkhouse-ubczqv clickhouse Succeed 4/4 Feb 12,2026 10:54 UTC+0800 check ops status done(B ops_status:clkhouse-ubczqv-horizontalscaling-lf9ww ns-ezujo HorizontalScaling clkhouse-ubczqv clickhouse Succeed 4/4 Feb 12,2026 10:54 UTC+0800 (B  `kubectl patch -p '{"metadata":{"finalizers":[]}}' --type=merge opsrequests.operations clkhouse-ubczqv-horizontalscaling-lf9ww --namespace ns-ezujo `(B  opsrequest.operations.kubeblocks.io/clkhouse-ubczqv-horizontalscaling-lf9ww patched  `kbcli cluster delete-ops --name clkhouse-ubczqv-horizontalscaling-lf9ww --force --auto-approve --namespace ns-ezujo `(B  OpsRequest clkhouse-ubczqv-horizontalscaling-lf9ww deleted  `kubectl get secrets -l app.kubernetes.io/instance=clkhouse-ubczqv`(B  set secret: clkhouse-ubczqv-clickhouse-ffp-account-admin  `kubectl get secrets clkhouse-ubczqv-clickhouse-ffp-account-admin -o jsonpath="{.data.username}"`(B   `kubectl get secrets clkhouse-ubczqv-clickhouse-ffp-account-admin -o jsonpath="{.data.password}"`(B   `kubectl get secrets clkhouse-ubczqv-clickhouse-ffp-account-admin -o jsonpath="{.data.port}"`(B  DB_USERNAME_PROXY:;DB_PASSWORD_PROXY:;DB_PORT_PROXY:8123(B DB_USERNAME:admin;DB_PASSWORD:6Jo7OC5Y67;DB_PORT:9000;DB_DATABASE:default(B check db_client batch data count  `echo 'clickhouse-client --host clkhouse-ubczqv-clickhouse-ffp.ns-ezujo.svc.cluster.local --port 9000 --user admin --password "6Jo7OC5Y67" --query "SELECT count(*) FROM executions_loop.executions_loop_table;"' | kubectl exec -it clkhouse-ubczqv-clickhouse-ffp-0 --namespace ns-ezujo -- bash`(B  check db_client batch [337] equal [337] data Success(B check cluster status before ops check cluster status done(B cluster_status:Running(B  `kbcli cluster vscale clkhouse-ubczqv --auto-approve --force=true --components ch-keeper --cpu 300m --memory 2.1Gi --namespace ns-ezujo `(B  OpsRequest clkhouse-ubczqv-verticalscaling-qp72p created successfully, you can view the progress: kbcli cluster describe-ops clkhouse-ubczqv-verticalscaling-qp72p -n ns-ezujo check ops status  `kbcli cluster list-ops clkhouse-ubczqv --status all --namespace ns-ezujo `(B  NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME clkhouse-ubczqv-verticalscaling-qp72p ns-ezujo VerticalScaling clkhouse-ubczqv ch-keeper Running 0/3 Feb 12,2026 10:55 UTC+0800 check cluster status  `kbcli cluster list clkhouse-ubczqv --show-labels --namespace ns-ezujo `(B  NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS clkhouse-ubczqv ns-ezujo clickhouse WipeOut Updating Feb 12,2026 10:05 UTC+0800 app.kubernetes.io/instance=clkhouse-ubczqv,clusterdefinition.kubeblocks.io/name=clickhouse cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B check cluster status done(B cluster_status:Running(B check pod status  `kbcli cluster list-instances clkhouse-ubczqv --namespace ns-ezujo `(B  NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME clkhouse-ubczqv-ch-keeper-0 ns-ezujo clkhouse-ubczqv ch-keeper Running follower 0 300m / 300m 2254857830400m / 2254857830400m data:25Gi aks-cicdamdpool-17242166-vmss000003/10.224.0.6 Feb 12,2026 10:56 UTC+0800 clkhouse-ubczqv-ch-keeper-1 ns-ezujo clkhouse-ubczqv ch-keeper Running follower 0 300m / 300m 2254857830400m / 2254857830400m data:25Gi aks-cicdamdpool-17242166-vmss000000/10.224.0.9 Feb 12,2026 10:57 UTC+0800 clkhouse-ubczqv-ch-keeper-2 ns-ezujo clkhouse-ubczqv ch-keeper Running leader 0 300m / 300m 2254857830400m / 2254857830400m data:25Gi aks-cicdamdpool-17242166-vmss000001/10.224.0.8 Feb 12,2026 10:55 UTC+0800 clkhouse-ubczqv-clickhouse-ffp-0 ns-ezujo clkhouse-ubczqv clickhouse(clickhouse-ffp) Running 0 300m / 300m 2254857830400m / 2254857830400m data:20Gi aks-cicdamdpool-17242166-vmss000001/10.224.0.8 Feb 12,2026 10:40 UTC+0800 clkhouse-ubczqv-clickhouse-ffp-1 ns-ezujo clkhouse-ubczqv clickhouse(clickhouse-ffp) Running 0 300m / 300m 2254857830400m / 2254857830400m data:20Gi aks-cicdamdpool-17242166-vmss000000/10.224.0.9 Feb 12,2026 10:40 UTC+0800 clkhouse-ubczqv-clickhouse-mhg-0 ns-ezujo clkhouse-ubczqv clickhouse(clickhouse-mhg) Running 0 300m / 300m 2254857830400m / 2254857830400m data:20Gi aks-cicdamdpool-17242166-vmss000000/10.224.0.9 Feb 12,2026 10:40 UTC+0800 clkhouse-ubczqv-clickhouse-mhg-1 ns-ezujo clkhouse-ubczqv clickhouse(clickhouse-mhg) Running 0 300m / 300m 2254857830400m / 2254857830400m data:20Gi aks-cicdamdpool-17242166-vmss000001/10.224.0.8 Feb 12,2026 10:40 UTC+0800 check pod status done(B  `kubectl get secrets -l app.kubernetes.io/instance=clkhouse-ubczqv`(B  set secret: clkhouse-ubczqv-clickhouse-ffp-account-admin  `kubectl get secrets clkhouse-ubczqv-clickhouse-ffp-account-admin -o jsonpath="{.data.username}"`(B   `kubectl get secrets clkhouse-ubczqv-clickhouse-ffp-account-admin -o jsonpath="{.data.password}"`(B   `kubectl get secrets clkhouse-ubczqv-clickhouse-ffp-account-admin -o jsonpath="{.data.port}"`(B  DB_USERNAME_PROXY:;DB_PASSWORD_PROXY:;DB_PORT_PROXY:8123(B DB_USERNAME:admin;DB_PASSWORD:6Jo7OC5Y67;DB_PORT:9000;DB_DATABASE:default(B check cluster connect  `echo 'clickhouse-client --host clkhouse-ubczqv-clickhouse-ffp.ns-ezujo.svc.cluster.local --port 9000 --user admin --password "6Jo7OC5Y67"' | kubectl exec -it clkhouse-ubczqv-clickhouse-ffp-0 --namespace ns-ezujo -- bash`(B  check cluster connect done(B check ops status  `kbcli cluster list-ops clkhouse-ubczqv --status all --namespace ns-ezujo `(B  NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME clkhouse-ubczqv-verticalscaling-qp72p ns-ezujo VerticalScaling clkhouse-ubczqv ch-keeper Succeed 3/3 Feb 12,2026 10:55 UTC+0800 check ops status done(B ops_status:clkhouse-ubczqv-verticalscaling-qp72p ns-ezujo VerticalScaling clkhouse-ubczqv ch-keeper Succeed 3/3 Feb 12,2026 10:55 UTC+0800 (B  `kubectl patch -p '{"metadata":{"finalizers":[]}}' --type=merge opsrequests.operations clkhouse-ubczqv-verticalscaling-qp72p --namespace ns-ezujo `(B  opsrequest.operations.kubeblocks.io/clkhouse-ubczqv-verticalscaling-qp72p patched  `kbcli cluster delete-ops --name clkhouse-ubczqv-verticalscaling-qp72p --force --auto-approve --namespace ns-ezujo `(B  OpsRequest clkhouse-ubczqv-verticalscaling-qp72p deleted  `kubectl get secrets -l app.kubernetes.io/instance=clkhouse-ubczqv`(B  set secret: clkhouse-ubczqv-clickhouse-ffp-account-admin  `kubectl get secrets clkhouse-ubczqv-clickhouse-ffp-account-admin -o jsonpath="{.data.username}"`(B   `kubectl get secrets clkhouse-ubczqv-clickhouse-ffp-account-admin -o jsonpath="{.data.password}"`(B   `kubectl get secrets clkhouse-ubczqv-clickhouse-ffp-account-admin -o jsonpath="{.data.port}"`(B  DB_USERNAME_PROXY:;DB_PASSWORD_PROXY:;DB_PORT_PROXY:8123(B DB_USERNAME:admin;DB_PASSWORD:6Jo7OC5Y67;DB_PORT:9000;DB_DATABASE:default(B check db_client batch data count  `echo 'clickhouse-client --host clkhouse-ubczqv-clickhouse-ffp.ns-ezujo.svc.cluster.local --port 9000 --user admin --password "6Jo7OC5Y67" --query "SELECT count(*) FROM executions_loop.executions_loop_table;"' | kubectl exec -it clkhouse-ubczqv-clickhouse-ffp-0 --namespace ns-ezujo -- bash`(B  check db_client batch [337] equal [337] data Success(B cmpv upgrade service version:2,22.3.18|2,22.3.20|2,22.8.21|2,24.8.3|2,25.4.4|2,25.9.7 cmpv service version upgrade upgrade from:25.4.4 to service version:25.9.7  `kubectl get pvc -l app.kubernetes.io/instance=clkhouse-ubczqv,apps.kubeblocks.io/component-name=clickhouse,apps.kubeblocks.io/vct-name=data --namespace ns-ezujo `(B  clkhouse-ubczqv clickhouse data pvc is empty cluster volume-expand check cluster status before ops check cluster status done(B cluster_status:Running(B  `kbcli cluster volume-expand clkhouse-ubczqv --auto-approve --force=true --components clickhouse --volume-claim-templates data --storage 30Gi --namespace ns-ezujo `(B  OpsRequest clkhouse-ubczqv-volumeexpansion-s6k9q created successfully, you can view the progress: kbcli cluster describe-ops clkhouse-ubczqv-volumeexpansion-s6k9q -n ns-ezujo check ops status  `kbcli cluster list-ops clkhouse-ubczqv --status all --namespace ns-ezujo `(B  NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME clkhouse-ubczqv-volumeexpansion-s6k9q ns-ezujo VolumeExpansion clkhouse-ubczqv clickhouse Running 0/4 Feb 12,2026 10:57 UTC+0800 check cluster status  `kbcli cluster list clkhouse-ubczqv --show-labels --namespace ns-ezujo `(B  NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS clkhouse-ubczqv ns-ezujo clickhouse WipeOut Updating Feb 12,2026 10:05 UTC+0800 app.kubernetes.io/instance=clkhouse-ubczqv,clusterdefinition.kubeblocks.io/name=clickhouse cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B check cluster status done(B cluster_status:Running(B check pod status  `kbcli cluster list-instances clkhouse-ubczqv --namespace ns-ezujo `(B  NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME clkhouse-ubczqv-ch-keeper-0 ns-ezujo clkhouse-ubczqv ch-keeper Running follower 0 300m / 300m 2254857830400m / 2254857830400m data:25Gi aks-cicdamdpool-17242166-vmss000003/10.224.0.6 Feb 12,2026 10:56 UTC+0800 clkhouse-ubczqv-ch-keeper-1 ns-ezujo clkhouse-ubczqv ch-keeper Running follower 0 300m / 300m 2254857830400m / 2254857830400m data:25Gi aks-cicdamdpool-17242166-vmss000000/10.224.0.9 Feb 12,2026 10:57 UTC+0800 clkhouse-ubczqv-ch-keeper-2 ns-ezujo clkhouse-ubczqv ch-keeper Running leader 0 300m / 300m 2254857830400m / 2254857830400m data:25Gi aks-cicdamdpool-17242166-vmss000001/10.224.0.8 Feb 12,2026 10:55 UTC+0800 clkhouse-ubczqv-clickhouse-ffp-0 ns-ezujo clkhouse-ubczqv clickhouse(clickhouse-ffp) Running 0 300m / 300m 2254857830400m / 2254857830400m data:30Gi aks-cicdamdpool-17242166-vmss000001/10.224.0.8 Feb 12,2026 10:40 UTC+0800 clkhouse-ubczqv-clickhouse-ffp-1 ns-ezujo clkhouse-ubczqv clickhouse(clickhouse-ffp) Running 0 300m / 300m 2254857830400m / 2254857830400m data:30Gi aks-cicdamdpool-17242166-vmss000000/10.224.0.9 Feb 12,2026 10:40 UTC+0800 clkhouse-ubczqv-clickhouse-mhg-0 ns-ezujo clkhouse-ubczqv clickhouse(clickhouse-mhg) Running 0 300m / 300m 2254857830400m / 2254857830400m data:30Gi aks-cicdamdpool-17242166-vmss000000/10.224.0.9 Feb 12,2026 10:40 UTC+0800 clkhouse-ubczqv-clickhouse-mhg-1 ns-ezujo clkhouse-ubczqv clickhouse(clickhouse-mhg) Running 0 300m / 300m 2254857830400m / 2254857830400m data:30Gi aks-cicdamdpool-17242166-vmss000001/10.224.0.8 Feb 12,2026 10:40 UTC+0800 check pod status done(B  `kubectl get secrets -l app.kubernetes.io/instance=clkhouse-ubczqv`(B  set secret: clkhouse-ubczqv-clickhouse-ffp-account-admin  `kubectl get secrets clkhouse-ubczqv-clickhouse-ffp-account-admin -o jsonpath="{.data.username}"`(B   `kubectl get secrets clkhouse-ubczqv-clickhouse-ffp-account-admin -o jsonpath="{.data.password}"`(B   `kubectl get secrets clkhouse-ubczqv-clickhouse-ffp-account-admin -o jsonpath="{.data.port}"`(B  DB_USERNAME_PROXY:;DB_PASSWORD_PROXY:;DB_PORT_PROXY:8123(B DB_USERNAME:admin;DB_PASSWORD:6Jo7OC5Y67;DB_PORT:9000;DB_DATABASE:default(B check cluster connect  `echo 'clickhouse-client --host clkhouse-ubczqv-clickhouse-ffp.ns-ezujo.svc.cluster.local --port 9000 --user admin --password "6Jo7OC5Y67"' | kubectl exec -it clkhouse-ubczqv-clickhouse-ffp-0 --namespace ns-ezujo -- bash`(B  check cluster connect done(B check ops status  `kbcli cluster list-ops clkhouse-ubczqv --status all --namespace ns-ezujo `(B  NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME clkhouse-ubczqv-volumeexpansion-s6k9q ns-ezujo VolumeExpansion clkhouse-ubczqv clickhouse Succeed 4/4 Feb 12,2026 10:57 UTC+0800 check ops status done(B ops_status:clkhouse-ubczqv-volumeexpansion-s6k9q ns-ezujo VolumeExpansion clkhouse-ubczqv clickhouse Succeed 4/4 Feb 12,2026 10:57 UTC+0800 (B  `kubectl patch -p '{"metadata":{"finalizers":[]}}' --type=merge opsrequests.operations clkhouse-ubczqv-volumeexpansion-s6k9q --namespace ns-ezujo `(B  opsrequest.operations.kubeblocks.io/clkhouse-ubczqv-volumeexpansion-s6k9q patched  `kbcli cluster delete-ops --name clkhouse-ubczqv-volumeexpansion-s6k9q --force --auto-approve --namespace ns-ezujo `(B  OpsRequest clkhouse-ubczqv-volumeexpansion-s6k9q deleted  `kubectl get secrets -l app.kubernetes.io/instance=clkhouse-ubczqv`(B  set secret: clkhouse-ubczqv-clickhouse-ffp-account-admin  `kubectl get secrets clkhouse-ubczqv-clickhouse-ffp-account-admin -o jsonpath="{.data.username}"`(B   `kubectl get secrets clkhouse-ubczqv-clickhouse-ffp-account-admin -o jsonpath="{.data.password}"`(B   `kubectl get secrets clkhouse-ubczqv-clickhouse-ffp-account-admin -o jsonpath="{.data.port}"`(B  DB_USERNAME_PROXY:;DB_PASSWORD_PROXY:;DB_PORT_PROXY:8123(B DB_USERNAME:admin;DB_PASSWORD:6Jo7OC5Y67;DB_PORT:9000;DB_DATABASE:default(B check db_client batch data count  `echo 'clickhouse-client --host clkhouse-ubczqv-clickhouse-ffp.ns-ezujo.svc.cluster.local --port 9000 --user admin --password "6Jo7OC5Y67" --query "SELECT count(*) FROM executions_loop.executions_loop_table;"' | kubectl exec -it clkhouse-ubczqv-clickhouse-ffp-0 --namespace ns-ezujo -- bash`(B  check db_client batch [337] equal [337] data Success(B cmpv upgrade service version:2,22.3.18|2,22.3.20|2,22.8.21|2,24.8.3|2,25.4.4|2,25.9.7 cmpv service version upgrade upgrade from:25.4.4 to service version:25.9.7 patch clkhouse-ubczqv shards 3  `kubectl patch cluster clkhouse-ubczqv --namespace ns-ezujo --type json -p '[{"op": "replace", "path": "/spec/shardings/0/shards", "value": '3'}]'`(B  cluster.apps.kubeblocks.io/clkhouse-ubczqv patched get cluster clkhouse-ubczqv shard clickhouse component name  `kubectl get component -l "app.kubernetes.io/instance=clkhouse-ubczqv,apps.kubeblocks.io/sharding-name=clickhouse" --namespace ns-ezujo`(B  set shard component name:clickhouse-mhg check cluster status  `kbcli cluster list clkhouse-ubczqv --show-labels --namespace ns-ezujo `(B  NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS clkhouse-ubczqv ns-ezujo clickhouse WipeOut Updating Feb 12,2026 10:05 UTC+0800 app.kubernetes.io/instance=clkhouse-ubczqv,clusterdefinition.kubeblocks.io/name=clickhouse cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B check cluster status done(B cluster_status:Running(B check pod status  `kbcli cluster list-instances clkhouse-ubczqv --namespace ns-ezujo `(B  NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME clkhouse-ubczqv-ch-keeper-0 ns-ezujo clkhouse-ubczqv ch-keeper Running follower 0 300m / 300m 2254857830400m / 2254857830400m data:25Gi aks-cicdamdpool-17242166-vmss000003/10.224.0.6 Feb 12,2026 10:56 UTC+0800 clkhouse-ubczqv-ch-keeper-1 ns-ezujo clkhouse-ubczqv ch-keeper Running follower 0 300m / 300m 2254857830400m / 2254857830400m data:25Gi aks-cicdamdpool-17242166-vmss000000/10.224.0.9 Feb 12,2026 10:57 UTC+0800 clkhouse-ubczqv-ch-keeper-2 ns-ezujo clkhouse-ubczqv ch-keeper Running leader 0 300m / 300m 2254857830400m / 2254857830400m data:25Gi aks-cicdamdpool-17242166-vmss000001/10.224.0.8 Feb 12,2026 10:55 UTC+0800 clkhouse-ubczqv-clickhouse-ffp-0 ns-ezujo clkhouse-ubczqv clickhouse(clickhouse-ffp) Running 0 300m / 300m 2254857830400m / 2254857830400m data:30Gi aks-cicdamdpool-17242166-vmss000001/10.224.0.8 Feb 12,2026 10:40 UTC+0800 clkhouse-ubczqv-clickhouse-ffp-1 ns-ezujo clkhouse-ubczqv clickhouse(clickhouse-ffp) Running 0 300m / 300m 2254857830400m / 2254857830400m data:30Gi aks-cicdamdpool-17242166-vmss000000/10.224.0.9 Feb 12,2026 10:40 UTC+0800 clkhouse-ubczqv-clickhouse-hq2-0 ns-ezujo clkhouse-ubczqv clickhouse(clickhouse-hq2) Running 0 300m / 300m 2254857830400m / 2254857830400m data:30Gi aks-cicdamdpool-17242166-vmss000003/10.224.0.6 Feb 12,2026 11:03 UTC+0800 clkhouse-ubczqv-clickhouse-hq2-1 ns-ezujo clkhouse-ubczqv clickhouse(clickhouse-hq2) Running 0 300m / 300m 2254857830400m / 2254857830400m data:30Gi aks-cicdamdpool-17242166-vmss000000/10.224.0.9 Feb 12,2026 11:03 UTC+0800 clkhouse-ubczqv-clickhouse-mhg-0 ns-ezujo clkhouse-ubczqv clickhouse(clickhouse-mhg) Running 0 300m / 300m 2254857830400m / 2254857830400m data:30Gi aks-cicdamdpool-17242166-vmss000000/10.224.0.9 Feb 12,2026 10:40 UTC+0800 clkhouse-ubczqv-clickhouse-mhg-1 ns-ezujo clkhouse-ubczqv clickhouse(clickhouse-mhg) Running 0 300m / 300m 2254857830400m / 2254857830400m data:30Gi aks-cicdamdpool-17242166-vmss000001/10.224.0.8 Feb 12,2026 10:40 UTC+0800 check pod status done(B  `kubectl get secrets -l app.kubernetes.io/instance=clkhouse-ubczqv`(B  set secret: clkhouse-ubczqv-clickhouse-mhg-account-admin  `kubectl get secrets clkhouse-ubczqv-clickhouse-mhg-account-admin -o jsonpath="{.data.username}"`(B   `kubectl get secrets clkhouse-ubczqv-clickhouse-mhg-account-admin -o jsonpath="{.data.password}"`(B   `kubectl get secrets clkhouse-ubczqv-clickhouse-mhg-account-admin -o jsonpath="{.data.port}"`(B  DB_USERNAME_PROXY:;DB_PASSWORD_PROXY:;DB_PORT_PROXY:8123(B DB_USERNAME:admin;DB_PASSWORD:6Jo7OC5Y67;DB_PORT:9000;DB_DATABASE:default(B check cluster connect  `echo 'clickhouse-client --host clkhouse-ubczqv-clickhouse-mhg.ns-ezujo.svc.cluster.local --port 9000 --user admin --password "6Jo7OC5Y67"' | kubectl exec -it clkhouse-ubczqv-clickhouse-mhg-0 --namespace ns-ezujo -- bash`(B  check cluster connect done(B job pod status:(B job pod status:(B job pod status:(B check clkhouse-ubczqv post-provision skip(B cluster custom-ops post-scale-out-shard-for-clickhouse apiVersion: operations.kubeblocks.io/v1alpha1 kind: OpsRequest metadata: generateName: clkhouse-ubczqv-custom- namespace: ns-ezujo spec: type: Custom clusterName: clkhouse-ubczqv force: true custom: components: - componentName: clickhouse maxConcurrentComponents: 0 opsDefinitionName: post-scale-out-shard-for-clickhouse check cluster status before ops check cluster status done(B cluster_status:Running(B  `kubectl create -f test_ops_cluster_clkhouse-ubczqv.yaml`(B  opsrequest.operations.kubeblocks.io/clkhouse-ubczqv-custom-dwkm2 created create test_ops_cluster_clkhouse-ubczqv.yaml Success(B  `rm -rf test_ops_cluster_clkhouse-ubczqv.yaml`(B  check ops status  `kbcli cluster list-ops clkhouse-ubczqv --status all --namespace ns-ezujo `(B  NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME clkhouse-ubczqv-custom-dwkm2 ns-ezujo Custom clkhouse-ubczqv Running -/- Feb 12,2026 11:10 UTC+0800 check cluster status  `kbcli cluster list clkhouse-ubczqv --show-labels --namespace ns-ezujo `(B  NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS clkhouse-ubczqv ns-ezujo clickhouse WipeOut Running Feb 12,2026 10:05 UTC+0800 app.kubernetes.io/instance=clkhouse-ubczqv,clusterdefinition.kubeblocks.io/name=clickhouse check cluster status done(B cluster_status:Running(B check pod status  `kbcli cluster list-instances clkhouse-ubczqv --namespace ns-ezujo `(B  NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME clkhouse-ubczqv-ch-keeper-0 ns-ezujo clkhouse-ubczqv ch-keeper Running follower 0 300m / 300m 2254857830400m / 2254857830400m data:25Gi aks-cicdamdpool-17242166-vmss000003/10.224.0.6 Feb 12,2026 10:56 UTC+0800 clkhouse-ubczqv-ch-keeper-1 ns-ezujo clkhouse-ubczqv ch-keeper Running follower 0 300m / 300m 2254857830400m / 2254857830400m data:25Gi aks-cicdamdpool-17242166-vmss000000/10.224.0.9 Feb 12,2026 10:57 UTC+0800 clkhouse-ubczqv-ch-keeper-2 ns-ezujo clkhouse-ubczqv ch-keeper Running leader 0 300m / 300m 2254857830400m / 2254857830400m data:25Gi aks-cicdamdpool-17242166-vmss000001/10.224.0.8 Feb 12,2026 10:55 UTC+0800 clkhouse-ubczqv-clickhouse-ffp-0 ns-ezujo clkhouse-ubczqv clickhouse(clickhouse-ffp) Running 0 300m / 300m 2254857830400m / 2254857830400m data:30Gi aks-cicdamdpool-17242166-vmss000001/10.224.0.8 Feb 12,2026 10:40 UTC+0800 clkhouse-ubczqv-clickhouse-ffp-1 ns-ezujo clkhouse-ubczqv clickhouse(clickhouse-ffp) Running 0 300m / 300m 2254857830400m / 2254857830400m data:30Gi aks-cicdamdpool-17242166-vmss000000/10.224.0.9 Feb 12,2026 10:40 UTC+0800 clkhouse-ubczqv-clickhouse-hq2-0 ns-ezujo clkhouse-ubczqv clickhouse(clickhouse-hq2) Running 0 300m / 300m 2254857830400m / 2254857830400m data:30Gi aks-cicdamdpool-17242166-vmss000003/10.224.0.6 Feb 12,2026 11:03 UTC+0800 clkhouse-ubczqv-clickhouse-hq2-1 ns-ezujo clkhouse-ubczqv clickhouse(clickhouse-hq2) Running 0 300m / 300m 2254857830400m / 2254857830400m data:30Gi aks-cicdamdpool-17242166-vmss000000/10.224.0.9 Feb 12,2026 11:03 UTC+0800 clkhouse-ubczqv-clickhouse-mhg-0 ns-ezujo clkhouse-ubczqv clickhouse(clickhouse-mhg) Running 0 300m / 300m 2254857830400m / 2254857830400m data:30Gi aks-cicdamdpool-17242166-vmss000000/10.224.0.9 Feb 12,2026 10:40 UTC+0800 clkhouse-ubczqv-clickhouse-mhg-1 ns-ezujo clkhouse-ubczqv clickhouse(clickhouse-mhg) Running 0 300m / 300m 2254857830400m / 2254857830400m data:30Gi aks-cicdamdpool-17242166-vmss000001/10.224.0.8 Feb 12,2026 10:40 UTC+0800 check pod status done(B  `kubectl get secrets -l app.kubernetes.io/instance=clkhouse-ubczqv`(B  set secret: clkhouse-ubczqv-clickhouse-mhg-account-admin  `kubectl get secrets clkhouse-ubczqv-clickhouse-mhg-account-admin -o jsonpath="{.data.username}"`(B   `kubectl get secrets clkhouse-ubczqv-clickhouse-mhg-account-admin -o jsonpath="{.data.password}"`(B   `kubectl get secrets clkhouse-ubczqv-clickhouse-mhg-account-admin -o jsonpath="{.data.port}"`(B  DB_USERNAME_PROXY:;DB_PASSWORD_PROXY:;DB_PORT_PROXY:8123(B DB_USERNAME:admin;DB_PASSWORD:6Jo7OC5Y67;DB_PORT:9000;DB_DATABASE:default(B check cluster connect  `echo 'clickhouse-client --host clkhouse-ubczqv-clickhouse-mhg.ns-ezujo.svc.cluster.local --port 9000 --user admin --password "6Jo7OC5Y67"' | kubectl exec -it clkhouse-ubczqv-clickhouse-mhg-0 --namespace ns-ezujo -- bash`(B  check cluster connect done(B check ops status  `kbcli cluster list-ops clkhouse-ubczqv --status all --namespace ns-ezujo `(B  NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME clkhouse-ubczqv-custom-dwkm2 ns-ezujo Custom clkhouse-ubczqv clickhouse Succeed 1/1 Feb 12,2026 11:10 UTC+0800 check ops status done(B ops_status:clkhouse-ubczqv-custom-dwkm2 ns-ezujo Custom clkhouse-ubczqv clickhouse Succeed 1/1 Feb 12,2026 11:10 UTC+0800 (B  `kubectl patch -p '{"metadata":{"finalizers":[]}}' --type=merge opsrequests.operations clkhouse-ubczqv-custom-dwkm2 --namespace ns-ezujo `(B  opsrequest.operations.kubeblocks.io/clkhouse-ubczqv-custom-dwkm2 patched  `kbcli cluster delete-ops --name clkhouse-ubczqv-custom-dwkm2 --force --auto-approve --namespace ns-ezujo `(B  OpsRequest clkhouse-ubczqv-custom-dwkm2 deleted  `kubectl get secrets -l app.kubernetes.io/instance=clkhouse-ubczqv`(B  set secret: clkhouse-ubczqv-clickhouse-mhg-account-admin  `kubectl get secrets clkhouse-ubczqv-clickhouse-mhg-account-admin -o jsonpath="{.data.username}"`(B   `kubectl get secrets clkhouse-ubczqv-clickhouse-mhg-account-admin -o jsonpath="{.data.password}"`(B   `kubectl get secrets clkhouse-ubczqv-clickhouse-mhg-account-admin -o jsonpath="{.data.port}"`(B  DB_USERNAME_PROXY:;DB_PASSWORD_PROXY:;DB_PORT_PROXY:8123(B DB_USERNAME:admin;DB_PASSWORD:6Jo7OC5Y67;DB_PORT:9000;DB_DATABASE:default(B check db_client batch data count  `echo 'clickhouse-client --host clkhouse-ubczqv-clickhouse-mhg.ns-ezujo.svc.cluster.local --port 9000 --user admin --password "6Jo7OC5Y67" --query "SELECT count(*) FROM executions_loop.executions_loop_table;"' | kubectl exec -it clkhouse-ubczqv-clickhouse-mhg-0 --namespace ns-ezujo -- bash`(B  check db_client batch [337] equal [337] data Success(B  `kubectl get secrets -l app.kubernetes.io/instance=clkhouse-ubczqv`(B  set secret: clkhouse-ubczqv-clickhouse-mhg-account-admin  `kubectl get secrets clkhouse-ubczqv-clickhouse-mhg-account-admin -o jsonpath="{.data.username}"`(B   `kubectl get secrets clkhouse-ubczqv-clickhouse-mhg-account-admin -o jsonpath="{.data.password}"`(B   `kubectl get secrets clkhouse-ubczqv-clickhouse-mhg-account-admin -o jsonpath="{.data.port}"`(B  DB_USERNAME_PROXY:;DB_PASSWORD_PROXY:;DB_PORT_PROXY:8123(B DB_USERNAME:admin;DB_PASSWORD:6Jo7OC5Y67;DB_PORT:9000;DB_DATABASE:default(B check db_client batch data count  `echo 'clickhouse-client --host clkhouse-ubczqv-clickhouse-mhg.ns-ezujo.svc.cluster.local --port 9000 --user admin --password "6Jo7OC5Y67" --query "SELECT count(*) FROM executions_loop.executions_loop_table;"' | kubectl exec -it clkhouse-ubczqv-clickhouse-mhg-0 --namespace ns-ezujo -- bash`(B  check db_client batch [337] equal [337] data Success(B patch clkhouse-ubczqv shards 2  `kubectl patch cluster clkhouse-ubczqv --namespace ns-ezujo --type json -p '[{"op": "replace", "path": "/spec/shardings/0/shards", "value": '2'}]'`(B  cluster.apps.kubeblocks.io/clkhouse-ubczqv patched get cluster clkhouse-ubczqv shard clickhouse component name  `kubectl get component -l "app.kubernetes.io/instance=clkhouse-ubczqv,apps.kubeblocks.io/sharding-name=clickhouse" --namespace ns-ezujo`(B  set shard component name:clickhouse-ffp check cluster status  `kbcli cluster list clkhouse-ubczqv --show-labels --namespace ns-ezujo `(B  NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS clkhouse-ubczqv ns-ezujo clickhouse WipeOut Running Feb 12,2026 10:05 UTC+0800 app.kubernetes.io/instance=clkhouse-ubczqv,clusterdefinition.kubeblocks.io/name=clickhouse check cluster status done(B cluster_status:Running(B check pod status  `kbcli cluster list-instances clkhouse-ubczqv --namespace ns-ezujo `(B  NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME clkhouse-ubczqv-ch-keeper-0 ns-ezujo clkhouse-ubczqv ch-keeper Running follower 0 300m / 300m 2254857830400m / 2254857830400m data:25Gi aks-cicdamdpool-17242166-vmss000003/10.224.0.6 Feb 12,2026 10:56 UTC+0800 clkhouse-ubczqv-ch-keeper-1 ns-ezujo clkhouse-ubczqv ch-keeper Running follower 0 300m / 300m 2254857830400m / 2254857830400m data:25Gi aks-cicdamdpool-17242166-vmss000000/10.224.0.9 Feb 12,2026 10:57 UTC+0800 clkhouse-ubczqv-ch-keeper-2 ns-ezujo clkhouse-ubczqv ch-keeper Running leader 0 300m / 300m 2254857830400m / 2254857830400m data:25Gi aks-cicdamdpool-17242166-vmss000001/10.224.0.8 Feb 12,2026 10:55 UTC+0800 clkhouse-ubczqv-clickhouse-ffp-0 ns-ezujo clkhouse-ubczqv clickhouse(clickhouse-ffp) Running 0 300m / 300m 2254857830400m / 2254857830400m data:30Gi aks-cicdamdpool-17242166-vmss000001/10.224.0.8 Feb 12,2026 10:40 UTC+0800 clkhouse-ubczqv-clickhouse-ffp-1 ns-ezujo clkhouse-ubczqv clickhouse(clickhouse-ffp) Running 0 300m / 300m 2254857830400m / 2254857830400m data:30Gi aks-cicdamdpool-17242166-vmss000000/10.224.0.9 Feb 12,2026 10:40 UTC+0800 clkhouse-ubczqv-clickhouse-hq2-0 ns-ezujo clkhouse-ubczqv clickhouse(clickhouse-hq2) Running 0 300m / 300m 2254857830400m / 2254857830400m data:30Gi aks-cicdamdpool-17242166-vmss000003/10.224.0.6 Feb 12,2026 11:03 UTC+0800 clkhouse-ubczqv-clickhouse-hq2-1 ns-ezujo clkhouse-ubczqv clickhouse(clickhouse-hq2) Running 0 300m / 300m 2254857830400m / 2254857830400m data:30Gi aks-cicdamdpool-17242166-vmss000000/10.224.0.9 Feb 12,2026 11:03 UTC+0800 check pod status done(B  `kubectl get secrets -l app.kubernetes.io/instance=clkhouse-ubczqv`(B  set secret: clkhouse-ubczqv-clickhouse-ffp-account-admin  `kubectl get secrets clkhouse-ubczqv-clickhouse-ffp-account-admin -o jsonpath="{.data.username}"`(B   `kubectl get secrets clkhouse-ubczqv-clickhouse-ffp-account-admin -o jsonpath="{.data.password}"`(B   `kubectl get secrets clkhouse-ubczqv-clickhouse-ffp-account-admin -o jsonpath="{.data.port}"`(B  DB_USERNAME_PROXY:;DB_PASSWORD_PROXY:;DB_PORT_PROXY:8123(B DB_USERNAME:admin;DB_PASSWORD:6Jo7OC5Y67;DB_PORT:9000;DB_DATABASE:default(B check cluster connect  `echo 'clickhouse-client --host clkhouse-ubczqv-clickhouse-ffp.ns-ezujo.svc.cluster.local --port 9000 --user admin --password "6Jo7OC5Y67"' | kubectl exec -it clkhouse-ubczqv-clickhouse-ffp-0 --namespace ns-ezujo -- bash`(B  check cluster connect done(B job pod status:(B job pod status:(B job pod status:(B check clkhouse-ubczqv pre-terminate skip(B  `kubectl get secrets -l app.kubernetes.io/instance=clkhouse-ubczqv`(B  set secret: clkhouse-ubczqv-clickhouse-ffp-account-admin  `kubectl get secrets clkhouse-ubczqv-clickhouse-ffp-account-admin -o jsonpath="{.data.username}"`(B   `kubectl get secrets clkhouse-ubczqv-clickhouse-ffp-account-admin -o jsonpath="{.data.password}"`(B   `kubectl get secrets clkhouse-ubczqv-clickhouse-ffp-account-admin -o jsonpath="{.data.port}"`(B  DB_USERNAME_PROXY:;DB_PASSWORD_PROXY:;DB_PORT_PROXY:8123(B DB_USERNAME:admin;DB_PASSWORD:6Jo7OC5Y67;DB_PORT:9000;DB_DATABASE:default(B set db_client batch data count  `echo 'clickhouse-client --host clkhouse-ubczqv-clickhouse-ffp.ns-ezujo.svc.cluster.local --port 9000 --user admin --password "6Jo7OC5Y67" --query "SELECT count(*) FROM executions_loop.executions_loop_table;"' | kubectl exec -it clkhouse-ubczqv-clickhouse-ffp-0 --namespace ns-ezujo -- bash`(B  set db_client batch data retry times: 1(B set db_client batch data retry times: 2(B set db_client batch data retry times: 3(B set db_client batch data retry times: 4(B set db_client batch data retry times: 5(B set db_client batch data retry times: 6(B set db_client batch data retry times: 7(B set db_client batch data retry times: 8(B set db_client batch data retry times: 9(B set db_client batch data retry times: 10(B set db_client batch data Failure(B 171 set DB_CLIENT_BATCH_DATA_COUNT: 196  `kubectl get secrets -l app.kubernetes.io/instance=clkhouse-ubczqv`(B  set secret: clkhouse-ubczqv-clickhouse-ffp-account-admin  `kubectl get secrets clkhouse-ubczqv-clickhouse-ffp-account-admin -o jsonpath="{.data.username}"`(B   `kubectl get secrets clkhouse-ubczqv-clickhouse-ffp-account-admin -o jsonpath="{.data.password}"`(B   `kubectl get secrets clkhouse-ubczqv-clickhouse-ffp-account-admin -o jsonpath="{.data.port}"`(B  DB_USERNAME_PROXY:;DB_PASSWORD_PROXY:;DB_PORT_PROXY:8123(B DB_USERNAME:admin;DB_PASSWORD:6Jo7OC5Y67;DB_PORT:9000;DB_DATABASE:default(B check db_client batch data count  `echo 'clickhouse-client --host clkhouse-ubczqv-clickhouse-ffp.ns-ezujo.svc.cluster.local --port 9000 --user admin --password "6Jo7OC5Y67" --query "SELECT count(*) FROM executions_loop.executions_loop_table;"' | kubectl exec -it clkhouse-ubczqv-clickhouse-ffp-0 --namespace ns-ezujo -- bash`(B  check db_client batch [196] equal [196] data Success(B  `kubectl get secrets -l app.kubernetes.io/instance=clkhouse-ubczqv`(B  set secret: clkhouse-ubczqv-clickhouse-ffp-account-admin  `kubectl get secrets clkhouse-ubczqv-clickhouse-ffp-account-admin -o jsonpath="{.data.username}"`(B   `kubectl get secrets clkhouse-ubczqv-clickhouse-ffp-account-admin -o jsonpath="{.data.password}"`(B   `kubectl get secrets clkhouse-ubczqv-clickhouse-ffp-account-admin -o jsonpath="{.data.port}"`(B  DB_USERNAME_PROXY:;DB_PASSWORD_PROXY:;DB_PORT_PROXY:8123(B DB_USERNAME:admin;DB_PASSWORD:6Jo7OC5Y67;DB_PORT:9000;DB_DATABASE:default(B  `echo 'clickhouse-client --host clkhouse-ubczqv-clickhouse-ffp.ns-ezujo.svc.cluster.local --port 9000 --user admin --password "6Jo7OC5Y67" --query "CREATE TABLE test_kbcli (id Int32,name String) ENGINE = MergeTree() ORDER BY id;"' | kubectl exec -it clkhouse-ubczqv-clickhouse-ffp-0 --namespace ns-ezujo -- bash`(B   `echo "clickhouse-client --host clkhouse-ubczqv-clickhouse-ffp.ns-ezujo.svc.cluster.local --port 9000 --user admin --password \"6Jo7OC5Y67\" --query \"INSERT INTO test_kbcli VALUES (1,'ormsy');\" " | kubectl exec -it clkhouse-ubczqv-clickhouse-ffp-0 --namespace ns-ezujo -- bash`(B   `echo "clickhouse-client --host clkhouse-ubczqv-clickhouse-ffp.ns-ezujo.svc.cluster.local --port 9000 --user admin --password \"6Jo7OC5Y67\" --query \"INSERT INTO test_kbcli VALUES (1,'ormsy');\" " | kubectl exec -it clkhouse-ubczqv-clickhouse-ffp-0 --namespace ns-ezujo -- bash`(B   `echo 'clickhouse-client --host clkhouse-ubczqv-clickhouse-ffp.ns-ezujo.svc.cluster.local --port 9000 --user admin --password "6Jo7OC5Y67" --query "CREATE TABLE test_kbcli (id Int32,name String) ENGINE = MergeTree() ORDER BY id;"' | kubectl exec -it clkhouse-ubczqv-clickhouse-ffp-0 --namespace ns-ezujo -- bash`(B   `clickhouse-client --host clkhouse-ubczqv-clickhouse-ffp.ns-ezujo.svc.cluster.local --port 9000 --user admin --password "6Jo7OC5Y67" --query "SELECT * FROM test_kbcli;"`(B  exec return msg:1 ormsy check msg:[ormsy] equal msg:[1 ormsy](B test failover kill1(B check cluster status before cluster-failover-kill1 check cluster status done(B cluster_status:Running(B  `kill 1`(B  exec return message: check cluster status  `kbcli cluster list clkhouse-ubczqv --show-labels --namespace ns-ezujo `(B  NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS clkhouse-ubczqv ns-ezujo clickhouse WipeOut Updating Feb 12,2026 10:05 UTC+0800 app.kubernetes.io/instance=clkhouse-ubczqv,clusterdefinition.kubeblocks.io/name=clickhouse cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B check cluster status done(B cluster_status:Running(B check pod status  `kbcli cluster list-instances clkhouse-ubczqv --namespace ns-ezujo `(B  NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME clkhouse-ubczqv-ch-keeper-0 ns-ezujo clkhouse-ubczqv ch-keeper Running follower 0 300m / 300m 2254857830400m / 2254857830400m data:25Gi aks-cicdamdpool-17242166-vmss000003/10.224.0.6 Feb 12,2026 10:56 UTC+0800 clkhouse-ubczqv-ch-keeper-1 ns-ezujo clkhouse-ubczqv ch-keeper Running follower 0 300m / 300m 2254857830400m / 2254857830400m data:25Gi aks-cicdamdpool-17242166-vmss000000/10.224.0.9 Feb 12,2026 10:57 UTC+0800 clkhouse-ubczqv-ch-keeper-2 ns-ezujo clkhouse-ubczqv ch-keeper Running leader 0 300m / 300m 2254857830400m / 2254857830400m data:25Gi aks-cicdamdpool-17242166-vmss000001/10.224.0.8 Feb 12,2026 10:55 UTC+0800 clkhouse-ubczqv-clickhouse-ffp-0 ns-ezujo clkhouse-ubczqv clickhouse(clickhouse-ffp) Running 0 300m / 300m 2254857830400m / 2254857830400m data:30Gi aks-cicdamdpool-17242166-vmss000001/10.224.0.8 Feb 12,2026 10:40 UTC+0800 clkhouse-ubczqv-clickhouse-ffp-1 ns-ezujo clkhouse-ubczqv clickhouse(clickhouse-ffp) Running 0 300m / 300m 2254857830400m / 2254857830400m data:30Gi aks-cicdamdpool-17242166-vmss000000/10.224.0.9 Feb 12,2026 10:40 UTC+0800 clkhouse-ubczqv-clickhouse-hq2-0 ns-ezujo clkhouse-ubczqv clickhouse(clickhouse-hq2) Running 0 300m / 300m 2254857830400m / 2254857830400m data:30Gi aks-cicdamdpool-17242166-vmss000003/10.224.0.6 Feb 12,2026 11:03 UTC+0800 clkhouse-ubczqv-clickhouse-hq2-1 ns-ezujo clkhouse-ubczqv clickhouse(clickhouse-hq2) Running 0 300m / 300m 2254857830400m / 2254857830400m data:30Gi aks-cicdamdpool-17242166-vmss000000/10.224.0.9 Feb 12,2026 11:03 UTC+0800 check pod status done(B  `kubectl get secrets -l app.kubernetes.io/instance=clkhouse-ubczqv`(B  set secret: clkhouse-ubczqv-clickhouse-ffp-account-admin  `kubectl get secrets clkhouse-ubczqv-clickhouse-ffp-account-admin -o jsonpath="{.data.username}"`(B   `kubectl get secrets clkhouse-ubczqv-clickhouse-ffp-account-admin -o jsonpath="{.data.password}"`(B   `kubectl get secrets clkhouse-ubczqv-clickhouse-ffp-account-admin -o jsonpath="{.data.port}"`(B  DB_USERNAME_PROXY:;DB_PASSWORD_PROXY:;DB_PORT_PROXY:8123(B DB_USERNAME:admin;DB_PASSWORD:6Jo7OC5Y67;DB_PORT:9000;DB_DATABASE:default(B check cluster connect  `echo 'clickhouse-client --host clkhouse-ubczqv-clickhouse-ffp.ns-ezujo.svc.cluster.local --port 9000 --user admin --password "6Jo7OC5Y67"' | kubectl exec -it clkhouse-ubczqv-clickhouse-ffp-0 --namespace ns-ezujo -- bash`(B  check cluster connect done(B check failover pod name failover pod name:clkhouse-ubczqv-clickhouse-ffp-0 failover kill1 Success(B  `kubectl get secrets -l app.kubernetes.io/instance=clkhouse-ubczqv`(B  set secret: clkhouse-ubczqv-clickhouse-ffp-account-admin  `kubectl get secrets clkhouse-ubczqv-clickhouse-ffp-account-admin -o jsonpath="{.data.username}"`(B   `kubectl get secrets clkhouse-ubczqv-clickhouse-ffp-account-admin -o jsonpath="{.data.password}"`(B   `kubectl get secrets clkhouse-ubczqv-clickhouse-ffp-account-admin -o jsonpath="{.data.port}"`(B  DB_USERNAME_PROXY:;DB_PASSWORD_PROXY:;DB_PORT_PROXY:8123(B DB_USERNAME:admin;DB_PASSWORD:6Jo7OC5Y67;DB_PORT:9000;DB_DATABASE:default(B check db_client batch data count  `echo 'clickhouse-client --host clkhouse-ubczqv-clickhouse-ffp.ns-ezujo.svc.cluster.local --port 9000 --user admin --password "6Jo7OC5Y67" --query "SELECT count(*) FROM executions_loop.executions_loop_table;"' | kubectl exec -it clkhouse-ubczqv-clickhouse-ffp-0 --namespace ns-ezujo -- bash`(B  check db_client batch [196] equal [196] data Success(B cluster update terminationPolicy WipeOut  `kbcli cluster update clkhouse-ubczqv --termination-policy=WipeOut --namespace ns-ezujo `(B  cluster.apps.kubeblocks.io/clkhouse-ubczqv updated (no change) check cluster status  `kbcli cluster list clkhouse-ubczqv --show-labels --namespace ns-ezujo `(B  NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS clkhouse-ubczqv ns-ezujo clickhouse WipeOut Running Feb 12,2026 10:05 UTC+0800 app.kubernetes.io/instance=clkhouse-ubczqv,clusterdefinition.kubeblocks.io/name=clickhouse check cluster status done(B cluster_status:Running(B check pod status  `kbcli cluster list-instances clkhouse-ubczqv --namespace ns-ezujo `(B  NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME clkhouse-ubczqv-ch-keeper-0 ns-ezujo clkhouse-ubczqv ch-keeper Running follower 0 300m / 300m 2254857830400m / 2254857830400m data:25Gi aks-cicdamdpool-17242166-vmss000003/10.224.0.6 Feb 12,2026 10:56 UTC+0800 clkhouse-ubczqv-ch-keeper-1 ns-ezujo clkhouse-ubczqv ch-keeper Running follower 0 300m / 300m 2254857830400m / 2254857830400m data:25Gi aks-cicdamdpool-17242166-vmss000000/10.224.0.9 Feb 12,2026 10:57 UTC+0800 clkhouse-ubczqv-ch-keeper-2 ns-ezujo clkhouse-ubczqv ch-keeper Running leader 0 300m / 300m 2254857830400m / 2254857830400m data:25Gi aks-cicdamdpool-17242166-vmss000001/10.224.0.8 Feb 12,2026 10:55 UTC+0800 clkhouse-ubczqv-clickhouse-ffp-0 ns-ezujo clkhouse-ubczqv clickhouse(clickhouse-ffp) Running 0 300m / 300m 2254857830400m / 2254857830400m data:30Gi aks-cicdamdpool-17242166-vmss000001/10.224.0.8 Feb 12,2026 10:40 UTC+0800 clkhouse-ubczqv-clickhouse-ffp-1 ns-ezujo clkhouse-ubczqv clickhouse(clickhouse-ffp) Running 0 300m / 300m 2254857830400m / 2254857830400m data:30Gi aks-cicdamdpool-17242166-vmss000000/10.224.0.9 Feb 12,2026 10:40 UTC+0800 clkhouse-ubczqv-clickhouse-hq2-0 ns-ezujo clkhouse-ubczqv clickhouse(clickhouse-hq2) Running 0 300m / 300m 2254857830400m / 2254857830400m data:30Gi aks-cicdamdpool-17242166-vmss000003/10.224.0.6 Feb 12,2026 11:03 UTC+0800 clkhouse-ubczqv-clickhouse-hq2-1 ns-ezujo clkhouse-ubczqv clickhouse(clickhouse-hq2) Running 0 300m / 300m 2254857830400m / 2254857830400m data:30Gi aks-cicdamdpool-17242166-vmss000000/10.224.0.9 Feb 12,2026 11:03 UTC+0800 check pod status done(B  `kubectl get secrets -l app.kubernetes.io/instance=clkhouse-ubczqv`(B  set secret: clkhouse-ubczqv-clickhouse-ffp-account-admin  `kubectl get secrets clkhouse-ubczqv-clickhouse-ffp-account-admin -o jsonpath="{.data.username}"`(B   `kubectl get secrets clkhouse-ubczqv-clickhouse-ffp-account-admin -o jsonpath="{.data.password}"`(B   `kubectl get secrets clkhouse-ubczqv-clickhouse-ffp-account-admin -o jsonpath="{.data.port}"`(B  DB_USERNAME_PROXY:;DB_PASSWORD_PROXY:;DB_PORT_PROXY:8123(B DB_USERNAME:admin;DB_PASSWORD:6Jo7OC5Y67;DB_PORT:9000;DB_DATABASE:default(B check cluster connect  `echo 'clickhouse-client --host clkhouse-ubczqv-clickhouse-ffp.ns-ezujo.svc.cluster.local --port 9000 --user admin --password "6Jo7OC5Y67"' | kubectl exec -it clkhouse-ubczqv-clickhouse-ffp-0 --namespace ns-ezujo -- bash`(B  check cluster connect done(B cluster full backup  `kubectl get backuprepo backuprepo-kbcli-test -o jsonpath="{.spec.credential.name}"`(B   `kubectl get backuprepo backuprepo-kbcli-test -o jsonpath="{.spec.credential.namespace}"`(B   `kubectl get secrets kb-backuprepo-njfcd -n kb-qqsns -o jsonpath="{.data.accessKeyId}"`(B   `kubectl get secrets kb-backuprepo-njfcd -n kb-qqsns -o jsonpath="{.data.secretAccessKey}"`(B  KUBEBLOCKS NAMESPACE:kb-qqsns get kubeblocks namespace done(B  `kubectl get secrets -l app.kubernetes.io/instance=kbcli-test-minio --namespace kb-qqsns -o jsonpath="{.items[0].data.root-user}"`(B   `kubectl get secrets -l app.kubernetes.io/instance=kbcli-test-minio --namespace kb-qqsns -o jsonpath="{.items[0].data.root-password}"`(B  minio_user:kbclitest,minio_password:kbclitest,minio_endpoint:kbcli-test-minio.kb-qqsns.svc.cluster.local:9000 list minio bucket kbcli-test  `echo 'mc alias set minioserver http://kbcli-test-minio.kb-qqsns.svc.cluster.local:9000 kbclitest kbclitest;mc ls minioserver' | kubectl exec -it kbcli-test-minio-557dc6b665-8qwr5 --namespace kb-qqsns -- bash`(B  list minio bucket done(B default backuprepo:backuprepo-kbcli-test exists(B  `kbcli cluster backup clkhouse-ubczqv --method full --namespace ns-ezujo `(B  Backup backup-ns-ezujo-clkhouse-ubczqv-20260212111425 created successfully, you can view the progress: kbcli cluster list-backups --names=backup-ns-ezujo-clkhouse-ubczqv-20260212111425 -n ns-ezujo check backup status  `kbcli cluster list-backups clkhouse-ubczqv --namespace ns-ezujo `(B  NAME NAMESPACE SOURCE-CLUSTER METHOD STATUS TOTAL-SIZE DURATION DELETION-POLICY CREATE-TIME COMPLETION-TIME EXPIRATION backup-ns-ezujo-clkhouse-ubczqv-20260212111425 ns-ezujo clkhouse-ubczqv full Delete Feb 12,2026 11:14 UTC+0800 backup_status:clkhouse-ubczqv-full-Running(B backup_status:clkhouse-ubczqv-full-Running(B backup_status:clkhouse-ubczqv-full-Running(B backup_status:clkhouse-ubczqv-full-Running(B backup_status:clkhouse-ubczqv-full-Running(B check backup status done(B backup_status:backup-ns-ezujo-clkhouse-ubczqv-20260212111425 ns-ezujo clkhouse-ubczqv full Completed 33416 23s Delete Feb 12,2026 11:14 UTC+0800 Feb 12,2026 11:14 UTC+0800 (B cluster restore backup  `kbcli cluster describe-backup --names backup-ns-ezujo-clkhouse-ubczqv-20260212111425 --namespace ns-ezujo `(B  Name: backup-ns-ezujo-clkhouse-ubczqv-20260212111425 Cluster: clkhouse-ubczqv Namespace: ns-ezujo Spec: Method: full Policy Name: clkhouse-ubczqv-clickhouse-backup-policy Actions: dp-backup-clickhouse-hq2-0: ActionType: Job WorkloadName: dp-backup-clickhouse-hq2-0-backup-ns-ezujo-clkhouse-ubczqv-2026 TargetPodName: clkhouse-ubczqv-clickhouse-hq2-0 Phase: Completed Start Time: Feb 12,2026 11:14 UTC+0800 Completion Time: Feb 12,2026 11:14 UTC+0800 dp-backup-clickhouse-ffp-0: ActionType: Job WorkloadName: dp-backup-clickhouse-ffp-0-backup-ns-ezujo-clkhouse-ubczqv-2026 TargetPodName: clkhouse-ubczqv-clickhouse-ffp-0 Phase: Completed Start Time: Feb 12,2026 11:14 UTC+0800 Completion Time: Feb 12,2026 11:14 UTC+0800 Status: Phase: Completed Total Size: 33416 ActionSet Name: clickhouse-full-backup Repository: backuprepo-kbcli-test Duration: 23s Start Time: Feb 12,2026 11:14 UTC+0800 Completion Time: Feb 12,2026 11:14 UTC+0800 Path: /ns-ezujo/clkhouse-ubczqv-a94ed3b3-0fe9-4495-9438-a75d29939320/clickhouse/backup-ns-ezujo-clkhouse-ubczqv-20260212111425 Warning Events:  `kbcli cluster restore clkhouse-ubczqv-backup --backup backup-ns-ezujo-clkhouse-ubczqv-20260212111425 --namespace ns-ezujo `(B  Cluster clkhouse-ubczqv-backup created check cluster status  `kbcli cluster list clkhouse-ubczqv-backup --show-labels --namespace ns-ezujo `(B  NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS clkhouse-ubczqv-backup ns-ezujo clickhouse WipeOut Creating Feb 12,2026 11:14 UTC+0800 clusterdefinition.kubeblocks.io/name=clickhouse cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B  `kubectl get pods -l app.kubernetes.io/instance=clkhouse-ubczqv-backup -n ns-ezujo | (grep 'clkhouse-ubczqv-backup-ch-keeper' || true)`(B  pod "clkhouse-ubczqv-backup-ch-keeper-0" force deleted pod "clkhouse-ubczqv-backup-ch-keeper-1" force deleted pod "clkhouse-ubczqv-backup-ch-keeper-2" force deleted cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B [Error] check cluster status timeout(B --------------------------------------get cluster clkhouse-ubczqv-backup yaml--------------------------------------  `kubectl get cluster clkhouse-ubczqv-backup -o yaml --namespace ns-ezujo `(B  apiVersion: apps.kubeblocks.io/v1 kind: Cluster metadata: annotations: kubeblocks.io/crd-api-version: apps.kubeblocks.io/v1 kubeblocks.io/ops-request: '[{"name":"clkhouse-ubczqv-backup","type":"Restore"}]' kubeblocks.io/restore-from-backup: '{"clickhouse":{"doReadyRestoreAfterClusterRunning":"false","name":"backup-ns-ezujo-clkhouse-ubczqv-20260212111425","namespace":"ns-ezujo","volumeRestorePolicy":"Parallel"}}' creationTimestamp: "2026-02-12T03:14:53Z" finalizers: - cluster.kubeblocks.io/finalizer generation: 1 labels: clusterdefinition.kubeblocks.io/name: clickhouse name: clkhouse-ubczqv-backup namespace: ns-ezujo resourceVersion: "95554" uid: f55d90cb-0f7e-453b-b2d1-eb776c9c0b42 spec: clusterDef: clickhouse componentSpecs: - annotations: kubeblocks.io/restart: "2026-02-12T02:37:13Z" componentDef: clickhouse-keeper-1.0.2 disableExporter: false name: ch-keeper podUpdatePolicy: PreferInPlace replicas: 3 resources: limits: cpu: 300m memory: 2254857830400m requests: cpu: 300m memory: 2254857830400m serviceVersion: 25.9.7 services: - name: default podService: false serviceType: ClusterIP systemAccounts: - disabled: false name: admin passwordConfig: length: 10 letterCase: MixedCases numDigits: 5 numSymbols: 0 seed: clkhouse-ubczqv volumeClaimTemplates: - name: data spec: accessModes: - ReadWriteOnce resources: requests: storage: 25Gi shardings: - name: clickhouse shardingDef: clickhouse shards: 2 template: annotations: kubeblocks.io/restart: "2026-02-12T02:35:47Z" componentDef: clickhouse-1.0.2 disableExporter: false env: - name: INIT_CLUSTER_NAME value: default name: clickhouse podUpdatePolicy: PreferInPlace replicas: 2 resources: limits: cpu: 300m memory: 2254857830400m requests: cpu: 300m memory: 2254857830400m serviceVersion: 25.9.7 services: - name: default podService: false serviceType: ClusterIP systemAccounts: - disabled: false name: admin passwordConfig: length: 10 letterCase: MixedCases numDigits: 5 numSymbols: 0 seed: clkhouse-ubczqv volumeClaimTemplates: - name: data spec: accessModes: - ReadWriteOnce resources: requests: storage: 30Gi terminationPolicy: WipeOut topology: cluster status: components: ch-keeper: observedGeneration: 1 phase: Creating upToDate: true conditions: - lastTransitionTime: "2026-02-12T03:14:53Z" message: 'The operator has started the provisioning of Cluster: clkhouse-ubczqv-backup' observedGeneration: 1 reason: PreCheckSucceed status: "True" type: ProvisioningStarted - lastTransitionTime: "2026-02-12T03:14:53Z" message: Successfully applied for resources observedGeneration: 1 reason: ApplyResourcesSucceed status: "True" type: ApplyResources observedGeneration: 1 phase: Creating shardings: clickhouse: message: reason: the sharding to be created observedGeneration: 1 ------------------------------------------------------------------------------------------------------------------ --------------------------------------describe cluster clkhouse-ubczqv-backup--------------------------------------  `kubectl describe cluster clkhouse-ubczqv-backup --namespace ns-ezujo `(B  Name: clkhouse-ubczqv-backup Namespace: ns-ezujo Labels: clusterdefinition.kubeblocks.io/name=clickhouse Annotations: kubeblocks.io/crd-api-version: apps.kubeblocks.io/v1 kubeblocks.io/ops-request: [{"name":"clkhouse-ubczqv-backup","type":"Restore"}] kubeblocks.io/restore-from-backup: {"clickhouse":{"doReadyRestoreAfterClusterRunning":"false","name":"backup-ns-ezujo-clkhouse-ubczqv-20260212111425","namespace":"ns-ezujo",... API Version: apps.kubeblocks.io/v1 Kind: Cluster Metadata: Creation Timestamp: 2026-02-12T03:14:53Z Finalizers: cluster.kubeblocks.io/finalizer Generation: 1 Resource Version: 95554 UID: f55d90cb-0f7e-453b-b2d1-eb776c9c0b42 Spec: Cluster Def: clickhouse Component Specs: Annotations: kubeblocks.io/restart: 2026-02-12T02:37:13Z Component Def: clickhouse-keeper-1.0.2 Disable Exporter: false Name: ch-keeper Pod Update Policy: PreferInPlace Replicas: 3 Resources: Limits: Cpu: 300m Memory: 2254857830400m Requests: Cpu: 300m Memory: 2254857830400m Service Version: 25.9.7 Services: Name: default Pod Service: false Service Type: ClusterIP System Accounts: Disabled: false Name: admin Password Config: Length: 10 Letter Case: MixedCases Num Digits: 5 Num Symbols: 0 Seed: clkhouse-ubczqv Volume Claim Templates: Name: data Spec: Access Modes: ReadWriteOnce Resources: Requests: Storage: 25Gi Shardings: Name: clickhouse Sharding Def: clickhouse Shards: 2 Template: Annotations: kubeblocks.io/restart: 2026-02-12T02:35:47Z Component Def: clickhouse-1.0.2 Disable Exporter: false Env: Name: INIT_CLUSTER_NAME Value: default Name: clickhouse Pod Update Policy: PreferInPlace Replicas: 2 Resources: Limits: Cpu: 300m Memory: 2254857830400m Requests: Cpu: 300m Memory: 2254857830400m Service Version: 25.9.7 Services: Name: default Pod Service: false Service Type: ClusterIP System Accounts: Disabled: false Name: admin Password Config: Length: 10 Letter Case: MixedCases Num Digits: 5 Num Symbols: 0 Seed: clkhouse-ubczqv Volume Claim Templates: Name: data Spec: Access Modes: ReadWriteOnce Resources: Requests: Storage: 30Gi Termination Policy: WipeOut Topology: cluster Status: Components: Ch - Keeper: Observed Generation: 1 Phase: Creating Up To Date: true Conditions: Last Transition Time: 2026-02-12T03:14:53Z Message: The operator has started the provisioning of Cluster: clkhouse-ubczqv-backup Observed Generation: 1 Reason: PreCheckSucceed Status: True Type: ProvisioningStarted Last Transition Time: 2026-02-12T03:14:53Z Message: Successfully applied for resources Observed Generation: 1 Reason: ApplyResourcesSucceed Status: True Type: ApplyResources Observed Generation: 1 Phase: Creating Shardings: Clickhouse: Message: Reason: the sharding to be created Observed Generation: 1 Events: Type Reason Age From Message ---- ------ ---- ---- ------- Normal PreCheckSucceed 7m15s cluster-controller The operator has started the provisioning of Cluster: clkhouse-ubczqv-backup Normal ApplyResourcesSucceed 7m15s cluster-controller Successfully applied for resources Warning ReconcileBackupPolicyFail 111s (x17 over 7m15s) backup-policy-driver-controller failed to reconcile: sharding components clickhouse not found Normal ClusterComponentPhaseTransition 111s (x9 over 7m14s) cluster-controller cluster component ch-keeper is Creating ------------------------------------------------------------------------------------------------------------------ get cluster clkhouse-ubczqv-backup shard clickhouse component name  `kubectl get component -l "app.kubernetes.io/instance=clkhouse-ubczqv-backup,apps.kubeblocks.io/sharding-name=clickhouse" --namespace ns-ezujo`(B  no component name found(B check pod status  `kbcli cluster list-instances clkhouse-ubczqv-backup --namespace ns-ezujo `(B  NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME clkhouse-ubczqv-backup-ch-keeper-0 ns-ezujo clkhouse-ubczqv-backup ch-keeper Init:0/3 0 300m / 300m 2254857830400m / 2254857830400m data:25Gi aks-cicdamdpool-17242166-vmss000003/10.224.0.6 Feb 12,2026 11:20 UTC+0800 clkhouse-ubczqv-backup-ch-keeper-1 ns-ezujo clkhouse-ubczqv-backup ch-keeper Running leader 0 300m / 300m 2254857830400m / 2254857830400m data:25Gi aks-cicdamdpool-17242166-vmss000001/10.224.0.8 Feb 12,2026 11:20 UTC+0800 clkhouse-ubczqv-backup-ch-keeper-2 ns-ezujo clkhouse-ubczqv-backup ch-keeper Running follower 0 300m / 300m 2254857830400m / 2254857830400m data:25Gi aks-cicdamdpool-17242166-vmss000000/10.224.0.9 Feb 12,2026 11:20 UTC+0800 pod_status:Init:0/3(B pod_status:Init:0/3(B pod_status:Init:0/3(B pod_status:Init:0/3(B pod_status:Init:0/3(B pod_status:Init:0/3(B pod_status:Init:0/3(B pod_status:Init:0/3(B pod_status:Init:0/3(B pod_status:Init:0/3(B pod_status:Init:0/3(B pod_status:Init:0/3(B pod_status:Init:0/3(B pod_status:Init:0/3(B pod_status:Init:0/3(B pod_status:Init:0/3(B pod_status:Init:0/3(B pod_status:Init:0/3(B pod_status:Init:0/3(B pod_status:Init:0/3(B pod_status:Init:0/3(B pod_status:Init:0/3(B pod_status:Init:0/3(B pod_status:Init:0/3(B pod_status:Init:0/3(B pod_status:Init:0/3(B pod_status:Init:0/3(B pod_status:Init:0/3(B pod_status:Init:0/3(B pod_status:Init:0/3(B pod_status:Init:0/3(B pod_status:Init:0/3(B pod_status:Init:0/3(B pod_status:Init:0/3(B pod_status:Init:0/3(B pod_status:Init:0/3(B pod_status:Init:0/3(B pod_status:Init:0/3(B pod_status:Init:0/3(B pod_status:Init:0/3(B pod_status:Init:0/3(B pod_status:Init:0/3(B pod_status:Init:0/3(B pod_status:Init:0/3(B pod_status:Init:0/3(B pod_status:Init:0/3(B pod_status:Init:0/3(B pod_status:Init:0/3(B pod_status:Init:0/3(B pod_status:Init:0/3(B pod_status:Init:0/3(B pod_status:Init:0/3(B pod_status:Init:0/3(B pod_status:Init:0/3(B pod_status:Init:0/3(B pod_status:Init:0/3(B pod_status:Init:0/3(B pod_status:Init:0/3(B pod_status:Init:0/3(B pod_status:Init:1/3(B check pod status done(B check cluster status again cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Creating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B cluster_status:Updating(B check cluster status again done(B  `kubectl get secrets -l app.kubernetes.io/instance=clkhouse-ubczqv-backup`(B  set secret: clkhouse-ubczqv-backup-ch-keeper-account-admin  `kubectl get secrets clkhouse-ubczqv-backup-ch-keeper-account-admin -o jsonpath="{.data.username}"`(B   `kubectl get secrets clkhouse-ubczqv-backup-ch-keeper-account-admin -o jsonpath="{.data.password}"`(B   `kubectl get secrets clkhouse-ubczqv-backup-ch-keeper-account-admin -o jsonpath="{.data.port}"`(B  DB_USERNAME_PROXY:;DB_PASSWORD_PROXY:;DB_PORT_PROXY:8123(B DB_USERNAME:admin;DB_PASSWORD:6Jo7OC5Y67;DB_PORT:9000;DB_DATABASE:default(B get clickhouse-ffp pod name... get clickhouse-ffp pod name... get clickhouse-ffp pod name... get clickhouse-ffp pod name... get clickhouse-ffp pod name... get clickhouse-ffp pod name... get clickhouse-ffp pod name... get clickhouse-ffp pod name... get clickhouse-ffp pod name... get clickhouse-ffp pod name... get clickhouse-ffp pod name... get clickhouse-ffp pod name... get clickhouse-ffp pod name... get clickhouse-ffp pod name... get clickhouse-ffp pod name... get clickhouse-ffp pod name... get clickhouse-ffp pod name... get clickhouse-ffp pod name... get clickhouse-ffp pod name... get clickhouse-ffp pod name... get clickhouse-ffp pod name... get clickhouse-ffp pod name... get clickhouse-ffp pod name... get clickhouse-ffp pod name... get clickhouse-ffp pod name... get clickhouse-ffp pod name... get clickhouse-ffp pod name... get clickhouse-ffp pod name... get clickhouse-ffp pod name... get clickhouse-ffp pod name... get clickhouse-ffp pod name... get clickhouse-ffp pod name... get clickhouse-ffp pod name... get clickhouse-ffp pod name... get clickhouse-ffp pod name... get clickhouse-ffp pod name... get clickhouse-ffp pod name... get clickhouse-ffp pod name... get clickhouse-ffp pod name... get clickhouse-ffp pod name... get clickhouse-ffp pod name... get clickhouse-ffp pod name... get clickhouse-ffp pod name... get clickhouse-ffp pod name... get clickhouse-ffp pod name... get clickhouse-ffp pod name... get clickhouse-ffp pod name... get clickhouse-ffp pod name... get clickhouse-ffp pod name... get clickhouse-ffp pod name... get clickhouse-ffp pod name... get clickhouse-ffp pod name... get clickhouse-ffp pod name... get clickhouse-ffp pod name... get clickhouse-ffp pod name... get clickhouse-ffp pod name... get clickhouse-ffp pod name... get clickhouse-ffp pod name... get clickhouse-ffp pod name... get clickhouse-ffp pod name... get pod name timeout(B check cluster connect  `echo 'clickhouse-client --host .ns-ezujo.svc.cluster.local --port 9000 --user admin --password "6Jo7OC5Y67"' | kubectl exec -it --namespace ns-ezujo -- bash`(B  connect checking...(B connect checking...(B connect checking...(B connect checking...(B connect checking...(B connect checking...(B connect checking...(B connect checking...(B connect checking...(B connect checking...(B connect checking...(B connect checking...(B connect checking...(B connect checking...(B connect checking...(B connect checking...(B connect checking...(B connect checking...(B connect checking...(B connect checking...(B connect checking...(B connect checking...(B connect checking...(B connect checking...(B connect checking...(B connect checking...(B connect checking...(B connect checking...(B connect checking...(B connect checking...(B connect checking...(B connect checking...(B connect checking...(B connect checking...(B connect checking...(B connect checking...(B connect checking...(B connect checking...(B connect checking...(B connect checking...(B connect checking...(B get clickhouse-ffp pod name... get clickhouse-ffp pod name... get clickhouse-ffp pod name... get clickhouse-ffp pod name... get clickhouse-ffp pod name... get clickhouse-ffp pod name... get clickhouse-ffp pod name... get clickhouse-ffp pod name... get clickhouse-ffp pod name... get clickhouse-ffp pod name... get clickhouse-ffp pod name... get clickhouse-ffp pod name... get clickhouse-ffp pod name... get clickhouse-ffp pod name... get clickhouse-ffp pod name... get clickhouse-ffp pod name... get clickhouse-ffp pod name... get clickhouse-ffp pod name... get clickhouse-ffp pod name... get clickhouse-ffp pod name... get clickhouse-ffp pod name... get clickhouse-ffp pod name... get clickhouse-ffp pod name... get clickhouse-ffp pod name... get clickhouse-ffp pod name... get clickhouse-ffp pod name... get clickhouse-ffp pod name... get clickhouse-ffp pod name... get clickhouse-ffp pod name... get clickhouse-ffp pod name... get clickhouse-ffp pod name... get clickhouse-ffp pod name... get clickhouse-ffp pod name... get clickhouse-ffp pod name... get clickhouse-ffp pod name... get clickhouse-ffp pod name... get clickhouse-ffp pod name... get clickhouse-ffp pod name... get clickhouse-ffp pod name... get clickhouse-ffp pod name... get clickhouse-ffp pod name... get clickhouse-ffp pod name... get clickhouse-ffp pod name... get clickhouse-ffp pod name... get clickhouse-ffp pod name... get clickhouse-ffp pod name... get clickhouse-ffp pod name... get clickhouse-ffp pod name... get clickhouse-ffp pod name... get clickhouse-ffp pod name... get clickhouse-ffp pod name... get clickhouse-ffp pod name... get clickhouse-ffp pod name... get clickhouse-ffp pod name... get clickhouse-ffp pod name... get clickhouse-ffp pod name... get clickhouse-ffp pod name... get clickhouse-ffp pod name... get clickhouse-ffp pod name... get clickhouse-ffp pod name... get pod name timeout(B  `kubectl delete pod -n ns-ezujo --force `(B  connect checking...(B connect checking...(B connect checking...(B connect checking...(B connect checking...(B connect checking...(B connect checking...(B connect checking...(B connect checking...(B connect checking...(B connect checking...(B connect checking...(B connect checking...(B connect checking...(B connect checking...(B connect checking...(B connect checking...(B connect checking...(B connect checking...(B connect checking...(B check cluster connect timeout(B --------------------------------------get cluster clkhouse-ubczqv-backup yaml--------------------------------------  `kubectl get cluster clkhouse-ubczqv-backup -o yaml --namespace ns-ezujo `(B  apiVersion: apps.kubeblocks.io/v1 kind: Cluster metadata: annotations: kubeblocks.io/crd-api-version: apps.kubeblocks.io/v1 creationTimestamp: "2026-02-12T03:14:53Z" finalizers: - cluster.kubeblocks.io/finalizer generation: 1 labels: clusterdefinition.kubeblocks.io/name: clickhouse name: clkhouse-ubczqv-backup namespace: ns-ezujo resourceVersion: "107376" uid: f55d90cb-0f7e-453b-b2d1-eb776c9c0b42 spec: clusterDef: clickhouse componentSpecs: - annotations: kubeblocks.io/restart: "2026-02-12T02:37:13Z" componentDef: clickhouse-keeper-1.0.2 disableExporter: false name: ch-keeper podUpdatePolicy: PreferInPlace replicas: 3 resources: limits: cpu: 300m memory: 2254857830400m requests: cpu: 300m memory: 2254857830400m serviceVersion: 25.9.7 services: - name: default podService: false serviceType: ClusterIP systemAccounts: - disabled: false name: admin passwordConfig: length: 10 letterCase: MixedCases numDigits: 5 numSymbols: 0 seed: clkhouse-ubczqv volumeClaimTemplates: - name: data spec: accessModes: - ReadWriteOnce resources: requests: storage: 25Gi shardings: - name: clickhouse shardingDef: clickhouse shards: 2 template: annotations: kubeblocks.io/restart: "2026-02-12T02:35:47Z" componentDef: clickhouse-1.0.2 disableExporter: false env: - name: INIT_CLUSTER_NAME value: default name: clickhouse podUpdatePolicy: PreferInPlace replicas: 2 resources: limits: cpu: 300m memory: 2254857830400m requests: cpu: 300m memory: 2254857830400m serviceVersion: 25.9.7 services: - name: default podService: false serviceType: ClusterIP systemAccounts: - disabled: false name: admin passwordConfig: length: 10 letterCase: MixedCases numDigits: 5 numSymbols: 0 seed: clkhouse-ubczqv volumeClaimTemplates: - name: data spec: accessModes: - ReadWriteOnce resources: requests: storage: 30Gi terminationPolicy: WipeOut topology: cluster status: components: ch-keeper: observedGeneration: 1 phase: Running upToDate: true conditions: - lastTransitionTime: "2026-02-12T03:14:53Z" message: 'The operator has started the provisioning of Cluster: clkhouse-ubczqv-backup' observedGeneration: 1 reason: PreCheckSucceed status: "True" type: ProvisioningStarted - lastTransitionTime: "2026-02-12T03:14:53Z" message: Successfully applied for resources observedGeneration: 1 reason: ApplyResourcesSucceed status: "True" type: ApplyResources - lastTransitionTime: "2026-02-12T03:28:49Z" message: cluster clkhouse-ubczqv-backup is ready reason: ClusterReady status: "True" type: Ready observedGeneration: 1 phase: Running shardings: clickhouse: observedGeneration: 1 phase: Running upToDate: true ------------------------------------------------------------------------------------------------------------------ --------------------------------------describe cluster clkhouse-ubczqv-backup--------------------------------------  `kubectl describe cluster clkhouse-ubczqv-backup --namespace ns-ezujo `(B  Name: clkhouse-ubczqv-backup Namespace: ns-ezujo Labels: clusterdefinition.kubeblocks.io/name=clickhouse Annotations: kubeblocks.io/crd-api-version: apps.kubeblocks.io/v1 API Version: apps.kubeblocks.io/v1 Kind: Cluster Metadata: Creation Timestamp: 2026-02-12T03:14:53Z Finalizers: cluster.kubeblocks.io/finalizer Generation: 1 Resource Version: 107376 UID: f55d90cb-0f7e-453b-b2d1-eb776c9c0b42 Spec: Cluster Def: clickhouse Component Specs: Annotations: kubeblocks.io/restart: 2026-02-12T02:37:13Z Component Def: clickhouse-keeper-1.0.2 Disable Exporter: false Name: ch-keeper Pod Update Policy: PreferInPlace Replicas: 3 Resources: Limits: Cpu: 300m Memory: 2254857830400m Requests: Cpu: 300m Memory: 2254857830400m Service Version: 25.9.7 Services: Name: default Pod Service: false Service Type: ClusterIP System Accounts: Disabled: false Name: admin Password Config: Length: 10 Letter Case: MixedCases Num Digits: 5 Num Symbols: 0 Seed: clkhouse-ubczqv Volume Claim Templates: Name: data Spec: Access Modes: ReadWriteOnce Resources: Requests: Storage: 25Gi Shardings: Name: clickhouse Sharding Def: clickhouse Shards: 2 Template: Annotations: kubeblocks.io/restart: 2026-02-12T02:35:47Z Component Def: clickhouse-1.0.2 Disable Exporter: false Env: Name: INIT_CLUSTER_NAME Value: default Name: clickhouse Pod Update Policy: PreferInPlace Replicas: 2 Resources: Limits: Cpu: 300m Memory: 2254857830400m Requests: Cpu: 300m Memory: 2254857830400m Service Version: 25.9.7 Services: Name: default Pod Service: false Service Type: ClusterIP System Accounts: Disabled: false Name: admin Password Config: Length: 10 Letter Case: MixedCases Num Digits: 5 Num Symbols: 0 Seed: clkhouse-ubczqv Volume Claim Templates: Name: data Spec: Access Modes: ReadWriteOnce Resources: Requests: Storage: 30Gi Termination Policy: WipeOut Topology: cluster Status: Components: Ch - Keeper: Observed Generation: 1 Phase: Running Up To Date: true Conditions: Last Transition Time: 2026-02-12T03:14:53Z Message: The operator has started the provisioning of Cluster: clkhouse-ubczqv-backup Observed Generation: 1 Reason: PreCheckSucceed Status: True Type: ProvisioningStarted Last Transition Time: 2026-02-12T03:14:53Z Message: Successfully applied for resources Observed Generation: 1 Reason: ApplyResourcesSucceed Status: True Type: ApplyResources Last Transition Time: 2026-02-12T03:28:49Z Message: cluster clkhouse-ubczqv-backup is ready Reason: ClusterReady Status: True Type: Ready Observed Generation: 1 Phase: Running Shardings: Clickhouse: Observed Generation: 1 Phase: Running Up To Date: true Events: Type Reason Age From Message ---- ------ ---- ---- ------- Normal PreCheckSucceed 22m cluster-controller The operator has started the provisioning of Cluster: clkhouse-ubczqv-backup Normal ApplyResourcesSucceed 22m cluster-controller Successfully applied for resources Normal ClusterComponentPhaseTransition 11m (x10 over 22m) cluster-controller cluster component ch-keeper is Creating Warning ReconcileBackupPolicyFail 11m (x18 over 22m) backup-policy-driver-controller failed to reconcile: sharding components clickhouse not found Normal ClusterComponentPhaseTransition 9m5s (x7 over 9m7s) cluster-controller cluster sharding clickhouse is Creating Normal ClusterComponentPhaseTransition 20s (x24 over 9m7s) cluster-controller cluster component ch-keeper is Running Normal ClusterComponentPhaseTransition 20s (x8 over 8m11s) cluster-controller cluster sharding clickhouse is Running ------------------------------------------------------------------------------------------------------------------ check backup restore post ready post_ready_pod_exists:(B post_ready_pod_exists:(B post_ready_pod_exists:(B post_ready_pod_exists:(B post_ready_pod_exists:(B post_ready_pod_exists:(B post_ready_pod_exists:(B post_ready_pod_exists:(B post_ready_pod_exists:(B post_ready_pod_exists:(B post_ready_pod_exists:(B post_ready_pod_exists:(B post_ready_pod_exists:(B post_ready_pod_exists:(B post_ready_pod_exists:(B post_ready_pod_exists:(B post_ready_pod_exists:(B post_ready_pod_exists:(B post_ready_pod_exists:(B post_ready_pod_exists:(B post_ready_pod_exists:(B post_ready_pod_exists:(B post_ready_pod_exists:(B post_ready_pod_exists:(B post_ready_pod_exists:(B check backup restore post ready exists timeout(B check backup restore post ready done(B  `kbcli cluster describe-backup --names backup-ns-ezujo-clkhouse-ubczqv-20260212111425 --namespace ns-ezujo `(B  Name: backup-ns-ezujo-clkhouse-ubczqv-20260212111425 Cluster: clkhouse-ubczqv Namespace: ns-ezujo Spec: Method: full Policy Name: clkhouse-ubczqv-clickhouse-backup-policy Actions: dp-backup-clickhouse-hq2-0: ActionType: Job WorkloadName: dp-backup-clickhouse-hq2-0-backup-ns-ezujo-clkhouse-ubczqv-2026 TargetPodName: clkhouse-ubczqv-clickhouse-hq2-0 Phase: Completed Start Time: Feb 12,2026 11:14 UTC+0800 Completion Time: Feb 12,2026 11:14 UTC+0800 dp-backup-clickhouse-ffp-0: ActionType: Job WorkloadName: dp-backup-clickhouse-ffp-0-backup-ns-ezujo-clkhouse-ubczqv-2026 TargetPodName: clkhouse-ubczqv-clickhouse-ffp-0 Phase: Completed Start Time: Feb 12,2026 11:14 UTC+0800 Completion Time: Feb 12,2026 11:14 UTC+0800 Status: Phase: Completed Total Size: 33416 ActionSet Name: clickhouse-full-backup Repository: backuprepo-kbcli-test Duration: 23s Start Time: Feb 12,2026 11:14 UTC+0800 Completion Time: Feb 12,2026 11:14 UTC+0800 Path: /ns-ezujo/clkhouse-ubczqv-a94ed3b3-0fe9-4495-9438-a75d29939320/clickhouse/backup-ns-ezujo-clkhouse-ubczqv-20260212111425 Warning Events: delete cluster clkhouse-ubczqv-backup  `kbcli cluster delete clkhouse-ubczqv-backup --auto-approve --namespace ns-ezujo `(B  pod_info:clkhouse-ubczqv-backup-ch-keeper-0 2/2 Running 0 19m clkhouse-ubczqv-backup-ch-keeper-1 2/2 Running 0 19m clkhouse-ubczqv-backup-ch-keeper-2 2/2 Running 0 19m clkhouse-ubczqv-backup-clickhouse-jch-0 2/2 Running 1 (10m ago) 11m clkhouse-ubczqv-backup-clickhouse-jch-1 2/2 Running 0 11m clkhouse-ubczqv-backup-clickhouse-ntn-0 2/2 Running 0 11m clkhouse-ubczqv-backup-clickhouse-ntn-1 2/2 Running 0 11m Cluster clkhouse-ubczqv-backup deleted pod_info:clkhouse-ubczqv-backup-ch-keeper-0 2/2 Terminating 0 19m delete cluster pod done(B check cluster resource non-exist OK: pvc(B delete cluster done(B cluster delete backup  `kubectl patch -p '{"metadata":{"finalizers":[]}}' --type=merge backups backup-ns-ezujo-clkhouse-ubczqv-20260212111425 --namespace ns-ezujo `(B  backup.dataprotection.kubeblocks.io/backup-ns-ezujo-clkhouse-ubczqv-20260212111425 patched  `kbcli cluster delete-backup clkhouse-ubczqv --name backup-ns-ezujo-clkhouse-ubczqv-20260212111425 --force --auto-approve --namespace ns-ezujo `(B  Backup backup-ns-ezujo-clkhouse-ubczqv-20260212111425 deleted get cluster clkhouse-ubczqv shard clickhouse component name  `kubectl get component -l "app.kubernetes.io/instance=clkhouse-ubczqv,apps.kubeblocks.io/sharding-name=clickhouse" --namespace ns-ezujo`(B  set shard component name:clickhouse-ffp cluster list-logs  `kbcli cluster list-logs clkhouse-ubczqv --component clickhouse-ffp --namespace ns-ezujo `(B  cluster logs  `kbcli cluster logs clkhouse-ubczqv --tail 30 --namespace ns-ezujo `(B  2026.02.12 03:37:28.900124 [ 68 ] {} KeeperTCPHandler: Receiving request for session 63 took 9993 ms 2026.02.12 03:37:30.294842 [ 67 ] {} KeeperTCPHandler: Receiving request for session 62 took 9993 ms 2026.02.12 03:37:38.900135 [ 68 ] {} KeeperTCPHandler: Receiving request for session 63 took 9993 ms 2026.02.12 03:37:40.294843 [ 67 ] {} KeeperTCPHandler: Receiving request for session 62 took 9993 ms 2026.02.12 03:37:48.900116 [ 68 ] {} KeeperTCPHandler: Receiving request for session 63 took 9993 ms 2026.02.12 03:37:50.294868 [ 67 ] {} KeeperTCPHandler: Receiving request for session 62 took 9989 ms 2026.02.12 03:37:58.900163 [ 68 ] {} KeeperTCPHandler: Receiving request for session 63 took 9993 ms 2026.02.12 03:38:00.294887 [ 67 ] {} KeeperTCPHandler: Receiving request for session 62 took 9991 ms 2026.02.12 03:38:08.900857 [ 68 ] {} KeeperTCPHandler: Receiving request for session 63 took 9993 ms 2026.02.12 03:38:10.294863 [ 67 ] {} KeeperTCPHandler: Receiving request for session 62 took 9991 ms 2026.02.12 03:38:18.900147 [ 68 ] {} KeeperTCPHandler: Receiving request for session 63 took 9988 ms 2026.02.12 03:38:20.294807 [ 67 ] {} KeeperTCPHandler: Receiving request for session 62 took 9993 ms 2026.02.12 03:38:28.900131 [ 68 ] {} KeeperTCPHandler: Receiving request for session 63 took 9989 ms 2026.02.12 03:38:30.294912 [ 67 ] {} KeeperTCPHandler: Receiving request for session 62 took 9992 ms 2026.02.12 03:38:38.900124 [ 68 ] {} KeeperTCPHandler: Receiving request for session 63 took 9992 ms 2026.02.12 03:38:40.294954 [ 67 ] {} KeeperTCPHandler: Receiving request for session 62 took 9992 ms 2026.02.12 03:38:48.900135 [ 68 ] {} KeeperTCPHandler: Receiving request for session 63 took 9992 ms 2026.02.12 03:38:50.295685 [ 67 ] {} KeeperTCPHandler: Receiving request for session 62 took 9980 ms 2026.02.12 03:38:58.900137 [ 68 ] {} KeeperTCPHandler: Receiving request for session 63 took 9959 ms 2026.02.12 03:39:00.294834 [ 67 ] {} KeeperTCPHandler: Receiving request for session 62 took 9992 ms 2026.02.12 03:39:08.900135 [ 68 ] {} KeeperTCPHandler: Receiving request for session 63 took 9992 ms 2026.02.12 03:39:10.294892 [ 67 ] {} KeeperTCPHandler: Receiving request for session 62 took 9994 ms 2026.02.12 03:39:18.900157 [ 68 ] {} KeeperTCPHandler: Receiving request for session 63 took 9992 ms 2026.02.12 03:39:20.295612 [ 67 ] {} KeeperTCPHandler: Receiving request for session 62 took 9992 ms 2026.02.12 03:39:28.900148 [ 68 ] {} KeeperTCPHandler: Receiving request for session 63 took 9992 ms 2026.02.12 03:39:30.294918 [ 67 ] {} KeeperTCPHandler: Receiving request for session 62 took 9993 ms 2026.02.12 03:39:38.900138 [ 68 ] {} KeeperTCPHandler: Receiving request for session 63 took 9993 ms 2026.02.12 03:39:40.294974 [ 67 ] {} KeeperTCPHandler: Receiving request for session 62 took 9993 ms 2026.02.12 03:39:48.900133 [ 68 ] {} KeeperTCPHandler: Receiving request for session 63 took 9989 ms 2026.02.12 03:39:50.294879 [ 67 ] {} KeeperTCPHandler: Receiving request for session 62 took 9993 ms delete cluster clkhouse-ubczqv  `kbcli cluster delete clkhouse-ubczqv --auto-approve --namespace ns-ezujo `(B  pod_info:clkhouse-ubczqv-ch-keeper-0 2/2 Running 0 43m clkhouse-ubczqv-ch-keeper-1 2/2 Running 0 42m clkhouse-ubczqv-ch-keeper-2 2/2 Running 0 44m clkhouse-ubczqv-clickhouse-ffp-0 2/2 Running 7 (26m ago) 59m clkhouse-ubczqv-clickhouse-ffp-1 2/2 Running 0 59m clkhouse-ubczqv-clickhouse-hq2-0 2/2 Running 0 35m clkhouse-ubczqv-clickhouse-hq2-1 2/2 Running 0 35m Cluster clkhouse-ubczqv deleted pod_info:clkhouse-ubczqv-ch-keeper-1 2/2 Terminating 0 43m delete cluster pod done(B check cluster resource non-exist OK: pvc(B delete cluster done(B Clickhouse Test Suite All Done!(B Test Engine: clickhouse Test Type: 29 --------------------------------------Clickhouse 25.9.7 (Topology = cluster Replicas 2) Test Result-------------------------------------- [PASSED]|[Create]|[Topology=cluster;ComponentDefinition=clickhouse-1.0.2;ComponentVersion=clickhouse;ServiceVersion=25.9.7;]|[Description=Create a cluster with the specified topology cluster with the specified component definition clickhouse-1.0.2 and component version clickhouse and service version 25.9.7](B [PASSED]|[Connect]|[ComponentName=clickhouse-ffp]|[Description=Connect to the cluster](B [PASSED]|[NoFailover]|[HA=Connection Stress;ComponentName=clickhouse-ffp]|[Description=Simulates conditions where pods experience connection stress either due to expected/undesired processes thereby testing the application's resilience to potential slowness/unavailability of some replicas due to high Connection load.](B [PASSED]|[VolumeExpansion]|[ComponentName=ch-keeper]|[Description=VolumeExpansion the cluster specify component ch-keeper](B [PASSED]|[VerticalScaling]|[ComponentName=clickhouse]|[Description=VerticalScaling the cluster specify component clickhouse](B [PASSED]|[Restart]|[-]|[Description=Restart the cluster](B [PASSED]|[NoFailover]|[HA=Delete Pod;ComponentName=clickhouse-ffp]|[Description=Simulates conditions where pods terminating forced/graceful thereby testing deployment sanity (replica availability & uninterrupted service) and recovery workflow of the application.](B [PASSED]|[Restart]|[ComponentName=clickhouse]|[Description=Restart the cluster specify component clickhouse](B [PASSED]|[Restart]|[ComponentName=ch-keeper]|[Description=Restart the cluster specify component ch-keeper](B [PASSED]|[Stop]|[-]|[Description=Stop the cluster](B [PASSED]|[Start]|[-]|[Description=Start the cluster](B [PASSED]|[HorizontalScaling Out]|[ComponentName=clickhouse]|[Description=HorizontalScaling Out the cluster specify component clickhouse](B [PASSED]|[HorizontalScaling In]|[ComponentName=clickhouse]|[Description=HorizontalScaling In the cluster specify component clickhouse](B [PASSED]|[VerticalScaling]|[ComponentName=ch-keeper]|[Description=VerticalScaling the cluster specify component ch-keeper](B [PASSED]|[VolumeExpansion]|[ComponentName=clickhouse]|[Description=VolumeExpansion the cluster specify component clickhouse](B [PASSED]|[Scale Out Shard Post]|[ShardsName=clickhouse]|[Description=-](B [PASSED]|[HorizontalScaling Out]|[ShardsName=clickhouse]|[Description=HorizontalScaling Out the cluster](B [PASSED]|[HorizontalScaling In]|[ShardsName=clickhouse]|[Description=HorizontalScaling In the cluster](B [PASSED]|[Connect]|[Endpoints=true]|[Description=Connect to the cluster](B [PASSED]|[NoFailover]|[HA=Kill 1;ComponentName=clickhouse-ffp]|[Description=Simulates conditions where process 1 killed either due to expected/undesired processes thereby testing the application's resilience to unavailability of some replicas due to abnormal termination signals.](B [PASSED]|[Update]|[TerminationPolicy=WipeOut]|[Description=Update the cluster TerminationPolicy WipeOut](B [PASSED]|[Backup]|[BackupMethod=full]|[Description=The cluster full Backup](B [FAILED]|[Check Connect]|[-]|[Description=-](B [FAILED]|[Restore]|[BackupMethod=full]|[Description=The cluster full Restore](B [PASSED]|[Delete Restore Cluster]|[BackupMethod=full]|[Description=Delete the full restore cluster](B [PASSED]|[Delete]|[-]|[Description=Delete the cluster](B [END]