source commons files source engines files source kubeblocks files source kubedb files CLUSTER_NAME: `kubectl get namespace | grep ns-pkhtu ` `kubectl create namespace ns-pkhtu` namespace/ns-pkhtu created create namespace ns-pkhtu done download kbcli `gh release list --repo apecloud/kbcli --limit 100 | (grep "1.0" || true)` `curl -fsSL https://kubeblocks.io/installer/install_cli.sh | bash -s v1.0.1` Your system is linux_amd64 Installing kbcli ... Downloading ... % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 33.6M 100 33.6M 0 0 190M 0 --:--:-- --:--:-- --:--:-- 190M kbcli installed successfully. Kubernetes: v1.32.6 KubeBlocks: 1.0.1 kbcli: 1.0.1 Make sure your docker service is running and begin your journey with kbcli: kbcli playground init For more information on how to get started, please visit: https://kubeblocks.io download kbcli v1.0.1 done Kubernetes: v1.32.6 KubeBlocks: 1.0.1 kbcli: 1.0.1 Kubernetes Env: v1.32.6 check snapshot controller check snapshot controller done POD_RESOURCES: aks kb-default-sc found aks default-vsc found found default storage class: default KubeBlocks version is:1.0.1 skip upgrade KubeBlocks current KubeBlocks version: 1.0.1 Error: no repositories to show helm repo add chaos-mesh https://charts.chaos-mesh.org "chaos-mesh" has been added to your repositories add helm chart repo chaos-mesh success chaos mesh already installed create orchestrator cluster orcm-ipjffc check component definition set component name:orchestrator set orchestrator component definition set orchestrator component definition orchestrator-raft-1.0.1 LIMIT_CPU:0.5 LIMIT_MEMORY:0.5 storage size: 1 CLUSTER_NAME:orcm-ipjffc No resources found in ns-pkhtu namespace. pod_info: create 3 replica WipeOut orchestrator cluster check component definition set component definition by component version no component definitions found apiVersion: apps.kubeblocks.io/v1 kind: Cluster metadata: name: orcm-ipjffc namespace: ns-pkhtu spec: clusterDef: orchestrator topology: raft terminationPolicy: WipeOut services: - name: orchestrator componentSelector: orchestrator spec: ports: - name: orc-http port: 80 componentSpecs: - name: orchestrator serviceVersion: 3.2.6 replicas: 3 resources: requests: cpu: 500m memory: 0.5Gi limits: cpu: 500m memory: 0.5Gi volumeClaimTemplates: - name: data spec: storageClassName: accessModes: - ReadWriteOnce resources: requests: storage: 1Gi `kubectl apply -f test_create_orcm-ipjffc.yaml` cluster.apps.kubeblocks.io/orcm-ipjffc created apply test_create_orcm-ipjffc.yaml Success `rm -rf test_create_orcm-ipjffc.yaml` check cluster status `kbcli cluster list orcm-ipjffc --show-labels --namespace ns-pkhtu ` NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS orcm-ipjffc ns-pkhtu orchestrator WipeOut Creating Sep 11,2025 17:21 UTC+0800 clusterdefinition.kubeblocks.io/name=orchestrator cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances orcm-ipjffc --namespace ns-pkhtu ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME orcm-ipjffc-orchestrator-0 ns-pkhtu orcm-ipjffc orchestrator Running primary 0 500m / 500m 512Mi / 512Mi data:1Gi aks-cicdamdpool-40497330-vmss000001/10.224.0.7 Sep 11,2025 17:21 UTC+0800 orcm-ipjffc-orchestrator-1 ns-pkhtu orcm-ipjffc orchestrator Running secondary 0 500m / 500m 512Mi / 512Mi data:1Gi aks-cicdamdpool-40497330-vmss000000/10.224.0.6 Sep 11,2025 17:22 UTC+0800 orcm-ipjffc-orchestrator-2 ns-pkhtu orcm-ipjffc orchestrator Running secondary 0 500m / 500m 512Mi / 512Mi data:1Gi aks-cicdamdpool-40497330-vmss000002/10.224.0.5 Sep 11,2025 17:22 UTC+0800 check pod status done check cluster connect ` echo 'curl -s http://orcm-ipjffc-orchestrator:80/api/health ' | kubectl exec -it orcm-ipjffc-orchestrator-0 --namespace ns-pkhtu -- bash` check cluster connect done `kubectl get secrets -l app.kubernetes.io/instance=orcm-ipjffc` set secret: orcm-ipjffc-orchestrator-account-orchestrator `kubectl get secrets orcm-ipjffc-orchestrator-account-orchestrator -o jsonpath="***.data.username***"` `kubectl get secrets orcm-ipjffc-orchestrator-account-orchestrator -o jsonpath="***.data.password***"` `kubectl get secrets orcm-ipjffc-orchestrator-account-orchestrator -o jsonpath="***.data.port***"` DB_USERNAME:orchestrator;DB_PASSWORD:9X8zOhN88eDM4942;DB_PORT:;DB_DATABASE: check pod orcm-ipjffc-orchestrator-0 container_name orchestrator exist password 9X8zOhN88eDM4942 check pod orcm-ipjffc-orchestrator-0 container_name kbagent exist password 9X8zOhN88eDM4942 No container logs contain secret password. check component definition set component name:mysql set component version set component version:mysql set service versions:8.4.2,8.4.1,8.4.0,8.0.39,8.0.38,8.0.37,8.0.36,8.0.35,8.0.34,8.0.33,8.0.32,8.0.31,8.0.30,5.7.44 set service versions sorted:5.7.44,8.0.30,8.0.31,8.0.32,8.0.33,8.0.34,8.0.35,8.0.36,8.0.37,8.0.38,8.0.39,8.4.0,8.4.1,8.4.2 set mysql component definition set mysql component definition REPORT_COUNT 0:0 set replicas first:2,5.7.44|2,8.0.30|2,8.0.31|2,8.0.32|2,8.0.33|2,8.0.34|2,8.0.35|2,8.0.36|2,8.0.37|2,8.0.38|2,8.0.39 set replicas third:2,8.0.33 set replicas fourth:2,8.0.30 set minimum cmpv service version set minimum cmpv service version replicas:2,8.0.30 REPORT_COUNT:1 CLUSTER_TOPOLOGY:orc-proxysql topology orc-proxysql found in cluster definition mysql set mysql component definition set mysql component definition LIMIT_CPU:0.5 LIMIT_MEMORY:0.5 storage size: 10 CLUSTER_NAME:mysql-ipjffc No resources found in ns-pkhtu namespace. pod_info: termination_policy:DoNotTerminate create 2 replica DoNotTerminate mysql cluster check component definition set component definition by component version check cmpd by labels set component definition1: mysql-8.0-1.0.1 by component version:mysql apiVersion: apps.kubeblocks.io/v1 kind: Cluster metadata: name: mysql-ipjffc namespace: ns-pkhtu spec: clusterDef: mysql topology: orc-proxysql terminationPolicy: DoNotTerminate componentSpecs: - name: mysql serviceVersion: 8.0.30 env: - name: PROXY_ENABLED value: "on" disableExporter: true replicas: 2 resources: limits: cpu: 500m memory: 0.5Gi requests: cpu: 500m memory: 0.5Gi volumeClaimTemplates: - name: data spec: storageClassName: accessModes: - ReadWriteOnce resources: requests: storage: 10Gi serviceRefs: - name: orchestrator namespace: ns-pkhtu clusterServiceSelector: cluster: orcm-ipjffc service: component: orchestrator service: orchestrator port: orc-http credential: component: orchestrator name: orchestrator - name: proxysql replicas: 1 resources: limits: cpu: 500m memory: 0.5Gi requests: cpu: 500m memory: 0.5Gi `kubectl apply -f test_create_mysql-ipjffc.yaml` cluster.apps.kubeblocks.io/mysql-ipjffc created apply test_create_mysql-ipjffc.yaml Success `rm -rf test_create_mysql-ipjffc.yaml` check cluster status `kbcli cluster list mysql-ipjffc --show-labels --namespace ns-pkhtu ` NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS mysql-ipjffc ns-pkhtu mysql DoNotTerminate Creating Sep 11,2025 17:23 UTC+0800 clusterdefinition.kubeblocks.io/name=mysql cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances mysql-ipjffc --namespace ns-pkhtu ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME mysql-ipjffc-mysql-0 ns-pkhtu mysql-ipjffc mysql Running primary 0 500m / 500m 512Mi / 512Mi data:10Gi aks-cicdamdpool-40497330-vmss000000/10.224.0.6 Sep 11,2025 17:23 UTC+0800 mysql-ipjffc-mysql-1 ns-pkhtu mysql-ipjffc mysql Running secondary 0 500m / 500m 512Mi / 512Mi data:10Gi aks-cicdamdpool-40497330-vmss000002/10.224.0.5 Sep 11,2025 17:24 UTC+0800 mysql-ipjffc-proxysql-0 ns-pkhtu mysql-ipjffc proxysql Running 0 500m / 500m 512Mi / 512Mi aks-cicdamdpool-40497330-vmss000002/10.224.0.5 Sep 11,2025 17:25 UTC+0800 check pod status done check cluster role check cluster role done primary: mysql-ipjffc-mysql-0;secondary: mysql-ipjffc-mysql-1 `kubectl get secrets -l app.kubernetes.io/instance=mysql-ipjffc` set secret: mysql-ipjffc-mysql-account-root `kubectl get secrets mysql-ipjffc-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-ipjffc-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-ipjffc-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:2MLwgG6236;DB_PORT:3306;DB_DATABASE:mysql check cluster connect `echo " echo \"SHOW SLAVE STATUS\G;\" | mysql -P3306 -h127.0.0.1 -uroot -p'2MLwgG6236' " | kubectl exec -it mysql-ipjffc-mysql-1 --namespace ns-pkhtu -- bash ` check cluster connect done `kubectl get secrets -l app.kubernetes.io/instance=mysql-ipjffc` set secret: mysql-ipjffc-mysql-account-root `kubectl get secrets mysql-ipjffc-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-ipjffc-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-ipjffc-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:2MLwgG6236;DB_PORT:3306;DB_DATABASE:mysql check pod mysql-ipjffc-mysql-0 container_name mysql exist password 2MLwgG6236 check pod mysql-ipjffc-mysql-0 container_name kbagent exist password 2MLwgG6236 check pod mysql-ipjffc-mysql-0 container_name config-manager exist password 2MLwgG6236 No container logs contain secret password. describe cluster `kbcli cluster describe mysql-ipjffc --namespace ns-pkhtu ` Name: mysql-ipjffc Created Time: Sep 11,2025 17:23 UTC+0800 NAMESPACE CLUSTER-DEFINITION TOPOLOGY STATUS TERMINATION-POLICY ns-pkhtu mysql orc-proxysql Running DoNotTerminate Endpoints: COMPONENT INTERNAL EXTERNAL mysql mysql-ipjffc-mysql-0.ns-pkhtu.svc.cluster.local:3306 mysql-ipjffc-mysql-1.ns-pkhtu.svc.cluster.local:3306 mysql-ipjffc-mysql-server.ns-pkhtu.svc.cluster.local:3306 proxysql mysql-ipjffc-proxysql-proxy-ordinal-0.ns-pkhtu.svc.cluster.local:6032 mysql-ipjffc-proxysql-proxy-ordinal-0.ns-pkhtu.svc.cluster.local:6033 mysql-ipjffc-proxysql-proxy-server.ns-pkhtu.svc.cluster.local:6033 Topology: COMPONENT SERVICE-VERSION INSTANCE ROLE STATUS AZ NODE CREATED-TIME mysql 8.0.30 mysql-ipjffc-mysql-0 primary Running 0 aks-cicdamdpool-40497330-vmss000000/10.224.0.6 Sep 11,2025 17:23 UTC+0800 mysql 8.0.30 mysql-ipjffc-mysql-1 secondary Running 0 aks-cicdamdpool-40497330-vmss000002/10.224.0.5 Sep 11,2025 17:24 UTC+0800 proxysql 2.4.4 mysql-ipjffc-proxysql-0 Running 0 aks-cicdamdpool-40497330-vmss000002/10.224.0.5 Sep 11,2025 17:25 UTC+0800 Resources Allocation: COMPONENT INSTANCE-TEMPLATE CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE-SIZE STORAGE-CLASS mysql 500m / 500m 512Mi / 512Mi data:10Gi default proxysql 500m / 500m 512Mi / 512Mi Images: COMPONENT COMPONENT-DEFINITION IMAGE mysql mysql-orc-8.0-1.0.1 docker.io/apecloud/mysql:8.0.30 docker.io/apecloud/kubeblocks-tools:1.0.1 proxysql proxysql-mysql-1.0.1 docker.io/apecloud/proxysql:2.4.4 Data Protection: BACKUP-REPO AUTO-BACKUP BACKUP-SCHEDULE BACKUP-METHOD BACKUP-RETENTION RECOVERABLE-TIME Show cluster events: kbcli cluster list-events -n ns-pkhtu mysql-ipjffc `kbcli cluster label mysql-ipjffc app.kubernetes.io/instance- --namespace ns-pkhtu ` label "app.kubernetes.io/instance" not found. `kbcli cluster label mysql-ipjffc app.kubernetes.io/instance=mysql-ipjffc --namespace ns-pkhtu ` `kbcli cluster label mysql-ipjffc --list --namespace ns-pkhtu ` NAME NAMESPACE LABELS mysql-ipjffc ns-pkhtu app.kubernetes.io/instance=mysql-ipjffc clusterdefinition.kubeblocks.io/name=mysql label cluster app.kubernetes.io/instance=mysql-ipjffc Success `kbcli cluster label case.name=kbcli.test1 -l app.kubernetes.io/instance=mysql-ipjffc --namespace ns-pkhtu ` `kbcli cluster label mysql-ipjffc --list --namespace ns-pkhtu ` NAME NAMESPACE LABELS mysql-ipjffc ns-pkhtu app.kubernetes.io/instance=mysql-ipjffc case.name=kbcli.test1 clusterdefinition.kubeblocks.io/name=mysql label cluster case.name=kbcli.test1 Success `kbcli cluster label mysql-ipjffc case.name=kbcli.test2 --overwrite --namespace ns-pkhtu ` `kbcli cluster label mysql-ipjffc --list --namespace ns-pkhtu ` NAME NAMESPACE LABELS mysql-ipjffc ns-pkhtu app.kubernetes.io/instance=mysql-ipjffc case.name=kbcli.test2 clusterdefinition.kubeblocks.io/name=mysql label cluster case.name=kbcli.test2 Success `kbcli cluster label mysql-ipjffc case.name- --namespace ns-pkhtu ` `kbcli cluster label mysql-ipjffc --list --namespace ns-pkhtu ` NAME NAMESPACE LABELS mysql-ipjffc ns-pkhtu app.kubernetes.io/instance=mysql-ipjffc clusterdefinition.kubeblocks.io/name=mysql delete cluster label case.name Success cluster connect `kubectl get secrets -l app.kubernetes.io/instance=mysql-ipjffc` set secret: mysql-ipjffc-mysql-account-root `kubectl get secrets mysql-ipjffc-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-ipjffc-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-ipjffc-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:2MLwgG6236;DB_PORT:3306;DB_DATABASE:mysql Defaulted container "mysql" out of: mysql, kbagent, config-manager, init-data (init), init-jq (init), init-kbagent (init), kbagent-worker (init) Unable to use a TTY - input is not a terminal or the right kind of file Warning: arning] Using a password on the command line interface can be insecure. *************************** 1. row *************************** Slave_IO_State: Waiting for source to send event Master_Host: mysql-ipjffc-mysql-0.mysql-ipjffc-mysql-headless Master_User: root Master_Port: 3306 Connect_Retry: 1 Master_Log_File: mysql-ipjffc-mysql-0-bin.000003 Read_Master_Log_Pos: 3512 Relay_Log_File: relay-bin.000002 Relay_Log_Pos: 3758 Relay_Master_Log_File: mysql-ipjffc-mysql-0-bin.000003 Slave_IO_Running: Yes Slave_SQL_Running: Yes Replicate_Do_DB: Replicate_Ignore_DB: Replicate_Do_Table: Replicate_Ignore_Table: Replicate_Wild_Do_Table: Replicate_Wild_Ignore_Table: Last_Errno: 0 Last_Error: Skip_Counter: 0 Exec_Master_Log_Pos: 3512 Relay_Log_Space: 3962 Until_Condition: None Until_Log_File: Until_Log_Pos: 0 Master_SSL_Allowed: No Master_SSL_CA_File: Master_SSL_CA_Path: Master_SSL_Cert: Master_SSL_Cipher: Master_SSL_Key: Seconds_Behind_Master: 0 Master_SSL_Verify_Server_Cert: No Last_IO_Errno: 0 Last_IO_Error: Last_SQL_Errno: 0 Last_SQL_Error: Replicate_Ignore_Server_Ids: Master_Server_Id: 1 Master_UUID: 0c582975-8ef1-11f0-9ec7-9a57d1505195 Master_Info_File: mysql.slave_master_info SQL_Delay: 0 SQL_Remaining_Delay: NULL Slave_SQL_Running_State: Replica has read all relay log; waiting for more updates Master_Retry_Count: 86400 Master_Bind: Last_IO_Error_Timestamp: Last_SQL_Error_Timestamp: Master_SSL_Crl: Master_SSL_Crlpath: Retrieved_Gtid_Set: 0c582975-8ef1-11f0-9ec7-9a57d1505195:1-10 Executed_Gtid_Set: 0c582975-8ef1-11f0-9ec7-9a57d1505195:1-10 Auto_Position: 1 Replicate_Rewrite_DB: Channel_Name: Master_TLS_Version: Master_public_key_path: Get_master_public_key: 1 Network_Namespace: `echo " echo \"show variables like 'max_connections';\" | mysql -h127.0.0.1 -uroot -p2MLwgG6236 -P3306 " | kubectl exec -it mysql-ipjffc-mysql-1 --namespace ns-pkhtu -- bash ` Defaulted container "mysql" out of: mysql, kbagent, config-manager, init-data (init), init-jq (init), init-kbagent (init), kbagent-worker (init) Unable to use a TTY - input is not a terminal or the right kind of file Warning: arning] Using a password on the command line interface can be insecure. Variable_name Value max_connections 83 connect cluster Success set max_connections to 83 insert batch data by db client Error from server (NotFound): pods "test-db-client-executionloop-mysql-ipjffc" not found `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge pods test-db-client-executionloop-mysql-ipjffc --namespace ns-pkhtu ` Error from server (NotFound): pods "test-db-client-executionloop-mysql-ipjffc" not found Warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely. Error from server (NotFound): pods "test-db-client-executionloop-mysql-ipjffc" not found `kubectl get secrets -l app.kubernetes.io/instance=mysql-ipjffc` set secret: mysql-ipjffc-mysql-account-root `kubectl get secrets mysql-ipjffc-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-ipjffc-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-ipjffc-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:2MLwgG6236;DB_PORT:3306;DB_DATABASE:mysql apiVersion: v1 kind: Pod metadata: name: test-db-client-executionloop-mysql-ipjffc namespace: ns-pkhtu spec: containers: - name: test-dbclient imagePullPolicy: IfNotPresent image: docker.io/apecloud/dbclient:test args: - "--host" - "mysql-ipjffc-mysql-server.ns-pkhtu.svc.cluster.local" - "--user" - "root" - "--password" - "2MLwgG6236" - "--port" - "3306" - "--dbtype" - "mysql" - "--test" - "executionloop" - "--duration" - "60" - "--interval" - "1" restartPolicy: Never `kubectl apply -f test-db-client-executionloop-mysql-ipjffc.yaml` pod/test-db-client-executionloop-mysql-ipjffc created apply test-db-client-executionloop-mysql-ipjffc.yaml Success `rm -rf test-db-client-executionloop-mysql-ipjffc.yaml` check pod status pod_status:NAME READY STATUS RESTARTS AGE test-db-client-executionloop-mysql-ipjffc 1/1 Running 0 5s pod_status:NAME READY STATUS RESTARTS AGE test-db-client-executionloop-mysql-ipjffc 1/1 Running 0 9s pod_status:NAME READY STATUS RESTARTS AGE test-db-client-executionloop-mysql-ipjffc 1/1 Running 0 15s pod_status:NAME READY STATUS RESTARTS AGE test-db-client-executionloop-mysql-ipjffc 1/1 Running 0 20s pod_status:NAME READY STATUS RESTARTS AGE test-db-client-executionloop-mysql-ipjffc 1/1 Running 0 25s pod_status:NAME READY STATUS RESTARTS AGE test-db-client-executionloop-mysql-ipjffc 1/1 Running 0 30s pod_status:NAME READY STATUS RESTARTS AGE test-db-client-executionloop-mysql-ipjffc 1/1 Running 0 35s pod_status:NAME READY STATUS RESTARTS AGE test-db-client-executionloop-mysql-ipjffc 1/1 Running 0 40s pod_status:NAME READY STATUS RESTARTS AGE test-db-client-executionloop-mysql-ipjffc 1/1 Running 0 45s pod_status:NAME READY STATUS RESTARTS AGE test-db-client-executionloop-mysql-ipjffc 1/1 Running 0 50s pod_status:NAME READY STATUS RESTARTS AGE test-db-client-executionloop-mysql-ipjffc 1/1 Running 0 55s pod_status:NAME READY STATUS RESTARTS AGE test-db-client-executionloop-mysql-ipjffc 1/1 Running 0 60s check pod test-db-client-executionloop-mysql-ipjffc status done pod_status:NAME READY STATUS RESTARTS AGE test-db-client-executionloop-mysql-ipjffc 0/1 Completed 0 66s check cluster status `kbcli cluster list mysql-ipjffc --show-labels --namespace ns-pkhtu ` NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS mysql-ipjffc ns-pkhtu mysql DoNotTerminate Running Sep 11,2025 17:23 UTC+0800 app.kubernetes.io/instance=mysql-ipjffc,clusterdefinition.kubeblocks.io/name=mysql check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances mysql-ipjffc --namespace ns-pkhtu ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME mysql-ipjffc-mysql-0 ns-pkhtu mysql-ipjffc mysql Running primary 0 500m / 500m 512Mi / 512Mi data:10Gi aks-cicdamdpool-40497330-vmss000000/10.224.0.6 Sep 11,2025 17:23 UTC+0800 mysql-ipjffc-mysql-1 ns-pkhtu mysql-ipjffc mysql Running secondary 0 500m / 500m 512Mi / 512Mi data:10Gi aks-cicdamdpool-40497330-vmss000002/10.224.0.5 Sep 11,2025 17:24 UTC+0800 mysql-ipjffc-proxysql-0 ns-pkhtu mysql-ipjffc proxysql Running 0 500m / 500m 512Mi / 512Mi aks-cicdamdpool-40497330-vmss000002/10.224.0.5 Sep 11,2025 17:25 UTC+0800 check pod status done check cluster role check cluster role done primary: mysql-ipjffc-mysql-0;secondary: mysql-ipjffc-mysql-1 `kubectl get secrets -l app.kubernetes.io/instance=mysql-ipjffc` set secret: mysql-ipjffc-mysql-account-root `kubectl get secrets mysql-ipjffc-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-ipjffc-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-ipjffc-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:2MLwgG6236;DB_PORT:3306;DB_DATABASE:mysql check cluster connect `echo " echo \"SHOW SLAVE STATUS\G;\" | mysql -P3306 -h127.0.0.1 -uroot -p'2MLwgG6236' " | kubectl exec -it mysql-ipjffc-mysql-1 --namespace ns-pkhtu -- bash ` check cluster connect done --host mysql-ipjffc-mysql-server.ns-pkhtu.svc.cluster.local --user root --password 2MLwgG6236 --port 3306 --dbtype mysql --test executionloop --duration 60 --interval 1 SLF4J(I): Connected with provider of type [ch.qos.logback.classic.spi.LogbackServiceProvider] Execution loop start: create databases executions_loop CREATE DATABASE IF NOT EXISTS executions_loop; java.io.IOException: Failed to execute query: java.sql.SQLException: The MySQL server is running with the --super-read-only option so it cannot execute this statement [2025-09-11 09:26:09.329] Connection error occurred! create databases executions_loop CREATE DATABASE IF NOT EXISTS executions_loop; java.io.IOException: Failed to execute query: java.sql.SQLException: The MySQL server is running with the --super-read-only option so it cannot execute this statement [ 1s ] executions total: 2 successful: 0 failed: 2 disconnect: 1 create databases executions_loop CREATE DATABASE IF NOT EXISTS executions_loop; drop table executions_loop_table DROP TABLE IF EXISTS executions_loop.executions_loop_table; create table executions_loop_table CREATE TABLE IF NOT EXISTS executions_loop.executions_loop_table (id INT PRIMARY KEY AUTO_INCREMENT, value VARCHAR(255), tinyint_col TINYINT, smallint_col SMALLINT, mediumint_col MEDIUMINT, int_col INT, bigint_col BIGINT, float_col FLOAT, double_col DOUBLE, decimal_col DECIMAL(10, 2), date_col DATE, time_col TIME, datetime_col DATETIME, timestamp_col TIMESTAMP, year_col YEAR, char_col CHAR(10), text_col TEXT, blob_col BLOB, binary_col BINARY(10), varbinary_col VARBINARY(255), enum_col ENUM('Option1', 'Option2', 'Option3'), set_col SET('Value1', 'Value2', 'Value3') ); Execution loop start:INSERT INTO executions_loop.executions_loop_table (value, tinyint_col, smallint_col, mediumint_col, int_col, bigint_col, float_col, double_col, decimal_col, date_col, time_col, datetime_col, timestamp_col, year_col, char_col, text_col, blob_col, binary_col, varbinary_col, enum_col, set_col) VALUES ('executions_loop_test_1', 38, 18107, 5381614, -696802356, -2395668625684264275, 0.9419084, 0.621890596179794, 3.1155330023484584, '2025-09-11', '09:26:11', '2025-09-11 09:26:11.437', CURRENT_TIMESTAMP, 2115, 'czu4cbSEkr', 'E7MvFmV6Ku90AkovDzuemNL2ziN13zcCyRyJvm8KODyqaCSkWCUS0Q0LN6fLyyQOeUaiD90pUmstk2ZYgVnhyyNqN7XmKKWXhJRfkIq8PaTDAUYwnprZ6bpigxlaEo4WFZu9zRAfIc2sm20ByXfWkZfyaN2hKfggB1M4SYbYeBK4b9RbH2sm35rMQUUVWjrMMrZ93oW9xTAJZN2JEx9YXTytvESWY45Hy0UD0rpDY8BkywNORy96gTHkrkUfqER', UNHEX(REPLACE('fe86a3d13df30c0ec4b0', ' ', '')), UNHEX(REPLACE('b6ac25b42916e2270934', ' ', '')), UNHEX(REPLACE('541c31712e8ea04ff716493f733d49e5e95622cbcce4909db1c9d6d1948eee6e851cb670053da4d952df6189e8c7ad52c658923b53ca0e8a6eaa554966549ee76a1cfbae6c88f0f34ffa854dd00f97c816e7c660b7bb4e3e6004c33a4b7e08a75249a762fb84405bceff77b532698a9fd822cbe8597ca41d6b57253a26f5e5e40e0170df7c87a01cd6953165698562f1cf614c660e5f8c3cd96f9a916c00ad7371de14076d77faa91191c15aa64916720383faff9e409a7ed40e27a3a6045f4dd6d520b481f1e9134ea59df26bf513613e53ee9646525d94ed22a358f391df8b9961020c1f3a02bcffa5493511996a539001c85837b402f59890c4f283c2ae', ' ', '')), 'Option3', 'Value1' ); [2025-09-11 09:26:09.329] Connection error occurred! [2025-09-11 09:26:11.492] Connection successfully recovered! The connection was restored in 2163 milliseconds. [ 2s ] executions total: 3 successful: 1 failed: 2 disconnect: 1 [ 3s ] executions total: 67 successful: 65 failed: 2 disconnect: 1 [ 4s ] executions total: 135 successful: 133 failed: 2 disconnect: 1 [ 5s ] executions total: 209 successful: 207 failed: 2 disconnect: 1 [ 6s ] executions total: 283 successful: 281 failed: 2 disconnect: 1 [ 7s ] executions total: 354 successful: 352 failed: 2 disconnect: 1 [ 8s ] executions total: 428 successful: 426 failed: 2 disconnect: 1 [ 9s ] executions total: 502 successful: 500 failed: 2 disconnect: 1 [ 10s ] executions total: 572 successful: 570 failed: 2 disconnect: 1 [ 11s ] executions total: 646 successful: 644 failed: 2 disconnect: 1 [ 12s ] executions total: 718 successful: 716 failed: 2 disconnect: 1 [ 13s ] executions total: 766 successful: 764 failed: 2 disconnect: 1 [ 14s ] executions total: 842 successful: 840 failed: 2 disconnect: 1 [ 15s ] executions total: 916 successful: 914 failed: 2 disconnect: 1 [ 16s ] executions total: 990 successful: 988 failed: 2 disconnect: 1 [ 17s ] executions total: 1065 successful: 1063 failed: 2 disconnect: 1 [ 18s ] executions total: 1139 successful: 1137 failed: 2 disconnect: 1 [ 19s ] executions total: 1214 successful: 1212 failed: 2 disconnect: 1 [ 20s ] executions total: 1293 successful: 1291 failed: 2 disconnect: 1 [ 21s ] executions total: 1354 successful: 1352 failed: 2 disconnect: 1 [ 22s ] executions total: 1427 successful: 1425 failed: 2 disconnect: 1 [ 23s ] executions total: 1503 successful: 1501 failed: 2 disconnect: 1 [ 24s ] executions total: 1578 successful: 1576 failed: 2 disconnect: 1 [ 25s ] executions total: 1655 successful: 1653 failed: 2 disconnect: 1 [ 26s ] executions total: 1732 successful: 1730 failed: 2 disconnect: 1 [ 27s ] executions total: 1807 successful: 1805 failed: 2 disconnect: 1 [ 28s ] executions total: 1883 successful: 1881 failed: 2 disconnect: 1 [ 29s ] executions total: 1960 successful: 1958 failed: 2 disconnect: 1 [ 30s ] executions total: 2032 successful: 2030 failed: 2 disconnect: 1 [ 31s ] executions total: 2086 successful: 2084 failed: 2 disconnect: 1 [ 32s ] executions total: 2165 successful: 2163 failed: 2 disconnect: 1 [ 33s ] executions total: 2235 successful: 2233 failed: 2 disconnect: 1 [ 34s ] executions total: 2308 successful: 2306 failed: 2 disconnect: 1 [ 35s ] executions total: 2377 successful: 2375 failed: 2 disconnect: 1 [ 36s ] executions total: 2447 successful: 2445 failed: 2 disconnect: 1 [ 37s ] executions total: 2520 successful: 2518 failed: 2 disconnect: 1 [ 38s ] executions total: 2590 successful: 2588 failed: 2 disconnect: 1 [ 39s ] executions total: 2664 successful: 2662 failed: 2 disconnect: 1 [ 40s ] executions total: 2737 successful: 2735 failed: 2 disconnect: 1 [ 41s ] executions total: 2804 successful: 2802 failed: 2 disconnect: 1 [ 42s ] executions total: 2878 successful: 2876 failed: 2 disconnect: 1 [ 43s ] executions total: 2952 successful: 2950 failed: 2 disconnect: 1 [ 44s ] executions total: 3027 successful: 3025 failed: 2 disconnect: 1 [ 45s ] executions total: 3103 successful: 3101 failed: 2 disconnect: 1 [ 46s ] executions total: 3178 successful: 3176 failed: 2 disconnect: 1 [ 47s ] executions total: 3255 successful: 3253 failed: 2 disconnect: 1 [ 48s ] executions total: 3328 successful: 3326 failed: 2 disconnect: 1 [ 49s ] executions total: 3404 successful: 3402 failed: 2 disconnect: 1 [ 50s ] executions total: 3481 successful: 3479 failed: 2 disconnect: 1 [ 51s ] executions total: 3551 successful: 3549 failed: 2 disconnect: 1 [ 52s ] executions total: 3629 successful: 3627 failed: 2 disconnect: 1 [ 53s ] executions total: 3704 successful: 3702 failed: 2 disconnect: 1 [ 54s ] executions total: 3780 successful: 3778 failed: 2 disconnect: 1 [ 55s ] executions total: 3857 successful: 3855 failed: 2 disconnect: 1 [ 56s ] executions total: 3935 successful: 3933 failed: 2 disconnect: 1 [ 57s ] executions total: 4010 successful: 4008 failed: 2 disconnect: 1 [ 58s ] executions total: 4086 successful: 4084 failed: 2 disconnect: 1 [ 60s ] executions total: 4121 successful: 4119 failed: 2 disconnect: 1 Test Result: Total Executions: 4121 Successful Executions: 4119 Failed Executions: 2 Disconnection Counts: 1 Connection Information: Database Type: mysql Host: mysql-ipjffc-mysql-server.ns-pkhtu.svc.cluster.local Port: 3306 Database: Table: User: root Org: Access Mode: mysql Test Type: executionloop Query: Duration: 60 seconds Interval: 1 seconds DB_CLIENT_BATCH_DATA_COUNT: 4119 `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge pods test-db-client-executionloop-mysql-ipjffc --namespace ns-pkhtu ` pod/test-db-client-executionloop-mysql-ipjffc patched (no change) Warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely. pod "test-db-client-executionloop-mysql-ipjffc" force deleted `kubectl get secrets -l app.kubernetes.io/instance=mysql-ipjffc` set secret: mysql-ipjffc-mysql-account-root `kubectl get secrets mysql-ipjffc-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-ipjffc-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-ipjffc-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:2MLwgG6236;DB_PORT:3306;DB_DATABASE:mysql set db_client batch data count `echo "echo \"select count(*) from executions_loop.executions_loop_table;\" | mysql -P3306 -hmysql-ipjffc-mysql-server.ns-pkhtu.svc.cluster.local -uroot -p'2MLwgG6236' " | kubectl exec -it mysql-ipjffc-mysql-0 --namespace ns-pkhtu -- bash ` set db_client batch data Success LB_TYPE is set to: internet cluster expose check cluster status before ops check cluster status done cluster_status:Running `kbcli cluster expose mysql-ipjffc --auto-approve --force=true --type internet --enable true --components mysql --role-selector primary --namespace ns-pkhtu ` OpsRequest mysql-ipjffc-expose-5rvrn created successfully, you can view the progress: kbcli cluster describe-ops mysql-ipjffc-expose-5rvrn -n ns-pkhtu check ops status `kbcli cluster list-ops mysql-ipjffc --status all --namespace ns-pkhtu ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME mysql-ipjffc-expose-5rvrn ns-pkhtu Expose mysql-ipjffc Running -/- Sep 11,2025 17:27 UTC+0800 check cluster status `kbcli cluster list mysql-ipjffc --show-labels --namespace ns-pkhtu ` NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS mysql-ipjffc ns-pkhtu mysql DoNotTerminate Running Sep 11,2025 17:23 UTC+0800 app.kubernetes.io/instance=mysql-ipjffc,clusterdefinition.kubeblocks.io/name=mysql check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances mysql-ipjffc --namespace ns-pkhtu ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME mysql-ipjffc-mysql-0 ns-pkhtu mysql-ipjffc mysql Running primary 0 500m / 500m 512Mi / 512Mi data:10Gi aks-cicdamdpool-40497330-vmss000000/10.224.0.6 Sep 11,2025 17:23 UTC+0800 mysql-ipjffc-mysql-1 ns-pkhtu mysql-ipjffc mysql Running secondary 0 500m / 500m 512Mi / 512Mi data:10Gi aks-cicdamdpool-40497330-vmss000002/10.224.0.5 Sep 11,2025 17:24 UTC+0800 mysql-ipjffc-proxysql-0 ns-pkhtu mysql-ipjffc proxysql Running 0 500m / 500m 512Mi / 512Mi aks-cicdamdpool-40497330-vmss000002/10.224.0.5 Sep 11,2025 17:25 UTC+0800 check pod status done check cluster role check cluster role done primary: mysql-ipjffc-mysql-0;secondary: mysql-ipjffc-mysql-1 `kubectl get secrets -l app.kubernetes.io/instance=mysql-ipjffc` set secret: mysql-ipjffc-mysql-account-root `kubectl get secrets mysql-ipjffc-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-ipjffc-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-ipjffc-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:2MLwgG6236;DB_PORT:3306;DB_DATABASE:mysql check cluster connect `echo " echo \"SHOW SLAVE STATUS\G;\" | mysql -P3306 -h127.0.0.1 -uroot -p'2MLwgG6236' " | kubectl exec -it mysql-ipjffc-mysql-1 --namespace ns-pkhtu -- bash ` check cluster connect done check ops status `kbcli cluster list-ops mysql-ipjffc --status all --namespace ns-pkhtu ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME mysql-ipjffc-expose-5rvrn ns-pkhtu Expose mysql-ipjffc mysql Running 0/1 Sep 11,2025 17:27 UTC+0800 ops_status:mysql-ipjffc-expose-5rvrn ns-pkhtu Expose mysql-ipjffc mysql Running 0/1 Sep 11,2025 17:27 UTC+0800 ops_status:mysql-ipjffc-expose-5rvrn ns-pkhtu Expose mysql-ipjffc mysql Running 0/1 Sep 11,2025 17:27 UTC+0800 ops_status:mysql-ipjffc-expose-5rvrn ns-pkhtu Expose mysql-ipjffc mysql Running 0/1 Sep 11,2025 17:27 UTC+0800 ops_status:mysql-ipjffc-expose-5rvrn ns-pkhtu Expose mysql-ipjffc mysql Running 0/1 Sep 11,2025 17:27 UTC+0800 ops_status:mysql-ipjffc-expose-5rvrn ns-pkhtu Expose mysql-ipjffc mysql Running 0/1 Sep 11,2025 17:27 UTC+0800 ops_status:mysql-ipjffc-expose-5rvrn ns-pkhtu Expose mysql-ipjffc mysql Running 0/1 Sep 11,2025 17:27 UTC+0800 ops_status:mysql-ipjffc-expose-5rvrn ns-pkhtu Expose mysql-ipjffc mysql Running 0/1 Sep 11,2025 17:27 UTC+0800 ops_status:mysql-ipjffc-expose-5rvrn ns-pkhtu Expose mysql-ipjffc mysql Running 0/1 Sep 11,2025 17:27 UTC+0800 check ops status done ops_status:mysql-ipjffc-expose-5rvrn ns-pkhtu Expose mysql-ipjffc mysql Succeed 1/1 Sep 11,2025 17:27 UTC+0800 `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge opsrequests.operations mysql-ipjffc-expose-5rvrn --namespace ns-pkhtu ` opsrequest.operations.kubeblocks.io/mysql-ipjffc-expose-5rvrn patched `kbcli cluster delete-ops --name mysql-ipjffc-expose-5rvrn --force --auto-approve --namespace ns-pkhtu ` OpsRequest mysql-ipjffc-expose-5rvrn deleted `kubectl get secrets -l app.kubernetes.io/instance=mysql-ipjffc` set secret: mysql-ipjffc-mysql-account-root `kubectl get secrets mysql-ipjffc-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-ipjffc-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-ipjffc-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:2MLwgG6236;DB_PORT:3306;DB_DATABASE:mysql check db_client batch data count `echo "echo \"select count(*) from executions_loop.executions_loop_table;\" | mysql -P3306 -hmysql-ipjffc-mysql-server.ns-pkhtu.svc.cluster.local -uroot -p'2MLwgG6236' " | kubectl exec -it mysql-ipjffc-mysql-0 --namespace ns-pkhtu -- bash ` check db_client batch data Success `kubectl get secrets -l app.kubernetes.io/instance=mysql-ipjffc` set secret: mysql-ipjffc-mysql-account-root `kubectl get secrets mysql-ipjffc-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-ipjffc-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-ipjffc-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:2MLwgG6236;DB_PORT:3306;DB_DATABASE:mysql check readonly db_client batch data count `echo "echo \"select count(*) from executions_loop.executions_loop_table;\" | mysql -P3306 -h127.0.0.1 -uroot -p'2MLwgG6236' " | kubectl exec -it mysql-ipjffc-mysql-1 --namespace ns-pkhtu -- bash ` check readonly db_client batch data Success test failover dnserror check cluster status before cluster-failover-dnserror check cluster status done cluster_status:Running `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge DNSChaos test-chaos-mesh-dnserror-mysql-ipjffc --namespace ns-pkhtu ` Warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely. Error from server (NotFound): dnschaos.chaos-mesh.org "test-chaos-mesh-dnserror-mysql-ipjffc" not found Error from server (NotFound): dnschaos.chaos-mesh.org "test-chaos-mesh-dnserror-mysql-ipjffc" not found apiVersion: chaos-mesh.org/v1alpha1 kind: DNSChaos metadata: name: test-chaos-mesh-dnserror-mysql-ipjffc namespace: ns-pkhtu spec: selector: namespaces: - ns-pkhtu labelSelectors: apps.kubeblocks.io/pod-name: mysql-ipjffc-mysql-0 mode: all action: error duration: 2m `kubectl apply -f test-chaos-mesh-dnserror-mysql-ipjffc.yaml` dnschaos.chaos-mesh.org/test-chaos-mesh-dnserror-mysql-ipjffc created apply test-chaos-mesh-dnserror-mysql-ipjffc.yaml Success `rm -rf test-chaos-mesh-dnserror-mysql-ipjffc.yaml` dnserror chaos test waiting 120 seconds check cluster status `kbcli cluster list mysql-ipjffc --show-labels --namespace ns-pkhtu ` NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS mysql-ipjffc ns-pkhtu mysql DoNotTerminate Running Sep 11,2025 17:23 UTC+0800 app.kubernetes.io/instance=mysql-ipjffc,clusterdefinition.kubeblocks.io/name=mysql check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances mysql-ipjffc --namespace ns-pkhtu ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME mysql-ipjffc-mysql-0 ns-pkhtu mysql-ipjffc mysql Running primary 0 500m / 500m 512Mi / 512Mi data:10Gi aks-cicdamdpool-40497330-vmss000000/10.224.0.6 Sep 11,2025 17:23 UTC+0800 mysql-ipjffc-mysql-1 ns-pkhtu mysql-ipjffc mysql Running secondary 0 500m / 500m 512Mi / 512Mi data:10Gi aks-cicdamdpool-40497330-vmss000002/10.224.0.5 Sep 11,2025 17:24 UTC+0800 mysql-ipjffc-proxysql-0 ns-pkhtu mysql-ipjffc proxysql Running 0 500m / 500m 512Mi / 512Mi aks-cicdamdpool-40497330-vmss000002/10.224.0.5 Sep 11,2025 17:25 UTC+0800 check pod status done check cluster role check cluster role done primary: mysql-ipjffc-mysql-0;secondary: mysql-ipjffc-mysql-1 `kubectl get secrets -l app.kubernetes.io/instance=mysql-ipjffc` set secret: mysql-ipjffc-mysql-account-root `kubectl get secrets mysql-ipjffc-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-ipjffc-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-ipjffc-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:2MLwgG6236;DB_PORT:3306;DB_DATABASE:mysql check cluster connect `echo " echo \"SHOW SLAVE STATUS\G;\" | mysql -P3306 -h127.0.0.1 -uroot -p'2MLwgG6236' " | kubectl exec -it mysql-ipjffc-mysql-1 --namespace ns-pkhtu -- bash ` check cluster connect done `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge DNSChaos test-chaos-mesh-dnserror-mysql-ipjffc --namespace ns-pkhtu ` Warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely. dnschaos.chaos-mesh.org "test-chaos-mesh-dnserror-mysql-ipjffc" force deleted dnschaos.chaos-mesh.org/test-chaos-mesh-dnserror-mysql-ipjffc patched check failover pod name failover pod name:mysql-ipjffc-mysql-0 failover dnserror Success `kubectl get secrets -l app.kubernetes.io/instance=mysql-ipjffc` set secret: mysql-ipjffc-mysql-account-root `kubectl get secrets mysql-ipjffc-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-ipjffc-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-ipjffc-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:2MLwgG6236;DB_PORT:3306;DB_DATABASE:mysql check db_client batch data count `echo "echo \"select count(*) from executions_loop.executions_loop_table;\" | mysql -P3306 -hmysql-ipjffc-mysql-server.ns-pkhtu.svc.cluster.local -uroot -p'2MLwgG6236' " | kubectl exec -it mysql-ipjffc-mysql-0 --namespace ns-pkhtu -- bash ` check db_client batch data Success `kubectl get secrets -l app.kubernetes.io/instance=mysql-ipjffc` set secret: mysql-ipjffc-mysql-account-root `kubectl get secrets mysql-ipjffc-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-ipjffc-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-ipjffc-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:2MLwgG6236;DB_PORT:3306;DB_DATABASE:mysql check readonly db_client batch data count `echo "echo \"select count(*) from executions_loop.executions_loop_table;\" | mysql -P3306 -h127.0.0.1 -uroot -p'2MLwgG6236' " | kubectl exec -it mysql-ipjffc-mysql-1 --namespace ns-pkhtu -- bash ` check readonly db_client batch data Success LB_TYPE is set to: internet No resources found in ns-pkhtu namespace. `kubectl get secrets -l app.kubernetes.io/instance=mysql-ipjffc` set secret: mysql-ipjffc-mysql-account-root `kubectl get secrets mysql-ipjffc-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-ipjffc-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-ipjffc-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:2MLwgG6236;DB_PORT:3306;DB_DATABASE:mysql apiVersion: v1 kind: Pod metadata: name: benchtest-mysql-ipjffc namespace: ns-pkhtu spec: containers: - name: test-sysbench imagePullPolicy: IfNotPresent image: docker.io/apecloud/customsuites:latest env: - name: TYPE value: "2" - name: FLAG value: "0" - name: CONFIGS value: "mode:all,driver:mysql,host:4.156.152.8,user:root,password:2MLwgG6236,port:3306,db:benchtest,tables:5,threads:4,times:10,size:1000,type:oltp_read_write" restartPolicy: Never `kubectl apply -f benchtest-mysql-ipjffc.yaml` pod/benchtest-mysql-ipjffc created apply benchtest-mysql-ipjffc.yaml Success check pod status pod_status:NAME READY STATUS RESTARTS AGE benchtest-mysql-ipjffc 0/1 ContainerCreating 0 0s pod_status:NAME READY STATUS RESTARTS AGE benchtest-mysql-ipjffc 1/1 Running 0 4s pod_status:NAME READY STATUS RESTARTS AGE benchtest-mysql-ipjffc 1/1 Running 0 9s check pod benchtest-mysql-ipjffc status done pod_status:NAME READY STATUS RESTARTS AGE benchtest-mysql-ipjffc 0/1 Completed 0 14s `rm -rf benchtest-mysql-ipjffc.yaml` `kubectl logs benchtest-mysql-ipjffc --tail 30 --namespace ns-pkhtu ` [ 7s ] thds: 4 tps: 135.01 qps: 2704.17 (r/w/o: 1890.12/544.03/270.02) lat (ms,99%): 62.19 err/s: 0.00 reconn/s: 0.00 [ 8s ] thds: 4 tps: 118.99 qps: 2369.85 (r/w/o: 1665.89/465.97/237.98) lat (ms,99%): 74.46 err/s: 0.00 reconn/s: 0.00 [ 9s ] thds: 4 tps: 116.01 qps: 2321.13 (r/w/o: 1619.09/470.03/232.01) lat (ms,99%): 94.10 err/s: 0.00 reconn/s: 0.00 [ 10s ] thds: 4 tps: 117.00 qps: 2345.99 (r/w/o: 1642.99/469.00/234.00) lat (ms,99%): 65.65 err/s: 0.00 reconn/s: 0.00 SQL statistics: queries performed: read: 17164 write: 4904 other: 2452 total: 24520 transactions: 1226 (122.36 per sec.) queries: 24520 (2447.28 per sec.) ignored errors: 0 (0.00 per sec.) reconnects: 0 (0.00 per sec.) General statistics: total time: 10.0178s total number of events: 1226 Latency (ms): min: 9.32 avg: 32.66 max: 96.78 99th percentile: 68.05 sum: 40045.16 Threads fairness: events (avg/stddev): 306.5000/5.77 execution time (avg/stddev): 10.0113/0.00 `kubectl delete pod benchtest-mysql-ipjffc --force --namespace ns-pkhtu ` Warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely. pod "benchtest-mysql-ipjffc" force deleted test failover networkcorruptover check cluster status before cluster-failover-networkcorruptover check cluster status done cluster_status:Running `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge NetworkChaos test-chaos-mesh-networkcorruptover-mysql-ipjffc --namespace ns-pkhtu ` Warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely. Error from server (NotFound): networkchaos.chaos-mesh.org "test-chaos-mesh-networkcorruptover-mysql-ipjffc" not found Error from server (NotFound): networkchaos.chaos-mesh.org "test-chaos-mesh-networkcorruptover-mysql-ipjffc" not found apiVersion: chaos-mesh.org/v1alpha1 kind: NetworkChaos metadata: name: test-chaos-mesh-networkcorruptover-mysql-ipjffc namespace: ns-pkhtu spec: selector: namespaces: - ns-pkhtu labelSelectors: apps.kubeblocks.io/pod-name: mysql-ipjffc-mysql-0 mode: all action: corrupt corrupt: corrupt: '100' correlation: '100' direction: to duration: 2m `kubectl apply -f test-chaos-mesh-networkcorruptover-mysql-ipjffc.yaml` networkchaos.chaos-mesh.org/test-chaos-mesh-networkcorruptover-mysql-ipjffc created apply test-chaos-mesh-networkcorruptover-mysql-ipjffc.yaml Success `rm -rf test-chaos-mesh-networkcorruptover-mysql-ipjffc.yaml` networkcorruptover chaos test waiting 120 seconds check cluster status `kbcli cluster list mysql-ipjffc --show-labels --namespace ns-pkhtu ` NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS mysql-ipjffc ns-pkhtu mysql DoNotTerminate Running Sep 11,2025 17:23 UTC+0800 app.kubernetes.io/instance=mysql-ipjffc,clusterdefinition.kubeblocks.io/name=mysql check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances mysql-ipjffc --namespace ns-pkhtu ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME mysql-ipjffc-mysql-0 ns-pkhtu mysql-ipjffc mysql Running primary 0 500m / 500m 512Mi / 512Mi data:10Gi aks-cicdamdpool-40497330-vmss000000/10.224.0.6 Sep 11,2025 17:23 UTC+0800 mysql-ipjffc-mysql-1 ns-pkhtu mysql-ipjffc mysql Running primary 0 500m / 500m 512Mi / 512Mi data:10Gi aks-cicdamdpool-40497330-vmss000002/10.224.0.5 Sep 11,2025 17:24 UTC+0800 mysql-ipjffc-proxysql-0 ns-pkhtu mysql-ipjffc proxysql Running 0 500m / 500m 512Mi / 512Mi aks-cicdamdpool-40497330-vmss000002/10.224.0.5 Sep 11,2025 17:25 UTC+0800 check pod status done check cluster role No resources found in ns-pkhtu namespace. primary: mysql-ipjffc-mysql-0 mysql-ipjffc-mysql-1;secondary: No resources found in ns-pkhtu namespace. primary: mysql-ipjffc-mysql-0 mysql-ipjffc-mysql-1;secondary: check cluster role done primary: mysql-ipjffc-mysql-1;secondary: mysql-ipjffc-mysql-0 `kubectl get secrets -l app.kubernetes.io/instance=mysql-ipjffc` set secret: mysql-ipjffc-mysql-account-root `kubectl get secrets mysql-ipjffc-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-ipjffc-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-ipjffc-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:2MLwgG6236;DB_PORT:3306;DB_DATABASE:mysql check cluster connect `echo " echo \"SHOW SLAVE STATUS\G;\" | mysql -P3306 -h127.0.0.1 -uroot -p'2MLwgG6236' " | kubectl exec -it mysql-ipjffc-mysql-0 --namespace ns-pkhtu -- bash ` check cluster connect done `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge NetworkChaos test-chaos-mesh-networkcorruptover-mysql-ipjffc --namespace ns-pkhtu ` Warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely. networkchaos.chaos-mesh.org "test-chaos-mesh-networkcorruptover-mysql-ipjffc" force deleted networkchaos.chaos-mesh.org/test-chaos-mesh-networkcorruptover-mysql-ipjffc patched check failover pod name failover pod name:mysql-ipjffc-mysql-1 failover networkcorruptover Success `kubectl get secrets -l app.kubernetes.io/instance=mysql-ipjffc` set secret: mysql-ipjffc-mysql-account-root `kubectl get secrets mysql-ipjffc-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-ipjffc-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-ipjffc-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:2MLwgG6236;DB_PORT:3306;DB_DATABASE:mysql check db_client batch data count `echo "echo \"select count(*) from executions_loop.executions_loop_table;\" | mysql -P3306 -hmysql-ipjffc-mysql-server.ns-pkhtu.svc.cluster.local -uroot -p'2MLwgG6236' " | kubectl exec -it mysql-ipjffc-mysql-1 --namespace ns-pkhtu -- bash ` check db_client batch data Success `kubectl get secrets -l app.kubernetes.io/instance=mysql-ipjffc` set secret: mysql-ipjffc-mysql-account-root `kubectl get secrets mysql-ipjffc-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-ipjffc-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-ipjffc-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:2MLwgG6236;DB_PORT:3306;DB_DATABASE:mysql check readonly db_client batch data count `echo "echo \"select count(*) from executions_loop.executions_loop_table;\" | mysql -P3306 -h127.0.0.1 -uroot -p'2MLwgG6236' " | kubectl exec -it mysql-ipjffc-mysql-0 --namespace ns-pkhtu -- bash ` check readonly db_client batch data Success test failover fullcpu check cluster status before cluster-failover-fullcpu check cluster status done cluster_status:Running `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge StressChaos test-chaos-mesh-fullcpu-mysql-ipjffc --namespace ns-pkhtu ` Warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely. Error from server (NotFound): stresschaos.chaos-mesh.org "test-chaos-mesh-fullcpu-mysql-ipjffc" not found Error from server (NotFound): stresschaos.chaos-mesh.org "test-chaos-mesh-fullcpu-mysql-ipjffc" not found apiVersion: chaos-mesh.org/v1alpha1 kind: StressChaos metadata: name: test-chaos-mesh-fullcpu-mysql-ipjffc namespace: ns-pkhtu spec: selector: namespaces: - ns-pkhtu labelSelectors: apps.kubeblocks.io/pod-name: mysql-ipjffc-mysql-1 mode: all stressors: cpu: workers: 100 load: 100 duration: 2m `kubectl apply -f test-chaos-mesh-fullcpu-mysql-ipjffc.yaml` stresschaos.chaos-mesh.org/test-chaos-mesh-fullcpu-mysql-ipjffc created apply test-chaos-mesh-fullcpu-mysql-ipjffc.yaml Success `rm -rf test-chaos-mesh-fullcpu-mysql-ipjffc.yaml` fullcpu chaos test waiting 120 seconds check cluster status `kbcli cluster list mysql-ipjffc --show-labels --namespace ns-pkhtu ` NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS mysql-ipjffc ns-pkhtu mysql DoNotTerminate Running Sep 11,2025 17:23 UTC+0800 app.kubernetes.io/instance=mysql-ipjffc,clusterdefinition.kubeblocks.io/name=mysql check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances mysql-ipjffc --namespace ns-pkhtu ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME mysql-ipjffc-mysql-0 ns-pkhtu mysql-ipjffc mysql Running secondary 0 500m / 500m 512Mi / 512Mi data:10Gi aks-cicdamdpool-40497330-vmss000000/10.224.0.6 Sep 11,2025 17:23 UTC+0800 mysql-ipjffc-mysql-1 ns-pkhtu mysql-ipjffc mysql Running primary 0 500m / 500m 512Mi / 512Mi data:10Gi aks-cicdamdpool-40497330-vmss000002/10.224.0.5 Sep 11,2025 17:24 UTC+0800 mysql-ipjffc-proxysql-0 ns-pkhtu mysql-ipjffc proxysql Running 0 500m / 500m 512Mi / 512Mi aks-cicdamdpool-40497330-vmss000002/10.224.0.5 Sep 11,2025 17:25 UTC+0800 check pod status done check cluster role check cluster role done primary: mysql-ipjffc-mysql-1;secondary: mysql-ipjffc-mysql-0 `kubectl get secrets -l app.kubernetes.io/instance=mysql-ipjffc` set secret: mysql-ipjffc-mysql-account-root `kubectl get secrets mysql-ipjffc-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-ipjffc-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-ipjffc-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:2MLwgG6236;DB_PORT:3306;DB_DATABASE:mysql check cluster connect `echo " echo \"SHOW SLAVE STATUS\G;\" | mysql -P3306 -h127.0.0.1 -uroot -p'2MLwgG6236' " | kubectl exec -it mysql-ipjffc-mysql-0 --namespace ns-pkhtu -- bash ` check cluster connect done `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge StressChaos test-chaos-mesh-fullcpu-mysql-ipjffc --namespace ns-pkhtu ` Warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely. stresschaos.chaos-mesh.org "test-chaos-mesh-fullcpu-mysql-ipjffc" force deleted stresschaos.chaos-mesh.org/test-chaos-mesh-fullcpu-mysql-ipjffc patched check failover pod name failover pod name:mysql-ipjffc-mysql-1 failover fullcpu Success `kubectl get secrets -l app.kubernetes.io/instance=mysql-ipjffc` set secret: mysql-ipjffc-mysql-account-root `kubectl get secrets mysql-ipjffc-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-ipjffc-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-ipjffc-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:2MLwgG6236;DB_PORT:3306;DB_DATABASE:mysql check db_client batch data count `echo "echo \"select count(*) from executions_loop.executions_loop_table;\" | mysql -P3306 -hmysql-ipjffc-mysql-server.ns-pkhtu.svc.cluster.local -uroot -p'2MLwgG6236' " | kubectl exec -it mysql-ipjffc-mysql-1 --namespace ns-pkhtu -- bash ` check db_client batch data Success `kubectl get secrets -l app.kubernetes.io/instance=mysql-ipjffc` set secret: mysql-ipjffc-mysql-account-root `kubectl get secrets mysql-ipjffc-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-ipjffc-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-ipjffc-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:2MLwgG6236;DB_PORT:3306;DB_DATABASE:mysql check readonly db_client batch data count `echo "echo \"select count(*) from executions_loop.executions_loop_table;\" | mysql -P3306 -h127.0.0.1 -uroot -p'2MLwgG6236' " | kubectl exec -it mysql-ipjffc-mysql-0 --namespace ns-pkhtu -- bash ` check readonly db_client batch data Success test failover networkpartition check cluster status before cluster-failover-networkpartition check cluster status done cluster_status:Running `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge NetworkChaos test-chaos-mesh-networkpartition-mysql-ipjffc --namespace ns-pkhtu ` Warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely. Error from server (NotFound): networkchaos.chaos-mesh.org "test-chaos-mesh-networkpartition-mysql-ipjffc" not found Error from server (NotFound): networkchaos.chaos-mesh.org "test-chaos-mesh-networkpartition-mysql-ipjffc" not found apiVersion: chaos-mesh.org/v1alpha1 kind: NetworkChaos metadata: name: test-chaos-mesh-networkpartition-mysql-ipjffc namespace: ns-pkhtu spec: selector: namespaces: - ns-pkhtu labelSelectors: apps.kubeblocks.io/pod-name: mysql-ipjffc-mysql-1 action: partition mode: all target: mode: all selector: namespaces: - ns-pkhtu labelSelectors: apps.kubeblocks.io/pod-name: mysql-ipjffc-mysql-0 direction: to duration: 2m `kubectl apply -f test-chaos-mesh-networkpartition-mysql-ipjffc.yaml` networkchaos.chaos-mesh.org/test-chaos-mesh-networkpartition-mysql-ipjffc created apply test-chaos-mesh-networkpartition-mysql-ipjffc.yaml Success `rm -rf test-chaos-mesh-networkpartition-mysql-ipjffc.yaml` networkpartition chaos test waiting 120 seconds check cluster status `kbcli cluster list mysql-ipjffc --show-labels --namespace ns-pkhtu ` NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS mysql-ipjffc ns-pkhtu mysql DoNotTerminate Running Sep 11,2025 17:23 UTC+0800 app.kubernetes.io/instance=mysql-ipjffc,clusterdefinition.kubeblocks.io/name=mysql check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances mysql-ipjffc --namespace ns-pkhtu ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME mysql-ipjffc-mysql-0 ns-pkhtu mysql-ipjffc mysql Running secondary 0 500m / 500m 512Mi / 512Mi data:10Gi aks-cicdamdpool-40497330-vmss000000/10.224.0.6 Sep 11,2025 17:23 UTC+0800 mysql-ipjffc-mysql-1 ns-pkhtu mysql-ipjffc mysql Running primary 0 500m / 500m 512Mi / 512Mi data:10Gi aks-cicdamdpool-40497330-vmss000002/10.224.0.5 Sep 11,2025 17:24 UTC+0800 mysql-ipjffc-proxysql-0 ns-pkhtu mysql-ipjffc proxysql Running 0 500m / 500m 512Mi / 512Mi aks-cicdamdpool-40497330-vmss000002/10.224.0.5 Sep 11,2025 17:25 UTC+0800 check pod status done check cluster role check cluster role done primary: mysql-ipjffc-mysql-1;secondary: mysql-ipjffc-mysql-0 `kubectl get secrets -l app.kubernetes.io/instance=mysql-ipjffc` set secret: mysql-ipjffc-mysql-account-root `kubectl get secrets mysql-ipjffc-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-ipjffc-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-ipjffc-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:2MLwgG6236;DB_PORT:3306;DB_DATABASE:mysql check cluster connect `echo " echo \"SHOW SLAVE STATUS\G;\" | mysql -P3306 -h127.0.0.1 -uroot -p'2MLwgG6236' " | kubectl exec -it mysql-ipjffc-mysql-0 --namespace ns-pkhtu -- bash ` check cluster connect done `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge NetworkChaos test-chaos-mesh-networkpartition-mysql-ipjffc --namespace ns-pkhtu ` Warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely. networkchaos.chaos-mesh.org "test-chaos-mesh-networkpartition-mysql-ipjffc" force deleted Error from server (NotFound): networkchaos.chaos-mesh.org "test-chaos-mesh-networkpartition-mysql-ipjffc" not found check failover pod name failover pod name:mysql-ipjffc-mysql-1 failover networkpartition Success `kubectl get secrets -l app.kubernetes.io/instance=mysql-ipjffc` set secret: mysql-ipjffc-mysql-account-root `kubectl get secrets mysql-ipjffc-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-ipjffc-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-ipjffc-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:2MLwgG6236;DB_PORT:3306;DB_DATABASE:mysql check db_client batch data count `echo "echo \"select count(*) from executions_loop.executions_loop_table;\" | mysql -P3306 -hmysql-ipjffc-mysql-server.ns-pkhtu.svc.cluster.local -uroot -p'2MLwgG6236' " | kubectl exec -it mysql-ipjffc-mysql-1 --namespace ns-pkhtu -- bash ` check db_client batch data Success `kubectl get secrets -l app.kubernetes.io/instance=mysql-ipjffc` set secret: mysql-ipjffc-mysql-account-root `kubectl get secrets mysql-ipjffc-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-ipjffc-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-ipjffc-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:2MLwgG6236;DB_PORT:3306;DB_DATABASE:mysql check readonly db_client batch data count `echo "echo \"select count(*) from executions_loop.executions_loop_table;\" | mysql -P3306 -h127.0.0.1 -uroot -p'2MLwgG6236' " | kubectl exec -it mysql-ipjffc-mysql-0 --namespace ns-pkhtu -- bash ` check readonly db_client batch data Success test failover dnsrandom check cluster status before cluster-failover-dnsrandom check cluster status done cluster_status:Running `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge DNSChaos test-chaos-mesh-dnsrandom-mysql-ipjffc --namespace ns-pkhtu ` Warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely. Error from server (NotFound): dnschaos.chaos-mesh.org "test-chaos-mesh-dnsrandom-mysql-ipjffc" not found apiVersion: chaos-mesh.org/v1alpha1 kind: DNSChaos metadata: name: test-chaos-mesh-dnsrandom-mysql-ipjffc namespace: ns-pkhtu spec: selector: namespaces: - ns-pkhtu labelSelectors: apps.kubeblocks.io/pod-name: mysql-ipjffc-mysql-1 mode: all action: random duration: 2m `kubectl apply -f test-chaos-mesh-dnsrandom-mysql-ipjffc.yaml` Error from server (NotFound): dnschaos.chaos-mesh.org "test-chaos-mesh-dnsrandom-mysql-ipjffc" not found dnschaos.chaos-mesh.org/test-chaos-mesh-dnsrandom-mysql-ipjffc created apply test-chaos-mesh-dnsrandom-mysql-ipjffc.yaml Success `rm -rf test-chaos-mesh-dnsrandom-mysql-ipjffc.yaml` dnsrandom chaos test waiting 120 seconds check cluster status `kbcli cluster list mysql-ipjffc --show-labels --namespace ns-pkhtu ` NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS mysql-ipjffc ns-pkhtu mysql DoNotTerminate Running Sep 11,2025 17:23 UTC+0800 app.kubernetes.io/instance=mysql-ipjffc,clusterdefinition.kubeblocks.io/name=mysql check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances mysql-ipjffc --namespace ns-pkhtu ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME mysql-ipjffc-mysql-0 ns-pkhtu mysql-ipjffc mysql Running secondary 0 500m / 500m 512Mi / 512Mi data:10Gi aks-cicdamdpool-40497330-vmss000000/10.224.0.6 Sep 11,2025 17:23 UTC+0800 mysql-ipjffc-mysql-1 ns-pkhtu mysql-ipjffc mysql Running primary 0 500m / 500m 512Mi / 512Mi data:10Gi aks-cicdamdpool-40497330-vmss000002/10.224.0.5 Sep 11,2025 17:24 UTC+0800 mysql-ipjffc-proxysql-0 ns-pkhtu mysql-ipjffc proxysql Running 0 500m / 500m 512Mi / 512Mi aks-cicdamdpool-40497330-vmss000002/10.224.0.5 Sep 11,2025 17:25 UTC+0800 check pod status done check cluster role check cluster role done primary: mysql-ipjffc-mysql-1;secondary: mysql-ipjffc-mysql-0 `kubectl get secrets -l app.kubernetes.io/instance=mysql-ipjffc` set secret: mysql-ipjffc-mysql-account-root `kubectl get secrets mysql-ipjffc-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-ipjffc-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-ipjffc-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:2MLwgG6236;DB_PORT:3306;DB_DATABASE:mysql check cluster connect `echo " echo \"SHOW SLAVE STATUS\G;\" | mysql -P3306 -h127.0.0.1 -uroot -p'2MLwgG6236' " | kubectl exec -it mysql-ipjffc-mysql-0 --namespace ns-pkhtu -- bash ` check cluster connect done `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge DNSChaos test-chaos-mesh-dnsrandom-mysql-ipjffc --namespace ns-pkhtu ` Warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely. dnschaos.chaos-mesh.org "test-chaos-mesh-dnsrandom-mysql-ipjffc" force deleted dnschaos.chaos-mesh.org/test-chaos-mesh-dnsrandom-mysql-ipjffc patched check failover pod name failover pod name:mysql-ipjffc-mysql-1 failover dnsrandom Success `kubectl get secrets -l app.kubernetes.io/instance=mysql-ipjffc` set secret: mysql-ipjffc-mysql-account-root `kubectl get secrets mysql-ipjffc-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-ipjffc-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-ipjffc-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:2MLwgG6236;DB_PORT:3306;DB_DATABASE:mysql check db_client batch data count `echo "echo \"select count(*) from executions_loop.executions_loop_table;\" | mysql -P3306 -hmysql-ipjffc-mysql-server.ns-pkhtu.svc.cluster.local -uroot -p'2MLwgG6236' " | kubectl exec -it mysql-ipjffc-mysql-1 --namespace ns-pkhtu -- bash ` check db_client batch data Success `kubectl get secrets -l app.kubernetes.io/instance=mysql-ipjffc` set secret: mysql-ipjffc-mysql-account-root `kubectl get secrets mysql-ipjffc-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-ipjffc-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-ipjffc-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:2MLwgG6236;DB_PORT:3306;DB_DATABASE:mysql check readonly db_client batch data count `echo "echo \"select count(*) from executions_loop.executions_loop_table;\" | mysql -P3306 -h127.0.0.1 -uroot -p'2MLwgG6236' " | kubectl exec -it mysql-ipjffc-mysql-0 --namespace ns-pkhtu -- bash ` check readonly db_client batch data Success skip cluster HorizontalScaling In `kubectl get pvc -l app.kubernetes.io/instance=mysql-ipjffc,apps.kubeblocks.io/component-name=mysql,apps.kubeblocks.io/vct-name=data --namespace ns-pkhtu ` cluster volume-expand check cluster status before ops check cluster status done cluster_status:Running No resources found in mysql-ipjffc namespace. `kbcli cluster volume-expand mysql-ipjffc --auto-approve --force=true --components mysql --volume-claim-templates data --storage 12Gi --namespace ns-pkhtu ` OpsRequest mysql-ipjffc-volumeexpansion-j2j7v created successfully, you can view the progress: kbcli cluster describe-ops mysql-ipjffc-volumeexpansion-j2j7v -n ns-pkhtu check ops status `kbcli cluster list-ops mysql-ipjffc --status all --namespace ns-pkhtu ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME mysql-ipjffc-volumeexpansion-j2j7v ns-pkhtu VolumeExpansion mysql-ipjffc mysql Creating -/- Sep 11,2025 17:40 UTC+0800 check cluster status `kbcli cluster list mysql-ipjffc --show-labels --namespace ns-pkhtu ` NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS mysql-ipjffc ns-pkhtu mysql DoNotTerminate Updating Sep 11,2025 17:23 UTC+0800 app.kubernetes.io/instance=mysql-ipjffc,clusterdefinition.kubeblocks.io/name=mysql cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances mysql-ipjffc --namespace ns-pkhtu ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME mysql-ipjffc-mysql-0 ns-pkhtu mysql-ipjffc mysql Running secondary 0 500m / 500m 512Mi / 512Mi data:12Gi aks-cicdamdpool-40497330-vmss000000/10.224.0.6 Sep 11,2025 17:23 UTC+0800 mysql-ipjffc-mysql-1 ns-pkhtu mysql-ipjffc mysql Running primary 0 500m / 500m 512Mi / 512Mi data:12Gi aks-cicdamdpool-40497330-vmss000002/10.224.0.5 Sep 11,2025 17:24 UTC+0800 mysql-ipjffc-proxysql-0 ns-pkhtu mysql-ipjffc proxysql Running 0 500m / 500m 512Mi / 512Mi aks-cicdamdpool-40497330-vmss000002/10.224.0.5 Sep 11,2025 17:25 UTC+0800 check pod status done check cluster role check cluster role done primary: mysql-ipjffc-mysql-1;secondary: mysql-ipjffc-mysql-0 `kubectl get secrets -l app.kubernetes.io/instance=mysql-ipjffc` set secret: mysql-ipjffc-mysql-account-root `kubectl get secrets mysql-ipjffc-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-ipjffc-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-ipjffc-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:2MLwgG6236;DB_PORT:3306;DB_DATABASE:mysql check cluster connect `echo " echo \"SHOW SLAVE STATUS\G;\" | mysql -P3306 -h127.0.0.1 -uroot -p'2MLwgG6236' " | kubectl exec -it mysql-ipjffc-mysql-0 --namespace ns-pkhtu -- bash ` check cluster connect done No resources found in mysql-ipjffc namespace. check ops status `kbcli cluster list-ops mysql-ipjffc --status all --namespace ns-pkhtu ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME mysql-ipjffc-volumeexpansion-j2j7v ns-pkhtu VolumeExpansion mysql-ipjffc mysql Succeed 2/2 Sep 11,2025 17:40 UTC+0800 check ops status done ops_status:mysql-ipjffc-volumeexpansion-j2j7v ns-pkhtu VolumeExpansion mysql-ipjffc mysql Succeed 2/2 Sep 11,2025 17:40 UTC+0800 `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge opsrequests.operations mysql-ipjffc-volumeexpansion-j2j7v --namespace ns-pkhtu ` opsrequest.operations.kubeblocks.io/mysql-ipjffc-volumeexpansion-j2j7v patched `kbcli cluster delete-ops --name mysql-ipjffc-volumeexpansion-j2j7v --force --auto-approve --namespace ns-pkhtu ` OpsRequest mysql-ipjffc-volumeexpansion-j2j7v deleted `kubectl get secrets -l app.kubernetes.io/instance=mysql-ipjffc` set secret: mysql-ipjffc-mysql-account-root `kubectl get secrets mysql-ipjffc-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-ipjffc-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-ipjffc-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:2MLwgG6236;DB_PORT:3306;DB_DATABASE:mysql check db_client batch data count `echo "echo \"select count(*) from executions_loop.executions_loop_table;\" | mysql -P3306 -hmysql-ipjffc-mysql-server.ns-pkhtu.svc.cluster.local -uroot -p'2MLwgG6236' " | kubectl exec -it mysql-ipjffc-mysql-1 --namespace ns-pkhtu -- bash ` check db_client batch data Success `kubectl get secrets -l app.kubernetes.io/instance=mysql-ipjffc` set secret: mysql-ipjffc-mysql-account-root `kubectl get secrets mysql-ipjffc-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-ipjffc-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-ipjffc-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:2MLwgG6236;DB_PORT:3306;DB_DATABASE:mysql check readonly db_client batch data count `echo "echo \"select count(*) from executions_loop.executions_loop_table;\" | mysql -P3306 -h127.0.0.1 -uroot -p'2MLwgG6236' " | kubectl exec -it mysql-ipjffc-mysql-0 --namespace ns-pkhtu -- bash ` check readonly db_client batch data Success test failover oom check cluster status before cluster-failover-oom check cluster status done cluster_status:Running `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge StressChaos test-chaos-mesh-oom-mysql-ipjffc --namespace ns-pkhtu ` Warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely. Error from server (NotFound): stresschaos.chaos-mesh.org "test-chaos-mesh-oom-mysql-ipjffc" not found Error from server (NotFound): stresschaos.chaos-mesh.org "test-chaos-mesh-oom-mysql-ipjffc" not found apiVersion: chaos-mesh.org/v1alpha1 kind: StressChaos metadata: name: test-chaos-mesh-oom-mysql-ipjffc namespace: ns-pkhtu spec: selector: namespaces: - ns-pkhtu labelSelectors: apps.kubeblocks.io/pod-name: mysql-ipjffc-mysql-1 mode: all stressors: memory: workers: 1 size: "100GB" oomScoreAdj: -1000 duration: 2m `kubectl apply -f test-chaos-mesh-oom-mysql-ipjffc.yaml` stresschaos.chaos-mesh.org/test-chaos-mesh-oom-mysql-ipjffc created apply test-chaos-mesh-oom-mysql-ipjffc.yaml Success `rm -rf test-chaos-mesh-oom-mysql-ipjffc.yaml` check cluster status `kbcli cluster list mysql-ipjffc --show-labels --namespace ns-pkhtu ` NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS mysql-ipjffc ns-pkhtu mysql DoNotTerminate Updating Sep 11,2025 17:23 UTC+0800 app.kubernetes.io/instance=mysql-ipjffc,clusterdefinition.kubeblocks.io/name=mysql cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances mysql-ipjffc --namespace ns-pkhtu ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME mysql-ipjffc-mysql-0 ns-pkhtu mysql-ipjffc mysql Running secondary 0 500m / 500m 512Mi / 512Mi data:12Gi aks-cicdamdpool-40497330-vmss000000/10.224.0.6 Sep 11,2025 17:23 UTC+0800 mysql-ipjffc-mysql-1 ns-pkhtu mysql-ipjffc mysql Running secondary 0 500m / 500m 512Mi / 512Mi data:12Gi aks-cicdamdpool-40497330-vmss000002/10.224.0.5 Sep 11,2025 17:24 UTC+0800 mysql-ipjffc-proxysql-0 ns-pkhtu mysql-ipjffc proxysql Running 0 500m / 500m 512Mi / 512Mi aks-cicdamdpool-40497330-vmss000002/10.224.0.5 Sep 11,2025 17:25 UTC+0800 check pod status done check cluster role No resources found in ns-pkhtu namespace. primary: ;secondary: mysql-ipjffc-mysql-0 mysql-ipjffc-mysql-1 No resources found in ns-pkhtu namespace. primary: ;secondary: mysql-ipjffc-mysql-0 mysql-ipjffc-mysql-1 check cluster role done primary: mysql-ipjffc-mysql-0;secondary: mysql-ipjffc-mysql-1 `kubectl get secrets -l app.kubernetes.io/instance=mysql-ipjffc` set secret: mysql-ipjffc-mysql-account-root `kubectl get secrets mysql-ipjffc-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-ipjffc-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-ipjffc-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:2MLwgG6236;DB_PORT:3306;DB_DATABASE:mysql check cluster connect `echo " echo \"SHOW SLAVE STATUS\G;\" | mysql -P3306 -h127.0.0.1 -uroot -p'2MLwgG6236' " | kubectl exec -it mysql-ipjffc-mysql-1 --namespace ns-pkhtu -- bash ` check cluster connect done `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge StressChaos test-chaos-mesh-oom-mysql-ipjffc --namespace ns-pkhtu ` Warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely. stresschaos.chaos-mesh.org "test-chaos-mesh-oom-mysql-ipjffc" force deleted stresschaos.chaos-mesh.org/test-chaos-mesh-oom-mysql-ipjffc patched check failover pod name failover pod name:mysql-ipjffc-mysql-0 failover oom Success `kubectl get secrets -l app.kubernetes.io/instance=mysql-ipjffc` set secret: mysql-ipjffc-mysql-account-root `kubectl get secrets mysql-ipjffc-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-ipjffc-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-ipjffc-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:2MLwgG6236;DB_PORT:3306;DB_DATABASE:mysql check db_client batch data count `echo "echo \"select count(*) from executions_loop.executions_loop_table;\" | mysql -P3306 -hmysql-ipjffc-mysql-server.ns-pkhtu.svc.cluster.local -uroot -p'2MLwgG6236' " | kubectl exec -it mysql-ipjffc-mysql-0 --namespace ns-pkhtu -- bash ` check db_client batch data Success `kubectl get secrets -l app.kubernetes.io/instance=mysql-ipjffc` set secret: mysql-ipjffc-mysql-account-root `kubectl get secrets mysql-ipjffc-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-ipjffc-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-ipjffc-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:2MLwgG6236;DB_PORT:3306;DB_DATABASE:mysql check readonly db_client batch data count `echo "echo \"select count(*) from executions_loop.executions_loop_table;\" | mysql -P3306 -h127.0.0.1 -uroot -p'2MLwgG6236' " | kubectl exec -it mysql-ipjffc-mysql-1 --namespace ns-pkhtu -- bash ` check readonly db_client batch data Success test failover networkduplicate check cluster status before cluster-failover-networkduplicate check cluster status done cluster_status:Running `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge NetworkChaos test-chaos-mesh-networkduplicate-mysql-ipjffc --namespace ns-pkhtu ` Warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely. Error from server (NotFound): networkchaos.chaos-mesh.org "test-chaos-mesh-networkduplicate-mysql-ipjffc" not found Error from server (NotFound): networkchaos.chaos-mesh.org "test-chaos-mesh-networkduplicate-mysql-ipjffc" not found apiVersion: chaos-mesh.org/v1alpha1 kind: NetworkChaos metadata: name: test-chaos-mesh-networkduplicate-mysql-ipjffc namespace: ns-pkhtu spec: selector: namespaces: - ns-pkhtu labelSelectors: apps.kubeblocks.io/pod-name: mysql-ipjffc-mysql-0 mode: all action: duplicate duplicate: duplicate: '100' correlation: '100' direction: to duration: 2m `kubectl apply -f test-chaos-mesh-networkduplicate-mysql-ipjffc.yaml` networkchaos.chaos-mesh.org/test-chaos-mesh-networkduplicate-mysql-ipjffc created apply test-chaos-mesh-networkduplicate-mysql-ipjffc.yaml Success `rm -rf test-chaos-mesh-networkduplicate-mysql-ipjffc.yaml` networkduplicate chaos test waiting 120 seconds check cluster status `kbcli cluster list mysql-ipjffc --show-labels --namespace ns-pkhtu ` NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS mysql-ipjffc ns-pkhtu mysql DoNotTerminate Running Sep 11,2025 17:23 UTC+0800 app.kubernetes.io/instance=mysql-ipjffc,clusterdefinition.kubeblocks.io/name=mysql check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances mysql-ipjffc --namespace ns-pkhtu ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME mysql-ipjffc-mysql-0 ns-pkhtu mysql-ipjffc mysql Running primary 0 500m / 500m 512Mi / 512Mi data:12Gi aks-cicdamdpool-40497330-vmss000000/10.224.0.6 Sep 11,2025 17:23 UTC+0800 mysql-ipjffc-mysql-1 ns-pkhtu mysql-ipjffc mysql Running secondary 0 500m / 500m 512Mi / 512Mi data:12Gi aks-cicdamdpool-40497330-vmss000002/10.224.0.5 Sep 11,2025 17:24 UTC+0800 mysql-ipjffc-proxysql-0 ns-pkhtu mysql-ipjffc proxysql Running 0 500m / 500m 512Mi / 512Mi aks-cicdamdpool-40497330-vmss000002/10.224.0.5 Sep 11,2025 17:25 UTC+0800 check pod status done check cluster role check cluster role done primary: mysql-ipjffc-mysql-0;secondary: mysql-ipjffc-mysql-1 `kubectl get secrets -l app.kubernetes.io/instance=mysql-ipjffc` set secret: mysql-ipjffc-mysql-account-root `kubectl get secrets mysql-ipjffc-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-ipjffc-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-ipjffc-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:2MLwgG6236;DB_PORT:3306;DB_DATABASE:mysql check cluster connect `echo " echo \"SHOW SLAVE STATUS\G;\" | mysql -P3306 -h127.0.0.1 -uroot -p'2MLwgG6236' " | kubectl exec -it mysql-ipjffc-mysql-1 --namespace ns-pkhtu -- bash ` check cluster connect done `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge NetworkChaos test-chaos-mesh-networkduplicate-mysql-ipjffc --namespace ns-pkhtu ` Warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely. networkchaos.chaos-mesh.org "test-chaos-mesh-networkduplicate-mysql-ipjffc" force deleted networkchaos.chaos-mesh.org/test-chaos-mesh-networkduplicate-mysql-ipjffc patched check failover pod name failover pod name:mysql-ipjffc-mysql-0 failover networkduplicate Success `kubectl get secrets -l app.kubernetes.io/instance=mysql-ipjffc` set secret: mysql-ipjffc-mysql-account-root `kubectl get secrets mysql-ipjffc-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-ipjffc-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-ipjffc-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:2MLwgG6236;DB_PORT:3306;DB_DATABASE:mysql check db_client batch data count `echo "echo \"select count(*) from executions_loop.executions_loop_table;\" | mysql -P3306 -hmysql-ipjffc-mysql-server.ns-pkhtu.svc.cluster.local -uroot -p'2MLwgG6236' " | kubectl exec -it mysql-ipjffc-mysql-0 --namespace ns-pkhtu -- bash ` check db_client batch data Success `kubectl get secrets -l app.kubernetes.io/instance=mysql-ipjffc` set secret: mysql-ipjffc-mysql-account-root `kubectl get secrets mysql-ipjffc-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-ipjffc-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-ipjffc-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:2MLwgG6236;DB_PORT:3306;DB_DATABASE:mysql check readonly db_client batch data count `echo "echo \"select count(*) from executions_loop.executions_loop_table;\" | mysql -P3306 -h127.0.0.1 -uroot -p'2MLwgG6236' " | kubectl exec -it mysql-ipjffc-mysql-1 --namespace ns-pkhtu -- bash ` check readonly db_client batch data Success cluster does not need to check monitor currently check cluster status `kbcli cluster list mysql-ipjffc --show-labels --namespace ns-pkhtu ` NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS mysql-ipjffc ns-pkhtu mysql DoNotTerminate Running Sep 11,2025 17:23 UTC+0800 app.kubernetes.io/instance=mysql-ipjffc,clusterdefinition.kubeblocks.io/name=mysql check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances mysql-ipjffc --namespace ns-pkhtu ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME mysql-ipjffc-mysql-0 ns-pkhtu mysql-ipjffc mysql Running primary 0 500m / 500m 512Mi / 512Mi data:12Gi aks-cicdamdpool-40497330-vmss000000/10.224.0.6 Sep 11,2025 17:23 UTC+0800 mysql-ipjffc-mysql-1 ns-pkhtu mysql-ipjffc mysql Running secondary 0 500m / 500m 512Mi / 512Mi data:12Gi aks-cicdamdpool-40497330-vmss000002/10.224.0.5 Sep 11,2025 17:24 UTC+0800 mysql-ipjffc-proxysql-0 ns-pkhtu mysql-ipjffc proxysql Running 0 500m / 500m 512Mi / 512Mi aks-cicdamdpool-40497330-vmss000002/10.224.0.5 Sep 11,2025 17:25 UTC+0800 check pod status done check cluster role check cluster role done primary: mysql-ipjffc-mysql-0;secondary: mysql-ipjffc-mysql-1 `kubectl get secrets -l app.kubernetes.io/instance=mysql-ipjffc` set secret: mysql-ipjffc-mysql-account-root `kubectl get secrets mysql-ipjffc-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-ipjffc-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-ipjffc-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:2MLwgG6236;DB_PORT:3306;DB_DATABASE:mysql check cluster connect `echo " echo \"SHOW SLAVE STATUS\G;\" | mysql -P3306 -h127.0.0.1 -uroot -p'2MLwgG6236' " | kubectl exec -it mysql-ipjffc-mysql-1 --namespace ns-pkhtu -- bash ` check cluster connect done test failover networkbandwidthover check cluster status before cluster-failover-networkbandwidthover check cluster status done cluster_status:Running `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge NetworkChaos test-chaos-mesh-networkbandwidthover-mysql-ipjffc --namespace ns-pkhtu ` Warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely. Error from server (NotFound): networkchaos.chaos-mesh.org "test-chaos-mesh-networkbandwidthover-mysql-ipjffc" not found Error from server (NotFound): networkchaos.chaos-mesh.org "test-chaos-mesh-networkbandwidthover-mysql-ipjffc" not found apiVersion: chaos-mesh.org/v1alpha1 kind: NetworkChaos metadata: name: test-chaos-mesh-networkbandwidthover-mysql-ipjffc namespace: ns-pkhtu spec: selector: namespaces: - ns-pkhtu labelSelectors: apps.kubeblocks.io/pod-name: mysql-ipjffc-mysql-0 action: bandwidth mode: all bandwidth: rate: '1bps' limit: 20971520 buffer: 10000 duration: 2m `kubectl apply -f test-chaos-mesh-networkbandwidthover-mysql-ipjffc.yaml` networkchaos.chaos-mesh.org/test-chaos-mesh-networkbandwidthover-mysql-ipjffc created apply test-chaos-mesh-networkbandwidthover-mysql-ipjffc.yaml Success `rm -rf test-chaos-mesh-networkbandwidthover-mysql-ipjffc.yaml` networkbandwidthover chaos test waiting 120 seconds check cluster status `kbcli cluster list mysql-ipjffc --show-labels --namespace ns-pkhtu ` NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS mysql-ipjffc ns-pkhtu mysql DoNotTerminate Running Sep 11,2025 17:23 UTC+0800 app.kubernetes.io/instance=mysql-ipjffc,clusterdefinition.kubeblocks.io/name=mysql check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances mysql-ipjffc --namespace ns-pkhtu ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME mysql-ipjffc-mysql-0 ns-pkhtu mysql-ipjffc mysql Running primary 0 500m / 500m 512Mi / 512Mi data:12Gi aks-cicdamdpool-40497330-vmss000000/10.224.0.6 Sep 11,2025 17:23 UTC+0800 mysql-ipjffc-mysql-1 ns-pkhtu mysql-ipjffc mysql Running primary 0 500m / 500m 512Mi / 512Mi data:12Gi aks-cicdamdpool-40497330-vmss000002/10.224.0.5 Sep 11,2025 17:24 UTC+0800 mysql-ipjffc-proxysql-0 ns-pkhtu mysql-ipjffc proxysql Running 0 500m / 500m 512Mi / 512Mi aks-cicdamdpool-40497330-vmss000002/10.224.0.5 Sep 11,2025 17:25 UTC+0800 check pod status done check cluster role No resources found in ns-pkhtu namespace. primary: mysql-ipjffc-mysql-0 mysql-ipjffc-mysql-1;secondary: No resources found in ns-pkhtu namespace. primary: mysql-ipjffc-mysql-0 mysql-ipjffc-mysql-1;secondary: check cluster role done primary: mysql-ipjffc-mysql-1;secondary: mysql-ipjffc-mysql-0 `kubectl get secrets -l app.kubernetes.io/instance=mysql-ipjffc` set secret: mysql-ipjffc-mysql-account-root `kubectl get secrets mysql-ipjffc-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-ipjffc-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-ipjffc-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:2MLwgG6236;DB_PORT:3306;DB_DATABASE:mysql check cluster connect `echo " echo \"SHOW SLAVE STATUS\G;\" | mysql -P3306 -h127.0.0.1 -uroot -p'2MLwgG6236' " | kubectl exec -it mysql-ipjffc-mysql-0 --namespace ns-pkhtu -- bash ` check cluster connect done `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge NetworkChaos test-chaos-mesh-networkbandwidthover-mysql-ipjffc --namespace ns-pkhtu ` Warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely. networkchaos.chaos-mesh.org "test-chaos-mesh-networkbandwidthover-mysql-ipjffc" force deleted Error from server (NotFound): networkchaos.chaos-mesh.org "test-chaos-mesh-networkbandwidthover-mysql-ipjffc" not found check failover pod name failover pod name:mysql-ipjffc-mysql-1 failover networkbandwidthover Success `kubectl get secrets -l app.kubernetes.io/instance=mysql-ipjffc` set secret: mysql-ipjffc-mysql-account-root `kubectl get secrets mysql-ipjffc-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-ipjffc-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-ipjffc-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:2MLwgG6236;DB_PORT:3306;DB_DATABASE:mysql check db_client batch data count `echo "echo \"select count(*) from executions_loop.executions_loop_table;\" | mysql -P3306 -hmysql-ipjffc-mysql-server.ns-pkhtu.svc.cluster.local -uroot -p'2MLwgG6236' " | kubectl exec -it mysql-ipjffc-mysql-1 --namespace ns-pkhtu -- bash ` check db_client batch data Success `kubectl get secrets -l app.kubernetes.io/instance=mysql-ipjffc` set secret: mysql-ipjffc-mysql-account-root `kubectl get secrets mysql-ipjffc-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-ipjffc-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-ipjffc-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:2MLwgG6236;DB_PORT:3306;DB_DATABASE:mysql check readonly db_client batch data count `echo "echo \"select count(*) from executions_loop.executions_loop_table;\" | mysql -P3306 -h127.0.0.1 -uroot -p'2MLwgG6236' " | kubectl exec -it mysql-ipjffc-mysql-0 --namespace ns-pkhtu -- bash ` check readonly db_client batch data Success test failover timeoffset check cluster status before cluster-failover-timeoffset check cluster status done cluster_status:Running `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge TimeChaos test-chaos-mesh-timeoffset-mysql-ipjffc --namespace ns-pkhtu ` Warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely. Error from server (NotFound): timechaos.chaos-mesh.org "test-chaos-mesh-timeoffset-mysql-ipjffc" not found Error from server (NotFound): timechaos.chaos-mesh.org "test-chaos-mesh-timeoffset-mysql-ipjffc" not found apiVersion: chaos-mesh.org/v1alpha1 kind: TimeChaos metadata: name: test-chaos-mesh-timeoffset-mysql-ipjffc namespace: ns-pkhtu spec: selector: namespaces: - ns-pkhtu labelSelectors: apps.kubeblocks.io/pod-name: mysql-ipjffc-mysql-1 mode: all timeOffset: '-10m' clockIds: - CLOCK_REALTIME duration: 2m `kubectl apply -f test-chaos-mesh-timeoffset-mysql-ipjffc.yaml` timechaos.chaos-mesh.org/test-chaos-mesh-timeoffset-mysql-ipjffc created apply test-chaos-mesh-timeoffset-mysql-ipjffc.yaml Success `rm -rf test-chaos-mesh-timeoffset-mysql-ipjffc.yaml` timeoffset chaos test waiting 120 seconds check cluster status `kbcli cluster list mysql-ipjffc --show-labels --namespace ns-pkhtu ` NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS mysql-ipjffc ns-pkhtu mysql DoNotTerminate Running Sep 11,2025 17:23 UTC+0800 app.kubernetes.io/instance=mysql-ipjffc,clusterdefinition.kubeblocks.io/name=mysql check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances mysql-ipjffc --namespace ns-pkhtu ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME mysql-ipjffc-mysql-0 ns-pkhtu mysql-ipjffc mysql Running secondary 0 500m / 500m 512Mi / 512Mi data:12Gi aks-cicdamdpool-40497330-vmss000000/10.224.0.6 Sep 11,2025 17:23 UTC+0800 mysql-ipjffc-mysql-1 ns-pkhtu mysql-ipjffc mysql Running primary 0 500m / 500m 512Mi / 512Mi data:12Gi aks-cicdamdpool-40497330-vmss000002/10.224.0.5 Sep 11,2025 17:24 UTC+0800 mysql-ipjffc-proxysql-0 ns-pkhtu mysql-ipjffc proxysql Running 0 500m / 500m 512Mi / 512Mi aks-cicdamdpool-40497330-vmss000002/10.224.0.5 Sep 11,2025 17:25 UTC+0800 check pod status done check cluster role check cluster role done primary: mysql-ipjffc-mysql-1;secondary: mysql-ipjffc-mysql-0 `kubectl get secrets -l app.kubernetes.io/instance=mysql-ipjffc` set secret: mysql-ipjffc-mysql-account-root `kubectl get secrets mysql-ipjffc-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-ipjffc-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-ipjffc-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:2MLwgG6236;DB_PORT:3306;DB_DATABASE:mysql check cluster connect `echo " echo \"SHOW SLAVE STATUS\G;\" | mysql -P3306 -h127.0.0.1 -uroot -p'2MLwgG6236' " | kubectl exec -it mysql-ipjffc-mysql-0 --namespace ns-pkhtu -- bash ` check cluster connect done `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge TimeChaos test-chaos-mesh-timeoffset-mysql-ipjffc --namespace ns-pkhtu ` Warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely. timechaos.chaos-mesh.org "test-chaos-mesh-timeoffset-mysql-ipjffc" force deleted Error from server (NotFound): timechaos.chaos-mesh.org "test-chaos-mesh-timeoffset-mysql-ipjffc" not found check failover pod name failover pod name:mysql-ipjffc-mysql-1 failover timeoffset Success `kubectl get secrets -l app.kubernetes.io/instance=mysql-ipjffc` set secret: mysql-ipjffc-mysql-account-root `kubectl get secrets mysql-ipjffc-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-ipjffc-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-ipjffc-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:2MLwgG6236;DB_PORT:3306;DB_DATABASE:mysql check db_client batch data count `echo "echo \"select count(*) from executions_loop.executions_loop_table;\" | mysql -P3306 -hmysql-ipjffc-mysql-server.ns-pkhtu.svc.cluster.local -uroot -p'2MLwgG6236' " | kubectl exec -it mysql-ipjffc-mysql-1 --namespace ns-pkhtu -- bash ` check db_client batch data Success `kubectl get secrets -l app.kubernetes.io/instance=mysql-ipjffc` set secret: mysql-ipjffc-mysql-account-root `kubectl get secrets mysql-ipjffc-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-ipjffc-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-ipjffc-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:2MLwgG6236;DB_PORT:3306;DB_DATABASE:mysql check readonly db_client batch data count `echo "echo \"select count(*) from executions_loop.executions_loop_table;\" | mysql -P3306 -h127.0.0.1 -uroot -p'2MLwgG6236' " | kubectl exec -it mysql-ipjffc-mysql-0 --namespace ns-pkhtu -- bash ` check readonly db_client batch data Success cluster stop check cluster status before ops check cluster status done cluster_status:Running `kbcli cluster stop mysql-ipjffc --auto-approve --force=true --namespace ns-pkhtu ` OpsRequest mysql-ipjffc-stop-2qtxr created successfully, you can view the progress: kbcli cluster describe-ops mysql-ipjffc-stop-2qtxr -n ns-pkhtu check ops status `kbcli cluster list-ops mysql-ipjffc --status all --namespace ns-pkhtu ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME mysql-ipjffc-stop-2qtxr ns-pkhtu Stop mysql-ipjffc Running -/- Sep 11,2025 17:54 UTC+0800 check cluster status `kbcli cluster list mysql-ipjffc --show-labels --namespace ns-pkhtu ` NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS mysql-ipjffc ns-pkhtu mysql DoNotTerminate Stopping Sep 11,2025 17:23 UTC+0800 app.kubernetes.io/instance=mysql-ipjffc,clusterdefinition.kubeblocks.io/name=mysql cluster_status:Stopping cluster_status:Stopping cluster_status:Stopping cluster_status:Stopping cluster_status:Stopping cluster_status:Stopping cluster_status:Stopping cluster_status:Stopping cluster_status:Stopping cluster_status:Stopping cluster_status:Stopping cluster_status:Stopping cluster_status:Stopping cluster_status:Stopping cluster_status:Stopping cluster_status:Stopping cluster_status:Stopping check cluster status done cluster_status:Stopped check pod status `kbcli cluster list-instances mysql-ipjffc --namespace ns-pkhtu ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME check pod status done check ops status `kbcli cluster list-ops mysql-ipjffc --status all --namespace ns-pkhtu ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME mysql-ipjffc-stop-2qtxr ns-pkhtu Stop mysql-ipjffc mysql,proxysql Succeed 3/3 Sep 11,2025 17:54 UTC+0800 check ops status done ops_status:mysql-ipjffc-stop-2qtxr ns-pkhtu Stop mysql-ipjffc mysql,proxysql Succeed 3/3 Sep 11,2025 17:54 UTC+0800 `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge opsrequests.operations mysql-ipjffc-stop-2qtxr --namespace ns-pkhtu ` opsrequest.operations.kubeblocks.io/mysql-ipjffc-stop-2qtxr patched `kbcli cluster delete-ops --name mysql-ipjffc-stop-2qtxr --force --auto-approve --namespace ns-pkhtu ` OpsRequest mysql-ipjffc-stop-2qtxr deleted cluster start check cluster status before ops check cluster status done cluster_status:Stopped `kbcli cluster start mysql-ipjffc --force=true --namespace ns-pkhtu ` OpsRequest mysql-ipjffc-start-xj2v5 created successfully, you can view the progress: kbcli cluster describe-ops mysql-ipjffc-start-xj2v5 -n ns-pkhtu check ops status `kbcli cluster list-ops mysql-ipjffc --status all --namespace ns-pkhtu ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME mysql-ipjffc-start-xj2v5 ns-pkhtu Start mysql-ipjffc Creating -/- Sep 11,2025 17:55 UTC+0800 check cluster status `kbcli cluster list mysql-ipjffc --show-labels --namespace ns-pkhtu ` NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS mysql-ipjffc ns-pkhtu mysql DoNotTerminate Updating Sep 11,2025 17:23 UTC+0800 app.kubernetes.io/instance=mysql-ipjffc,clusterdefinition.kubeblocks.io/name=mysql cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances mysql-ipjffc --namespace ns-pkhtu ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME mysql-ipjffc-mysql-0 ns-pkhtu mysql-ipjffc mysql Running primary 0 500m / 500m 512Mi / 512Mi data:12Gi aks-cicdamdpool-40497330-vmss000002/10.224.0.5 Sep 11,2025 17:55 UTC+0800 mysql-ipjffc-mysql-1 ns-pkhtu mysql-ipjffc mysql Running secondary 0 500m / 500m 512Mi / 512Mi data:12Gi aks-cicdamdpool-40497330-vmss000000/10.224.0.6 Sep 11,2025 17:58 UTC+0800 mysql-ipjffc-proxysql-0 ns-pkhtu mysql-ipjffc proxysql Running 0 500m / 500m 512Mi / 512Mi aks-cicdamdpool-40497330-vmss000001/10.224.0.7 Sep 11,2025 18:03 UTC+0800 check pod status done check cluster role check cluster role done primary: mysql-ipjffc-mysql-0;secondary: mysql-ipjffc-mysql-1 `kubectl get secrets -l app.kubernetes.io/instance=mysql-ipjffc` set secret: mysql-ipjffc-mysql-account-root `kubectl get secrets mysql-ipjffc-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-ipjffc-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-ipjffc-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:2MLwgG6236;DB_PORT:3306;DB_DATABASE:mysql check cluster connect `echo " echo \"SHOW SLAVE STATUS\G;\" | mysql -P3306 -h127.0.0.1 -uroot -p'2MLwgG6236' " | kubectl exec -it mysql-ipjffc-mysql-1 --namespace ns-pkhtu -- bash ` check cluster connect done check ops status `kbcli cluster list-ops mysql-ipjffc --status all --namespace ns-pkhtu ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME mysql-ipjffc-start-xj2v5 ns-pkhtu Start mysql-ipjffc mysql,proxysql Succeed 3/3 Sep 11,2025 17:55 UTC+0800 check ops status done ops_status:mysql-ipjffc-start-xj2v5 ns-pkhtu Start mysql-ipjffc mysql,proxysql Succeed 3/3 Sep 11,2025 17:55 UTC+0800 `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge opsrequests.operations mysql-ipjffc-start-xj2v5 --namespace ns-pkhtu ` opsrequest.operations.kubeblocks.io/mysql-ipjffc-start-xj2v5 patched `kbcli cluster delete-ops --name mysql-ipjffc-start-xj2v5 --force --auto-approve --namespace ns-pkhtu ` OpsRequest mysql-ipjffc-start-xj2v5 deleted `kubectl get secrets -l app.kubernetes.io/instance=mysql-ipjffc` set secret: mysql-ipjffc-mysql-account-root `kubectl get secrets mysql-ipjffc-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-ipjffc-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-ipjffc-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:2MLwgG6236;DB_PORT:3306;DB_DATABASE:mysql check db_client batch data count `echo "echo \"select count(*) from executions_loop.executions_loop_table;\" | mysql -P3306 -hmysql-ipjffc-mysql-server.ns-pkhtu.svc.cluster.local -uroot -p'2MLwgG6236' " | kubectl exec -it mysql-ipjffc-mysql-0 --namespace ns-pkhtu -- bash ` check db_client batch data Success `kubectl get secrets -l app.kubernetes.io/instance=mysql-ipjffc` set secret: mysql-ipjffc-mysql-account-root `kubectl get secrets mysql-ipjffc-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-ipjffc-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-ipjffc-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:2MLwgG6236;DB_PORT:3306;DB_DATABASE:mysql check readonly db_client batch data count `echo "echo \"select count(*) from executions_loop.executions_loop_table;\" | mysql -P3306 -h127.0.0.1 -uroot -p'2MLwgG6236' " | kubectl exec -it mysql-ipjffc-mysql-1 --namespace ns-pkhtu -- bash ` check readonly db_client batch data Success cluster configure component_tmp: mysql apiVersion: operations.kubeblocks.io/v1alpha1 kind: OpsRequest metadata: generateName: mysql-ipjffc-reconfiguring- namespace: ns-pkhtu spec: type: Reconfiguring clusterName: mysql-ipjffc force: true reconfigures: - componentName: mysql parameters: - key: binlog_expire_logs_seconds value: '691200' check cluster status before ops check cluster status done cluster_status:Running `kubectl create -f test_ops_cluster_mysql-ipjffc.yaml` opsrequest.operations.kubeblocks.io/mysql-ipjffc-reconfiguring-6zdvv created create test_ops_cluster_mysql-ipjffc.yaml Success `rm -rf test_ops_cluster_mysql-ipjffc.yaml` check ops status `kbcli cluster list-ops mysql-ipjffc --status all --namespace ns-pkhtu ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME mysql-ipjffc-reconfiguring-6zdvv ns-pkhtu Reconfiguring mysql-ipjffc mysql,mysql Running -/- Sep 11,2025 18:04 UTC+0800 check cluster status `kbcli cluster list mysql-ipjffc --show-labels --namespace ns-pkhtu ` NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS mysql-ipjffc ns-pkhtu mysql DoNotTerminate Running Sep 11,2025 17:23 UTC+0800 app.kubernetes.io/instance=mysql-ipjffc,clusterdefinition.kubeblocks.io/name=mysql check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances mysql-ipjffc --namespace ns-pkhtu ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME mysql-ipjffc-mysql-0 ns-pkhtu mysql-ipjffc mysql Running primary 0 500m / 500m 512Mi / 512Mi data:12Gi aks-cicdamdpool-40497330-vmss000002/10.224.0.5 Sep 11,2025 17:55 UTC+0800 mysql-ipjffc-mysql-1 ns-pkhtu mysql-ipjffc mysql Running secondary 0 500m / 500m 512Mi / 512Mi data:12Gi aks-cicdamdpool-40497330-vmss000000/10.224.0.6 Sep 11,2025 17:58 UTC+0800 mysql-ipjffc-proxysql-0 ns-pkhtu mysql-ipjffc proxysql Running 0 500m / 500m 512Mi / 512Mi aks-cicdamdpool-40497330-vmss000001/10.224.0.7 Sep 11,2025 18:03 UTC+0800 check pod status done check cluster role check cluster role done primary: mysql-ipjffc-mysql-0;secondary: mysql-ipjffc-mysql-1 `kubectl get secrets -l app.kubernetes.io/instance=mysql-ipjffc` set secret: mysql-ipjffc-mysql-account-root `kubectl get secrets mysql-ipjffc-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-ipjffc-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-ipjffc-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:2MLwgG6236;DB_PORT:3306;DB_DATABASE:mysql check cluster connect `echo " echo \"SHOW SLAVE STATUS\G;\" | mysql -P3306 -h127.0.0.1 -uroot -p'2MLwgG6236' " | kubectl exec -it mysql-ipjffc-mysql-1 --namespace ns-pkhtu -- bash ` check cluster connect done check ops status `kbcli cluster list-ops mysql-ipjffc --status all --namespace ns-pkhtu ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME mysql-ipjffc-reconfiguring-6zdvv ns-pkhtu Reconfiguring mysql-ipjffc mysql,mysql Succeed -/- Sep 11,2025 18:04 UTC+0800 check ops status done ops_status:mysql-ipjffc-reconfiguring-6zdvv ns-pkhtu Reconfiguring mysql-ipjffc mysql,mysql Succeed -/- Sep 11,2025 18:04 UTC+0800 `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge opsrequests.operations mysql-ipjffc-reconfiguring-6zdvv --namespace ns-pkhtu ` opsrequest.operations.kubeblocks.io/mysql-ipjffc-reconfiguring-6zdvv patched `kbcli cluster delete-ops --name mysql-ipjffc-reconfiguring-6zdvv --force --auto-approve --namespace ns-pkhtu ` OpsRequest mysql-ipjffc-reconfiguring-6zdvv deleted component_config:mysql check config variables `kubectl get secrets -l app.kubernetes.io/instance=mysql-ipjffc` set secret: mysql-ipjffc-mysql-account-root `kubectl get secrets mysql-ipjffc-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-ipjffc-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-ipjffc-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:2MLwgG6236;DB_PORT:3306;DB_DATABASE:mysql Defaulted container "mysql" out of: mysql, kbagent, config-manager, init-data (init), init-jq (init), init-kbagent (init), kbagent-worker (init) Unable to use a TTY - input is not a terminal or the right kind of file Warning: arning] Using a password on the command line interface can be insecure. current value_actual: 691200 configure:[binlog_expire_logs_seconds] result actual:[691200] equal expected:[691200] `kubectl get secrets -l app.kubernetes.io/instance=mysql-ipjffc` set secret: mysql-ipjffc-mysql-account-root `kubectl get secrets mysql-ipjffc-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-ipjffc-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-ipjffc-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:2MLwgG6236;DB_PORT:3306;DB_DATABASE:mysql check db_client batch data count `echo "echo \"select count(*) from executions_loop.executions_loop_table;\" | mysql -P3306 -hmysql-ipjffc-mysql-server.ns-pkhtu.svc.cluster.local -uroot -p'2MLwgG6236' " | kubectl exec -it mysql-ipjffc-mysql-0 --namespace ns-pkhtu -- bash ` check db_client batch data Success `kubectl get secrets -l app.kubernetes.io/instance=mysql-ipjffc` set secret: mysql-ipjffc-mysql-account-root `kubectl get secrets mysql-ipjffc-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-ipjffc-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-ipjffc-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:2MLwgG6236;DB_PORT:3306;DB_DATABASE:mysql check readonly db_client batch data count `echo "echo \"select count(*) from executions_loop.executions_loop_table;\" | mysql -P3306 -h127.0.0.1 -uroot -p'2MLwgG6236' " | kubectl exec -it mysql-ipjffc-mysql-1 --namespace ns-pkhtu -- bash ` check readonly db_client batch data Success check cluster status before ops check cluster status done cluster_status:Running `kbcli cluster vscale mysql-ipjffc --auto-approve --force=true --components mysql --cpu 600m --memory 0.6Gi --namespace ns-pkhtu ` OpsRequest mysql-ipjffc-verticalscaling-nzv27 created successfully, you can view the progress: kbcli cluster describe-ops mysql-ipjffc-verticalscaling-nzv27 -n ns-pkhtu check ops status `kbcli cluster list-ops mysql-ipjffc --status all --namespace ns-pkhtu ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME mysql-ipjffc-verticalscaling-nzv27 ns-pkhtu VerticalScaling mysql-ipjffc mysql Creating -/- Sep 11,2025 18:04 UTC+0800 check cluster status `kbcli cluster list mysql-ipjffc --show-labels --namespace ns-pkhtu ` NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS mysql-ipjffc ns-pkhtu mysql DoNotTerminate Updating Sep 11,2025 17:23 UTC+0800 app.kubernetes.io/instance=mysql-ipjffc,clusterdefinition.kubeblocks.io/name=mysql cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances mysql-ipjffc --namespace ns-pkhtu ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME mysql-ipjffc-mysql-0 ns-pkhtu mysql-ipjffc mysql Running secondary 0 600m / 600m 644245094400m / 644245094400m data:12Gi aks-cicdamdpool-40497330-vmss000002/10.224.0.5 Sep 11,2025 18:05 UTC+0800 mysql-ipjffc-mysql-1 ns-pkhtu mysql-ipjffc mysql Running primary 0 600m / 600m 644245094400m / 644245094400m data:12Gi aks-cicdamdpool-40497330-vmss000000/10.224.0.6 Sep 11,2025 18:04 UTC+0800 mysql-ipjffc-proxysql-0 ns-pkhtu mysql-ipjffc proxysql Running 0 500m / 500m 512Mi / 512Mi aks-cicdamdpool-40497330-vmss000001/10.224.0.7 Sep 11,2025 18:03 UTC+0800 check pod status done check cluster role check cluster role done primary: mysql-ipjffc-mysql-1;secondary: mysql-ipjffc-mysql-0 `kubectl get secrets -l app.kubernetes.io/instance=mysql-ipjffc` set secret: mysql-ipjffc-mysql-account-root `kubectl get secrets mysql-ipjffc-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-ipjffc-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-ipjffc-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:2MLwgG6236;DB_PORT:3306;DB_DATABASE:mysql check cluster connect `echo " echo \"SHOW SLAVE STATUS\G;\" | mysql -P3306 -h127.0.0.1 -uroot -p'2MLwgG6236' " | kubectl exec -it mysql-ipjffc-mysql-0 --namespace ns-pkhtu -- bash ` check cluster connect done check ops status `kbcli cluster list-ops mysql-ipjffc --status all --namespace ns-pkhtu ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME mysql-ipjffc-verticalscaling-nzv27 ns-pkhtu VerticalScaling mysql-ipjffc mysql Succeed 2/2 Sep 11,2025 18:04 UTC+0800 check ops status done ops_status:mysql-ipjffc-verticalscaling-nzv27 ns-pkhtu VerticalScaling mysql-ipjffc mysql Succeed 2/2 Sep 11,2025 18:04 UTC+0800 `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge opsrequests.operations mysql-ipjffc-verticalscaling-nzv27 --namespace ns-pkhtu ` opsrequest.operations.kubeblocks.io/mysql-ipjffc-verticalscaling-nzv27 patched `kbcli cluster delete-ops --name mysql-ipjffc-verticalscaling-nzv27 --force --auto-approve --namespace ns-pkhtu ` OpsRequest mysql-ipjffc-verticalscaling-nzv27 deleted `kubectl get secrets -l app.kubernetes.io/instance=mysql-ipjffc` set secret: mysql-ipjffc-mysql-account-root `kubectl get secrets mysql-ipjffc-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-ipjffc-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-ipjffc-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:2MLwgG6236;DB_PORT:3306;DB_DATABASE:mysql check db_client batch data count `echo "echo \"select count(*) from executions_loop.executions_loop_table;\" | mysql -P3306 -hmysql-ipjffc-mysql-server.ns-pkhtu.svc.cluster.local -uroot -p'2MLwgG6236' " | kubectl exec -it mysql-ipjffc-mysql-1 --namespace ns-pkhtu -- bash ` check db_client batch data Success `kubectl get secrets -l app.kubernetes.io/instance=mysql-ipjffc` set secret: mysql-ipjffc-mysql-account-root `kubectl get secrets mysql-ipjffc-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-ipjffc-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-ipjffc-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:2MLwgG6236;DB_PORT:3306;DB_DATABASE:mysql check readonly db_client batch data count `echo "echo \"select count(*) from executions_loop.executions_loop_table;\" | mysql -P3306 -h127.0.0.1 -uroot -p'2MLwgG6236' " | kubectl exec -it mysql-ipjffc-mysql-0 --namespace ns-pkhtu -- bash ` check readonly db_client batch data Success cluster restart check cluster status before ops check cluster status done cluster_status:Running `kbcli cluster restart mysql-ipjffc --auto-approve --force=true --namespace ns-pkhtu ` OpsRequest mysql-ipjffc-restart-ptx8p created successfully, you can view the progress: kbcli cluster describe-ops mysql-ipjffc-restart-ptx8p -n ns-pkhtu check ops status `kbcli cluster list-ops mysql-ipjffc --status all --namespace ns-pkhtu ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME mysql-ipjffc-restart-ptx8p ns-pkhtu Restart mysql-ipjffc mysql,proxysql Creating -/- Sep 11,2025 18:06 UTC+0800 check cluster status `kbcli cluster list mysql-ipjffc --show-labels --namespace ns-pkhtu ` NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS mysql-ipjffc ns-pkhtu mysql DoNotTerminate Updating Sep 11,2025 17:23 UTC+0800 app.kubernetes.io/instance=mysql-ipjffc,clusterdefinition.kubeblocks.io/name=mysql cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances mysql-ipjffc --namespace ns-pkhtu ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME mysql-ipjffc-mysql-0 ns-pkhtu mysql-ipjffc mysql Running primary 0 600m / 600m 644245094400m / 644245094400m data:12Gi aks-cicdamdpool-40497330-vmss000002/10.224.0.5 Sep 11,2025 18:06 UTC+0800 mysql-ipjffc-mysql-1 ns-pkhtu mysql-ipjffc mysql Running secondary 0 600m / 600m 644245094400m / 644245094400m data:12Gi aks-cicdamdpool-40497330-vmss000000/10.224.0.6 Sep 11,2025 18:08 UTC+0800 mysql-ipjffc-proxysql-0 ns-pkhtu mysql-ipjffc proxysql Running 0 500m / 500m 512Mi / 512Mi aks-cicdamdpool-40497330-vmss000001/10.224.0.7 Sep 11,2025 18:09 UTC+0800 check pod status done check cluster role check cluster role done primary: mysql-ipjffc-mysql-0;secondary: mysql-ipjffc-mysql-1 `kubectl get secrets -l app.kubernetes.io/instance=mysql-ipjffc` set secret: mysql-ipjffc-mysql-account-root `kubectl get secrets mysql-ipjffc-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-ipjffc-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-ipjffc-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:2MLwgG6236;DB_PORT:3306;DB_DATABASE:mysql check cluster connect `echo " echo \"SHOW SLAVE STATUS\G;\" | mysql -P3306 -h127.0.0.1 -uroot -p'2MLwgG6236' " | kubectl exec -it mysql-ipjffc-mysql-1 --namespace ns-pkhtu -- bash ` check cluster connect done check ops status `kbcli cluster list-ops mysql-ipjffc --status all --namespace ns-pkhtu ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME mysql-ipjffc-restart-ptx8p ns-pkhtu Restart mysql-ipjffc mysql,proxysql Succeed 3/3 Sep 11,2025 18:06 UTC+0800 check ops status done ops_status:mysql-ipjffc-restart-ptx8p ns-pkhtu Restart mysql-ipjffc mysql,proxysql Succeed 3/3 Sep 11,2025 18:06 UTC+0800 `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge opsrequests.operations mysql-ipjffc-restart-ptx8p --namespace ns-pkhtu ` opsrequest.operations.kubeblocks.io/mysql-ipjffc-restart-ptx8p patched `kbcli cluster delete-ops --name mysql-ipjffc-restart-ptx8p --force --auto-approve --namespace ns-pkhtu ` OpsRequest mysql-ipjffc-restart-ptx8p deleted `kubectl get secrets -l app.kubernetes.io/instance=mysql-ipjffc` set secret: mysql-ipjffc-mysql-account-root `kubectl get secrets mysql-ipjffc-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-ipjffc-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-ipjffc-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:2MLwgG6236;DB_PORT:3306;DB_DATABASE:mysql check db_client batch data count `echo "echo \"select count(*) from executions_loop.executions_loop_table;\" | mysql -P3306 -hmysql-ipjffc-mysql-server.ns-pkhtu.svc.cluster.local -uroot -p'2MLwgG6236' " | kubectl exec -it mysql-ipjffc-mysql-0 --namespace ns-pkhtu -- bash ` check db_client batch data Success `kubectl get secrets -l app.kubernetes.io/instance=mysql-ipjffc` set secret: mysql-ipjffc-mysql-account-root `kubectl get secrets mysql-ipjffc-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-ipjffc-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-ipjffc-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:2MLwgG6236;DB_PORT:3306;DB_DATABASE:mysql check readonly db_client batch data count `echo "echo \"select count(*) from executions_loop.executions_loop_table;\" | mysql -P3306 -h127.0.0.1 -uroot -p'2MLwgG6236' " | kubectl exec -it mysql-ipjffc-mysql-1 --namespace ns-pkhtu -- bash ` check readonly db_client batch data Success test failover networkdelay check cluster status before cluster-failover-networkdelay check cluster status done cluster_status:Running `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge NetworkChaos test-chaos-mesh-networkdelay-mysql-ipjffc --namespace ns-pkhtu ` Warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely. Error from server (NotFound): networkchaos.chaos-mesh.org "test-chaos-mesh-networkdelay-mysql-ipjffc" not found Error from server (NotFound): networkchaos.chaos-mesh.org "test-chaos-mesh-networkdelay-mysql-ipjffc" not found apiVersion: chaos-mesh.org/v1alpha1 kind: NetworkChaos metadata: name: test-chaos-mesh-networkdelay-mysql-ipjffc namespace: ns-pkhtu spec: selector: namespaces: - ns-pkhtu labelSelectors: apps.kubeblocks.io/pod-name: mysql-ipjffc-mysql-0 mode: all action: delay delay: latency: 2000ms correlation: '100' jitter: 0ms direction: to duration: 2m `kubectl apply -f test-chaos-mesh-networkdelay-mysql-ipjffc.yaml` networkchaos.chaos-mesh.org/test-chaos-mesh-networkdelay-mysql-ipjffc created apply test-chaos-mesh-networkdelay-mysql-ipjffc.yaml Success `rm -rf test-chaos-mesh-networkdelay-mysql-ipjffc.yaml` networkdelay chaos test waiting 120 seconds check cluster status `kbcli cluster list mysql-ipjffc --show-labels --namespace ns-pkhtu ` NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS mysql-ipjffc ns-pkhtu mysql DoNotTerminate Running Sep 11,2025 17:23 UTC+0800 app.kubernetes.io/instance=mysql-ipjffc,clusterdefinition.kubeblocks.io/name=mysql check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances mysql-ipjffc --namespace ns-pkhtu ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME mysql-ipjffc-mysql-0 ns-pkhtu mysql-ipjffc mysql Running primary 0 600m / 600m 644245094400m / 644245094400m data:12Gi aks-cicdamdpool-40497330-vmss000002/10.224.0.5 Sep 11,2025 18:06 UTC+0800 mysql-ipjffc-mysql-1 ns-pkhtu mysql-ipjffc mysql Running secondary 0 600m / 600m 644245094400m / 644245094400m data:12Gi aks-cicdamdpool-40497330-vmss000000/10.224.0.6 Sep 11,2025 18:08 UTC+0800 mysql-ipjffc-proxysql-0 ns-pkhtu mysql-ipjffc proxysql Running 0 500m / 500m 512Mi / 512Mi aks-cicdamdpool-40497330-vmss000001/10.224.0.7 Sep 11,2025 18:09 UTC+0800 check pod status done check cluster role check cluster role done primary: mysql-ipjffc-mysql-0;secondary: mysql-ipjffc-mysql-1 `kubectl get secrets -l app.kubernetes.io/instance=mysql-ipjffc` set secret: mysql-ipjffc-mysql-account-root `kubectl get secrets mysql-ipjffc-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-ipjffc-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-ipjffc-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:2MLwgG6236;DB_PORT:3306;DB_DATABASE:mysql check cluster connect `echo " echo \"SHOW SLAVE STATUS\G;\" | mysql -P3306 -h127.0.0.1 -uroot -p'2MLwgG6236' " | kubectl exec -it mysql-ipjffc-mysql-1 --namespace ns-pkhtu -- bash ` check cluster connect done `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge NetworkChaos test-chaos-mesh-networkdelay-mysql-ipjffc --namespace ns-pkhtu ` Warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely. networkchaos.chaos-mesh.org "test-chaos-mesh-networkdelay-mysql-ipjffc" force deleted Error from server (NotFound): networkchaos.chaos-mesh.org "test-chaos-mesh-networkdelay-mysql-ipjffc" not found check failover pod name failover pod name:mysql-ipjffc-mysql-0 failover networkdelay Success `kubectl get secrets -l app.kubernetes.io/instance=mysql-ipjffc` set secret: mysql-ipjffc-mysql-account-root `kubectl get secrets mysql-ipjffc-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-ipjffc-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-ipjffc-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:2MLwgG6236;DB_PORT:3306;DB_DATABASE:mysql check db_client batch data count `echo "echo \"select count(*) from executions_loop.executions_loop_table;\" | mysql -P3306 -hmysql-ipjffc-mysql-server.ns-pkhtu.svc.cluster.local -uroot -p'2MLwgG6236' " | kubectl exec -it mysql-ipjffc-mysql-0 --namespace ns-pkhtu -- bash ` check db_client batch data Success `kubectl get secrets -l app.kubernetes.io/instance=mysql-ipjffc` set secret: mysql-ipjffc-mysql-account-root `kubectl get secrets mysql-ipjffc-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-ipjffc-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-ipjffc-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:2MLwgG6236;DB_PORT:3306;DB_DATABASE:mysql check readonly db_client batch data count `echo "echo \"select count(*) from executions_loop.executions_loop_table;\" | mysql -P3306 -h127.0.0.1 -uroot -p'2MLwgG6236' " | kubectl exec -it mysql-ipjffc-mysql-1 --namespace ns-pkhtu -- bash ` check readonly db_client batch data Success test failover connectionstress check cluster status before cluster-failover-connectionstress check cluster status done cluster_status:Running Error from server (NotFound): pods "test-db-client-connectionstress-mysql-ipjffc" not found `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge pods test-db-client-connectionstress-mysql-ipjffc --namespace ns-pkhtu ` Error from server (NotFound): pods "test-db-client-connectionstress-mysql-ipjffc" not found Warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely. Error from server (NotFound): pods "test-db-client-connectionstress-mysql-ipjffc" not found `kubectl get secrets -l app.kubernetes.io/instance=mysql-ipjffc` set secret: mysql-ipjffc-mysql-account-root `kubectl get secrets mysql-ipjffc-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-ipjffc-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-ipjffc-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:2MLwgG6236;DB_PORT:3306;DB_DATABASE:mysql apiVersion: v1 kind: Pod metadata: name: test-db-client-connectionstress-mysql-ipjffc namespace: ns-pkhtu spec: containers: - name: test-dbclient imagePullPolicy: IfNotPresent image: docker.io/apecloud/dbclient:test args: - "--host" - "mysql-ipjffc-mysql-server.ns-pkhtu.svc.cluster.local" - "--user" - "root" - "--password" - "2MLwgG6236" - "--port" - "3306" - "--database" - "mysql" - "--dbtype" - "mysql" - "--test" - "connectionstress" - "--connections" - "83" - "--duration" - "60" restartPolicy: Never `kubectl apply -f test-db-client-connectionstress-mysql-ipjffc.yaml` pod/test-db-client-connectionstress-mysql-ipjffc created apply test-db-client-connectionstress-mysql-ipjffc.yaml Success `rm -rf test-db-client-connectionstress-mysql-ipjffc.yaml` check pod status check pod test-db-client-connectionstress-mysql-ipjffc status done pod_status:NAME READY STATUS RESTARTS AGE test-db-client-connectionstress-mysql-ipjffc 0/1 Completed 0 5s check cluster status `kbcli cluster list mysql-ipjffc --show-labels --namespace ns-pkhtu ` NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS mysql-ipjffc ns-pkhtu mysql DoNotTerminate Running Sep 11,2025 17:23 UTC+0800 app.kubernetes.io/instance=mysql-ipjffc,clusterdefinition.kubeblocks.io/name=mysql check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances mysql-ipjffc --namespace ns-pkhtu ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME mysql-ipjffc-mysql-0 ns-pkhtu mysql-ipjffc mysql Running primary 0 600m / 600m 644245094400m / 644245094400m data:12Gi aks-cicdamdpool-40497330-vmss000002/10.224.0.5 Sep 11,2025 18:06 UTC+0800 mysql-ipjffc-mysql-1 ns-pkhtu mysql-ipjffc mysql Running secondary 0 600m / 600m 644245094400m / 644245094400m data:12Gi aks-cicdamdpool-40497330-vmss000000/10.224.0.6 Sep 11,2025 18:08 UTC+0800 mysql-ipjffc-proxysql-0 ns-pkhtu mysql-ipjffc proxysql Running 0 500m / 500m 512Mi / 512Mi aks-cicdamdpool-40497330-vmss000001/10.224.0.7 Sep 11,2025 18:09 UTC+0800 check pod status done check cluster role check cluster role done primary: mysql-ipjffc-mysql-0;secondary: mysql-ipjffc-mysql-1 `kubectl get secrets -l app.kubernetes.io/instance=mysql-ipjffc` set secret: mysql-ipjffc-mysql-account-root `kubectl get secrets mysql-ipjffc-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-ipjffc-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-ipjffc-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:2MLwgG6236;DB_PORT:3306;DB_DATABASE:mysql check cluster connect `echo " echo \"SHOW SLAVE STATUS\G;\" | mysql -P3306 -h127.0.0.1 -uroot -p'2MLwgG6236' " | kubectl exec -it mysql-ipjffc-mysql-1 --namespace ns-pkhtu -- bash ` check cluster connect done --host mysql-ipjffc-mysql-server.ns-pkhtu.svc.cluster.local --user root --password 2MLwgG6236 --port 3306 --database mysql --dbtype mysql --test connectionstress --connections 83 --duration 60 SLF4J(I): Connected with provider of type [ch.qos.logback.classic.spi.LogbackServiceProvider] Test Result: null Connection Information: Database Type: mysql Host: mysql-ipjffc-mysql-server.ns-pkhtu.svc.cluster.local Port: 3306 Database: mysql Table: User: root Org: Access Mode: mysql Test Type: connectionstress Connection Count: 83 Duration: 60 seconds `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge pods test-db-client-connectionstress-mysql-ipjffc --namespace ns-pkhtu ` pod/test-db-client-connectionstress-mysql-ipjffc patched (no change) Warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely. pod "test-db-client-connectionstress-mysql-ipjffc" force deleted `kubectl get secrets -l app.kubernetes.io/instance=mysql-ipjffc` set secret: mysql-ipjffc-mysql-account-root `kubectl get secrets mysql-ipjffc-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-ipjffc-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-ipjffc-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:2MLwgG6236;DB_PORT:3306;DB_DATABASE:mysql set db_client batch data count `echo "echo \"select count(*) from executions_loop.executions_loop_table;\" | mysql -P3306 -hmysql-ipjffc-mysql-server.ns-pkhtu.svc.cluster.local -uroot -p'2MLwgG6236' " | kubectl exec -it mysql-ipjffc-mysql-0 --namespace ns-pkhtu -- bash ` set db_client batch data Success check failover pod name failover pod name:mysql-ipjffc-mysql-0 failover connectionstress Success `kubectl get secrets -l app.kubernetes.io/instance=mysql-ipjffc` set secret: mysql-ipjffc-mysql-account-root `kubectl get secrets mysql-ipjffc-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-ipjffc-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-ipjffc-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:2MLwgG6236;DB_PORT:3306;DB_DATABASE:mysql check db_client batch data count `echo "echo \"select count(*) from executions_loop.executions_loop_table;\" | mysql -P3306 -hmysql-ipjffc-mysql-server.ns-pkhtu.svc.cluster.local -uroot -p'2MLwgG6236' " | kubectl exec -it mysql-ipjffc-mysql-0 --namespace ns-pkhtu -- bash ` check db_client batch data Success `kubectl get secrets -l app.kubernetes.io/instance=mysql-ipjffc` set secret: mysql-ipjffc-mysql-account-root `kubectl get secrets mysql-ipjffc-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-ipjffc-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-ipjffc-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:2MLwgG6236;DB_PORT:3306;DB_DATABASE:mysql check readonly db_client batch data count `echo "echo \"select count(*) from executions_loop.executions_loop_table;\" | mysql -P3306 -h127.0.0.1 -uroot -p'2MLwgG6236' " | kubectl exec -it mysql-ipjffc-mysql-1 --namespace ns-pkhtu -- bash ` check readonly db_client batch data Success test failover networkloss check cluster status before cluster-failover-networkloss check cluster status done cluster_status:Running `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge NetworkChaos test-chaos-mesh-networkloss-mysql-ipjffc --namespace ns-pkhtu ` Warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely. Error from server (NotFound): networkchaos.chaos-mesh.org "test-chaos-mesh-networkloss-mysql-ipjffc" not found Error from server (NotFound): networkchaos.chaos-mesh.org "test-chaos-mesh-networkloss-mysql-ipjffc" not found apiVersion: chaos-mesh.org/v1alpha1 kind: NetworkChaos metadata: name: test-chaos-mesh-networkloss-mysql-ipjffc namespace: ns-pkhtu spec: selector: namespaces: - ns-pkhtu labelSelectors: apps.kubeblocks.io/pod-name: mysql-ipjffc-mysql-0 mode: all action: loss loss: loss: '100' correlation: '100' direction: to duration: 2m `kubectl apply -f test-chaos-mesh-networkloss-mysql-ipjffc.yaml` networkchaos.chaos-mesh.org/test-chaos-mesh-networkloss-mysql-ipjffc created apply test-chaos-mesh-networkloss-mysql-ipjffc.yaml Success `rm -rf test-chaos-mesh-networkloss-mysql-ipjffc.yaml` networkloss chaos test waiting 120 seconds check cluster status `kbcli cluster list mysql-ipjffc --show-labels --namespace ns-pkhtu ` NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS mysql-ipjffc ns-pkhtu mysql DoNotTerminate Running Sep 11,2025 17:23 UTC+0800 app.kubernetes.io/instance=mysql-ipjffc,clusterdefinition.kubeblocks.io/name=mysql check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances mysql-ipjffc --namespace ns-pkhtu ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME mysql-ipjffc-mysql-0 ns-pkhtu mysql-ipjffc mysql Running primary 0 600m / 600m 644245094400m / 644245094400m data:12Gi aks-cicdamdpool-40497330-vmss000002/10.224.0.5 Sep 11,2025 18:06 UTC+0800 mysql-ipjffc-mysql-1 ns-pkhtu mysql-ipjffc mysql Running primary 0 600m / 600m 644245094400m / 644245094400m data:12Gi aks-cicdamdpool-40497330-vmss000000/10.224.0.6 Sep 11,2025 18:08 UTC+0800 mysql-ipjffc-proxysql-0 ns-pkhtu mysql-ipjffc proxysql Running 0 500m / 500m 512Mi / 512Mi aks-cicdamdpool-40497330-vmss000001/10.224.0.7 Sep 11,2025 18:09 UTC+0800 check pod status done check cluster role No resources found in ns-pkhtu namespace. primary: mysql-ipjffc-mysql-0 mysql-ipjffc-mysql-1;secondary: check cluster role done primary: mysql-ipjffc-mysql-1;secondary: mysql-ipjffc-mysql-0 `kubectl get secrets -l app.kubernetes.io/instance=mysql-ipjffc` set secret: mysql-ipjffc-mysql-account-root `kubectl get secrets mysql-ipjffc-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-ipjffc-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-ipjffc-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:2MLwgG6236;DB_PORT:3306;DB_DATABASE:mysql check cluster connect `echo " echo \"SHOW SLAVE STATUS\G;\" | mysql -P3306 -h127.0.0.1 -uroot -p'2MLwgG6236' " | kubectl exec -it mysql-ipjffc-mysql-0 --namespace ns-pkhtu -- bash ` check cluster connect done `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge NetworkChaos test-chaos-mesh-networkloss-mysql-ipjffc --namespace ns-pkhtu ` Warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely. networkchaos.chaos-mesh.org "test-chaos-mesh-networkloss-mysql-ipjffc" force deleted networkchaos.chaos-mesh.org/test-chaos-mesh-networkloss-mysql-ipjffc patched check failover pod name failover pod name:mysql-ipjffc-mysql-1 failover networkloss Failure `kubectl get secrets -l app.kubernetes.io/instance=mysql-ipjffc` set secret: mysql-ipjffc-mysql-account-root `kubectl get secrets mysql-ipjffc-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-ipjffc-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-ipjffc-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:2MLwgG6236;DB_PORT:3306;DB_DATABASE:mysql check db_client batch data count `echo "echo \"select count(*) from executions_loop.executions_loop_table;\" | mysql -P3306 -hmysql-ipjffc-mysql-server.ns-pkhtu.svc.cluster.local -uroot -p'2MLwgG6236' " | kubectl exec -it mysql-ipjffc-mysql-1 --namespace ns-pkhtu -- bash ` check db_client batch data Success `kubectl get secrets -l app.kubernetes.io/instance=mysql-ipjffc` set secret: mysql-ipjffc-mysql-account-root `kubectl get secrets mysql-ipjffc-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-ipjffc-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-ipjffc-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:2MLwgG6236;DB_PORT:3306;DB_DATABASE:mysql check readonly db_client batch data count `echo "echo \"select count(*) from executions_loop.executions_loop_table;\" | mysql -P3306 -h127.0.0.1 -uroot -p'2MLwgG6236' " | kubectl exec -it mysql-ipjffc-mysql-0 --namespace ns-pkhtu -- bash ` check readonly db_client batch data Success cluster update terminationPolicy WipeOut `kbcli cluster update mysql-ipjffc --termination-policy=WipeOut --namespace ns-pkhtu ` cluster.apps.kubeblocks.io/mysql-ipjffc updated check cluster status `kbcli cluster list mysql-ipjffc --show-labels --namespace ns-pkhtu ` NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS mysql-ipjffc ns-pkhtu mysql WipeOut Running Sep 11,2025 17:23 UTC+0800 app.kubernetes.io/instance=mysql-ipjffc,clusterdefinition.kubeblocks.io/name=mysql check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances mysql-ipjffc --namespace ns-pkhtu ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME mysql-ipjffc-mysql-0 ns-pkhtu mysql-ipjffc mysql Running secondary 0 600m / 600m 644245094400m / 644245094400m data:12Gi aks-cicdamdpool-40497330-vmss000002/10.224.0.5 Sep 11,2025 18:06 UTC+0800 mysql-ipjffc-mysql-1 ns-pkhtu mysql-ipjffc mysql Running primary 0 600m / 600m 644245094400m / 644245094400m data:12Gi aks-cicdamdpool-40497330-vmss000000/10.224.0.6 Sep 11,2025 18:08 UTC+0800 mysql-ipjffc-proxysql-0 ns-pkhtu mysql-ipjffc proxysql Running 0 500m / 500m 512Mi / 512Mi aks-cicdamdpool-40497330-vmss000001/10.224.0.7 Sep 11,2025 18:09 UTC+0800 check pod status done check cluster role check cluster role done primary: mysql-ipjffc-mysql-1;secondary: mysql-ipjffc-mysql-0 `kubectl get secrets -l app.kubernetes.io/instance=mysql-ipjffc` set secret: mysql-ipjffc-mysql-account-root `kubectl get secrets mysql-ipjffc-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-ipjffc-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-ipjffc-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:2MLwgG6236;DB_PORT:3306;DB_DATABASE:mysql check cluster connect `echo " echo \"SHOW SLAVE STATUS\G;\" | mysql -P3306 -h127.0.0.1 -uroot -p'2MLwgG6236' " | kubectl exec -it mysql-ipjffc-mysql-0 --namespace ns-pkhtu -- bash ` check cluster connect done cluster xtrabackup backup `kubectl get backuprepo backuprepo-kbcli-test -o jsonpath="***.spec.credential.name***"` `kubectl get backuprepo backuprepo-kbcli-test -o jsonpath="***.spec.credential.namespace***"` `kubectl get secrets kb-backuprepo-fc6xr -n kb-heauh -o jsonpath="***.data.accessKeyId***"` `kubectl get secrets kb-backuprepo-fc6xr -n kb-heauh -o jsonpath="***.data.secretAccessKey***"` KUBEBLOCKS NAMESPACE:kb-heauh get kubeblocks namespace done `kubectl get secrets -l app.kubernetes.io/instance=kbcli-test-minio --namespace kb-heauh -o jsonpath="***.items[0].data.root-user***"` `kubectl get secrets -l app.kubernetes.io/instance=kbcli-test-minio --namespace kb-heauh -o jsonpath="***.items[0].data.root-password***"` minio_user:kbclitest,minio_password:kbclitest,minio_endpoint:kbcli-test-minio.kb-heauh.svc.cluster.local:9000 list minio bucket kbcli-test `echo 'mc config host add minioserver http://kbcli-test-minio.kb-heauh.svc.cluster.local:9000 kbclitest kbclitest;mc ls minioserver' | kubectl exec -it kbcli-test-minio-8f45f86b6-jvj74 --namespace kb-heauh -- bash` Unable to use a TTY - input is not a terminal or the right kind of file list minio bucket done default backuprepo:backuprepo-kbcli-test exists `kbcli cluster backup mysql-ipjffc --method xtrabackup --namespace ns-pkhtu ` Backup backup-ns-pkhtu-mysql-ipjffc-20250911181345 created successfully, you can view the progress: kbcli cluster list-backups --names=backup-ns-pkhtu-mysql-ipjffc-20250911181345 -n ns-pkhtu check backup status `kbcli cluster list-backups mysql-ipjffc --namespace ns-pkhtu ` No backups found in ns-pkhtu namespace. backup_status:mysql-ipjffc-xtrabackup-Delete backup_status:mysql-ipjffc-xtrabackup-Running backup_status:mysql-ipjffc-xtrabackup-Running backup_status:mysql-ipjffc-xtrabackup-Running backup_status:mysql-ipjffc-xtrabackup-Running check backup status done backup_status:backup-ns-pkhtu-mysql-ipjffc-20250911181345 ns-pkhtu mysql-ipjffc xtrabackup Completed 4967694 23s Delete Sep 11,2025 18:13 UTC+0800 Sep 11,2025 18:14 UTC+0800 cluster restore backup Error from server (NotFound): opsrequests.operations.kubeblocks.io "abk-ipjffc" not found `kbcli cluster describe-backup --names backup-ns-pkhtu-mysql-ipjffc-20250911181345 --namespace ns-pkhtu ` Name: backup-ns-pkhtu-mysql-ipjffc-20250911181345 Cluster: mysql-ipjffc Namespace: ns-pkhtu Spec: Method: xtrabackup Policy Name: mysql-ipjffc-mysql-backup-policy Actions: dp-backup-0: ActionType: Job WorkloadName: dp-backup-0-backup-ns-pkhtu-mysql-ipjffc-20250911181345-0a1a7f2 TargetPodName: mysql-ipjffc-mysql-0 Phase: Completed Start Time: Sep 11,2025 18:13 UTC+0800 Completion Time: Sep 11,2025 18:14 UTC+0800 Status: Phase: Completed Total Size: 4967694 ActionSet Name: mysql-xtrabackup-br Repository: backuprepo-kbcli-test Duration: 23s Start Time: Sep 11,2025 18:13 UTC+0800 Completion Time: Sep 11,2025 18:14 UTC+0800 Path: /ns-pkhtu/mysql-ipjffc-3589fa19-3246-4813-9e31-0a0a75b3714c/mysql/backup-ns-pkhtu-mysql-ipjffc-20250911181345 Warning Events: `kbcli cluster restore abk-ipjffc --backup backup-ns-pkhtu-mysql-ipjffc-20250911181345 --namespace ns-pkhtu ` Cluster abk-ipjffc created check cluster status `kbcli cluster list abk-ipjffc --show-labels --namespace ns-pkhtu ` NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS abk-ipjffc ns-pkhtu mysql WipeOut Creating Sep 11,2025 18:14 UTC+0800 clusterdefinition.kubeblocks.io/name=mysql cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances abk-ipjffc --namespace ns-pkhtu ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME abk-ipjffc-mysql-0 ns-pkhtu abk-ipjffc mysql Running primary 0 600m / 600m 644245094400m / 644245094400m data:12Gi aks-cicdamdpool-40497330-vmss000000/10.224.0.6 Sep 11,2025 18:14 UTC+0800 abk-ipjffc-mysql-1 ns-pkhtu abk-ipjffc mysql Running secondary 0 600m / 600m 644245094400m / 644245094400m data:12Gi aks-cicdamdpool-40497330-vmss000000/10.224.0.6 Sep 11,2025 18:15 UTC+0800 abk-ipjffc-proxysql-0 ns-pkhtu abk-ipjffc proxysql Running 0 500m / 500m 512Mi / 512Mi aks-cicdamdpool-40497330-vmss000002/10.224.0.5 Sep 11,2025 18:16 UTC+0800 check pod status done check cluster role check cluster role done primary: abk-ipjffc-mysql-0;secondary: abk-ipjffc-mysql-1 `kubectl get secrets -l app.kubernetes.io/instance=abk-ipjffc` set secret: abk-ipjffc-mysql-account-root `kubectl get secrets abk-ipjffc-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets abk-ipjffc-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets abk-ipjffc-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:2MLwgG6236;DB_PORT:3306;DB_DATABASE:mysql check cluster connect `echo " echo \"SHOW SLAVE STATUS\G;\" | mysql -P3306 -h127.0.0.1 -uroot -p'2MLwgG6236' " | kubectl exec -it abk-ipjffc-mysql-1 --namespace ns-pkhtu -- bash ` check cluster connect done `kbcli cluster describe-backup --names backup-ns-pkhtu-mysql-ipjffc-20250911181345 --namespace ns-pkhtu ` Name: backup-ns-pkhtu-mysql-ipjffc-20250911181345 Cluster: mysql-ipjffc Namespace: ns-pkhtu Spec: Method: xtrabackup Policy Name: mysql-ipjffc-mysql-backup-policy Actions: dp-backup-0: ActionType: Job WorkloadName: dp-backup-0-backup-ns-pkhtu-mysql-ipjffc-20250911181345-0a1a7f2 TargetPodName: mysql-ipjffc-mysql-0 Phase: Completed Start Time: Sep 11,2025 18:13 UTC+0800 Completion Time: Sep 11,2025 18:14 UTC+0800 Status: Phase: Completed Total Size: 4967694 ActionSet Name: mysql-xtrabackup-br Repository: backuprepo-kbcli-test Duration: 23s Start Time: Sep 11,2025 18:13 UTC+0800 Completion Time: Sep 11,2025 18:14 UTC+0800 Path: /ns-pkhtu/mysql-ipjffc-3589fa19-3246-4813-9e31-0a0a75b3714c/mysql/backup-ns-pkhtu-mysql-ipjffc-20250911181345 Warning Events: cluster connect `kubectl get secrets -l app.kubernetes.io/instance=abk-ipjffc` set secret: abk-ipjffc-mysql-account-root `kubectl get secrets abk-ipjffc-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets abk-ipjffc-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets abk-ipjffc-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:2MLwgG6236;DB_PORT:3306;DB_DATABASE:mysql Defaulted container "mysql" out of: mysql, kbagent, config-manager, init-data (init), init-jq (init), init-kbagent (init), kbagent-worker (init) Unable to use a TTY - input is not a terminal or the right kind of file Warning: arning] Using a password on the command line interface can be insecure. *************************** 1. row *************************** Slave_IO_State: Waiting for source to send event Master_Host: abk-ipjffc-mysql-0.abk-ipjffc-mysql-headless Master_User: root Master_Port: 3306 Connect_Retry: 1 Master_Log_File: abk-ipjffc-mysql-0-bin.000001 Read_Master_Log_Pos: 2957 Relay_Log_File: relay-bin.000002 Relay_Log_Pos: 3199 Relay_Master_Log_File: abk-ipjffc-mysql-0-bin.000001 Slave_IO_Running: Yes Slave_SQL_Running: Yes Replicate_Do_DB: Replicate_Ignore_DB: Replicate_Do_Table: Replicate_Ignore_Table: Replicate_Wild_Do_Table: Replicate_Wild_Ignore_Table: Last_Errno: 0 Last_Error: Skip_Counter: 0 Exec_Master_Log_Pos: 2957 Relay_Log_Space: 3403 Until_Condition: None Until_Log_File: Until_Log_Pos: 0 Master_SSL_Allowed: No Master_SSL_CA_File: Master_SSL_CA_Path: Master_SSL_Cert: Master_SSL_Cipher: Master_SSL_Key: Seconds_Behind_Master: 0 Master_SSL_Verify_Server_Cert: No Last_IO_Errno: 0 Last_IO_Error: Last_SQL_Errno: 0 Last_SQL_Error: Replicate_Ignore_Server_Ids: Master_Server_Id: 1 Master_UUID: 424134dc-8ef8-11f0-9cf0-a24c09595a7e Master_Info_File: mysql.slave_master_info SQL_Delay: 0 SQL_Remaining_Delay: NULL Slave_SQL_Running_State: Replica has read all relay log; waiting for more updates Master_Retry_Count: 86400 Master_Bind: Last_IO_Error_Timestamp: Last_SQL_Error_Timestamp: Master_SSL_Crl: Master_SSL_Crlpath: Retrieved_Gtid_Set: 424134dc-8ef8-11f0-9cf0-a24c09595a7e:1-8 Executed_Gtid_Set: 0c582975-8ef1-11f0-9ec7-9a57d1505195:1-5387, 424134dc-8ef8-11f0-9cf0-a24c09595a7e:1-8 Auto_Position: 1 Replicate_Rewrite_DB: Channel_Name: Master_TLS_Version: Master_public_key_path: Get_master_public_key: 1 Network_Namespace: `echo " echo \"show variables like 'max_connections';\" | mysql -h127.0.0.1 -uroot -p2MLwgG6236 -P3306 " | kubectl exec -it abk-ipjffc-mysql-1 --namespace ns-pkhtu -- bash ` Defaulted container "mysql" out of: mysql, kbagent, config-manager, init-data (init), init-jq (init), init-kbagent (init), kbagent-worker (init) Unable to use a TTY - input is not a terminal or the right kind of file Warning: arning] Using a password on the command line interface can be insecure. Variable_name Value max_connections 100 connect cluster Success set max_connections to 100 delete cluster abk-ipjffc `kbcli cluster delete abk-ipjffc --auto-approve --namespace ns-pkhtu ` Cluster abk-ipjffc deleted pod_info:abk-ipjffc-mysql-0 3/3 Running 0 109s abk-ipjffc-mysql-1 3/3 Running 0 49s abk-ipjffc-proxysql-0 1/1 Running 0 8s pod_info:abk-ipjffc-mysql-0 3/3 Running 0 2m10s abk-ipjffc-mysql-1 3/3 Running 0 70s abk-ipjffc-proxysql-0 1/1 Terminating 0 29s pod_info:abk-ipjffc-mysql-0 3/3 Terminating 0 2m35s abk-ipjffc-mysql-1 3/3 Terminating 0 95s No resources found in ns-pkhtu namespace. delete cluster pod done No resources found in ns-pkhtu namespace. check cluster resource non-exist OK: pvc No resources found in ns-pkhtu namespace. delete cluster done No resources found in ns-pkhtu namespace. No resources found in ns-pkhtu namespace. No resources found in ns-pkhtu namespace. cluster delete backup `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge backups backup-ns-pkhtu-mysql-ipjffc-20250911181345 --namespace ns-pkhtu ` backup.dataprotection.kubeblocks.io/backup-ns-pkhtu-mysql-ipjffc-20250911181345 patched `kbcli cluster delete-backup mysql-ipjffc --name backup-ns-pkhtu-mysql-ipjffc-20250911181345 --force --auto-approve --namespace ns-pkhtu ` Backup backup-ns-pkhtu-mysql-ipjffc-20250911181345 deleted No opsrequests found in ns-pkhtu namespace. `kubectl get backupschedule -l app.kubernetes.io/instance=mysql-ipjffc ` `kubectl get backupschedule mysql-ipjffc-mysql-backup-schedule -ojsonpath='***.spec.schedules[*].backupMethod***' ` backupschedule.dataprotection.kubeblocks.io/mysql-ipjffc-mysql-backup-schedule patched backupschedule.dataprotection.kubeblocks.io/mysql-ipjffc-mysql-backup-schedule patched check backup status `kbcli cluster list-backups mysql-ipjffc --namespace ns-pkhtu ` No backups found in ns-pkhtu namespace. No backups found in ns-pkhtu namespace. backup_status:-- `kubectl get backupschedule -l app.kubernetes.io/instance=mysql-ipjffc ` `kubectl get backupschedule mysql-ipjffc-mysql-backup-schedule -ojsonpath='***.spec.schedules[*].backupMethod***' ` backupschedule.dataprotection.kubeblocks.io/mysql-ipjffc-mysql-backup-schedule patched backupschedule.dataprotection.kubeblocks.io/mysql-ipjffc-mysql-backup-schedule patched backupschedule.dataprotection.kubeblocks.io/mysql-ipjffc-mysql-backup-schedule patched backupschedule.dataprotection.kubeblocks.io/mysql-ipjffc-mysql-backup-schedule patched (no change) backupschedule.dataprotection.kubeblocks.io/mysql-ipjffc-mysql-backup-schedule patched backupschedule.dataprotection.kubeblocks.io/mysql-ipjffc-mysql-backup-schedule patched (no change) backupschedule.dataprotection.kubeblocks.io/mysql-ipjffc-mysql-backup-schedule patched backupschedule.dataprotection.kubeblocks.io/mysql-ipjffc-mysql-backup-schedule patched (no change) backup_status:mysql-ipjffc-xtrabackup-Running backup_status:mysql-ipjffc-xtrabackup-Running check backup status done backup_status:mysql-ipjffc-xtrabackup-20250911101801 ns-pkhtu mysql-ipjffc xtrabackup Completed 4967699 11s Delete Sep 11,2025 18:18 UTC+0800 Sep 11,2025 18:18 UTC+0800 Sep 19,2025 18:18 UTC+0800 `kubectl get backupschedule -l app.kubernetes.io/instance=mysql-ipjffc ` `kubectl get backupschedule mysql-ipjffc-mysql-backup-schedule -ojsonpath='***.spec.schedules[*].backupMethod***' ` backupschedule.dataprotection.kubeblocks.io/mysql-ipjffc-mysql-backup-schedule patched (no change) backupschedule.dataprotection.kubeblocks.io/mysql-ipjffc-mysql-backup-schedule patched (no change) backupschedule.dataprotection.kubeblocks.io/mysql-ipjffc-mysql-backup-schedule patched (no change) backupschedule.dataprotection.kubeblocks.io/mysql-ipjffc-mysql-backup-schedule patched (no change) backupschedule.dataprotection.kubeblocks.io/mysql-ipjffc-mysql-backup-schedule patched (no change) backupschedule.dataprotection.kubeblocks.io/mysql-ipjffc-mysql-backup-schedule patched (no change) backupschedule.dataprotection.kubeblocks.io/mysql-ipjffc-mysql-backup-schedule patched (no change) backupschedule.dataprotection.kubeblocks.io/mysql-ipjffc-mysql-backup-schedule patched (no change) cluster restore backup Error from server (NotFound): opsrequests.operations.kubeblocks.io "abk-ipjffc" not found `kbcli cluster describe-backup --names mysql-ipjffc-xtrabackup-20250911101801 --namespace ns-pkhtu ` Name: mysql-ipjffc-xtrabackup-20250911101801 Cluster: mysql-ipjffc Namespace: ns-pkhtu Spec: Method: xtrabackup Policy Name: mysql-ipjffc-mysql-backup-policy Actions: dp-backup-0: ActionType: Job WorkloadName: dp-backup-0-mysql-ipjffc-xtrabackup-20250911101801-8adbf19c TargetPodName: mysql-ipjffc-mysql-0 Phase: Completed Start Time: Sep 11,2025 18:18 UTC+0800 Completion Time: Sep 11,2025 18:18 UTC+0800 Status: Phase: Completed Total Size: 4967699 ActionSet Name: mysql-xtrabackup-br Repository: backuprepo-kbcli-test Duration: 11s Expiration Time: Sep 19,2025 18:18 UTC+0800 Start Time: Sep 11,2025 18:18 UTC+0800 Completion Time: Sep 11,2025 18:18 UTC+0800 Path: /ns-pkhtu/mysql-ipjffc-3589fa19-3246-4813-9e31-0a0a75b3714c/mysql/mysql-ipjffc-xtrabackup-20250911101801 Warning Events: `kbcli cluster restore abk-ipjffc --backup mysql-ipjffc-xtrabackup-20250911101801 --namespace ns-pkhtu ` Cluster abk-ipjffc created check cluster status `kbcli cluster list abk-ipjffc --show-labels --namespace ns-pkhtu ` NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS abk-ipjffc ns-pkhtu mysql WipeOut Creating Sep 11,2025 18:18 UTC+0800 clusterdefinition.kubeblocks.io/name=mysql cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances abk-ipjffc --namespace ns-pkhtu ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME abk-ipjffc-mysql-0 ns-pkhtu abk-ipjffc mysql Running primary 0 600m / 600m 644245094400m / 644245094400m data:12Gi aks-cicdamdpool-40497330-vmss000000/10.224.0.6 Sep 11,2025 18:19 UTC+0800 abk-ipjffc-mysql-1 ns-pkhtu abk-ipjffc mysql Running secondary 0 600m / 600m 644245094400m / 644245094400m data:12Gi aks-cicdamdpool-40497330-vmss000002/10.224.0.5 Sep 11,2025 18:20 UTC+0800 abk-ipjffc-proxysql-0 ns-pkhtu abk-ipjffc proxysql Running 0 500m / 500m 512Mi / 512Mi aks-cicdamdpool-40497330-vmss000001/10.224.0.7 Sep 11,2025 18:23 UTC+0800 check pod status done check cluster role check cluster role done primary: abk-ipjffc-mysql-0;secondary: abk-ipjffc-mysql-1 `kubectl get secrets -l app.kubernetes.io/instance=abk-ipjffc` set secret: abk-ipjffc-mysql-account-root `kubectl get secrets abk-ipjffc-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets abk-ipjffc-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets abk-ipjffc-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:2MLwgG6236;DB_PORT:3306;DB_DATABASE:mysql check cluster connect `echo " echo \"SHOW SLAVE STATUS\G;\" | mysql -P3306 -h127.0.0.1 -uroot -p'2MLwgG6236' " | kubectl exec -it abk-ipjffc-mysql-1 --namespace ns-pkhtu -- bash ` check cluster connect done `kbcli cluster describe-backup --names mysql-ipjffc-xtrabackup-20250911101801 --namespace ns-pkhtu ` Name: mysql-ipjffc-xtrabackup-20250911101801 Cluster: mysql-ipjffc Namespace: ns-pkhtu Spec: Method: xtrabackup Policy Name: mysql-ipjffc-mysql-backup-policy Actions: dp-backup-0: ActionType: Job WorkloadName: dp-backup-0-mysql-ipjffc-xtrabackup-20250911101801-8adbf19c TargetPodName: mysql-ipjffc-mysql-0 Phase: Completed Start Time: Sep 11,2025 18:18 UTC+0800 Completion Time: Sep 11,2025 18:18 UTC+0800 Status: Phase: Completed Total Size: 4967699 ActionSet Name: mysql-xtrabackup-br Repository: backuprepo-kbcli-test Duration: 11s Expiration Time: Sep 19,2025 18:18 UTC+0800 Start Time: Sep 11,2025 18:18 UTC+0800 Completion Time: Sep 11,2025 18:18 UTC+0800 Path: /ns-pkhtu/mysql-ipjffc-3589fa19-3246-4813-9e31-0a0a75b3714c/mysql/mysql-ipjffc-xtrabackup-20250911101801 Warning Events: cluster connect `kubectl get secrets -l app.kubernetes.io/instance=abk-ipjffc` set secret: abk-ipjffc-mysql-account-root `kubectl get secrets abk-ipjffc-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets abk-ipjffc-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets abk-ipjffc-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:2MLwgG6236;DB_PORT:3306;DB_DATABASE:mysql Defaulted container "mysql" out of: mysql, kbagent, config-manager, init-data (init), init-jq (init), init-kbagent (init), kbagent-worker (init) Unable to use a TTY - input is not a terminal or the right kind of file Warning: arning] Using a password on the command line interface can be insecure. *************************** 1. row *************************** Slave_IO_State: Waiting for source to send event Master_Host: abk-ipjffc-mysql-0.abk-ipjffc-mysql-headless Master_User: root Master_Port: 3306 Connect_Retry: 1 Master_Log_File: abk-ipjffc-mysql-0-bin.000001 Read_Master_Log_Pos: 2959 Relay_Log_File: relay-bin.000002 Relay_Log_Pos: 3201 Relay_Master_Log_File: abk-ipjffc-mysql-0-bin.000001 Slave_IO_Running: Yes Slave_SQL_Running: Yes Replicate_Do_DB: Replicate_Ignore_DB: Replicate_Do_Table: Replicate_Ignore_Table: Replicate_Wild_Do_Table: Replicate_Wild_Ignore_Table: Last_Errno: 0 Last_Error: Skip_Counter: 0 Exec_Master_Log_Pos: 2959 Relay_Log_Space: 3405 Until_Condition: None Until_Log_File: Until_Log_Pos: 0 Master_SSL_Allowed: No Master_SSL_CA_File: Master_SSL_CA_Path: Master_SSL_Cert: Master_SSL_Cipher: Master_SSL_Key: Seconds_Behind_Master: 0 Master_SSL_Verify_Server_Cert: No Last_IO_Errno: 0 Last_IO_Error: Last_SQL_Errno: 0 Last_SQL_Error: Replicate_Ignore_Server_Ids: Master_Server_Id: 1 Master_UUID: c248d526-8ef8-11f0-abfd-a24c09595a7e Master_Info_File: mysql.slave_master_info SQL_Delay: 0 SQL_Remaining_Delay: NULL Slave_SQL_Running_State: Replica has read all relay log; waiting for more updates Master_Retry_Count: 86400 Master_Bind: Last_IO_Error_Timestamp: Last_SQL_Error_Timestamp: Master_SSL_Crl: Master_SSL_Crlpath: Retrieved_Gtid_Set: c248d526-8ef8-11f0-abfd-a24c09595a7e:1-8 Executed_Gtid_Set: 0c582975-8ef1-11f0-9ec7-9a57d1505195:1-5387, c248d526-8ef8-11f0-abfd-a24c09595a7e:1-8 Auto_Position: 1 Replicate_Rewrite_DB: Channel_Name: Master_TLS_Version: Master_public_key_path: Get_master_public_key: 1 Network_Namespace: `echo " echo \"show variables like 'max_connections';\" | mysql -h127.0.0.1 -uroot -p2MLwgG6236 -P3306 " | kubectl exec -it abk-ipjffc-mysql-1 --namespace ns-pkhtu -- bash ` Defaulted container "mysql" out of: mysql, kbagent, config-manager, init-data (init), init-jq (init), init-kbagent (init), kbagent-worker (init) Unable to use a TTY - input is not a terminal or the right kind of file Warning: arning] Using a password on the command line interface can be insecure. Variable_name Value max_connections 100 connect cluster Success set max_connections to 100 delete cluster abk-ipjffc `kbcli cluster delete abk-ipjffc --auto-approve --namespace ns-pkhtu ` Cluster abk-ipjffc deleted pod_info:abk-ipjffc-mysql-0 3/3 Running 0 4m7s abk-ipjffc-mysql-1 3/3 Running 0 2m45s abk-ipjffc-proxysql-0 1/1 Running 0 8s pod_info:abk-ipjffc-mysql-0 3/3 Running 0 4m27s abk-ipjffc-mysql-1 3/3 Running 0 3m5s abk-ipjffc-proxysql-0 1/1 Terminating 0 28s pod_info:abk-ipjffc-mysql-0 3/3 Terminating 0 4m52s abk-ipjffc-mysql-1 3/3 Terminating 0 3m30s No resources found in ns-pkhtu namespace. delete cluster pod done No resources found in ns-pkhtu namespace. check cluster resource non-exist OK: pvc No resources found in ns-pkhtu namespace. delete cluster done No resources found in ns-pkhtu namespace. No resources found in ns-pkhtu namespace. No resources found in ns-pkhtu namespace. cluster delete backup `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge backups mysql-ipjffc-xtrabackup-20250911101801 --namespace ns-pkhtu ` backup.dataprotection.kubeblocks.io/mysql-ipjffc-xtrabackup-20250911101801 patched `kbcli cluster delete-backup mysql-ipjffc --name mysql-ipjffc-xtrabackup-20250911101801 --force --auto-approve --namespace ns-pkhtu ` Backup mysql-ipjffc-xtrabackup-20250911101801 deleted No opsrequests found in ns-pkhtu namespace. cluster list-logs `kbcli cluster list-logs mysql-ipjffc --namespace ns-pkhtu ` No log files found. Error from server (NotFound): pods "mysql-ipjffc-mysql-1" not found cluster logs `kbcli cluster logs mysql-ipjffc --tail 30 --namespace ns-pkhtu ` Defaulted container "mysql" out of: mysql, kbagent, config-manager, init-data (init), init-jq (init), init-kbagent (init), kbagent-worker (init) 2025-09-11 10:08:15+00:00 [Note] [Entrypoint]: Entrypoint script for MySQL Server 8.0.30-1.el8 started. 2025-09-11 10:08:16+00:00 [Note] [Entrypoint]: Switching to dedicated user 'mysql' 2025-09-11 10:08:16+00:00 [Note] [Entrypoint]: Entrypoint script for MySQL Server 8.0.30-1.el8 started. '/var/lib/mysql/mysql.sock' -> '/var/run/mysqld/mysqld.sock' cluster logs slow `kbcli cluster logs mysql-ipjffc --tail 30 --file-type=slow --namespace ns-pkhtu ` error: can't get file path pattern by type slow cluster logs error `kbcli cluster logs mysql-ipjffc --tail 30 --file-type=error --namespace ns-pkhtu ` error: can't get file path pattern by type error LB_TYPE is set to: internet cluster expose check cluster status before ops check cluster status done cluster_status:Running `kbcli cluster expose mysql-ipjffc --auto-approve --force=true --type internet --enable false --components mysql --role-selector primary --namespace ns-pkhtu ` OpsRequest mysql-ipjffc-expose-xmtdl created successfully, you can view the progress: kbcli cluster describe-ops mysql-ipjffc-expose-xmtdl -n ns-pkhtu check ops status `kbcli cluster list-ops mysql-ipjffc --status all --namespace ns-pkhtu ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME mysql-ipjffc-expose-xmtdl ns-pkhtu Expose mysql-ipjffc Creating -/- Sep 11,2025 18:24 UTC+0800 check cluster status `kbcli cluster list mysql-ipjffc --show-labels --namespace ns-pkhtu ` NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS mysql-ipjffc ns-pkhtu mysql WipeOut Running Sep 11,2025 17:23 UTC+0800 app.kubernetes.io/instance=mysql-ipjffc,clusterdefinition.kubeblocks.io/name=mysql check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances mysql-ipjffc --namespace ns-pkhtu ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME mysql-ipjffc-mysql-0 ns-pkhtu mysql-ipjffc mysql Running secondary 0 600m / 600m 644245094400m / 644245094400m data:12Gi aks-cicdamdpool-40497330-vmss000002/10.224.0.5 Sep 11,2025 18:06 UTC+0800 mysql-ipjffc-mysql-1 ns-pkhtu mysql-ipjffc mysql Running primary 0 600m / 600m 644245094400m / 644245094400m data:12Gi aks-cicdamdpool-40497330-vmss000000/10.224.0.6 Sep 11,2025 18:08 UTC+0800 mysql-ipjffc-proxysql-0 ns-pkhtu mysql-ipjffc proxysql Running 0 500m / 500m 512Mi / 512Mi aks-cicdamdpool-40497330-vmss000001/10.224.0.7 Sep 11,2025 18:09 UTC+0800 check pod status done check cluster role check cluster role done primary: mysql-ipjffc-mysql-1;secondary: mysql-ipjffc-mysql-0 `kubectl get secrets -l app.kubernetes.io/instance=mysql-ipjffc` set secret: mysql-ipjffc-mysql-account-root `kubectl get secrets mysql-ipjffc-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-ipjffc-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-ipjffc-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:2MLwgG6236;DB_PORT:3306;DB_DATABASE:mysql check cluster connect `echo " echo \"SHOW SLAVE STATUS\G;\" | mysql -P3306 -h127.0.0.1 -uroot -p'2MLwgG6236' " | kubectl exec -it mysql-ipjffc-mysql-0 --namespace ns-pkhtu -- bash ` check cluster connect done check ops status `kbcli cluster list-ops mysql-ipjffc --status all --namespace ns-pkhtu ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME mysql-ipjffc-expose-xmtdl ns-pkhtu Expose mysql-ipjffc mysql Running 0/1 Sep 11,2025 18:24 UTC+0800 ops_status:mysql-ipjffc-expose-xmtdl ns-pkhtu Expose mysql-ipjffc mysql Running 0/1 Sep 11,2025 18:24 UTC+0800 ops_status:mysql-ipjffc-expose-xmtdl ns-pkhtu Expose mysql-ipjffc mysql Running 0/1 Sep 11,2025 18:24 UTC+0800 check ops status done ops_status:mysql-ipjffc-expose-xmtdl ns-pkhtu Expose mysql-ipjffc mysql Succeed 1/1 Sep 11,2025 18:24 UTC+0800 `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge opsrequests.operations mysql-ipjffc-expose-xmtdl --namespace ns-pkhtu ` opsrequest.operations.kubeblocks.io/mysql-ipjffc-expose-xmtdl patched `kbcli cluster delete-ops --name mysql-ipjffc-expose-xmtdl --force --auto-approve --namespace ns-pkhtu ` OpsRequest mysql-ipjffc-expose-xmtdl deleted `kubectl get secrets -l app.kubernetes.io/instance=mysql-ipjffc` set secret: mysql-ipjffc-mysql-account-root `kubectl get secrets mysql-ipjffc-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-ipjffc-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-ipjffc-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:2MLwgG6236;DB_PORT:3306;DB_DATABASE:mysql check db_client batch data count `echo "echo \"select count(*) from executions_loop.executions_loop_table;\" | mysql -P3306 -hmysql-ipjffc-mysql-server.ns-pkhtu.svc.cluster.local -uroot -p'2MLwgG6236' " | kubectl exec -it mysql-ipjffc-mysql-1 --namespace ns-pkhtu -- bash ` check db_client batch data Success `kubectl get secrets -l app.kubernetes.io/instance=mysql-ipjffc` set secret: mysql-ipjffc-mysql-account-root `kubectl get secrets mysql-ipjffc-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-ipjffc-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-ipjffc-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:2MLwgG6236;DB_PORT:3306;DB_DATABASE:mysql check readonly db_client batch data count `echo "echo \"select count(*) from executions_loop.executions_loop_table;\" | mysql -P3306 -h127.0.0.1 -uroot -p'2MLwgG6236' " | kubectl exec -it mysql-ipjffc-mysql-0 --namespace ns-pkhtu -- bash ` check readonly db_client batch data Success delete cluster mysql-ipjffc `kbcli cluster delete mysql-ipjffc --auto-approve --namespace ns-pkhtu ` Cluster mysql-ipjffc deleted pod_info:mysql-ipjffc-mysql-0 3/3 Running 0 17m mysql-ipjffc-mysql-1 3/3 Running 0 16m mysql-ipjffc-proxysql-0 1/1 Running 0 15m pod_info:mysql-ipjffc-mysql-0 3/3 Running 0 18m mysql-ipjffc-mysql-1 3/3 Running 0 17m mysql-ipjffc-proxysql-0 1/1 Terminating 0 16m pod_info:mysql-ipjffc-mysql-0 3/3 Terminating 0 18m mysql-ipjffc-mysql-1 3/3 Terminating 0 17m No resources found in ns-pkhtu namespace. delete cluster pod done No resources found in ns-pkhtu namespace. check cluster resource non-exist OK: pvc No resources found in ns-pkhtu namespace. delete cluster done No resources found in ns-pkhtu namespace. No resources found in ns-pkhtu namespace. No resources found in ns-pkhtu namespace. Mysql Test Suite All Done! delete cluster orcm-ipjffc `kbcli cluster delete orcm-ipjffc --auto-approve --namespace ns-pkhtu ` Cluster orcm-ipjffc deleted pod_info:orcm-ipjffc-orchestrator-0 2/2 Running 0 64m orcm-ipjffc-orchestrator-1 2/2 Running 0 63m orcm-ipjffc-orchestrator-2 2/2 Running 0 63m pod_info:orcm-ipjffc-orchestrator-0 2/2 Terminating 0 64m orcm-ipjffc-orchestrator-1 2/2 Terminating 0 64m orcm-ipjffc-orchestrator-2 2/2 Terminating 0 63m No resources found in ns-pkhtu namespace. delete cluster pod done No resources found in ns-pkhtu namespace. check cluster resource non-exist OK: pvc No resources found in ns-pkhtu namespace. delete cluster done No resources found in ns-pkhtu namespace. No resources found in ns-pkhtu namespace. No resources found in ns-pkhtu namespace. Test Engine: mysql Test Type: 21 [PASSED]|[Create]|[ComponentDefinition=orchestrator-raft-1.0.1;ServiceVersion=3.2.6;]|[Description=Create a cluster with the specified component definition orchestrator-raft-1.0.1 and service version 3.2.6] --------------------------------------Mysql Orchestrator Proxysql (Topology = orc-proxysql Replicas 2) Test Result-------------------------------------- [PASSED]|[Create]|[ComponentDefinition=mysql-8.0-1.0.1;ComponentVersion=mysql;ServiceVersion=8.0.30;]|[Description=Create a cluster with the specified component definition mysql-8.0-1.0.1 and component version mysql and service version 8.0.30] [PASSED]|[Connect]|[ComponentName=mysql]|[Description=Connect to the cluster] [PASSED]|[Expose]|[Enable=true;TYPE=internet;ComponentName=mysql]|[Description=Expose Enable the internet service with mysql component] [PASSED]|[No-Failover]|[HA=DNS Error;Durations=2m;ComponentName=mysql]|[Description=Simulates conditions where pods experience DNS service errors for a period of time either due to expected/undesired processes thereby testing the application's resilience to potential slowness/unavailability of some replicas due to DNS service errors.] [PASSED]|[Bench]|[HostType=LB;ComponentName=mysql]|[Description=Bench the cluster LB service with mysql component] [PASSED]|[Failover]|[HA=Network Corrupt;Durations=2m;ComponentName=mysql]|[Description=Simulates network corrupt fault thereby testing the application's resilience to potential slowness/unavailability of some replicas due to corrupt network.] [PASSED]|[No-Failover]|[HA=Full CPU;Durations=2m;ComponentName=mysql]|[Description=Simulates conditions where pods experience CPU full either due to expected/undesired processes thereby testing the application's resilience to potential slowness/unavailability of some replicas due to high CPU load.] [PASSED]|[No-Failover]|[HA=Network Partition;Durations=2m;ComponentName=mysql]|[Description=Simulates network partition fault thereby testing the application's resilience to potential slowness/unavailability of some replicas due to partition network.] [PASSED]|[No-Failover]|[HA=DNS Random;Durations=2m;ComponentName=mysql]|[Description=Simulates conditions where pods experience random IP addresses being returned by the DNS service for a period of time either due to expected/undesired processes thereby testing the application's resilience to potential slowness/unavailability of some replicas due to the DNS service returning random IP addresses.] [PASSED]|[VolumeExpansion]|[ComponentName=mysql]|[Description=VolumeExpansion the cluster specify component mysql] [PASSED]|[Failover]|[HA=OOM;Durations=2m;ComponentName=mysql]|[Description=Simulates conditions where pods experience OOM either due to expected/undesired processes thereby testing the application's resilience to potential slowness/unavailability of some replicas due to high Memory load.] [PASSED]|[No-Failover]|[HA=Network Duplicate;Durations=2m;ComponentName=mysql]|[Description=Simulates network duplicate fault thereby testing the application's resilience to potential slowness/unavailability of some replicas due to duplicate network.] [PASSED]|[Update]|[Monitor=true]|[Description=Update the cluster Monitor enable] [PASSED]|[Failover]|[HA=Network Bandwidth;Durations=2m;ComponentName=mysql]|[Description=Simulates network bandwidth fault thereby testing the application's resilience to potential slowness/unavailability of some replicas due to bandwidth network.] [PASSED]|[No-Failover]|[HA=Time Offset;Durations=2m;ComponentName=mysql]|[Description=Simulates a time offset scenario thereby testing the application's resilience to potential slowness/unavailability of some replicas due to time offset.] [PASSED]|[Stop]|[-]|[Description=Stop the cluster] [PASSED]|[Start]|[-]|[Description=Start the cluster] [PASSED]|[Reconfiguring]|[ComponentName=mysql;binlog_expire_logs_seconds=691200]|[Description=Reconfiguring the cluster specify component mysql set binlog_expire_logs_seconds=691200] [PASSED]|[VerticalScaling]|[ComponentName=mysql]|[Description=VerticalScaling the cluster specify component mysql] [PASSED]|[Restart]|[-]|[Description=Restart the cluster] [PASSED]|[No-Failover]|[HA=Network Delay;Durations=2m;ComponentName=mysql]|[Description=Simulates network delay fault thereby testing the application's resilience to potential slowness/unavailability of some replicas due to delay network.] [PASSED]|[No-Failover]|[HA=Connection Stress;ComponentName=mysql]|[Description=Simulates conditions where pods experience connection stress either due to expected/undesired processes thereby testing the application's resilience to potential slowness/unavailability of some replicas due to high Connection load.] [WARNING]|[CheckFailover]|[FailoverType=networkloss]|[Description=-] [PASSED]|[Failover]|[HA=Network Loss;Durations=2m;ComponentName=mysql]|[Description=Simulates network loss fault thereby testing the application's resilience to potential slowness/unavailability of some replicas due to loss network.] [PASSED]|[Update]|[TerminationPolicy=WipeOut]|[Description=Update the cluster TerminationPolicy WipeOut] [PASSED]|[Backup]|[BackupMethod=xtrabackup]|[Description=The cluster xtrabackup Backup] [PASSED]|[Restore]|[BackupMethod=xtrabackup]|[Description=The cluster xtrabackup Restore] [PASSED]|[Connect]|[ComponentName=mysql]|[Description=Connect to the cluster] [PASSED]|[Delete Restore Cluster]|[BackupMethod=xtrabackup]|[Description=Delete the xtrabackup restore cluster] [PASSED]|[Backup]|[Schedule=true;BackupMethod=xtrabackup]|[Description=The cluster Schedule xtrabackup Backup] [PASSED]|[Restore]|[Schedule=true;BackupMethod=xtrabackup]|[Description=The cluster Schedule xtrabackup Restore] [PASSED]|[Connect]|[ComponentName=mysql]|[Description=Connect to the cluster] [PASSED]|[Delete Restore Cluster]|[Schedule=true;BackupMethod=xtrabackup]|[Description=Delete the Schedule xtrabackup restore cluster] [PASSED]|[Expose]|[Disable=true;TYPE=internet;ComponentName=mysql]|[Description=Expose Disable the internet service with mysql component] [PASSED]|[Delete]|[-]|[Description=Delete the cluster] [END]