source commons files source engines files source kubeblocks files source kubedb files CLUSTER_NAME: `kubectl get namespace | grep ns-oihey ` `kubectl create namespace ns-oihey` namespace/ns-oihey created create namespace ns-oihey done download kbcli `gh release list --repo apecloud/kbcli --limit 100 | (grep "1.0" || true)` `curl -fsSL https://kubeblocks.io/installer/install_cli.sh | bash -s v1.0.1` Your system is linux_amd64 Installing kbcli ... Downloading ... % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 33.6M 100 33.6M 0 0 99.1M 0 --:--:-- --:--:-- --:--:-- 99.1M kbcli installed successfully. Kubernetes: v1.32.6 KubeBlocks: 1.0.1 kbcli: 1.0.1 Make sure your docker service is running and begin your journey with kbcli: kbcli playground init For more information on how to get started, please visit: https://kubeblocks.io download kbcli v1.0.1 done Kubernetes: v1.32.6 KubeBlocks: 1.0.1 kbcli: 1.0.1 Kubernetes Env: v1.32.6 check snapshot controller check snapshot controller done POD_RESOURCES: aks kb-default-sc found aks default-vsc found found default storage class: default KubeBlocks version is:1.0.1 skip upgrade KubeBlocks current KubeBlocks version: 1.0.1 Error: no repositories to show helm repo add chaos-mesh https://charts.chaos-mesh.org "chaos-mesh" has been added to your repositories add helm chart repo chaos-mesh success chaos mesh already installed check component definition set component name:mysql set component version set component version:mysql set service versions:8.4.2,8.4.1,8.4.0,8.0.39,8.0.38,8.0.37,8.0.36,8.0.35,8.0.34,8.0.33,8.0.32,8.0.31,8.0.30,5.7.44 set service versions sorted:5.7.44,8.0.30,8.0.31,8.0.32,8.0.33,8.0.34,8.0.35,8.0.36,8.0.37,8.0.38,8.0.39,8.4.0,8.4.1,8.4.2 set mysql component definition set mysql component definition REPORT_COUNT 0:0 set replicas first:2,5.7.44|2,8.0.30|2,8.0.31|2,8.0.32|2,8.0.33|2,8.0.34|2,8.0.35|2,8.0.36|2,8.0.37|2,8.0.38|2,8.0.39|2,8.4.0|2,8.4.1|2,8.4.2 set replicas third:2,8.0.35 set replicas fourth:2,8.0.30 set minimum cmpv service version set minimum cmpv service version replicas:2,8.0.30 REPORT_COUNT:1 CLUSTER_TOPOLOGY:semisync topology semisync found in cluster definition mysql set mysql component definition set mysql component definition LIMIT_CPU:0.1 LIMIT_MEMORY:0.5 storage size: 10 CLUSTER_NAME:mysql-uaeapw No resources found in ns-oihey namespace. pod_info: termination_policy:Delete create 2 replica Delete mysql cluster check component definition set component definition by component version check cmpd by labels set component definition1: mysql-8.0-1.0.1 by component version:mysql apiVersion: apps.kubeblocks.io/v1 kind: Cluster metadata: name: mysql-uaeapw namespace: ns-oihey spec: clusterDef: mysql topology: semisync terminationPolicy: Delete componentSpecs: - name: mysql serviceVersion: 8.0.30 disableExporter: true replicas: 2 resources: limits: cpu: 100m memory: 0.5Gi requests: cpu: 100m memory: 0.5Gi volumeClaimTemplates: - name: data spec: storageClassName: accessModes: - ReadWriteOnce resources: requests: storage: 10Gi `kubectl apply -f test_create_mysql-uaeapw.yaml` cluster.apps.kubeblocks.io/mysql-uaeapw created apply test_create_mysql-uaeapw.yaml Success `rm -rf test_create_mysql-uaeapw.yaml` check cluster status `kbcli cluster list mysql-uaeapw --show-labels --namespace ns-oihey ` NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS mysql-uaeapw ns-oihey mysql Delete Creating Sep 12,2025 13:05 UTC+0800 clusterdefinition.kubeblocks.io/name=mysql cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances mysql-uaeapw --namespace ns-oihey ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME mysql-uaeapw-mysql-0 ns-oihey mysql-uaeapw mysql Running primary 0 100m / 100m 512Mi / 512Mi data:10Gi aks-cicdamdpool-13759654-vmss000002/10.224.0.6 Sep 12,2025 13:05 UTC+0800 mysql-uaeapw-mysql-1 ns-oihey mysql-uaeapw mysql Running secondary 0 100m / 100m 512Mi / 512Mi data:10Gi aks-cicdamdpool-13759654-vmss000001/10.224.0.7 Sep 12,2025 13:08 UTC+0800 check pod status done check cluster role check cluster role done primary: mysql-uaeapw-mysql-0;secondary: mysql-uaeapw-mysql-1 `kubectl get secrets -l app.kubernetes.io/instance=mysql-uaeapw` set secret: mysql-uaeapw-mysql-account-root `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:29FV699wpG;DB_PORT:3306;DB_DATABASE:mysql check cluster connect `echo " echo \"SHOW SLAVE STATUS\G;\" | mysql -P3306 -h127.0.0.1 -uroot -p'29FV699wpG' " | kubectl exec -it mysql-uaeapw-mysql-1 --namespace ns-oihey -- bash ` connect checking... connect checking... connect checking... connect checking... connect checking... connect checking... connect checking... connect checking... connect checking... check cluster connect done `kubectl get secrets -l app.kubernetes.io/instance=mysql-uaeapw` set secret: mysql-uaeapw-mysql-account-root `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:29FV699wpG;DB_PORT:3306;DB_DATABASE:mysql check pod mysql-uaeapw-mysql-0 container_name mysql exist password 29FV699wpG check pod mysql-uaeapw-mysql-0 container_name mysql-exporter exist password 29FV699wpG check pod mysql-uaeapw-mysql-0 container_name kbagent exist password 29FV699wpG check pod mysql-uaeapw-mysql-0 container_name config-manager exist password 29FV699wpG No container logs contain secret password. describe cluster `kbcli cluster describe mysql-uaeapw --namespace ns-oihey ` Name: mysql-uaeapw Created Time: Sep 12,2025 13:05 UTC+0800 NAMESPACE CLUSTER-DEFINITION TOPOLOGY STATUS TERMINATION-POLICY ns-oihey mysql semisync Running Delete Endpoints: COMPONENT INTERNAL EXTERNAL mysql mysql-uaeapw-mysql.ns-oihey.svc.cluster.local:3306 Topology: COMPONENT SERVICE-VERSION INSTANCE ROLE STATUS AZ NODE CREATED-TIME mysql 8.0.30 mysql-uaeapw-mysql-0 primary Running 0 aks-cicdamdpool-13759654-vmss000002/10.224.0.6 Sep 12,2025 13:05 UTC+0800 mysql 8.0.30 mysql-uaeapw-mysql-1 secondary Running 0 aks-cicdamdpool-13759654-vmss000001/10.224.0.7 Sep 12,2025 13:08 UTC+0800 Resources Allocation: COMPONENT INSTANCE-TEMPLATE CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE-SIZE STORAGE-CLASS mysql 100m / 100m 512Mi / 512Mi data:10Gi default Images: COMPONENT COMPONENT-DEFINITION IMAGE mysql mysql-8.0-1.0.1 docker.io/apecloud/mysql:8.0.30 docker.io/apecloud/mysqld-exporter:0.15.1 docker.io/apecloud/kubeblocks-tools:1.0.1 Data Protection: BACKUP-REPO AUTO-BACKUP BACKUP-SCHEDULE BACKUP-METHOD BACKUP-RETENTION RECOVERABLE-TIME Show cluster events: kbcli cluster list-events -n ns-oihey mysql-uaeapw `kbcli cluster label mysql-uaeapw app.kubernetes.io/instance- --namespace ns-oihey ` label "app.kubernetes.io/instance" not found. `kbcli cluster label mysql-uaeapw app.kubernetes.io/instance=mysql-uaeapw --namespace ns-oihey ` `kbcli cluster label mysql-uaeapw --list --namespace ns-oihey ` NAME NAMESPACE LABELS mysql-uaeapw ns-oihey app.kubernetes.io/instance=mysql-uaeapw clusterdefinition.kubeblocks.io/name=mysql label cluster app.kubernetes.io/instance=mysql-uaeapw Success `kbcli cluster label case.name=kbcli.test1 -l app.kubernetes.io/instance=mysql-uaeapw --namespace ns-oihey ` `kbcli cluster label mysql-uaeapw --list --namespace ns-oihey ` NAME NAMESPACE LABELS mysql-uaeapw ns-oihey app.kubernetes.io/instance=mysql-uaeapw case.name=kbcli.test1 clusterdefinition.kubeblocks.io/name=mysql label cluster case.name=kbcli.test1 Success `kbcli cluster label mysql-uaeapw case.name=kbcli.test2 --overwrite --namespace ns-oihey ` `kbcli cluster label mysql-uaeapw --list --namespace ns-oihey ` NAME NAMESPACE LABELS mysql-uaeapw ns-oihey app.kubernetes.io/instance=mysql-uaeapw case.name=kbcli.test2 clusterdefinition.kubeblocks.io/name=mysql label cluster case.name=kbcli.test2 Success `kbcli cluster label mysql-uaeapw case.name- --namespace ns-oihey ` `kbcli cluster label mysql-uaeapw --list --namespace ns-oihey ` NAME NAMESPACE LABELS mysql-uaeapw ns-oihey app.kubernetes.io/instance=mysql-uaeapw clusterdefinition.kubeblocks.io/name=mysql delete cluster label case.name Success cluster connect `kubectl get secrets -l app.kubernetes.io/instance=mysql-uaeapw` set secret: mysql-uaeapw-mysql-account-root `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:29FV699wpG;DB_PORT:3306;DB_DATABASE:mysql Defaulted container "mysql" out of: mysql, mysql-exporter, kbagent, config-manager, init-data (init), init-xtrabackup (init), init-jemalloc (init), init-syncer (init), init-kbagent (init), kbagent-worker (init) Unable to use a TTY - input is not a terminal or the right kind of file Warning: arning] Using a password on the command line interface can be insecure. *************************** 1. row *************************** Slave_IO_State: Waiting for source to send event Master_Host: mysql-uaeapw-mysql-0.mysql-uaeapw-mysql-headless Master_User: kbreplicator Master_Port: 3306 Connect_Retry: 60 Master_Log_File: mysql-uaeapw-mysql-0-bin.000004 Read_Master_Log_Pos: 20648 Relay_Log_File: relay-bin.000002 Relay_Log_Pos: 20854 Relay_Master_Log_File: mysql-uaeapw-mysql-0-bin.000004 Slave_IO_Running: Yes Slave_SQL_Running: Yes Replicate_Do_DB: Replicate_Ignore_DB: Replicate_Do_Table: Replicate_Ignore_Table: Replicate_Wild_Do_Table: Replicate_Wild_Ignore_Table: Last_Errno: 0 Last_Error: Skip_Counter: 0 Exec_Master_Log_Pos: 20648 Relay_Log_Space: 21058 Until_Condition: None Until_Log_File: Until_Log_Pos: 0 Master_SSL_Allowed: Yes Master_SSL_CA_File: Master_SSL_CA_Path: Master_SSL_Cert: Master_SSL_Cipher: Master_SSL_Key: Seconds_Behind_Master: 0 Master_SSL_Verify_Server_Cert: No Last_IO_Errno: 0 Last_IO_Error: Last_SQL_Errno: 0 Last_SQL_Error: Replicate_Ignore_Server_Ids: Master_Server_Id: 1 Master_UUID: 7b207893-8f96-11f0-91e0-b23bb744dc56 Master_Info_File: mysql.slave_master_info SQL_Delay: 0 SQL_Remaining_Delay: NULL Slave_SQL_Running_State: Replica has read all relay log; waiting for more updates Master_Retry_Count: 86400 Master_Bind: Last_IO_Error_Timestamp: Last_SQL_Error_Timestamp: Master_SSL_Crl: Master_SSL_Crlpath: Retrieved_Gtid_Set: 7b207893-8f96-11f0-91e0-b23bb744dc56:63-113 Executed_Gtid_Set: 7b207893-8f96-11f0-91e0-b23bb744dc56:1-113 Auto_Position: 1 Replicate_Rewrite_DB: Channel_Name: Master_TLS_Version: Master_public_key_path: Get_master_public_key: 0 Network_Namespace: `echo " echo \"show variables like 'max_connections';\" | mysql -h127.0.0.1 -uroot -p29FV699wpG -P3306 " | kubectl exec -it mysql-uaeapw-mysql-1 --namespace ns-oihey -- bash ` Defaulted container "mysql" out of: mysql, mysql-exporter, kbagent, config-manager, init-data (init), init-xtrabackup (init), init-jemalloc (init), init-syncer (init), init-kbagent (init), kbagent-worker (init) Unable to use a TTY - input is not a terminal or the right kind of file Warning: arning] Using a password on the command line interface can be insecure. Variable_name Value max_connections 83 connect cluster Success set max_connections to 83 insert batch data by db client Error from server (NotFound): pods "test-db-client-executionloop-mysql-uaeapw" not found `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge pods test-db-client-executionloop-mysql-uaeapw --namespace ns-oihey ` Error from server (NotFound): pods "test-db-client-executionloop-mysql-uaeapw" not found Warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely. Error from server (NotFound): pods "test-db-client-executionloop-mysql-uaeapw" not found `kubectl get secrets -l app.kubernetes.io/instance=mysql-uaeapw` set secret: mysql-uaeapw-mysql-account-root `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:29FV699wpG;DB_PORT:3306;DB_DATABASE:mysql apiVersion: v1 kind: Pod metadata: name: test-db-client-executionloop-mysql-uaeapw namespace: ns-oihey spec: containers: - name: test-dbclient imagePullPolicy: IfNotPresent image: docker.io/apecloud/dbclient:test args: - "--host" - "mysql-uaeapw-mysql.ns-oihey.svc.cluster.local" - "--user" - "root" - "--password" - "29FV699wpG" - "--port" - "3306" - "--dbtype" - "mysql" - "--test" - "executionloop" - "--duration" - "60" - "--interval" - "1" restartPolicy: Never `kubectl apply -f test-db-client-executionloop-mysql-uaeapw.yaml` pod/test-db-client-executionloop-mysql-uaeapw created apply test-db-client-executionloop-mysql-uaeapw.yaml Success `rm -rf test-db-client-executionloop-mysql-uaeapw.yaml` check pod status pod_status:NAME READY STATUS RESTARTS AGE test-db-client-executionloop-mysql-uaeapw 1/1 Running 0 5s pod_status:NAME READY STATUS RESTARTS AGE test-db-client-executionloop-mysql-uaeapw 1/1 Running 0 9s pod_status:NAME READY STATUS RESTARTS AGE test-db-client-executionloop-mysql-uaeapw 1/1 Running 0 15s pod_status:NAME READY STATUS RESTARTS AGE test-db-client-executionloop-mysql-uaeapw 1/1 Running 0 20s pod_status:NAME READY STATUS RESTARTS AGE test-db-client-executionloop-mysql-uaeapw 1/1 Running 0 25s pod_status:NAME READY STATUS RESTARTS AGE test-db-client-executionloop-mysql-uaeapw 1/1 Running 0 30s pod_status:NAME READY STATUS RESTARTS AGE test-db-client-executionloop-mysql-uaeapw 1/1 Running 0 35s pod_status:NAME READY STATUS RESTARTS AGE test-db-client-executionloop-mysql-uaeapw 1/1 Running 0 40s pod_status:NAME READY STATUS RESTARTS AGE test-db-client-executionloop-mysql-uaeapw 1/1 Running 0 45s pod_status:NAME READY STATUS RESTARTS AGE test-db-client-executionloop-mysql-uaeapw 1/1 Running 0 50s pod_status:NAME READY STATUS RESTARTS AGE test-db-client-executionloop-mysql-uaeapw 1/1 Running 0 55s pod_status:NAME READY STATUS RESTARTS AGE test-db-client-executionloop-mysql-uaeapw 1/1 Running 0 61s check pod test-db-client-executionloop-mysql-uaeapw status done pod_status:NAME READY STATUS RESTARTS AGE test-db-client-executionloop-mysql-uaeapw 0/1 Completed 0 66s check cluster status `kbcli cluster list mysql-uaeapw --show-labels --namespace ns-oihey ` NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS mysql-uaeapw ns-oihey mysql Delete Running Sep 12,2025 13:05 UTC+0800 app.kubernetes.io/instance=mysql-uaeapw,clusterdefinition.kubeblocks.io/name=mysql check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances mysql-uaeapw --namespace ns-oihey ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME mysql-uaeapw-mysql-0 ns-oihey mysql-uaeapw mysql Running primary 0 100m / 100m 512Mi / 512Mi data:10Gi aks-cicdamdpool-13759654-vmss000002/10.224.0.6 Sep 12,2025 13:05 UTC+0800 mysql-uaeapw-mysql-1 ns-oihey mysql-uaeapw mysql Running secondary 0 100m / 100m 512Mi / 512Mi data:10Gi aks-cicdamdpool-13759654-vmss000001/10.224.0.7 Sep 12,2025 13:08 UTC+0800 check pod status done check cluster role check cluster role done primary: mysql-uaeapw-mysql-0;secondary: mysql-uaeapw-mysql-1 `kubectl get secrets -l app.kubernetes.io/instance=mysql-uaeapw` set secret: mysql-uaeapw-mysql-account-root `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:29FV699wpG;DB_PORT:3306;DB_DATABASE:mysql check cluster connect `echo " echo \"SHOW SLAVE STATUS\G;\" | mysql -P3306 -h127.0.0.1 -uroot -p'29FV699wpG' " | kubectl exec -it mysql-uaeapw-mysql-1 --namespace ns-oihey -- bash ` check cluster connect done --host mysql-uaeapw-mysql.ns-oihey.svc.cluster.local --user root --password 29FV699wpG --port 3306 --dbtype mysql --test executionloop --duration 60 --interval 1 SLF4J(I): Connected with provider of type [ch.qos.logback.classic.spi.LogbackServiceProvider] Execution loop start: create databases executions_loop CREATE DATABASE IF NOT EXISTS executions_loop; drop table executions_loop_table DROP TABLE IF EXISTS executions_loop.executions_loop_table; create table executions_loop_table CREATE TABLE IF NOT EXISTS executions_loop.executions_loop_table (id INT PRIMARY KEY AUTO_INCREMENT, value VARCHAR(255), tinyint_col TINYINT, smallint_col SMALLINT, mediumint_col MEDIUMINT, int_col INT, bigint_col BIGINT, float_col FLOAT, double_col DOUBLE, decimal_col DECIMAL(10, 2), date_col DATE, time_col TIME, datetime_col DATETIME, timestamp_col TIMESTAMP, year_col YEAR, char_col CHAR(10), text_col TEXT, blob_col BLOB, binary_col BINARY(10), varbinary_col VARBINARY(255), enum_col ENUM('Option1', 'Option2', 'Option3'), set_col SET('Value1', 'Value2', 'Value3') ); Execution loop start:INSERT INTO executions_loop.executions_loop_table (value, tinyint_col, smallint_col, mediumint_col, int_col, bigint_col, float_col, double_col, decimal_col, date_col, time_col, datetime_col, timestamp_col, year_col, char_col, text_col, blob_col, binary_col, varbinary_col, enum_col, set_col) VALUES ('executions_loop_test_1', 50, 22283, 5414916, -1099038120, 6263976447063050485, 0.3576373, 0.13695730924665872, 97.66301115848634, '2025-09-12', '05:10:37', '2025-09-12 05:10:37.264', CURRENT_TIMESTAMP, 2080, 'QmnkRqUxAT', '0wn1qeIxskfmX0wg22HKZJx6cfAXNqHFQx6POsuOWoRXswSqipBIYfmbqIbAFFTJPWvAutBqSk4WXXSzE5l8MYZ90Ilb0cqCqxtcZj140CxpamsdAbyu1rGcSg8lbPAYkxkTwzWghdLASLqidfyRs1qs18bHt1DVL8UKuRvgMG1PPBqsHUx15EhtQ1OO3S6bmgXEabGyZ2B6iDe07m6h2ylzLoEuu15jXyuWNdQvCw9pFjdm4dS4IFXZwmeEzVW', UNHEX(REPLACE('f1f422bf31bea49b08a3', ' ', '')), UNHEX(REPLACE('14100915e0c6dd6d3e51', ' ', '')), UNHEX(REPLACE('6656deebffeda0871e0f5f2cd56682d02214cfccabccfecdf87e6b363333f8600e2ff3017f0d1220e1bc8df74129273f1ed1f0236457fa2b3d0de4d3d2541dbd5f821d31a844faa07d34df5f2995182d28ab1db7258b4c576be64411bd7b05e98e85bd54a20261b1c65619163fd3464c1c32e346782d794b11bf38ecdb12c065c3e340d57827f273a7eda2f7be41fd160f5769a20c1f04a31332086bd80ef7699c08583e9bbc9d0a9e3a48afe2209a39c7dea1b5321c84d028b78838a2e22436a73a9af9603d46ec3bd5929b6d4fdfb53ea403e2600d1d725de98349ed83e448eb85a29e7d6fbf29a5d9cebb2417ee5323ab7bd9b2e7c32e901d5104b07f8d', ' ', '')), 'Option1', 'Value3' ); [ 1s ] executions total: 49 successful: 49 failed: 0 disconnect: 0 [ 2s ] executions total: 103 successful: 103 failed: 0 disconnect: 0 [ 3s ] executions total: 156 successful: 156 failed: 0 disconnect: 0 [ 4s ] executions total: 214 successful: 214 failed: 0 disconnect: 0 [ 5s ] executions total: 266 successful: 266 failed: 0 disconnect: 0 [ 6s ] executions total: 323 successful: 323 failed: 0 disconnect: 0 [ 7s ] executions total: 379 successful: 379 failed: 0 disconnect: 0 [ 8s ] executions total: 430 successful: 430 failed: 0 disconnect: 0 [ 9s ] executions total: 487 successful: 487 failed: 0 disconnect: 0 [ 10s ] executions total: 549 successful: 549 failed: 0 disconnect: 0 [ 11s ] executions total: 606 successful: 606 failed: 0 disconnect: 0 [ 12s ] executions total: 659 successful: 659 failed: 0 disconnect: 0 [ 13s ] executions total: 721 successful: 721 failed: 0 disconnect: 0 [ 14s ] executions total: 764 successful: 764 failed: 0 disconnect: 0 [ 15s ] executions total: 816 successful: 816 failed: 0 disconnect: 0 [ 16s ] executions total: 864 successful: 864 failed: 0 disconnect: 0 [ 17s ] executions total: 919 successful: 919 failed: 0 disconnect: 0 [ 18s ] executions total: 974 successful: 974 failed: 0 disconnect: 0 [ 19s ] executions total: 1027 successful: 1027 failed: 0 disconnect: 0 [ 20s ] executions total: 1076 successful: 1076 failed: 0 disconnect: 0 [ 21s ] executions total: 1135 successful: 1135 failed: 0 disconnect: 0 [ 22s ] executions total: 1189 successful: 1189 failed: 0 disconnect: 0 [ 23s ] executions total: 1240 successful: 1240 failed: 0 disconnect: 0 [ 24s ] executions total: 1292 successful: 1292 failed: 0 disconnect: 0 [ 25s ] executions total: 1340 successful: 1340 failed: 0 disconnect: 0 [ 26s ] executions total: 1385 successful: 1385 failed: 0 disconnect: 0 [ 27s ] executions total: 1428 successful: 1428 failed: 0 disconnect: 0 [ 28s ] executions total: 1475 successful: 1475 failed: 0 disconnect: 0 [ 29s ] executions total: 1524 successful: 1524 failed: 0 disconnect: 0 [ 30s ] executions total: 1570 successful: 1570 failed: 0 disconnect: 0 [ 31s ] executions total: 1626 successful: 1626 failed: 0 disconnect: 0 [ 32s ] executions total: 1683 successful: 1683 failed: 0 disconnect: 0 [ 33s ] executions total: 1732 successful: 1732 failed: 0 disconnect: 0 [ 34s ] executions total: 1784 successful: 1784 failed: 0 disconnect: 0 [ 35s ] executions total: 1835 successful: 1835 failed: 0 disconnect: 0 [ 36s ] executions total: 1887 successful: 1887 failed: 0 disconnect: 0 [ 37s ] executions total: 1938 successful: 1938 failed: 0 disconnect: 0 [ 38s ] executions total: 1987 successful: 1987 failed: 0 disconnect: 0 [ 39s ] executions total: 2039 successful: 2039 failed: 0 disconnect: 0 [ 40s ] executions total: 2087 successful: 2087 failed: 0 disconnect: 0 [ 41s ] executions total: 2135 successful: 2135 failed: 0 disconnect: 0 [ 42s ] executions total: 2185 successful: 2185 failed: 0 disconnect: 0 [ 43s ] executions total: 2234 successful: 2234 failed: 0 disconnect: 0 [ 44s ] executions total: 2287 successful: 2287 failed: 0 disconnect: 0 [ 45s ] executions total: 2334 successful: 2334 failed: 0 disconnect: 0 [ 46s ] executions total: 2393 successful: 2393 failed: 0 disconnect: 0 [ 47s ] executions total: 2450 successful: 2450 failed: 0 disconnect: 0 [ 48s ] executions total: 2506 successful: 2506 failed: 0 disconnect: 0 [ 49s ] executions total: 2568 successful: 2568 failed: 0 disconnect: 0 [ 50s ] executions total: 2624 successful: 2624 failed: 0 disconnect: 0 [ 51s ] executions total: 2680 successful: 2680 failed: 0 disconnect: 0 [ 52s ] executions total: 2732 successful: 2732 failed: 0 disconnect: 0 [ 53s ] executions total: 2780 successful: 2780 failed: 0 disconnect: 0 [ 54s ] executions total: 2833 successful: 2833 failed: 0 disconnect: 0 [ 55s ] executions total: 2887 successful: 2887 failed: 0 disconnect: 0 [ 56s ] executions total: 2939 successful: 2939 failed: 0 disconnect: 0 [ 57s ] executions total: 2988 successful: 2988 failed: 0 disconnect: 0 [ 58s ] executions total: 3043 successful: 3043 failed: 0 disconnect: 0 [ 59s ] executions total: 3095 successful: 3095 failed: 0 disconnect: 0 [ 60s ] executions total: 3113 successful: 3113 failed: 0 disconnect: 0 Test Result: Total Executions: 3113 Successful Executions: 3113 Failed Executions: 0 Disconnection Counts: 0 Connection Information: Database Type: mysql Host: mysql-uaeapw-mysql.ns-oihey.svc.cluster.local Port: 3306 Database: Table: User: root Org: Access Mode: mysql Test Type: executionloop Query: Duration: 60 seconds Interval: 1 seconds DB_CLIENT_BATCH_DATA_COUNT: 3113 `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge pods test-db-client-executionloop-mysql-uaeapw --namespace ns-oihey ` pod/test-db-client-executionloop-mysql-uaeapw patched (no change) Warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely. pod "test-db-client-executionloop-mysql-uaeapw" force deleted `kubectl get secrets -l app.kubernetes.io/instance=mysql-uaeapw` set secret: mysql-uaeapw-mysql-account-root `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:29FV699wpG;DB_PORT:3306;DB_DATABASE:mysql set db_client batch data count `echo "echo \"select count(*) from executions_loop.executions_loop_table;\" | mysql -P3306 -hmysql-uaeapw-mysql.ns-oihey.svc.cluster.local -uroot -p'29FV699wpG' " | kubectl exec -it mysql-uaeapw-mysql-0 --namespace ns-oihey -- bash ` set db_client batch data Success LB_TYPE is set to: intranet cluster expose check cluster status before ops check cluster status done cluster_status:Running `kbcli cluster expose mysql-uaeapw --auto-approve --force=true --type intranet --enable true --components mysql --role-selector primary --namespace ns-oihey ` OpsRequest mysql-uaeapw-expose-vp5w4 created successfully, you can view the progress: kbcli cluster describe-ops mysql-uaeapw-expose-vp5w4 -n ns-oihey check ops status `kbcli cluster list-ops mysql-uaeapw --status all --namespace ns-oihey ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME mysql-uaeapw-expose-vp5w4 ns-oihey Expose mysql-uaeapw Creating -/- Sep 12,2025 13:11 UTC+0800 check cluster status `kbcli cluster list mysql-uaeapw --show-labels --namespace ns-oihey ` NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS mysql-uaeapw ns-oihey mysql Delete Running Sep 12,2025 13:05 UTC+0800 app.kubernetes.io/instance=mysql-uaeapw,clusterdefinition.kubeblocks.io/name=mysql check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances mysql-uaeapw --namespace ns-oihey ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME mysql-uaeapw-mysql-0 ns-oihey mysql-uaeapw mysql Running primary 0 100m / 100m 512Mi / 512Mi data:10Gi aks-cicdamdpool-13759654-vmss000002/10.224.0.6 Sep 12,2025 13:05 UTC+0800 mysql-uaeapw-mysql-1 ns-oihey mysql-uaeapw mysql Running secondary 0 100m / 100m 512Mi / 512Mi data:10Gi aks-cicdamdpool-13759654-vmss000001/10.224.0.7 Sep 12,2025 13:08 UTC+0800 check pod status done check cluster role check cluster role done primary: mysql-uaeapw-mysql-0;secondary: mysql-uaeapw-mysql-1 `kubectl get secrets -l app.kubernetes.io/instance=mysql-uaeapw` set secret: mysql-uaeapw-mysql-account-root `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:29FV699wpG;DB_PORT:3306;DB_DATABASE:mysql check cluster connect `echo " echo \"SHOW SLAVE STATUS\G;\" | mysql -P3306 -h127.0.0.1 -uroot -p'29FV699wpG' " | kubectl exec -it mysql-uaeapw-mysql-1 --namespace ns-oihey -- bash ` check cluster connect done check ops status `kbcli cluster list-ops mysql-uaeapw --status all --namespace ns-oihey ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME mysql-uaeapw-expose-vp5w4 ns-oihey Expose mysql-uaeapw mysql Running 0/1 Sep 12,2025 13:11 UTC+0800 ops_status:mysql-uaeapw-expose-vp5w4 ns-oihey Expose mysql-uaeapw mysql Running 0/1 Sep 12,2025 13:11 UTC+0800 ops_status:mysql-uaeapw-expose-vp5w4 ns-oihey Expose mysql-uaeapw mysql Running 0/1 Sep 12,2025 13:11 UTC+0800 ops_status:mysql-uaeapw-expose-vp5w4 ns-oihey Expose mysql-uaeapw mysql Running 0/1 Sep 12,2025 13:11 UTC+0800 ops_status:mysql-uaeapw-expose-vp5w4 ns-oihey Expose mysql-uaeapw mysql Running 0/1 Sep 12,2025 13:11 UTC+0800 ops_status:mysql-uaeapw-expose-vp5w4 ns-oihey Expose mysql-uaeapw mysql Running 0/1 Sep 12,2025 13:11 UTC+0800 ops_status:mysql-uaeapw-expose-vp5w4 ns-oihey Expose mysql-uaeapw mysql Running 0/1 Sep 12,2025 13:11 UTC+0800 ops_status:mysql-uaeapw-expose-vp5w4 ns-oihey Expose mysql-uaeapw mysql Running 0/1 Sep 12,2025 13:11 UTC+0800 ops_status:mysql-uaeapw-expose-vp5w4 ns-oihey Expose mysql-uaeapw mysql Running 0/1 Sep 12,2025 13:11 UTC+0800 ops_status:mysql-uaeapw-expose-vp5w4 ns-oihey Expose mysql-uaeapw mysql Running 0/1 Sep 12,2025 13:11 UTC+0800 check ops status done ops_status:mysql-uaeapw-expose-vp5w4 ns-oihey Expose mysql-uaeapw mysql Succeed 1/1 Sep 12,2025 13:11 UTC+0800 `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge opsrequests.operations mysql-uaeapw-expose-vp5w4 --namespace ns-oihey ` opsrequest.operations.kubeblocks.io/mysql-uaeapw-expose-vp5w4 patched `kbcli cluster delete-ops --name mysql-uaeapw-expose-vp5w4 --force --auto-approve --namespace ns-oihey ` OpsRequest mysql-uaeapw-expose-vp5w4 deleted `kubectl get secrets -l app.kubernetes.io/instance=mysql-uaeapw` set secret: mysql-uaeapw-mysql-account-root `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:29FV699wpG;DB_PORT:3306;DB_DATABASE:mysql check db_client batch data count `echo "echo \"select count(*) from executions_loop.executions_loop_table;\" | mysql -P3306 -hmysql-uaeapw-mysql.ns-oihey.svc.cluster.local -uroot -p'29FV699wpG' " | kubectl exec -it mysql-uaeapw-mysql-0 --namespace ns-oihey -- bash ` check db_client batch data Success `kubectl get secrets -l app.kubernetes.io/instance=mysql-uaeapw` set secret: mysql-uaeapw-mysql-account-root `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:29FV699wpG;DB_PORT:3306;DB_DATABASE:mysql check readonly db_client batch data count `echo "echo \"select count(*) from executions_loop.executions_loop_table;\" | mysql -P3306 -h127.0.0.1 -uroot -p'29FV699wpG' " | kubectl exec -it mysql-uaeapw-mysql-1 --namespace ns-oihey -- bash ` check readonly db_client batch data Success test failover networklossover check cluster status before cluster-failover-networklossover check cluster status done cluster_status:Running `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge NetworkChaos test-chaos-mesh-networklossover-mysql-uaeapw --namespace ns-oihey ` Warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely. Error from server (NotFound): networkchaos.chaos-mesh.org "test-chaos-mesh-networklossover-mysql-uaeapw" not found Error from server (NotFound): networkchaos.chaos-mesh.org "test-chaos-mesh-networklossover-mysql-uaeapw" not found apiVersion: chaos-mesh.org/v1alpha1 kind: NetworkChaos metadata: name: test-chaos-mesh-networklossover-mysql-uaeapw namespace: ns-oihey spec: selector: namespaces: - ns-oihey labelSelectors: apps.kubeblocks.io/pod-name: mysql-uaeapw-mysql-0 mode: all action: loss loss: loss: '100' correlation: '100' direction: to duration: 2m `kubectl apply -f test-chaos-mesh-networklossover-mysql-uaeapw.yaml` networkchaos.chaos-mesh.org/test-chaos-mesh-networklossover-mysql-uaeapw created apply test-chaos-mesh-networklossover-mysql-uaeapw.yaml Success `rm -rf test-chaos-mesh-networklossover-mysql-uaeapw.yaml` networklossover chaos test waiting 120 seconds check cluster status `kbcli cluster list mysql-uaeapw --show-labels --namespace ns-oihey ` NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS mysql-uaeapw ns-oihey mysql Delete Running Sep 12,2025 13:05 UTC+0800 app.kubernetes.io/instance=mysql-uaeapw,clusterdefinition.kubeblocks.io/name=mysql check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances mysql-uaeapw --namespace ns-oihey ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME mysql-uaeapw-mysql-0 ns-oihey mysql-uaeapw mysql Running secondary 0 100m / 100m 512Mi / 512Mi data:10Gi aks-cicdamdpool-13759654-vmss000002/10.224.0.6 Sep 12,2025 13:05 UTC+0800 mysql-uaeapw-mysql-1 ns-oihey mysql-uaeapw mysql Running primary 0 100m / 100m 512Mi / 512Mi data:10Gi aks-cicdamdpool-13759654-vmss000001/10.224.0.7 Sep 12,2025 13:08 UTC+0800 check pod status done check cluster role check cluster role done primary: mysql-uaeapw-mysql-1;secondary: mysql-uaeapw-mysql-0 `kubectl get secrets -l app.kubernetes.io/instance=mysql-uaeapw` set secret: mysql-uaeapw-mysql-account-root `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:29FV699wpG;DB_PORT:3306;DB_DATABASE:mysql check cluster connect `echo " echo \"SHOW SLAVE STATUS\G;\" | mysql -P3306 -h127.0.0.1 -uroot -p'29FV699wpG' " | kubectl exec -it mysql-uaeapw-mysql-0 --namespace ns-oihey -- bash ` check cluster connect done `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge NetworkChaos test-chaos-mesh-networklossover-mysql-uaeapw --namespace ns-oihey ` Warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely. networkchaos.chaos-mesh.org "test-chaos-mesh-networklossover-mysql-uaeapw" force deleted networkchaos.chaos-mesh.org/test-chaos-mesh-networklossover-mysql-uaeapw patched check failover pod name failover pod name:mysql-uaeapw-mysql-1 failover networklossover Success `kubectl get secrets -l app.kubernetes.io/instance=mysql-uaeapw` set secret: mysql-uaeapw-mysql-account-root `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:29FV699wpG;DB_PORT:3306;DB_DATABASE:mysql check db_client batch data count `echo "echo \"select count(*) from executions_loop.executions_loop_table;\" | mysql -P3306 -hmysql-uaeapw-mysql.ns-oihey.svc.cluster.local -uroot -p'29FV699wpG' " | kubectl exec -it mysql-uaeapw-mysql-1 --namespace ns-oihey -- bash ` check db_client batch data Success `kubectl get secrets -l app.kubernetes.io/instance=mysql-uaeapw` set secret: mysql-uaeapw-mysql-account-root `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:29FV699wpG;DB_PORT:3306;DB_DATABASE:mysql check readonly db_client batch data count `echo "echo \"select count(*) from executions_loop.executions_loop_table;\" | mysql -P3306 -h127.0.0.1 -uroot -p'29FV699wpG' " | kubectl exec -it mysql-uaeapw-mysql-0 --namespace ns-oihey -- bash ` check readonly db_client batch data Success test failover connectionstress check cluster status before cluster-failover-connectionstress check cluster status done cluster_status:Running Error from server (NotFound): pods "test-db-client-connectionstress-mysql-uaeapw" not found `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge pods test-db-client-connectionstress-mysql-uaeapw --namespace ns-oihey ` Error from server (NotFound): pods "test-db-client-connectionstress-mysql-uaeapw" not found Warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely. Error from server (NotFound): pods "test-db-client-connectionstress-mysql-uaeapw" not found `kubectl get secrets -l app.kubernetes.io/instance=mysql-uaeapw` set secret: mysql-uaeapw-mysql-account-root `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:29FV699wpG;DB_PORT:3306;DB_DATABASE:mysql apiVersion: v1 kind: Pod metadata: name: test-db-client-connectionstress-mysql-uaeapw namespace: ns-oihey spec: containers: - name: test-dbclient imagePullPolicy: IfNotPresent image: docker.io/apecloud/dbclient:test args: - "--host" - "mysql-uaeapw-mysql.ns-oihey.svc.cluster.local" - "--user" - "root" - "--password" - "29FV699wpG" - "--port" - "3306" - "--database" - "mysql" - "--dbtype" - "mysql" - "--test" - "connectionstress" - "--connections" - "83" - "--duration" - "60" restartPolicy: Never `kubectl apply -f test-db-client-connectionstress-mysql-uaeapw.yaml` pod/test-db-client-connectionstress-mysql-uaeapw created apply test-db-client-connectionstress-mysql-uaeapw.yaml Success `rm -rf test-db-client-connectionstress-mysql-uaeapw.yaml` check pod status check pod test-db-client-connectionstress-mysql-uaeapw status done pod_status:NAME READY STATUS RESTARTS AGE test-db-client-connectionstress-mysql-uaeapw 0/1 Completed 0 5s check cluster status `kbcli cluster list mysql-uaeapw --show-labels --namespace ns-oihey ` NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS mysql-uaeapw ns-oihey mysql Delete Running Sep 12,2025 13:05 UTC+0800 app.kubernetes.io/instance=mysql-uaeapw,clusterdefinition.kubeblocks.io/name=mysql check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances mysql-uaeapw --namespace ns-oihey ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME mysql-uaeapw-mysql-0 ns-oihey mysql-uaeapw mysql Running secondary 0 100m / 100m 512Mi / 512Mi data:10Gi aks-cicdamdpool-13759654-vmss000002/10.224.0.6 Sep 12,2025 13:05 UTC+0800 mysql-uaeapw-mysql-1 ns-oihey mysql-uaeapw mysql Running primary 0 100m / 100m 512Mi / 512Mi data:10Gi aks-cicdamdpool-13759654-vmss000001/10.224.0.7 Sep 12,2025 13:08 UTC+0800 check pod status done check cluster role check cluster role done primary: mysql-uaeapw-mysql-1;secondary: mysql-uaeapw-mysql-0 `kubectl get secrets -l app.kubernetes.io/instance=mysql-uaeapw` set secret: mysql-uaeapw-mysql-account-root `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:29FV699wpG;DB_PORT:3306;DB_DATABASE:mysql check cluster connect `echo " echo \"SHOW SLAVE STATUS\G;\" | mysql -P3306 -h127.0.0.1 -uroot -p'29FV699wpG' " | kubectl exec -it mysql-uaeapw-mysql-0 --namespace ns-oihey -- bash ` check cluster connect done --host mysql-uaeapw-mysql.ns-oihey.svc.cluster.local --user root --password 29FV699wpG --port 3306 --database mysql --dbtype mysql --test connectionstress --connections 83 --duration 60 SLF4J(I): Connected with provider of type [ch.qos.logback.classic.spi.LogbackServiceProvider] Failed to connect to MySQL database: java.sql.SQLNonTransientConnectionException: Data source rejected establishment of connection, message from server: "Too many connections" Trying with database MySQL. java.io.IOException: Failed to connect to MySQL database: at com.apecloud.dbtester.tester.MySQLTester.connect(MySQLTester.java:65) at com.apecloud.dbtester.tester.MySQLTester.connectionStress(MySQLTester.java:113) at com.apecloud.dbtester.commons.TestExecutor.executeTest(TestExecutor.java:37) at OneClient.executeTest(OneClient.java:108) at OneClient.main(OneClient.java:40) Caused by: java.sql.SQLNonTransientConnectionException: Data source rejected establishment of connection, message from server: "Too many connections" at com.mysql.cj.jdbc.exceptions.SQLError.createSQLException(SQLError.java:110) at com.mysql.cj.jdbc.exceptions.SQLExceptionsMapping.translateException(SQLExceptionsMapping.java:122) at com.mysql.cj.jdbc.ConnectionImpl.createNewIO(ConnectionImpl.java:829) at com.mysql.cj.jdbc.ConnectionImpl.(ConnectionImpl.java:449) at com.mysql.cj.jdbc.ConnectionImpl.getInstance(ConnectionImpl.java:242) at com.mysql.cj.jdbc.NonRegisteringDriver.connect(NonRegisteringDriver.java:198) at java.sql/java.sql.DriverManager.getConnection(Unknown Source) at java.sql/java.sql.DriverManager.getConnection(Unknown Source) at com.apecloud.dbtester.tester.MySQLTester.connect(MySQLTester.java:63) ... 4 more Failed to connect to MySQL database: java.sql.SQLNonTransientConnectionException: Data source rejected establishment of connection, message from server: "Too many connections" Trying with database MySQL. java.io.IOException: Failed to connect to MySQL database: at com.apecloud.dbtester.tester.MySQLTester.connect(MySQLTester.java:65) at com.apecloud.dbtester.tester.MySQLTester.connectionStress(MySQLTester.java:113) at com.apecloud.dbtester.commons.TestExecutor.executeTest(TestExecutor.java:37) at OneClient.executeTest(OneClient.java:108) at OneClient.main(OneClient.java:40) Caused by: java.sql.SQLNonTransientConnectionException: Data source rejected establishment of connection, message from server: "Too many connections" at com.mysql.cj.jdbc.exceptions.SQLError.createSQLException(SQLError.java:110) at com.mysql.cj.jdbc.exceptions.SQLExceptionsMapping.translateException(SQLExceptionsMapping.java:122) at com.mysql.cj.jdbc.ConnectionImpl.createNewIO(ConnectionImpl.java:829) at com.mysql.cj.jdbc.ConnectionImpl.(ConnectionImpl.java:449) at com.mysql.cj.jdbc.ConnectionImpl.getInstance(ConnectionImpl.java:242) at com.mysql.cj.jdbc.NonRegisteringDriver.connect(NonRegisteringDriver.java:198) at java.sql/java.sql.DriverManager.getConnection(Unknown Source) at java.sql/java.sql.DriverManager.getConnection(Unknown Source) at com.apecloud.dbtester.tester.MySQLTester.connect(MySQLTester.java:63) ... 4 more Failed to connect to MySQL database: java.sql.SQLNonTransientConnectionException: Data source rejected establishment of connection, message from server: "Too many connections" Trying with database MySQL. java.io.IOException: Failed to connect to MySQL database: at com.apecloud.dbtester.tester.MySQLTester.connect(MySQLTester.java:65) at com.apecloud.dbtester.tester.MySQLTester.connectionStress(MySQLTester.java:113) at com.apecloud.dbtester.commons.TestExecutor.executeTest(TestExecutor.java:37) at OneClient.executeTest(OneClient.java:108) at OneClient.main(OneClient.java:40) Caused by: java.sql.SQLNonTransientConnectionException: Data source rejected establishment of connection, message from server: "Too many connections" at com.mysql.cj.jdbc.exceptions.SQLError.createSQLException(SQLError.java:110) at com.mysql.cj.jdbc.exceptions.SQLExceptionsMapping.translateException(SQLExceptionsMapping.java:122) at com.mysql.cj.jdbc.ConnectionImpl.createNewIO(ConnectionImpl.java:829) at com.mysql.cj.jdbc.ConnectionImpl.(ConnectionImpl.java:449) at com.mysql.cj.jdbc.ConnectionImpl.getInstance(ConnectionImpl.java:242) at com.mysql.cj.jdbc.NonRegisteringDriver.connect(NonRegisteringDriver.java:198) at java.sql/java.sql.DriverManager.getConnection(Unknown Source) at java.sql/java.sql.DriverManager.getConnection(Unknown Source) at com.apecloud.dbtester.tester.MySQLTester.connect(MySQLTester.java:63) ... 4 more Failed to connect to MySQL database: java.sql.SQLNonTransientConnectionException: Data source rejected establishment of connection, message from server: "Too many connections" Trying with database MySQL. java.io.IOException: Failed to connect to MySQL database: at com.apecloud.dbtester.tester.MySQLTester.connect(MySQLTester.java:65) at com.apecloud.dbtester.tester.MySQLTester.connectionStress(MySQLTester.java:113) at com.apecloud.dbtester.commons.TestExecutor.executeTest(TestExecutor.java:37) at OneClient.executeTest(OneClient.java:108) at OneClient.main(OneClient.java:40) Caused by: java.sql.SQLNonTransientConnectionException: Data source rejected establishment of connection, message from server: "Too many connections" at com.mysql.cj.jdbc.exceptions.SQLError.createSQLException(SQLError.java:110) at com.mysql.cj.jdbc.exceptions.SQLExceptionsMapping.translateException(SQLExceptionsMapping.java:122) at com.mysql.cj.jdbc.ConnectionImpl.createNewIO(ConnectionImpl.java:829) at com.mysql.cj.jdbc.ConnectionImpl.(ConnectionImpl.java:449) at com.mysql.cj.jdbc.ConnectionImpl.getInstance(ConnectionImpl.java:242) at com.mysql.cj.jdbc.NonRegisteringDriver.connect(NonRegisteringDriver.java:198) at java.sql/java.sql.DriverManager.getConnection(Unknown Source) at java.sql/java.sql.DriverManager.getConnection(Unknown Source) at com.apecloud.dbtester.tester.MySQLTester.connect(MySQLTester.java:63) ... 4 more Test Result: null Connection Information: Database Type: mysql Host: mysql-uaeapw-mysql.ns-oihey.svc.cluster.local Port: 3306 Database: mysql Table: User: root Org: Access Mode: mysql Test Type: connectionstress Connection Count: 83 Duration: 60 seconds `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge pods test-db-client-connectionstress-mysql-uaeapw --namespace ns-oihey ` pod/test-db-client-connectionstress-mysql-uaeapw patched (no change) Warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely. pod "test-db-client-connectionstress-mysql-uaeapw" force deleted `kubectl get secrets -l app.kubernetes.io/instance=mysql-uaeapw` set secret: mysql-uaeapw-mysql-account-root `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:29FV699wpG;DB_PORT:3306;DB_DATABASE:mysql set db_client batch data count `echo "echo \"select count(*) from executions_loop.executions_loop_table;\" | mysql -P3306 -hmysql-uaeapw-mysql.ns-oihey.svc.cluster.local -uroot -p'29FV699wpG' " | kubectl exec -it mysql-uaeapw-mysql-1 --namespace ns-oihey -- bash ` set db_client batch data Success check failover pod name failover pod name:mysql-uaeapw-mysql-1 failover connectionstress Success `kubectl get secrets -l app.kubernetes.io/instance=mysql-uaeapw` set secret: mysql-uaeapw-mysql-account-root `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:29FV699wpG;DB_PORT:3306;DB_DATABASE:mysql check db_client batch data count `echo "echo \"select count(*) from executions_loop.executions_loop_table;\" | mysql -P3306 -hmysql-uaeapw-mysql.ns-oihey.svc.cluster.local -uroot -p'29FV699wpG' " | kubectl exec -it mysql-uaeapw-mysql-1 --namespace ns-oihey -- bash ` check db_client batch data Success `kubectl get secrets -l app.kubernetes.io/instance=mysql-uaeapw` set secret: mysql-uaeapw-mysql-account-root `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:29FV699wpG;DB_PORT:3306;DB_DATABASE:mysql check readonly db_client batch data count `echo "echo \"select count(*) from executions_loop.executions_loop_table;\" | mysql -P3306 -h127.0.0.1 -uroot -p'29FV699wpG' " | kubectl exec -it mysql-uaeapw-mysql-0 --namespace ns-oihey -- bash ` check readonly db_client batch data Success check cluster status before ops check cluster status done cluster_status:Running `kbcli cluster vscale mysql-uaeapw --auto-approve --force=true --components mysql --cpu 200m --memory 0.6Gi --namespace ns-oihey ` OpsRequest mysql-uaeapw-verticalscaling-phwhr created successfully, you can view the progress: kbcli cluster describe-ops mysql-uaeapw-verticalscaling-phwhr -n ns-oihey check ops status `kbcli cluster list-ops mysql-uaeapw --status all --namespace ns-oihey ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME mysql-uaeapw-verticalscaling-phwhr ns-oihey VerticalScaling mysql-uaeapw mysql Creating -/- Sep 12,2025 13:15 UTC+0800 check cluster status `kbcli cluster list mysql-uaeapw --show-labels --namespace ns-oihey ` NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS mysql-uaeapw ns-oihey mysql Delete Updating Sep 12,2025 13:05 UTC+0800 app.kubernetes.io/instance=mysql-uaeapw,clusterdefinition.kubeblocks.io/name=mysql cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances mysql-uaeapw --namespace ns-oihey ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME mysql-uaeapw-mysql-0 ns-oihey mysql-uaeapw mysql Running primary 0 200m / 200m 644245094400m / 644245094400m data:10Gi aks-cicdamdpool-13759654-vmss000002/10.224.0.6 Sep 12,2025 13:15 UTC+0800 mysql-uaeapw-mysql-1 ns-oihey mysql-uaeapw mysql Running secondary 0 200m / 200m 644245094400m / 644245094400m data:10Gi aks-cicdamdpool-13759654-vmss000001/10.224.0.7 Sep 12,2025 13:16 UTC+0800 check pod status done check cluster role check cluster role done primary: mysql-uaeapw-mysql-0;secondary: mysql-uaeapw-mysql-1 `kubectl get secrets -l app.kubernetes.io/instance=mysql-uaeapw` set secret: mysql-uaeapw-mysql-account-root `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:29FV699wpG;DB_PORT:3306;DB_DATABASE:mysql check cluster connect `echo " echo \"SHOW SLAVE STATUS\G;\" | mysql -P3306 -h127.0.0.1 -uroot -p'29FV699wpG' " | kubectl exec -it mysql-uaeapw-mysql-1 --namespace ns-oihey -- bash ` check cluster connect done check ops status `kbcli cluster list-ops mysql-uaeapw --status all --namespace ns-oihey ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME mysql-uaeapw-verticalscaling-phwhr ns-oihey VerticalScaling mysql-uaeapw mysql Succeed 2/2 Sep 12,2025 13:15 UTC+0800 check ops status done ops_status:mysql-uaeapw-verticalscaling-phwhr ns-oihey VerticalScaling mysql-uaeapw mysql Succeed 2/2 Sep 12,2025 13:15 UTC+0800 `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge opsrequests.operations mysql-uaeapw-verticalscaling-phwhr --namespace ns-oihey ` opsrequest.operations.kubeblocks.io/mysql-uaeapw-verticalscaling-phwhr patched `kbcli cluster delete-ops --name mysql-uaeapw-verticalscaling-phwhr --force --auto-approve --namespace ns-oihey ` OpsRequest mysql-uaeapw-verticalscaling-phwhr deleted `kubectl get secrets -l app.kubernetes.io/instance=mysql-uaeapw` set secret: mysql-uaeapw-mysql-account-root `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:29FV699wpG;DB_PORT:3306;DB_DATABASE:mysql check db_client batch data count `echo "echo \"select count(*) from executions_loop.executions_loop_table;\" | mysql -P3306 -hmysql-uaeapw-mysql.ns-oihey.svc.cluster.local -uroot -p'29FV699wpG' " | kubectl exec -it mysql-uaeapw-mysql-0 --namespace ns-oihey -- bash ` check db_client batch data Success `kubectl get secrets -l app.kubernetes.io/instance=mysql-uaeapw` set secret: mysql-uaeapw-mysql-account-root `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:29FV699wpG;DB_PORT:3306;DB_DATABASE:mysql check readonly db_client batch data count `echo "echo \"select count(*) from executions_loop.executions_loop_table;\" | mysql -P3306 -h127.0.0.1 -uroot -p'29FV699wpG' " | kubectl exec -it mysql-uaeapw-mysql-1 --namespace ns-oihey -- bash ` check readonly db_client batch data Success cluster does not need to check monitor currently check cluster status `kbcli cluster list mysql-uaeapw --show-labels --namespace ns-oihey ` NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS mysql-uaeapw ns-oihey mysql Delete Running Sep 12,2025 13:05 UTC+0800 app.kubernetes.io/instance=mysql-uaeapw,clusterdefinition.kubeblocks.io/name=mysql check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances mysql-uaeapw --namespace ns-oihey ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME mysql-uaeapw-mysql-0 ns-oihey mysql-uaeapw mysql Running primary 0 200m / 200m 644245094400m / 644245094400m data:10Gi aks-cicdamdpool-13759654-vmss000002/10.224.0.6 Sep 12,2025 13:15 UTC+0800 mysql-uaeapw-mysql-1 ns-oihey mysql-uaeapw mysql Running secondary 0 200m / 200m 644245094400m / 644245094400m data:10Gi aks-cicdamdpool-13759654-vmss000001/10.224.0.7 Sep 12,2025 13:16 UTC+0800 check pod status done check cluster role check cluster role done primary: mysql-uaeapw-mysql-0;secondary: mysql-uaeapw-mysql-1 `kubectl get secrets -l app.kubernetes.io/instance=mysql-uaeapw` set secret: mysql-uaeapw-mysql-account-root `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:29FV699wpG;DB_PORT:3306;DB_DATABASE:mysql check cluster connect `echo " echo \"SHOW SLAVE STATUS\G;\" | mysql -P3306 -h127.0.0.1 -uroot -p'29FV699wpG' " | kubectl exec -it mysql-uaeapw-mysql-1 --namespace ns-oihey -- bash ` check cluster connect done test failover fullcpu check cluster status before cluster-failover-fullcpu check cluster status done cluster_status:Running `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge StressChaos test-chaos-mesh-fullcpu-mysql-uaeapw --namespace ns-oihey ` Warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely. Error from server (NotFound): stresschaos.chaos-mesh.org "test-chaos-mesh-fullcpu-mysql-uaeapw" not found Error from server (NotFound): stresschaos.chaos-mesh.org "test-chaos-mesh-fullcpu-mysql-uaeapw" not found apiVersion: chaos-mesh.org/v1alpha1 kind: StressChaos metadata: name: test-chaos-mesh-fullcpu-mysql-uaeapw namespace: ns-oihey spec: selector: namespaces: - ns-oihey labelSelectors: apps.kubeblocks.io/pod-name: mysql-uaeapw-mysql-0 mode: all stressors: cpu: workers: 100 load: 100 duration: 2m `kubectl apply -f test-chaos-mesh-fullcpu-mysql-uaeapw.yaml` stresschaos.chaos-mesh.org/test-chaos-mesh-fullcpu-mysql-uaeapw created apply test-chaos-mesh-fullcpu-mysql-uaeapw.yaml Success `rm -rf test-chaos-mesh-fullcpu-mysql-uaeapw.yaml` fullcpu chaos test waiting 120 seconds check cluster status `kbcli cluster list mysql-uaeapw --show-labels --namespace ns-oihey ` NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS mysql-uaeapw ns-oihey mysql Delete Running Sep 12,2025 13:05 UTC+0800 app.kubernetes.io/instance=mysql-uaeapw,clusterdefinition.kubeblocks.io/name=mysql check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances mysql-uaeapw --namespace ns-oihey ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME mysql-uaeapw-mysql-0 ns-oihey mysql-uaeapw mysql Running primary 0 200m / 200m 644245094400m / 644245094400m data:10Gi aks-cicdamdpool-13759654-vmss000002/10.224.0.6 Sep 12,2025 13:15 UTC+0800 mysql-uaeapw-mysql-1 ns-oihey mysql-uaeapw mysql Running secondary 0 200m / 200m 644245094400m / 644245094400m data:10Gi aks-cicdamdpool-13759654-vmss000001/10.224.0.7 Sep 12,2025 13:16 UTC+0800 check pod status done check cluster role check cluster role done primary: mysql-uaeapw-mysql-0;secondary: mysql-uaeapw-mysql-1 `kubectl get secrets -l app.kubernetes.io/instance=mysql-uaeapw` set secret: mysql-uaeapw-mysql-account-root `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:29FV699wpG;DB_PORT:3306;DB_DATABASE:mysql check cluster connect `echo " echo \"SHOW SLAVE STATUS\G;\" | mysql -P3306 -h127.0.0.1 -uroot -p'29FV699wpG' " | kubectl exec -it mysql-uaeapw-mysql-1 --namespace ns-oihey -- bash ` check cluster connect done `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge StressChaos test-chaos-mesh-fullcpu-mysql-uaeapw --namespace ns-oihey ` Warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely. stresschaos.chaos-mesh.org "test-chaos-mesh-fullcpu-mysql-uaeapw" force deleted stresschaos.chaos-mesh.org/test-chaos-mesh-fullcpu-mysql-uaeapw patched check failover pod name failover pod name:mysql-uaeapw-mysql-0 failover fullcpu Success `kubectl get secrets -l app.kubernetes.io/instance=mysql-uaeapw` set secret: mysql-uaeapw-mysql-account-root `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:29FV699wpG;DB_PORT:3306;DB_DATABASE:mysql check db_client batch data count `echo "echo \"select count(*) from executions_loop.executions_loop_table;\" | mysql -P3306 -hmysql-uaeapw-mysql.ns-oihey.svc.cluster.local -uroot -p'29FV699wpG' " | kubectl exec -it mysql-uaeapw-mysql-0 --namespace ns-oihey -- bash ` check db_client batch data Success `kubectl get secrets -l app.kubernetes.io/instance=mysql-uaeapw` set secret: mysql-uaeapw-mysql-account-root `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:29FV699wpG;DB_PORT:3306;DB_DATABASE:mysql check readonly db_client batch data count `echo "echo \"select count(*) from executions_loop.executions_loop_table;\" | mysql -P3306 -h127.0.0.1 -uroot -p'29FV699wpG' " | kubectl exec -it mysql-uaeapw-mysql-1 --namespace ns-oihey -- bash ` check readonly db_client batch data Success test failover dnserror check cluster status before cluster-failover-dnserror check cluster status done cluster_status:Running `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge DNSChaos test-chaos-mesh-dnserror-mysql-uaeapw --namespace ns-oihey ` Warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely. Error from server (NotFound): dnschaos.chaos-mesh.org "test-chaos-mesh-dnserror-mysql-uaeapw" not found Error from server (NotFound): dnschaos.chaos-mesh.org "test-chaos-mesh-dnserror-mysql-uaeapw" not found apiVersion: chaos-mesh.org/v1alpha1 kind: DNSChaos metadata: name: test-chaos-mesh-dnserror-mysql-uaeapw namespace: ns-oihey spec: selector: namespaces: - ns-oihey labelSelectors: apps.kubeblocks.io/pod-name: mysql-uaeapw-mysql-0 mode: all action: error duration: 2m `kubectl apply -f test-chaos-mesh-dnserror-mysql-uaeapw.yaml` dnschaos.chaos-mesh.org/test-chaos-mesh-dnserror-mysql-uaeapw created apply test-chaos-mesh-dnserror-mysql-uaeapw.yaml Success `rm -rf test-chaos-mesh-dnserror-mysql-uaeapw.yaml` dnserror chaos test waiting 120 seconds check cluster status `kbcli cluster list mysql-uaeapw --show-labels --namespace ns-oihey ` NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS mysql-uaeapw ns-oihey mysql Delete Running Sep 12,2025 13:05 UTC+0800 app.kubernetes.io/instance=mysql-uaeapw,clusterdefinition.kubeblocks.io/name=mysql check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances mysql-uaeapw --namespace ns-oihey ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME mysql-uaeapw-mysql-0 ns-oihey mysql-uaeapw mysql Running primary 0 200m / 200m 644245094400m / 644245094400m data:10Gi aks-cicdamdpool-13759654-vmss000002/10.224.0.6 Sep 12,2025 13:15 UTC+0800 mysql-uaeapw-mysql-1 ns-oihey mysql-uaeapw mysql Running secondary 0 200m / 200m 644245094400m / 644245094400m data:10Gi aks-cicdamdpool-13759654-vmss000001/10.224.0.7 Sep 12,2025 13:16 UTC+0800 check pod status done check cluster role check cluster role done primary: mysql-uaeapw-mysql-0;secondary: mysql-uaeapw-mysql-1 `kubectl get secrets -l app.kubernetes.io/instance=mysql-uaeapw` set secret: mysql-uaeapw-mysql-account-root `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:29FV699wpG;DB_PORT:3306;DB_DATABASE:mysql check cluster connect `echo " echo \"SHOW SLAVE STATUS\G;\" | mysql -P3306 -h127.0.0.1 -uroot -p'29FV699wpG' " | kubectl exec -it mysql-uaeapw-mysql-1 --namespace ns-oihey -- bash ` check cluster connect done `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge DNSChaos test-chaos-mesh-dnserror-mysql-uaeapw --namespace ns-oihey ` Warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely. dnschaos.chaos-mesh.org "test-chaos-mesh-dnserror-mysql-uaeapw" force deleted Error from server (NotFound): dnschaos.chaos-mesh.org "test-chaos-mesh-dnserror-mysql-uaeapw" not found check failover pod name failover pod name:mysql-uaeapw-mysql-0 failover dnserror Success `kubectl get secrets -l app.kubernetes.io/instance=mysql-uaeapw` set secret: mysql-uaeapw-mysql-account-root `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:29FV699wpG;DB_PORT:3306;DB_DATABASE:mysql check db_client batch data count `echo "echo \"select count(*) from executions_loop.executions_loop_table;\" | mysql -P3306 -hmysql-uaeapw-mysql.ns-oihey.svc.cluster.local -uroot -p'29FV699wpG' " | kubectl exec -it mysql-uaeapw-mysql-0 --namespace ns-oihey -- bash ` check db_client batch data Success `kubectl get secrets -l app.kubernetes.io/instance=mysql-uaeapw` set secret: mysql-uaeapw-mysql-account-root `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:29FV699wpG;DB_PORT:3306;DB_DATABASE:mysql check readonly db_client batch data count `echo "echo \"select count(*) from executions_loop.executions_loop_table;\" | mysql -P3306 -h127.0.0.1 -uroot -p'29FV699wpG' " | kubectl exec -it mysql-uaeapw-mysql-1 --namespace ns-oihey -- bash ` check readonly db_client batch data Success cluster configure component_tmp: mysql apiVersion: operations.kubeblocks.io/v1alpha1 kind: OpsRequest metadata: generateName: mysql-uaeapw-reconfiguring- namespace: ns-oihey spec: type: Reconfiguring clusterName: mysql-uaeapw force: true reconfigures: - componentName: mysql parameters: - key: binlog_expire_logs_seconds value: '691200' check cluster status before ops check cluster status done cluster_status:Running `kubectl create -f test_ops_cluster_mysql-uaeapw.yaml` opsrequest.operations.kubeblocks.io/mysql-uaeapw-reconfiguring-bfx7h created create test_ops_cluster_mysql-uaeapw.yaml Success `rm -rf test_ops_cluster_mysql-uaeapw.yaml` check ops status `kbcli cluster list-ops mysql-uaeapw --status all --namespace ns-oihey ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME mysql-uaeapw-reconfiguring-bfx7h ns-oihey Reconfiguring mysql-uaeapw mysql,mysql Running -/- Sep 12,2025 13:21 UTC+0800 check cluster status `kbcli cluster list mysql-uaeapw --show-labels --namespace ns-oihey ` NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS mysql-uaeapw ns-oihey mysql Delete Running Sep 12,2025 13:05 UTC+0800 app.kubernetes.io/instance=mysql-uaeapw,clusterdefinition.kubeblocks.io/name=mysql check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances mysql-uaeapw --namespace ns-oihey ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME mysql-uaeapw-mysql-0 ns-oihey mysql-uaeapw mysql Running primary 0 200m / 200m 644245094400m / 644245094400m data:10Gi aks-cicdamdpool-13759654-vmss000002/10.224.0.6 Sep 12,2025 13:15 UTC+0800 mysql-uaeapw-mysql-1 ns-oihey mysql-uaeapw mysql Running secondary 0 200m / 200m 644245094400m / 644245094400m data:10Gi aks-cicdamdpool-13759654-vmss000001/10.224.0.7 Sep 12,2025 13:16 UTC+0800 check pod status done check cluster role check cluster role done primary: mysql-uaeapw-mysql-0;secondary: mysql-uaeapw-mysql-1 `kubectl get secrets -l app.kubernetes.io/instance=mysql-uaeapw` set secret: mysql-uaeapw-mysql-account-root `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:29FV699wpG;DB_PORT:3306;DB_DATABASE:mysql check cluster connect `echo " echo \"SHOW SLAVE STATUS\G;\" | mysql -P3306 -h127.0.0.1 -uroot -p'29FV699wpG' " | kubectl exec -it mysql-uaeapw-mysql-1 --namespace ns-oihey -- bash ` check cluster connect done check ops status `kbcli cluster list-ops mysql-uaeapw --status all --namespace ns-oihey ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME mysql-uaeapw-reconfiguring-bfx7h ns-oihey Reconfiguring mysql-uaeapw mysql,mysql Succeed -/- Sep 12,2025 13:21 UTC+0800 check ops status done ops_status:mysql-uaeapw-reconfiguring-bfx7h ns-oihey Reconfiguring mysql-uaeapw mysql,mysql Succeed -/- Sep 12,2025 13:21 UTC+0800 `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge opsrequests.operations mysql-uaeapw-reconfiguring-bfx7h --namespace ns-oihey ` opsrequest.operations.kubeblocks.io/mysql-uaeapw-reconfiguring-bfx7h patched `kbcli cluster delete-ops --name mysql-uaeapw-reconfiguring-bfx7h --force --auto-approve --namespace ns-oihey ` OpsRequest mysql-uaeapw-reconfiguring-bfx7h deleted component_config:mysql check config variables `kubectl get secrets -l app.kubernetes.io/instance=mysql-uaeapw` set secret: mysql-uaeapw-mysql-account-root `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:29FV699wpG;DB_PORT:3306;DB_DATABASE:mysql Defaulted container "mysql" out of: mysql, mysql-exporter, kbagent, config-manager, init-data (init), init-xtrabackup (init), init-jemalloc (init), init-syncer (init), init-kbagent (init), kbagent-worker (init) Unable to use a TTY - input is not a terminal or the right kind of file Warning: arning] Using a password on the command line interface can be insecure. current value_actual: 691200 configure:[binlog_expire_logs_seconds] result actual:[691200] equal expected:[691200] `kubectl get secrets -l app.kubernetes.io/instance=mysql-uaeapw` set secret: mysql-uaeapw-mysql-account-root `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:29FV699wpG;DB_PORT:3306;DB_DATABASE:mysql check db_client batch data count `echo "echo \"select count(*) from executions_loop.executions_loop_table;\" | mysql -P3306 -hmysql-uaeapw-mysql.ns-oihey.svc.cluster.local -uroot -p'29FV699wpG' " | kubectl exec -it mysql-uaeapw-mysql-0 --namespace ns-oihey -- bash ` check db_client batch data Success `kubectl get secrets -l app.kubernetes.io/instance=mysql-uaeapw` set secret: mysql-uaeapw-mysql-account-root `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:29FV699wpG;DB_PORT:3306;DB_DATABASE:mysql check readonly db_client batch data count `echo "echo \"select count(*) from executions_loop.executions_loop_table;\" | mysql -P3306 -h127.0.0.1 -uroot -p'29FV699wpG' " | kubectl exec -it mysql-uaeapw-mysql-1 --namespace ns-oihey -- bash ` check readonly db_client batch data Success test failover podfailure check cluster status before cluster-failover-podfailure check cluster status done cluster_status:Running `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge PodChaos test-chaos-mesh-podfailure-mysql-uaeapw --namespace ns-oihey ` Warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely. Error from server (NotFound): podchaos.chaos-mesh.org "test-chaos-mesh-podfailure-mysql-uaeapw" not found Error from server (NotFound): podchaos.chaos-mesh.org "test-chaos-mesh-podfailure-mysql-uaeapw" not found apiVersion: chaos-mesh.org/v1alpha1 kind: PodChaos metadata: name: test-chaos-mesh-podfailure-mysql-uaeapw namespace: ns-oihey spec: selector: namespaces: - ns-oihey labelSelectors: apps.kubeblocks.io/pod-name: mysql-uaeapw-mysql-0 mode: all action: pod-failure duration: 2m `kubectl apply -f test-chaos-mesh-podfailure-mysql-uaeapw.yaml` podchaos.chaos-mesh.org/test-chaos-mesh-podfailure-mysql-uaeapw created apply test-chaos-mesh-podfailure-mysql-uaeapw.yaml Success `rm -rf test-chaos-mesh-podfailure-mysql-uaeapw.yaml` podfailure chaos test waiting 120 seconds check cluster status `kbcli cluster list mysql-uaeapw --show-labels --namespace ns-oihey ` NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS mysql-uaeapw ns-oihey mysql Delete Failed Sep 12,2025 13:05 UTC+0800 app.kubernetes.io/instance=mysql-uaeapw,clusterdefinition.kubeblocks.io/name=mysql cluster_status:Failed check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances mysql-uaeapw --namespace ns-oihey ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME mysql-uaeapw-mysql-0 ns-oihey mysql-uaeapw mysql Running secondary 0 200m / 200m 644245094400m / 644245094400m data:10Gi aks-cicdamdpool-13759654-vmss000002/10.224.0.6 Sep 12,2025 13:15 UTC+0800 mysql-uaeapw-mysql-1 ns-oihey mysql-uaeapw mysql Running primary 0 200m / 200m 644245094400m / 644245094400m data:10Gi aks-cicdamdpool-13759654-vmss000001/10.224.0.7 Sep 12,2025 13:16 UTC+0800 check pod status done check cluster role check cluster role done primary: mysql-uaeapw-mysql-1;secondary: mysql-uaeapw-mysql-0 `kubectl get secrets -l app.kubernetes.io/instance=mysql-uaeapw` set secret: mysql-uaeapw-mysql-account-root `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:29FV699wpG;DB_PORT:3306;DB_DATABASE:mysql check cluster connect `echo " echo \"SHOW SLAVE STATUS\G;\" | mysql -P3306 -h127.0.0.1 -uroot -p'29FV699wpG' " | kubectl exec -it mysql-uaeapw-mysql-0 --namespace ns-oihey -- bash ` check cluster connect done `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge PodChaos test-chaos-mesh-podfailure-mysql-uaeapw --namespace ns-oihey ` Warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely. podchaos.chaos-mesh.org "test-chaos-mesh-podfailure-mysql-uaeapw" force deleted Error from server (NotFound): podchaos.chaos-mesh.org "test-chaos-mesh-podfailure-mysql-uaeapw" not found check failover pod name failover pod name:mysql-uaeapw-mysql-1 failover podfailure Success `kubectl get secrets -l app.kubernetes.io/instance=mysql-uaeapw` set secret: mysql-uaeapw-mysql-account-root `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:29FV699wpG;DB_PORT:3306;DB_DATABASE:mysql check db_client batch data count `echo "echo \"select count(*) from executions_loop.executions_loop_table;\" | mysql -P3306 -hmysql-uaeapw-mysql.ns-oihey.svc.cluster.local -uroot -p'29FV699wpG' " | kubectl exec -it mysql-uaeapw-mysql-1 --namespace ns-oihey -- bash ` check db_client batch data Success `kubectl get secrets -l app.kubernetes.io/instance=mysql-uaeapw` set secret: mysql-uaeapw-mysql-account-root `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:29FV699wpG;DB_PORT:3306;DB_DATABASE:mysql check readonly db_client batch data count `echo "echo \"select count(*) from executions_loop.executions_loop_table;\" | mysql -P3306 -h127.0.0.1 -uroot -p'29FV699wpG' " | kubectl exec -it mysql-uaeapw-mysql-0 --namespace ns-oihey -- bash ` check readonly db_client batch data Success cluster mysql scale-out cluster mysql scale-out replicas: 3 check cluster status before ops check cluster status done cluster_status:Running No resources found in mysql-uaeapw namespace. `kbcli cluster scale-out mysql-uaeapw --auto-approve --force=true --components mysql --replicas 1 --namespace ns-oihey ` OpsRequest mysql-uaeapw-horizontalscaling-v9l84 created successfully, you can view the progress: kbcli cluster describe-ops mysql-uaeapw-horizontalscaling-v9l84 -n ns-oihey check ops status `kbcli cluster list-ops mysql-uaeapw --status all --namespace ns-oihey ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME mysql-uaeapw-horizontalscaling-v9l84 ns-oihey HorizontalScaling mysql-uaeapw mysql Running -/- Sep 12,2025 13:23 UTC+0800 check cluster status `kbcli cluster list mysql-uaeapw --show-labels --namespace ns-oihey ` NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS mysql-uaeapw ns-oihey mysql Delete Updating Sep 12,2025 13:05 UTC+0800 app.kubernetes.io/instance=mysql-uaeapw,clusterdefinition.kubeblocks.io/name=mysql cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances mysql-uaeapw --namespace ns-oihey ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME mysql-uaeapw-mysql-0 ns-oihey mysql-uaeapw mysql Running secondary 0 200m / 200m 644245094400m / 644245094400m data:10Gi aks-cicdamdpool-13759654-vmss000002/10.224.0.6 Sep 12,2025 13:15 UTC+0800 mysql-uaeapw-mysql-1 ns-oihey mysql-uaeapw mysql Running primary 0 200m / 200m 644245094400m / 644245094400m data:10Gi aks-cicdamdpool-13759654-vmss000001/10.224.0.7 Sep 12,2025 13:16 UTC+0800 mysql-uaeapw-mysql-2 ns-oihey mysql-uaeapw mysql Running secondary 0 200m / 200m 644245094400m / 644245094400m data:10Gi aks-cicdamdpool-13759654-vmss000000/10.224.0.5 Sep 12,2025 13:23 UTC+0800 check pod status done check cluster role check cluster role done primary: mysql-uaeapw-mysql-1;secondary: mysql-uaeapw-mysql-0 mysql-uaeapw-mysql-2 `kubectl get secrets -l app.kubernetes.io/instance=mysql-uaeapw` set secret: mysql-uaeapw-mysql-account-root `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:29FV699wpG;DB_PORT:3306;DB_DATABASE:mysql check cluster connect `echo " echo \"SHOW SLAVE STATUS\G;\" | mysql -P3306 -h127.0.0.1 -uroot -p'29FV699wpG' " | kubectl exec -it mysql-uaeapw-mysql-0 --namespace ns-oihey -- bash ` check cluster connect done No resources found in mysql-uaeapw namespace. check ops status `kbcli cluster list-ops mysql-uaeapw --status all --namespace ns-oihey ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME mysql-uaeapw-horizontalscaling-v9l84 ns-oihey HorizontalScaling mysql-uaeapw mysql Succeed 1/1 Sep 12,2025 13:23 UTC+0800 check ops status done ops_status:mysql-uaeapw-horizontalscaling-v9l84 ns-oihey HorizontalScaling mysql-uaeapw mysql Succeed 1/1 Sep 12,2025 13:23 UTC+0800 `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge opsrequests.operations mysql-uaeapw-horizontalscaling-v9l84 --namespace ns-oihey ` opsrequest.operations.kubeblocks.io/mysql-uaeapw-horizontalscaling-v9l84 patched `kbcli cluster delete-ops --name mysql-uaeapw-horizontalscaling-v9l84 --force --auto-approve --namespace ns-oihey ` OpsRequest mysql-uaeapw-horizontalscaling-v9l84 deleted `kubectl get secrets -l app.kubernetes.io/instance=mysql-uaeapw` set secret: mysql-uaeapw-mysql-account-root `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:29FV699wpG;DB_PORT:3306;DB_DATABASE:mysql check db_client batch data count `echo "echo \"select count(*) from executions_loop.executions_loop_table;\" | mysql -P3306 -hmysql-uaeapw-mysql.ns-oihey.svc.cluster.local -uroot -p'29FV699wpG' " | kubectl exec -it mysql-uaeapw-mysql-1 --namespace ns-oihey -- bash ` check db_client batch data Success `kubectl get secrets -l app.kubernetes.io/instance=mysql-uaeapw` set secret: mysql-uaeapw-mysql-account-root `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:29FV699wpG;DB_PORT:3306;DB_DATABASE:mysql check readonly db_client batch data count `echo "echo \"select count(*) from executions_loop.executions_loop_table;\" | mysql -P3306 -h127.0.0.1 -uroot -p'29FV699wpG' " | kubectl exec -it mysql-uaeapw-mysql-0 --namespace ns-oihey -- bash ` check readonly db_client batch data Success cluster mysql scale-in cluster mysql scale-in replicas: 2 check cluster status before ops check cluster status done cluster_status:Running No resources found in mysql-uaeapw namespace. `kbcli cluster scale-in mysql-uaeapw --auto-approve --force=true --components mysql --replicas 1 --namespace ns-oihey ` OpsRequest mysql-uaeapw-horizontalscaling-wpttq created successfully, you can view the progress: kbcli cluster describe-ops mysql-uaeapw-horizontalscaling-wpttq -n ns-oihey check ops status `kbcli cluster list-ops mysql-uaeapw --status all --namespace ns-oihey ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME mysql-uaeapw-horizontalscaling-wpttq ns-oihey HorizontalScaling mysql-uaeapw mysql Running -/- Sep 12,2025 13:25 UTC+0800 check cluster status `kbcli cluster list mysql-uaeapw --show-labels --namespace ns-oihey ` NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS mysql-uaeapw ns-oihey mysql Delete Running Sep 12,2025 13:05 UTC+0800 app.kubernetes.io/instance=mysql-uaeapw,clusterdefinition.kubeblocks.io/name=mysql check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances mysql-uaeapw --namespace ns-oihey ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME mysql-uaeapw-mysql-0 ns-oihey mysql-uaeapw mysql Running secondary 0 200m / 200m 644245094400m / 644245094400m data:10Gi aks-cicdamdpool-13759654-vmss000002/10.224.0.6 Sep 12,2025 13:15 UTC+0800 mysql-uaeapw-mysql-1 ns-oihey mysql-uaeapw mysql Running primary 0 200m / 200m 644245094400m / 644245094400m data:10Gi aks-cicdamdpool-13759654-vmss000001/10.224.0.7 Sep 12,2025 13:16 UTC+0800 check pod status done check cluster role check cluster role done primary: mysql-uaeapw-mysql-1;secondary: mysql-uaeapw-mysql-0 `kubectl get secrets -l app.kubernetes.io/instance=mysql-uaeapw` set secret: mysql-uaeapw-mysql-account-root `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:29FV699wpG;DB_PORT:3306;DB_DATABASE:mysql check cluster connect `echo " echo \"SHOW SLAVE STATUS\G;\" | mysql -P3306 -h127.0.0.1 -uroot -p'29FV699wpG' " | kubectl exec -it mysql-uaeapw-mysql-0 --namespace ns-oihey -- bash ` check cluster connect done No resources found in mysql-uaeapw namespace. check ops status `kbcli cluster list-ops mysql-uaeapw --status all --namespace ns-oihey ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME mysql-uaeapw-horizontalscaling-wpttq ns-oihey HorizontalScaling mysql-uaeapw mysql Succeed 1/1 Sep 12,2025 13:25 UTC+0800 check ops status done ops_status:mysql-uaeapw-horizontalscaling-wpttq ns-oihey HorizontalScaling mysql-uaeapw mysql Succeed 1/1 Sep 12,2025 13:25 UTC+0800 `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge opsrequests.operations mysql-uaeapw-horizontalscaling-wpttq --namespace ns-oihey ` opsrequest.operations.kubeblocks.io/mysql-uaeapw-horizontalscaling-wpttq patched `kbcli cluster delete-ops --name mysql-uaeapw-horizontalscaling-wpttq --force --auto-approve --namespace ns-oihey ` OpsRequest mysql-uaeapw-horizontalscaling-wpttq deleted `kubectl get secrets -l app.kubernetes.io/instance=mysql-uaeapw` set secret: mysql-uaeapw-mysql-account-root `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:29FV699wpG;DB_PORT:3306;DB_DATABASE:mysql check db_client batch data count `echo "echo \"select count(*) from executions_loop.executions_loop_table;\" | mysql -P3306 -hmysql-uaeapw-mysql.ns-oihey.svc.cluster.local -uroot -p'29FV699wpG' " | kubectl exec -it mysql-uaeapw-mysql-1 --namespace ns-oihey -- bash ` check db_client batch data Success `kubectl get secrets -l app.kubernetes.io/instance=mysql-uaeapw` set secret: mysql-uaeapw-mysql-account-root `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:29FV699wpG;DB_PORT:3306;DB_DATABASE:mysql check readonly db_client batch data count `echo "echo \"select count(*) from executions_loop.executions_loop_table;\" | mysql -P3306 -h127.0.0.1 -uroot -p'29FV699wpG' " | kubectl exec -it mysql-uaeapw-mysql-0 --namespace ns-oihey -- bash ` check readonly db_client batch data Success test failover timeoffset check cluster status before cluster-failover-timeoffset check cluster status done cluster_status:Running `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge TimeChaos test-chaos-mesh-timeoffset-mysql-uaeapw --namespace ns-oihey ` Warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely. Error from server (NotFound): timechaos.chaos-mesh.org "test-chaos-mesh-timeoffset-mysql-uaeapw" not found Error from server (NotFound): timechaos.chaos-mesh.org "test-chaos-mesh-timeoffset-mysql-uaeapw" not found apiVersion: chaos-mesh.org/v1alpha1 kind: TimeChaos metadata: name: test-chaos-mesh-timeoffset-mysql-uaeapw namespace: ns-oihey spec: selector: namespaces: - ns-oihey labelSelectors: apps.kubeblocks.io/pod-name: mysql-uaeapw-mysql-1 mode: all timeOffset: '-10m' clockIds: - CLOCK_REALTIME duration: 2m `kubectl apply -f test-chaos-mesh-timeoffset-mysql-uaeapw.yaml` timechaos.chaos-mesh.org/test-chaos-mesh-timeoffset-mysql-uaeapw created apply test-chaos-mesh-timeoffset-mysql-uaeapw.yaml Success `rm -rf test-chaos-mesh-timeoffset-mysql-uaeapw.yaml` timeoffset chaos test waiting 120 seconds check cluster status `kbcli cluster list mysql-uaeapw --show-labels --namespace ns-oihey ` NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS mysql-uaeapw ns-oihey mysql Delete Running Sep 12,2025 13:05 UTC+0800 app.kubernetes.io/instance=mysql-uaeapw,clusterdefinition.kubeblocks.io/name=mysql check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances mysql-uaeapw --namespace ns-oihey ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME mysql-uaeapw-mysql-0 ns-oihey mysql-uaeapw mysql Running secondary 0 200m / 200m 644245094400m / 644245094400m data:10Gi aks-cicdamdpool-13759654-vmss000002/10.224.0.6 Sep 12,2025 13:15 UTC+0800 mysql-uaeapw-mysql-1 ns-oihey mysql-uaeapw mysql Running primary 0 200m / 200m 644245094400m / 644245094400m data:10Gi aks-cicdamdpool-13759654-vmss000001/10.224.0.7 Sep 12,2025 13:16 UTC+0800 check pod status done check cluster role check cluster role done primary: mysql-uaeapw-mysql-1;secondary: mysql-uaeapw-mysql-0 `kubectl get secrets -l app.kubernetes.io/instance=mysql-uaeapw` set secret: mysql-uaeapw-mysql-account-root `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:29FV699wpG;DB_PORT:3306;DB_DATABASE:mysql check cluster connect `echo " echo \"SHOW SLAVE STATUS\G;\" | mysql -P3306 -h127.0.0.1 -uroot -p'29FV699wpG' " | kubectl exec -it mysql-uaeapw-mysql-0 --namespace ns-oihey -- bash ` check cluster connect done `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge TimeChaos test-chaos-mesh-timeoffset-mysql-uaeapw --namespace ns-oihey ` Warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely. timechaos.chaos-mesh.org "test-chaos-mesh-timeoffset-mysql-uaeapw" force deleted Error from server (NotFound): timechaos.chaos-mesh.org "test-chaos-mesh-timeoffset-mysql-uaeapw" not found check failover pod name failover pod name:mysql-uaeapw-mysql-1 failover timeoffset Success `kubectl get secrets -l app.kubernetes.io/instance=mysql-uaeapw` set secret: mysql-uaeapw-mysql-account-root `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:29FV699wpG;DB_PORT:3306;DB_DATABASE:mysql check db_client batch data count `echo "echo \"select count(*) from executions_loop.executions_loop_table;\" | mysql -P3306 -hmysql-uaeapw-mysql.ns-oihey.svc.cluster.local -uroot -p'29FV699wpG' " | kubectl exec -it mysql-uaeapw-mysql-1 --namespace ns-oihey -- bash ` check db_client batch data Success `kubectl get secrets -l app.kubernetes.io/instance=mysql-uaeapw` set secret: mysql-uaeapw-mysql-account-root `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:29FV699wpG;DB_PORT:3306;DB_DATABASE:mysql check readonly db_client batch data count `echo "echo \"select count(*) from executions_loop.executions_loop_table;\" | mysql -P3306 -h127.0.0.1 -uroot -p'29FV699wpG' " | kubectl exec -it mysql-uaeapw-mysql-0 --namespace ns-oihey -- bash ` check readonly db_client batch data Success test failover networkcorruptover check cluster status before cluster-failover-networkcorruptover check cluster status done cluster_status:Running `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge NetworkChaos test-chaos-mesh-networkcorruptover-mysql-uaeapw --namespace ns-oihey ` Warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely. Error from server (NotFound): networkchaos.chaos-mesh.org "test-chaos-mesh-networkcorruptover-mysql-uaeapw" not found Error from server (NotFound): networkchaos.chaos-mesh.org "test-chaos-mesh-networkcorruptover-mysql-uaeapw" not found apiVersion: chaos-mesh.org/v1alpha1 kind: NetworkChaos metadata: name: test-chaos-mesh-networkcorruptover-mysql-uaeapw namespace: ns-oihey spec: selector: namespaces: - ns-oihey labelSelectors: apps.kubeblocks.io/pod-name: mysql-uaeapw-mysql-1 mode: all action: corrupt corrupt: corrupt: '100' correlation: '100' direction: to duration: 2m `kubectl apply -f test-chaos-mesh-networkcorruptover-mysql-uaeapw.yaml` networkchaos.chaos-mesh.org/test-chaos-mesh-networkcorruptover-mysql-uaeapw created apply test-chaos-mesh-networkcorruptover-mysql-uaeapw.yaml Success `rm -rf test-chaos-mesh-networkcorruptover-mysql-uaeapw.yaml` networkcorruptover chaos test waiting 120 seconds check cluster status `kbcli cluster list mysql-uaeapw --show-labels --namespace ns-oihey ` NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS mysql-uaeapw ns-oihey mysql Delete Running Sep 12,2025 13:05 UTC+0800 app.kubernetes.io/instance=mysql-uaeapw,clusterdefinition.kubeblocks.io/name=mysql check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances mysql-uaeapw --namespace ns-oihey ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME mysql-uaeapw-mysql-0 ns-oihey mysql-uaeapw mysql Running primary 0 200m / 200m 644245094400m / 644245094400m data:10Gi aks-cicdamdpool-13759654-vmss000002/10.224.0.6 Sep 12,2025 13:15 UTC+0800 mysql-uaeapw-mysql-1 ns-oihey mysql-uaeapw mysql Running secondary 0 200m / 200m 644245094400m / 644245094400m data:10Gi aks-cicdamdpool-13759654-vmss000001/10.224.0.7 Sep 12,2025 13:16 UTC+0800 check pod status done check cluster role check cluster role done primary: mysql-uaeapw-mysql-0;secondary: mysql-uaeapw-mysql-1 `kubectl get secrets -l app.kubernetes.io/instance=mysql-uaeapw` set secret: mysql-uaeapw-mysql-account-root `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:29FV699wpG;DB_PORT:3306;DB_DATABASE:mysql check cluster connect `echo " echo \"SHOW SLAVE STATUS\G;\" | mysql -P3306 -h127.0.0.1 -uroot -p'29FV699wpG' " | kubectl exec -it mysql-uaeapw-mysql-1 --namespace ns-oihey -- bash ` check cluster connect done `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge NetworkChaos test-chaos-mesh-networkcorruptover-mysql-uaeapw --namespace ns-oihey ` Warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely. networkchaos.chaos-mesh.org "test-chaos-mesh-networkcorruptover-mysql-uaeapw" force deleted networkchaos.chaos-mesh.org/test-chaos-mesh-networkcorruptover-mysql-uaeapw patched check failover pod name failover pod name:mysql-uaeapw-mysql-0 failover networkcorruptover Success `kubectl get secrets -l app.kubernetes.io/instance=mysql-uaeapw` set secret: mysql-uaeapw-mysql-account-root `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:29FV699wpG;DB_PORT:3306;DB_DATABASE:mysql check db_client batch data count `echo "echo \"select count(*) from executions_loop.executions_loop_table;\" | mysql -P3306 -hmysql-uaeapw-mysql.ns-oihey.svc.cluster.local -uroot -p'29FV699wpG' " | kubectl exec -it mysql-uaeapw-mysql-0 --namespace ns-oihey -- bash ` check db_client batch data Success `kubectl get secrets -l app.kubernetes.io/instance=mysql-uaeapw` set secret: mysql-uaeapw-mysql-account-root `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:29FV699wpG;DB_PORT:3306;DB_DATABASE:mysql check readonly db_client batch data count `echo "echo \"select count(*) from executions_loop.executions_loop_table;\" | mysql -P3306 -h127.0.0.1 -uroot -p'29FV699wpG' " | kubectl exec -it mysql-uaeapw-mysql-1 --namespace ns-oihey -- bash ` check readonly db_client batch data Success test failover networkduplicate check cluster status before cluster-failover-networkduplicate check cluster status done cluster_status:Running `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge NetworkChaos test-chaos-mesh-networkduplicate-mysql-uaeapw --namespace ns-oihey ` Warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely. Error from server (NotFound): networkchaos.chaos-mesh.org "test-chaos-mesh-networkduplicate-mysql-uaeapw" not found Error from server (NotFound): networkchaos.chaos-mesh.org "test-chaos-mesh-networkduplicate-mysql-uaeapw" not found apiVersion: chaos-mesh.org/v1alpha1 kind: NetworkChaos metadata: name: test-chaos-mesh-networkduplicate-mysql-uaeapw namespace: ns-oihey spec: selector: namespaces: - ns-oihey labelSelectors: apps.kubeblocks.io/pod-name: mysql-uaeapw-mysql-0 mode: all action: duplicate duplicate: duplicate: '100' correlation: '100' direction: to duration: 2m `kubectl apply -f test-chaos-mesh-networkduplicate-mysql-uaeapw.yaml` networkchaos.chaos-mesh.org/test-chaos-mesh-networkduplicate-mysql-uaeapw created apply test-chaos-mesh-networkduplicate-mysql-uaeapw.yaml Success `rm -rf test-chaos-mesh-networkduplicate-mysql-uaeapw.yaml` networkduplicate chaos test waiting 120 seconds check cluster status `kbcli cluster list mysql-uaeapw --show-labels --namespace ns-oihey ` NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS mysql-uaeapw ns-oihey mysql Delete Running Sep 12,2025 13:05 UTC+0800 app.kubernetes.io/instance=mysql-uaeapw,clusterdefinition.kubeblocks.io/name=mysql check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances mysql-uaeapw --namespace ns-oihey ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME mysql-uaeapw-mysql-0 ns-oihey mysql-uaeapw mysql Running primary 0 200m / 200m 644245094400m / 644245094400m data:10Gi aks-cicdamdpool-13759654-vmss000002/10.224.0.6 Sep 12,2025 13:15 UTC+0800 mysql-uaeapw-mysql-1 ns-oihey mysql-uaeapw mysql Running secondary 0 200m / 200m 644245094400m / 644245094400m data:10Gi aks-cicdamdpool-13759654-vmss000001/10.224.0.7 Sep 12,2025 13:16 UTC+0800 check pod status done check cluster role check cluster role done primary: mysql-uaeapw-mysql-0;secondary: mysql-uaeapw-mysql-1 `kubectl get secrets -l app.kubernetes.io/instance=mysql-uaeapw` set secret: mysql-uaeapw-mysql-account-root `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:29FV699wpG;DB_PORT:3306;DB_DATABASE:mysql check cluster connect `echo " echo \"SHOW SLAVE STATUS\G;\" | mysql -P3306 -h127.0.0.1 -uroot -p'29FV699wpG' " | kubectl exec -it mysql-uaeapw-mysql-1 --namespace ns-oihey -- bash ` check cluster connect done `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge NetworkChaos test-chaos-mesh-networkduplicate-mysql-uaeapw --namespace ns-oihey ` Warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely. networkchaos.chaos-mesh.org "test-chaos-mesh-networkduplicate-mysql-uaeapw" force deleted networkchaos.chaos-mesh.org/test-chaos-mesh-networkduplicate-mysql-uaeapw patched check failover pod name failover pod name:mysql-uaeapw-mysql-0 failover networkduplicate Success `kubectl get secrets -l app.kubernetes.io/instance=mysql-uaeapw` set secret: mysql-uaeapw-mysql-account-root `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:29FV699wpG;DB_PORT:3306;DB_DATABASE:mysql check db_client batch data count `echo "echo \"select count(*) from executions_loop.executions_loop_table;\" | mysql -P3306 -hmysql-uaeapw-mysql.ns-oihey.svc.cluster.local -uroot -p'29FV699wpG' " | kubectl exec -it mysql-uaeapw-mysql-0 --namespace ns-oihey -- bash ` check db_client batch data Success `kubectl get secrets -l app.kubernetes.io/instance=mysql-uaeapw` set secret: mysql-uaeapw-mysql-account-root `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:29FV699wpG;DB_PORT:3306;DB_DATABASE:mysql check readonly db_client batch data count `echo "echo \"select count(*) from executions_loop.executions_loop_table;\" | mysql -P3306 -h127.0.0.1 -uroot -p'29FV699wpG' " | kubectl exec -it mysql-uaeapw-mysql-1 --namespace ns-oihey -- bash ` check readonly db_client batch data Success test failover oom check cluster status before cluster-failover-oom check cluster status done cluster_status:Running `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge StressChaos test-chaos-mesh-oom-mysql-uaeapw --namespace ns-oihey ` Warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely. Error from server (NotFound): stresschaos.chaos-mesh.org "test-chaos-mesh-oom-mysql-uaeapw" not found Error from server (NotFound): stresschaos.chaos-mesh.org "test-chaos-mesh-oom-mysql-uaeapw" not found apiVersion: chaos-mesh.org/v1alpha1 kind: StressChaos metadata: name: test-chaos-mesh-oom-mysql-uaeapw namespace: ns-oihey spec: selector: namespaces: - ns-oihey labelSelectors: apps.kubeblocks.io/pod-name: mysql-uaeapw-mysql-0 mode: all stressors: memory: workers: 1 size: "100GB" oomScoreAdj: -1000 duration: 2m `kubectl apply -f test-chaos-mesh-oom-mysql-uaeapw.yaml` stresschaos.chaos-mesh.org/test-chaos-mesh-oom-mysql-uaeapw created apply test-chaos-mesh-oom-mysql-uaeapw.yaml Success `rm -rf test-chaos-mesh-oom-mysql-uaeapw.yaml` check cluster status `kbcli cluster list mysql-uaeapw --show-labels --namespace ns-oihey ` NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS mysql-uaeapw ns-oihey mysql Delete Running Sep 12,2025 13:05 UTC+0800 app.kubernetes.io/instance=mysql-uaeapw,clusterdefinition.kubeblocks.io/name=mysql check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances mysql-uaeapw --namespace ns-oihey ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME mysql-uaeapw-mysql-0 ns-oihey mysql-uaeapw mysql Running secondary 0 200m / 200m 644245094400m / 644245094400m data:10Gi aks-cicdamdpool-13759654-vmss000002/10.224.0.6 Sep 12,2025 13:15 UTC+0800 mysql-uaeapw-mysql-1 ns-oihey mysql-uaeapw mysql Running primary 0 200m / 200m 644245094400m / 644245094400m data:10Gi aks-cicdamdpool-13759654-vmss000001/10.224.0.7 Sep 12,2025 13:16 UTC+0800 check pod status done check cluster role check cluster role done primary: mysql-uaeapw-mysql-1;secondary: mysql-uaeapw-mysql-0 `kubectl get secrets -l app.kubernetes.io/instance=mysql-uaeapw` set secret: mysql-uaeapw-mysql-account-root `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:29FV699wpG;DB_PORT:3306;DB_DATABASE:mysql check cluster connect `echo " echo \"SHOW SLAVE STATUS\G;\" | mysql -P3306 -h127.0.0.1 -uroot -p'29FV699wpG' " | kubectl exec -it mysql-uaeapw-mysql-0 --namespace ns-oihey -- bash ` check cluster connect done `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge StressChaos test-chaos-mesh-oom-mysql-uaeapw --namespace ns-oihey ` Warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely. stresschaos.chaos-mesh.org "test-chaos-mesh-oom-mysql-uaeapw" force deleted stresschaos.chaos-mesh.org/test-chaos-mesh-oom-mysql-uaeapw patched check failover pod name failover pod name:mysql-uaeapw-mysql-1 failover oom Success `kubectl get secrets -l app.kubernetes.io/instance=mysql-uaeapw` set secret: mysql-uaeapw-mysql-account-root `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:29FV699wpG;DB_PORT:3306;DB_DATABASE:mysql check db_client batch data count `echo "echo \"select count(*) from executions_loop.executions_loop_table;\" | mysql -P3306 -hmysql-uaeapw-mysql.ns-oihey.svc.cluster.local -uroot -p'29FV699wpG' " | kubectl exec -it mysql-uaeapw-mysql-1 --namespace ns-oihey -- bash ` check db_client batch data Success `kubectl get secrets -l app.kubernetes.io/instance=mysql-uaeapw` set secret: mysql-uaeapw-mysql-account-root `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:29FV699wpG;DB_PORT:3306;DB_DATABASE:mysql check readonly db_client batch data count `echo "echo \"select count(*) from executions_loop.executions_loop_table;\" | mysql -P3306 -h127.0.0.1 -uroot -p'29FV699wpG' " | kubectl exec -it mysql-uaeapw-mysql-0 --namespace ns-oihey -- bash ` check readonly db_client batch data Success test failover kill1 check cluster status before cluster-failover-kill1 check cluster status done cluster_status:Running `kill 1` Defaulted container "mysql" out of: mysql, mysql-exporter, kbagent, config-manager, init-data (init), init-xtrabackup (init), init-jemalloc (init), init-syncer (init), init-kbagent (init), kbagent-worker (init) Unable to use a TTY - input is not a terminal or the right kind of file exec return message: check cluster status `kbcli cluster list mysql-uaeapw --show-labels --namespace ns-oihey ` NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS mysql-uaeapw ns-oihey mysql Delete Running Sep 12,2025 13:05 UTC+0800 app.kubernetes.io/instance=mysql-uaeapw,clusterdefinition.kubeblocks.io/name=mysql check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances mysql-uaeapw --namespace ns-oihey ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME mysql-uaeapw-mysql-0 ns-oihey mysql-uaeapw mysql Running primary 0 200m / 200m 644245094400m / 644245094400m data:10Gi aks-cicdamdpool-13759654-vmss000002/10.224.0.6 Sep 12,2025 13:15 UTC+0800 mysql-uaeapw-mysql-1 ns-oihey mysql-uaeapw mysql Running secondary 0 200m / 200m 644245094400m / 644245094400m data:10Gi aks-cicdamdpool-13759654-vmss000001/10.224.0.7 Sep 12,2025 13:16 UTC+0800 check pod status done check cluster role check cluster role done primary: mysql-uaeapw-mysql-0;secondary: mysql-uaeapw-mysql-1 `kubectl get secrets -l app.kubernetes.io/instance=mysql-uaeapw` set secret: mysql-uaeapw-mysql-account-root `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:29FV699wpG;DB_PORT:3306;DB_DATABASE:mysql check cluster connect `echo " echo \"SHOW SLAVE STATUS\G;\" | mysql -P3306 -h127.0.0.1 -uroot -p'29FV699wpG' " | kubectl exec -it mysql-uaeapw-mysql-1 --namespace ns-oihey -- bash ` check cluster connect done check failover pod name failover pod name:mysql-uaeapw-mysql-0 failover kill1 Success `kubectl get secrets -l app.kubernetes.io/instance=mysql-uaeapw` set secret: mysql-uaeapw-mysql-account-root `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:29FV699wpG;DB_PORT:3306;DB_DATABASE:mysql check db_client batch data count `echo "echo \"select count(*) from executions_loop.executions_loop_table;\" | mysql -P3306 -hmysql-uaeapw-mysql.ns-oihey.svc.cluster.local -uroot -p'29FV699wpG' " | kubectl exec -it mysql-uaeapw-mysql-0 --namespace ns-oihey -- bash ` check db_client batch data Success `kubectl get secrets -l app.kubernetes.io/instance=mysql-uaeapw` set secret: mysql-uaeapw-mysql-account-root `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:29FV699wpG;DB_PORT:3306;DB_DATABASE:mysql check readonly db_client batch data count `echo "echo \"select count(*) from executions_loop.executions_loop_table;\" | mysql -P3306 -h127.0.0.1 -uroot -p'29FV699wpG' " | kubectl exec -it mysql-uaeapw-mysql-1 --namespace ns-oihey -- bash ` check readonly db_client batch data Success `kubectl get pvc -l app.kubernetes.io/instance=mysql-uaeapw,apps.kubeblocks.io/component-name=mysql,apps.kubeblocks.io/vct-name=data --namespace ns-oihey ` cluster volume-expand check cluster status before ops check cluster status done cluster_status:Running No resources found in mysql-uaeapw namespace. `kbcli cluster volume-expand mysql-uaeapw --auto-approve --force=true --components mysql --volume-claim-templates data --storage 12Gi --namespace ns-oihey ` OpsRequest mysql-uaeapw-volumeexpansion-xr97x created successfully, you can view the progress: kbcli cluster describe-ops mysql-uaeapw-volumeexpansion-xr97x -n ns-oihey check ops status `kbcli cluster list-ops mysql-uaeapw --status all --namespace ns-oihey ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME mysql-uaeapw-volumeexpansion-xr97x ns-oihey VolumeExpansion mysql-uaeapw mysql Creating -/- Sep 12,2025 13:32 UTC+0800 check cluster status `kbcli cluster list mysql-uaeapw --show-labels --namespace ns-oihey ` NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS mysql-uaeapw ns-oihey mysql Delete Updating Sep 12,2025 13:05 UTC+0800 app.kubernetes.io/instance=mysql-uaeapw,clusterdefinition.kubeblocks.io/name=mysql cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances mysql-uaeapw --namespace ns-oihey ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME mysql-uaeapw-mysql-0 ns-oihey mysql-uaeapw mysql Running primary 0 200m / 200m 644245094400m / 644245094400m data:12Gi aks-cicdamdpool-13759654-vmss000002/10.224.0.6 Sep 12,2025 13:15 UTC+0800 mysql-uaeapw-mysql-1 ns-oihey mysql-uaeapw mysql Running secondary 0 200m / 200m 644245094400m / 644245094400m data:12Gi aks-cicdamdpool-13759654-vmss000001/10.224.0.7 Sep 12,2025 13:16 UTC+0800 check pod status done check cluster role check cluster role done primary: mysql-uaeapw-mysql-0;secondary: mysql-uaeapw-mysql-1 `kubectl get secrets -l app.kubernetes.io/instance=mysql-uaeapw` set secret: mysql-uaeapw-mysql-account-root `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:29FV699wpG;DB_PORT:3306;DB_DATABASE:mysql check cluster connect `echo " echo \"SHOW SLAVE STATUS\G;\" | mysql -P3306 -h127.0.0.1 -uroot -p'29FV699wpG' " | kubectl exec -it mysql-uaeapw-mysql-1 --namespace ns-oihey -- bash ` check cluster connect done No resources found in mysql-uaeapw namespace. check ops status `kbcli cluster list-ops mysql-uaeapw --status all --namespace ns-oihey ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME mysql-uaeapw-volumeexpansion-xr97x ns-oihey VolumeExpansion mysql-uaeapw mysql Succeed 2/2 Sep 12,2025 13:32 UTC+0800 check ops status done ops_status:mysql-uaeapw-volumeexpansion-xr97x ns-oihey VolumeExpansion mysql-uaeapw mysql Succeed 2/2 Sep 12,2025 13:32 UTC+0800 `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge opsrequests.operations mysql-uaeapw-volumeexpansion-xr97x --namespace ns-oihey ` opsrequest.operations.kubeblocks.io/mysql-uaeapw-volumeexpansion-xr97x patched `kbcli cluster delete-ops --name mysql-uaeapw-volumeexpansion-xr97x --force --auto-approve --namespace ns-oihey ` OpsRequest mysql-uaeapw-volumeexpansion-xr97x deleted `kubectl get secrets -l app.kubernetes.io/instance=mysql-uaeapw` set secret: mysql-uaeapw-mysql-account-root `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:29FV699wpG;DB_PORT:3306;DB_DATABASE:mysql check db_client batch data count `echo "echo \"select count(*) from executions_loop.executions_loop_table;\" | mysql -P3306 -hmysql-uaeapw-mysql.ns-oihey.svc.cluster.local -uroot -p'29FV699wpG' " | kubectl exec -it mysql-uaeapw-mysql-0 --namespace ns-oihey -- bash ` check db_client batch data Success `kubectl get secrets -l app.kubernetes.io/instance=mysql-uaeapw` set secret: mysql-uaeapw-mysql-account-root `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:29FV699wpG;DB_PORT:3306;DB_DATABASE:mysql check readonly db_client batch data count `echo "echo \"select count(*) from executions_loop.executions_loop_table;\" | mysql -P3306 -h127.0.0.1 -uroot -p'29FV699wpG' " | kubectl exec -it mysql-uaeapw-mysql-1 --namespace ns-oihey -- bash ` check readonly db_client batch data Success cluster restart check cluster status before ops check cluster status done cluster_status:Running `kbcli cluster restart mysql-uaeapw --auto-approve --force=true --namespace ns-oihey ` OpsRequest mysql-uaeapw-restart-xpr5m created successfully, you can view the progress: kbcli cluster describe-ops mysql-uaeapw-restart-xpr5m -n ns-oihey check ops status `kbcli cluster list-ops mysql-uaeapw --status all --namespace ns-oihey ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME mysql-uaeapw-restart-xpr5m ns-oihey Restart mysql-uaeapw mysql Running -/- Sep 12,2025 13:38 UTC+0800 check cluster status `kbcli cluster list mysql-uaeapw --show-labels --namespace ns-oihey ` NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS mysql-uaeapw ns-oihey mysql Delete Updating Sep 12,2025 13:05 UTC+0800 app.kubernetes.io/instance=mysql-uaeapw,clusterdefinition.kubeblocks.io/name=mysql cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances mysql-uaeapw --namespace ns-oihey ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME mysql-uaeapw-mysql-0 ns-oihey mysql-uaeapw mysql Running secondary 0 200m / 200m 644245094400m / 644245094400m data:12Gi aks-cicdamdpool-13759654-vmss000002/10.224.0.6 Sep 12,2025 13:39 UTC+0800 mysql-uaeapw-mysql-1 ns-oihey mysql-uaeapw mysql Running primary 0 200m / 200m 644245094400m / 644245094400m data:12Gi aks-cicdamdpool-13759654-vmss000001/10.224.0.7 Sep 12,2025 13:38 UTC+0800 check pod status done check cluster role check cluster role done primary: mysql-uaeapw-mysql-1;secondary: mysql-uaeapw-mysql-0 `kubectl get secrets -l app.kubernetes.io/instance=mysql-uaeapw` set secret: mysql-uaeapw-mysql-account-root `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:29FV699wpG;DB_PORT:3306;DB_DATABASE:mysql check cluster connect `echo " echo \"SHOW SLAVE STATUS\G;\" | mysql -P3306 -h127.0.0.1 -uroot -p'29FV699wpG' " | kubectl exec -it mysql-uaeapw-mysql-0 --namespace ns-oihey -- bash ` check cluster connect done check ops status `kbcli cluster list-ops mysql-uaeapw --status all --namespace ns-oihey ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME mysql-uaeapw-restart-xpr5m ns-oihey Restart mysql-uaeapw mysql Succeed 2/2 Sep 12,2025 13:38 UTC+0800 check ops status done ops_status:mysql-uaeapw-restart-xpr5m ns-oihey Restart mysql-uaeapw mysql Succeed 2/2 Sep 12,2025 13:38 UTC+0800 `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge opsrequests.operations mysql-uaeapw-restart-xpr5m --namespace ns-oihey ` opsrequest.operations.kubeblocks.io/mysql-uaeapw-restart-xpr5m patched `kbcli cluster delete-ops --name mysql-uaeapw-restart-xpr5m --force --auto-approve --namespace ns-oihey ` OpsRequest mysql-uaeapw-restart-xpr5m deleted `kubectl get secrets -l app.kubernetes.io/instance=mysql-uaeapw` set secret: mysql-uaeapw-mysql-account-root `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:29FV699wpG;DB_PORT:3306;DB_DATABASE:mysql check db_client batch data count `echo "echo \"select count(*) from executions_loop.executions_loop_table;\" | mysql -P3306 -hmysql-uaeapw-mysql.ns-oihey.svc.cluster.local -uroot -p'29FV699wpG' " | kubectl exec -it mysql-uaeapw-mysql-1 --namespace ns-oihey -- bash ` check db_client batch data Success `kubectl get secrets -l app.kubernetes.io/instance=mysql-uaeapw` set secret: mysql-uaeapw-mysql-account-root `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:29FV699wpG;DB_PORT:3306;DB_DATABASE:mysql check readonly db_client batch data count `echo "echo \"select count(*) from executions_loop.executions_loop_table;\" | mysql -P3306 -h127.0.0.1 -uroot -p'29FV699wpG' " | kubectl exec -it mysql-uaeapw-mysql-0 --namespace ns-oihey -- bash ` check readonly db_client batch data Success test failover networkbandwidthover check cluster status before cluster-failover-networkbandwidthover check cluster status done cluster_status:Running `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge NetworkChaos test-chaos-mesh-networkbandwidthover-mysql-uaeapw --namespace ns-oihey ` Warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely. Error from server (NotFound): networkchaos.chaos-mesh.org "test-chaos-mesh-networkbandwidthover-mysql-uaeapw" not found Error from server (NotFound): networkchaos.chaos-mesh.org "test-chaos-mesh-networkbandwidthover-mysql-uaeapw" not found apiVersion: chaos-mesh.org/v1alpha1 kind: NetworkChaos metadata: name: test-chaos-mesh-networkbandwidthover-mysql-uaeapw namespace: ns-oihey spec: selector: namespaces: - ns-oihey labelSelectors: apps.kubeblocks.io/pod-name: mysql-uaeapw-mysql-1 action: bandwidth mode: all bandwidth: rate: '1bps' limit: 20971520 buffer: 10000 duration: 2m `kubectl apply -f test-chaos-mesh-networkbandwidthover-mysql-uaeapw.yaml` networkchaos.chaos-mesh.org/test-chaos-mesh-networkbandwidthover-mysql-uaeapw created apply test-chaos-mesh-networkbandwidthover-mysql-uaeapw.yaml Success `rm -rf test-chaos-mesh-networkbandwidthover-mysql-uaeapw.yaml` networkbandwidthover chaos test waiting 120 seconds check cluster status `kbcli cluster list mysql-uaeapw --show-labels --namespace ns-oihey ` NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS mysql-uaeapw ns-oihey mysql Delete Running Sep 12,2025 13:05 UTC+0800 app.kubernetes.io/instance=mysql-uaeapw,clusterdefinition.kubeblocks.io/name=mysql check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances mysql-uaeapw --namespace ns-oihey ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME mysql-uaeapw-mysql-0 ns-oihey mysql-uaeapw mysql Running primary 0 200m / 200m 644245094400m / 644245094400m data:12Gi aks-cicdamdpool-13759654-vmss000002/10.224.0.6 Sep 12,2025 13:39 UTC+0800 mysql-uaeapw-mysql-1 ns-oihey mysql-uaeapw mysql Running secondary 0 200m / 200m 644245094400m / 644245094400m data:12Gi aks-cicdamdpool-13759654-vmss000001/10.224.0.7 Sep 12,2025 13:38 UTC+0800 check pod status done check cluster role check cluster role done primary: mysql-uaeapw-mysql-0;secondary: mysql-uaeapw-mysql-1 `kubectl get secrets -l app.kubernetes.io/instance=mysql-uaeapw` set secret: mysql-uaeapw-mysql-account-root `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:29FV699wpG;DB_PORT:3306;DB_DATABASE:mysql check cluster connect `echo " echo \"SHOW SLAVE STATUS\G;\" | mysql -P3306 -h127.0.0.1 -uroot -p'29FV699wpG' " | kubectl exec -it mysql-uaeapw-mysql-1 --namespace ns-oihey -- bash ` check cluster connect done `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge NetworkChaos test-chaos-mesh-networkbandwidthover-mysql-uaeapw --namespace ns-oihey ` Warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely. networkchaos.chaos-mesh.org "test-chaos-mesh-networkbandwidthover-mysql-uaeapw" force deleted networkchaos.chaos-mesh.org/test-chaos-mesh-networkbandwidthover-mysql-uaeapw patched check failover pod name failover pod name:mysql-uaeapw-mysql-0 failover networkbandwidthover Success `kubectl get secrets -l app.kubernetes.io/instance=mysql-uaeapw` set secret: mysql-uaeapw-mysql-account-root `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:29FV699wpG;DB_PORT:3306;DB_DATABASE:mysql check db_client batch data count `echo "echo \"select count(*) from executions_loop.executions_loop_table;\" | mysql -P3306 -hmysql-uaeapw-mysql.ns-oihey.svc.cluster.local -uroot -p'29FV699wpG' " | kubectl exec -it mysql-uaeapw-mysql-0 --namespace ns-oihey -- bash ` check db_client batch data Success `kubectl get secrets -l app.kubernetes.io/instance=mysql-uaeapw` set secret: mysql-uaeapw-mysql-account-root `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:29FV699wpG;DB_PORT:3306;DB_DATABASE:mysql check readonly db_client batch data count `echo "echo \"select count(*) from executions_loop.executions_loop_table;\" | mysql -P3306 -h127.0.0.1 -uroot -p'29FV699wpG' " | kubectl exec -it mysql-uaeapw-mysql-1 --namespace ns-oihey -- bash ` check readonly db_client batch data Success cmpv upgrade service version:2,5.7.44|2,8.0.30|2,8.0.31|2,8.0.32|2,8.0.33|2,8.0.34|2,8.0.35|2,8.0.36|2,8.0.37|2,8.0.38|2,8.0.39|2,8.4.0|2,8.4.1|2,8.4.2 set latest cmpv service version latest service version:8.0.39 cmpv service version upgrade and downgrade 8.0.30 is less than 8.0.31 upgrade from:8.0.30 to service version:8.0.31 cluster upgrade apiVersion: operations.kubeblocks.io/v1alpha1 kind: OpsRequest metadata: generateName: mysql-uaeapw-upgrade-cmpv- namespace: ns-oihey spec: clusterName: mysql-uaeapw upgrade: components: - componentName: mysql serviceVersion: 8.0.31 type: Upgrade check cluster status before ops check cluster status done cluster_status:Running `kubectl create -f test_ops_cluster_mysql-uaeapw.yaml` opsrequest.operations.kubeblocks.io/mysql-uaeapw-upgrade-cmpv-8z7l7 created create test_ops_cluster_mysql-uaeapw.yaml Success `rm -rf test_ops_cluster_mysql-uaeapw.yaml` check ops status `kbcli cluster list-ops mysql-uaeapw --status all --namespace ns-oihey ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME mysql-uaeapw-upgrade-cmpv-8z7l7 ns-oihey Upgrade mysql-uaeapw mysql Running 0/2 Sep 12,2025 13:42 UTC+0800 check cluster status `kbcli cluster list mysql-uaeapw --show-labels --namespace ns-oihey ` NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS mysql-uaeapw ns-oihey mysql Delete Updating Sep 12,2025 13:05 UTC+0800 app.kubernetes.io/instance=mysql-uaeapw,clusterdefinition.kubeblocks.io/name=mysql cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances mysql-uaeapw --namespace ns-oihey ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME mysql-uaeapw-mysql-0 ns-oihey mysql-uaeapw mysql Running secondary 0 200m / 200m 644245094400m / 644245094400m data:12Gi aks-cicdamdpool-13759654-vmss000002/10.224.0.6 Sep 12,2025 13:39 UTC+0800 mysql-uaeapw-mysql-1 ns-oihey mysql-uaeapw mysql Running secondary 0 200m / 200m 644245094400m / 644245094400m data:12Gi aks-cicdamdpool-13759654-vmss000001/10.224.0.7 Sep 12,2025 13:38 UTC+0800 check pod status done check cluster role No resources found in ns-oihey namespace. primary: ;secondary: mysql-uaeapw-mysql-0 mysql-uaeapw-mysql-1 No resources found in ns-oihey namespace. primary: ;secondary: mysql-uaeapw-mysql-0 mysql-uaeapw-mysql-1 No resources found in ns-oihey namespace. primary: ;secondary: mysql-uaeapw-mysql-0 mysql-uaeapw-mysql-1 No resources found in ns-oihey namespace. primary: ;secondary: mysql-uaeapw-mysql-0 mysql-uaeapw-mysql-1 No resources found in ns-oihey namespace. primary: ;secondary: mysql-uaeapw-mysql-0 mysql-uaeapw-mysql-1 No resources found in ns-oihey namespace. primary: ;secondary: mysql-uaeapw-mysql-0 mysql-uaeapw-mysql-1 No resources found in ns-oihey namespace. primary: ;secondary: mysql-uaeapw-mysql-0 mysql-uaeapw-mysql-1 No resources found in ns-oihey namespace. primary: ;secondary: mysql-uaeapw-mysql-0 mysql-uaeapw-mysql-1 No resources found in ns-oihey namespace. primary: ;secondary: mysql-uaeapw-mysql-0 mysql-uaeapw-mysql-1 No resources found in ns-oihey namespace. primary: ;secondary: mysql-uaeapw-mysql-0 mysql-uaeapw-mysql-1 No resources found in ns-oihey namespace. primary: ;secondary: mysql-uaeapw-mysql-0 mysql-uaeapw-mysql-1 No resources found in ns-oihey namespace. primary: ;secondary: mysql-uaeapw-mysql-0 mysql-uaeapw-mysql-1 No resources found in ns-oihey namespace. primary: ;secondary: mysql-uaeapw-mysql-0 mysql-uaeapw-mysql-1 No resources found in ns-oihey namespace. primary: ;secondary: mysql-uaeapw-mysql-0 mysql-uaeapw-mysql-1 No resources found in ns-oihey namespace. primary: ;secondary: mysql-uaeapw-mysql-0 mysql-uaeapw-mysql-1 No resources found in ns-oihey namespace. primary: ;secondary: mysql-uaeapw-mysql-0 mysql-uaeapw-mysql-1 No resources found in ns-oihey namespace. primary: ;secondary: mysql-uaeapw-mysql-0 mysql-uaeapw-mysql-1 No resources found in ns-oihey namespace. primary: ;secondary: mysql-uaeapw-mysql-0 mysql-uaeapw-mysql-1 No resources found in ns-oihey namespace. primary: ;secondary: mysql-uaeapw-mysql-0 mysql-uaeapw-mysql-1 No resources found in ns-oihey namespace. primary: ;secondary: mysql-uaeapw-mysql-0 mysql-uaeapw-mysql-1 No resources found in ns-oihey namespace. primary: ;secondary: mysql-uaeapw-mysql-0 mysql-uaeapw-mysql-1 No resources found in ns-oihey namespace. primary: ;secondary: mysql-uaeapw-mysql-0 mysql-uaeapw-mysql-1 No resources found in ns-oihey namespace. primary: ;secondary: mysql-uaeapw-mysql-1 check cluster role done primary: mysql-uaeapw-mysql-0;secondary: mysql-uaeapw-mysql-1 `kubectl get secrets -l app.kubernetes.io/instance=mysql-uaeapw` set secret: mysql-uaeapw-mysql-account-root `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:29FV699wpG;DB_PORT:3306;DB_DATABASE:mysql check cluster connect `echo " echo \"SHOW SLAVE STATUS\G;\" | mysql -P3306 -h127.0.0.1 -uroot -p'29FV699wpG' " | kubectl exec -it mysql-uaeapw-mysql-1 --namespace ns-oihey -- bash ` check cluster connect done check ops status `kbcli cluster list-ops mysql-uaeapw --status all --namespace ns-oihey ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME mysql-uaeapw-upgrade-cmpv-8z7l7 ns-oihey Upgrade mysql-uaeapw mysql Succeed 2/2 Sep 12,2025 13:42 UTC+0800 check ops status done ops_status:mysql-uaeapw-upgrade-cmpv-8z7l7 ns-oihey Upgrade mysql-uaeapw mysql Succeed 2/2 Sep 12,2025 13:42 UTC+0800 `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge opsrequests.operations mysql-uaeapw-upgrade-cmpv-8z7l7 --namespace ns-oihey ` opsrequest.operations.kubeblocks.io/mysql-uaeapw-upgrade-cmpv-8z7l7 patched `kbcli cluster delete-ops --name mysql-uaeapw-upgrade-cmpv-8z7l7 --force --auto-approve --namespace ns-oihey ` OpsRequest mysql-uaeapw-upgrade-cmpv-8z7l7 deleted `kubectl get secrets -l app.kubernetes.io/instance=mysql-uaeapw` set secret: mysql-uaeapw-mysql-account-root `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:29FV699wpG;DB_PORT:3306;DB_DATABASE:mysql check db_client batch data count `echo "echo \"select count(*) from executions_loop.executions_loop_table;\" | mysql -P3306 -hmysql-uaeapw-mysql.ns-oihey.svc.cluster.local -uroot -p'29FV699wpG' " | kubectl exec -it mysql-uaeapw-mysql-0 --namespace ns-oihey -- bash ` check db_client batch data Success `kubectl get secrets -l app.kubernetes.io/instance=mysql-uaeapw` set secret: mysql-uaeapw-mysql-account-root `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:29FV699wpG;DB_PORT:3306;DB_DATABASE:mysql check readonly db_client batch data count `echo "echo \"select count(*) from executions_loop.executions_loop_table;\" | mysql -P3306 -h127.0.0.1 -uroot -p'29FV699wpG' " | kubectl exec -it mysql-uaeapw-mysql-1 --namespace ns-oihey -- bash ` check readonly db_client batch data Success 8.0.31 is less than 8.0.32 upgrade from:8.0.31 to service version:8.0.32 cluster upgrade apiVersion: operations.kubeblocks.io/v1alpha1 kind: OpsRequest metadata: generateName: mysql-uaeapw-upgrade-cmpv- namespace: ns-oihey spec: clusterName: mysql-uaeapw upgrade: components: - componentName: mysql serviceVersion: 8.0.32 type: Upgrade check cluster status before ops check cluster status done cluster_status:Running `kubectl create -f test_ops_cluster_mysql-uaeapw.yaml` opsrequest.operations.kubeblocks.io/mysql-uaeapw-upgrade-cmpv-d9n2g created create test_ops_cluster_mysql-uaeapw.yaml Success `rm -rf test_ops_cluster_mysql-uaeapw.yaml` check ops status `kbcli cluster list-ops mysql-uaeapw --status all --namespace ns-oihey ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME mysql-uaeapw-upgrade-cmpv-d9n2g ns-oihey Upgrade mysql-uaeapw Running -/- Sep 12,2025 13:43 UTC+0800 check cluster status `kbcli cluster list mysql-uaeapw --show-labels --namespace ns-oihey ` NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS mysql-uaeapw ns-oihey mysql Delete Updating Sep 12,2025 13:05 UTC+0800 app.kubernetes.io/instance=mysql-uaeapw,clusterdefinition.kubeblocks.io/name=mysql cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances mysql-uaeapw --namespace ns-oihey ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME mysql-uaeapw-mysql-0 ns-oihey mysql-uaeapw mysql Running secondary 0 200m / 200m 644245094400m / 644245094400m data:12Gi aks-cicdamdpool-13759654-vmss000002/10.224.0.6 Sep 12,2025 13:39 UTC+0800 mysql-uaeapw-mysql-1 ns-oihey mysql-uaeapw mysql Running secondary 0 200m / 200m 644245094400m / 644245094400m data:12Gi aks-cicdamdpool-13759654-vmss000001/10.224.0.7 Sep 12,2025 13:38 UTC+0800 check pod status done check cluster role No resources found in ns-oihey namespace. primary: ;secondary: mysql-uaeapw-mysql-0 mysql-uaeapw-mysql-1 No resources found in ns-oihey namespace. primary: ;secondary: mysql-uaeapw-mysql-0 mysql-uaeapw-mysql-1 No resources found in ns-oihey namespace. primary: ;secondary: mysql-uaeapw-mysql-0 mysql-uaeapw-mysql-1 No resources found in ns-oihey namespace. primary: ;secondary: mysql-uaeapw-mysql-0 mysql-uaeapw-mysql-1 No resources found in ns-oihey namespace. primary: ;secondary: mysql-uaeapw-mysql-0 mysql-uaeapw-mysql-1 No resources found in ns-oihey namespace. primary: ;secondary: mysql-uaeapw-mysql-0 mysql-uaeapw-mysql-1 No resources found in ns-oihey namespace. primary: ;secondary: mysql-uaeapw-mysql-0 mysql-uaeapw-mysql-1 No resources found in ns-oihey namespace. primary: ;secondary: mysql-uaeapw-mysql-0 mysql-uaeapw-mysql-1 No resources found in ns-oihey namespace. primary: ;secondary: mysql-uaeapw-mysql-0 mysql-uaeapw-mysql-1 No resources found in ns-oihey namespace. primary: ;secondary: mysql-uaeapw-mysql-0 mysql-uaeapw-mysql-1 No resources found in ns-oihey namespace. primary: ;secondary: mysql-uaeapw-mysql-0 mysql-uaeapw-mysql-1 No resources found in ns-oihey namespace. primary: ;secondary: mysql-uaeapw-mysql-0 mysql-uaeapw-mysql-1 No resources found in ns-oihey namespace. primary: ;secondary: mysql-uaeapw-mysql-0 mysql-uaeapw-mysql-1 No resources found in ns-oihey namespace. primary: ;secondary: mysql-uaeapw-mysql-0 mysql-uaeapw-mysql-1 No resources found in ns-oihey namespace. primary: ;secondary: mysql-uaeapw-mysql-0 mysql-uaeapw-mysql-1 No resources found in ns-oihey namespace. primary: ;secondary: mysql-uaeapw-mysql-0 mysql-uaeapw-mysql-1 No resources found in ns-oihey namespace. primary: ;secondary: mysql-uaeapw-mysql-0 mysql-uaeapw-mysql-1 No resources found in ns-oihey namespace. primary: ;secondary: mysql-uaeapw-mysql-0 mysql-uaeapw-mysql-1 No resources found in ns-oihey namespace. primary: ;secondary: mysql-uaeapw-mysql-0 mysql-uaeapw-mysql-1 No resources found in ns-oihey namespace. primary: ;secondary: mysql-uaeapw-mysql-0 mysql-uaeapw-mysql-1 No resources found in ns-oihey namespace. primary: ;secondary: mysql-uaeapw-mysql-0 mysql-uaeapw-mysql-1 No resources found in ns-oihey namespace. primary: ;secondary: mysql-uaeapw-mysql-0 mysql-uaeapw-mysql-1 check cluster role done primary: mysql-uaeapw-mysql-0;secondary: mysql-uaeapw-mysql-1 `kubectl get secrets -l app.kubernetes.io/instance=mysql-uaeapw` set secret: mysql-uaeapw-mysql-account-root `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:29FV699wpG;DB_PORT:3306;DB_DATABASE:mysql check cluster connect `echo " echo \"SHOW SLAVE STATUS\G;\" | mysql -P3306 -h127.0.0.1 -uroot -p'29FV699wpG' " | kubectl exec -it mysql-uaeapw-mysql-1 --namespace ns-oihey -- bash ` check cluster connect done check ops status `kbcli cluster list-ops mysql-uaeapw --status all --namespace ns-oihey ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME mysql-uaeapw-upgrade-cmpv-d9n2g ns-oihey Upgrade mysql-uaeapw mysql Succeed 2/2 Sep 12,2025 13:43 UTC+0800 check ops status done ops_status:mysql-uaeapw-upgrade-cmpv-d9n2g ns-oihey Upgrade mysql-uaeapw mysql Succeed 2/2 Sep 12,2025 13:43 UTC+0800 `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge opsrequests.operations mysql-uaeapw-upgrade-cmpv-d9n2g --namespace ns-oihey ` opsrequest.operations.kubeblocks.io/mysql-uaeapw-upgrade-cmpv-d9n2g patched `kbcli cluster delete-ops --name mysql-uaeapw-upgrade-cmpv-d9n2g --force --auto-approve --namespace ns-oihey ` OpsRequest mysql-uaeapw-upgrade-cmpv-d9n2g deleted `kubectl get secrets -l app.kubernetes.io/instance=mysql-uaeapw` set secret: mysql-uaeapw-mysql-account-root `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:29FV699wpG;DB_PORT:3306;DB_DATABASE:mysql check db_client batch data count `echo "echo \"select count(*) from executions_loop.executions_loop_table;\" | mysql -P3306 -hmysql-uaeapw-mysql.ns-oihey.svc.cluster.local -uroot -p'29FV699wpG' " | kubectl exec -it mysql-uaeapw-mysql-0 --namespace ns-oihey -- bash ` check db_client batch data Success `kubectl get secrets -l app.kubernetes.io/instance=mysql-uaeapw` set secret: mysql-uaeapw-mysql-account-root `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:29FV699wpG;DB_PORT:3306;DB_DATABASE:mysql check readonly db_client batch data count `echo "echo \"select count(*) from executions_loop.executions_loop_table;\" | mysql -P3306 -h127.0.0.1 -uroot -p'29FV699wpG' " | kubectl exec -it mysql-uaeapw-mysql-1 --namespace ns-oihey -- bash ` check readonly db_client batch data Success 8.0.32 is less than 8.0.33 upgrade from:8.0.32 to service version:8.0.33 cluster upgrade apiVersion: operations.kubeblocks.io/v1alpha1 kind: OpsRequest metadata: generateName: mysql-uaeapw-upgrade-cmpv- namespace: ns-oihey spec: clusterName: mysql-uaeapw upgrade: components: - componentName: mysql serviceVersion: 8.0.33 type: Upgrade check cluster status before ops check cluster status done cluster_status:Running `kubectl create -f test_ops_cluster_mysql-uaeapw.yaml` opsrequest.operations.kubeblocks.io/mysql-uaeapw-upgrade-cmpv-xwgst created create test_ops_cluster_mysql-uaeapw.yaml Success `rm -rf test_ops_cluster_mysql-uaeapw.yaml` check ops status `kbcli cluster list-ops mysql-uaeapw --status all --namespace ns-oihey ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME mysql-uaeapw-upgrade-cmpv-xwgst ns-oihey Upgrade mysql-uaeapw Creating -/- Sep 12,2025 13:45 UTC+0800 check cluster status `kbcli cluster list mysql-uaeapw --show-labels --namespace ns-oihey ` NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS mysql-uaeapw ns-oihey mysql Delete Updating Sep 12,2025 13:05 UTC+0800 app.kubernetes.io/instance=mysql-uaeapw,clusterdefinition.kubeblocks.io/name=mysql cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances mysql-uaeapw --namespace ns-oihey ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME mysql-uaeapw-mysql-0 ns-oihey mysql-uaeapw mysql Running secondary 0 200m / 200m 644245094400m / 644245094400m data:12Gi aks-cicdamdpool-13759654-vmss000002/10.224.0.6 Sep 12,2025 13:39 UTC+0800 mysql-uaeapw-mysql-1 ns-oihey mysql-uaeapw mysql Running secondary 0 200m / 200m 644245094400m / 644245094400m data:12Gi aks-cicdamdpool-13759654-vmss000001/10.224.0.7 Sep 12,2025 13:38 UTC+0800 check pod status done check cluster role No resources found in ns-oihey namespace. primary: ;secondary: mysql-uaeapw-mysql-0 mysql-uaeapw-mysql-1 No resources found in ns-oihey namespace. primary: ;secondary: mysql-uaeapw-mysql-0 mysql-uaeapw-mysql-1 No resources found in ns-oihey namespace. primary: ;secondary: mysql-uaeapw-mysql-0 mysql-uaeapw-mysql-1 No resources found in ns-oihey namespace. primary: ;secondary: mysql-uaeapw-mysql-0 mysql-uaeapw-mysql-1 No resources found in ns-oihey namespace. primary: ;secondary: mysql-uaeapw-mysql-0 mysql-uaeapw-mysql-1 No resources found in ns-oihey namespace. primary: ;secondary: mysql-uaeapw-mysql-0 mysql-uaeapw-mysql-1 No resources found in ns-oihey namespace. primary: ;secondary: mysql-uaeapw-mysql-0 mysql-uaeapw-mysql-1 No resources found in ns-oihey namespace. primary: ;secondary: mysql-uaeapw-mysql-0 mysql-uaeapw-mysql-1 No resources found in ns-oihey namespace. primary: ;secondary: mysql-uaeapw-mysql-0 mysql-uaeapw-mysql-1 No resources found in ns-oihey namespace. primary: ;secondary: mysql-uaeapw-mysql-0 mysql-uaeapw-mysql-1 No resources found in ns-oihey namespace. primary: ;secondary: mysql-uaeapw-mysql-0 mysql-uaeapw-mysql-1 No resources found in ns-oihey namespace. primary: ;secondary: mysql-uaeapw-mysql-0 mysql-uaeapw-mysql-1 No resources found in ns-oihey namespace. primary: ;secondary: mysql-uaeapw-mysql-0 mysql-uaeapw-mysql-1 No resources found in ns-oihey namespace. primary: ;secondary: mysql-uaeapw-mysql-0 mysql-uaeapw-mysql-1 No resources found in ns-oihey namespace. primary: ;secondary: mysql-uaeapw-mysql-0 mysql-uaeapw-mysql-1 No resources found in ns-oihey namespace. primary: ;secondary: mysql-uaeapw-mysql-0 mysql-uaeapw-mysql-1 No resources found in ns-oihey namespace. primary: ;secondary: mysql-uaeapw-mysql-0 mysql-uaeapw-mysql-1 No resources found in ns-oihey namespace. primary: ;secondary: mysql-uaeapw-mysql-0 mysql-uaeapw-mysql-1 No resources found in ns-oihey namespace. primary: ;secondary: mysql-uaeapw-mysql-0 mysql-uaeapw-mysql-1 No resources found in ns-oihey namespace. primary: ;secondary: mysql-uaeapw-mysql-0 mysql-uaeapw-mysql-1 check cluster role done primary: mysql-uaeapw-mysql-0;secondary: mysql-uaeapw-mysql-1 `kubectl get secrets -l app.kubernetes.io/instance=mysql-uaeapw` set secret: mysql-uaeapw-mysql-account-root `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:29FV699wpG;DB_PORT:3306;DB_DATABASE:mysql check cluster connect `echo " echo \"SHOW SLAVE STATUS\G;\" | mysql -P3306 -h127.0.0.1 -uroot -p'29FV699wpG' " | kubectl exec -it mysql-uaeapw-mysql-1 --namespace ns-oihey -- bash ` check cluster connect done check ops status `kbcli cluster list-ops mysql-uaeapw --status all --namespace ns-oihey ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME mysql-uaeapw-upgrade-cmpv-xwgst ns-oihey Upgrade mysql-uaeapw mysql Succeed 2/2 Sep 12,2025 13:45 UTC+0800 check ops status done ops_status:mysql-uaeapw-upgrade-cmpv-xwgst ns-oihey Upgrade mysql-uaeapw mysql Succeed 2/2 Sep 12,2025 13:45 UTC+0800 `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge opsrequests.operations mysql-uaeapw-upgrade-cmpv-xwgst --namespace ns-oihey ` opsrequest.operations.kubeblocks.io/mysql-uaeapw-upgrade-cmpv-xwgst patched `kbcli cluster delete-ops --name mysql-uaeapw-upgrade-cmpv-xwgst --force --auto-approve --namespace ns-oihey ` OpsRequest mysql-uaeapw-upgrade-cmpv-xwgst deleted `kubectl get secrets -l app.kubernetes.io/instance=mysql-uaeapw` set secret: mysql-uaeapw-mysql-account-root `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:29FV699wpG;DB_PORT:3306;DB_DATABASE:mysql check db_client batch data count `echo "echo \"select count(*) from executions_loop.executions_loop_table;\" | mysql -P3306 -hmysql-uaeapw-mysql.ns-oihey.svc.cluster.local -uroot -p'29FV699wpG' " | kubectl exec -it mysql-uaeapw-mysql-0 --namespace ns-oihey -- bash ` check db_client batch data Success `kubectl get secrets -l app.kubernetes.io/instance=mysql-uaeapw` set secret: mysql-uaeapw-mysql-account-root `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:29FV699wpG;DB_PORT:3306;DB_DATABASE:mysql check readonly db_client batch data count `echo "echo \"select count(*) from executions_loop.executions_loop_table;\" | mysql -P3306 -h127.0.0.1 -uroot -p'29FV699wpG' " | kubectl exec -it mysql-uaeapw-mysql-1 --namespace ns-oihey -- bash ` check readonly db_client batch data Success 8.0.33 is less than 8.0.34 upgrade from:8.0.33 to service version:8.0.34 cluster upgrade apiVersion: operations.kubeblocks.io/v1alpha1 kind: OpsRequest metadata: generateName: mysql-uaeapw-upgrade-cmpv- namespace: ns-oihey spec: clusterName: mysql-uaeapw upgrade: components: - componentName: mysql serviceVersion: 8.0.34 type: Upgrade check cluster status before ops check cluster status done cluster_status:Running `kubectl create -f test_ops_cluster_mysql-uaeapw.yaml` opsrequest.operations.kubeblocks.io/mysql-uaeapw-upgrade-cmpv-lffsp created create test_ops_cluster_mysql-uaeapw.yaml Success `rm -rf test_ops_cluster_mysql-uaeapw.yaml` check ops status `kbcli cluster list-ops mysql-uaeapw --status all --namespace ns-oihey ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME mysql-uaeapw-upgrade-cmpv-lffsp ns-oihey Upgrade mysql-uaeapw mysql Running 0/2 Sep 12,2025 13:46 UTC+0800 check cluster status `kbcli cluster list mysql-uaeapw --show-labels --namespace ns-oihey ` NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS mysql-uaeapw ns-oihey mysql Delete Updating Sep 12,2025 13:05 UTC+0800 app.kubernetes.io/instance=mysql-uaeapw,clusterdefinition.kubeblocks.io/name=mysql cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances mysql-uaeapw --namespace ns-oihey ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME mysql-uaeapw-mysql-0 ns-oihey mysql-uaeapw mysql Running secondary 0 200m / 200m 644245094400m / 644245094400m data:12Gi aks-cicdamdpool-13759654-vmss000002/10.224.0.6 Sep 12,2025 13:39 UTC+0800 mysql-uaeapw-mysql-1 ns-oihey mysql-uaeapw mysql Running secondary 0 200m / 200m 644245094400m / 644245094400m data:12Gi aks-cicdamdpool-13759654-vmss000001/10.224.0.7 Sep 12,2025 13:38 UTC+0800 check pod status done check cluster role No resources found in ns-oihey namespace. primary: ;secondary: mysql-uaeapw-mysql-0 mysql-uaeapw-mysql-1 No resources found in ns-oihey namespace. primary: ;secondary: mysql-uaeapw-mysql-0 mysql-uaeapw-mysql-1 No resources found in ns-oihey namespace. primary: ;secondary: mysql-uaeapw-mysql-0 mysql-uaeapw-mysql-1 No resources found in ns-oihey namespace. primary: ;secondary: mysql-uaeapw-mysql-0 mysql-uaeapw-mysql-1 No resources found in ns-oihey namespace. primary: ;secondary: mysql-uaeapw-mysql-0 mysql-uaeapw-mysql-1 No resources found in ns-oihey namespace. primary: ;secondary: mysql-uaeapw-mysql-0 mysql-uaeapw-mysql-1 No resources found in ns-oihey namespace. primary: ;secondary: mysql-uaeapw-mysql-0 mysql-uaeapw-mysql-1 No resources found in ns-oihey namespace. primary: ;secondary: mysql-uaeapw-mysql-0 mysql-uaeapw-mysql-1 No resources found in ns-oihey namespace. primary: ;secondary: mysql-uaeapw-mysql-0 mysql-uaeapw-mysql-1 No resources found in ns-oihey namespace. primary: ;secondary: mysql-uaeapw-mysql-0 mysql-uaeapw-mysql-1 No resources found in ns-oihey namespace. primary: ;secondary: mysql-uaeapw-mysql-0 mysql-uaeapw-mysql-1 No resources found in ns-oihey namespace. primary: ;secondary: mysql-uaeapw-mysql-0 mysql-uaeapw-mysql-1 No resources found in ns-oihey namespace. primary: ;secondary: mysql-uaeapw-mysql-0 mysql-uaeapw-mysql-1 No resources found in ns-oihey namespace. primary: ;secondary: mysql-uaeapw-mysql-0 mysql-uaeapw-mysql-1 No resources found in ns-oihey namespace. primary: ;secondary: mysql-uaeapw-mysql-0 mysql-uaeapw-mysql-1 No resources found in ns-oihey namespace. primary: ;secondary: mysql-uaeapw-mysql-0 mysql-uaeapw-mysql-1 No resources found in ns-oihey namespace. primary: ;secondary: mysql-uaeapw-mysql-0 mysql-uaeapw-mysql-1 No resources found in ns-oihey namespace. primary: ;secondary: mysql-uaeapw-mysql-0 mysql-uaeapw-mysql-1 No resources found in ns-oihey namespace. primary: ;secondary: mysql-uaeapw-mysql-0 mysql-uaeapw-mysql-1 check cluster role done primary: mysql-uaeapw-mysql-0;secondary: mysql-uaeapw-mysql-1 `kubectl get secrets -l app.kubernetes.io/instance=mysql-uaeapw` set secret: mysql-uaeapw-mysql-account-root `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:29FV699wpG;DB_PORT:3306;DB_DATABASE:mysql check cluster connect `echo " echo \"SHOW SLAVE STATUS\G;\" | mysql -P3306 -h127.0.0.1 -uroot -p'29FV699wpG' " | kubectl exec -it mysql-uaeapw-mysql-1 --namespace ns-oihey -- bash ` check cluster connect done check ops status `kbcli cluster list-ops mysql-uaeapw --status all --namespace ns-oihey ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME mysql-uaeapw-upgrade-cmpv-lffsp ns-oihey Upgrade mysql-uaeapw mysql Succeed 2/2 Sep 12,2025 13:46 UTC+0800 check ops status done ops_status:mysql-uaeapw-upgrade-cmpv-lffsp ns-oihey Upgrade mysql-uaeapw mysql Succeed 2/2 Sep 12,2025 13:46 UTC+0800 `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge opsrequests.operations mysql-uaeapw-upgrade-cmpv-lffsp --namespace ns-oihey ` opsrequest.operations.kubeblocks.io/mysql-uaeapw-upgrade-cmpv-lffsp patched `kbcli cluster delete-ops --name mysql-uaeapw-upgrade-cmpv-lffsp --force --auto-approve --namespace ns-oihey ` OpsRequest mysql-uaeapw-upgrade-cmpv-lffsp deleted `kubectl get secrets -l app.kubernetes.io/instance=mysql-uaeapw` set secret: mysql-uaeapw-mysql-account-root `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:29FV699wpG;DB_PORT:3306;DB_DATABASE:mysql check db_client batch data count `echo "echo \"select count(*) from executions_loop.executions_loop_table;\" | mysql -P3306 -hmysql-uaeapw-mysql.ns-oihey.svc.cluster.local -uroot -p'29FV699wpG' " | kubectl exec -it mysql-uaeapw-mysql-0 --namespace ns-oihey -- bash ` check db_client batch data Success `kubectl get secrets -l app.kubernetes.io/instance=mysql-uaeapw` set secret: mysql-uaeapw-mysql-account-root `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:29FV699wpG;DB_PORT:3306;DB_DATABASE:mysql check readonly db_client batch data count `echo "echo \"select count(*) from executions_loop.executions_loop_table;\" | mysql -P3306 -h127.0.0.1 -uroot -p'29FV699wpG' " | kubectl exec -it mysql-uaeapw-mysql-1 --namespace ns-oihey -- bash ` check readonly db_client batch data Success upgrade from:8.0.34 to service version:8.0.35 cluster upgrade apiVersion: operations.kubeblocks.io/v1alpha1 kind: OpsRequest metadata: generateName: mysql-uaeapw-upgrade-cmpv- namespace: ns-oihey spec: clusterName: mysql-uaeapw upgrade: components: - componentName: mysql serviceVersion: 8.0.35 type: Upgrade check cluster status before ops check cluster status done cluster_status:Running `kubectl create -f test_ops_cluster_mysql-uaeapw.yaml` opsrequest.operations.kubeblocks.io/mysql-uaeapw-upgrade-cmpv-ff5m9 created create test_ops_cluster_mysql-uaeapw.yaml Success `rm -rf test_ops_cluster_mysql-uaeapw.yaml` check ops status `kbcli cluster list-ops mysql-uaeapw --status all --namespace ns-oihey ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME mysql-uaeapw-upgrade-cmpv-ff5m9 ns-oihey Upgrade mysql-uaeapw mysql Running 0/2 Sep 12,2025 13:48 UTC+0800 check cluster status `kbcli cluster list mysql-uaeapw --show-labels --namespace ns-oihey ` NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS mysql-uaeapw ns-oihey mysql Delete Updating Sep 12,2025 13:05 UTC+0800 app.kubernetes.io/instance=mysql-uaeapw,clusterdefinition.kubeblocks.io/name=mysql cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances mysql-uaeapw --namespace ns-oihey ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME mysql-uaeapw-mysql-0 ns-oihey mysql-uaeapw mysql Running secondary 0 200m / 200m 644245094400m / 644245094400m data:12Gi aks-cicdamdpool-13759654-vmss000002/10.224.0.6 Sep 12,2025 13:39 UTC+0800 mysql-uaeapw-mysql-1 ns-oihey mysql-uaeapw mysql Running secondary 0 200m / 200m 644245094400m / 644245094400m data:12Gi aks-cicdamdpool-13759654-vmss000001/10.224.0.7 Sep 12,2025 13:38 UTC+0800 check pod status done check cluster role No resources found in ns-oihey namespace. primary: ;secondary: mysql-uaeapw-mysql-0 mysql-uaeapw-mysql-1 No resources found in ns-oihey namespace. primary: ;secondary: mysql-uaeapw-mysql-0 mysql-uaeapw-mysql-1 No resources found in ns-oihey namespace. primary: ;secondary: mysql-uaeapw-mysql-0 mysql-uaeapw-mysql-1 No resources found in ns-oihey namespace. primary: ;secondary: mysql-uaeapw-mysql-0 mysql-uaeapw-mysql-1 No resources found in ns-oihey namespace. primary: ;secondary: mysql-uaeapw-mysql-0 mysql-uaeapw-mysql-1 No resources found in ns-oihey namespace. primary: ;secondary: mysql-uaeapw-mysql-0 mysql-uaeapw-mysql-1 No resources found in ns-oihey namespace. primary: ;secondary: mysql-uaeapw-mysql-0 mysql-uaeapw-mysql-1 No resources found in ns-oihey namespace. primary: ;secondary: mysql-uaeapw-mysql-0 mysql-uaeapw-mysql-1 No resources found in ns-oihey namespace. primary: ;secondary: mysql-uaeapw-mysql-0 mysql-uaeapw-mysql-1 No resources found in ns-oihey namespace. primary: ;secondary: mysql-uaeapw-mysql-0 mysql-uaeapw-mysql-1 No resources found in ns-oihey namespace. primary: ;secondary: mysql-uaeapw-mysql-0 mysql-uaeapw-mysql-1 No resources found in ns-oihey namespace. primary: ;secondary: mysql-uaeapw-mysql-0 mysql-uaeapw-mysql-1 No resources found in ns-oihey namespace. primary: ;secondary: mysql-uaeapw-mysql-0 mysql-uaeapw-mysql-1 No resources found in ns-oihey namespace. primary: ;secondary: mysql-uaeapw-mysql-0 mysql-uaeapw-mysql-1 No resources found in ns-oihey namespace. primary: ;secondary: mysql-uaeapw-mysql-0 mysql-uaeapw-mysql-1 No resources found in ns-oihey namespace. primary: ;secondary: mysql-uaeapw-mysql-0 mysql-uaeapw-mysql-1 No resources found in ns-oihey namespace. primary: ;secondary: mysql-uaeapw-mysql-0 mysql-uaeapw-mysql-1 No resources found in ns-oihey namespace. primary: ;secondary: mysql-uaeapw-mysql-0 mysql-uaeapw-mysql-1 No resources found in ns-oihey namespace. primary: ;secondary: mysql-uaeapw-mysql-0 mysql-uaeapw-mysql-1 check cluster role done primary: mysql-uaeapw-mysql-0;secondary: mysql-uaeapw-mysql-1 `kubectl get secrets -l app.kubernetes.io/instance=mysql-uaeapw` set secret: mysql-uaeapw-mysql-account-root `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:29FV699wpG;DB_PORT:3306;DB_DATABASE:mysql check cluster connect `echo " echo \"SHOW SLAVE STATUS\G;\" | mysql -P3306 -h127.0.0.1 -uroot -p'29FV699wpG' " | kubectl exec -it mysql-uaeapw-mysql-1 --namespace ns-oihey -- bash ` check cluster connect done check ops status `kbcli cluster list-ops mysql-uaeapw --status all --namespace ns-oihey ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME mysql-uaeapw-upgrade-cmpv-ff5m9 ns-oihey Upgrade mysql-uaeapw mysql Succeed 2/2 Sep 12,2025 13:48 UTC+0800 check ops status done ops_status:mysql-uaeapw-upgrade-cmpv-ff5m9 ns-oihey Upgrade mysql-uaeapw mysql Succeed 2/2 Sep 12,2025 13:48 UTC+0800 `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge opsrequests.operations mysql-uaeapw-upgrade-cmpv-ff5m9 --namespace ns-oihey ` opsrequest.operations.kubeblocks.io/mysql-uaeapw-upgrade-cmpv-ff5m9 patched `kbcli cluster delete-ops --name mysql-uaeapw-upgrade-cmpv-ff5m9 --force --auto-approve --namespace ns-oihey ` OpsRequest mysql-uaeapw-upgrade-cmpv-ff5m9 deleted `kubectl get secrets -l app.kubernetes.io/instance=mysql-uaeapw` set secret: mysql-uaeapw-mysql-account-root `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:29FV699wpG;DB_PORT:3306;DB_DATABASE:mysql check db_client batch data count `echo "echo \"select count(*) from executions_loop.executions_loop_table;\" | mysql -P3306 -hmysql-uaeapw-mysql.ns-oihey.svc.cluster.local -uroot -p'29FV699wpG' " | kubectl exec -it mysql-uaeapw-mysql-0 --namespace ns-oihey -- bash ` check db_client batch data Success `kubectl get secrets -l app.kubernetes.io/instance=mysql-uaeapw` set secret: mysql-uaeapw-mysql-account-root `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:29FV699wpG;DB_PORT:3306;DB_DATABASE:mysql check readonly db_client batch data count `echo "echo \"select count(*) from executions_loop.executions_loop_table;\" | mysql -P3306 -h127.0.0.1 -uroot -p'29FV699wpG' " | kubectl exec -it mysql-uaeapw-mysql-1 --namespace ns-oihey -- bash ` check readonly db_client batch data Success upgrade from:8.0.35 to service version:8.0.39 cluster upgrade apiVersion: operations.kubeblocks.io/v1alpha1 kind: OpsRequest metadata: generateName: mysql-uaeapw-upgrade-cmpv- namespace: ns-oihey spec: clusterName: mysql-uaeapw upgrade: components: - componentName: mysql serviceVersion: 8.0.39 type: Upgrade check cluster status before ops check cluster status done cluster_status:Running `kubectl create -f test_ops_cluster_mysql-uaeapw.yaml` opsrequest.operations.kubeblocks.io/mysql-uaeapw-upgrade-cmpv-q2xnl created create test_ops_cluster_mysql-uaeapw.yaml Success `rm -rf test_ops_cluster_mysql-uaeapw.yaml` check ops status `kbcli cluster list-ops mysql-uaeapw --status all --namespace ns-oihey ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME mysql-uaeapw-upgrade-cmpv-q2xnl ns-oihey Upgrade mysql-uaeapw Creating -/- Sep 12,2025 13:49 UTC+0800 check cluster status `kbcli cluster list mysql-uaeapw --show-labels --namespace ns-oihey ` NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS mysql-uaeapw ns-oihey mysql Delete Updating Sep 12,2025 13:05 UTC+0800 app.kubernetes.io/instance=mysql-uaeapw,clusterdefinition.kubeblocks.io/name=mysql cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances mysql-uaeapw --namespace ns-oihey ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME mysql-uaeapw-mysql-0 ns-oihey mysql-uaeapw mysql Running secondary 0 200m / 200m 644245094400m / 644245094400m data:12Gi aks-cicdamdpool-13759654-vmss000002/10.224.0.6 Sep 12,2025 13:39 UTC+0800 mysql-uaeapw-mysql-1 ns-oihey mysql-uaeapw mysql Running secondary 0 200m / 200m 644245094400m / 644245094400m data:12Gi aks-cicdamdpool-13759654-vmss000001/10.224.0.7 Sep 12,2025 13:38 UTC+0800 check pod status done check cluster role No resources found in ns-oihey namespace. primary: ;secondary: mysql-uaeapw-mysql-0 mysql-uaeapw-mysql-1 No resources found in ns-oihey namespace. primary: ;secondary: mysql-uaeapw-mysql-0 mysql-uaeapw-mysql-1 No resources found in ns-oihey namespace. primary: ;secondary: mysql-uaeapw-mysql-0 mysql-uaeapw-mysql-1 No resources found in ns-oihey namespace. primary: ;secondary: mysql-uaeapw-mysql-0 mysql-uaeapw-mysql-1 No resources found in ns-oihey namespace. primary: ;secondary: mysql-uaeapw-mysql-0 mysql-uaeapw-mysql-1 No resources found in ns-oihey namespace. primary: ;secondary: mysql-uaeapw-mysql-0 mysql-uaeapw-mysql-1 No resources found in ns-oihey namespace. primary: ;secondary: mysql-uaeapw-mysql-0 mysql-uaeapw-mysql-1 No resources found in ns-oihey namespace. primary: ;secondary: mysql-uaeapw-mysql-0 mysql-uaeapw-mysql-1 No resources found in ns-oihey namespace. primary: ;secondary: mysql-uaeapw-mysql-0 mysql-uaeapw-mysql-1 No resources found in ns-oihey namespace. primary: ;secondary: mysql-uaeapw-mysql-0 mysql-uaeapw-mysql-1 No resources found in ns-oihey namespace. primary: ;secondary: mysql-uaeapw-mysql-0 mysql-uaeapw-mysql-1 No resources found in ns-oihey namespace. primary: ;secondary: mysql-uaeapw-mysql-0 mysql-uaeapw-mysql-1 No resources found in ns-oihey namespace. primary: ;secondary: mysql-uaeapw-mysql-0 mysql-uaeapw-mysql-1 No resources found in ns-oihey namespace. primary: ;secondary: mysql-uaeapw-mysql-0 mysql-uaeapw-mysql-1 No resources found in ns-oihey namespace. primary: ;secondary: mysql-uaeapw-mysql-0 mysql-uaeapw-mysql-1 No resources found in ns-oihey namespace. primary: ;secondary: mysql-uaeapw-mysql-0 mysql-uaeapw-mysql-1 No resources found in ns-oihey namespace. primary: ;secondary: mysql-uaeapw-mysql-0 mysql-uaeapw-mysql-1 check cluster role done primary: mysql-uaeapw-mysql-0;secondary: mysql-uaeapw-mysql-1 `kubectl get secrets -l app.kubernetes.io/instance=mysql-uaeapw` set secret: mysql-uaeapw-mysql-account-root `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:29FV699wpG;DB_PORT:3306;DB_DATABASE:mysql check cluster connect `echo " echo \"SHOW SLAVE STATUS\G;\" | mysql -P3306 -h127.0.0.1 -uroot -p'29FV699wpG' " | kubectl exec -it mysql-uaeapw-mysql-1 --namespace ns-oihey -- bash ` check cluster connect done check ops status `kbcli cluster list-ops mysql-uaeapw --status all --namespace ns-oihey ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME mysql-uaeapw-upgrade-cmpv-q2xnl ns-oihey Upgrade mysql-uaeapw mysql Succeed 2/2 Sep 12,2025 13:49 UTC+0800 check ops status done ops_status:mysql-uaeapw-upgrade-cmpv-q2xnl ns-oihey Upgrade mysql-uaeapw mysql Succeed 2/2 Sep 12,2025 13:49 UTC+0800 `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge opsrequests.operations mysql-uaeapw-upgrade-cmpv-q2xnl --namespace ns-oihey ` opsrequest.operations.kubeblocks.io/mysql-uaeapw-upgrade-cmpv-q2xnl patched `kbcli cluster delete-ops --name mysql-uaeapw-upgrade-cmpv-q2xnl --force --auto-approve --namespace ns-oihey ` OpsRequest mysql-uaeapw-upgrade-cmpv-q2xnl deleted `kubectl get secrets -l app.kubernetes.io/instance=mysql-uaeapw` set secret: mysql-uaeapw-mysql-account-root `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:29FV699wpG;DB_PORT:3306;DB_DATABASE:mysql check db_client batch data count `echo "echo \"select count(*) from executions_loop.executions_loop_table;\" | mysql -P3306 -hmysql-uaeapw-mysql.ns-oihey.svc.cluster.local -uroot -p'29FV699wpG' " | kubectl exec -it mysql-uaeapw-mysql-0 --namespace ns-oihey -- bash ` check db_client batch data Success `kubectl get secrets -l app.kubernetes.io/instance=mysql-uaeapw` set secret: mysql-uaeapw-mysql-account-root `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:29FV699wpG;DB_PORT:3306;DB_DATABASE:mysql check readonly db_client batch data count `echo "echo \"select count(*) from executions_loop.executions_loop_table;\" | mysql -P3306 -h127.0.0.1 -uroot -p'29FV699wpG' " | kubectl exec -it mysql-uaeapw-mysql-1 --namespace ns-oihey -- bash ` check readonly db_client batch data Success downgrade from:8.0.39 to service version:8.0.35 cluster upgrade apiVersion: operations.kubeblocks.io/v1alpha1 kind: OpsRequest metadata: generateName: mysql-uaeapw-upgrade-cmpv- namespace: ns-oihey spec: clusterName: mysql-uaeapw upgrade: components: - componentName: mysql serviceVersion: 8.0.35 type: Upgrade check cluster status before ops check cluster status done cluster_status:Running `kubectl create -f test_ops_cluster_mysql-uaeapw.yaml` opsrequest.operations.kubeblocks.io/mysql-uaeapw-upgrade-cmpv-7bhq6 created create test_ops_cluster_mysql-uaeapw.yaml Success `rm -rf test_ops_cluster_mysql-uaeapw.yaml` check ops status `kbcli cluster list-ops mysql-uaeapw --status all --namespace ns-oihey ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME mysql-uaeapw-upgrade-cmpv-7bhq6 ns-oihey Upgrade mysql-uaeapw Running -/- Sep 12,2025 13:51 UTC+0800 check cluster status `kbcli cluster list mysql-uaeapw --show-labels --namespace ns-oihey ` NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS mysql-uaeapw ns-oihey mysql Delete Updating Sep 12,2025 13:05 UTC+0800 app.kubernetes.io/instance=mysql-uaeapw,clusterdefinition.kubeblocks.io/name=mysql cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances mysql-uaeapw --namespace ns-oihey ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME mysql-uaeapw-mysql-0 ns-oihey mysql-uaeapw mysql Running secondary 0 200m / 200m 644245094400m / 644245094400m data:12Gi aks-cicdamdpool-13759654-vmss000002/10.224.0.6 Sep 12,2025 13:39 UTC+0800 mysql-uaeapw-mysql-1 ns-oihey mysql-uaeapw mysql Running primary 0 200m / 200m 644245094400m / 644245094400m data:12Gi aks-cicdamdpool-13759654-vmss000001/10.224.0.7 Sep 12,2025 13:38 UTC+0800 check pod status done check cluster role check cluster role done primary: mysql-uaeapw-mysql-1;secondary: mysql-uaeapw-mysql-0 `kubectl get secrets -l app.kubernetes.io/instance=mysql-uaeapw` set secret: mysql-uaeapw-mysql-account-root `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:29FV699wpG;DB_PORT:3306;DB_DATABASE:mysql check cluster connect `echo " echo \"SHOW SLAVE STATUS\G;\" | mysql -P3306 -h127.0.0.1 -uroot -p'29FV699wpG' " | kubectl exec -it mysql-uaeapw-mysql-0 --namespace ns-oihey -- bash ` connect checking... check cluster connect done check ops status `kbcli cluster list-ops mysql-uaeapw --status all --namespace ns-oihey ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME mysql-uaeapw-upgrade-cmpv-7bhq6 ns-oihey Upgrade mysql-uaeapw mysql Succeed 2/2 Sep 12,2025 13:51 UTC+0800 check ops status done ops_status:mysql-uaeapw-upgrade-cmpv-7bhq6 ns-oihey Upgrade mysql-uaeapw mysql Succeed 2/2 Sep 12,2025 13:51 UTC+0800 `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge opsrequests.operations mysql-uaeapw-upgrade-cmpv-7bhq6 --namespace ns-oihey ` opsrequest.operations.kubeblocks.io/mysql-uaeapw-upgrade-cmpv-7bhq6 patched `kbcli cluster delete-ops --name mysql-uaeapw-upgrade-cmpv-7bhq6 --force --auto-approve --namespace ns-oihey ` OpsRequest mysql-uaeapw-upgrade-cmpv-7bhq6 deleted `kubectl get secrets -l app.kubernetes.io/instance=mysql-uaeapw` set secret: mysql-uaeapw-mysql-account-root `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:29FV699wpG;DB_PORT:3306;DB_DATABASE:mysql check db_client batch data count `echo "echo \"select count(*) from executions_loop.executions_loop_table;\" | mysql -P3306 -hmysql-uaeapw-mysql.ns-oihey.svc.cluster.local -uroot -p'29FV699wpG' " | kubectl exec -it mysql-uaeapw-mysql-1 --namespace ns-oihey -- bash ` check db_client batch data Success `kubectl get secrets -l app.kubernetes.io/instance=mysql-uaeapw` set secret: mysql-uaeapw-mysql-account-root `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:29FV699wpG;DB_PORT:3306;DB_DATABASE:mysql check readonly db_client batch data count `echo "echo \"select count(*) from executions_loop.executions_loop_table;\" | mysql -P3306 -h127.0.0.1 -uroot -p'29FV699wpG' " | kubectl exec -it mysql-uaeapw-mysql-0 --namespace ns-oihey -- bash ` check readonly db_client batch data Success upgrade from:8.0.35 to service version:8.0.36 cluster upgrade apiVersion: operations.kubeblocks.io/v1alpha1 kind: OpsRequest metadata: generateName: mysql-uaeapw-upgrade-cmpv- namespace: ns-oihey spec: clusterName: mysql-uaeapw upgrade: components: - componentName: mysql serviceVersion: 8.0.36 type: Upgrade check cluster status before ops check cluster status done cluster_status:Running `kubectl create -f test_ops_cluster_mysql-uaeapw.yaml` opsrequest.operations.kubeblocks.io/mysql-uaeapw-upgrade-cmpv-9tjrh created create test_ops_cluster_mysql-uaeapw.yaml Success `rm -rf test_ops_cluster_mysql-uaeapw.yaml` check ops status `kbcli cluster list-ops mysql-uaeapw --status all --namespace ns-oihey ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME mysql-uaeapw-upgrade-cmpv-9tjrh ns-oihey Upgrade mysql-uaeapw Running -/- Sep 12,2025 13:52 UTC+0800 check cluster status `kbcli cluster list mysql-uaeapw --show-labels --namespace ns-oihey ` NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS mysql-uaeapw ns-oihey mysql Delete Updating Sep 12,2025 13:05 UTC+0800 app.kubernetes.io/instance=mysql-uaeapw,clusterdefinition.kubeblocks.io/name=mysql cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances mysql-uaeapw --namespace ns-oihey ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME mysql-uaeapw-mysql-0 ns-oihey mysql-uaeapw mysql Running secondary 0 200m / 200m 644245094400m / 644245094400m data:12Gi aks-cicdamdpool-13759654-vmss000002/10.224.0.6 Sep 12,2025 13:39 UTC+0800 mysql-uaeapw-mysql-1 ns-oihey mysql-uaeapw mysql Running secondary 0 200m / 200m 644245094400m / 644245094400m data:12Gi aks-cicdamdpool-13759654-vmss000001/10.224.0.7 Sep 12,2025 13:38 UTC+0800 check pod status done check cluster role No resources found in ns-oihey namespace. primary: ;secondary: mysql-uaeapw-mysql-0 mysql-uaeapw-mysql-1 No resources found in ns-oihey namespace. primary: ;secondary: mysql-uaeapw-mysql-0 mysql-uaeapw-mysql-1 No resources found in ns-oihey namespace. primary: ;secondary: mysql-uaeapw-mysql-0 mysql-uaeapw-mysql-1 No resources found in ns-oihey namespace. primary: ;secondary: mysql-uaeapw-mysql-0 mysql-uaeapw-mysql-1 No resources found in ns-oihey namespace. primary: ;secondary: mysql-uaeapw-mysql-0 mysql-uaeapw-mysql-1 No resources found in ns-oihey namespace. primary: ;secondary: mysql-uaeapw-mysql-0 mysql-uaeapw-mysql-1 No resources found in ns-oihey namespace. primary: ;secondary: mysql-uaeapw-mysql-0 mysql-uaeapw-mysql-1 No resources found in ns-oihey namespace. primary: ;secondary: mysql-uaeapw-mysql-0 mysql-uaeapw-mysql-1 No resources found in ns-oihey namespace. primary: ;secondary: mysql-uaeapw-mysql-0 mysql-uaeapw-mysql-1 No resources found in ns-oihey namespace. primary: ;secondary: mysql-uaeapw-mysql-0 mysql-uaeapw-mysql-1 No resources found in ns-oihey namespace. primary: ;secondary: mysql-uaeapw-mysql-0 mysql-uaeapw-mysql-1 No resources found in ns-oihey namespace. primary: ;secondary: mysql-uaeapw-mysql-0 mysql-uaeapw-mysql-1 No resources found in ns-oihey namespace. primary: ;secondary: mysql-uaeapw-mysql-0 mysql-uaeapw-mysql-1 No resources found in ns-oihey namespace. primary: ;secondary: mysql-uaeapw-mysql-0 mysql-uaeapw-mysql-1 No resources found in ns-oihey namespace. primary: ;secondary: mysql-uaeapw-mysql-0 mysql-uaeapw-mysql-1 No resources found in ns-oihey namespace. primary: ;secondary: mysql-uaeapw-mysql-0 mysql-uaeapw-mysql-1 No resources found in ns-oihey namespace. primary: ;secondary: mysql-uaeapw-mysql-0 mysql-uaeapw-mysql-1 No resources found in ns-oihey namespace. primary: ;secondary: mysql-uaeapw-mysql-0 mysql-uaeapw-mysql-1 No resources found in ns-oihey namespace. primary: ;secondary: mysql-uaeapw-mysql-0 mysql-uaeapw-mysql-1 No resources found in ns-oihey namespace. primary: ;secondary: mysql-uaeapw-mysql-0 mysql-uaeapw-mysql-1 No resources found in ns-oihey namespace. primary: ;secondary: mysql-uaeapw-mysql-0 mysql-uaeapw-mysql-1 check cluster role done primary: mysql-uaeapw-mysql-1;secondary: mysql-uaeapw-mysql-0 `kubectl get secrets -l app.kubernetes.io/instance=mysql-uaeapw` set secret: mysql-uaeapw-mysql-account-root `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:29FV699wpG;DB_PORT:3306;DB_DATABASE:mysql check cluster connect `echo " echo \"SHOW SLAVE STATUS\G;\" | mysql -P3306 -h127.0.0.1 -uroot -p'29FV699wpG' " | kubectl exec -it mysql-uaeapw-mysql-0 --namespace ns-oihey -- bash ` check cluster connect done check ops status `kbcli cluster list-ops mysql-uaeapw --status all --namespace ns-oihey ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME mysql-uaeapw-upgrade-cmpv-9tjrh ns-oihey Upgrade mysql-uaeapw mysql Succeed 2/2 Sep 12,2025 13:52 UTC+0800 check ops status done ops_status:mysql-uaeapw-upgrade-cmpv-9tjrh ns-oihey Upgrade mysql-uaeapw mysql Succeed 2/2 Sep 12,2025 13:52 UTC+0800 `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge opsrequests.operations mysql-uaeapw-upgrade-cmpv-9tjrh --namespace ns-oihey ` opsrequest.operations.kubeblocks.io/mysql-uaeapw-upgrade-cmpv-9tjrh patched `kbcli cluster delete-ops --name mysql-uaeapw-upgrade-cmpv-9tjrh --force --auto-approve --namespace ns-oihey ` OpsRequest mysql-uaeapw-upgrade-cmpv-9tjrh deleted `kubectl get secrets -l app.kubernetes.io/instance=mysql-uaeapw` set secret: mysql-uaeapw-mysql-account-root `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:29FV699wpG;DB_PORT:3306;DB_DATABASE:mysql check db_client batch data count `echo "echo \"select count(*) from executions_loop.executions_loop_table;\" | mysql -P3306 -hmysql-uaeapw-mysql.ns-oihey.svc.cluster.local -uroot -p'29FV699wpG' " | kubectl exec -it mysql-uaeapw-mysql-1 --namespace ns-oihey -- bash ` check db_client batch data Success `kubectl get secrets -l app.kubernetes.io/instance=mysql-uaeapw` set secret: mysql-uaeapw-mysql-account-root `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:29FV699wpG;DB_PORT:3306;DB_DATABASE:mysql check readonly db_client batch data count `echo "echo \"select count(*) from executions_loop.executions_loop_table;\" | mysql -P3306 -h127.0.0.1 -uroot -p'29FV699wpG' " | kubectl exec -it mysql-uaeapw-mysql-0 --namespace ns-oihey -- bash ` check readonly db_client batch data Success upgrade from:8.0.36 to service version:8.0.39 cluster upgrade apiVersion: operations.kubeblocks.io/v1alpha1 kind: OpsRequest metadata: generateName: mysql-uaeapw-upgrade-cmpv- namespace: ns-oihey spec: clusterName: mysql-uaeapw upgrade: components: - componentName: mysql serviceVersion: 8.0.39 type: Upgrade check cluster status before ops check cluster status done cluster_status:Running `kubectl create -f test_ops_cluster_mysql-uaeapw.yaml` opsrequest.operations.kubeblocks.io/mysql-uaeapw-upgrade-cmpv-ds7kf created create test_ops_cluster_mysql-uaeapw.yaml Success `rm -rf test_ops_cluster_mysql-uaeapw.yaml` check ops status `kbcli cluster list-ops mysql-uaeapw --status all --namespace ns-oihey ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME mysql-uaeapw-upgrade-cmpv-ds7kf ns-oihey Upgrade mysql-uaeapw Running -/- Sep 12,2025 13:53 UTC+0800 check cluster status `kbcli cluster list mysql-uaeapw --show-labels --namespace ns-oihey ` NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS mysql-uaeapw ns-oihey mysql Delete Updating Sep 12,2025 13:05 UTC+0800 app.kubernetes.io/instance=mysql-uaeapw,clusterdefinition.kubeblocks.io/name=mysql cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances mysql-uaeapw --namespace ns-oihey ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME mysql-uaeapw-mysql-0 ns-oihey mysql-uaeapw mysql Running secondary 0 200m / 200m 644245094400m / 644245094400m data:12Gi aks-cicdamdpool-13759654-vmss000002/10.224.0.6 Sep 12,2025 13:39 UTC+0800 mysql-uaeapw-mysql-1 ns-oihey mysql-uaeapw mysql Running secondary 0 200m / 200m 644245094400m / 644245094400m data:12Gi aks-cicdamdpool-13759654-vmss000001/10.224.0.7 Sep 12,2025 13:38 UTC+0800 check pod status done check cluster role No resources found in ns-oihey namespace. primary: ;secondary: mysql-uaeapw-mysql-0 mysql-uaeapw-mysql-1 No resources found in ns-oihey namespace. primary: ;secondary: mysql-uaeapw-mysql-0 mysql-uaeapw-mysql-1 No resources found in ns-oihey namespace. primary: ;secondary: mysql-uaeapw-mysql-0 mysql-uaeapw-mysql-1 No resources found in ns-oihey namespace. primary: ;secondary: mysql-uaeapw-mysql-0 mysql-uaeapw-mysql-1 No resources found in ns-oihey namespace. primary: ;secondary: mysql-uaeapw-mysql-0 mysql-uaeapw-mysql-1 No resources found in ns-oihey namespace. primary: ;secondary: mysql-uaeapw-mysql-0 mysql-uaeapw-mysql-1 No resources found in ns-oihey namespace. primary: ;secondary: mysql-uaeapw-mysql-0 mysql-uaeapw-mysql-1 No resources found in ns-oihey namespace. primary: ;secondary: mysql-uaeapw-mysql-0 mysql-uaeapw-mysql-1 No resources found in ns-oihey namespace. primary: ;secondary: mysql-uaeapw-mysql-0 mysql-uaeapw-mysql-1 No resources found in ns-oihey namespace. primary: ;secondary: mysql-uaeapw-mysql-0 mysql-uaeapw-mysql-1 No resources found in ns-oihey namespace. primary: ;secondary: mysql-uaeapw-mysql-0 mysql-uaeapw-mysql-1 No resources found in ns-oihey namespace. primary: ;secondary: mysql-uaeapw-mysql-0 mysql-uaeapw-mysql-1 No resources found in ns-oihey namespace. primary: ;secondary: mysql-uaeapw-mysql-0 mysql-uaeapw-mysql-1 No resources found in ns-oihey namespace. primary: ;secondary: mysql-uaeapw-mysql-0 mysql-uaeapw-mysql-1 No resources found in ns-oihey namespace. primary: ;secondary: mysql-uaeapw-mysql-0 mysql-uaeapw-mysql-1 No resources found in ns-oihey namespace. primary: ;secondary: mysql-uaeapw-mysql-0 mysql-uaeapw-mysql-1 No resources found in ns-oihey namespace. primary: ;secondary: mysql-uaeapw-mysql-0 check cluster role done primary: mysql-uaeapw-mysql-1;secondary: mysql-uaeapw-mysql-0 `kubectl get secrets -l app.kubernetes.io/instance=mysql-uaeapw` set secret: mysql-uaeapw-mysql-account-root `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:29FV699wpG;DB_PORT:3306;DB_DATABASE:mysql check cluster connect `echo " echo \"SHOW SLAVE STATUS\G;\" | mysql -P3306 -h127.0.0.1 -uroot -p'29FV699wpG' " | kubectl exec -it mysql-uaeapw-mysql-0 --namespace ns-oihey -- bash ` check cluster connect done check ops status `kbcli cluster list-ops mysql-uaeapw --status all --namespace ns-oihey ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME mysql-uaeapw-upgrade-cmpv-ds7kf ns-oihey Upgrade mysql-uaeapw mysql Succeed 2/2 Sep 12,2025 13:53 UTC+0800 check ops status done ops_status:mysql-uaeapw-upgrade-cmpv-ds7kf ns-oihey Upgrade mysql-uaeapw mysql Succeed 2/2 Sep 12,2025 13:53 UTC+0800 `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge opsrequests.operations mysql-uaeapw-upgrade-cmpv-ds7kf --namespace ns-oihey ` opsrequest.operations.kubeblocks.io/mysql-uaeapw-upgrade-cmpv-ds7kf patched `kbcli cluster delete-ops --name mysql-uaeapw-upgrade-cmpv-ds7kf --force --auto-approve --namespace ns-oihey ` OpsRequest mysql-uaeapw-upgrade-cmpv-ds7kf deleted `kubectl get secrets -l app.kubernetes.io/instance=mysql-uaeapw` set secret: mysql-uaeapw-mysql-account-root `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:29FV699wpG;DB_PORT:3306;DB_DATABASE:mysql check db_client batch data count `echo "echo \"select count(*) from executions_loop.executions_loop_table;\" | mysql -P3306 -hmysql-uaeapw-mysql.ns-oihey.svc.cluster.local -uroot -p'29FV699wpG' " | kubectl exec -it mysql-uaeapw-mysql-1 --namespace ns-oihey -- bash ` check db_client batch data Success `kubectl get secrets -l app.kubernetes.io/instance=mysql-uaeapw` set secret: mysql-uaeapw-mysql-account-root `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:29FV699wpG;DB_PORT:3306;DB_DATABASE:mysql check readonly db_client batch data count `echo "echo \"select count(*) from executions_loop.executions_loop_table;\" | mysql -P3306 -h127.0.0.1 -uroot -p'29FV699wpG' " | kubectl exec -it mysql-uaeapw-mysql-0 --namespace ns-oihey -- bash ` check readonly db_client batch data Success downgrade from:8.0.39 to service version:8.0.36 cluster upgrade apiVersion: operations.kubeblocks.io/v1alpha1 kind: OpsRequest metadata: generateName: mysql-uaeapw-upgrade-cmpv- namespace: ns-oihey spec: clusterName: mysql-uaeapw upgrade: components: - componentName: mysql serviceVersion: 8.0.36 type: Upgrade check cluster status before ops check cluster status done cluster_status:Running `kubectl create -f test_ops_cluster_mysql-uaeapw.yaml` opsrequest.operations.kubeblocks.io/mysql-uaeapw-upgrade-cmpv-jbgkr created create test_ops_cluster_mysql-uaeapw.yaml Success `rm -rf test_ops_cluster_mysql-uaeapw.yaml` check ops status `kbcli cluster list-ops mysql-uaeapw --status all --namespace ns-oihey ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME mysql-uaeapw-upgrade-cmpv-jbgkr ns-oihey Upgrade mysql-uaeapw Creating -/- Sep 12,2025 13:54 UTC+0800 check cluster status `kbcli cluster list mysql-uaeapw --show-labels --namespace ns-oihey ` NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS mysql-uaeapw ns-oihey mysql Delete Updating Sep 12,2025 13:05 UTC+0800 app.kubernetes.io/instance=mysql-uaeapw,clusterdefinition.kubeblocks.io/name=mysql cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances mysql-uaeapw --namespace ns-oihey ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME mysql-uaeapw-mysql-0 ns-oihey mysql-uaeapw mysql Running primary 0 200m / 200m 644245094400m / 644245094400m data:12Gi aks-cicdamdpool-13759654-vmss000002/10.224.0.6 Sep 12,2025 13:39 UTC+0800 mysql-uaeapw-mysql-1 ns-oihey mysql-uaeapw mysql Running secondary 0 200m / 200m 644245094400m / 644245094400m data:12Gi aks-cicdamdpool-13759654-vmss000001/10.224.0.7 Sep 12,2025 13:38 UTC+0800 check pod status done check cluster role check cluster role done primary: mysql-uaeapw-mysql-0;secondary: mysql-uaeapw-mysql-1 `kubectl get secrets -l app.kubernetes.io/instance=mysql-uaeapw` set secret: mysql-uaeapw-mysql-account-root `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:29FV699wpG;DB_PORT:3306;DB_DATABASE:mysql check cluster connect `echo " echo \"SHOW SLAVE STATUS\G;\" | mysql -P3306 -h127.0.0.1 -uroot -p'29FV699wpG' " | kubectl exec -it mysql-uaeapw-mysql-1 --namespace ns-oihey -- bash ` check cluster connect done check ops status `kbcli cluster list-ops mysql-uaeapw --status all --namespace ns-oihey ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME mysql-uaeapw-upgrade-cmpv-jbgkr ns-oihey Upgrade mysql-uaeapw mysql Succeed 2/2 Sep 12,2025 13:54 UTC+0800 check ops status done ops_status:mysql-uaeapw-upgrade-cmpv-jbgkr ns-oihey Upgrade mysql-uaeapw mysql Succeed 2/2 Sep 12,2025 13:54 UTC+0800 `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge opsrequests.operations mysql-uaeapw-upgrade-cmpv-jbgkr --namespace ns-oihey ` opsrequest.operations.kubeblocks.io/mysql-uaeapw-upgrade-cmpv-jbgkr patched `kbcli cluster delete-ops --name mysql-uaeapw-upgrade-cmpv-jbgkr --force --auto-approve --namespace ns-oihey ` OpsRequest mysql-uaeapw-upgrade-cmpv-jbgkr deleted `kubectl get secrets -l app.kubernetes.io/instance=mysql-uaeapw` set secret: mysql-uaeapw-mysql-account-root `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:29FV699wpG;DB_PORT:3306;DB_DATABASE:mysql check db_client batch data count `echo "echo \"select count(*) from executions_loop.executions_loop_table;\" | mysql -P3306 -hmysql-uaeapw-mysql.ns-oihey.svc.cluster.local -uroot -p'29FV699wpG' " | kubectl exec -it mysql-uaeapw-mysql-0 --namespace ns-oihey -- bash ` check db_client batch data Success `kubectl get secrets -l app.kubernetes.io/instance=mysql-uaeapw` set secret: mysql-uaeapw-mysql-account-root `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:29FV699wpG;DB_PORT:3306;DB_DATABASE:mysql check readonly db_client batch data count `echo "echo \"select count(*) from executions_loop.executions_loop_table;\" | mysql -P3306 -h127.0.0.1 -uroot -p'29FV699wpG' " | kubectl exec -it mysql-uaeapw-mysql-1 --namespace ns-oihey -- bash ` check readonly db_client batch data Success upgrade from:8.0.36 to service version:8.0.37 cluster upgrade apiVersion: operations.kubeblocks.io/v1alpha1 kind: OpsRequest metadata: generateName: mysql-uaeapw-upgrade-cmpv- namespace: ns-oihey spec: clusterName: mysql-uaeapw upgrade: components: - componentName: mysql serviceVersion: 8.0.37 type: Upgrade check cluster status before ops check cluster status done cluster_status:Running `kubectl create -f test_ops_cluster_mysql-uaeapw.yaml` opsrequest.operations.kubeblocks.io/mysql-uaeapw-upgrade-cmpv-ssq6k created create test_ops_cluster_mysql-uaeapw.yaml Success `rm -rf test_ops_cluster_mysql-uaeapw.yaml` check ops status `kbcli cluster list-ops mysql-uaeapw --status all --namespace ns-oihey ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME mysql-uaeapw-upgrade-cmpv-ssq6k ns-oihey Upgrade mysql-uaeapw mysql Running 0/2 Sep 12,2025 13:55 UTC+0800 check cluster status `kbcli cluster list mysql-uaeapw --show-labels --namespace ns-oihey ` NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS mysql-uaeapw ns-oihey mysql Delete Updating Sep 12,2025 13:05 UTC+0800 app.kubernetes.io/instance=mysql-uaeapw,clusterdefinition.kubeblocks.io/name=mysql cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances mysql-uaeapw --namespace ns-oihey ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME mysql-uaeapw-mysql-0 ns-oihey mysql-uaeapw mysql Running secondary 0 200m / 200m 644245094400m / 644245094400m data:12Gi aks-cicdamdpool-13759654-vmss000002/10.224.0.6 Sep 12,2025 13:39 UTC+0800 mysql-uaeapw-mysql-1 ns-oihey mysql-uaeapw mysql Running secondary 0 200m / 200m 644245094400m / 644245094400m data:12Gi aks-cicdamdpool-13759654-vmss000001/10.224.0.7 Sep 12,2025 13:38 UTC+0800 check pod status done check cluster role No resources found in ns-oihey namespace. primary: ;secondary: mysql-uaeapw-mysql-0 mysql-uaeapw-mysql-1 No resources found in ns-oihey namespace. primary: ;secondary: mysql-uaeapw-mysql-0 mysql-uaeapw-mysql-1 No resources found in ns-oihey namespace. primary: ;secondary: mysql-uaeapw-mysql-0 mysql-uaeapw-mysql-1 No resources found in ns-oihey namespace. primary: ;secondary: mysql-uaeapw-mysql-0 mysql-uaeapw-mysql-1 No resources found in ns-oihey namespace. primary: ;secondary: mysql-uaeapw-mysql-0 mysql-uaeapw-mysql-1 No resources found in ns-oihey namespace. primary: ;secondary: mysql-uaeapw-mysql-0 mysql-uaeapw-mysql-1 No resources found in ns-oihey namespace. primary: ;secondary: mysql-uaeapw-mysql-0 mysql-uaeapw-mysql-1 No resources found in ns-oihey namespace. primary: ;secondary: mysql-uaeapw-mysql-0 mysql-uaeapw-mysql-1 No resources found in ns-oihey namespace. primary: ;secondary: mysql-uaeapw-mysql-0 mysql-uaeapw-mysql-1 No resources found in ns-oihey namespace. primary: ;secondary: mysql-uaeapw-mysql-0 mysql-uaeapw-mysql-1 No resources found in ns-oihey namespace. primary: ;secondary: mysql-uaeapw-mysql-0 mysql-uaeapw-mysql-1 No resources found in ns-oihey namespace. primary: ;secondary: mysql-uaeapw-mysql-0 mysql-uaeapw-mysql-1 No resources found in ns-oihey namespace. primary: ;secondary: mysql-uaeapw-mysql-0 mysql-uaeapw-mysql-1 No resources found in ns-oihey namespace. primary: ;secondary: mysql-uaeapw-mysql-0 mysql-uaeapw-mysql-1 No resources found in ns-oihey namespace. primary: ;secondary: mysql-uaeapw-mysql-0 mysql-uaeapw-mysql-1 No resources found in ns-oihey namespace. primary: ;secondary: mysql-uaeapw-mysql-0 mysql-uaeapw-mysql-1 No resources found in ns-oihey namespace. primary: ;secondary: mysql-uaeapw-mysql-0 mysql-uaeapw-mysql-1 check cluster role done primary: mysql-uaeapw-mysql-0;secondary: mysql-uaeapw-mysql-1 `kubectl get secrets -l app.kubernetes.io/instance=mysql-uaeapw` set secret: mysql-uaeapw-mysql-account-root `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:29FV699wpG;DB_PORT:3306;DB_DATABASE:mysql check cluster connect `echo " echo \"SHOW SLAVE STATUS\G;\" | mysql -P3306 -h127.0.0.1 -uroot -p'29FV699wpG' " | kubectl exec -it mysql-uaeapw-mysql-1 --namespace ns-oihey -- bash ` check cluster connect done check ops status `kbcli cluster list-ops mysql-uaeapw --status all --namespace ns-oihey ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME mysql-uaeapw-upgrade-cmpv-ssq6k ns-oihey Upgrade mysql-uaeapw mysql Succeed 2/2 Sep 12,2025 13:55 UTC+0800 check ops status done ops_status:mysql-uaeapw-upgrade-cmpv-ssq6k ns-oihey Upgrade mysql-uaeapw mysql Succeed 2/2 Sep 12,2025 13:55 UTC+0800 `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge opsrequests.operations mysql-uaeapw-upgrade-cmpv-ssq6k --namespace ns-oihey ` opsrequest.operations.kubeblocks.io/mysql-uaeapw-upgrade-cmpv-ssq6k patched `kbcli cluster delete-ops --name mysql-uaeapw-upgrade-cmpv-ssq6k --force --auto-approve --namespace ns-oihey ` OpsRequest mysql-uaeapw-upgrade-cmpv-ssq6k deleted `kubectl get secrets -l app.kubernetes.io/instance=mysql-uaeapw` set secret: mysql-uaeapw-mysql-account-root `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:29FV699wpG;DB_PORT:3306;DB_DATABASE:mysql check db_client batch data count `echo "echo \"select count(*) from executions_loop.executions_loop_table;\" | mysql -P3306 -hmysql-uaeapw-mysql.ns-oihey.svc.cluster.local -uroot -p'29FV699wpG' " | kubectl exec -it mysql-uaeapw-mysql-0 --namespace ns-oihey -- bash ` check db_client batch data Success `kubectl get secrets -l app.kubernetes.io/instance=mysql-uaeapw` set secret: mysql-uaeapw-mysql-account-root `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:29FV699wpG;DB_PORT:3306;DB_DATABASE:mysql check readonly db_client batch data count `echo "echo \"select count(*) from executions_loop.executions_loop_table;\" | mysql -P3306 -h127.0.0.1 -uroot -p'29FV699wpG' " | kubectl exec -it mysql-uaeapw-mysql-1 --namespace ns-oihey -- bash ` check readonly db_client batch data Success upgrade from:8.0.37 to service version:8.0.39 cluster upgrade apiVersion: operations.kubeblocks.io/v1alpha1 kind: OpsRequest metadata: generateName: mysql-uaeapw-upgrade-cmpv- namespace: ns-oihey spec: clusterName: mysql-uaeapw upgrade: components: - componentName: mysql serviceVersion: 8.0.39 type: Upgrade check cluster status before ops check cluster status done cluster_status:Running `kubectl create -f test_ops_cluster_mysql-uaeapw.yaml` opsrequest.operations.kubeblocks.io/mysql-uaeapw-upgrade-cmpv-9gmr5 created create test_ops_cluster_mysql-uaeapw.yaml Success `rm -rf test_ops_cluster_mysql-uaeapw.yaml` check ops status `kbcli cluster list-ops mysql-uaeapw --status all --namespace ns-oihey ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME mysql-uaeapw-upgrade-cmpv-9gmr5 ns-oihey Upgrade mysql-uaeapw mysql Running 0/2 Sep 12,2025 13:57 UTC+0800 check cluster status `kbcli cluster list mysql-uaeapw --show-labels --namespace ns-oihey ` NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS mysql-uaeapw ns-oihey mysql Delete Updating Sep 12,2025 13:05 UTC+0800 app.kubernetes.io/instance=mysql-uaeapw,clusterdefinition.kubeblocks.io/name=mysql cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances mysql-uaeapw --namespace ns-oihey ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME mysql-uaeapw-mysql-0 ns-oihey mysql-uaeapw mysql Running secondary 0 200m / 200m 644245094400m / 644245094400m data:12Gi aks-cicdamdpool-13759654-vmss000002/10.224.0.6 Sep 12,2025 13:39 UTC+0800 mysql-uaeapw-mysql-1 ns-oihey mysql-uaeapw mysql Running secondary 0 200m / 200m 644245094400m / 644245094400m data:12Gi aks-cicdamdpool-13759654-vmss000001/10.224.0.7 Sep 12,2025 13:38 UTC+0800 check pod status done check cluster role No resources found in ns-oihey namespace. primary: ;secondary: mysql-uaeapw-mysql-0 mysql-uaeapw-mysql-1 No resources found in ns-oihey namespace. primary: ;secondary: mysql-uaeapw-mysql-0 mysql-uaeapw-mysql-1 No resources found in ns-oihey namespace. primary: ;secondary: mysql-uaeapw-mysql-0 mysql-uaeapw-mysql-1 No resources found in ns-oihey namespace. primary: ;secondary: mysql-uaeapw-mysql-0 mysql-uaeapw-mysql-1 No resources found in ns-oihey namespace. primary: ;secondary: mysql-uaeapw-mysql-0 mysql-uaeapw-mysql-1 No resources found in ns-oihey namespace. primary: ;secondary: mysql-uaeapw-mysql-0 mysql-uaeapw-mysql-1 No resources found in ns-oihey namespace. primary: ;secondary: mysql-uaeapw-mysql-0 mysql-uaeapw-mysql-1 No resources found in ns-oihey namespace. primary: ;secondary: mysql-uaeapw-mysql-0 mysql-uaeapw-mysql-1 No resources found in ns-oihey namespace. primary: ;secondary: mysql-uaeapw-mysql-0 mysql-uaeapw-mysql-1 No resources found in ns-oihey namespace. primary: ;secondary: mysql-uaeapw-mysql-0 mysql-uaeapw-mysql-1 No resources found in ns-oihey namespace. primary: ;secondary: mysql-uaeapw-mysql-0 mysql-uaeapw-mysql-1 No resources found in ns-oihey namespace. primary: ;secondary: mysql-uaeapw-mysql-0 mysql-uaeapw-mysql-1 No resources found in ns-oihey namespace. primary: ;secondary: mysql-uaeapw-mysql-0 mysql-uaeapw-mysql-1 No resources found in ns-oihey namespace. primary: ;secondary: mysql-uaeapw-mysql-0 mysql-uaeapw-mysql-1 No resources found in ns-oihey namespace. primary: ;secondary: mysql-uaeapw-mysql-0 mysql-uaeapw-mysql-1 No resources found in ns-oihey namespace. primary: ;secondary: mysql-uaeapw-mysql-0 mysql-uaeapw-mysql-1 No resources found in ns-oihey namespace. primary: ;secondary: mysql-uaeapw-mysql-0 mysql-uaeapw-mysql-1 No resources found in ns-oihey namespace. primary: ;secondary: mysql-uaeapw-mysql-0 mysql-uaeapw-mysql-1 No resources found in ns-oihey namespace. primary: ;secondary: mysql-uaeapw-mysql-0 mysql-uaeapw-mysql-1 No resources found in ns-oihey namespace. primary: ;secondary: mysql-uaeapw-mysql-0 mysql-uaeapw-mysql-1 No resources found in ns-oihey namespace. primary: ;secondary: mysql-uaeapw-mysql-0 mysql-uaeapw-mysql-1 check cluster role done primary: mysql-uaeapw-mysql-0;secondary: mysql-uaeapw-mysql-1 `kubectl get secrets -l app.kubernetes.io/instance=mysql-uaeapw` set secret: mysql-uaeapw-mysql-account-root `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:29FV699wpG;DB_PORT:3306;DB_DATABASE:mysql check cluster connect `echo " echo \"SHOW SLAVE STATUS\G;\" | mysql -P3306 -h127.0.0.1 -uroot -p'29FV699wpG' " | kubectl exec -it mysql-uaeapw-mysql-1 --namespace ns-oihey -- bash ` check cluster connect done check ops status `kbcli cluster list-ops mysql-uaeapw --status all --namespace ns-oihey ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME mysql-uaeapw-upgrade-cmpv-9gmr5 ns-oihey Upgrade mysql-uaeapw mysql Succeed 2/2 Sep 12,2025 13:57 UTC+0800 check ops status done ops_status:mysql-uaeapw-upgrade-cmpv-9gmr5 ns-oihey Upgrade mysql-uaeapw mysql Succeed 2/2 Sep 12,2025 13:57 UTC+0800 `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge opsrequests.operations mysql-uaeapw-upgrade-cmpv-9gmr5 --namespace ns-oihey ` opsrequest.operations.kubeblocks.io/mysql-uaeapw-upgrade-cmpv-9gmr5 patched `kbcli cluster delete-ops --name mysql-uaeapw-upgrade-cmpv-9gmr5 --force --auto-approve --namespace ns-oihey ` OpsRequest mysql-uaeapw-upgrade-cmpv-9gmr5 deleted `kubectl get secrets -l app.kubernetes.io/instance=mysql-uaeapw` set secret: mysql-uaeapw-mysql-account-root `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:29FV699wpG;DB_PORT:3306;DB_DATABASE:mysql check db_client batch data count `echo "echo \"select count(*) from executions_loop.executions_loop_table;\" | mysql -P3306 -hmysql-uaeapw-mysql.ns-oihey.svc.cluster.local -uroot -p'29FV699wpG' " | kubectl exec -it mysql-uaeapw-mysql-0 --namespace ns-oihey -- bash ` check db_client batch data Success `kubectl get secrets -l app.kubernetes.io/instance=mysql-uaeapw` set secret: mysql-uaeapw-mysql-account-root `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:29FV699wpG;DB_PORT:3306;DB_DATABASE:mysql check readonly db_client batch data count `echo "echo \"select count(*) from executions_loop.executions_loop_table;\" | mysql -P3306 -h127.0.0.1 -uroot -p'29FV699wpG' " | kubectl exec -it mysql-uaeapw-mysql-1 --namespace ns-oihey -- bash ` check readonly db_client batch data Success downgrade from:8.0.39 to service version:8.0.37 cluster upgrade apiVersion: operations.kubeblocks.io/v1alpha1 kind: OpsRequest metadata: generateName: mysql-uaeapw-upgrade-cmpv- namespace: ns-oihey spec: clusterName: mysql-uaeapw upgrade: components: - componentName: mysql serviceVersion: 8.0.37 type: Upgrade check cluster status before ops check cluster status done cluster_status:Running `kubectl create -f test_ops_cluster_mysql-uaeapw.yaml` opsrequest.operations.kubeblocks.io/mysql-uaeapw-upgrade-cmpv-fdw8l created create test_ops_cluster_mysql-uaeapw.yaml Success `rm -rf test_ops_cluster_mysql-uaeapw.yaml` check ops status `kbcli cluster list-ops mysql-uaeapw --status all --namespace ns-oihey ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME mysql-uaeapw-upgrade-cmpv-fdw8l ns-oihey Upgrade mysql-uaeapw mysql Running 0/2 Sep 12,2025 13:58 UTC+0800 check cluster status `kbcli cluster list mysql-uaeapw --show-labels --namespace ns-oihey ` NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS mysql-uaeapw ns-oihey mysql Delete Updating Sep 12,2025 13:05 UTC+0800 app.kubernetes.io/instance=mysql-uaeapw,clusterdefinition.kubeblocks.io/name=mysql cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances mysql-uaeapw --namespace ns-oihey ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME mysql-uaeapw-mysql-0 ns-oihey mysql-uaeapw mysql Running secondary 0 200m / 200m 644245094400m / 644245094400m data:12Gi aks-cicdamdpool-13759654-vmss000002/10.224.0.6 Sep 12,2025 13:39 UTC+0800 mysql-uaeapw-mysql-1 ns-oihey mysql-uaeapw mysql Running primary 0 200m / 200m 644245094400m / 644245094400m data:12Gi aks-cicdamdpool-13759654-vmss000001/10.224.0.7 Sep 12,2025 13:38 UTC+0800 check pod status done check cluster role check cluster role done primary: mysql-uaeapw-mysql-1;secondary: mysql-uaeapw-mysql-0 `kubectl get secrets -l app.kubernetes.io/instance=mysql-uaeapw` set secret: mysql-uaeapw-mysql-account-root `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:29FV699wpG;DB_PORT:3306;DB_DATABASE:mysql check cluster connect `echo " echo \"SHOW SLAVE STATUS\G;\" | mysql -P3306 -h127.0.0.1 -uroot -p'29FV699wpG' " | kubectl exec -it mysql-uaeapw-mysql-0 --namespace ns-oihey -- bash ` check cluster connect done check ops status `kbcli cluster list-ops mysql-uaeapw --status all --namespace ns-oihey ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME mysql-uaeapw-upgrade-cmpv-fdw8l ns-oihey Upgrade mysql-uaeapw mysql Succeed 2/2 Sep 12,2025 13:58 UTC+0800 check ops status done ops_status:mysql-uaeapw-upgrade-cmpv-fdw8l ns-oihey Upgrade mysql-uaeapw mysql Succeed 2/2 Sep 12,2025 13:58 UTC+0800 `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge opsrequests.operations mysql-uaeapw-upgrade-cmpv-fdw8l --namespace ns-oihey ` opsrequest.operations.kubeblocks.io/mysql-uaeapw-upgrade-cmpv-fdw8l patched `kbcli cluster delete-ops --name mysql-uaeapw-upgrade-cmpv-fdw8l --force --auto-approve --namespace ns-oihey ` OpsRequest mysql-uaeapw-upgrade-cmpv-fdw8l deleted `kubectl get secrets -l app.kubernetes.io/instance=mysql-uaeapw` set secret: mysql-uaeapw-mysql-account-root `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:29FV699wpG;DB_PORT:3306;DB_DATABASE:mysql check db_client batch data count `echo "echo \"select count(*) from executions_loop.executions_loop_table;\" | mysql -P3306 -hmysql-uaeapw-mysql.ns-oihey.svc.cluster.local -uroot -p'29FV699wpG' " | kubectl exec -it mysql-uaeapw-mysql-1 --namespace ns-oihey -- bash ` check db_client batch data Success `kubectl get secrets -l app.kubernetes.io/instance=mysql-uaeapw` set secret: mysql-uaeapw-mysql-account-root `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:29FV699wpG;DB_PORT:3306;DB_DATABASE:mysql check readonly db_client batch data count `echo "echo \"select count(*) from executions_loop.executions_loop_table;\" | mysql -P3306 -h127.0.0.1 -uroot -p'29FV699wpG' " | kubectl exec -it mysql-uaeapw-mysql-0 --namespace ns-oihey -- bash ` check readonly db_client batch data Success upgrade from:8.0.37 to service version:8.0.38 cluster upgrade apiVersion: operations.kubeblocks.io/v1alpha1 kind: OpsRequest metadata: generateName: mysql-uaeapw-upgrade-cmpv- namespace: ns-oihey spec: clusterName: mysql-uaeapw upgrade: components: - componentName: mysql serviceVersion: 8.0.38 type: Upgrade check cluster status before ops check cluster status done cluster_status:Running `kubectl create -f test_ops_cluster_mysql-uaeapw.yaml` opsrequest.operations.kubeblocks.io/mysql-uaeapw-upgrade-cmpv-49xcs created create test_ops_cluster_mysql-uaeapw.yaml Success `rm -rf test_ops_cluster_mysql-uaeapw.yaml` check ops status `kbcli cluster list-ops mysql-uaeapw --status all --namespace ns-oihey ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME mysql-uaeapw-upgrade-cmpv-49xcs ns-oihey Upgrade mysql-uaeapw Running -/- Sep 12,2025 13:59 UTC+0800 check cluster status `kbcli cluster list mysql-uaeapw --show-labels --namespace ns-oihey ` NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS mysql-uaeapw ns-oihey mysql Delete Updating Sep 12,2025 13:05 UTC+0800 app.kubernetes.io/instance=mysql-uaeapw,clusterdefinition.kubeblocks.io/name=mysql cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances mysql-uaeapw --namespace ns-oihey ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME mysql-uaeapw-mysql-0 ns-oihey mysql-uaeapw mysql Running secondary 0 200m / 200m 644245094400m / 644245094400m data:12Gi aks-cicdamdpool-13759654-vmss000002/10.224.0.6 Sep 12,2025 13:39 UTC+0800 mysql-uaeapw-mysql-1 ns-oihey mysql-uaeapw mysql Running secondary 0 200m / 200m 644245094400m / 644245094400m data:12Gi aks-cicdamdpool-13759654-vmss000001/10.224.0.7 Sep 12,2025 13:38 UTC+0800 check pod status done check cluster role No resources found in ns-oihey namespace. primary: ;secondary: mysql-uaeapw-mysql-0 mysql-uaeapw-mysql-1 No resources found in ns-oihey namespace. primary: ;secondary: mysql-uaeapw-mysql-0 mysql-uaeapw-mysql-1 No resources found in ns-oihey namespace. primary: ;secondary: mysql-uaeapw-mysql-0 mysql-uaeapw-mysql-1 No resources found in ns-oihey namespace. primary: ;secondary: mysql-uaeapw-mysql-0 mysql-uaeapw-mysql-1 No resources found in ns-oihey namespace. primary: ;secondary: mysql-uaeapw-mysql-0 mysql-uaeapw-mysql-1 No resources found in ns-oihey namespace. primary: ;secondary: mysql-uaeapw-mysql-0 mysql-uaeapw-mysql-1 No resources found in ns-oihey namespace. primary: ;secondary: mysql-uaeapw-mysql-0 mysql-uaeapw-mysql-1 No resources found in ns-oihey namespace. primary: ;secondary: mysql-uaeapw-mysql-0 mysql-uaeapw-mysql-1 No resources found in ns-oihey namespace. primary: ;secondary: mysql-uaeapw-mysql-0 mysql-uaeapw-mysql-1 No resources found in ns-oihey namespace. primary: ;secondary: mysql-uaeapw-mysql-0 mysql-uaeapw-mysql-1 No resources found in ns-oihey namespace. primary: ;secondary: mysql-uaeapw-mysql-0 mysql-uaeapw-mysql-1 No resources found in ns-oihey namespace. primary: ;secondary: mysql-uaeapw-mysql-0 mysql-uaeapw-mysql-1 No resources found in ns-oihey namespace. primary: ;secondary: mysql-uaeapw-mysql-0 mysql-uaeapw-mysql-1 No resources found in ns-oihey namespace. primary: ;secondary: mysql-uaeapw-mysql-0 mysql-uaeapw-mysql-1 No resources found in ns-oihey namespace. primary: ;secondary: mysql-uaeapw-mysql-0 mysql-uaeapw-mysql-1 No resources found in ns-oihey namespace. primary: ;secondary: mysql-uaeapw-mysql-0 mysql-uaeapw-mysql-1 No resources found in ns-oihey namespace. primary: ;secondary: mysql-uaeapw-mysql-0 mysql-uaeapw-mysql-1 No resources found in ns-oihey namespace. primary: ;secondary: mysql-uaeapw-mysql-0 mysql-uaeapw-mysql-1 No resources found in ns-oihey namespace. primary: ;secondary: mysql-uaeapw-mysql-0 mysql-uaeapw-mysql-1 check cluster role done primary: mysql-uaeapw-mysql-1;secondary: mysql-uaeapw-mysql-0 `kubectl get secrets -l app.kubernetes.io/instance=mysql-uaeapw` set secret: mysql-uaeapw-mysql-account-root `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:29FV699wpG;DB_PORT:3306;DB_DATABASE:mysql check cluster connect `echo " echo \"SHOW SLAVE STATUS\G;\" | mysql -P3306 -h127.0.0.1 -uroot -p'29FV699wpG' " | kubectl exec -it mysql-uaeapw-mysql-0 --namespace ns-oihey -- bash ` check cluster connect done check ops status `kbcli cluster list-ops mysql-uaeapw --status all --namespace ns-oihey ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME mysql-uaeapw-upgrade-cmpv-49xcs ns-oihey Upgrade mysql-uaeapw mysql Succeed 2/2 Sep 12,2025 13:59 UTC+0800 check ops status done ops_status:mysql-uaeapw-upgrade-cmpv-49xcs ns-oihey Upgrade mysql-uaeapw mysql Succeed 2/2 Sep 12,2025 13:59 UTC+0800 `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge opsrequests.operations mysql-uaeapw-upgrade-cmpv-49xcs --namespace ns-oihey ` opsrequest.operations.kubeblocks.io/mysql-uaeapw-upgrade-cmpv-49xcs patched `kbcli cluster delete-ops --name mysql-uaeapw-upgrade-cmpv-49xcs --force --auto-approve --namespace ns-oihey ` OpsRequest mysql-uaeapw-upgrade-cmpv-49xcs deleted `kubectl get secrets -l app.kubernetes.io/instance=mysql-uaeapw` set secret: mysql-uaeapw-mysql-account-root `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:29FV699wpG;DB_PORT:3306;DB_DATABASE:mysql check db_client batch data count `echo "echo \"select count(*) from executions_loop.executions_loop_table;\" | mysql -P3306 -hmysql-uaeapw-mysql.ns-oihey.svc.cluster.local -uroot -p'29FV699wpG' " | kubectl exec -it mysql-uaeapw-mysql-1 --namespace ns-oihey -- bash ` check db_client batch data Success `kubectl get secrets -l app.kubernetes.io/instance=mysql-uaeapw` set secret: mysql-uaeapw-mysql-account-root `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:29FV699wpG;DB_PORT:3306;DB_DATABASE:mysql check readonly db_client batch data count `echo "echo \"select count(*) from executions_loop.executions_loop_table;\" | mysql -P3306 -h127.0.0.1 -uroot -p'29FV699wpG' " | kubectl exec -it mysql-uaeapw-mysql-0 --namespace ns-oihey -- bash ` check readonly db_client batch data Success upgrade from:8.0.38 to service version:8.0.39 cluster upgrade apiVersion: operations.kubeblocks.io/v1alpha1 kind: OpsRequest metadata: generateName: mysql-uaeapw-upgrade-cmpv- namespace: ns-oihey spec: clusterName: mysql-uaeapw upgrade: components: - componentName: mysql serviceVersion: 8.0.39 type: Upgrade check cluster status before ops check cluster status done cluster_status:Running `kubectl create -f test_ops_cluster_mysql-uaeapw.yaml` opsrequest.operations.kubeblocks.io/mysql-uaeapw-upgrade-cmpv-szzvj created create test_ops_cluster_mysql-uaeapw.yaml Success `rm -rf test_ops_cluster_mysql-uaeapw.yaml` check ops status `kbcli cluster list-ops mysql-uaeapw --status all --namespace ns-oihey ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME mysql-uaeapw-upgrade-cmpv-szzvj ns-oihey Upgrade mysql-uaeapw Running -/- Sep 12,2025 14:00 UTC+0800 check cluster status `kbcli cluster list mysql-uaeapw --show-labels --namespace ns-oihey ` NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS mysql-uaeapw ns-oihey mysql Delete Updating Sep 12,2025 13:05 UTC+0800 app.kubernetes.io/instance=mysql-uaeapw,clusterdefinition.kubeblocks.io/name=mysql cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances mysql-uaeapw --namespace ns-oihey ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME mysql-uaeapw-mysql-0 ns-oihey mysql-uaeapw mysql Running secondary 0 200m / 200m 644245094400m / 644245094400m data:12Gi aks-cicdamdpool-13759654-vmss000002/10.224.0.6 Sep 12,2025 13:39 UTC+0800 mysql-uaeapw-mysql-1 ns-oihey mysql-uaeapw mysql Running secondary 0 200m / 200m 644245094400m / 644245094400m data:12Gi aks-cicdamdpool-13759654-vmss000001/10.224.0.7 Sep 12,2025 13:38 UTC+0800 check pod status done check cluster role No resources found in ns-oihey namespace. primary: ;secondary: mysql-uaeapw-mysql-0 mysql-uaeapw-mysql-1 No resources found in ns-oihey namespace. primary: ;secondary: mysql-uaeapw-mysql-0 mysql-uaeapw-mysql-1 No resources found in ns-oihey namespace. primary: ;secondary: mysql-uaeapw-mysql-0 mysql-uaeapw-mysql-1 No resources found in ns-oihey namespace. primary: ;secondary: mysql-uaeapw-mysql-0 mysql-uaeapw-mysql-1 No resources found in ns-oihey namespace. primary: ;secondary: mysql-uaeapw-mysql-0 mysql-uaeapw-mysql-1 No resources found in ns-oihey namespace. primary: ;secondary: mysql-uaeapw-mysql-0 mysql-uaeapw-mysql-1 No resources found in ns-oihey namespace. primary: ;secondary: mysql-uaeapw-mysql-0 mysql-uaeapw-mysql-1 No resources found in ns-oihey namespace. primary: ;secondary: mysql-uaeapw-mysql-0 mysql-uaeapw-mysql-1 No resources found in ns-oihey namespace. primary: ;secondary: mysql-uaeapw-mysql-0 mysql-uaeapw-mysql-1 No resources found in ns-oihey namespace. primary: ;secondary: mysql-uaeapw-mysql-0 mysql-uaeapw-mysql-1 No resources found in ns-oihey namespace. primary: ;secondary: mysql-uaeapw-mysql-0 mysql-uaeapw-mysql-1 No resources found in ns-oihey namespace. primary: ;secondary: mysql-uaeapw-mysql-0 mysql-uaeapw-mysql-1 No resources found in ns-oihey namespace. primary: ;secondary: mysql-uaeapw-mysql-0 mysql-uaeapw-mysql-1 No resources found in ns-oihey namespace. primary: ;secondary: mysql-uaeapw-mysql-0 mysql-uaeapw-mysql-1 check cluster role done primary: mysql-uaeapw-mysql-1;secondary: mysql-uaeapw-mysql-0 `kubectl get secrets -l app.kubernetes.io/instance=mysql-uaeapw` set secret: mysql-uaeapw-mysql-account-root `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:29FV699wpG;DB_PORT:3306;DB_DATABASE:mysql check cluster connect `echo " echo \"SHOW SLAVE STATUS\G;\" | mysql -P3306 -h127.0.0.1 -uroot -p'29FV699wpG' " | kubectl exec -it mysql-uaeapw-mysql-0 --namespace ns-oihey -- bash ` check cluster connect done check ops status `kbcli cluster list-ops mysql-uaeapw --status all --namespace ns-oihey ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME mysql-uaeapw-upgrade-cmpv-szzvj ns-oihey Upgrade mysql-uaeapw mysql Succeed 2/2 Sep 12,2025 14:00 UTC+0800 check ops status done ops_status:mysql-uaeapw-upgrade-cmpv-szzvj ns-oihey Upgrade mysql-uaeapw mysql Succeed 2/2 Sep 12,2025 14:00 UTC+0800 `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge opsrequests.operations mysql-uaeapw-upgrade-cmpv-szzvj --namespace ns-oihey ` opsrequest.operations.kubeblocks.io/mysql-uaeapw-upgrade-cmpv-szzvj patched `kbcli cluster delete-ops --name mysql-uaeapw-upgrade-cmpv-szzvj --force --auto-approve --namespace ns-oihey ` OpsRequest mysql-uaeapw-upgrade-cmpv-szzvj deleted `kubectl get secrets -l app.kubernetes.io/instance=mysql-uaeapw` set secret: mysql-uaeapw-mysql-account-root `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:29FV699wpG;DB_PORT:3306;DB_DATABASE:mysql check db_client batch data count `echo "echo \"select count(*) from executions_loop.executions_loop_table;\" | mysql -P3306 -hmysql-uaeapw-mysql.ns-oihey.svc.cluster.local -uroot -p'29FV699wpG' " | kubectl exec -it mysql-uaeapw-mysql-1 --namespace ns-oihey -- bash ` check db_client batch data Success `kubectl get secrets -l app.kubernetes.io/instance=mysql-uaeapw` set secret: mysql-uaeapw-mysql-account-root `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:29FV699wpG;DB_PORT:3306;DB_DATABASE:mysql check readonly db_client batch data count `echo "echo \"select count(*) from executions_loop.executions_loop_table;\" | mysql -P3306 -h127.0.0.1 -uroot -p'29FV699wpG' " | kubectl exec -it mysql-uaeapw-mysql-0 --namespace ns-oihey -- bash ` check readonly db_client batch data Success downgrade from:8.0.39 to service version:8.0.38 cluster upgrade apiVersion: operations.kubeblocks.io/v1alpha1 kind: OpsRequest metadata: generateName: mysql-uaeapw-upgrade-cmpv- namespace: ns-oihey spec: clusterName: mysql-uaeapw upgrade: components: - componentName: mysql serviceVersion: 8.0.38 type: Upgrade check cluster status before ops check cluster status done cluster_status:Running `kubectl create -f test_ops_cluster_mysql-uaeapw.yaml` opsrequest.operations.kubeblocks.io/mysql-uaeapw-upgrade-cmpv-ndj8j created create test_ops_cluster_mysql-uaeapw.yaml Success `rm -rf test_ops_cluster_mysql-uaeapw.yaml` check ops status `kbcli cluster list-ops mysql-uaeapw --status all --namespace ns-oihey ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME mysql-uaeapw-upgrade-cmpv-ndj8j ns-oihey Upgrade mysql-uaeapw Running -/- Sep 12,2025 14:01 UTC+0800 check cluster status `kbcli cluster list mysql-uaeapw --show-labels --namespace ns-oihey ` NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS mysql-uaeapw ns-oihey mysql Delete Updating Sep 12,2025 13:05 UTC+0800 app.kubernetes.io/instance=mysql-uaeapw,clusterdefinition.kubeblocks.io/name=mysql cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances mysql-uaeapw --namespace ns-oihey ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME mysql-uaeapw-mysql-0 ns-oihey mysql-uaeapw mysql Running primary 0 200m / 200m 644245094400m / 644245094400m data:12Gi aks-cicdamdpool-13759654-vmss000002/10.224.0.6 Sep 12,2025 13:39 UTC+0800 mysql-uaeapw-mysql-1 ns-oihey mysql-uaeapw mysql Running secondary 0 200m / 200m 644245094400m / 644245094400m data:12Gi aks-cicdamdpool-13759654-vmss000001/10.224.0.7 Sep 12,2025 13:38 UTC+0800 check pod status done check cluster role check cluster role done primary: mysql-uaeapw-mysql-0;secondary: mysql-uaeapw-mysql-1 `kubectl get secrets -l app.kubernetes.io/instance=mysql-uaeapw` set secret: mysql-uaeapw-mysql-account-root `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:29FV699wpG;DB_PORT:3306;DB_DATABASE:mysql check cluster connect `echo " echo \"SHOW SLAVE STATUS\G;\" | mysql -P3306 -h127.0.0.1 -uroot -p'29FV699wpG' " | kubectl exec -it mysql-uaeapw-mysql-1 --namespace ns-oihey -- bash ` check cluster connect done check ops status `kbcli cluster list-ops mysql-uaeapw --status all --namespace ns-oihey ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME mysql-uaeapw-upgrade-cmpv-ndj8j ns-oihey Upgrade mysql-uaeapw mysql Succeed 2/2 Sep 12,2025 14:01 UTC+0800 check ops status done ops_status:mysql-uaeapw-upgrade-cmpv-ndj8j ns-oihey Upgrade mysql-uaeapw mysql Succeed 2/2 Sep 12,2025 14:01 UTC+0800 `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge opsrequests.operations mysql-uaeapw-upgrade-cmpv-ndj8j --namespace ns-oihey ` opsrequest.operations.kubeblocks.io/mysql-uaeapw-upgrade-cmpv-ndj8j patched `kbcli cluster delete-ops --name mysql-uaeapw-upgrade-cmpv-ndj8j --force --auto-approve --namespace ns-oihey ` OpsRequest mysql-uaeapw-upgrade-cmpv-ndj8j deleted `kubectl get secrets -l app.kubernetes.io/instance=mysql-uaeapw` set secret: mysql-uaeapw-mysql-account-root `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:29FV699wpG;DB_PORT:3306;DB_DATABASE:mysql check db_client batch data count `echo "echo \"select count(*) from executions_loop.executions_loop_table;\" | mysql -P3306 -hmysql-uaeapw-mysql.ns-oihey.svc.cluster.local -uroot -p'29FV699wpG' " | kubectl exec -it mysql-uaeapw-mysql-0 --namespace ns-oihey -- bash ` check db_client batch data Success `kubectl get secrets -l app.kubernetes.io/instance=mysql-uaeapw` set secret: mysql-uaeapw-mysql-account-root `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:29FV699wpG;DB_PORT:3306;DB_DATABASE:mysql check readonly db_client batch data count `echo "echo \"select count(*) from executions_loop.executions_loop_table;\" | mysql -P3306 -h127.0.0.1 -uroot -p'29FV699wpG' " | kubectl exec -it mysql-uaeapw-mysql-1 --namespace ns-oihey -- bash ` check readonly db_client batch data Success test failover networkdelay check cluster status before cluster-failover-networkdelay check cluster status done cluster_status:Running `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge NetworkChaos test-chaos-mesh-networkdelay-mysql-uaeapw --namespace ns-oihey ` Warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely. Error from server (NotFound): networkchaos.chaos-mesh.org "test-chaos-mesh-networkdelay-mysql-uaeapw" not found Error from server (NotFound): networkchaos.chaos-mesh.org "test-chaos-mesh-networkdelay-mysql-uaeapw" not found apiVersion: chaos-mesh.org/v1alpha1 kind: NetworkChaos metadata: name: test-chaos-mesh-networkdelay-mysql-uaeapw namespace: ns-oihey spec: selector: namespaces: - ns-oihey labelSelectors: apps.kubeblocks.io/pod-name: mysql-uaeapw-mysql-0 mode: all action: delay delay: latency: 2000ms correlation: '100' jitter: 0ms direction: to duration: 2m `kubectl apply -f test-chaos-mesh-networkdelay-mysql-uaeapw.yaml` networkchaos.chaos-mesh.org/test-chaos-mesh-networkdelay-mysql-uaeapw created apply test-chaos-mesh-networkdelay-mysql-uaeapw.yaml Success `rm -rf test-chaos-mesh-networkdelay-mysql-uaeapw.yaml` networkdelay chaos test waiting 120 seconds check cluster status `kbcli cluster list mysql-uaeapw --show-labels --namespace ns-oihey ` NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS mysql-uaeapw ns-oihey mysql Delete Running Sep 12,2025 13:05 UTC+0800 app.kubernetes.io/instance=mysql-uaeapw,clusterdefinition.kubeblocks.io/name=mysql check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances mysql-uaeapw --namespace ns-oihey ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME mysql-uaeapw-mysql-0 ns-oihey mysql-uaeapw mysql Running primary 0 200m / 200m 644245094400m / 644245094400m data:12Gi aks-cicdamdpool-13759654-vmss000002/10.224.0.6 Sep 12,2025 13:39 UTC+0800 mysql-uaeapw-mysql-1 ns-oihey mysql-uaeapw mysql Running secondary 0 200m / 200m 644245094400m / 644245094400m data:12Gi aks-cicdamdpool-13759654-vmss000001/10.224.0.7 Sep 12,2025 13:38 UTC+0800 check pod status done check cluster role check cluster role done primary: mysql-uaeapw-mysql-0;secondary: mysql-uaeapw-mysql-1 `kubectl get secrets -l app.kubernetes.io/instance=mysql-uaeapw` set secret: mysql-uaeapw-mysql-account-root `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:29FV699wpG;DB_PORT:3306;DB_DATABASE:mysql check cluster connect `echo " echo \"SHOW SLAVE STATUS\G;\" | mysql -P3306 -h127.0.0.1 -uroot -p'29FV699wpG' " | kubectl exec -it mysql-uaeapw-mysql-1 --namespace ns-oihey -- bash ` check cluster connect done `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge NetworkChaos test-chaos-mesh-networkdelay-mysql-uaeapw --namespace ns-oihey ` Warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely. networkchaos.chaos-mesh.org "test-chaos-mesh-networkdelay-mysql-uaeapw" force deleted networkchaos.chaos-mesh.org/test-chaos-mesh-networkdelay-mysql-uaeapw patched check failover pod name failover pod name:mysql-uaeapw-mysql-0 failover networkdelay Success `kubectl get secrets -l app.kubernetes.io/instance=mysql-uaeapw` set secret: mysql-uaeapw-mysql-account-root `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:29FV699wpG;DB_PORT:3306;DB_DATABASE:mysql check db_client batch data count `echo "echo \"select count(*) from executions_loop.executions_loop_table;\" | mysql -P3306 -hmysql-uaeapw-mysql.ns-oihey.svc.cluster.local -uroot -p'29FV699wpG' " | kubectl exec -it mysql-uaeapw-mysql-0 --namespace ns-oihey -- bash ` check db_client batch data Success `kubectl get secrets -l app.kubernetes.io/instance=mysql-uaeapw` set secret: mysql-uaeapw-mysql-account-root `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:29FV699wpG;DB_PORT:3306;DB_DATABASE:mysql check readonly db_client batch data count `echo "echo \"select count(*) from executions_loop.executions_loop_table;\" | mysql -P3306 -h127.0.0.1 -uroot -p'29FV699wpG' " | kubectl exec -it mysql-uaeapw-mysql-1 --namespace ns-oihey -- bash ` check readonly db_client batch data Success test failover networkpartition check cluster status before cluster-failover-networkpartition check cluster status done cluster_status:Running `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge NetworkChaos test-chaos-mesh-networkpartition-mysql-uaeapw --namespace ns-oihey ` Warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely. Error from server (NotFound): networkchaos.chaos-mesh.org "test-chaos-mesh-networkpartition-mysql-uaeapw" not found Error from server (NotFound): networkchaos.chaos-mesh.org "test-chaos-mesh-networkpartition-mysql-uaeapw" not found apiVersion: chaos-mesh.org/v1alpha1 kind: NetworkChaos metadata: name: test-chaos-mesh-networkpartition-mysql-uaeapw namespace: ns-oihey spec: selector: namespaces: - ns-oihey labelSelectors: apps.kubeblocks.io/pod-name: mysql-uaeapw-mysql-0 action: partition mode: all target: mode: all selector: namespaces: - ns-oihey labelSelectors: apps.kubeblocks.io/pod-name: mysql-uaeapw-mysql-1 direction: to duration: 2m `kubectl apply -f test-chaos-mesh-networkpartition-mysql-uaeapw.yaml` networkchaos.chaos-mesh.org/test-chaos-mesh-networkpartition-mysql-uaeapw created apply test-chaos-mesh-networkpartition-mysql-uaeapw.yaml Success `rm -rf test-chaos-mesh-networkpartition-mysql-uaeapw.yaml` networkpartition chaos test waiting 120 seconds check cluster status `kbcli cluster list mysql-uaeapw --show-labels --namespace ns-oihey ` NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS mysql-uaeapw ns-oihey mysql Delete Running Sep 12,2025 13:05 UTC+0800 app.kubernetes.io/instance=mysql-uaeapw,clusterdefinition.kubeblocks.io/name=mysql check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances mysql-uaeapw --namespace ns-oihey ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME mysql-uaeapw-mysql-0 ns-oihey mysql-uaeapw mysql Running primary 0 200m / 200m 644245094400m / 644245094400m data:12Gi aks-cicdamdpool-13759654-vmss000002/10.224.0.6 Sep 12,2025 13:39 UTC+0800 mysql-uaeapw-mysql-1 ns-oihey mysql-uaeapw mysql Running secondary 0 200m / 200m 644245094400m / 644245094400m data:12Gi aks-cicdamdpool-13759654-vmss000001/10.224.0.7 Sep 12,2025 13:38 UTC+0800 check pod status done check cluster role check cluster role done primary: mysql-uaeapw-mysql-0;secondary: mysql-uaeapw-mysql-1 `kubectl get secrets -l app.kubernetes.io/instance=mysql-uaeapw` set secret: mysql-uaeapw-mysql-account-root `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:29FV699wpG;DB_PORT:3306;DB_DATABASE:mysql check cluster connect `echo " echo \"SHOW SLAVE STATUS\G;\" | mysql -P3306 -h127.0.0.1 -uroot -p'29FV699wpG' " | kubectl exec -it mysql-uaeapw-mysql-1 --namespace ns-oihey -- bash ` check cluster connect done `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge NetworkChaos test-chaos-mesh-networkpartition-mysql-uaeapw --namespace ns-oihey ` Warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely. networkchaos.chaos-mesh.org "test-chaos-mesh-networkpartition-mysql-uaeapw" force deleted Error from server (NotFound): networkchaos.chaos-mesh.org "test-chaos-mesh-networkpartition-mysql-uaeapw" not found check failover pod name failover pod name:mysql-uaeapw-mysql-0 failover networkpartition Success `kubectl get secrets -l app.kubernetes.io/instance=mysql-uaeapw` set secret: mysql-uaeapw-mysql-account-root `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:29FV699wpG;DB_PORT:3306;DB_DATABASE:mysql check db_client batch data count `echo "echo \"select count(*) from executions_loop.executions_loop_table;\" | mysql -P3306 -hmysql-uaeapw-mysql.ns-oihey.svc.cluster.local -uroot -p'29FV699wpG' " | kubectl exec -it mysql-uaeapw-mysql-0 --namespace ns-oihey -- bash ` check db_client batch data Success `kubectl get secrets -l app.kubernetes.io/instance=mysql-uaeapw` set secret: mysql-uaeapw-mysql-account-root `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:29FV699wpG;DB_PORT:3306;DB_DATABASE:mysql check readonly db_client batch data count `echo "echo \"select count(*) from executions_loop.executions_loop_table;\" | mysql -P3306 -h127.0.0.1 -uroot -p'29FV699wpG' " | kubectl exec -it mysql-uaeapw-mysql-1 --namespace ns-oihey -- bash ` check readonly db_client batch data Success test switchover apiVersion: operations.kubeblocks.io/v1alpha1 kind: OpsRequest metadata: generateName: mysql-uaeapw-switchover- namespace: ns-oihey spec: clusterName: mysql-uaeapw type: Switchover switchover: - componentName: mysql candidateName: 'mysql-uaeapw-mysql-1' instanceName: 'mysql-uaeapw-mysql-0' `kubectl create -f test_create_mysql-uaeapw_switchover.yaml` opsrequest.operations.kubeblocks.io/mysql-uaeapw-switchover-nsnwq created create test_create_mysql-uaeapw_switchover.yaml Success `rm -rf test_create_mysql-uaeapw_switchover.yaml` switchover pod:mysql-uaeapw-mysql-0 checking switchover... switchover pod:mysql-uaeapw-mysql-0 checking switchover... switchover pod:mysql-uaeapw-mysql-0 checking switchover... switchover pod:mysql-uaeapw-mysql-0 checking switchover... switchover pod:mysql-uaeapw-mysql-0 checking switchover... switchover pod:mysql-uaeapw-mysql-0 checking switchover... switchover pod:mysql-uaeapw-mysql-0 checking switchover... switchover pod:mysql-uaeapw-mysql-0 checking switchover... switchover pod:mysql-uaeapw-mysql-0 checking switchover... switchover pod:mysql-uaeapw-mysql-0 checking switchover... switchover pod:mysql-uaeapw-mysql-0 checking switchover... switchover pod:mysql-uaeapw-mysql-0 checking switchover... switchover pod:mysql-uaeapw-mysql-0 checking switchover... switchover pod:mysql-uaeapw-mysql-0 checking switchover... switchover pod:mysql-uaeapw-mysql-0 checking switchover... switchover pod:mysql-uaeapw-mysql-0 checking switchover... switchover pod:mysql-uaeapw-mysql-0 checking switchover... switchover pod:mysql-uaeapw-mysql-0 checking switchover... switchover pod:mysql-uaeapw-mysql-0 checking switchover... switchover pod:mysql-uaeapw-mysql-0 checking switchover... switchover pod:mysql-uaeapw-mysql-0 checking switchover... switchover pod:mysql-uaeapw-mysql-0 checking switchover... switchover pod:mysql-uaeapw-mysql-0 checking switchover... switchover pod:mysql-uaeapw-mysql-0 checking switchover... switchover pod:mysql-uaeapw-mysql-0 checking switchover... switchover pod:mysql-uaeapw-mysql-0 checking switchover... switchover pod:mysql-uaeapw-mysql-0 checking switchover... switchover pod:mysql-uaeapw-mysql-0 checking switchover... switchover pod:mysql-uaeapw-mysql-0 checking switchover... switchover pod:mysql-uaeapw-mysql-0 checking switchover... switchover pod:mysql-uaeapw-mysql-0 checking switchover... switchover pod:mysql-uaeapw-mysql-0 checking switchover... switchover pod:mysql-uaeapw-mysql-0 checking switchover... switchover pod:mysql-uaeapw-mysql-0 checking switchover... switchover pod:mysql-uaeapw-mysql-0 checking switchover... switchover pod:mysql-uaeapw-mysql-0 checking switchover... switchover pod:mysql-uaeapw-mysql-0 checking switchover... switchover pod:mysql-uaeapw-mysql-0 checking switchover... switchover pod:mysql-uaeapw-mysql-0 checking switchover... switchover pod:mysql-uaeapw-mysql-0 checking switchover... switchover pod:mysql-uaeapw-mysql-0 checking switchover... switchover pod:mysql-uaeapw-mysql-0 checking switchover... switchover pod:mysql-uaeapw-mysql-0 checking switchover... switchover pod:mysql-uaeapw-mysql-0 checking switchover... switchover pod:mysql-uaeapw-mysql-1 switchover success No resources found in ns-oihey namespace. `kubectl get secrets -l app.kubernetes.io/instance=mysql-uaeapw` set secret: mysql-uaeapw-mysql-account-root `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:29FV699wpG;DB_PORT:3306;DB_DATABASE:mysql apiVersion: v1 kind: Pod metadata: name: benchtest-mysql-uaeapw namespace: ns-oihey spec: containers: - name: test-sysbench imagePullPolicy: IfNotPresent image: docker.io/apecloud/customsuites:latest env: - name: TYPE value: "2" - name: FLAG value: "0" - name: CONFIGS value: "mode:all,driver:mysql,host:mysql-uaeapw-mysql.ns-oihey.svc.cluster.local,user:root,password:29FV699wpG,port:3306,db:benchtest,tables:5,threads:4,times:10,size:1000,type:oltp_read_write" restartPolicy: Never `kubectl apply -f benchtest-mysql-uaeapw.yaml` pod/benchtest-mysql-uaeapw created apply benchtest-mysql-uaeapw.yaml Success check pod status pod_status:NAME READY STATUS RESTARTS AGE benchtest-mysql-uaeapw 0/1 ContainerCreating 0 0s pod_status:NAME READY STATUS RESTARTS AGE benchtest-mysql-uaeapw 1/1 Running 0 5s pod_status:NAME READY STATUS RESTARTS AGE benchtest-mysql-uaeapw 1/1 Running 0 10s check pod benchtest-mysql-uaeapw status done pod_status:NAME READY STATUS RESTARTS AGE benchtest-mysql-uaeapw 0/1 Completed 0 15s `rm -rf benchtest-mysql-uaeapw.yaml` `kubectl logs benchtest-mysql-uaeapw --tail 30 --namespace ns-oihey ` [ 7s ] thds: 4 tps: 39.01 qps: 758.19 (r/w/o: 526.14/154.04/78.02) lat (ms,99%): 189.93 err/s: 0.00 reconn/s: 0.00 [ 8s ] thds: 4 tps: 43.00 qps: 884.00 (r/w/o: 622.00/176.00/86.00) lat (ms,99%): 183.21 err/s: 0.00 reconn/s: 0.00 [ 9s ] thds: 4 tps: 42.00 qps: 823.98 (r/w/o: 576.98/163.00/84.00) lat (ms,99%): 186.54 err/s: 0.00 reconn/s: 0.00 [ 10s ] thds: 4 tps: 41.00 qps: 833.02 (r/w/o: 585.01/166.00/82.00) lat (ms,99%): 277.21 err/s: 0.00 reconn/s: 0.00 SQL statistics: queries performed: read: 5768 write: 1648 other: 824 total: 8240 transactions: 412 (40.81 per sec.) queries: 8240 (816.12 per sec.) ignored errors: 0 (0.00 per sec.) reconnects: 0 (0.00 per sec.) General statistics: total time: 10.0949s total number of events: 412 Latency (ms): min: 11.95 avg: 97.40 max: 279.40 99th percentile: 189.93 sum: 40128.53 Threads fairness: events (avg/stddev): 103.0000/4.42 execution time (avg/stddev): 10.0321/0.04 `kubectl delete pod benchtest-mysql-uaeapw --force --namespace ns-oihey ` Warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely. pod "benchtest-mysql-uaeapw" force deleted LB_TYPE is set to: intranet No resources found in ns-oihey namespace. `kubectl get secrets -l app.kubernetes.io/instance=mysql-uaeapw` set secret: mysql-uaeapw-mysql-account-root `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:29FV699wpG;DB_PORT:3306;DB_DATABASE:mysql apiVersion: v1 kind: Pod metadata: name: benchtest-mysql-uaeapw namespace: ns-oihey spec: containers: - name: test-sysbench imagePullPolicy: IfNotPresent image: docker.io/apecloud/customsuites:latest env: - name: TYPE value: "2" - name: FLAG value: "0" - name: CONFIGS value: "mode:all,driver:mysql,host:10.224.0.8,user:root,password:29FV699wpG,port:3306,db:benchtest,tables:5,threads:4,times:10,size:1000,type:oltp_read_write" restartPolicy: Never `kubectl apply -f benchtest-mysql-uaeapw.yaml` pod/benchtest-mysql-uaeapw created apply benchtest-mysql-uaeapw.yaml Success check pod status pod_status:NAME READY STATUS RESTARTS AGE benchtest-mysql-uaeapw 0/1 ContainerCreating 0 0s pod_status:NAME READY STATUS RESTARTS AGE benchtest-mysql-uaeapw 1/1 Running 0 5s pod_status:NAME READY STATUS RESTARTS AGE benchtest-mysql-uaeapw 1/1 Running 0 10s check pod benchtest-mysql-uaeapw status done pod_status:NAME READY STATUS RESTARTS AGE benchtest-mysql-uaeapw 0/1 Completed 0 15s `rm -rf benchtest-mysql-uaeapw.yaml` `kubectl logs benchtest-mysql-uaeapw --tail 30 --namespace ns-oihey ` [ 7s ] thds: 4 tps: 41.05 qps: 816.98 (r/w/o: 574.69/160.19/82.10) lat (ms,99%): 207.82 err/s: 0.00 reconn/s: 0.00 [ 8s ] thds: 4 tps: 38.99 qps: 783.82 (r/w/o: 545.87/159.96/77.98) lat (ms,99%): 189.93 err/s: 0.00 reconn/s: 0.00 [ 9s ] thds: 4 tps: 42.01 qps: 823.12 (r/w/o: 579.08/160.02/84.01) lat (ms,99%): 193.38 err/s: 0.00 reconn/s: 0.00 [ 10s ] thds: 4 tps: 41.00 qps: 827.07 (r/w/o: 581.05/164.01/82.01) lat (ms,99%): 200.47 err/s: 0.00 reconn/s: 0.00 SQL statistics: queries performed: read: 5754 write: 1644 other: 822 total: 8220 transactions: 411 (40.65 per sec.) queries: 8220 (813.01 per sec.) ignored errors: 0 (0.00 per sec.) reconnects: 0 (0.00 per sec.) General statistics: total time: 10.1089s total number of events: 411 Latency (ms): min: 12.76 avg: 97.68 max: 210.43 99th percentile: 200.47 sum: 40147.08 Threads fairness: events (avg/stddev): 102.7500/3.77 execution time (avg/stddev): 10.0368/0.04 `kubectl delete pod benchtest-mysql-uaeapw --force --namespace ns-oihey ` Warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely. pod "benchtest-mysql-uaeapw" force deleted cluster stop check cluster status before ops check cluster status done cluster_status:Running `kbcli cluster stop mysql-uaeapw --auto-approve --force=true --namespace ns-oihey ` OpsRequest mysql-uaeapw-stop-rmh2m created successfully, you can view the progress: kbcli cluster describe-ops mysql-uaeapw-stop-rmh2m -n ns-oihey check ops status `kbcli cluster list-ops mysql-uaeapw --status all --namespace ns-oihey ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME mysql-uaeapw-switchover-nsnwq ns-oihey Switchover mysql-uaeapw mysql Succeed 1/1 Sep 12,2025 14:07 UTC+0800 mysql-uaeapw-stop-rmh2m ns-oihey Stop mysql-uaeapw Running -/- Sep 12,2025 14:11 UTC+0800 check cluster status `kbcli cluster list mysql-uaeapw --show-labels --namespace ns-oihey ` NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS mysql-uaeapw ns-oihey mysql Delete Stopping Sep 12,2025 13:05 UTC+0800 app.kubernetes.io/instance=mysql-uaeapw,clusterdefinition.kubeblocks.io/name=mysql cluster_status:Stopping cluster_status:Stopping cluster_status:Stopping cluster_status:Stopping cluster_status:Stopping cluster_status:Stopping cluster_status:Stopping cluster_status:Stopping check cluster status done cluster_status:Stopped check pod status `kbcli cluster list-instances mysql-uaeapw --namespace ns-oihey ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME check pod status done check ops status `kbcli cluster list-ops mysql-uaeapw --status all --namespace ns-oihey ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME mysql-uaeapw-switchover-nsnwq ns-oihey Switchover mysql-uaeapw mysql Succeed 1/1 Sep 12,2025 14:07 UTC+0800 mysql-uaeapw-stop-rmh2m ns-oihey Stop mysql-uaeapw mysql Succeed 2/2 Sep 12,2025 14:11 UTC+0800 check ops status done ops_status:mysql-uaeapw-stop-rmh2m ns-oihey Stop mysql-uaeapw mysql Succeed 2/2 Sep 12,2025 14:11 UTC+0800 `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge opsrequests.operations mysql-uaeapw-stop-rmh2m --namespace ns-oihey ` opsrequest.operations.kubeblocks.io/mysql-uaeapw-stop-rmh2m patched `kbcli cluster delete-ops --name mysql-uaeapw-stop-rmh2m --force --auto-approve --namespace ns-oihey ` OpsRequest mysql-uaeapw-stop-rmh2m deleted cluster start check cluster status before ops check cluster status done cluster_status:Stopped `kbcli cluster start mysql-uaeapw --force=true --namespace ns-oihey ` OpsRequest mysql-uaeapw-start-zf8vl created successfully, you can view the progress: kbcli cluster describe-ops mysql-uaeapw-start-zf8vl -n ns-oihey check ops status `kbcli cluster list-ops mysql-uaeapw --status all --namespace ns-oihey ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME mysql-uaeapw-switchover-nsnwq ns-oihey Switchover mysql-uaeapw mysql Succeed 1/1 Sep 12,2025 14:07 UTC+0800 mysql-uaeapw-start-zf8vl ns-oihey Start mysql-uaeapw mysql Running 0/2 Sep 12,2025 14:11 UTC+0800 check cluster status `kbcli cluster list mysql-uaeapw --show-labels --namespace ns-oihey ` NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS mysql-uaeapw ns-oihey mysql Delete Updating Sep 12,2025 13:05 UTC+0800 app.kubernetes.io/instance=mysql-uaeapw,clusterdefinition.kubeblocks.io/name=mysql cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances mysql-uaeapw --namespace ns-oihey ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME mysql-uaeapw-mysql-0 ns-oihey mysql-uaeapw mysql Running primary 0 200m / 200m 644245094400m / 644245094400m data:12Gi aks-cicdamdpool-13759654-vmss000002/10.224.0.6 Sep 12,2025 14:11 UTC+0800 mysql-uaeapw-mysql-1 ns-oihey mysql-uaeapw mysql Running secondary 0 200m / 200m 644245094400m / 644245094400m data:12Gi aks-cicdamdpool-13759654-vmss000000/10.224.0.5 Sep 12,2025 14:13 UTC+0800 check pod status done check cluster role check cluster role done primary: mysql-uaeapw-mysql-0;secondary: mysql-uaeapw-mysql-1 `kubectl get secrets -l app.kubernetes.io/instance=mysql-uaeapw` set secret: mysql-uaeapw-mysql-account-root `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:29FV699wpG;DB_PORT:3306;DB_DATABASE:mysql check cluster connect `echo " echo \"SHOW SLAVE STATUS\G;\" | mysql -P3306 -h127.0.0.1 -uroot -p'29FV699wpG' " | kubectl exec -it mysql-uaeapw-mysql-1 --namespace ns-oihey -- bash ` check cluster connect done check ops status `kbcli cluster list-ops mysql-uaeapw --status all --namespace ns-oihey ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME mysql-uaeapw-switchover-nsnwq ns-oihey Switchover mysql-uaeapw mysql Succeed 1/1 Sep 12,2025 14:07 UTC+0800 mysql-uaeapw-start-zf8vl ns-oihey Start mysql-uaeapw mysql Succeed 2/2 Sep 12,2025 14:11 UTC+0800 check ops status done ops_status:mysql-uaeapw-start-zf8vl ns-oihey Start mysql-uaeapw mysql Succeed 2/2 Sep 12,2025 14:11 UTC+0800 `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge opsrequests.operations mysql-uaeapw-start-zf8vl --namespace ns-oihey ` opsrequest.operations.kubeblocks.io/mysql-uaeapw-start-zf8vl patched `kbcli cluster delete-ops --name mysql-uaeapw-start-zf8vl --force --auto-approve --namespace ns-oihey ` OpsRequest mysql-uaeapw-start-zf8vl deleted `kubectl get secrets -l app.kubernetes.io/instance=mysql-uaeapw` set secret: mysql-uaeapw-mysql-account-root `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:29FV699wpG;DB_PORT:3306;DB_DATABASE:mysql check db_client batch data count `echo "echo \"select count(*) from executions_loop.executions_loop_table;\" | mysql -P3306 -hmysql-uaeapw-mysql.ns-oihey.svc.cluster.local -uroot -p'29FV699wpG' " | kubectl exec -it mysql-uaeapw-mysql-0 --namespace ns-oihey -- bash ` check db_client batch data Success `kubectl get secrets -l app.kubernetes.io/instance=mysql-uaeapw` set secret: mysql-uaeapw-mysql-account-root `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:29FV699wpG;DB_PORT:3306;DB_DATABASE:mysql check readonly db_client batch data count `echo "echo \"select count(*) from executions_loop.executions_loop_table;\" | mysql -P3306 -h127.0.0.1 -uroot -p'29FV699wpG' " | kubectl exec -it mysql-uaeapw-mysql-1 --namespace ns-oihey -- bash ` check readonly db_client batch data Success test failover dnsrandom check cluster status before cluster-failover-dnsrandom check cluster status done cluster_status:Running `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge DNSChaos test-chaos-mesh-dnsrandom-mysql-uaeapw --namespace ns-oihey ` Warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely. Error from server (NotFound): dnschaos.chaos-mesh.org "test-chaos-mesh-dnsrandom-mysql-uaeapw" not found Error from server (NotFound): dnschaos.chaos-mesh.org "test-chaos-mesh-dnsrandom-mysql-uaeapw" not found apiVersion: chaos-mesh.org/v1alpha1 kind: DNSChaos metadata: name: test-chaos-mesh-dnsrandom-mysql-uaeapw namespace: ns-oihey spec: selector: namespaces: - ns-oihey labelSelectors: apps.kubeblocks.io/pod-name: mysql-uaeapw-mysql-0 mode: all action: random duration: 2m `kubectl apply -f test-chaos-mesh-dnsrandom-mysql-uaeapw.yaml` dnschaos.chaos-mesh.org/test-chaos-mesh-dnsrandom-mysql-uaeapw created apply test-chaos-mesh-dnsrandom-mysql-uaeapw.yaml Success `rm -rf test-chaos-mesh-dnsrandom-mysql-uaeapw.yaml` dnsrandom chaos test waiting 120 seconds check cluster status `kbcli cluster list mysql-uaeapw --show-labels --namespace ns-oihey ` NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS mysql-uaeapw ns-oihey mysql Delete Running Sep 12,2025 13:05 UTC+0800 app.kubernetes.io/instance=mysql-uaeapw,clusterdefinition.kubeblocks.io/name=mysql check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances mysql-uaeapw --namespace ns-oihey ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME mysql-uaeapw-mysql-0 ns-oihey mysql-uaeapw mysql Running primary 0 200m / 200m 644245094400m / 644245094400m data:12Gi aks-cicdamdpool-13759654-vmss000002/10.224.0.6 Sep 12,2025 14:11 UTC+0800 mysql-uaeapw-mysql-1 ns-oihey mysql-uaeapw mysql Running secondary 0 200m / 200m 644245094400m / 644245094400m data:12Gi aks-cicdamdpool-13759654-vmss000000/10.224.0.5 Sep 12,2025 14:13 UTC+0800 check pod status done check cluster role check cluster role done primary: mysql-uaeapw-mysql-0;secondary: mysql-uaeapw-mysql-1 `kubectl get secrets -l app.kubernetes.io/instance=mysql-uaeapw` set secret: mysql-uaeapw-mysql-account-root `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:29FV699wpG;DB_PORT:3306;DB_DATABASE:mysql check cluster connect `echo " echo \"SHOW SLAVE STATUS\G;\" | mysql -P3306 -h127.0.0.1 -uroot -p'29FV699wpG' " | kubectl exec -it mysql-uaeapw-mysql-1 --namespace ns-oihey -- bash ` check cluster connect done `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge DNSChaos test-chaos-mesh-dnsrandom-mysql-uaeapw --namespace ns-oihey ` Warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely. dnschaos.chaos-mesh.org "test-chaos-mesh-dnsrandom-mysql-uaeapw" force deleted Error from server (NotFound): dnschaos.chaos-mesh.org "test-chaos-mesh-dnsrandom-mysql-uaeapw" not found check failover pod name failover pod name:mysql-uaeapw-mysql-0 failover dnsrandom Success `kubectl get secrets -l app.kubernetes.io/instance=mysql-uaeapw` set secret: mysql-uaeapw-mysql-account-root `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:29FV699wpG;DB_PORT:3306;DB_DATABASE:mysql check db_client batch data count `echo "echo \"select count(*) from executions_loop.executions_loop_table;\" | mysql -P3306 -hmysql-uaeapw-mysql.ns-oihey.svc.cluster.local -uroot -p'29FV699wpG' " | kubectl exec -it mysql-uaeapw-mysql-0 --namespace ns-oihey -- bash ` check db_client batch data Success `kubectl get secrets -l app.kubernetes.io/instance=mysql-uaeapw` set secret: mysql-uaeapw-mysql-account-root `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:29FV699wpG;DB_PORT:3306;DB_DATABASE:mysql check readonly db_client batch data count `echo "echo \"select count(*) from executions_loop.executions_loop_table;\" | mysql -P3306 -h127.0.0.1 -uroot -p'29FV699wpG' " | kubectl exec -it mysql-uaeapw-mysql-1 --namespace ns-oihey -- bash ` check readonly db_client batch data Success test failover podkill check cluster status before cluster-failover-podkill check cluster status done cluster_status:Running `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge PodChaos test-chaos-mesh-podkill-mysql-uaeapw --namespace ns-oihey ` Warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely. Error from server (NotFound): podchaos.chaos-mesh.org "test-chaos-mesh-podkill-mysql-uaeapw" not found Error from server (NotFound): podchaos.chaos-mesh.org "test-chaos-mesh-podkill-mysql-uaeapw" not found apiVersion: chaos-mesh.org/v1alpha1 kind: PodChaos metadata: name: test-chaos-mesh-podkill-mysql-uaeapw namespace: ns-oihey spec: selector: namespaces: - ns-oihey labelSelectors: apps.kubeblocks.io/pod-name: mysql-uaeapw-mysql-0 mode: all action: pod-kill `kubectl apply -f test-chaos-mesh-podkill-mysql-uaeapw.yaml` podchaos.chaos-mesh.org/test-chaos-mesh-podkill-mysql-uaeapw created apply test-chaos-mesh-podkill-mysql-uaeapw.yaml Success `rm -rf test-chaos-mesh-podkill-mysql-uaeapw.yaml` check cluster status `kbcli cluster list mysql-uaeapw --show-labels --namespace ns-oihey ` NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS mysql-uaeapw ns-oihey mysql Delete Updating Sep 12,2025 13:05 UTC+0800 app.kubernetes.io/instance=mysql-uaeapw,clusterdefinition.kubeblocks.io/name=mysql cluster_status:Updating check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances mysql-uaeapw --namespace ns-oihey ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME mysql-uaeapw-mysql-0 ns-oihey mysql-uaeapw mysql Running secondary 0 200m / 200m 644245094400m / 644245094400m data:12Gi aks-cicdamdpool-13759654-vmss000002/10.224.0.6 Sep 12,2025 14:16 UTC+0800 mysql-uaeapw-mysql-1 ns-oihey mysql-uaeapw mysql Running primary 0 200m / 200m 644245094400m / 644245094400m data:12Gi aks-cicdamdpool-13759654-vmss000000/10.224.0.5 Sep 12,2025 14:13 UTC+0800 check pod status done check cluster role check cluster role done primary: mysql-uaeapw-mysql-1;secondary: mysql-uaeapw-mysql-0 `kubectl get secrets -l app.kubernetes.io/instance=mysql-uaeapw` set secret: mysql-uaeapw-mysql-account-root `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:29FV699wpG;DB_PORT:3306;DB_DATABASE:mysql check cluster connect `echo " echo \"SHOW SLAVE STATUS\G;\" | mysql -P3306 -h127.0.0.1 -uroot -p'29FV699wpG' " | kubectl exec -it mysql-uaeapw-mysql-0 --namespace ns-oihey -- bash ` check cluster connect done `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge PodChaos test-chaos-mesh-podkill-mysql-uaeapw --namespace ns-oihey ` Warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely. podchaos.chaos-mesh.org "test-chaos-mesh-podkill-mysql-uaeapw" force deleted podchaos.chaos-mesh.org/test-chaos-mesh-podkill-mysql-uaeapw patched check failover pod name failover pod name:mysql-uaeapw-mysql-1 failover podkill Success `kubectl get secrets -l app.kubernetes.io/instance=mysql-uaeapw` set secret: mysql-uaeapw-mysql-account-root `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:29FV699wpG;DB_PORT:3306;DB_DATABASE:mysql check db_client batch data count `echo "echo \"select count(*) from executions_loop.executions_loop_table;\" | mysql -P3306 -hmysql-uaeapw-mysql.ns-oihey.svc.cluster.local -uroot -p'29FV699wpG' " | kubectl exec -it mysql-uaeapw-mysql-1 --namespace ns-oihey -- bash ` check db_client batch data Success `kubectl get secrets -l app.kubernetes.io/instance=mysql-uaeapw` set secret: mysql-uaeapw-mysql-account-root `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:29FV699wpG;DB_PORT:3306;DB_DATABASE:mysql check readonly db_client batch data count `echo "echo \"select count(*) from executions_loop.executions_loop_table;\" | mysql -P3306 -h127.0.0.1 -uroot -p'29FV699wpG' " | kubectl exec -it mysql-uaeapw-mysql-0 --namespace ns-oihey -- bash ` check readonly db_client batch data Success cluster update terminationPolicy WipeOut `kbcli cluster update mysql-uaeapw --termination-policy=WipeOut --namespace ns-oihey ` cluster.apps.kubeblocks.io/mysql-uaeapw updated check cluster status `kbcli cluster list mysql-uaeapw --show-labels --namespace ns-oihey ` NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS mysql-uaeapw ns-oihey mysql WipeOut Running Sep 12,2025 13:05 UTC+0800 app.kubernetes.io/instance=mysql-uaeapw,clusterdefinition.kubeblocks.io/name=mysql check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances mysql-uaeapw --namespace ns-oihey ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME mysql-uaeapw-mysql-0 ns-oihey mysql-uaeapw mysql Running secondary 0 200m / 200m 644245094400m / 644245094400m data:12Gi aks-cicdamdpool-13759654-vmss000002/10.224.0.6 Sep 12,2025 14:16 UTC+0800 mysql-uaeapw-mysql-1 ns-oihey mysql-uaeapw mysql Running primary 0 200m / 200m 644245094400m / 644245094400m data:12Gi aks-cicdamdpool-13759654-vmss000000/10.224.0.5 Sep 12,2025 14:13 UTC+0800 check pod status done check cluster role check cluster role done primary: mysql-uaeapw-mysql-1;secondary: mysql-uaeapw-mysql-0 `kubectl get secrets -l app.kubernetes.io/instance=mysql-uaeapw` set secret: mysql-uaeapw-mysql-account-root `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:29FV699wpG;DB_PORT:3306;DB_DATABASE:mysql check cluster connect `echo " echo \"SHOW SLAVE STATUS\G;\" | mysql -P3306 -h127.0.0.1 -uroot -p'29FV699wpG' " | kubectl exec -it mysql-uaeapw-mysql-0 --namespace ns-oihey -- bash ` check cluster connect done cluster xtrabackup backup `kubectl get backuprepo backuprepo-kbcli-test -o jsonpath="***.spec.credential.name***"` `kubectl get backuprepo backuprepo-kbcli-test -o jsonpath="***.spec.credential.namespace***"` `kubectl get secrets kb-backuprepo-85gdv -n kb-osxch -o jsonpath="***.data.accessKeyId***"` `kubectl get secrets kb-backuprepo-85gdv -n kb-osxch -o jsonpath="***.data.secretAccessKey***"` KUBEBLOCKS NAMESPACE:kb-osxch get kubeblocks namespace done `kubectl get secrets -l app.kubernetes.io/instance=kbcli-test-minio --namespace kb-osxch -o jsonpath="***.items[0].data.root-user***"` `kubectl get secrets -l app.kubernetes.io/instance=kbcli-test-minio --namespace kb-osxch -o jsonpath="***.items[0].data.root-password***"` minio_user:kbclitest,minio_password:kbclitest,minio_endpoint:kbcli-test-minio.kb-osxch.svc.cluster.local:9000 list minio bucket kbcli-test `echo 'mc config host add minioserver http://kbcli-test-minio.kb-osxch.svc.cluster.local:9000 kbclitest kbclitest;mc ls minioserver' | kubectl exec -it kbcli-test-minio-7664db4c4f-zj7xt --namespace kb-osxch -- bash` Unable to use a TTY - input is not a terminal or the right kind of file list minio bucket done default backuprepo:backuprepo-kbcli-test exists `kbcli cluster backup mysql-uaeapw --method xtrabackup --namespace ns-oihey ` Backup backup-ns-oihey-mysql-uaeapw-20250912141729 created successfully, you can view the progress: kbcli cluster list-backups --names=backup-ns-oihey-mysql-uaeapw-20250912141729 -n ns-oihey check backup status `kbcli cluster list-backups mysql-uaeapw --namespace ns-oihey ` NAME NAMESPACE SOURCE-CLUSTER METHOD STATUS TOTAL-SIZE DURATION DELETION-POLICY CREATE-TIME COMPLETION-TIME EXPIRATION backup-ns-oihey-mysql-uaeapw-20250912141729 ns-oihey mysql-uaeapw xtrabackup Delete Sep 12,2025 14:17 UTC+0800 backup_status:mysql-uaeapw-xtrabackup-Running backup_status:mysql-uaeapw-xtrabackup-Running backup_status:mysql-uaeapw-xtrabackup-Running backup_status:mysql-uaeapw-xtrabackup-Running check backup status done backup_status:backup-ns-oihey-mysql-uaeapw-20250912141729 ns-oihey mysql-uaeapw xtrabackup Completed 7718045 15s Delete Sep 12,2025 14:17 UTC+0800 Sep 12,2025 14:17 UTC+0800 `kubectl get secrets -l app.kubernetes.io/instance=mysql-uaeapw` set secret: mysql-uaeapw-mysql-account-root `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:29FV699wpG;DB_PORT:3306;DB_DATABASE:mysql `CREATE DATABASE IF NOT EXISTS kbclidb;CREATE TABLE IF NOT EXISTS kbclidb.msg (id INT UNSIGNED NOT NULL AUTO_INCREMENT,msg TEXT,time TIMESTAMP NULL,PRIMARY KEY (id)) ENGINE=InnoDB DEFAULT CHARSET=utf8mb4;insert into kbclidb.msg (msg, time) values ('kbcli-test-data-uaeapw0', CURRENT_TIMESTAMP);` Defaulted container "mysql" out of: mysql, mysql-exporter, kbagent, config-manager, init-data (init), init-xtrabackup (init), init-jemalloc (init), init-syncer (init), init-kbagent (init), kbagent-worker (init) Unable to use a TTY - input is not a terminal or the right kind of file Warning: arning] Using a password on the command line interface can be insecure. `kubectl get secrets -l app.kubernetes.io/instance=mysql-uaeapw` set secret: mysql-uaeapw-mysql-account-root `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:29FV699wpG;DB_PORT:3306;DB_DATABASE:mysql `insert into kbclidb.msg (msg, time) values ('kbcli-test-data-uaeapw1', CURRENT_TIMESTAMP);` Defaulted container "mysql" out of: mysql, mysql-exporter, kbagent, config-manager, init-data (init), init-xtrabackup (init), init-jemalloc (init), init-syncer (init), init-kbagent (init), kbagent-worker (init) Unable to use a TTY - input is not a terminal or the right kind of file Warning: arning] Using a password on the command line interface can be insecure. Defaulted container "mysql" out of: mysql, mysql-exporter, kbagent, config-manager, init-data (init), init-xtrabackup (init), init-jemalloc (init), init-syncer (init), init-kbagent (init), kbagent-worker (init) Unable to use a TTY - input is not a terminal or the right kind of file Warning: arning] Using a password on the command line interface can be insecure. `kubectl get secrets -l app.kubernetes.io/instance=mysql-uaeapw` set secret: mysql-uaeapw-mysql-account-root `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:29FV699wpG;DB_PORT:3306;DB_DATABASE:mysql `insert into kbclidb.msg (msg, time) values ('kbcli-test-data-uaeapw2', CURRENT_TIMESTAMP);` Defaulted container "mysql" out of: mysql, mysql-exporter, kbagent, config-manager, init-data (init), init-xtrabackup (init), init-jemalloc (init), init-syncer (init), init-kbagent (init), kbagent-worker (init) Unable to use a TTY - input is not a terminal or the right kind of file Warning: arning] Using a password on the command line interface can be insecure. Defaulted container "mysql" out of: mysql, mysql-exporter, kbagent, config-manager, init-data (init), init-xtrabackup (init), init-jemalloc (init), init-syncer (init), init-kbagent (init), kbagent-worker (init) Unable to use a TTY - input is not a terminal or the right kind of file Warning: arning] Using a password on the command line interface can be insecure. `kubectl get secrets -l app.kubernetes.io/instance=mysql-uaeapw` set secret: mysql-uaeapw-mysql-account-root `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:29FV699wpG;DB_PORT:3306;DB_DATABASE:mysql `insert into kbclidb.msg (msg, time) values ('kbcli-test-data-uaeapw3', CURRENT_TIMESTAMP);` Defaulted container "mysql" out of: mysql, mysql-exporter, kbagent, config-manager, init-data (init), init-xtrabackup (init), init-jemalloc (init), init-syncer (init), init-kbagent (init), kbagent-worker (init) Unable to use a TTY - input is not a terminal or the right kind of file Warning: arning] Using a password on the command line interface can be insecure. Defaulted container "mysql" out of: mysql, mysql-exporter, kbagent, config-manager, init-data (init), init-xtrabackup (init), init-jemalloc (init), init-syncer (init), init-kbagent (init), kbagent-worker (init) Unable to use a TTY - input is not a terminal or the right kind of file Warning: arning] Using a password on the command line interface can be insecure. cluster xtrabackup-inc backup `kubectl get backuprepo backuprepo-kbcli-test -o jsonpath="***.spec.credential.name***"` `kubectl get backuprepo backuprepo-kbcli-test -o jsonpath="***.spec.credential.namespace***"` `kubectl get secrets kb-backuprepo-85gdv -n kb-osxch -o jsonpath="***.data.accessKeyId***"` `kubectl get secrets kb-backuprepo-85gdv -n kb-osxch -o jsonpath="***.data.secretAccessKey***"` KUBEBLOCKS NAMESPACE:kb-osxch get kubeblocks namespace done `kubectl get secrets -l app.kubernetes.io/instance=kbcli-test-minio --namespace kb-osxch -o jsonpath="***.items[0].data.root-user***"` `kubectl get secrets -l app.kubernetes.io/instance=kbcli-test-minio --namespace kb-osxch -o jsonpath="***.items[0].data.root-password***"` minio_user:kbclitest,minio_password:kbclitest,minio_endpoint:kbcli-test-minio.kb-osxch.svc.cluster.local:9000 list minio bucket kbcli-test `echo 'mc config host add minioserver http://kbcli-test-minio.kb-osxch.svc.cluster.local:9000 kbclitest kbclitest;mc ls minioserver' | kubectl exec -it kbcli-test-minio-7664db4c4f-zj7xt --namespace kb-osxch -- bash` Unable to use a TTY - input is not a terminal or the right kind of file list minio bucket done default backuprepo:backuprepo-kbcli-test exists `kbcli cluster backup mysql-uaeapw --method xtrabackup-inc --namespace ns-oihey ` Backup backup-ns-oihey-mysql-uaeapw-20250912141814 created successfully, you can view the progress: kbcli cluster list-backups --names=backup-ns-oihey-mysql-uaeapw-20250912141814 -n ns-oihey check backup status `kbcli cluster list-backups mysql-uaeapw --namespace ns-oihey ` NAME NAMESPACE SOURCE-CLUSTER METHOD STATUS TOTAL-SIZE DURATION DELETION-POLICY CREATE-TIME COMPLETION-TIME EXPIRATION backup-ns-oihey-mysql-uaeapw-20250912141729 ns-oihey mysql-uaeapw xtrabackup Completed 7718045 15s Delete Sep 12,2025 14:17 UTC+0800 Sep 12,2025 14:17 UTC+0800 backup-ns-oihey-mysql-uaeapw-20250912141814 ns-oihey mysql-uaeapw xtrabackup-inc Running Delete Sep 12,2025 14:18 UTC+0800 backup_status:mysql-uaeapw-xtrabackup-inc-Running backup_status:mysql-uaeapw-xtrabackup-inc-Running backup_status:mysql-uaeapw-xtrabackup-inc-Running check backup status done backup_status:backup-ns-oihey-mysql-uaeapw-20250912141814 ns-oihey mysql-uaeapw xtrabackup-inc Completed 679901 11s Delete Sep 12,2025 14:18 UTC+0800 Sep 12,2025 14:18 UTC+0800 cluster restore backup Error from server (NotFound): opsrequests.operations.kubeblocks.io "abk-uaeapw" not found `kbcli cluster describe-backup --names backup-ns-oihey-mysql-uaeapw-20250912141814 --namespace ns-oihey ` Name: backup-ns-oihey-mysql-uaeapw-20250912141814 Cluster: mysql-uaeapw Namespace: ns-oihey Spec: Method: xtrabackup-inc Policy Name: mysql-uaeapw-mysql-backup-policy Actions: dp-backup-0: ActionType: Job WorkloadName: dp-backup-0-backup-ns-oihey-mysql-uaeapw-20250912141814-edd8581 TargetPodName: mysql-uaeapw-mysql-0 Phase: Completed Start Time: Sep 12,2025 14:18 UTC+0800 Completion Time: Sep 12,2025 14:18 UTC+0800 Status: Phase: Completed Total Size: 679901 ActionSet Name: mysql-xtrabackup-inc-br Repository: backuprepo-kbcli-test Duration: 11s Start Time: Sep 12,2025 14:18 UTC+0800 Completion Time: Sep 12,2025 14:18 UTC+0800 Path: /ns-oihey/mysql-uaeapw-8b0c2eba-1f93-4562-a606-56f7d217996c/mysql/backup-ns-oihey-mysql-uaeapw-20250912141814 Warning Events: `kbcli cluster restore abk-uaeapw --backup backup-ns-oihey-mysql-uaeapw-20250912141814 --namespace ns-oihey ` Cluster abk-uaeapw created check cluster status `kbcli cluster list abk-uaeapw --show-labels --namespace ns-oihey ` NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS abk-uaeapw ns-oihey mysql WipeOut Creating Sep 12,2025 14:18 UTC+0800 clusterdefinition.kubeblocks.io/name=mysql cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances abk-uaeapw --namespace ns-oihey ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME abk-uaeapw-mysql-0 ns-oihey abk-uaeapw mysql Running primary 0 200m / 200m 644245094400m / 644245094400m data:12Gi aks-cicdamdpool-13759654-vmss000002/10.224.0.6 Sep 12,2025 14:19 UTC+0800 abk-uaeapw-mysql-1 ns-oihey abk-uaeapw mysql Running secondary 0 200m / 200m 644245094400m / 644245094400m data:12Gi aks-cicdamdpool-13759654-vmss000000/10.224.0.5 Sep 12,2025 14:19 UTC+0800 check pod status done check cluster role check cluster role done primary: abk-uaeapw-mysql-0;secondary: abk-uaeapw-mysql-1 `kubectl get secrets -l app.kubernetes.io/instance=abk-uaeapw` set secret: abk-uaeapw-mysql-account-root `kubectl get secrets abk-uaeapw-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets abk-uaeapw-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets abk-uaeapw-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:29FV699wpG;DB_PORT:3306;DB_DATABASE:mysql check cluster connect `echo " echo \"SHOW SLAVE STATUS\G;\" | mysql -P3306 -h127.0.0.1 -uroot -p'29FV699wpG' " | kubectl exec -it abk-uaeapw-mysql-1 --namespace ns-oihey -- bash ` connect checking... check cluster connect done `kbcli cluster describe-backup --names backup-ns-oihey-mysql-uaeapw-20250912141814 --namespace ns-oihey ` Name: backup-ns-oihey-mysql-uaeapw-20250912141814 Cluster: mysql-uaeapw Namespace: ns-oihey Spec: Method: xtrabackup-inc Policy Name: mysql-uaeapw-mysql-backup-policy Actions: dp-backup-0: ActionType: Job WorkloadName: dp-backup-0-backup-ns-oihey-mysql-uaeapw-20250912141814-edd8581 TargetPodName: mysql-uaeapw-mysql-0 Phase: Completed Start Time: Sep 12,2025 14:18 UTC+0800 Completion Time: Sep 12,2025 14:18 UTC+0800 Status: Phase: Completed Total Size: 679901 ActionSet Name: mysql-xtrabackup-inc-br Repository: backuprepo-kbcli-test Duration: 11s Start Time: Sep 12,2025 14:18 UTC+0800 Completion Time: Sep 12,2025 14:18 UTC+0800 Path: /ns-oihey/mysql-uaeapw-8b0c2eba-1f93-4562-a606-56f7d217996c/mysql/backup-ns-oihey-mysql-uaeapw-20250912141814 Warning Events: `kubectl get secrets -l app.kubernetes.io/instance=abk-uaeapw` set secret: abk-uaeapw-mysql-account-root `kubectl get secrets abk-uaeapw-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets abk-uaeapw-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets abk-uaeapw-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:29FV699wpG;DB_PORT:3306;DB_DATABASE:mysql `select * from kbclidb.msg;` Defaulted container "mysql" out of: mysql, mysql-exporter, kbagent, config-manager, init-data (init), init-xtrabackup (init), init-jemalloc (init), init-syncer (init), init-kbagent (init), kbagent-worker (init) Unable to use a TTY - input is not a terminal or the right kind of file Warning: arning] Using a password on the command line interface can be insecure. id msg time 1 kbcli-test-data-uaeapw0 2025-09-12 06:17:51 2 kbcli-test-data-uaeapw1 2025-09-12 06:17:52 3 kbcli-test-data-uaeapw2 2025-09-12 06:17:59 4 kbcli-test-data-uaeapw3 2025-09-12 06:18:06 Point-In-Time Recovery Success `kubectl get secrets -l app.kubernetes.io/instance=mysql-uaeapw` set secret: mysql-uaeapw-mysql-account-root `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:29FV699wpG;DB_PORT:3306;DB_DATABASE:mysql cluster connect `kubectl get secrets -l app.kubernetes.io/instance=abk-uaeapw` set secret: abk-uaeapw-mysql-account-root `kubectl get secrets abk-uaeapw-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets abk-uaeapw-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets abk-uaeapw-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:29FV699wpG;DB_PORT:3306;DB_DATABASE:mysql Defaulted container "mysql" out of: mysql, mysql-exporter, kbagent, config-manager, init-data (init), init-xtrabackup (init), init-jemalloc (init), init-syncer (init), init-kbagent (init), kbagent-worker (init) Unable to use a TTY - input is not a terminal or the right kind of file Warning: arning] Using a password on the command line interface can be insecure. *************************** 1. row *************************** Slave_IO_State: Waiting for source to send event Master_Host: abk-uaeapw-mysql-0.abk-uaeapw-mysql-headless Master_User: kbreplicator Master_Port: 3306 Connect_Retry: 60 Master_Log_File: abk-uaeapw-mysql-0-bin.000001 Read_Master_Log_Pos: 14192 Relay_Log_File: relay-bin.000002 Relay_Log_Pos: 14033 Relay_Master_Log_File: abk-uaeapw-mysql-0-bin.000001 Slave_IO_Running: Yes Slave_SQL_Running: Yes Replicate_Do_DB: Replicate_Ignore_DB: Replicate_Do_Table: Replicate_Ignore_Table: Replicate_Wild_Do_Table: Replicate_Wild_Ignore_Table: Last_Errno: 0 Last_Error: Skip_Counter: 0 Exec_Master_Log_Pos: 13791 Relay_Log_Space: 14638 Until_Condition: None Until_Log_File: Until_Log_Pos: 0 Master_SSL_Allowed: Yes Master_SSL_CA_File: Master_SSL_CA_Path: Master_SSL_Cert: Master_SSL_Cipher: Master_SSL_Key: Seconds_Behind_Master: 1 Master_SSL_Verify_Server_Cert: No Last_IO_Errno: 0 Last_IO_Error: Last_SQL_Errno: 0 Last_SQL_Error: Replicate_Ignore_Server_Ids: Master_Server_Id: 1 Master_UUID: 75411f54-8fa0-11f0-af01-9ae617f3d17a Master_Info_File: mysql.slave_master_info SQL_Delay: 0 SQL_Remaining_Delay: NULL Slave_SQL_Running_State: Replica has read all relay log; waiting for more updates Master_Retry_Count: 86400 Master_Bind: Last_IO_Error_Timestamp: Last_SQL_Error_Timestamp: Master_SSL_Crl: Master_SSL_Crlpath: Retrieved_Gtid_Set: 75411f54-8fa0-11f0-af01-9ae617f3d17a:1-35 Executed_Gtid_Set: 75411f54-8fa0-11f0-af01-9ae617f3d17a:1-35, 7b207893-8f96-11f0-91e0-b23bb744dc56:1-5064, c5b4ddaf-8f96-11f0-944e-42bed56ef9be:1-1922 Auto_Position: 1 Replicate_Rewrite_DB: Channel_Name: Master_TLS_Version: Master_public_key_path: Get_master_public_key: 0 Network_Namespace: `echo " echo \"show variables like 'max_connections';\" | mysql -h127.0.0.1 -uroot -p29FV699wpG -P3306 " | kubectl exec -it abk-uaeapw-mysql-1 --namespace ns-oihey -- bash ` Defaulted container "mysql" out of: mysql, mysql-exporter, kbagent, config-manager, init-data (init), init-xtrabackup (init), init-jemalloc (init), init-syncer (init), init-kbagent (init), kbagent-worker (init) Unable to use a TTY - input is not a terminal or the right kind of file Warning: arning] Using a password on the command line interface can be insecure. Variable_name Value max_connections 100 connect cluster Success set max_connections to 100 delete cluster abk-uaeapw `kbcli cluster delete abk-uaeapw --auto-approve --namespace ns-oihey ` Cluster abk-uaeapw deleted pod_info:abk-uaeapw-mysql-0 4/4 Running 0 73s abk-uaeapw-mysql-1 4/4 Running 0 45s pod_info:abk-uaeapw-mysql-0 4/4 Terminating 0 93s No resources found in ns-oihey namespace. delete cluster pod done No resources found in ns-oihey namespace. check cluster resource non-exist OK: pvc No resources found in ns-oihey namespace. delete cluster done No resources found in ns-oihey namespace. No resources found in ns-oihey namespace. No resources found in ns-oihey namespace. cluster delete backup `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge backups backup-ns-oihey-mysql-uaeapw-20250912141729 --namespace ns-oihey ` backup.dataprotection.kubeblocks.io/backup-ns-oihey-mysql-uaeapw-20250912141729 patched `kbcli cluster delete-backup mysql-uaeapw --name backup-ns-oihey-mysql-uaeapw-20250912141729 --force --auto-approve --namespace ns-oihey ` Backup backup-ns-oihey-mysql-uaeapw-20250912141729 deleted `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge backups backup-ns-oihey-mysql-uaeapw-20250912141814 --namespace ns-oihey ` backup.dataprotection.kubeblocks.io/backup-ns-oihey-mysql-uaeapw-20250912141814 patched `kbcli cluster delete-backup mysql-uaeapw --name backup-ns-oihey-mysql-uaeapw-20250912141814 --force --auto-approve --namespace ns-oihey ` Backup backup-ns-oihey-mysql-uaeapw-20250912141814 deleted cluster xtrabackup backup `kubectl get backuprepo backuprepo-kbcli-test -o jsonpath="***.spec.credential.name***"` `kubectl get backuprepo backuprepo-kbcli-test -o jsonpath="***.spec.credential.namespace***"` `kubectl get secrets kb-backuprepo-85gdv -n kb-osxch -o jsonpath="***.data.accessKeyId***"` `kubectl get secrets kb-backuprepo-85gdv -n kb-osxch -o jsonpath="***.data.secretAccessKey***"` KUBEBLOCKS NAMESPACE:kb-osxch get kubeblocks namespace done `kubectl get secrets -l app.kubernetes.io/instance=kbcli-test-minio --namespace kb-osxch -o jsonpath="***.items[0].data.root-user***"` `kubectl get secrets -l app.kubernetes.io/instance=kbcli-test-minio --namespace kb-osxch -o jsonpath="***.items[0].data.root-password***"` minio_user:kbclitest,minio_password:kbclitest,minio_endpoint:kbcli-test-minio.kb-osxch.svc.cluster.local:9000 list minio bucket kbcli-test `echo 'mc config host add minioserver http://kbcli-test-minio.kb-osxch.svc.cluster.local:9000 kbclitest kbclitest;mc ls minioserver' | kubectl exec -it kbcli-test-minio-7664db4c4f-zj7xt --namespace kb-osxch -- bash` Unable to use a TTY - input is not a terminal or the right kind of file list minio bucket done default backuprepo:backuprepo-kbcli-test exists `kbcli cluster backup mysql-uaeapw --method xtrabackup --namespace ns-oihey ` Backup backup-ns-oihey-mysql-uaeapw-20250912142112 created successfully, you can view the progress: kbcli cluster list-backups --names=backup-ns-oihey-mysql-uaeapw-20250912142112 -n ns-oihey check backup status `kbcli cluster list-backups mysql-uaeapw --namespace ns-oihey ` NAME NAMESPACE SOURCE-CLUSTER METHOD STATUS TOTAL-SIZE DURATION DELETION-POLICY CREATE-TIME COMPLETION-TIME EXPIRATION backup-ns-oihey-mysql-uaeapw-20250912142112 ns-oihey mysql-uaeapw xtrabackup Delete Sep 12,2025 14:21 UTC+0800 backup_status:mysql-uaeapw-xtrabackup-Running backup_status:mysql-uaeapw-xtrabackup-Running backup_status:mysql-uaeapw-xtrabackup-Running check backup status done backup_status:backup-ns-oihey-mysql-uaeapw-20250912142112 ns-oihey mysql-uaeapw xtrabackup Completed 7823158 10s Delete Sep 12,2025 14:21 UTC+0800 Sep 12,2025 14:21 UTC+0800 cluster restore backup Error from server (NotFound): opsrequests.operations.kubeblocks.io "abk-uaeapw" not found `kbcli cluster describe-backup --names backup-ns-oihey-mysql-uaeapw-20250912142112 --namespace ns-oihey ` Name: backup-ns-oihey-mysql-uaeapw-20250912142112 Cluster: mysql-uaeapw Namespace: ns-oihey Spec: Method: xtrabackup Policy Name: mysql-uaeapw-mysql-backup-policy Actions: dp-backup-0: ActionType: Job WorkloadName: dp-backup-0-backup-ns-oihey-mysql-uaeapw-20250912142112-f53b54f TargetPodName: mysql-uaeapw-mysql-0 Phase: Completed Start Time: Sep 12,2025 14:21 UTC+0800 Completion Time: Sep 12,2025 14:21 UTC+0800 Status: Phase: Completed Total Size: 7823158 ActionSet Name: mysql-xtrabackup-br Repository: backuprepo-kbcli-test Duration: 10s Start Time: Sep 12,2025 14:21 UTC+0800 Completion Time: Sep 12,2025 14:21 UTC+0800 Path: /ns-oihey/mysql-uaeapw-8b0c2eba-1f93-4562-a606-56f7d217996c/mysql/backup-ns-oihey-mysql-uaeapw-20250912142112 Warning Events: `kbcli cluster restore abk-uaeapw --backup backup-ns-oihey-mysql-uaeapw-20250912142112 --namespace ns-oihey ` Cluster abk-uaeapw created check cluster status `kbcli cluster list abk-uaeapw --show-labels --namespace ns-oihey ` NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS abk-uaeapw ns-oihey mysql WipeOut Creating Sep 12,2025 14:21 UTC+0800 clusterdefinition.kubeblocks.io/name=mysql cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances abk-uaeapw --namespace ns-oihey ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME abk-uaeapw-mysql-0 ns-oihey abk-uaeapw mysql Running primary 0 200m / 200m 644245094400m / 644245094400m data:12Gi aks-cicdamdpool-13759654-vmss000002/10.224.0.6 Sep 12,2025 14:23 UTC+0800 abk-uaeapw-mysql-1 ns-oihey abk-uaeapw mysql Running secondary 0 200m / 200m 644245094400m / 644245094400m data:12Gi aks-cicdamdpool-13759654-vmss000000/10.224.0.5 Sep 12,2025 14:24 UTC+0800 check pod status done check cluster role check cluster role done primary: abk-uaeapw-mysql-0;secondary: abk-uaeapw-mysql-1 `kubectl get secrets -l app.kubernetes.io/instance=abk-uaeapw` set secret: abk-uaeapw-mysql-account-root `kubectl get secrets abk-uaeapw-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets abk-uaeapw-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets abk-uaeapw-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:29FV699wpG;DB_PORT:3306;DB_DATABASE:mysql check cluster connect `echo " echo \"SHOW SLAVE STATUS\G;\" | mysql -P3306 -h127.0.0.1 -uroot -p'29FV699wpG' " | kubectl exec -it abk-uaeapw-mysql-1 --namespace ns-oihey -- bash ` check cluster connect done `kbcli cluster describe-backup --names backup-ns-oihey-mysql-uaeapw-20250912142112 --namespace ns-oihey ` Name: backup-ns-oihey-mysql-uaeapw-20250912142112 Cluster: mysql-uaeapw Namespace: ns-oihey Spec: Method: xtrabackup Policy Name: mysql-uaeapw-mysql-backup-policy Actions: dp-backup-0: ActionType: Job WorkloadName: dp-backup-0-backup-ns-oihey-mysql-uaeapw-20250912142112-f53b54f TargetPodName: mysql-uaeapw-mysql-0 Phase: Completed Start Time: Sep 12,2025 14:21 UTC+0800 Completion Time: Sep 12,2025 14:21 UTC+0800 Status: Phase: Completed Total Size: 7823158 ActionSet Name: mysql-xtrabackup-br Repository: backuprepo-kbcli-test Duration: 10s Start Time: Sep 12,2025 14:21 UTC+0800 Completion Time: Sep 12,2025 14:21 UTC+0800 Path: /ns-oihey/mysql-uaeapw-8b0c2eba-1f93-4562-a606-56f7d217996c/mysql/backup-ns-oihey-mysql-uaeapw-20250912142112 Warning Events: cluster connect `kubectl get secrets -l app.kubernetes.io/instance=abk-uaeapw` set secret: abk-uaeapw-mysql-account-root `kubectl get secrets abk-uaeapw-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets abk-uaeapw-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets abk-uaeapw-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:29FV699wpG;DB_PORT:3306;DB_DATABASE:mysql Defaulted container "mysql" out of: mysql, mysql-exporter, kbagent, config-manager, init-data (init), init-xtrabackup (init), init-jemalloc (init), init-syncer (init), init-kbagent (init), kbagent-worker (init) Unable to use a TTY - input is not a terminal or the right kind of file Warning: arning] Using a password on the command line interface can be insecure. *************************** 1. row *************************** Slave_IO_State: Master_Host: mysql-uaeapw-mysql-1.mysql-uaeapw-mysql-headless Master_User: kbreplicator Master_Port: 3306 Connect_Retry: 60 Master_Log_File: mysql-uaeapw-mysql-1-bin.000024 Read_Master_Log_Pos: 73219 Relay_Log_File: relay-bin.000001 Relay_Log_Pos: 4 Relay_Master_Log_File: mysql-uaeapw-mysql-1-bin.000024 Slave_IO_Running: No Slave_SQL_Running: No Replicate_Do_DB: Replicate_Ignore_DB: Replicate_Do_Table: Replicate_Ignore_Table: Replicate_Wild_Do_Table: Replicate_Wild_Ignore_Table: Last_Errno: 0 Last_Error: Skip_Counter: 0 Exec_Master_Log_Pos: 73219 Relay_Log_Space: 157 Until_Condition: None Until_Log_File: Until_Log_Pos: 0 Master_SSL_Allowed: Yes Master_SSL_CA_File: Master_SSL_CA_Path: Master_SSL_Cert: Master_SSL_Cipher: Master_SSL_Key: Seconds_Behind_Master: NULL Master_SSL_Verify_Server_Cert: No Last_IO_Errno: 0 Last_IO_Error: Last_SQL_Errno: 0 Last_SQL_Error: Replicate_Ignore_Server_Ids: Master_Server_Id: 0 Master_UUID: c5b4ddaf-8f96-11f0-944e-42bed56ef9be Master_Info_File: mysql.slave_master_info SQL_Delay: 0 SQL_Remaining_Delay: NULL Slave_SQL_Running_State: Master_Retry_Count: 86400 Master_Bind: Last_IO_Error_Timestamp: Last_SQL_Error_Timestamp: Master_SSL_Crl: Master_SSL_Crlpath: Retrieved_Gtid_Set: Executed_Gtid_Set: 7b207893-8f96-11f0-91e0-b23bb744dc56:1-5064, c5b4ddaf-8f96-11f0-944e-42bed56ef9be:1-2100 Auto_Position: 1 Replicate_Rewrite_DB: Channel_Name: Master_TLS_Version: Master_public_key_path: Get_master_public_key: 0 Network_Namespace: `echo " echo \"show variables like 'max_connections';\" | mysql -h127.0.0.1 -uroot -p29FV699wpG -P3306 " | kubectl exec -it abk-uaeapw-mysql-1 --namespace ns-oihey -- bash ` Defaulted container "mysql" out of: mysql, mysql-exporter, kbagent, config-manager, init-data (init), init-xtrabackup (init), init-jemalloc (init), init-syncer (init), init-kbagent (init), kbagent-worker (init) Unable to use a TTY - input is not a terminal or the right kind of file Warning: arning] Using a password on the command line interface can be insecure. Variable_name Value max_connections 100 connect cluster Success set max_connections to 100 delete cluster abk-uaeapw `kbcli cluster delete abk-uaeapw --auto-approve --namespace ns-oihey ` Cluster abk-uaeapw deleted pod_info:abk-uaeapw-mysql-0 4/4 Running 0 107s abk-uaeapw-mysql-1 4/4 Running 0 37s No resources found in ns-oihey namespace. delete cluster pod done No resources found in ns-oihey namespace. check cluster resource non-exist OK: pvc No resources found in ns-oihey namespace. delete cluster done No resources found in ns-oihey namespace. No resources found in ns-oihey namespace. No resources found in ns-oihey namespace. cluster rebulid instances apiVersion: operations.kubeblocks.io/v1alpha1 kind: OpsRequest metadata: generateName: mysql-uaeapw-rebuildinstance- namespace: ns-oihey spec: type: RebuildInstance clusterName: mysql-uaeapw force: true rebuildFrom: - componentName: mysql instances: - name: mysql-uaeapw-mysql-0 backupName: backup-ns-oihey-mysql-uaeapw-20250912142112 inPlace: true restoreEnv: - name: BACKUP_FOR_STANDBY value: "true" check cluster status before ops check cluster status done cluster_status:Running `kubectl create -f test_ops_cluster_mysql-uaeapw.yaml` opsrequest.operations.kubeblocks.io/mysql-uaeapw-rebuildinstance-mjxjw created create test_ops_cluster_mysql-uaeapw.yaml Success `rm -rf test_ops_cluster_mysql-uaeapw.yaml` check ops status `kbcli cluster list-ops mysql-uaeapw --status all --namespace ns-oihey ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME mysql-uaeapw-switchover-nsnwq ns-oihey Switchover mysql-uaeapw mysql Succeed 1/1 Sep 12,2025 14:07 UTC+0800 mysql-uaeapw-rebuildinstance-mjxjw ns-oihey RebuildInstance mysql-uaeapw Creating -/- Sep 12,2025 14:25 UTC+0800 ops_status:mysql-uaeapw-rebuildinstance-mjxjw ns-oihey RebuildInstance mysql-uaeapw mysql Running 0/1 Sep 12,2025 14:25 UTC+0800 ops_status:mysql-uaeapw-rebuildinstance-mjxjw ns-oihey RebuildInstance mysql-uaeapw mysql Running 0/1 Sep 12,2025 14:25 UTC+0800 ops_status:mysql-uaeapw-rebuildinstance-mjxjw ns-oihey RebuildInstance mysql-uaeapw mysql Running 0/1 Sep 12,2025 14:25 UTC+0800 ops_status:mysql-uaeapw-rebuildinstance-mjxjw ns-oihey RebuildInstance mysql-uaeapw mysql Running 0/1 Sep 12,2025 14:25 UTC+0800 ops_status:mysql-uaeapw-rebuildinstance-mjxjw ns-oihey RebuildInstance mysql-uaeapw mysql Running 0/1 Sep 12,2025 14:25 UTC+0800 ops_status:mysql-uaeapw-rebuildinstance-mjxjw ns-oihey RebuildInstance mysql-uaeapw mysql Running 0/1 Sep 12,2025 14:25 UTC+0800 ops_status:mysql-uaeapw-rebuildinstance-mjxjw ns-oihey RebuildInstance mysql-uaeapw mysql Running 0/1 Sep 12,2025 14:25 UTC+0800 ops_status:mysql-uaeapw-rebuildinstance-mjxjw ns-oihey RebuildInstance mysql-uaeapw mysql Running 0/1 Sep 12,2025 14:25 UTC+0800 ops_status:mysql-uaeapw-rebuildinstance-mjxjw ns-oihey RebuildInstance mysql-uaeapw mysql Running 0/1 Sep 12,2025 14:25 UTC+0800 ops_status:mysql-uaeapw-rebuildinstance-mjxjw ns-oihey RebuildInstance mysql-uaeapw mysql Running 0/1 Sep 12,2025 14:25 UTC+0800 ops_status:mysql-uaeapw-rebuildinstance-mjxjw ns-oihey RebuildInstance mysql-uaeapw mysql Running 0/1 Sep 12,2025 14:25 UTC+0800 ops_status:mysql-uaeapw-rebuildinstance-mjxjw ns-oihey RebuildInstance mysql-uaeapw mysql Running 0/1 Sep 12,2025 14:25 UTC+0800 ops_status:mysql-uaeapw-rebuildinstance-mjxjw ns-oihey RebuildInstance mysql-uaeapw mysql Running 0/1 Sep 12,2025 14:25 UTC+0800 ops_status:mysql-uaeapw-rebuildinstance-mjxjw ns-oihey RebuildInstance mysql-uaeapw mysql Running 0/1 Sep 12,2025 14:25 UTC+0800 ops_status:mysql-uaeapw-rebuildinstance-mjxjw ns-oihey RebuildInstance mysql-uaeapw mysql Running 0/1 Sep 12,2025 14:25 UTC+0800 ops_status:mysql-uaeapw-rebuildinstance-mjxjw ns-oihey RebuildInstance mysql-uaeapw mysql Running 0/1 Sep 12,2025 14:25 UTC+0800 ops_status:mysql-uaeapw-rebuildinstance-mjxjw ns-oihey RebuildInstance mysql-uaeapw mysql Running 0/1 Sep 12,2025 14:25 UTC+0800 ops_status:mysql-uaeapw-rebuildinstance-mjxjw ns-oihey RebuildInstance mysql-uaeapw mysql Running 0/1 Sep 12,2025 14:25 UTC+0800 ops_status:mysql-uaeapw-rebuildinstance-mjxjw ns-oihey RebuildInstance mysql-uaeapw mysql Running 0/1 Sep 12,2025 14:25 UTC+0800 ops_status:mysql-uaeapw-rebuildinstance-mjxjw ns-oihey RebuildInstance mysql-uaeapw mysql Running 0/1 Sep 12,2025 14:25 UTC+0800 ops_status:mysql-uaeapw-rebuildinstance-mjxjw ns-oihey RebuildInstance mysql-uaeapw mysql Running 0/1 Sep 12,2025 14:25 UTC+0800 check ops status done ops_status:mysql-uaeapw-rebuildinstance-mjxjw ns-oihey RebuildInstance mysql-uaeapw mysql Succeed 1/1 Sep 12,2025 14:25 UTC+0800 `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge opsrequests.operations mysql-uaeapw-rebuildinstance-mjxjw --namespace ns-oihey ` opsrequest.operations.kubeblocks.io/mysql-uaeapw-rebuildinstance-mjxjw patched `kbcli cluster delete-ops --name mysql-uaeapw-rebuildinstance-mjxjw --force --auto-approve --namespace ns-oihey ` OpsRequest mysql-uaeapw-rebuildinstance-mjxjw deleted check cluster status `kbcli cluster list mysql-uaeapw --show-labels --namespace ns-oihey ` NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS mysql-uaeapw ns-oihey mysql WipeOut Running Sep 12,2025 13:05 UTC+0800 app.kubernetes.io/instance=mysql-uaeapw,clusterdefinition.kubeblocks.io/name=mysql check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances mysql-uaeapw --namespace ns-oihey ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME mysql-uaeapw-mysql-0 ns-oihey mysql-uaeapw mysql Running secondary 0 200m / 200m 644245094400m / 644245094400m data:12Gi aks-cicdamdpool-13759654-vmss000002/10.224.0.6 Sep 12,2025 14:26 UTC+0800 mysql-uaeapw-mysql-1 ns-oihey mysql-uaeapw mysql Running primary 0 200m / 200m 644245094400m / 644245094400m data:12Gi aks-cicdamdpool-13759654-vmss000000/10.224.0.5 Sep 12,2025 14:13 UTC+0800 check pod status done check cluster role check cluster role done primary: mysql-uaeapw-mysql-1;secondary: mysql-uaeapw-mysql-0 `kubectl get secrets -l app.kubernetes.io/instance=mysql-uaeapw` set secret: mysql-uaeapw-mysql-account-root `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:29FV699wpG;DB_PORT:3306;DB_DATABASE:mysql check cluster connect `echo " echo \"SHOW SLAVE STATUS\G;\" | mysql -P3306 -h127.0.0.1 -uroot -p'29FV699wpG' " | kubectl exec -it mysql-uaeapw-mysql-0 --namespace ns-oihey -- bash ` check cluster connect done `kubectl get secrets -l app.kubernetes.io/instance=mysql-uaeapw` set secret: mysql-uaeapw-mysql-account-root `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:29FV699wpG;DB_PORT:3306;DB_DATABASE:mysql check db_client batch data count `echo "echo \"select count(*) from executions_loop.executions_loop_table;\" | mysql -P3306 -hmysql-uaeapw-mysql.ns-oihey.svc.cluster.local -uroot -p'29FV699wpG' " | kubectl exec -it mysql-uaeapw-mysql-1 --namespace ns-oihey -- bash ` check db_client batch data Success `kubectl get secrets -l app.kubernetes.io/instance=mysql-uaeapw` set secret: mysql-uaeapw-mysql-account-root `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:29FV699wpG;DB_PORT:3306;DB_DATABASE:mysql check readonly db_client batch data count `echo "echo \"select count(*) from executions_loop.executions_loop_table;\" | mysql -P3306 -h127.0.0.1 -uroot -p'29FV699wpG' " | kubectl exec -it mysql-uaeapw-mysql-0 --namespace ns-oihey -- bash ` check readonly db_client batch data Success cluster delete backup `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge backups backup-ns-oihey-mysql-uaeapw-20250912142112 --namespace ns-oihey ` backup.dataprotection.kubeblocks.io/backup-ns-oihey-mysql-uaeapw-20250912142112 patched `kbcli cluster delete-backup mysql-uaeapw --name backup-ns-oihey-mysql-uaeapw-20250912142112 --force --auto-approve --namespace ns-oihey ` Backup backup-ns-oihey-mysql-uaeapw-20250912142112 deleted `kubectl get backupschedule -l app.kubernetes.io/instance=mysql-uaeapw ` `kubectl get backupschedule mysql-uaeapw-mysql-backup-schedule -ojsonpath='***.spec.schedules[*].backupMethod***' ` backupschedule.dataprotection.kubeblocks.io/mysql-uaeapw-mysql-backup-schedule patched backupschedule.dataprotection.kubeblocks.io/mysql-uaeapw-mysql-backup-schedule patched check backup status `kbcli cluster list-backups mysql-uaeapw --namespace ns-oihey ` No backups found in ns-oihey namespace. No backups found in ns-oihey namespace. backup_status:-- No backups found in ns-oihey namespace. backup_status:-- No backups found in ns-oihey namespace. backup_status:-- No backups found in ns-oihey namespace. backup_status:-- No backups found in ns-oihey namespace. backup_status:-- No backups found in ns-oihey namespace. backup_status:-- No backups found in ns-oihey namespace. backup_status:-- No backups found in ns-oihey namespace. backup_status:-- `kubectl get backupschedule -l app.kubernetes.io/instance=mysql-uaeapw ` `kubectl get backupschedule mysql-uaeapw-mysql-backup-schedule -ojsonpath='***.spec.schedules[*].backupMethod***' ` backupschedule.dataprotection.kubeblocks.io/mysql-uaeapw-mysql-backup-schedule patched backupschedule.dataprotection.kubeblocks.io/mysql-uaeapw-mysql-backup-schedule patched backupschedule.dataprotection.kubeblocks.io/mysql-uaeapw-mysql-backup-schedule patched backupschedule.dataprotection.kubeblocks.io/mysql-uaeapw-mysql-backup-schedule patched (no change) backupschedule.dataprotection.kubeblocks.io/mysql-uaeapw-mysql-backup-schedule patched backupschedule.dataprotection.kubeblocks.io/mysql-uaeapw-mysql-backup-schedule patched (no change) backupschedule.dataprotection.kubeblocks.io/mysql-uaeapw-mysql-backup-schedule patched backupschedule.dataprotection.kubeblocks.io/mysql-uaeapw-mysql-backup-schedule patched (no change) backup_status:mysql-uaeapw-xtrabackup-Running backup_status:mysql-uaeapw-xtrabackup-Running backup_status:mysql-uaeapw-xtrabackup-Running check backup status done backup_status:mysql-uaeapw-xtrabackup-20250912062800 ns-oihey mysql-uaeapw xtrabackup Completed 7707910 15s Delete Sep 12,2025 14:28 UTC+0800 Sep 12,2025 14:28 UTC+0800 Sep 20,2025 14:28 UTC+0800 `kubectl get backupschedule -l app.kubernetes.io/instance=mysql-uaeapw ` `kubectl get backupschedule mysql-uaeapw-mysql-backup-schedule -ojsonpath='***.spec.schedules[*].backupMethod***' ` backupschedule.dataprotection.kubeblocks.io/mysql-uaeapw-mysql-backup-schedule patched (no change) backupschedule.dataprotection.kubeblocks.io/mysql-uaeapw-mysql-backup-schedule patched (no change) backupschedule.dataprotection.kubeblocks.io/mysql-uaeapw-mysql-backup-schedule patched (no change) backupschedule.dataprotection.kubeblocks.io/mysql-uaeapw-mysql-backup-schedule patched (no change) backupschedule.dataprotection.kubeblocks.io/mysql-uaeapw-mysql-backup-schedule patched (no change) backupschedule.dataprotection.kubeblocks.io/mysql-uaeapw-mysql-backup-schedule patched (no change) backupschedule.dataprotection.kubeblocks.io/mysql-uaeapw-mysql-backup-schedule patched (no change) backupschedule.dataprotection.kubeblocks.io/mysql-uaeapw-mysql-backup-schedule patched (no change) cluster restore backup Error from server (NotFound): opsrequests.operations.kubeblocks.io "abk-uaeapw" not found `kbcli cluster describe-backup --names mysql-uaeapw-xtrabackup-20250912062800 --namespace ns-oihey ` Name: mysql-uaeapw-xtrabackup-20250912062800 Cluster: mysql-uaeapw Namespace: ns-oihey Spec: Method: xtrabackup Policy Name: mysql-uaeapw-mysql-backup-policy Actions: dp-backup-0: ActionType: Job WorkloadName: dp-backup-0-mysql-uaeapw-xtrabackup-20250912062800-ceecab41 TargetPodName: mysql-uaeapw-mysql-0 Phase: Completed Start Time: Sep 12,2025 14:28 UTC+0800 Completion Time: Sep 12,2025 14:28 UTC+0800 Status: Phase: Completed Total Size: 7707910 ActionSet Name: mysql-xtrabackup-br Repository: backuprepo-kbcli-test Duration: 15s Expiration Time: Sep 20,2025 14:28 UTC+0800 Start Time: Sep 12,2025 14:28 UTC+0800 Completion Time: Sep 12,2025 14:28 UTC+0800 Path: /ns-oihey/mysql-uaeapw-8b0c2eba-1f93-4562-a606-56f7d217996c/mysql/mysql-uaeapw-xtrabackup-20250912062800 Warning Events: `kbcli cluster restore abk-uaeapw --backup mysql-uaeapw-xtrabackup-20250912062800 --namespace ns-oihey ` Cluster abk-uaeapw created check cluster status `kbcli cluster list abk-uaeapw --show-labels --namespace ns-oihey ` NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS abk-uaeapw ns-oihey mysql WipeOut Creating Sep 12,2025 14:28 UTC+0800 clusterdefinition.kubeblocks.io/name=mysql cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances abk-uaeapw --namespace ns-oihey ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME abk-uaeapw-mysql-0 ns-oihey abk-uaeapw mysql Running primary 0 200m / 200m 644245094400m / 644245094400m data:12Gi aks-cicdamdpool-13759654-vmss000002/10.224.0.6 Sep 12,2025 14:28 UTC+0800 abk-uaeapw-mysql-1 ns-oihey abk-uaeapw mysql Running secondary 0 200m / 200m 644245094400m / 644245094400m data:12Gi aks-cicdamdpool-13759654-vmss000000/10.224.0.5 Sep 12,2025 14:29 UTC+0800 check pod status done check cluster role check cluster role done primary: abk-uaeapw-mysql-0;secondary: abk-uaeapw-mysql-1 `kubectl get secrets -l app.kubernetes.io/instance=abk-uaeapw` set secret: abk-uaeapw-mysql-account-root `kubectl get secrets abk-uaeapw-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets abk-uaeapw-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets abk-uaeapw-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:29FV699wpG;DB_PORT:3306;DB_DATABASE:mysql check cluster connect `echo " echo \"SHOW SLAVE STATUS\G;\" | mysql -P3306 -h127.0.0.1 -uroot -p'29FV699wpG' " | kubectl exec -it abk-uaeapw-mysql-1 --namespace ns-oihey -- bash ` check cluster connect done `kbcli cluster describe-backup --names mysql-uaeapw-xtrabackup-20250912062800 --namespace ns-oihey ` Name: mysql-uaeapw-xtrabackup-20250912062800 Cluster: mysql-uaeapw Namespace: ns-oihey Spec: Method: xtrabackup Policy Name: mysql-uaeapw-mysql-backup-policy Actions: dp-backup-0: ActionType: Job WorkloadName: dp-backup-0-mysql-uaeapw-xtrabackup-20250912062800-ceecab41 TargetPodName: mysql-uaeapw-mysql-0 Phase: Completed Start Time: Sep 12,2025 14:28 UTC+0800 Completion Time: Sep 12,2025 14:28 UTC+0800 Status: Phase: Completed Total Size: 7707910 ActionSet Name: mysql-xtrabackup-br Repository: backuprepo-kbcli-test Duration: 15s Expiration Time: Sep 20,2025 14:28 UTC+0800 Start Time: Sep 12,2025 14:28 UTC+0800 Completion Time: Sep 12,2025 14:28 UTC+0800 Path: /ns-oihey/mysql-uaeapw-8b0c2eba-1f93-4562-a606-56f7d217996c/mysql/mysql-uaeapw-xtrabackup-20250912062800 Warning Events: cluster connect `kubectl get secrets -l app.kubernetes.io/instance=abk-uaeapw` set secret: abk-uaeapw-mysql-account-root `kubectl get secrets abk-uaeapw-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets abk-uaeapw-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets abk-uaeapw-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:29FV699wpG;DB_PORT:3306;DB_DATABASE:mysql Defaulted container "mysql" out of: mysql, mysql-exporter, kbagent, config-manager, init-data (init), init-xtrabackup (init), init-jemalloc (init), init-syncer (init), init-kbagent (init), kbagent-worker (init) Unable to use a TTY - input is not a terminal or the right kind of file Warning: arning] Using a password on the command line interface can be insecure. *************************** 1. row *************************** Slave_IO_State: Waiting for source to send event Master_Host: abk-uaeapw-mysql-0.abk-uaeapw-mysql-headless Master_User: kbreplicator Master_Port: 3306 Connect_Retry: 60 Master_Log_File: abk-uaeapw-mysql-0-bin.000001 Read_Master_Log_Pos: 14192 Relay_Log_File: relay-bin.000002 Relay_Log_Pos: 3607 Relay_Master_Log_File: abk-uaeapw-mysql-0-bin.000001 Slave_IO_Running: Yes Slave_SQL_Running: Yes Replicate_Do_DB: Replicate_Ignore_DB: Replicate_Do_Table: Replicate_Ignore_Table: Replicate_Wild_Do_Table: Replicate_Wild_Ignore_Table: Last_Errno: 0 Last_Error: Skip_Counter: 0 Exec_Master_Log_Pos: 3365 Relay_Log_Space: 14638 Until_Condition: None Until_Log_File: Until_Log_Pos: 0 Master_SSL_Allowed: Yes Master_SSL_CA_File: Master_SSL_CA_Path: Master_SSL_Cert: Master_SSL_Cipher: Master_SSL_Key: Seconds_Behind_Master: 26 Master_SSL_Verify_Server_Cert: No Last_IO_Errno: 0 Last_IO_Error: Last_SQL_Errno: 0 Last_SQL_Error: Replicate_Ignore_Server_Ids: Master_Server_Id: 1 Master_UUID: d071f93c-8fa1-11f0-ae40-9ae617f3d17a Master_Info_File: mysql.slave_master_info SQL_Delay: 0 SQL_Remaining_Delay: NULL Slave_SQL_Running_State: waiting for handler commit Master_Retry_Count: 86400 Master_Bind: Last_IO_Error_Timestamp: Last_SQL_Error_Timestamp: Master_SSL_Crl: Master_SSL_Crlpath: Retrieved_Gtid_Set: d071f93c-8fa1-11f0-ae40-9ae617f3d17a:1-35 Executed_Gtid_Set: 7b207893-8f96-11f0-91e0-b23bb744dc56:1-5064, c5b4ddaf-8f96-11f0-944e-42bed56ef9be:1-2500, d071f93c-8fa1-11f0-ae40-9ae617f3d17a:1-8 Auto_Position: 1 Replicate_Rewrite_DB: Channel_Name: Master_TLS_Version: Master_public_key_path: Get_master_public_key: 0 Network_Namespace: `echo " echo \"show variables like 'max_connections';\" | mysql -h127.0.0.1 -uroot -p29FV699wpG -P3306 " | kubectl exec -it abk-uaeapw-mysql-1 --namespace ns-oihey -- bash ` Defaulted container "mysql" out of: mysql, mysql-exporter, kbagent, config-manager, init-data (init), init-xtrabackup (init), init-jemalloc (init), init-syncer (init), init-kbagent (init), kbagent-worker (init) Unable to use a TTY - input is not a terminal or the right kind of file Warning: arning] Using a password on the command line interface can be insecure. Variable_name Value max_connections 100 connect cluster Success set max_connections to 100 delete cluster abk-uaeapw `kbcli cluster delete abk-uaeapw --auto-approve --namespace ns-oihey ` Cluster abk-uaeapw deleted pod_info:abk-uaeapw-mysql-0 4/4 Running 0 69s abk-uaeapw-mysql-1 4/4 Running 0 40s pod_info:abk-uaeapw-mysql-0 4/4 Terminating 0 89s No resources found in ns-oihey namespace. delete cluster pod done No resources found in ns-oihey namespace. check cluster resource non-exist OK: pvc No resources found in ns-oihey namespace. delete cluster done No resources found in ns-oihey namespace. No resources found in ns-oihey namespace. No resources found in ns-oihey namespace. cluster delete backup `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge backups mysql-uaeapw-xtrabackup-20250912062800 --namespace ns-oihey ` backup.dataprotection.kubeblocks.io/mysql-uaeapw-xtrabackup-20250912062800 patched `kbcli cluster delete-backup mysql-uaeapw --name mysql-uaeapw-xtrabackup-20250912062800 --force --auto-approve --namespace ns-oihey ` Backup mysql-uaeapw-xtrabackup-20250912062800 deleted cluster list-logs `kbcli cluster list-logs mysql-uaeapw --namespace ns-oihey ` No log files found. Error from server (NotFound): pods "mysql-uaeapw-mysql-1" not found cluster logs `kbcli cluster logs mysql-uaeapw --tail 30 --namespace ns-oihey ` Defaulted container "mysql" out of: mysql, mysql-exporter, kbagent, config-manager, init-data (init), init-xtrabackup (init), init-jemalloc (init), init-syncer (init), init-kbagent (init), kbagent-worker (init) 2025-09-12T06:17:23Z INFO HA This member is Cluster's leader 2025-09-12T06:17:23Z DEBUG HA Refresh leader ttl 2025-09-12T06:18:23Z INFO HA This member is Cluster's leader 2025-09-12T06:18:23Z DEBUG HA Refresh leader ttl 2025-09-12T06:19:23Z INFO HA This member is Cluster's leader 2025-09-12T06:19:23Z DEBUG HA Refresh leader ttl 2025-09-12T06:20:23Z INFO HA This member is Cluster's leader 2025-09-12T06:20:23Z DEBUG HA Refresh leader ttl 2025-09-12T06:21:23Z INFO HA This member is Cluster's leader 2025-09-12T06:21:23Z DEBUG HA Refresh leader ttl 2025-09-12T06:22:23Z INFO HA This member is Cluster's leader 2025-09-12T06:22:23Z DEBUG HA Refresh leader ttl 2025-09-12T06:23:23Z INFO HA This member is Cluster's leader 2025-09-12T06:23:23Z DEBUG HA Refresh leader ttl 2025-09-12T06:24:23Z INFO HA This member is Cluster's leader 2025-09-12T06:24:23Z DEBUG HA Refresh leader ttl 2025-09-12T06:25:23Z INFO HA This member is Cluster's leader 2025-09-12T06:25:23Z DEBUG HA Refresh leader ttl [mysql] 2025/09/12 06:26:16 packets.go:37: read tcp 127.0.0.1:48210->127.0.0.1:3306: i/o timeout 2025-09-12T06:26:16Z INFO MySQL Write check failed ***"error": "Write check failed: invalid connection"*** 2025-09-12T06:26:31Z INFO HA This member is Cluster's leader 2025-09-12T06:26:31Z DEBUG HA Refresh leader ttl 2025-09-12T06:27:31Z INFO HA This member is Cluster's leader 2025-09-12T06:27:31Z DEBUG HA Refresh leader ttl 2025-09-12T06:28:31Z INFO HA This member is Cluster's leader 2025-09-12T06:28:31Z DEBUG HA Refresh leader ttl 2025-09-12T06:29:31Z INFO HA This member is Cluster's leader 2025-09-12T06:29:31Z DEBUG HA Refresh leader ttl 2025-09-12T06:30:31Z INFO HA This member is Cluster's leader 2025-09-12T06:30:31Z DEBUG HA Refresh leader ttl cluster logs slow `kbcli cluster logs mysql-uaeapw --tail 30 --file-type=slow --namespace ns-oihey ` error: can't get file path pattern by type slow cluster logs error `kbcli cluster logs mysql-uaeapw --tail 30 --file-type=error --namespace ns-oihey ` error: can't get file path pattern by type error LB_TYPE is set to: intranet cluster expose check cluster status before ops check cluster status done cluster_status:Running `kbcli cluster expose mysql-uaeapw --auto-approve --force=true --type intranet --enable false --components mysql --role-selector primary --namespace ns-oihey ` OpsRequest mysql-uaeapw-expose-585kt created successfully, you can view the progress: kbcli cluster describe-ops mysql-uaeapw-expose-585kt -n ns-oihey check ops status `kbcli cluster list-ops mysql-uaeapw --status all --namespace ns-oihey ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME mysql-uaeapw-switchover-nsnwq ns-oihey Switchover mysql-uaeapw mysql Succeed 1/1 Sep 12,2025 14:07 UTC+0800 mysql-uaeapw-expose-585kt ns-oihey Expose mysql-uaeapw Creating -/- Sep 12,2025 14:30 UTC+0800 check cluster status `kbcli cluster list mysql-uaeapw --show-labels --namespace ns-oihey ` NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS mysql-uaeapw ns-oihey mysql WipeOut Running Sep 12,2025 13:05 UTC+0800 app.kubernetes.io/instance=mysql-uaeapw,clusterdefinition.kubeblocks.io/name=mysql check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances mysql-uaeapw --namespace ns-oihey ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME mysql-uaeapw-mysql-0 ns-oihey mysql-uaeapw mysql Running secondary 0 200m / 200m 644245094400m / 644245094400m data:12Gi aks-cicdamdpool-13759654-vmss000002/10.224.0.6 Sep 12,2025 14:26 UTC+0800 mysql-uaeapw-mysql-1 ns-oihey mysql-uaeapw mysql Running primary 0 200m / 200m 644245094400m / 644245094400m data:12Gi aks-cicdamdpool-13759654-vmss000000/10.224.0.5 Sep 12,2025 14:13 UTC+0800 check pod status done check cluster role check cluster role done primary: mysql-uaeapw-mysql-1;secondary: mysql-uaeapw-mysql-0 `kubectl get secrets -l app.kubernetes.io/instance=mysql-uaeapw` set secret: mysql-uaeapw-mysql-account-root `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:29FV699wpG;DB_PORT:3306;DB_DATABASE:mysql check cluster connect `echo " echo \"SHOW SLAVE STATUS\G;\" | mysql -P3306 -h127.0.0.1 -uroot -p'29FV699wpG' " | kubectl exec -it mysql-uaeapw-mysql-0 --namespace ns-oihey -- bash ` check cluster connect done check ops status `kbcli cluster list-ops mysql-uaeapw --status all --namespace ns-oihey ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME mysql-uaeapw-switchover-nsnwq ns-oihey Switchover mysql-uaeapw mysql Succeed 1/1 Sep 12,2025 14:07 UTC+0800 mysql-uaeapw-expose-585kt ns-oihey Expose mysql-uaeapw mysql Running 0/1 Sep 12,2025 14:30 UTC+0800 ops_status:mysql-uaeapw-expose-585kt ns-oihey Expose mysql-uaeapw mysql Running 0/1 Sep 12,2025 14:30 UTC+0800 ops_status:mysql-uaeapw-expose-585kt ns-oihey Expose mysql-uaeapw mysql Running 0/1 Sep 12,2025 14:30 UTC+0800 ops_status:mysql-uaeapw-expose-585kt ns-oihey Expose mysql-uaeapw mysql Running 0/1 Sep 12,2025 14:30 UTC+0800 ops_status:mysql-uaeapw-expose-585kt ns-oihey Expose mysql-uaeapw mysql Running 0/1 Sep 12,2025 14:30 UTC+0800 ops_status:mysql-uaeapw-expose-585kt ns-oihey Expose mysql-uaeapw mysql Running 0/1 Sep 12,2025 14:30 UTC+0800 ops_status:mysql-uaeapw-expose-585kt ns-oihey Expose mysql-uaeapw mysql Running 0/1 Sep 12,2025 14:30 UTC+0800 ops_status:mysql-uaeapw-expose-585kt ns-oihey Expose mysql-uaeapw mysql Running 0/1 Sep 12,2025 14:30 UTC+0800 ops_status:mysql-uaeapw-expose-585kt ns-oihey Expose mysql-uaeapw mysql Running 0/1 Sep 12,2025 14:30 UTC+0800 ops_status:mysql-uaeapw-expose-585kt ns-oihey Expose mysql-uaeapw mysql Running 0/1 Sep 12,2025 14:30 UTC+0800 ops_status:mysql-uaeapw-expose-585kt ns-oihey Expose mysql-uaeapw mysql Running 0/1 Sep 12,2025 14:30 UTC+0800 ops_status:mysql-uaeapw-expose-585kt ns-oihey Expose mysql-uaeapw mysql Running 0/1 Sep 12,2025 14:30 UTC+0800 ops_status:mysql-uaeapw-expose-585kt ns-oihey Expose mysql-uaeapw mysql Running 0/1 Sep 12,2025 14:30 UTC+0800 ops_status:mysql-uaeapw-expose-585kt ns-oihey Expose mysql-uaeapw mysql Running 0/1 Sep 12,2025 14:30 UTC+0800 ops_status:mysql-uaeapw-expose-585kt ns-oihey Expose mysql-uaeapw mysql Running 0/1 Sep 12,2025 14:30 UTC+0800 ops_status:mysql-uaeapw-expose-585kt ns-oihey Expose mysql-uaeapw mysql Running 0/1 Sep 12,2025 14:30 UTC+0800 ops_status:mysql-uaeapw-expose-585kt ns-oihey Expose mysql-uaeapw mysql Running 0/1 Sep 12,2025 14:30 UTC+0800 ops_status:mysql-uaeapw-expose-585kt ns-oihey Expose mysql-uaeapw mysql Running 0/1 Sep 12,2025 14:30 UTC+0800 check ops status done ops_status:mysql-uaeapw-expose-585kt ns-oihey Expose mysql-uaeapw mysql Succeed 1/1 Sep 12,2025 14:30 UTC+0800 `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge opsrequests.operations mysql-uaeapw-expose-585kt --namespace ns-oihey ` opsrequest.operations.kubeblocks.io/mysql-uaeapw-expose-585kt patched `kbcli cluster delete-ops --name mysql-uaeapw-expose-585kt --force --auto-approve --namespace ns-oihey ` OpsRequest mysql-uaeapw-expose-585kt deleted `kubectl get secrets -l app.kubernetes.io/instance=mysql-uaeapw` set secret: mysql-uaeapw-mysql-account-root `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:29FV699wpG;DB_PORT:3306;DB_DATABASE:mysql check db_client batch data count `echo "echo \"select count(*) from executions_loop.executions_loop_table;\" | mysql -P3306 -hmysql-uaeapw-mysql.ns-oihey.svc.cluster.local -uroot -p'29FV699wpG' " | kubectl exec -it mysql-uaeapw-mysql-1 --namespace ns-oihey -- bash ` check db_client batch data Success `kubectl get secrets -l app.kubernetes.io/instance=mysql-uaeapw` set secret: mysql-uaeapw-mysql-account-root `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-uaeapw-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:29FV699wpG;DB_PORT:3306;DB_DATABASE:mysql check readonly db_client batch data count `echo "echo \"select count(*) from executions_loop.executions_loop_table;\" | mysql -P3306 -h127.0.0.1 -uroot -p'29FV699wpG' " | kubectl exec -it mysql-uaeapw-mysql-0 --namespace ns-oihey -- bash ` check readonly db_client batch data Success delete cluster mysql-uaeapw `kbcli cluster delete mysql-uaeapw --auto-approve --namespace ns-oihey ` Cluster mysql-uaeapw deleted pod_info:mysql-uaeapw-mysql-0 4/4 Running 0 6m23s mysql-uaeapw-mysql-1 4/4 Running 0 19m pod_info:mysql-uaeapw-mysql-1 4/4 Terminating 0 19m No resources found in ns-oihey namespace. delete cluster pod done No resources found in ns-oihey namespace. check cluster resource non-exist OK: pvc No resources found in ns-oihey namespace. delete cluster done No resources found in ns-oihey namespace. No resources found in ns-oihey namespace. No resources found in ns-oihey namespace. Mysql Test Suite All Done! Test Engine: mysql Test Type: 21 --------------------------------------Mysql (Topology = semisync Replicas 2) Test Result-------------------------------------- [PASSED]|[Create]|[ComponentDefinition=mysql-8.0-1.0.1;ComponentVersion=mysql;ServiceVersion=8.0.30;]|[Description=Create a cluster with the specified component definition mysql-8.0-1.0.1 and component version mysql and service version 8.0.30] [PASSED]|[Connect]|[ComponentName=mysql]|[Description=Connect to the cluster] [PASSED]|[Expose]|[Enable=true;TYPE=intranet;ComponentName=mysql]|[Description=Expose Enable the intranet service with mysql component] [PASSED]|[Failover]|[HA=Network Loss;Durations=2m;ComponentName=mysql]|[Description=Simulates network loss fault thereby testing the application's resilience to potential slowness/unavailability of some replicas due to loss network.] [PASSED]|[No-Failover]|[HA=Connection Stress;ComponentName=mysql]|[Description=Simulates conditions where pods experience connection stress either due to expected/undesired processes thereby testing the application's resilience to potential slowness/unavailability of some replicas due to high Connection load.] [PASSED]|[VerticalScaling]|[ComponentName=mysql]|[Description=VerticalScaling the cluster specify component mysql] [PASSED]|[Update]|[Monitor=true]|[Description=Update the cluster Monitor enable] [PASSED]|[No-Failover]|[HA=Full CPU;Durations=2m;ComponentName=mysql]|[Description=Simulates conditions where pods experience CPU full either due to expected/undesired processes thereby testing the application's resilience to potential slowness/unavailability of some replicas due to high CPU load.] [PASSED]|[No-Failover]|[HA=DNS Error;Durations=2m;ComponentName=mysql]|[Description=Simulates conditions where pods experience DNS service errors for a period of time either due to expected/undesired processes thereby testing the application's resilience to potential slowness/unavailability of some replicas due to DNS service errors.] [PASSED]|[Reconfiguring]|[ComponentName=mysql;binlog_expire_logs_seconds=691200]|[Description=Reconfiguring the cluster specify component mysql set binlog_expire_logs_seconds=691200] [PASSED]|[Failover]|[HA=Pod Failure;Durations=2m;ComponentName=mysql]|[Description=Simulates conditions where pods experience failure for a period of time either due to expected/undesired processes thereby testing the application's resilience to potential slowness/unavailability of some replicas due to failure.] [PASSED]|[HorizontalScaling Out]|[ComponentName=mysql]|[Description=HorizontalScaling Out the cluster specify component mysql] [PASSED]|[HorizontalScaling In]|[ComponentName=mysql]|[Description=HorizontalScaling In the cluster specify component mysql] [PASSED]|[No-Failover]|[HA=Time Offset;Durations=2m;ComponentName=mysql]|[Description=Simulates a time offset scenario thereby testing the application's resilience to potential slowness/unavailability of some replicas due to time offset.] [PASSED]|[Failover]|[HA=Network Corrupt;Durations=2m;ComponentName=mysql]|[Description=Simulates network corrupt fault thereby testing the application's resilience to potential slowness/unavailability of some replicas due to corrupt network.] [PASSED]|[No-Failover]|[HA=Network Duplicate;Durations=2m;ComponentName=mysql]|[Description=Simulates network duplicate fault thereby testing the application's resilience to potential slowness/unavailability of some replicas due to duplicate network.] [PASSED]|[Failover]|[HA=OOM;Durations=2m;ComponentName=mysql]|[Description=Simulates conditions where pods experience OOM either due to expected/undesired processes thereby testing the application's resilience to potential slowness/unavailability of some replicas due to high Memory load.] [PASSED]|[Failover]|[HA=Kill 1;ComponentName=mysql]|[Description=Simulates conditions where process 1 killed either due to expected/undesired processes thereby testing the application's resilience to unavailability of some replicas due to abnormal termination signals.] [PASSED]|[VolumeExpansion]|[ComponentName=mysql]|[Description=VolumeExpansion the cluster specify component mysql] [PASSED]|[Restart]|[-]|[Description=Restart the cluster] [PASSED]|[Failover]|[HA=Network Bandwidth;Durations=2m;ComponentName=mysql]|[Description=Simulates network bandwidth fault thereby testing the application's resilience to potential slowness/unavailability of some replicas due to bandwidth network.] [PASSED]|[Upgrade]|[ComponentName=mysql;ComponentVersionFrom=8.0.30;ComponentVersionTo=8.0.31]|[Description=Upgrade the cluster specify component mysql service version from 8.0.30 to 8.0.31] [PASSED]|[Upgrade]|[ComponentName=mysql;ComponentVersionFrom=8.0.31;ComponentVersionTo=8.0.32]|[Description=Upgrade the cluster specify component mysql service version from 8.0.31 to 8.0.32] [PASSED]|[Upgrade]|[ComponentName=mysql;ComponentVersionFrom=8.0.32;ComponentVersionTo=8.0.33]|[Description=Upgrade the cluster specify component mysql service version from 8.0.32 to 8.0.33] [PASSED]|[Upgrade]|[ComponentName=mysql;ComponentVersionFrom=8.0.33;ComponentVersionTo=8.0.34]|[Description=Upgrade the cluster specify component mysql service version from 8.0.33 to 8.0.34] [PASSED]|[Upgrade]|[ComponentName=mysql;ComponentVersionFrom=8.0.34;ComponentVersionTo=8.0.35]|[Description=Upgrade the cluster specify component mysql service version from 8.0.34 to 8.0.35] [PASSED]|[Upgrade]|[ComponentName=mysql;ComponentVersionFrom=8.0.35;ComponentVersionTo=8.0.39]|[Description=Upgrade the cluster specify component mysql service version from 8.0.35 to 8.0.39] [PASSED]|[Upgrade]|[ComponentName=mysql;ComponentVersionFrom=8.0.39;ComponentVersionTo=8.0.35]|[Description=Upgrade the cluster specify component mysql service version from 8.0.39 to 8.0.35] [PASSED]|[Upgrade]|[ComponentName=mysql;ComponentVersionFrom=8.0.35;ComponentVersionTo=8.0.36]|[Description=Upgrade the cluster specify component mysql service version from 8.0.35 to 8.0.36] [PASSED]|[Upgrade]|[ComponentName=mysql;ComponentVersionFrom=8.0.36;ComponentVersionTo=8.0.39]|[Description=Upgrade the cluster specify component mysql service version from 8.0.36 to 8.0.39] [PASSED]|[Upgrade]|[ComponentName=mysql;ComponentVersionFrom=8.0.39;ComponentVersionTo=8.0.36]|[Description=Upgrade the cluster specify component mysql service version from 8.0.39 to 8.0.36] [PASSED]|[Upgrade]|[ComponentName=mysql;ComponentVersionFrom=8.0.36;ComponentVersionTo=8.0.37]|[Description=Upgrade the cluster specify component mysql service version from 8.0.36 to 8.0.37] [PASSED]|[Upgrade]|[ComponentName=mysql;ComponentVersionFrom=8.0.37;ComponentVersionTo=8.0.39]|[Description=Upgrade the cluster specify component mysql service version from 8.0.37 to 8.0.39] [PASSED]|[Upgrade]|[ComponentName=mysql;ComponentVersionFrom=8.0.39;ComponentVersionTo=8.0.37]|[Description=Upgrade the cluster specify component mysql service version from 8.0.39 to 8.0.37] [PASSED]|[Upgrade]|[ComponentName=mysql;ComponentVersionFrom=8.0.37;ComponentVersionTo=8.0.38]|[Description=Upgrade the cluster specify component mysql service version from 8.0.37 to 8.0.38] [PASSED]|[Upgrade]|[ComponentName=mysql;ComponentVersionFrom=8.0.38;ComponentVersionTo=8.0.39]|[Description=Upgrade the cluster specify component mysql service version from 8.0.38 to 8.0.39] [PASSED]|[Upgrade]|[ComponentName=mysql;ComponentVersionFrom=8.0.39;ComponentVersionTo=8.0.38]|[Description=Upgrade the cluster specify component mysql service version from 8.0.39 to 8.0.38] [PASSED]|[No-Failover]|[HA=Network Delay;Durations=2m;ComponentName=mysql]|[Description=Simulates network delay fault thereby testing the application's resilience to potential slowness/unavailability of some replicas due to delay network.] [PASSED]|[No-Failover]|[HA=Network Partition;Durations=2m;ComponentName=mysql]|[Description=Simulates network partition fault thereby testing the application's resilience to potential slowness/unavailability of some replicas due to partition network.] [PASSED]|[SwitchOver]|[ComponentName=mysql]|[Description=SwitchOver the cluster specify component mysql] [PASSED]|[Bench]|[ComponentName=mysql]|[Description=Bench the cluster service with mysql component] [PASSED]|[Bench]|[HostType=LB;ComponentName=mysql]|[Description=Bench the cluster LB service with mysql component] [PASSED]|[Stop]|[-]|[Description=Stop the cluster] [PASSED]|[Start]|[-]|[Description=Start the cluster] [PASSED]|[No-Failover]|[HA=DNS Random;Durations=2m;ComponentName=mysql]|[Description=Simulates conditions where pods experience random IP addresses being returned by the DNS service for a period of time either due to expected/undesired processes thereby testing the application's resilience to potential slowness/unavailability of some replicas due to the DNS service returning random IP addresses.] [PASSED]|[Failover]|[HA=Pod Kill;ComponentName=mysql]|[Description=Simulates conditions where pods experience kill for a period of time either due to expected/undesired processes thereby testing the application's resilience to potential slowness/unavailability of some replicas due to kill.] [PASSED]|[Update]|[TerminationPolicy=WipeOut]|[Description=Update the cluster TerminationPolicy WipeOut] [PASSED]|[Backup]|[BackupMethod=xtrabackup]|[Description=The cluster xtrabackup Backup] [PASSED]|[Backup]|[BackupMethod=xtrabackup-inc]|[Description=The cluster xtrabackup-inc Backup] [PASSED]|[Restore Increment]|[BackupMethod=xtrabackup]|[Description=The cluster xtrabackup Restore Increment] [PASSED]|[Connect]|[ComponentName=mysql]|[Description=Connect to the cluster] [PASSED]|[Delete Restore Cluster]|[BackupMethod=xtrabackup]|[Description=Delete the xtrabackup restore cluster] [PASSED]|[Backup]|[BackupMethod=xtrabackup]|[Description=The cluster xtrabackup Backup] [PASSED]|[Restore]|[BackupMethod=xtrabackup]|[Description=The cluster xtrabackup Restore] [PASSED]|[Connect]|[ComponentName=mysql]|[Description=Connect to the cluster] [PASSED]|[Delete Restore Cluster]|[BackupMethod=xtrabackup]|[Description=Delete the xtrabackup restore cluster] [PASSED]|[RebuildInstance]|[ComponentName=mysql]|[Description=Rebuild the cluster instance specify component mysql] [PASSED]|[Backup]|[Schedule=true;BackupMethod=xtrabackup]|[Description=The cluster Schedule xtrabackup Backup] [PASSED]|[Restore]|[Schedule=true;BackupMethod=xtrabackup]|[Description=The cluster Schedule xtrabackup Restore] [PASSED]|[Connect]|[ComponentName=mysql]|[Description=Connect to the cluster] [PASSED]|[Delete Restore Cluster]|[Schedule=true;BackupMethod=xtrabackup]|[Description=Delete the Schedule xtrabackup restore cluster] [PASSED]|[Expose]|[Disable=true;TYPE=intranet;ComponentName=mysql]|[Description=Expose Disable the intranet service with mysql component] [PASSED]|[Delete]|[-]|[Description=Delete the cluster] [END]