source commons files source engines files source kubeblocks files source kubedb files CLUSTER_NAME: `kubectl get namespace | grep ns-kcduy ` `kubectl create namespace ns-kcduy` namespace/ns-kcduy created create namespace ns-kcduy done download kbcli `gh release list --repo apecloud/kbcli --limit 100 | (grep "1.0" || true)` `curl -fsSL https://kubeblocks.io/installer/install_cli.sh | bash -s v1.0.1` Your system is linux_amd64 Installing kbcli ... Downloading ... % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 33.6M 100 33.6M 0 0 144M 0 --:--:-- --:--:-- --:--:-- 314M kbcli installed successfully. Kubernetes: v1.32.6 KubeBlocks: 1.0.1 kbcli: 1.0.1 Make sure your docker service is running and begin your journey with kbcli: kbcli playground init For more information on how to get started, please visit: https://kubeblocks.io download kbcli v1.0.1 done Kubernetes: v1.32.6 KubeBlocks: 1.0.1 kbcli: 1.0.1 Kubernetes Env: v1.32.6 check snapshot controller check snapshot controller done POD_RESOURCES: aks kb-default-sc found aks default-vsc found found default storage class: default KubeBlocks version is:1.0.1 skip upgrade KubeBlocks current KubeBlocks version: 1.0.1 Error: no repositories to show helm repo add chaos-mesh https://charts.chaos-mesh.org "chaos-mesh" has been added to your repositories add helm chart repo chaos-mesh success chaos mesh already installed check component definition set component name:mysql set component version set component version:mysql set service versions:8.4.2,8.4.1,8.4.0,8.0.39,8.0.38,8.0.37,8.0.36,8.0.35,8.0.34,8.0.33,8.0.32,8.0.31,8.0.30,5.7.44 set service versions sorted:5.7.44,8.0.30,8.0.31,8.0.32,8.0.33,8.0.34,8.0.35,8.0.36,8.0.37,8.0.38,8.0.39,8.4.0,8.4.1,8.4.2 set mysql component definition set mysql component definition REPORT_COUNT 0:0 set replicas first:2,5.7.44|2,8.0.30|2,8.0.31|2,8.0.32|2,8.0.33|2,8.0.34|2,8.0.35|2,8.0.36|2,8.0.37|2,8.0.38|2,8.0.39|2,8.4.0|2,8.4.1|2,8.4.2 set replicas third:2,8.0.30 set replicas fourth:2,8.0.30 set minimum cmpv service version set minimum cmpv service version replicas:2,8.0.30 REPORT_COUNT:1 CLUSTER_TOPOLOGY:semisync-proxysql topology semisync-proxysql found in cluster definition mysql set mysql component definition set mysql component definition LIMIT_CPU:0.1 LIMIT_MEMORY:0.5 storage size: 10 CLUSTER_NAME:mysql-yseslc No resources found in ns-kcduy namespace. pod_info: termination_policy:DoNotTerminate create 2 replica DoNotTerminate mysql cluster check component definition set component definition by component version check cmpd by labels set component definition1: mysql-8.0-1.0.1 by component version:mysql apiVersion: apps.kubeblocks.io/v1 kind: Cluster metadata: name: mysql-yseslc namespace: ns-kcduy spec: clusterDef: mysql topology: semisync-proxysql terminationPolicy: DoNotTerminate componentSpecs: - name: mysql serviceVersion: 8.0.30 env: - name: PROXY_ENABLED value: "on" disableExporter: true replicas: 2 resources: limits: cpu: 100m memory: 0.5Gi requests: cpu: 100m memory: 0.5Gi volumeClaimTemplates: - name: data spec: storageClassName: accessModes: - ReadWriteOnce resources: requests: storage: 10Gi - name: proxysql replicas: 1 resources: limits: cpu: 100m memory: 0.5Gi requests: cpu: 100m memory: 0.5Gi `kubectl apply -f test_create_mysql-yseslc.yaml` cluster.apps.kubeblocks.io/mysql-yseslc created apply test_create_mysql-yseslc.yaml Success `rm -rf test_create_mysql-yseslc.yaml` check cluster status `kbcli cluster list mysql-yseslc --show-labels --namespace ns-kcduy ` NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS mysql-yseslc ns-kcduy mysql DoNotTerminate Creating Sep 11,2025 20:24 UTC+0800 clusterdefinition.kubeblocks.io/name=mysql cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Updating check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances mysql-yseslc --namespace ns-kcduy ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME mysql-yseslc-mysql-0 ns-kcduy mysql-yseslc mysql Running primary 0 100m / 100m 512Mi / 512Mi data:10Gi aks-cicdamdpool-42425418-vmss000001/10.224.0.5 Sep 11,2025 20:24 UTC+0800 mysql-yseslc-mysql-1 ns-kcduy mysql-yseslc mysql Running secondary 0 100m / 100m 512Mi / 512Mi data:10Gi aks-cicdamdpool-42425418-vmss000002/10.224.0.7 Sep 11,2025 20:27 UTC+0800 mysql-yseslc-proxysql-0 ns-kcduy mysql-yseslc proxysql Running 0 100m / 100m 512Mi / 512Mi aks-cicdamdpool-42425418-vmss000001/10.224.0.5 Sep 11,2025 20:28 UTC+0800 check pod status done check cluster role check cluster role done primary: mysql-yseslc-mysql-0;secondary: mysql-yseslc-mysql-1 `kubectl get secrets -l app.kubernetes.io/instance=mysql-yseslc` set secret: mysql-yseslc-mysql-account-root `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:94J7Xw74tE;DB_PORT:3306;DB_DATABASE:mysql check cluster connect `echo " echo \"SHOW SLAVE STATUS\G;\" | mysql -P3306 -h127.0.0.1 -uroot -p'94J7Xw74tE' " | kubectl exec -it mysql-yseslc-mysql-1 --namespace ns-kcduy -- bash ` connect checking... connect checking... connect checking... connect checking... connect checking... connect checking... check cluster connect done `kubectl get secrets -l app.kubernetes.io/instance=mysql-yseslc` set secret: mysql-yseslc-mysql-account-root `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:94J7Xw74tE;DB_PORT:3306;DB_DATABASE:mysql check pod mysql-yseslc-mysql-0 container_name mysql exist password 94J7Xw74tE check pod mysql-yseslc-mysql-0 container_name mysql-exporter exist password 94J7Xw74tE check pod mysql-yseslc-mysql-0 container_name kbagent exist password 94J7Xw74tE check pod mysql-yseslc-mysql-0 container_name config-manager exist password 94J7Xw74tE No container logs contain secret password. describe cluster `kbcli cluster describe mysql-yseslc --namespace ns-kcduy ` Name: mysql-yseslc Created Time: Sep 11,2025 20:24 UTC+0800 NAMESPACE CLUSTER-DEFINITION TOPOLOGY STATUS TERMINATION-POLICY ns-kcduy mysql semisync-proxysql Running DoNotTerminate Endpoints: COMPONENT INTERNAL EXTERNAL mysql mysql-yseslc-mysql.ns-kcduy.svc.cluster.local:3306 proxysql mysql-yseslc-proxysql-proxy-ordinal-0.ns-kcduy.svc.cluster.local:6032 mysql-yseslc-proxysql-proxy-ordinal-0.ns-kcduy.svc.cluster.local:6033 mysql-yseslc-proxysql-proxy-server.ns-kcduy.svc.cluster.local:6033 Topology: COMPONENT SERVICE-VERSION INSTANCE ROLE STATUS AZ NODE CREATED-TIME mysql 8.0.30 mysql-yseslc-mysql-0 primary Running 0 aks-cicdamdpool-42425418-vmss000001/10.224.0.5 Sep 11,2025 20:24 UTC+0800 mysql 8.0.30 mysql-yseslc-mysql-1 secondary Running 0 aks-cicdamdpool-42425418-vmss000002/10.224.0.7 Sep 11,2025 20:27 UTC+0800 proxysql 2.4.4 mysql-yseslc-proxysql-0 Running 0 aks-cicdamdpool-42425418-vmss000001/10.224.0.5 Sep 11,2025 20:28 UTC+0800 Resources Allocation: COMPONENT INSTANCE-TEMPLATE CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE-SIZE STORAGE-CLASS mysql 100m / 100m 512Mi / 512Mi data:10Gi default proxysql 100m / 100m 512Mi / 512Mi Images: COMPONENT COMPONENT-DEFINITION IMAGE mysql mysql-8.0-1.0.1 docker.io/apecloud/mysql:8.0.30 docker.io/apecloud/mysqld-exporter:0.15.1 docker.io/apecloud/kubeblocks-tools:1.0.1 proxysql proxysql-mysql-1.0.1 docker.io/apecloud/proxysql:2.4.4 Data Protection: BACKUP-REPO AUTO-BACKUP BACKUP-SCHEDULE BACKUP-METHOD BACKUP-RETENTION RECOVERABLE-TIME Show cluster events: kbcli cluster list-events -n ns-kcduy mysql-yseslc `kbcli cluster label mysql-yseslc app.kubernetes.io/instance- --namespace ns-kcduy ` label "app.kubernetes.io/instance" not found. `kbcli cluster label mysql-yseslc app.kubernetes.io/instance=mysql-yseslc --namespace ns-kcduy ` `kbcli cluster label mysql-yseslc --list --namespace ns-kcduy ` NAME NAMESPACE LABELS mysql-yseslc ns-kcduy app.kubernetes.io/instance=mysql-yseslc clusterdefinition.kubeblocks.io/name=mysql label cluster app.kubernetes.io/instance=mysql-yseslc Success `kbcli cluster label case.name=kbcli.test1 -l app.kubernetes.io/instance=mysql-yseslc --namespace ns-kcduy ` `kbcli cluster label mysql-yseslc --list --namespace ns-kcduy ` NAME NAMESPACE LABELS mysql-yseslc ns-kcduy app.kubernetes.io/instance=mysql-yseslc case.name=kbcli.test1 clusterdefinition.kubeblocks.io/name=mysql label cluster case.name=kbcli.test1 Success `kbcli cluster label mysql-yseslc case.name=kbcli.test2 --overwrite --namespace ns-kcduy ` `kbcli cluster label mysql-yseslc --list --namespace ns-kcduy ` NAME NAMESPACE LABELS mysql-yseslc ns-kcduy app.kubernetes.io/instance=mysql-yseslc case.name=kbcli.test2 clusterdefinition.kubeblocks.io/name=mysql label cluster case.name=kbcli.test2 Success `kbcli cluster label mysql-yseslc case.name- --namespace ns-kcduy ` `kbcli cluster label mysql-yseslc --list --namespace ns-kcduy ` NAME NAMESPACE LABELS mysql-yseslc ns-kcduy app.kubernetes.io/instance=mysql-yseslc clusterdefinition.kubeblocks.io/name=mysql delete cluster label case.name Success cluster connect `kubectl get secrets -l app.kubernetes.io/instance=mysql-yseslc` set secret: mysql-yseslc-mysql-account-root `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:94J7Xw74tE;DB_PORT:3306;DB_DATABASE:mysql Defaulted container "mysql" out of: mysql, mysql-exporter, kbagent, config-manager, init-data (init), init-xtrabackup (init), init-jemalloc (init), init-syncer (init), init-kbagent (init), kbagent-worker (init) Unable to use a TTY - input is not a terminal or the right kind of file Warning: arning] Using a password on the command line interface can be insecure. *************************** 1. row *************************** Slave_IO_State: Waiting for source to send event Master_Host: mysql-yseslc-mysql-0.mysql-yseslc-mysql-headless Master_User: kbreplicator Master_Port: 3306 Connect_Retry: 60 Master_Log_File: mysql-yseslc-mysql-0-bin.000004 Read_Master_Log_Pos: 22252 Relay_Log_File: relay-bin.000002 Relay_Log_Pos: 22458 Relay_Master_Log_File: mysql-yseslc-mysql-0-bin.000004 Slave_IO_Running: Yes Slave_SQL_Running: Yes Replicate_Do_DB: Replicate_Ignore_DB: Replicate_Do_Table: Replicate_Ignore_Table: Replicate_Wild_Do_Table: Replicate_Wild_Ignore_Table: Last_Errno: 0 Last_Error: Skip_Counter: 0 Exec_Master_Log_Pos: 22252 Relay_Log_Space: 22662 Until_Condition: None Until_Log_File: Until_Log_Pos: 0 Master_SSL_Allowed: Yes Master_SSL_CA_File: Master_SSL_CA_Path: Master_SSL_Cert: Master_SSL_Cipher: Master_SSL_Key: Seconds_Behind_Master: 0 Master_SSL_Verify_Server_Cert: No Last_IO_Errno: 0 Last_IO_Error: Last_SQL_Errno: 0 Last_SQL_Error: Replicate_Ignore_Server_Ids: Master_Server_Id: 1 Master_UUID: aba34ba6-8f0a-11f0-8469-16d308065a4e Master_Info_File: mysql.slave_master_info SQL_Delay: 0 SQL_Remaining_Delay: NULL Slave_SQL_Running_State: Replica has read all relay log; waiting for more updates Master_Retry_Count: 86400 Master_Bind: Last_IO_Error_Timestamp: Last_SQL_Error_Timestamp: Master_SSL_Crl: Master_SSL_Crlpath: Retrieved_Gtid_Set: aba34ba6-8f0a-11f0-8469-16d308065a4e:56-110 Executed_Gtid_Set: aba34ba6-8f0a-11f0-8469-16d308065a4e:1-110 Auto_Position: 1 Replicate_Rewrite_DB: Channel_Name: Master_TLS_Version: Master_public_key_path: Get_master_public_key: 0 Network_Namespace: `echo " echo \"show variables like 'max_connections';\" | mysql -h127.0.0.1 -uroot -p94J7Xw74tE -P3306 " | kubectl exec -it mysql-yseslc-mysql-1 --namespace ns-kcduy -- bash ` Defaulted container "mysql" out of: mysql, mysql-exporter, kbagent, config-manager, init-data (init), init-xtrabackup (init), init-jemalloc (init), init-syncer (init), init-kbagent (init), kbagent-worker (init) Unable to use a TTY - input is not a terminal or the right kind of file Warning: arning] Using a password on the command line interface can be insecure. Variable_name Value max_connections 83 connect cluster Success set max_connections to 83 insert batch data by db client Error from server (NotFound): pods "test-db-client-executionloop-mysql-yseslc" not found `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge pods test-db-client-executionloop-mysql-yseslc --namespace ns-kcduy ` Error from server (NotFound): pods "test-db-client-executionloop-mysql-yseslc" not found Warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely. Error from server (NotFound): pods "test-db-client-executionloop-mysql-yseslc" not found `kubectl get secrets -l app.kubernetes.io/instance=mysql-yseslc` set secret: mysql-yseslc-mysql-account-root `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:94J7Xw74tE;DB_PORT:3306;DB_DATABASE:mysql apiVersion: v1 kind: Pod metadata: name: test-db-client-executionloop-mysql-yseslc namespace: ns-kcduy spec: containers: - name: test-dbclient imagePullPolicy: IfNotPresent image: docker.io/apecloud/dbclient:test args: - "--host" - "mysql-yseslc-mysql.ns-kcduy.svc.cluster.local" - "--user" - "root" - "--password" - "94J7Xw74tE" - "--port" - "3306" - "--dbtype" - "mysql" - "--test" - "executionloop" - "--duration" - "60" - "--interval" - "1" restartPolicy: Never `kubectl apply -f test-db-client-executionloop-mysql-yseslc.yaml` pod/test-db-client-executionloop-mysql-yseslc created apply test-db-client-executionloop-mysql-yseslc.yaml Success `rm -rf test-db-client-executionloop-mysql-yseslc.yaml` check pod status pod_status:NAME READY STATUS RESTARTS AGE test-db-client-executionloop-mysql-yseslc 1/1 Running 0 5s pod_status:NAME READY STATUS RESTARTS AGE test-db-client-executionloop-mysql-yseslc 1/1 Running 0 9s pod_status:NAME READY STATUS RESTARTS AGE test-db-client-executionloop-mysql-yseslc 1/1 Running 0 14s pod_status:NAME READY STATUS RESTARTS AGE test-db-client-executionloop-mysql-yseslc 1/1 Running 0 19s pod_status:NAME READY STATUS RESTARTS AGE test-db-client-executionloop-mysql-yseslc 1/1 Running 0 24s pod_status:NAME READY STATUS RESTARTS AGE test-db-client-executionloop-mysql-yseslc 1/1 Running 0 29s pod_status:NAME READY STATUS RESTARTS AGE test-db-client-executionloop-mysql-yseslc 1/1 Running 0 34s pod_status:NAME READY STATUS RESTARTS AGE test-db-client-executionloop-mysql-yseslc 1/1 Running 0 40s pod_status:NAME READY STATUS RESTARTS AGE test-db-client-executionloop-mysql-yseslc 1/1 Running 0 45s pod_status:NAME READY STATUS RESTARTS AGE test-db-client-executionloop-mysql-yseslc 1/1 Running 0 50s pod_status:NAME READY STATUS RESTARTS AGE test-db-client-executionloop-mysql-yseslc 1/1 Running 0 55s pod_status:NAME READY STATUS RESTARTS AGE test-db-client-executionloop-mysql-yseslc 1/1 Running 0 60s check pod test-db-client-executionloop-mysql-yseslc status done pod_status:NAME READY STATUS RESTARTS AGE test-db-client-executionloop-mysql-yseslc 0/1 Completed 0 65s check cluster status `kbcli cluster list mysql-yseslc --show-labels --namespace ns-kcduy ` NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS mysql-yseslc ns-kcduy mysql DoNotTerminate Running Sep 11,2025 20:24 UTC+0800 app.kubernetes.io/instance=mysql-yseslc,clusterdefinition.kubeblocks.io/name=mysql check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances mysql-yseslc --namespace ns-kcduy ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME mysql-yseslc-mysql-0 ns-kcduy mysql-yseslc mysql Running primary 0 100m / 100m 512Mi / 512Mi data:10Gi aks-cicdamdpool-42425418-vmss000001/10.224.0.5 Sep 11,2025 20:24 UTC+0800 mysql-yseslc-mysql-1 ns-kcduy mysql-yseslc mysql Running secondary 0 100m / 100m 512Mi / 512Mi data:10Gi aks-cicdamdpool-42425418-vmss000002/10.224.0.7 Sep 11,2025 20:27 UTC+0800 mysql-yseslc-proxysql-0 ns-kcduy mysql-yseslc proxysql Running 0 100m / 100m 512Mi / 512Mi aks-cicdamdpool-42425418-vmss000001/10.224.0.5 Sep 11,2025 20:28 UTC+0800 check pod status done check cluster role check cluster role done primary: mysql-yseslc-mysql-0;secondary: mysql-yseslc-mysql-1 `kubectl get secrets -l app.kubernetes.io/instance=mysql-yseslc` set secret: mysql-yseslc-mysql-account-root `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:94J7Xw74tE;DB_PORT:3306;DB_DATABASE:mysql check cluster connect `echo " echo \"SHOW SLAVE STATUS\G;\" | mysql -P3306 -h127.0.0.1 -uroot -p'94J7Xw74tE' " | kubectl exec -it mysql-yseslc-mysql-1 --namespace ns-kcduy -- bash ` check cluster connect done --host mysql-yseslc-mysql.ns-kcduy.svc.cluster.local --user root --password 94J7Xw74tE --port 3306 --dbtype mysql --test executionloop --duration 60 --interval 1 SLF4J(I): Connected with provider of type [ch.qos.logback.classic.spi.LogbackServiceProvider] Execution loop start: create databases executions_loop CREATE DATABASE IF NOT EXISTS executions_loop; drop table executions_loop_table DROP TABLE IF EXISTS executions_loop.executions_loop_table; create table executions_loop_table CREATE TABLE IF NOT EXISTS executions_loop.executions_loop_table (id INT PRIMARY KEY AUTO_INCREMENT, value VARCHAR(255), tinyint_col TINYINT, smallint_col SMALLINT, mediumint_col MEDIUMINT, int_col INT, bigint_col BIGINT, float_col FLOAT, double_col DOUBLE, decimal_col DECIMAL(10, 2), date_col DATE, time_col TIME, datetime_col DATETIME, timestamp_col TIMESTAMP, year_col YEAR, char_col CHAR(10), text_col TEXT, blob_col BLOB, binary_col BINARY(10), varbinary_col VARBINARY(255), enum_col ENUM('Option1', 'Option2', 'Option3'), set_col SET('Value1', 'Value2', 'Value3') ); Execution loop start:INSERT INTO executions_loop.executions_loop_table (value, tinyint_col, smallint_col, mediumint_col, int_col, bigint_col, float_col, double_col, decimal_col, date_col, time_col, datetime_col, timestamp_col, year_col, char_col, text_col, blob_col, binary_col, varbinary_col, enum_col, set_col) VALUES ('executions_loop_test_1', 80, 11289, 7434229, -767518128, -2499247194580767003, 0.40770924, 0.16512436963933141, 96.56443616094622, '2025-09-11', '12:29:45', '2025-09-11 12:29:45.743', CURRENT_TIMESTAMP, 2042, 'Q8wJv1ohbf', 'H90UHoDusVj20NcKKrcHilAvMF0ZjVHiTUXrYBkOBZioI0jGUFwDihf1AQtJrhlbsGSd88io4VLOjEnIK4kpven3YIXw0Epc4rffRcm3p8U1MoWtsmygWswN0EWIkfaTML1pOLAgPwFtI09njzJaNa1CUoZFBxKQQQe3IkZy55vub0G65ESnNJe4Cyya5NbtoG3VTPi2IjHdcbl1abRA3eWq66D5LkkJqLyEInjIE4RnUdJol97QeCEl9ixrpfq', UNHEX(REPLACE('ae85280452075be1c3fa', ' ', '')), UNHEX(REPLACE('bc8016a159d1eda58c3f', ' ', '')), UNHEX(REPLACE('d77b0f38e630254863a8fccb5ee1a3f0715b1d54a32fb18f9db4caf3294978d47fe8480ce8b79bf0922b9dfaafc04d7a6dfde37fa423fac1d948f2ffd90cc7829274d8c727b999daab9957a5b4938a08edef00ecc16a28fdb4ed209bbc5ef5c110e8191faa6c37522d015dcc5d7d85ab5b36402c21c536372a34a29cb68b291e6d8e919ed63ad7d930e31e899f613b13d89ad6bb8c4532560a35fef0ed2dc89f13b165e5fae4ed21dc71ebb8f4812832b450e881f2818c6178378b274d110f6cdee19cd6c53d77a5f01e638ed8295d28f7665182e453536c6ba71db9042878339e15ebe6ca71197e3c7aa16d4d6bcbd6dc0a1a33192970b9305c508f068fd6', ' ', '')), 'Option3', 'Value1' ); [ 1s ] executions total: 38 successful: 38 failed: 0 disconnect: 0 [ 2s ] executions total: 94 successful: 94 failed: 0 disconnect: 0 [ 3s ] executions total: 146 successful: 146 failed: 0 disconnect: 0 [ 4s ] executions total: 202 successful: 202 failed: 0 disconnect: 0 [ 5s ] executions total: 259 successful: 259 failed: 0 disconnect: 0 [ 6s ] executions total: 314 successful: 314 failed: 0 disconnect: 0 [ 7s ] executions total: 373 successful: 373 failed: 0 disconnect: 0 [ 8s ] executions total: 426 successful: 426 failed: 0 disconnect: 0 [ 9s ] executions total: 487 successful: 487 failed: 0 disconnect: 0 [ 10s ] executions total: 549 successful: 549 failed: 0 disconnect: 0 [ 11s ] executions total: 608 successful: 608 failed: 0 disconnect: 0 [ 12s ] executions total: 670 successful: 670 failed: 0 disconnect: 0 [ 13s ] executions total: 734 successful: 734 failed: 0 disconnect: 0 [ 14s ] executions total: 779 successful: 779 failed: 0 disconnect: 0 [ 15s ] executions total: 831 successful: 831 failed: 0 disconnect: 0 [ 16s ] executions total: 889 successful: 889 failed: 0 disconnect: 0 [ 17s ] executions total: 950 successful: 950 failed: 0 disconnect: 0 [ 18s ] executions total: 1012 successful: 1012 failed: 0 disconnect: 0 [ 19s ] executions total: 1071 successful: 1071 failed: 0 disconnect: 0 [ 20s ] executions total: 1137 successful: 1137 failed: 0 disconnect: 0 [ 21s ] executions total: 1203 successful: 1203 failed: 0 disconnect: 0 [ 22s ] executions total: 1261 successful: 1261 failed: 0 disconnect: 0 [ 23s ] executions total: 1319 successful: 1319 failed: 0 disconnect: 0 [ 24s ] executions total: 1381 successful: 1381 failed: 0 disconnect: 0 [ 25s ] executions total: 1441 successful: 1441 failed: 0 disconnect: 0 [ 26s ] executions total: 1501 successful: 1501 failed: 0 disconnect: 0 [ 27s ] executions total: 1550 successful: 1550 failed: 0 disconnect: 0 [ 28s ] executions total: 1608 successful: 1608 failed: 0 disconnect: 0 [ 29s ] executions total: 1672 successful: 1672 failed: 0 disconnect: 0 [ 30s ] executions total: 1735 successful: 1735 failed: 0 disconnect: 0 [ 31s ] executions total: 1796 successful: 1796 failed: 0 disconnect: 0 [ 32s ] executions total: 1862 successful: 1862 failed: 0 disconnect: 0 [ 33s ] executions total: 1923 successful: 1923 failed: 0 disconnect: 0 [ 34s ] executions total: 1986 successful: 1986 failed: 0 disconnect: 0 [ 35s ] executions total: 2046 successful: 2046 failed: 0 disconnect: 0 [ 36s ] executions total: 2113 successful: 2113 failed: 0 disconnect: 0 [ 37s ] executions total: 2176 successful: 2176 failed: 0 disconnect: 0 [ 38s ] executions total: 2240 successful: 2240 failed: 0 disconnect: 0 [ 39s ] executions total: 2306 successful: 2306 failed: 0 disconnect: 0 [ 40s ] executions total: 2364 successful: 2364 failed: 0 disconnect: 0 [ 41s ] executions total: 2428 successful: 2428 failed: 0 disconnect: 0 [ 42s ] executions total: 2492 successful: 2492 failed: 0 disconnect: 0 [ 43s ] executions total: 2555 successful: 2555 failed: 0 disconnect: 0 [ 44s ] executions total: 2613 successful: 2613 failed: 0 disconnect: 0 [ 45s ] executions total: 2676 successful: 2676 failed: 0 disconnect: 0 [ 46s ] executions total: 2732 successful: 2732 failed: 0 disconnect: 0 [ 47s ] executions total: 2793 successful: 2793 failed: 0 disconnect: 0 [ 48s ] executions total: 2859 successful: 2859 failed: 0 disconnect: 0 [ 49s ] executions total: 2920 successful: 2920 failed: 0 disconnect: 0 [ 50s ] executions total: 2985 successful: 2985 failed: 0 disconnect: 0 [ 51s ] executions total: 3043 successful: 3043 failed: 0 disconnect: 0 [ 52s ] executions total: 3099 successful: 3099 failed: 0 disconnect: 0 [ 53s ] executions total: 3157 successful: 3157 failed: 0 disconnect: 0 [ 54s ] executions total: 3215 successful: 3215 failed: 0 disconnect: 0 [ 55s ] executions total: 3279 successful: 3279 failed: 0 disconnect: 0 [ 56s ] executions total: 3340 successful: 3340 failed: 0 disconnect: 0 [ 57s ] executions total: 3400 successful: 3400 failed: 0 disconnect: 0 [ 58s ] executions total: 3460 successful: 3460 failed: 0 disconnect: 0 [ 59s ] executions total: 3523 successful: 3523 failed: 0 disconnect: 0 [ 60s ] executions total: 3546 successful: 3546 failed: 0 disconnect: 0 Test Result: Total Executions: 3546 Successful Executions: 3546 Failed Executions: 0 Disconnection Counts: 0 Connection Information: Database Type: mysql Host: mysql-yseslc-mysql.ns-kcduy.svc.cluster.local Port: 3306 Database: Table: User: root Org: Access Mode: mysql Test Type: executionloop Query: Duration: 60 seconds Interval: 1 seconds DB_CLIENT_BATCH_DATA_COUNT: 3546 `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge pods test-db-client-executionloop-mysql-yseslc --namespace ns-kcduy ` pod/test-db-client-executionloop-mysql-yseslc patched (no change) Warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely. pod "test-db-client-executionloop-mysql-yseslc" force deleted `kubectl get secrets -l app.kubernetes.io/instance=mysql-yseslc` set secret: mysql-yseslc-mysql-account-root `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:94J7Xw74tE;DB_PORT:3306;DB_DATABASE:mysql set db_client batch data count `echo "echo \"select count(*) from executions_loop.executions_loop_table;\" | mysql -P3306 -hmysql-yseslc-mysql.ns-kcduy.svc.cluster.local -uroot -p'94J7Xw74tE' " | kubectl exec -it mysql-yseslc-mysql-0 --namespace ns-kcduy -- bash ` set db_client batch data Success LB_TYPE is set to: intranet cluster expose check cluster status before ops check cluster status done cluster_status:Running `kbcli cluster expose mysql-yseslc --auto-approve --force=true --type intranet --enable true --components mysql --role-selector primary --namespace ns-kcduy ` OpsRequest mysql-yseslc-expose-v6znt created successfully, you can view the progress: kbcli cluster describe-ops mysql-yseslc-expose-v6znt -n ns-kcduy check ops status `kbcli cluster list-ops mysql-yseslc --status all --namespace ns-kcduy ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME mysql-yseslc-expose-v6znt ns-kcduy Expose mysql-yseslc Running -/- Sep 11,2025 20:30 UTC+0800 check cluster status `kbcli cluster list mysql-yseslc --show-labels --namespace ns-kcduy ` NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS mysql-yseslc ns-kcduy mysql DoNotTerminate Running Sep 11,2025 20:24 UTC+0800 app.kubernetes.io/instance=mysql-yseslc,clusterdefinition.kubeblocks.io/name=mysql check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances mysql-yseslc --namespace ns-kcduy ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME mysql-yseslc-mysql-0 ns-kcduy mysql-yseslc mysql Running primary 0 100m / 100m 512Mi / 512Mi data:10Gi aks-cicdamdpool-42425418-vmss000001/10.224.0.5 Sep 11,2025 20:24 UTC+0800 mysql-yseslc-mysql-1 ns-kcduy mysql-yseslc mysql Running secondary 0 100m / 100m 512Mi / 512Mi data:10Gi aks-cicdamdpool-42425418-vmss000002/10.224.0.7 Sep 11,2025 20:27 UTC+0800 mysql-yseslc-proxysql-0 ns-kcduy mysql-yseslc proxysql Running 0 100m / 100m 512Mi / 512Mi aks-cicdamdpool-42425418-vmss000001/10.224.0.5 Sep 11,2025 20:28 UTC+0800 check pod status done check cluster role check cluster role done primary: mysql-yseslc-mysql-0;secondary: mysql-yseslc-mysql-1 `kubectl get secrets -l app.kubernetes.io/instance=mysql-yseslc` set secret: mysql-yseslc-mysql-account-root `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:94J7Xw74tE;DB_PORT:3306;DB_DATABASE:mysql check cluster connect `echo " echo \"SHOW SLAVE STATUS\G;\" | mysql -P3306 -h127.0.0.1 -uroot -p'94J7Xw74tE' " | kubectl exec -it mysql-yseslc-mysql-1 --namespace ns-kcduy -- bash ` check cluster connect done check ops status `kbcli cluster list-ops mysql-yseslc --status all --namespace ns-kcduy ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME mysql-yseslc-expose-v6znt ns-kcduy Expose mysql-yseslc mysql Running 0/1 Sep 11,2025 20:30 UTC+0800 ops_status:mysql-yseslc-expose-v6znt ns-kcduy Expose mysql-yseslc mysql Running 0/1 Sep 11,2025 20:30 UTC+0800 ops_status:mysql-yseslc-expose-v6znt ns-kcduy Expose mysql-yseslc mysql Running 0/1 Sep 11,2025 20:30 UTC+0800 ops_status:mysql-yseslc-expose-v6znt ns-kcduy Expose mysql-yseslc mysql Running 0/1 Sep 11,2025 20:30 UTC+0800 ops_status:mysql-yseslc-expose-v6znt ns-kcduy Expose mysql-yseslc mysql Running 0/1 Sep 11,2025 20:30 UTC+0800 ops_status:mysql-yseslc-expose-v6znt ns-kcduy Expose mysql-yseslc mysql Running 0/1 Sep 11,2025 20:30 UTC+0800 ops_status:mysql-yseslc-expose-v6znt ns-kcduy Expose mysql-yseslc mysql Running 0/1 Sep 11,2025 20:30 UTC+0800 ops_status:mysql-yseslc-expose-v6znt ns-kcduy Expose mysql-yseslc mysql Running 0/1 Sep 11,2025 20:30 UTC+0800 ops_status:mysql-yseslc-expose-v6znt ns-kcduy Expose mysql-yseslc mysql Running 0/1 Sep 11,2025 20:30 UTC+0800 ops_status:mysql-yseslc-expose-v6znt ns-kcduy Expose mysql-yseslc mysql Running 0/1 Sep 11,2025 20:30 UTC+0800 ops_status:mysql-yseslc-expose-v6znt ns-kcduy Expose mysql-yseslc mysql Running 0/1 Sep 11,2025 20:30 UTC+0800 ops_status:mysql-yseslc-expose-v6znt ns-kcduy Expose mysql-yseslc mysql Running 0/1 Sep 11,2025 20:30 UTC+0800 check ops status done ops_status:mysql-yseslc-expose-v6znt ns-kcduy Expose mysql-yseslc mysql Succeed 1/1 Sep 11,2025 20:30 UTC+0800 `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge opsrequests.operations mysql-yseslc-expose-v6znt --namespace ns-kcduy ` opsrequest.operations.kubeblocks.io/mysql-yseslc-expose-v6znt patched `kbcli cluster delete-ops --name mysql-yseslc-expose-v6znt --force --auto-approve --namespace ns-kcduy ` OpsRequest mysql-yseslc-expose-v6znt deleted `kubectl get secrets -l app.kubernetes.io/instance=mysql-yseslc` set secret: mysql-yseslc-mysql-account-root `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:94J7Xw74tE;DB_PORT:3306;DB_DATABASE:mysql check db_client batch data count `echo "echo \"select count(*) from executions_loop.executions_loop_table;\" | mysql -P3306 -hmysql-yseslc-mysql.ns-kcduy.svc.cluster.local -uroot -p'94J7Xw74tE' " | kubectl exec -it mysql-yseslc-mysql-0 --namespace ns-kcduy -- bash ` check db_client batch data Success `kubectl get secrets -l app.kubernetes.io/instance=mysql-yseslc` set secret: mysql-yseslc-mysql-account-root `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:94J7Xw74tE;DB_PORT:3306;DB_DATABASE:mysql check readonly db_client batch data count `echo "echo \"select count(*) from executions_loop.executions_loop_table;\" | mysql -P3306 -h127.0.0.1 -uroot -p'94J7Xw74tE' " | kubectl exec -it mysql-yseslc-mysql-1 --namespace ns-kcduy -- bash ` check readonly db_client batch data Success test failover connectionstress check cluster status before cluster-failover-connectionstress check cluster status done cluster_status:Running Error from server (NotFound): pods "test-db-client-connectionstress-mysql-yseslc" not found `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge pods test-db-client-connectionstress-mysql-yseslc --namespace ns-kcduy ` Error from server (NotFound): pods "test-db-client-connectionstress-mysql-yseslc" not found Warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely. Error from server (NotFound): pods "test-db-client-connectionstress-mysql-yseslc" not found `kubectl get secrets -l app.kubernetes.io/instance=mysql-yseslc` set secret: mysql-yseslc-mysql-account-root `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:94J7Xw74tE;DB_PORT:3306;DB_DATABASE:mysql apiVersion: v1 kind: Pod metadata: name: test-db-client-connectionstress-mysql-yseslc namespace: ns-kcduy spec: containers: - name: test-dbclient imagePullPolicy: IfNotPresent image: docker.io/apecloud/dbclient:test args: - "--host" - "mysql-yseslc-mysql.ns-kcduy.svc.cluster.local" - "--user" - "root" - "--password" - "94J7Xw74tE" - "--port" - "3306" - "--database" - "mysql" - "--dbtype" - "mysql" - "--test" - "connectionstress" - "--connections" - "83" - "--duration" - "60" restartPolicy: Never `kubectl apply -f test-db-client-connectionstress-mysql-yseslc.yaml` pod/test-db-client-connectionstress-mysql-yseslc created apply test-db-client-connectionstress-mysql-yseslc.yaml Success `rm -rf test-db-client-connectionstress-mysql-yseslc.yaml` check pod status check pod test-db-client-connectionstress-mysql-yseslc status done pod_status:NAME READY STATUS RESTARTS AGE test-db-client-connectionstress-mysql-yseslc 0/1 Completed 0 5s check cluster status `kbcli cluster list mysql-yseslc --show-labels --namespace ns-kcduy ` NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS mysql-yseslc ns-kcduy mysql DoNotTerminate Running Sep 11,2025 20:24 UTC+0800 app.kubernetes.io/instance=mysql-yseslc,clusterdefinition.kubeblocks.io/name=mysql check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances mysql-yseslc --namespace ns-kcduy ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME mysql-yseslc-mysql-0 ns-kcduy mysql-yseslc mysql Running primary 0 100m / 100m 512Mi / 512Mi data:10Gi aks-cicdamdpool-42425418-vmss000001/10.224.0.5 Sep 11,2025 20:24 UTC+0800 mysql-yseslc-mysql-1 ns-kcduy mysql-yseslc mysql Running secondary 0 100m / 100m 512Mi / 512Mi data:10Gi aks-cicdamdpool-42425418-vmss000002/10.224.0.7 Sep 11,2025 20:27 UTC+0800 mysql-yseslc-proxysql-0 ns-kcduy mysql-yseslc proxysql Running 0 100m / 100m 512Mi / 512Mi aks-cicdamdpool-42425418-vmss000001/10.224.0.5 Sep 11,2025 20:28 UTC+0800 check pod status done check cluster role check cluster role done primary: mysql-yseslc-mysql-0;secondary: mysql-yseslc-mysql-1 `kubectl get secrets -l app.kubernetes.io/instance=mysql-yseslc` set secret: mysql-yseslc-mysql-account-root `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:94J7Xw74tE;DB_PORT:3306;DB_DATABASE:mysql check cluster connect `echo " echo \"SHOW SLAVE STATUS\G;\" | mysql -P3306 -h127.0.0.1 -uroot -p'94J7Xw74tE' " | kubectl exec -it mysql-yseslc-mysql-1 --namespace ns-kcduy -- bash ` check cluster connect done at com.mysql.cj.jdbc.exceptions.SQLExceptionsMapping.translateException(SQLExceptionsMapping.java:122) at com.mysql.cj.jdbc.ConnectionImpl.createNewIO(ConnectionImpl.java:829) at com.mysql.cj.jdbc.ConnectionImpl.(ConnectionImpl.java:449) at com.mysql.cj.jdbc.ConnectionImpl.getInstance(ConnectionImpl.java:242) at com.mysql.cj.jdbc.NonRegisteringDriver.connect(NonRegisteringDriver.java:198) at java.sql/java.sql.DriverManager.getConnection(Unknown Source) at java.sql/java.sql.DriverManager.getConnection(Unknown Source) at com.apecloud.dbtester.tester.MySQLTester.connect(MySQLTester.java:63) ... 4 more Failed to connect to MySQL database: java.sql.SQLNonTransientConnectionException: Data source rejected establishment of connection, message from server: "Too many connections" Trying with database MySQL. java.io.IOException: Failed to connect to MySQL database: at com.apecloud.dbtester.tester.MySQLTester.connect(MySQLTester.java:65) at com.apecloud.dbtester.tester.MySQLTester.connectionStress(MySQLTester.java:113) at com.apecloud.dbtester.commons.TestExecutor.executeTest(TestExecutor.java:37) at OneClient.executeTest(OneClient.java:108) at OneClient.main(OneClient.java:40) Caused by: java.sql.SQLNonTransientConnectionException: Data source rejected establishment of connection, message from server: "Too many connections" at com.mysql.cj.jdbc.exceptions.SQLError.createSQLException(SQLError.java:110) at com.mysql.cj.jdbc.exceptions.SQLExceptionsMapping.translateException(SQLExceptionsMapping.java:122) at com.mysql.cj.jdbc.ConnectionImpl.createNewIO(ConnectionImpl.java:829) at com.mysql.cj.jdbc.ConnectionImpl.(ConnectionImpl.java:449) at com.mysql.cj.jdbc.ConnectionImpl.getInstance(ConnectionImpl.java:242) at com.mysql.cj.jdbc.NonRegisteringDriver.connect(NonRegisteringDriver.java:198) at java.sql/java.sql.DriverManager.getConnection(Unknown Source) at java.sql/java.sql.DriverManager.getConnection(Unknown Source) at com.apecloud.dbtester.tester.MySQLTester.connect(MySQLTester.java:63) ... 4 more Failed to connect to MySQL database: java.sql.SQLNonTransientConnectionException: Data source rejected establishment of connection, message from server: "Too many connections" Trying with database MySQL. java.io.IOException: Failed to connect to MySQL database: at com.apecloud.dbtester.tester.MySQLTester.connect(MySQLTester.java:65) at com.apecloud.dbtester.tester.MySQLTester.connectionStress(MySQLTester.java:113) at com.apecloud.dbtester.commons.TestExecutor.executeTest(TestExecutor.java:37) at OneClient.executeTest(OneClient.java:108) at OneClient.main(OneClient.java:40) Caused by: java.sql.SQLNonTransientConnectionException: Data source rejected establishment of connection, message from server: "Too many connections" at com.mysql.cj.jdbc.exceptions.SQLError.createSQLException(SQLError.java:110) at com.mysql.cj.jdbc.exceptions.SQLExceptionsMapping.translateException(SQLExceptionsMapping.java:122) at com.mysql.cj.jdbc.ConnectionImpl.createNewIO(ConnectionImpl.java:829) at com.mysql.cj.jdbc.ConnectionImpl.(ConnectionImpl.java:449) at com.mysql.cj.jdbc.ConnectionImpl.getInstance(ConnectionImpl.java:242) at com.mysql.cj.jdbc.NonRegisteringDriver.connect(NonRegisteringDriver.java:198) at java.sql/java.sql.DriverManager.getConnection(Unknown Source) at java.sql/java.sql.DriverManager.getConnection(Unknown Source) at com.apecloud.dbtester.tester.MySQLTester.connect(MySQLTester.java:63) ... 4 more Failed to connect to MySQL database: java.sql.SQLNonTransientConnectionException: Data source rejected establishment of connection, message from server: "Too many connections" Trying with database MySQL. java.io.IOException: Failed to connect to MySQL database: at com.apecloud.dbtester.tester.MySQLTester.connect(MySQLTester.java:65) at com.apecloud.dbtester.tester.MySQLTester.connectionStress(MySQLTester.java:113) at com.apecloud.dbtester.commons.TestExecutor.executeTest(TestExecutor.java:37) at OneClient.executeTest(OneClient.java:108) at OneClient.main(OneClient.java:40) Caused by: java.sql.SQLNonTransientConnectionException: Data source rejected establishment of connection, message from server: "Too many connections" at com.mysql.cj.jdbc.exceptions.SQLError.createSQLException(SQLError.java:110) at com.mysql.cj.jdbc.exceptions.SQLExceptionsMapping.translateException(SQLExceptionsMapping.java:122) at com.mysql.cj.jdbc.ConnectionImpl.createNewIO(ConnectionImpl.java:829) at com.mysql.cj.jdbc.ConnectionImpl.(ConnectionImpl.java:449) at com.mysql.cj.jdbc.ConnectionImpl.getInstance(ConnectionImpl.java:242) at com.mysql.cj.jdbc.NonRegisteringDriver.connect(NonRegisteringDriver.java:198) at java.sql/java.sql.DriverManager.getConnection(Unknown Source) at java.sql/java.sql.DriverManager.getConnection(Unknown Source) at com.apecloud.dbtester.tester.MySQLTester.connect(MySQLTester.java:63) ... 4 more Failed to connect to MySQL database: java.sql.SQLNonTransientConnectionException: Data source rejected establishment of connection, message from server: "Too many connections" Trying with database MySQL. java.io.IOException: Failed to connect to MySQL database: at com.apecloud.dbtester.tester.MySQLTester.connect(MySQLTester.java:65) at com.apecloud.dbtester.tester.MySQLTester.connectionStress(MySQLTester.java:113) at com.apecloud.dbtester.commons.TestExecutor.executeTest(TestExecutor.java:37) at OneClient.executeTest(OneClient.java:108) at OneClient.main(OneClient.java:40) Caused by: java.sql.SQLNonTransientConnectionException: Data source rejected establishment of connection, message from server: "Too many connections" at com.mysql.cj.jdbc.exceptions.SQLError.createSQLException(SQLError.java:110) at com.mysql.cj.jdbc.exceptions.SQLExceptionsMapping.translateException(SQLExceptionsMapping.java:122) at com.mysql.cj.jdbc.ConnectionImpl.createNewIO(ConnectionImpl.java:829) at com.mysql.cj.jdbc.ConnectionImpl.(ConnectionImpl.java:449) at com.mysql.cj.jdbc.ConnectionImpl.getInstance(ConnectionImpl.java:242) at com.mysql.cj.jdbc.NonRegisteringDriver.connect(NonRegisteringDriver.java:198) at java.sql/java.sql.DriverManager.getConnection(Unknown Source) at java.sql/java.sql.DriverManager.getConnection(Unknown Source) at com.apecloud.dbtester.tester.MySQLTester.connect(MySQLTester.java:63) ... 4 more Test Result: null Connection Information: Database Type: mysql Host: mysql-yseslc-mysql.ns-kcduy.svc.cluster.local Port: 3306 Database: mysql Table: User: root Org: Access Mode: mysql Test Type: connectionstress Connection Count: 83 Duration: 60 seconds `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge pods test-db-client-connectionstress-mysql-yseslc --namespace ns-kcduy ` pod/test-db-client-connectionstress-mysql-yseslc patched (no change) Warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely. pod "test-db-client-connectionstress-mysql-yseslc" force deleted `kubectl get secrets -l app.kubernetes.io/instance=mysql-yseslc` set secret: mysql-yseslc-mysql-account-root `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:94J7Xw74tE;DB_PORT:3306;DB_DATABASE:mysql set db_client batch data count `echo "echo \"select count(*) from executions_loop.executions_loop_table;\" | mysql -P3306 -hmysql-yseslc-mysql.ns-kcduy.svc.cluster.local -uroot -p'94J7Xw74tE' " | kubectl exec -it mysql-yseslc-mysql-0 --namespace ns-kcduy -- bash ` set db_client batch data Success check failover pod name failover pod name:mysql-yseslc-mysql-0 failover connectionstress Success `kubectl get secrets -l app.kubernetes.io/instance=mysql-yseslc` set secret: mysql-yseslc-mysql-account-root `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:94J7Xw74tE;DB_PORT:3306;DB_DATABASE:mysql check db_client batch data count `echo "echo \"select count(*) from executions_loop.executions_loop_table;\" | mysql -P3306 -hmysql-yseslc-mysql.ns-kcduy.svc.cluster.local -uroot -p'94J7Xw74tE' " | kubectl exec -it mysql-yseslc-mysql-0 --namespace ns-kcduy -- bash ` check db_client batch data Success `kubectl get secrets -l app.kubernetes.io/instance=mysql-yseslc` set secret: mysql-yseslc-mysql-account-root `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:94J7Xw74tE;DB_PORT:3306;DB_DATABASE:mysql check readonly db_client batch data count `echo "echo \"select count(*) from executions_loop.executions_loop_table;\" | mysql -P3306 -h127.0.0.1 -uroot -p'94J7Xw74tE' " | kubectl exec -it mysql-yseslc-mysql-1 --namespace ns-kcduy -- bash ` check readonly db_client batch data Success test failover networkcorruptover check cluster status before cluster-failover-networkcorruptover check cluster status done cluster_status:Running `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge NetworkChaos test-chaos-mesh-networkcorruptover-mysql-yseslc --namespace ns-kcduy ` Warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely. Error from server (NotFound): networkchaos.chaos-mesh.org "test-chaos-mesh-networkcorruptover-mysql-yseslc" not found Error from server (NotFound): networkchaos.chaos-mesh.org "test-chaos-mesh-networkcorruptover-mysql-yseslc" not found apiVersion: chaos-mesh.org/v1alpha1 kind: NetworkChaos metadata: name: test-chaos-mesh-networkcorruptover-mysql-yseslc namespace: ns-kcduy spec: selector: namespaces: - ns-kcduy labelSelectors: apps.kubeblocks.io/pod-name: mysql-yseslc-mysql-0 mode: all action: corrupt corrupt: corrupt: '100' correlation: '100' direction: to duration: 2m `kubectl apply -f test-chaos-mesh-networkcorruptover-mysql-yseslc.yaml` networkchaos.chaos-mesh.org/test-chaos-mesh-networkcorruptover-mysql-yseslc created apply test-chaos-mesh-networkcorruptover-mysql-yseslc.yaml Success `rm -rf test-chaos-mesh-networkcorruptover-mysql-yseslc.yaml` networkcorruptover chaos test waiting 120 seconds check cluster status `kbcli cluster list mysql-yseslc --show-labels --namespace ns-kcduy ` NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS mysql-yseslc ns-kcduy mysql DoNotTerminate Running Sep 11,2025 20:24 UTC+0800 app.kubernetes.io/instance=mysql-yseslc,clusterdefinition.kubeblocks.io/name=mysql check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances mysql-yseslc --namespace ns-kcduy ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME mysql-yseslc-mysql-0 ns-kcduy mysql-yseslc mysql Running primary 0 100m / 100m 512Mi / 512Mi data:10Gi aks-cicdamdpool-42425418-vmss000001/10.224.0.5 Sep 11,2025 20:24 UTC+0800 mysql-yseslc-mysql-1 ns-kcduy mysql-yseslc mysql Running primary 0 100m / 100m 512Mi / 512Mi data:10Gi aks-cicdamdpool-42425418-vmss000002/10.224.0.7 Sep 11,2025 20:27 UTC+0800 mysql-yseslc-proxysql-0 ns-kcduy mysql-yseslc proxysql Running 0 100m / 100m 512Mi / 512Mi aks-cicdamdpool-42425418-vmss000001/10.224.0.5 Sep 11,2025 20:28 UTC+0800 check pod status done check cluster role No resources found in ns-kcduy namespace. primary: mysql-yseslc-mysql-0 mysql-yseslc-mysql-1;secondary: No resources found in ns-kcduy namespace. primary: mysql-yseslc-mysql-0 mysql-yseslc-mysql-1;secondary: No resources found in ns-kcduy namespace. primary: mysql-yseslc-mysql-0 mysql-yseslc-mysql-1;secondary: No resources found in ns-kcduy namespace. primary: mysql-yseslc-mysql-0 mysql-yseslc-mysql-1;secondary: No resources found in ns-kcduy namespace. primary: mysql-yseslc-mysql-0 mysql-yseslc-mysql-1;secondary: No resources found in ns-kcduy namespace. primary: mysql-yseslc-mysql-0 mysql-yseslc-mysql-1;secondary: No resources found in ns-kcduy namespace. primary: mysql-yseslc-mysql-0 mysql-yseslc-mysql-1;secondary: check cluster role done primary: mysql-yseslc-mysql-1;secondary: mysql-yseslc-mysql-0 `kubectl get secrets -l app.kubernetes.io/instance=mysql-yseslc` set secret: mysql-yseslc-mysql-account-root `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:94J7Xw74tE;DB_PORT:3306;DB_DATABASE:mysql check cluster connect `echo " echo \"SHOW SLAVE STATUS\G;\" | mysql -P3306 -h127.0.0.1 -uroot -p'94J7Xw74tE' " | kubectl exec -it mysql-yseslc-mysql-0 --namespace ns-kcduy -- bash ` check cluster connect done `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge NetworkChaos test-chaos-mesh-networkcorruptover-mysql-yseslc --namespace ns-kcduy ` Warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely. networkchaos.chaos-mesh.org "test-chaos-mesh-networkcorruptover-mysql-yseslc" force deleted Error from server (NotFound): networkchaos.chaos-mesh.org "test-chaos-mesh-networkcorruptover-mysql-yseslc" not found check failover pod name failover pod name:mysql-yseslc-mysql-1 failover networkcorruptover Success `kubectl get secrets -l app.kubernetes.io/instance=mysql-yseslc` set secret: mysql-yseslc-mysql-account-root `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:94J7Xw74tE;DB_PORT:3306;DB_DATABASE:mysql check db_client batch data count `echo "echo \"select count(*) from executions_loop.executions_loop_table;\" | mysql -P3306 -hmysql-yseslc-mysql.ns-kcduy.svc.cluster.local -uroot -p'94J7Xw74tE' " | kubectl exec -it mysql-yseslc-mysql-1 --namespace ns-kcduy -- bash ` check db_client batch data Success `kubectl get secrets -l app.kubernetes.io/instance=mysql-yseslc` set secret: mysql-yseslc-mysql-account-root `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:94J7Xw74tE;DB_PORT:3306;DB_DATABASE:mysql check readonly db_client batch data count `echo "echo \"select count(*) from executions_loop.executions_loop_table;\" | mysql -P3306 -h127.0.0.1 -uroot -p'94J7Xw74tE' " | kubectl exec -it mysql-yseslc-mysql-0 --namespace ns-kcduy -- bash ` check readonly db_client batch data Success test switchover apiVersion: operations.kubeblocks.io/v1alpha1 kind: OpsRequest metadata: generateName: mysql-yseslc-switchover- namespace: ns-kcduy spec: clusterName: mysql-yseslc type: Switchover switchover: - componentName: mysql candidateName: 'mysql-yseslc-mysql-0' instanceName: 'mysql-yseslc-mysql-1' `kubectl create -f test_create_mysql-yseslc_switchover.yaml` opsrequest.operations.kubeblocks.io/mysql-yseslc-switchover-4bfkr created create test_create_mysql-yseslc_switchover.yaml Success `rm -rf test_create_mysql-yseslc_switchover.yaml` switchover pod:mysql-yseslc-mysql-1 checking switchover... switchover pod:mysql-yseslc-mysql-1 checking switchover... get mysql primary pod name... switchover pod:mysql-yseslc-mysql-0 switchover success No resources found in ns-kcduy namespace. `kubectl get secrets -l app.kubernetes.io/instance=mysql-yseslc` set secret: mysql-yseslc-mysql-account-root `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:94J7Xw74tE;DB_PORT:3306;DB_DATABASE:mysql apiVersion: v1 kind: Pod metadata: name: benchtest-mysql-yseslc namespace: ns-kcduy spec: containers: - name: test-sysbench imagePullPolicy: IfNotPresent image: docker.io/apecloud/customsuites:latest env: - name: TYPE value: "2" - name: FLAG value: "0" - name: CONFIGS value: "mode:all,driver:mysql,host:mysql-yseslc-mysql.ns-kcduy.svc.cluster.local,user:root,password:94J7Xw74tE,port:3306,db:benchtest,tables:5,threads:4,times:10,size:1000,type:oltp_read_write" restartPolicy: Never `kubectl apply -f benchtest-mysql-yseslc.yaml` pod/benchtest-mysql-yseslc created apply benchtest-mysql-yseslc.yaml Success check pod status pod_status:NAME READY STATUS RESTARTS AGE benchtest-mysql-yseslc 0/1 ContainerCreating 0 0s pod_status:NAME READY STATUS RESTARTS AGE benchtest-mysql-yseslc 0/1 ContainerCreating 0 5s pod_status:NAME READY STATUS RESTARTS AGE benchtest-mysql-yseslc 0/1 ContainerCreating 0 10s pod_status:NAME READY STATUS RESTARTS AGE benchtest-mysql-yseslc 0/1 ContainerCreating 0 15s pod_status:NAME READY STATUS RESTARTS AGE benchtest-mysql-yseslc 1/1 Running 0 20s pod_status:NAME READY STATUS RESTARTS AGE benchtest-mysql-yseslc 1/1 Running 0 25s pod_status:NAME READY STATUS RESTARTS AGE benchtest-mysql-yseslc 1/1 Running 0 30s pod_status:NAME READY STATUS RESTARTS AGE benchtest-mysql-yseslc 1/1 Running 0 35s check pod benchtest-mysql-yseslc status done pod_status:NAME READY STATUS RESTARTS AGE benchtest-mysql-yseslc 0/1 Completed 0 40s `rm -rf benchtest-mysql-yseslc.yaml` `kubectl logs benchtest-mysql-yseslc --tail 30 --namespace ns-kcduy ` [ 7s ] thds: 4 tps: 19.99 qps: 367.89 (r/w/o: 257.92/69.98/39.99) lat (ms,99%): 502.20 err/s: 0.00 reconn/s: 0.00 [ 8s ] thds: 4 tps: 18.00 qps: 370.10 (r/w/o: 262.07/72.02/36.01) lat (ms,99%): 303.33 err/s: 0.00 reconn/s: 0.00 [ 9s ] thds: 4 tps: 17.00 qps: 357.00 (r/w/o: 248.00/75.00/34.00) lat (ms,99%): 383.33 err/s: 0.00 reconn/s: 0.00 [ 10s ] thds: 4 tps: 17.00 qps: 356.04 (r/w/o: 253.03/69.01/34.00) lat (ms,99%): 390.30 err/s: 0.00 reconn/s: 0.00 SQL statistics: queries performed: read: 2450 write: 700 other: 350 total: 3500 transactions: 175 (17.45 per sec.) queries: 3500 (349.08 per sec.) ignored errors: 0 (0.00 per sec.) reconnects: 0 (0.00 per sec.) General statistics: total time: 10.0247s total number of events: 175 Latency (ms): min: 16.71 avg: 228.92 max: 514.88 99th percentile: 484.44 sum: 40060.63 Threads fairness: events (avg/stddev): 43.7500/1.92 execution time (avg/stddev): 10.0152/0.01 `kubectl delete pod benchtest-mysql-yseslc --force --namespace ns-kcduy ` Warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely. pod "benchtest-mysql-yseslc" force deleted LB_TYPE is set to: intranet No resources found in ns-kcduy namespace. `kubectl get secrets -l app.kubernetes.io/instance=mysql-yseslc` set secret: mysql-yseslc-mysql-account-root `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:94J7Xw74tE;DB_PORT:3306;DB_DATABASE:mysql apiVersion: v1 kind: Pod metadata: name: benchtest-mysql-yseslc namespace: ns-kcduy spec: containers: - name: test-sysbench imagePullPolicy: IfNotPresent image: docker.io/apecloud/customsuites:latest env: - name: TYPE value: "2" - name: FLAG value: "0" - name: CONFIGS value: "mode:all,driver:mysql,host:10.224.0.8,user:root,password:94J7Xw74tE,port:3306,db:benchtest,tables:5,threads:4,times:10,size:1000,type:oltp_read_write" restartPolicy: Never `kubectl apply -f benchtest-mysql-yseslc.yaml` pod/benchtest-mysql-yseslc created apply benchtest-mysql-yseslc.yaml Success check pod status pod_status:NAME READY STATUS RESTARTS AGE benchtest-mysql-yseslc 0/1 ContainerCreating 0 0s pod_status:NAME READY STATUS RESTARTS AGE benchtest-mysql-yseslc 1/1 Running 0 4s pod_status:NAME READY STATUS RESTARTS AGE benchtest-mysql-yseslc 1/1 Running 0 9s pod_status:NAME READY STATUS RESTARTS AGE benchtest-mysql-yseslc 1/1 Running 0 14s check pod benchtest-mysql-yseslc status done pod_status:NAME READY STATUS RESTARTS AGE benchtest-mysql-yseslc 0/1 Completed 0 19s `rm -rf benchtest-mysql-yseslc.yaml` `kubectl logs benchtest-mysql-yseslc --tail 30 --namespace ns-kcduy ` [ 7s ] thds: 4 tps: 18.00 qps: 357.01 (r/w/o: 252.01/69.00/36.00) lat (ms,99%): 502.20 err/s: 0.00 reconn/s: 0.00 [ 8s ] thds: 4 tps: 17.00 qps: 301.93 (r/w/o: 208.95/58.99/33.99) lat (ms,99%): 502.20 err/s: 0.00 reconn/s: 0.00 [ 9s ] thds: 4 tps: 15.00 qps: 333.08 (r/w/o: 235.06/68.02/30.01) lat (ms,99%): 390.30 err/s: 0.00 reconn/s: 0.00 [ 10s ] thds: 4 tps: 17.00 qps: 337.00 (r/w/o: 240.00/63.00/34.00) lat (ms,99%): 383.33 err/s: 0.00 reconn/s: 0.00 SQL statistics: queries performed: read: 2240 write: 640 other: 320 total: 3200 transactions: 160 (15.69 per sec.) queries: 3200 (313.84 per sec.) ignored errors: 0 (0.00 per sec.) reconnects: 0 (0.00 per sec.) General statistics: total time: 10.1945s total number of events: 160 Latency (ms): min: 14.15 avg: 253.67 max: 597.22 99th percentile: 502.20 sum: 40587.55 Threads fairness: events (avg/stddev): 40.0000/2.12 execution time (avg/stddev): 10.1469/0.05 `kubectl delete pod benchtest-mysql-yseslc --force --namespace ns-kcduy ` Warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely. pod "benchtest-mysql-yseslc" force deleted cluster configure component_tmp: mysql apiVersion: operations.kubeblocks.io/v1alpha1 kind: OpsRequest metadata: generateName: mysql-yseslc-reconfiguring- namespace: ns-kcduy spec: type: Reconfiguring clusterName: mysql-yseslc force: true reconfigures: - componentName: mysql parameters: - key: binlog_expire_logs_seconds value: '691200' check cluster status before ops check cluster status done cluster_status:Running `kubectl create -f test_ops_cluster_mysql-yseslc.yaml` opsrequest.operations.kubeblocks.io/mysql-yseslc-reconfiguring-8qml8 created create test_ops_cluster_mysql-yseslc.yaml Success `rm -rf test_ops_cluster_mysql-yseslc.yaml` check ops status `kbcli cluster list-ops mysql-yseslc --status all --namespace ns-kcduy ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME mysql-yseslc-switchover-4bfkr ns-kcduy Switchover mysql-yseslc mysql Succeed 1/1 Sep 11,2025 20:34 UTC+0800 mysql-yseslc-reconfiguring-8qml8 ns-kcduy Reconfiguring mysql-yseslc mysql,mysql Creating -/- Sep 11,2025 20:38 UTC+0800 check cluster status `kbcli cluster list mysql-yseslc --show-labels --namespace ns-kcduy ` NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS mysql-yseslc ns-kcduy mysql DoNotTerminate Running Sep 11,2025 20:24 UTC+0800 app.kubernetes.io/instance=mysql-yseslc,clusterdefinition.kubeblocks.io/name=mysql check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances mysql-yseslc --namespace ns-kcduy ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME mysql-yseslc-mysql-0 ns-kcduy mysql-yseslc mysql Running primary 0 100m / 100m 512Mi / 512Mi data:10Gi aks-cicdamdpool-42425418-vmss000001/10.224.0.5 Sep 11,2025 20:24 UTC+0800 mysql-yseslc-mysql-1 ns-kcduy mysql-yseslc mysql Running secondary 0 100m / 100m 512Mi / 512Mi data:10Gi aks-cicdamdpool-42425418-vmss000002/10.224.0.7 Sep 11,2025 20:27 UTC+0800 mysql-yseslc-proxysql-0 ns-kcduy mysql-yseslc proxysql Running 0 100m / 100m 512Mi / 512Mi aks-cicdamdpool-42425418-vmss000001/10.224.0.5 Sep 11,2025 20:28 UTC+0800 check pod status done check cluster role check cluster role done primary: mysql-yseslc-mysql-0;secondary: mysql-yseslc-mysql-1 `kubectl get secrets -l app.kubernetes.io/instance=mysql-yseslc` set secret: mysql-yseslc-mysql-account-root `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:94J7Xw74tE;DB_PORT:3306;DB_DATABASE:mysql check cluster connect `echo " echo \"SHOW SLAVE STATUS\G;\" | mysql -P3306 -h127.0.0.1 -uroot -p'94J7Xw74tE' " | kubectl exec -it mysql-yseslc-mysql-1 --namespace ns-kcduy -- bash ` check cluster connect done check ops status `kbcli cluster list-ops mysql-yseslc --status all --namespace ns-kcduy ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME mysql-yseslc-switchover-4bfkr ns-kcduy Switchover mysql-yseslc mysql Succeed 1/1 Sep 11,2025 20:34 UTC+0800 mysql-yseslc-reconfiguring-8qml8 ns-kcduy Reconfiguring mysql-yseslc mysql,mysql Succeed -/- Sep 11,2025 20:38 UTC+0800 check ops status done ops_status:mysql-yseslc-reconfiguring-8qml8 ns-kcduy Reconfiguring mysql-yseslc mysql,mysql Succeed -/- Sep 11,2025 20:38 UTC+0800 `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge opsrequests.operations mysql-yseslc-reconfiguring-8qml8 --namespace ns-kcduy ` opsrequest.operations.kubeblocks.io/mysql-yseslc-reconfiguring-8qml8 patched `kbcli cluster delete-ops --name mysql-yseslc-reconfiguring-8qml8 --force --auto-approve --namespace ns-kcduy ` OpsRequest mysql-yseslc-reconfiguring-8qml8 deleted component_config:mysql check config variables `kubectl get secrets -l app.kubernetes.io/instance=mysql-yseslc` set secret: mysql-yseslc-mysql-account-root `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:94J7Xw74tE;DB_PORT:3306;DB_DATABASE:mysql Defaulted container "mysql" out of: mysql, mysql-exporter, kbagent, config-manager, init-data (init), init-xtrabackup (init), init-jemalloc (init), init-syncer (init), init-kbagent (init), kbagent-worker (init) Unable to use a TTY - input is not a terminal or the right kind of file Warning: arning] Using a password on the command line interface can be insecure. current value_actual: 691200 configure:[binlog_expire_logs_seconds] result actual:[691200] equal expected:[691200] `kubectl get secrets -l app.kubernetes.io/instance=mysql-yseslc` set secret: mysql-yseslc-mysql-account-root `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:94J7Xw74tE;DB_PORT:3306;DB_DATABASE:mysql check db_client batch data count `echo "echo \"select count(*) from executions_loop.executions_loop_table;\" | mysql -P3306 -hmysql-yseslc-mysql.ns-kcduy.svc.cluster.local -uroot -p'94J7Xw74tE' " | kubectl exec -it mysql-yseslc-mysql-0 --namespace ns-kcduy -- bash ` check db_client batch data Success `kubectl get secrets -l app.kubernetes.io/instance=mysql-yseslc` set secret: mysql-yseslc-mysql-account-root `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:94J7Xw74tE;DB_PORT:3306;DB_DATABASE:mysql check readonly db_client batch data count `echo "echo \"select count(*) from executions_loop.executions_loop_table;\" | mysql -P3306 -h127.0.0.1 -uroot -p'94J7Xw74tE' " | kubectl exec -it mysql-yseslc-mysql-1 --namespace ns-kcduy -- bash ` check readonly db_client batch data Success cluster does not need to check monitor currently check cluster status `kbcli cluster list mysql-yseslc --show-labels --namespace ns-kcduy ` NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS mysql-yseslc ns-kcduy mysql DoNotTerminate Running Sep 11,2025 20:24 UTC+0800 app.kubernetes.io/instance=mysql-yseslc,clusterdefinition.kubeblocks.io/name=mysql check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances mysql-yseslc --namespace ns-kcduy ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME mysql-yseslc-mysql-0 ns-kcduy mysql-yseslc mysql Running primary 0 100m / 100m 512Mi / 512Mi data:10Gi aks-cicdamdpool-42425418-vmss000001/10.224.0.5 Sep 11,2025 20:24 UTC+0800 mysql-yseslc-mysql-1 ns-kcduy mysql-yseslc mysql Running secondary 0 100m / 100m 512Mi / 512Mi data:10Gi aks-cicdamdpool-42425418-vmss000002/10.224.0.7 Sep 11,2025 20:27 UTC+0800 mysql-yseslc-proxysql-0 ns-kcduy mysql-yseslc proxysql Running 0 100m / 100m 512Mi / 512Mi aks-cicdamdpool-42425418-vmss000001/10.224.0.5 Sep 11,2025 20:28 UTC+0800 check pod status done check cluster role check cluster role done primary: mysql-yseslc-mysql-0;secondary: mysql-yseslc-mysql-1 `kubectl get secrets -l app.kubernetes.io/instance=mysql-yseslc` set secret: mysql-yseslc-mysql-account-root `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:94J7Xw74tE;DB_PORT:3306;DB_DATABASE:mysql check cluster connect `echo " echo \"SHOW SLAVE STATUS\G;\" | mysql -P3306 -h127.0.0.1 -uroot -p'94J7Xw74tE' " | kubectl exec -it mysql-yseslc-mysql-1 --namespace ns-kcduy -- bash ` check cluster connect done test failover networkdelay check cluster status before cluster-failover-networkdelay check cluster status done cluster_status:Running `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge NetworkChaos test-chaos-mesh-networkdelay-mysql-yseslc --namespace ns-kcduy ` Warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely. Error from server (NotFound): networkchaos.chaos-mesh.org "test-chaos-mesh-networkdelay-mysql-yseslc" not found Error from server (NotFound): networkchaos.chaos-mesh.org "test-chaos-mesh-networkdelay-mysql-yseslc" not found apiVersion: chaos-mesh.org/v1alpha1 kind: NetworkChaos metadata: name: test-chaos-mesh-networkdelay-mysql-yseslc namespace: ns-kcduy spec: selector: namespaces: - ns-kcduy labelSelectors: apps.kubeblocks.io/pod-name: mysql-yseslc-mysql-0 mode: all action: delay delay: latency: 2000ms correlation: '100' jitter: 0ms direction: to duration: 2m `kubectl apply -f test-chaos-mesh-networkdelay-mysql-yseslc.yaml` networkchaos.chaos-mesh.org/test-chaos-mesh-networkdelay-mysql-yseslc created apply test-chaos-mesh-networkdelay-mysql-yseslc.yaml Success `rm -rf test-chaos-mesh-networkdelay-mysql-yseslc.yaml` networkdelay chaos test waiting 120 seconds check cluster status `kbcli cluster list mysql-yseslc --show-labels --namespace ns-kcduy ` NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS mysql-yseslc ns-kcduy mysql DoNotTerminate Running Sep 11,2025 20:24 UTC+0800 app.kubernetes.io/instance=mysql-yseslc,clusterdefinition.kubeblocks.io/name=mysql check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances mysql-yseslc --namespace ns-kcduy ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME mysql-yseslc-mysql-0 ns-kcduy mysql-yseslc mysql Running primary 0 100m / 100m 512Mi / 512Mi data:10Gi aks-cicdamdpool-42425418-vmss000001/10.224.0.5 Sep 11,2025 20:24 UTC+0800 mysql-yseslc-mysql-1 ns-kcduy mysql-yseslc mysql Running secondary 0 100m / 100m 512Mi / 512Mi data:10Gi aks-cicdamdpool-42425418-vmss000002/10.224.0.7 Sep 11,2025 20:27 UTC+0800 mysql-yseslc-proxysql-0 ns-kcduy mysql-yseslc proxysql Running 0 100m / 100m 512Mi / 512Mi aks-cicdamdpool-42425418-vmss000001/10.224.0.5 Sep 11,2025 20:28 UTC+0800 check pod status done check cluster role check cluster role done primary: mysql-yseslc-mysql-0;secondary: mysql-yseslc-mysql-1 `kubectl get secrets -l app.kubernetes.io/instance=mysql-yseslc` set secret: mysql-yseslc-mysql-account-root `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:94J7Xw74tE;DB_PORT:3306;DB_DATABASE:mysql check cluster connect `echo " echo \"SHOW SLAVE STATUS\G;\" | mysql -P3306 -h127.0.0.1 -uroot -p'94J7Xw74tE' " | kubectl exec -it mysql-yseslc-mysql-1 --namespace ns-kcduy -- bash ` check cluster connect done `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge NetworkChaos test-chaos-mesh-networkdelay-mysql-yseslc --namespace ns-kcduy ` Warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely. networkchaos.chaos-mesh.org "test-chaos-mesh-networkdelay-mysql-yseslc" force deleted Error from server (NotFound): networkchaos.chaos-mesh.org "test-chaos-mesh-networkdelay-mysql-yseslc" not found check failover pod name failover pod name:mysql-yseslc-mysql-0 failover networkdelay Success `kubectl get secrets -l app.kubernetes.io/instance=mysql-yseslc` set secret: mysql-yseslc-mysql-account-root `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:94J7Xw74tE;DB_PORT:3306;DB_DATABASE:mysql check db_client batch data count `echo "echo \"select count(*) from executions_loop.executions_loop_table;\" | mysql -P3306 -hmysql-yseslc-mysql.ns-kcduy.svc.cluster.local -uroot -p'94J7Xw74tE' " | kubectl exec -it mysql-yseslc-mysql-0 --namespace ns-kcduy -- bash ` check db_client batch data Success `kubectl get secrets -l app.kubernetes.io/instance=mysql-yseslc` set secret: mysql-yseslc-mysql-account-root `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:94J7Xw74tE;DB_PORT:3306;DB_DATABASE:mysql check readonly db_client batch data count `echo "echo \"select count(*) from executions_loop.executions_loop_table;\" | mysql -P3306 -h127.0.0.1 -uroot -p'94J7Xw74tE' " | kubectl exec -it mysql-yseslc-mysql-1 --namespace ns-kcduy -- bash ` check readonly db_client batch data Success cluster restart check cluster status before ops check cluster status done cluster_status:Running `kbcli cluster restart mysql-yseslc --auto-approve --force=true --namespace ns-kcduy ` OpsRequest mysql-yseslc-restart-prnf4 created successfully, you can view the progress: kbcli cluster describe-ops mysql-yseslc-restart-prnf4 -n ns-kcduy check ops status `kbcli cluster list-ops mysql-yseslc --status all --namespace ns-kcduy ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME mysql-yseslc-switchover-4bfkr ns-kcduy Switchover mysql-yseslc mysql Succeed 1/1 Sep 11,2025 20:34 UTC+0800 mysql-yseslc-restart-prnf4 ns-kcduy Restart mysql-yseslc mysql,proxysql Creating -/- Sep 11,2025 20:40 UTC+0800 check cluster status `kbcli cluster list mysql-yseslc --show-labels --namespace ns-kcduy ` NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS mysql-yseslc ns-kcduy mysql DoNotTerminate Updating Sep 11,2025 20:24 UTC+0800 app.kubernetes.io/instance=mysql-yseslc,clusterdefinition.kubeblocks.io/name=mysql cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances mysql-yseslc --namespace ns-kcduy ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME mysql-yseslc-mysql-0 ns-kcduy mysql-yseslc mysql Running secondary 0 100m / 100m 512Mi / 512Mi data:10Gi aks-cicdamdpool-42425418-vmss000001/10.224.0.5 Sep 11,2025 20:41 UTC+0800 mysql-yseslc-mysql-1 ns-kcduy mysql-yseslc mysql Running primary 0 100m / 100m 512Mi / 512Mi data:10Gi aks-cicdamdpool-42425418-vmss000002/10.224.0.7 Sep 11,2025 20:40 UTC+0800 mysql-yseslc-proxysql-0 ns-kcduy mysql-yseslc proxysql Running 0 100m / 100m 512Mi / 512Mi aks-cicdamdpool-42425418-vmss000001/10.224.0.5 Sep 11,2025 20:42 UTC+0800 check pod status done check cluster role check cluster role done primary: mysql-yseslc-mysql-1;secondary: mysql-yseslc-mysql-0 `kubectl get secrets -l app.kubernetes.io/instance=mysql-yseslc` set secret: mysql-yseslc-mysql-account-root `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:94J7Xw74tE;DB_PORT:3306;DB_DATABASE:mysql check cluster connect `echo " echo \"SHOW SLAVE STATUS\G;\" | mysql -P3306 -h127.0.0.1 -uroot -p'94J7Xw74tE' " | kubectl exec -it mysql-yseslc-mysql-0 --namespace ns-kcduy -- bash ` check cluster connect done check ops status `kbcli cluster list-ops mysql-yseslc --status all --namespace ns-kcduy ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME mysql-yseslc-switchover-4bfkr ns-kcduy Switchover mysql-yseslc mysql Succeed 1/1 Sep 11,2025 20:34 UTC+0800 mysql-yseslc-restart-prnf4 ns-kcduy Restart mysql-yseslc mysql,proxysql Succeed 3/3 Sep 11,2025 20:40 UTC+0800 check ops status done ops_status:mysql-yseslc-restart-prnf4 ns-kcduy Restart mysql-yseslc mysql,proxysql Succeed 3/3 Sep 11,2025 20:40 UTC+0800 `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge opsrequests.operations mysql-yseslc-restart-prnf4 --namespace ns-kcduy ` opsrequest.operations.kubeblocks.io/mysql-yseslc-restart-prnf4 patched `kbcli cluster delete-ops --name mysql-yseslc-restart-prnf4 --force --auto-approve --namespace ns-kcduy ` OpsRequest mysql-yseslc-restart-prnf4 deleted `kubectl get secrets -l app.kubernetes.io/instance=mysql-yseslc` set secret: mysql-yseslc-mysql-account-root `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:94J7Xw74tE;DB_PORT:3306;DB_DATABASE:mysql check db_client batch data count `echo "echo \"select count(*) from executions_loop.executions_loop_table;\" | mysql -P3306 -hmysql-yseslc-mysql.ns-kcduy.svc.cluster.local -uroot -p'94J7Xw74tE' " | kubectl exec -it mysql-yseslc-mysql-1 --namespace ns-kcduy -- bash ` check db_client batch data Success `kubectl get secrets -l app.kubernetes.io/instance=mysql-yseslc` set secret: mysql-yseslc-mysql-account-root `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:94J7Xw74tE;DB_PORT:3306;DB_DATABASE:mysql check readonly db_client batch data count `echo "echo \"select count(*) from executions_loop.executions_loop_table;\" | mysql -P3306 -h127.0.0.1 -uroot -p'94J7Xw74tE' " | kubectl exec -it mysql-yseslc-mysql-0 --namespace ns-kcduy -- bash ` check readonly db_client batch data Success test failover networkduplicate check cluster status before cluster-failover-networkduplicate check cluster status done cluster_status:Running `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge NetworkChaos test-chaos-mesh-networkduplicate-mysql-yseslc --namespace ns-kcduy ` Warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely. Error from server (NotFound): networkchaos.chaos-mesh.org "test-chaos-mesh-networkduplicate-mysql-yseslc" not found Error from server (NotFound): networkchaos.chaos-mesh.org "test-chaos-mesh-networkduplicate-mysql-yseslc" not found apiVersion: chaos-mesh.org/v1alpha1 kind: NetworkChaos metadata: name: test-chaos-mesh-networkduplicate-mysql-yseslc namespace: ns-kcduy spec: selector: namespaces: - ns-kcduy labelSelectors: apps.kubeblocks.io/pod-name: mysql-yseslc-mysql-1 mode: all action: duplicate duplicate: duplicate: '100' correlation: '100' direction: to duration: 2m `kubectl apply -f test-chaos-mesh-networkduplicate-mysql-yseslc.yaml` networkchaos.chaos-mesh.org/test-chaos-mesh-networkduplicate-mysql-yseslc created apply test-chaos-mesh-networkduplicate-mysql-yseslc.yaml Success `rm -rf test-chaos-mesh-networkduplicate-mysql-yseslc.yaml` networkduplicate chaos test waiting 120 seconds check cluster status `kbcli cluster list mysql-yseslc --show-labels --namespace ns-kcduy ` NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS mysql-yseslc ns-kcduy mysql DoNotTerminate Running Sep 11,2025 20:24 UTC+0800 app.kubernetes.io/instance=mysql-yseslc,clusterdefinition.kubeblocks.io/name=mysql check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances mysql-yseslc --namespace ns-kcduy ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME mysql-yseslc-mysql-0 ns-kcduy mysql-yseslc mysql Running secondary 0 100m / 100m 512Mi / 512Mi data:10Gi aks-cicdamdpool-42425418-vmss000001/10.224.0.5 Sep 11,2025 20:41 UTC+0800 mysql-yseslc-mysql-1 ns-kcduy mysql-yseslc mysql Running primary 0 100m / 100m 512Mi / 512Mi data:10Gi aks-cicdamdpool-42425418-vmss000002/10.224.0.7 Sep 11,2025 20:40 UTC+0800 mysql-yseslc-proxysql-0 ns-kcduy mysql-yseslc proxysql Running 0 100m / 100m 512Mi / 512Mi aks-cicdamdpool-42425418-vmss000001/10.224.0.5 Sep 11,2025 20:42 UTC+0800 check pod status done check cluster role check cluster role done primary: mysql-yseslc-mysql-1;secondary: mysql-yseslc-mysql-0 `kubectl get secrets -l app.kubernetes.io/instance=mysql-yseslc` set secret: mysql-yseslc-mysql-account-root `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:94J7Xw74tE;DB_PORT:3306;DB_DATABASE:mysql check cluster connect `echo " echo \"SHOW SLAVE STATUS\G;\" | mysql -P3306 -h127.0.0.1 -uroot -p'94J7Xw74tE' " | kubectl exec -it mysql-yseslc-mysql-0 --namespace ns-kcduy -- bash ` check cluster connect done `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge NetworkChaos test-chaos-mesh-networkduplicate-mysql-yseslc --namespace ns-kcduy ` Warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely. networkchaos.chaos-mesh.org "test-chaos-mesh-networkduplicate-mysql-yseslc" force deleted networkchaos.chaos-mesh.org/test-chaos-mesh-networkduplicate-mysql-yseslc patched check failover pod name failover pod name:mysql-yseslc-mysql-1 failover networkduplicate Success `kubectl get secrets -l app.kubernetes.io/instance=mysql-yseslc` set secret: mysql-yseslc-mysql-account-root `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:94J7Xw74tE;DB_PORT:3306;DB_DATABASE:mysql check db_client batch data count `echo "echo \"select count(*) from executions_loop.executions_loop_table;\" | mysql -P3306 -hmysql-yseslc-mysql.ns-kcduy.svc.cluster.local -uroot -p'94J7Xw74tE' " | kubectl exec -it mysql-yseslc-mysql-1 --namespace ns-kcduy -- bash ` check db_client batch data Success `kubectl get secrets -l app.kubernetes.io/instance=mysql-yseslc` set secret: mysql-yseslc-mysql-account-root `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:94J7Xw74tE;DB_PORT:3306;DB_DATABASE:mysql check readonly db_client batch data count `echo "echo \"select count(*) from executions_loop.executions_loop_table;\" | mysql -P3306 -h127.0.0.1 -uroot -p'94J7Xw74tE' " | kubectl exec -it mysql-yseslc-mysql-0 --namespace ns-kcduy -- bash ` check readonly db_client batch data Success test failover kill1 check cluster status before cluster-failover-kill1 check cluster status done cluster_status:Running `kill 1` Defaulted container "mysql" out of: mysql, mysql-exporter, kbagent, config-manager, init-data (init), init-xtrabackup (init), init-jemalloc (init), init-syncer (init), init-kbagent (init), kbagent-worker (init) Unable to use a TTY - input is not a terminal or the right kind of file exec return message: check cluster status `kbcli cluster list mysql-yseslc --show-labels --namespace ns-kcduy ` NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS mysql-yseslc ns-kcduy mysql DoNotTerminate Running Sep 11,2025 20:24 UTC+0800 app.kubernetes.io/instance=mysql-yseslc,clusterdefinition.kubeblocks.io/name=mysql check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances mysql-yseslc --namespace ns-kcduy ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME mysql-yseslc-mysql-0 ns-kcduy mysql-yseslc mysql Running primary 0 100m / 100m 512Mi / 512Mi data:10Gi aks-cicdamdpool-42425418-vmss000001/10.224.0.5 Sep 11,2025 20:41 UTC+0800 mysql-yseslc-mysql-1 ns-kcduy mysql-yseslc mysql Running secondary 0 100m / 100m 512Mi / 512Mi data:10Gi aks-cicdamdpool-42425418-vmss000002/10.224.0.7 Sep 11,2025 20:40 UTC+0800 mysql-yseslc-proxysql-0 ns-kcduy mysql-yseslc proxysql Running 0 100m / 100m 512Mi / 512Mi aks-cicdamdpool-42425418-vmss000001/10.224.0.5 Sep 11,2025 20:42 UTC+0800 check pod status done check cluster role check cluster role done primary: mysql-yseslc-mysql-0;secondary: mysql-yseslc-mysql-1 `kubectl get secrets -l app.kubernetes.io/instance=mysql-yseslc` set secret: mysql-yseslc-mysql-account-root `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:94J7Xw74tE;DB_PORT:3306;DB_DATABASE:mysql check cluster connect `echo " echo \"SHOW SLAVE STATUS\G;\" | mysql -P3306 -h127.0.0.1 -uroot -p'94J7Xw74tE' " | kubectl exec -it mysql-yseslc-mysql-1 --namespace ns-kcduy -- bash ` check cluster connect done check failover pod name failover pod name:mysql-yseslc-mysql-0 failover kill1 Success `kubectl get secrets -l app.kubernetes.io/instance=mysql-yseslc` set secret: mysql-yseslc-mysql-account-root `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:94J7Xw74tE;DB_PORT:3306;DB_DATABASE:mysql check db_client batch data count `echo "echo \"select count(*) from executions_loop.executions_loop_table;\" | mysql -P3306 -hmysql-yseslc-mysql.ns-kcduy.svc.cluster.local -uroot -p'94J7Xw74tE' " | kubectl exec -it mysql-yseslc-mysql-0 --namespace ns-kcduy -- bash ` check db_client batch data Success `kubectl get secrets -l app.kubernetes.io/instance=mysql-yseslc` set secret: mysql-yseslc-mysql-account-root `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:94J7Xw74tE;DB_PORT:3306;DB_DATABASE:mysql check readonly db_client batch data count `echo "echo \"select count(*) from executions_loop.executions_loop_table;\" | mysql -P3306 -h127.0.0.1 -uroot -p'94J7Xw74tE' " | kubectl exec -it mysql-yseslc-mysql-1 --namespace ns-kcduy -- bash ` check readonly db_client batch data Success test failover fullcpu check cluster status before cluster-failover-fullcpu check cluster status done cluster_status:Running `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge StressChaos test-chaos-mesh-fullcpu-mysql-yseslc --namespace ns-kcduy ` Warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely. Error from server (NotFound): stresschaos.chaos-mesh.org "test-chaos-mesh-fullcpu-mysql-yseslc" not found Error from server (NotFound): stresschaos.chaos-mesh.org "test-chaos-mesh-fullcpu-mysql-yseslc" not found apiVersion: chaos-mesh.org/v1alpha1 kind: StressChaos metadata: name: test-chaos-mesh-fullcpu-mysql-yseslc namespace: ns-kcduy spec: selector: namespaces: - ns-kcduy labelSelectors: apps.kubeblocks.io/pod-name: mysql-yseslc-mysql-0 mode: all stressors: cpu: workers: 100 load: 100 duration: 2m `kubectl apply -f test-chaos-mesh-fullcpu-mysql-yseslc.yaml` stresschaos.chaos-mesh.org/test-chaos-mesh-fullcpu-mysql-yseslc created apply test-chaos-mesh-fullcpu-mysql-yseslc.yaml Success `rm -rf test-chaos-mesh-fullcpu-mysql-yseslc.yaml` fullcpu chaos test waiting 120 seconds check cluster status `kbcli cluster list mysql-yseslc --show-labels --namespace ns-kcduy ` NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS mysql-yseslc ns-kcduy mysql DoNotTerminate Running Sep 11,2025 20:24 UTC+0800 app.kubernetes.io/instance=mysql-yseslc,clusterdefinition.kubeblocks.io/name=mysql check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances mysql-yseslc --namespace ns-kcduy ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME mysql-yseslc-mysql-0 ns-kcduy mysql-yseslc mysql Running primary 0 100m / 100m 512Mi / 512Mi data:10Gi aks-cicdamdpool-42425418-vmss000001/10.224.0.5 Sep 11,2025 20:41 UTC+0800 mysql-yseslc-mysql-1 ns-kcduy mysql-yseslc mysql Running secondary 0 100m / 100m 512Mi / 512Mi data:10Gi aks-cicdamdpool-42425418-vmss000002/10.224.0.7 Sep 11,2025 20:40 UTC+0800 mysql-yseslc-proxysql-0 ns-kcduy mysql-yseslc proxysql Running 0 100m / 100m 512Mi / 512Mi aks-cicdamdpool-42425418-vmss000001/10.224.0.5 Sep 11,2025 20:42 UTC+0800 check pod status done check cluster role check cluster role done primary: mysql-yseslc-mysql-0;secondary: mysql-yseslc-mysql-1 `kubectl get secrets -l app.kubernetes.io/instance=mysql-yseslc` set secret: mysql-yseslc-mysql-account-root `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:94J7Xw74tE;DB_PORT:3306;DB_DATABASE:mysql check cluster connect `echo " echo \"SHOW SLAVE STATUS\G;\" | mysql -P3306 -h127.0.0.1 -uroot -p'94J7Xw74tE' " | kubectl exec -it mysql-yseslc-mysql-1 --namespace ns-kcduy -- bash ` check cluster connect done `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge StressChaos test-chaos-mesh-fullcpu-mysql-yseslc --namespace ns-kcduy ` Warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely. stresschaos.chaos-mesh.org "test-chaos-mesh-fullcpu-mysql-yseslc" force deleted Error from server (NotFound): stresschaos.chaos-mesh.org "test-chaos-mesh-fullcpu-mysql-yseslc" not found check failover pod name failover pod name:mysql-yseslc-mysql-0 failover fullcpu Success `kubectl get secrets -l app.kubernetes.io/instance=mysql-yseslc` set secret: mysql-yseslc-mysql-account-root `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:94J7Xw74tE;DB_PORT:3306;DB_DATABASE:mysql check db_client batch data count `echo "echo \"select count(*) from executions_loop.executions_loop_table;\" | mysql -P3306 -hmysql-yseslc-mysql.ns-kcduy.svc.cluster.local -uroot -p'94J7Xw74tE' " | kubectl exec -it mysql-yseslc-mysql-0 --namespace ns-kcduy -- bash ` check db_client batch data Success `kubectl get secrets -l app.kubernetes.io/instance=mysql-yseslc` set secret: mysql-yseslc-mysql-account-root `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:94J7Xw74tE;DB_PORT:3306;DB_DATABASE:mysql check readonly db_client batch data count `echo "echo \"select count(*) from executions_loop.executions_loop_table;\" | mysql -P3306 -h127.0.0.1 -uroot -p'94J7Xw74tE' " | kubectl exec -it mysql-yseslc-mysql-1 --namespace ns-kcduy -- bash ` check readonly db_client batch data Success test failover dnserror check cluster status before cluster-failover-dnserror check cluster status done cluster_status:Running `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge DNSChaos test-chaos-mesh-dnserror-mysql-yseslc --namespace ns-kcduy ` Warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely. Error from server (NotFound): dnschaos.chaos-mesh.org "test-chaos-mesh-dnserror-mysql-yseslc" not found Error from server (NotFound): dnschaos.chaos-mesh.org "test-chaos-mesh-dnserror-mysql-yseslc" not found apiVersion: chaos-mesh.org/v1alpha1 kind: DNSChaos metadata: name: test-chaos-mesh-dnserror-mysql-yseslc namespace: ns-kcduy spec: selector: namespaces: - ns-kcduy labelSelectors: apps.kubeblocks.io/pod-name: mysql-yseslc-mysql-0 mode: all action: error duration: 2m `kubectl apply -f test-chaos-mesh-dnserror-mysql-yseslc.yaml` dnschaos.chaos-mesh.org/test-chaos-mesh-dnserror-mysql-yseslc created apply test-chaos-mesh-dnserror-mysql-yseslc.yaml Success `rm -rf test-chaos-mesh-dnserror-mysql-yseslc.yaml` dnserror chaos test waiting 120 seconds check cluster status `kbcli cluster list mysql-yseslc --show-labels --namespace ns-kcduy ` NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS mysql-yseslc ns-kcduy mysql DoNotTerminate Running Sep 11,2025 20:24 UTC+0800 app.kubernetes.io/instance=mysql-yseslc,clusterdefinition.kubeblocks.io/name=mysql check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances mysql-yseslc --namespace ns-kcduy ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME mysql-yseslc-mysql-0 ns-kcduy mysql-yseslc mysql Running primary 0 100m / 100m 512Mi / 512Mi data:10Gi aks-cicdamdpool-42425418-vmss000001/10.224.0.5 Sep 11,2025 20:41 UTC+0800 mysql-yseslc-mysql-1 ns-kcduy mysql-yseslc mysql Running secondary 0 100m / 100m 512Mi / 512Mi data:10Gi aks-cicdamdpool-42425418-vmss000002/10.224.0.7 Sep 11,2025 20:40 UTC+0800 mysql-yseslc-proxysql-0 ns-kcduy mysql-yseslc proxysql Running 0 100m / 100m 512Mi / 512Mi aks-cicdamdpool-42425418-vmss000001/10.224.0.5 Sep 11,2025 20:42 UTC+0800 check pod status done check cluster role check cluster role done primary: mysql-yseslc-mysql-0;secondary: mysql-yseslc-mysql-1 `kubectl get secrets -l app.kubernetes.io/instance=mysql-yseslc` set secret: mysql-yseslc-mysql-account-root `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:94J7Xw74tE;DB_PORT:3306;DB_DATABASE:mysql check cluster connect `echo " echo \"SHOW SLAVE STATUS\G;\" | mysql -P3306 -h127.0.0.1 -uroot -p'94J7Xw74tE' " | kubectl exec -it mysql-yseslc-mysql-1 --namespace ns-kcduy -- bash ` check cluster connect done `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge DNSChaos test-chaos-mesh-dnserror-mysql-yseslc --namespace ns-kcduy ` Warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely. dnschaos.chaos-mesh.org "test-chaos-mesh-dnserror-mysql-yseslc" force deleted Error from server (NotFound): dnschaos.chaos-mesh.org "test-chaos-mesh-dnserror-mysql-yseslc" not found check failover pod name failover pod name:mysql-yseslc-mysql-0 failover dnserror Success `kubectl get secrets -l app.kubernetes.io/instance=mysql-yseslc` set secret: mysql-yseslc-mysql-account-root `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:94J7Xw74tE;DB_PORT:3306;DB_DATABASE:mysql check db_client batch data count `echo "echo \"select count(*) from executions_loop.executions_loop_table;\" | mysql -P3306 -hmysql-yseslc-mysql.ns-kcduy.svc.cluster.local -uroot -p'94J7Xw74tE' " | kubectl exec -it mysql-yseslc-mysql-0 --namespace ns-kcduy -- bash ` check db_client batch data Success `kubectl get secrets -l app.kubernetes.io/instance=mysql-yseslc` set secret: mysql-yseslc-mysql-account-root `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:94J7Xw74tE;DB_PORT:3306;DB_DATABASE:mysql check readonly db_client batch data count `echo "echo \"select count(*) from executions_loop.executions_loop_table;\" | mysql -P3306 -h127.0.0.1 -uroot -p'94J7Xw74tE' " | kubectl exec -it mysql-yseslc-mysql-1 --namespace ns-kcduy -- bash ` check readonly db_client batch data Success test failover networkpartition check cluster status before cluster-failover-networkpartition check cluster status done cluster_status:Running `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge NetworkChaos test-chaos-mesh-networkpartition-mysql-yseslc --namespace ns-kcduy ` Warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely. Error from server (NotFound): networkchaos.chaos-mesh.org "test-chaos-mesh-networkpartition-mysql-yseslc" not found Error from server (NotFound): networkchaos.chaos-mesh.org "test-chaos-mesh-networkpartition-mysql-yseslc" not found apiVersion: chaos-mesh.org/v1alpha1 kind: NetworkChaos metadata: name: test-chaos-mesh-networkpartition-mysql-yseslc namespace: ns-kcduy spec: selector: namespaces: - ns-kcduy labelSelectors: apps.kubeblocks.io/pod-name: mysql-yseslc-mysql-0 action: partition mode: all target: mode: all selector: namespaces: - ns-kcduy labelSelectors: apps.kubeblocks.io/pod-name: mysql-yseslc-mysql-1 direction: to duration: 2m `kubectl apply -f test-chaos-mesh-networkpartition-mysql-yseslc.yaml` networkchaos.chaos-mesh.org/test-chaos-mesh-networkpartition-mysql-yseslc created apply test-chaos-mesh-networkpartition-mysql-yseslc.yaml Success `rm -rf test-chaos-mesh-networkpartition-mysql-yseslc.yaml` networkpartition chaos test waiting 120 seconds check cluster status `kbcli cluster list mysql-yseslc --show-labels --namespace ns-kcduy ` NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS mysql-yseslc ns-kcduy mysql DoNotTerminate Running Sep 11,2025 20:24 UTC+0800 app.kubernetes.io/instance=mysql-yseslc,clusterdefinition.kubeblocks.io/name=mysql check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances mysql-yseslc --namespace ns-kcduy ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME mysql-yseslc-mysql-0 ns-kcduy mysql-yseslc mysql Running primary 0 100m / 100m 512Mi / 512Mi data:10Gi aks-cicdamdpool-42425418-vmss000001/10.224.0.5 Sep 11,2025 20:41 UTC+0800 mysql-yseslc-mysql-1 ns-kcduy mysql-yseslc mysql Running secondary 0 100m / 100m 512Mi / 512Mi data:10Gi aks-cicdamdpool-42425418-vmss000002/10.224.0.7 Sep 11,2025 20:40 UTC+0800 mysql-yseslc-proxysql-0 ns-kcduy mysql-yseslc proxysql Running 0 100m / 100m 512Mi / 512Mi aks-cicdamdpool-42425418-vmss000001/10.224.0.5 Sep 11,2025 20:42 UTC+0800 check pod status done check cluster role check cluster role done primary: mysql-yseslc-mysql-0;secondary: mysql-yseslc-mysql-1 `kubectl get secrets -l app.kubernetes.io/instance=mysql-yseslc` set secret: mysql-yseslc-mysql-account-root `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:94J7Xw74tE;DB_PORT:3306;DB_DATABASE:mysql check cluster connect `echo " echo \"SHOW SLAVE STATUS\G;\" | mysql -P3306 -h127.0.0.1 -uroot -p'94J7Xw74tE' " | kubectl exec -it mysql-yseslc-mysql-1 --namespace ns-kcduy -- bash ` check cluster connect done `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge NetworkChaos test-chaos-mesh-networkpartition-mysql-yseslc --namespace ns-kcduy ` Warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely. networkchaos.chaos-mesh.org "test-chaos-mesh-networkpartition-mysql-yseslc" force deleted networkchaos.chaos-mesh.org/test-chaos-mesh-networkpartition-mysql-yseslc patched check failover pod name failover pod name:mysql-yseslc-mysql-0 failover networkpartition Success `kubectl get secrets -l app.kubernetes.io/instance=mysql-yseslc` set secret: mysql-yseslc-mysql-account-root `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:94J7Xw74tE;DB_PORT:3306;DB_DATABASE:mysql check db_client batch data count `echo "echo \"select count(*) from executions_loop.executions_loop_table;\" | mysql -P3306 -hmysql-yseslc-mysql.ns-kcduy.svc.cluster.local -uroot -p'94J7Xw74tE' " | kubectl exec -it mysql-yseslc-mysql-0 --namespace ns-kcduy -- bash ` check db_client batch data Success `kubectl get secrets -l app.kubernetes.io/instance=mysql-yseslc` set secret: mysql-yseslc-mysql-account-root `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:94J7Xw74tE;DB_PORT:3306;DB_DATABASE:mysql check readonly db_client batch data count `echo "echo \"select count(*) from executions_loop.executions_loop_table;\" | mysql -P3306 -h127.0.0.1 -uroot -p'94J7Xw74tE' " | kubectl exec -it mysql-yseslc-mysql-1 --namespace ns-kcduy -- bash ` check readonly db_client batch data Success test failover dnsrandom check cluster status before cluster-failover-dnsrandom check cluster status done cluster_status:Running `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge DNSChaos test-chaos-mesh-dnsrandom-mysql-yseslc --namespace ns-kcduy ` Warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely. Error from server (NotFound): dnschaos.chaos-mesh.org "test-chaos-mesh-dnsrandom-mysql-yseslc" not found Error from server (NotFound): dnschaos.chaos-mesh.org "test-chaos-mesh-dnsrandom-mysql-yseslc" not found apiVersion: chaos-mesh.org/v1alpha1 kind: DNSChaos metadata: name: test-chaos-mesh-dnsrandom-mysql-yseslc namespace: ns-kcduy spec: selector: namespaces: - ns-kcduy labelSelectors: apps.kubeblocks.io/pod-name: mysql-yseslc-mysql-0 mode: all action: random duration: 2m `kubectl apply -f test-chaos-mesh-dnsrandom-mysql-yseslc.yaml` dnschaos.chaos-mesh.org/test-chaos-mesh-dnsrandom-mysql-yseslc created apply test-chaos-mesh-dnsrandom-mysql-yseslc.yaml Success `rm -rf test-chaos-mesh-dnsrandom-mysql-yseslc.yaml` dnsrandom chaos test waiting 120 seconds check cluster status `kbcli cluster list mysql-yseslc --show-labels --namespace ns-kcduy ` NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS mysql-yseslc ns-kcduy mysql DoNotTerminate Running Sep 11,2025 20:24 UTC+0800 app.kubernetes.io/instance=mysql-yseslc,clusterdefinition.kubeblocks.io/name=mysql check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances mysql-yseslc --namespace ns-kcduy ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME mysql-yseslc-mysql-0 ns-kcduy mysql-yseslc mysql Running primary 0 100m / 100m 512Mi / 512Mi data:10Gi aks-cicdamdpool-42425418-vmss000001/10.224.0.5 Sep 11,2025 20:41 UTC+0800 mysql-yseslc-mysql-1 ns-kcduy mysql-yseslc mysql Running secondary 0 100m / 100m 512Mi / 512Mi data:10Gi aks-cicdamdpool-42425418-vmss000002/10.224.0.7 Sep 11,2025 20:40 UTC+0800 mysql-yseslc-proxysql-0 ns-kcduy mysql-yseslc proxysql Running 0 100m / 100m 512Mi / 512Mi aks-cicdamdpool-42425418-vmss000001/10.224.0.5 Sep 11,2025 20:42 UTC+0800 check pod status done check cluster role check cluster role done primary: mysql-yseslc-mysql-0;secondary: mysql-yseslc-mysql-1 `kubectl get secrets -l app.kubernetes.io/instance=mysql-yseslc` set secret: mysql-yseslc-mysql-account-root `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:94J7Xw74tE;DB_PORT:3306;DB_DATABASE:mysql check cluster connect `echo " echo \"SHOW SLAVE STATUS\G;\" | mysql -P3306 -h127.0.0.1 -uroot -p'94J7Xw74tE' " | kubectl exec -it mysql-yseslc-mysql-1 --namespace ns-kcduy -- bash ` check cluster connect done `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge DNSChaos test-chaos-mesh-dnsrandom-mysql-yseslc --namespace ns-kcduy ` Warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely. dnschaos.chaos-mesh.org "test-chaos-mesh-dnsrandom-mysql-yseslc" force deleted Error from server (NotFound): dnschaos.chaos-mesh.org "test-chaos-mesh-dnsrandom-mysql-yseslc" not found check failover pod name failover pod name:mysql-yseslc-mysql-0 failover dnsrandom Success `kubectl get secrets -l app.kubernetes.io/instance=mysql-yseslc` set secret: mysql-yseslc-mysql-account-root `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:94J7Xw74tE;DB_PORT:3306;DB_DATABASE:mysql check db_client batch data count `echo "echo \"select count(*) from executions_loop.executions_loop_table;\" | mysql -P3306 -hmysql-yseslc-mysql.ns-kcduy.svc.cluster.local -uroot -p'94J7Xw74tE' " | kubectl exec -it mysql-yseslc-mysql-0 --namespace ns-kcduy -- bash ` check db_client batch data Success `kubectl get secrets -l app.kubernetes.io/instance=mysql-yseslc` set secret: mysql-yseslc-mysql-account-root `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:94J7Xw74tE;DB_PORT:3306;DB_DATABASE:mysql check readonly db_client batch data count `echo "echo \"select count(*) from executions_loop.executions_loop_table;\" | mysql -P3306 -h127.0.0.1 -uroot -p'94J7Xw74tE' " | kubectl exec -it mysql-yseslc-mysql-1 --namespace ns-kcduy -- bash ` check readonly db_client batch data Success check cluster status before ops check cluster status done cluster_status:Running `kbcli cluster vscale mysql-yseslc --auto-approve --force=true --components mysql --cpu 200m --memory 0.6Gi --namespace ns-kcduy ` OpsRequest mysql-yseslc-verticalscaling-vdfw8 created successfully, you can view the progress: kbcli cluster describe-ops mysql-yseslc-verticalscaling-vdfw8 -n ns-kcduy check ops status `kbcli cluster list-ops mysql-yseslc --status all --namespace ns-kcduy ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME mysql-yseslc-switchover-4bfkr ns-kcduy Switchover mysql-yseslc mysql Succeed 1/1 Sep 11,2025 20:34 UTC+0800 mysql-yseslc-verticalscaling-vdfw8 ns-kcduy VerticalScaling mysql-yseslc mysql Creating -/- Sep 11,2025 20:53 UTC+0800 check cluster status `kbcli cluster list mysql-yseslc --show-labels --namespace ns-kcduy ` NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS mysql-yseslc ns-kcduy mysql DoNotTerminate Updating Sep 11,2025 20:24 UTC+0800 app.kubernetes.io/instance=mysql-yseslc,clusterdefinition.kubeblocks.io/name=mysql cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances mysql-yseslc --namespace ns-kcduy ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME mysql-yseslc-mysql-0 ns-kcduy mysql-yseslc mysql Running secondary 0 200m / 200m 644245094400m / 644245094400m data:10Gi aks-cicdamdpool-42425418-vmss000001/10.224.0.5 Sep 11,2025 20:59 UTC+0800 mysql-yseslc-mysql-1 ns-kcduy mysql-yseslc mysql Running primary 0 200m / 200m 644245094400m / 644245094400m data:10Gi aks-cicdamdpool-42425418-vmss000000/10.224.0.9 Sep 11,2025 20:53 UTC+0800 mysql-yseslc-proxysql-0 ns-kcduy mysql-yseslc proxysql Running 0 100m / 100m 512Mi / 512Mi aks-cicdamdpool-42425418-vmss000001/10.224.0.5 Sep 11,2025 20:42 UTC+0800 check pod status done check cluster role check cluster role done primary: mysql-yseslc-mysql-1;secondary: mysql-yseslc-mysql-0 `kubectl get secrets -l app.kubernetes.io/instance=mysql-yseslc` set secret: mysql-yseslc-mysql-account-root `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:94J7Xw74tE;DB_PORT:3306;DB_DATABASE:mysql check cluster connect `echo " echo \"SHOW SLAVE STATUS\G;\" | mysql -P3306 -h127.0.0.1 -uroot -p'94J7Xw74tE' " | kubectl exec -it mysql-yseslc-mysql-0 --namespace ns-kcduy -- bash ` check cluster connect done check ops status `kbcli cluster list-ops mysql-yseslc --status all --namespace ns-kcduy ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME mysql-yseslc-switchover-4bfkr ns-kcduy Switchover mysql-yseslc mysql Succeed 1/1 Sep 11,2025 20:34 UTC+0800 mysql-yseslc-verticalscaling-vdfw8 ns-kcduy VerticalScaling mysql-yseslc mysql Succeed 2/2 Sep 11,2025 20:53 UTC+0800 check ops status done ops_status:mysql-yseslc-verticalscaling-vdfw8 ns-kcduy VerticalScaling mysql-yseslc mysql Succeed 2/2 Sep 11,2025 20:53 UTC+0800 `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge opsrequests.operations mysql-yseslc-verticalscaling-vdfw8 --namespace ns-kcduy ` opsrequest.operations.kubeblocks.io/mysql-yseslc-verticalscaling-vdfw8 patched `kbcli cluster delete-ops --name mysql-yseslc-verticalscaling-vdfw8 --force --auto-approve --namespace ns-kcduy ` OpsRequest mysql-yseslc-verticalscaling-vdfw8 deleted `kubectl get secrets -l app.kubernetes.io/instance=mysql-yseslc` set secret: mysql-yseslc-mysql-account-root `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:94J7Xw74tE;DB_PORT:3306;DB_DATABASE:mysql check db_client batch data count `echo "echo \"select count(*) from executions_loop.executions_loop_table;\" | mysql -P3306 -hmysql-yseslc-mysql.ns-kcduy.svc.cluster.local -uroot -p'94J7Xw74tE' " | kubectl exec -it mysql-yseslc-mysql-1 --namespace ns-kcduy -- bash ` check db_client batch data Success `kubectl get secrets -l app.kubernetes.io/instance=mysql-yseslc` set secret: mysql-yseslc-mysql-account-root `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:94J7Xw74tE;DB_PORT:3306;DB_DATABASE:mysql check readonly db_client batch data count `echo "echo \"select count(*) from executions_loop.executions_loop_table;\" | mysql -P3306 -h127.0.0.1 -uroot -p'94J7Xw74tE' " | kubectl exec -it mysql-yseslc-mysql-0 --namespace ns-kcduy -- bash ` check readonly db_client batch data Success cmpv upgrade service version:2,5.7.44|2,8.0.30|2,8.0.31|2,8.0.32|2,8.0.33|2,8.0.34|2,8.0.35|2,8.0.36|2,8.0.37|2,8.0.38|2,8.0.39|2,8.4.0|2,8.4.1|2,8.4.2 set latest cmpv service version latest service version:8.0.39 cmpv service version upgrade and downgrade 8.0.30 is less than 8.0.31 upgrade from:8.0.30 to service version:8.0.31 cluster upgrade apiVersion: operations.kubeblocks.io/v1alpha1 kind: OpsRequest metadata: generateName: mysql-yseslc-upgrade-cmpv- namespace: ns-kcduy spec: clusterName: mysql-yseslc upgrade: components: - componentName: mysql serviceVersion: 8.0.31 type: Upgrade check cluster status before ops check cluster status done cluster_status:Running `kubectl create -f test_ops_cluster_mysql-yseslc.yaml` opsrequest.operations.kubeblocks.io/mysql-yseslc-upgrade-cmpv-cblk9 created create test_ops_cluster_mysql-yseslc.yaml Success `rm -rf test_ops_cluster_mysql-yseslc.yaml` check ops status `kbcli cluster list-ops mysql-yseslc --status all --namespace ns-kcduy ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME mysql-yseslc-switchover-4bfkr ns-kcduy Switchover mysql-yseslc mysql Succeed 1/1 Sep 11,2025 20:34 UTC+0800 mysql-yseslc-upgrade-cmpv-cblk9 ns-kcduy Upgrade mysql-yseslc Running -/- Sep 11,2025 20:59 UTC+0800 check cluster status `kbcli cluster list mysql-yseslc --show-labels --namespace ns-kcduy ` NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS mysql-yseslc ns-kcduy mysql DoNotTerminate Updating Sep 11,2025 20:24 UTC+0800 app.kubernetes.io/instance=mysql-yseslc,clusterdefinition.kubeblocks.io/name=mysql cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances mysql-yseslc --namespace ns-kcduy ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME mysql-yseslc-mysql-0 ns-kcduy mysql-yseslc mysql Running secondary 0 200m / 200m 644245094400m / 644245094400m data:10Gi aks-cicdamdpool-42425418-vmss000001/10.224.0.5 Sep 11,2025 20:59 UTC+0800 mysql-yseslc-mysql-1 ns-kcduy mysql-yseslc mysql Running secondary 0 200m / 200m 644245094400m / 644245094400m data:10Gi aks-cicdamdpool-42425418-vmss000000/10.224.0.9 Sep 11,2025 20:53 UTC+0800 mysql-yseslc-proxysql-0 ns-kcduy mysql-yseslc proxysql Running 0 100m / 100m 512Mi / 512Mi aks-cicdamdpool-42425418-vmss000001/10.224.0.5 Sep 11,2025 20:42 UTC+0800 check pod status done check cluster role No resources found in ns-kcduy namespace. primary: ;secondary: mysql-yseslc-mysql-0 mysql-yseslc-mysql-1 No resources found in ns-kcduy namespace. primary: ;secondary: mysql-yseslc-mysql-0 mysql-yseslc-mysql-1 No resources found in ns-kcduy namespace. primary: ;secondary: mysql-yseslc-mysql-0 mysql-yseslc-mysql-1 No resources found in ns-kcduy namespace. primary: ;secondary: mysql-yseslc-mysql-0 mysql-yseslc-mysql-1 No resources found in ns-kcduy namespace. primary: ;secondary: mysql-yseslc-mysql-0 mysql-yseslc-mysql-1 No resources found in ns-kcduy namespace. primary: ;secondary: mysql-yseslc-mysql-0 mysql-yseslc-mysql-1 No resources found in ns-kcduy namespace. primary: ;secondary: mysql-yseslc-mysql-0 mysql-yseslc-mysql-1 No resources found in ns-kcduy namespace. primary: ;secondary: mysql-yseslc-mysql-0 mysql-yseslc-mysql-1 No resources found in ns-kcduy namespace. primary: ;secondary: mysql-yseslc-mysql-1 check cluster role done primary: mysql-yseslc-mysql-0;secondary: mysql-yseslc-mysql-1 `kubectl get secrets -l app.kubernetes.io/instance=mysql-yseslc` set secret: mysql-yseslc-mysql-account-root `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:94J7Xw74tE;DB_PORT:3306;DB_DATABASE:mysql check cluster connect `echo " echo \"SHOW SLAVE STATUS\G;\" | mysql -P3306 -h127.0.0.1 -uroot -p'94J7Xw74tE' " | kubectl exec -it mysql-yseslc-mysql-1 --namespace ns-kcduy -- bash ` connect checking... connect checking... connect checking... check cluster connect done check ops status `kbcli cluster list-ops mysql-yseslc --status all --namespace ns-kcduy ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME mysql-yseslc-switchover-4bfkr ns-kcduy Switchover mysql-yseslc mysql Succeed 1/1 Sep 11,2025 20:34 UTC+0800 mysql-yseslc-upgrade-cmpv-cblk9 ns-kcduy Upgrade mysql-yseslc mysql Succeed 2/2 Sep 11,2025 20:59 UTC+0800 check ops status done ops_status:mysql-yseslc-upgrade-cmpv-cblk9 ns-kcduy Upgrade mysql-yseslc mysql Succeed 2/2 Sep 11,2025 20:59 UTC+0800 `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge opsrequests.operations mysql-yseslc-upgrade-cmpv-cblk9 --namespace ns-kcduy ` opsrequest.operations.kubeblocks.io/mysql-yseslc-upgrade-cmpv-cblk9 patched `kbcli cluster delete-ops --name mysql-yseslc-upgrade-cmpv-cblk9 --force --auto-approve --namespace ns-kcduy ` OpsRequest mysql-yseslc-upgrade-cmpv-cblk9 deleted `kubectl get secrets -l app.kubernetes.io/instance=mysql-yseslc` set secret: mysql-yseslc-mysql-account-root `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:94J7Xw74tE;DB_PORT:3306;DB_DATABASE:mysql check db_client batch data count `echo "echo \"select count(*) from executions_loop.executions_loop_table;\" | mysql -P3306 -hmysql-yseslc-mysql.ns-kcduy.svc.cluster.local -uroot -p'94J7Xw74tE' " | kubectl exec -it mysql-yseslc-mysql-0 --namespace ns-kcduy -- bash ` check db_client batch data Success `kubectl get secrets -l app.kubernetes.io/instance=mysql-yseslc` set secret: mysql-yseslc-mysql-account-root `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:94J7Xw74tE;DB_PORT:3306;DB_DATABASE:mysql check readonly db_client batch data count `echo "echo \"select count(*) from executions_loop.executions_loop_table;\" | mysql -P3306 -h127.0.0.1 -uroot -p'94J7Xw74tE' " | kubectl exec -it mysql-yseslc-mysql-1 --namespace ns-kcduy -- bash ` check readonly db_client batch data Success 8.0.31 is less than 8.0.32 upgrade from:8.0.31 to service version:8.0.32 cluster upgrade apiVersion: operations.kubeblocks.io/v1alpha1 kind: OpsRequest metadata: generateName: mysql-yseslc-upgrade-cmpv- namespace: ns-kcduy spec: clusterName: mysql-yseslc upgrade: components: - componentName: mysql serviceVersion: 8.0.32 type: Upgrade check cluster status before ops check cluster status done cluster_status:Running `kubectl create -f test_ops_cluster_mysql-yseslc.yaml` opsrequest.operations.kubeblocks.io/mysql-yseslc-upgrade-cmpv-8gfk8 created create test_ops_cluster_mysql-yseslc.yaml Success `rm -rf test_ops_cluster_mysql-yseslc.yaml` check ops status `kbcli cluster list-ops mysql-yseslc --status all --namespace ns-kcduy ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME mysql-yseslc-switchover-4bfkr ns-kcduy Switchover mysql-yseslc mysql Succeed 1/1 Sep 11,2025 20:34 UTC+0800 mysql-yseslc-upgrade-cmpv-8gfk8 ns-kcduy Upgrade mysql-yseslc Creating -/- Sep 11,2025 21:00 UTC+0800 check cluster status `kbcli cluster list mysql-yseslc --show-labels --namespace ns-kcduy ` NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS mysql-yseslc ns-kcduy mysql DoNotTerminate Updating Sep 11,2025 20:24 UTC+0800 app.kubernetes.io/instance=mysql-yseslc,clusterdefinition.kubeblocks.io/name=mysql cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances mysql-yseslc --namespace ns-kcduy ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME mysql-yseslc-mysql-0 ns-kcduy mysql-yseslc mysql Running secondary 0 200m / 200m 644245094400m / 644245094400m data:10Gi aks-cicdamdpool-42425418-vmss000001/10.224.0.5 Sep 11,2025 20:59 UTC+0800 mysql-yseslc-mysql-1 ns-kcduy mysql-yseslc mysql Running secondary 0 200m / 200m 644245094400m / 644245094400m data:10Gi aks-cicdamdpool-42425418-vmss000000/10.224.0.9 Sep 11,2025 20:53 UTC+0800 mysql-yseslc-proxysql-0 ns-kcduy mysql-yseslc proxysql Running 0 100m / 100m 512Mi / 512Mi aks-cicdamdpool-42425418-vmss000001/10.224.0.5 Sep 11,2025 20:42 UTC+0800 check pod status done check cluster role No resources found in ns-kcduy namespace. primary: ;secondary: mysql-yseslc-mysql-0 mysql-yseslc-mysql-1 No resources found in ns-kcduy namespace. primary: ;secondary: mysql-yseslc-mysql-0 mysql-yseslc-mysql-1 No resources found in ns-kcduy namespace. primary: ;secondary: mysql-yseslc-mysql-0 mysql-yseslc-mysql-1 No resources found in ns-kcduy namespace. primary: ;secondary: mysql-yseslc-mysql-0 mysql-yseslc-mysql-1 No resources found in ns-kcduy namespace. primary: ;secondary: mysql-yseslc-mysql-0 mysql-yseslc-mysql-1 No resources found in ns-kcduy namespace. primary: ;secondary: mysql-yseslc-mysql-0 mysql-yseslc-mysql-1 No resources found in ns-kcduy namespace. primary: ;secondary: mysql-yseslc-mysql-0 mysql-yseslc-mysql-1 No resources found in ns-kcduy namespace. primary: ;secondary: mysql-yseslc-mysql-0 mysql-yseslc-mysql-1 No resources found in ns-kcduy namespace. primary: ;secondary: mysql-yseslc-mysql-0 mysql-yseslc-mysql-1 No resources found in ns-kcduy namespace. primary: ;secondary: mysql-yseslc-mysql-0 mysql-yseslc-mysql-1 No resources found in ns-kcduy namespace. primary: ;secondary: mysql-yseslc-mysql-0 mysql-yseslc-mysql-1 No resources found in ns-kcduy namespace. primary: ;secondary: mysql-yseslc-mysql-0 mysql-yseslc-mysql-1 No resources found in ns-kcduy namespace. primary: ;secondary: mysql-yseslc-mysql-0 mysql-yseslc-mysql-1 No resources found in ns-kcduy namespace. primary: ;secondary: mysql-yseslc-mysql-0 mysql-yseslc-mysql-1 No resources found in ns-kcduy namespace. primary: ;secondary: mysql-yseslc-mysql-0 mysql-yseslc-mysql-1 No resources found in ns-kcduy namespace. primary: ;secondary: mysql-yseslc-mysql-0 mysql-yseslc-mysql-1 No resources found in ns-kcduy namespace. primary: ;secondary: mysql-yseslc-mysql-0 mysql-yseslc-mysql-1 No resources found in ns-kcduy namespace. primary: ;secondary: mysql-yseslc-mysql-0 mysql-yseslc-mysql-1 No resources found in ns-kcduy namespace. primary: ;secondary: mysql-yseslc-mysql-0 mysql-yseslc-mysql-1 No resources found in ns-kcduy namespace. primary: ;secondary: mysql-yseslc-mysql-0 mysql-yseslc-mysql-1 No resources found in ns-kcduy namespace. primary: ;secondary: mysql-yseslc-mysql-0 mysql-yseslc-mysql-1 No resources found in ns-kcduy namespace. primary: ;secondary: mysql-yseslc-mysql-0 mysql-yseslc-mysql-1 No resources found in ns-kcduy namespace. primary: ;secondary: mysql-yseslc-mysql-0 mysql-yseslc-mysql-1 No resources found in ns-kcduy namespace. primary: ;secondary: mysql-yseslc-mysql-0 mysql-yseslc-mysql-1 No resources found in ns-kcduy namespace. primary: ;secondary: mysql-yseslc-mysql-0 mysql-yseslc-mysql-1 No resources found in ns-kcduy namespace. primary: ;secondary: mysql-yseslc-mysql-0 mysql-yseslc-mysql-1 No resources found in ns-kcduy namespace. primary: ;secondary: mysql-yseslc-mysql-0 mysql-yseslc-mysql-1 check cluster role done primary: mysql-yseslc-mysql-0;secondary: mysql-yseslc-mysql-1 `kubectl get secrets -l app.kubernetes.io/instance=mysql-yseslc` set secret: mysql-yseslc-mysql-account-root `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:94J7Xw74tE;DB_PORT:3306;DB_DATABASE:mysql check cluster connect `echo " echo \"SHOW SLAVE STATUS\G;\" | mysql -P3306 -h127.0.0.1 -uroot -p'94J7Xw74tE' " | kubectl exec -it mysql-yseslc-mysql-1 --namespace ns-kcduy -- bash ` check cluster connect done check ops status `kbcli cluster list-ops mysql-yseslc --status all --namespace ns-kcduy ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME mysql-yseslc-switchover-4bfkr ns-kcduy Switchover mysql-yseslc mysql Succeed 1/1 Sep 11,2025 20:34 UTC+0800 mysql-yseslc-upgrade-cmpv-8gfk8 ns-kcduy Upgrade mysql-yseslc mysql Succeed 2/2 Sep 11,2025 21:00 UTC+0800 check ops status done ops_status:mysql-yseslc-upgrade-cmpv-8gfk8 ns-kcduy Upgrade mysql-yseslc mysql Succeed 2/2 Sep 11,2025 21:00 UTC+0800 `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge opsrequests.operations mysql-yseslc-upgrade-cmpv-8gfk8 --namespace ns-kcduy ` opsrequest.operations.kubeblocks.io/mysql-yseslc-upgrade-cmpv-8gfk8 patched `kbcli cluster delete-ops --name mysql-yseslc-upgrade-cmpv-8gfk8 --force --auto-approve --namespace ns-kcduy ` OpsRequest mysql-yseslc-upgrade-cmpv-8gfk8 deleted `kubectl get secrets -l app.kubernetes.io/instance=mysql-yseslc` set secret: mysql-yseslc-mysql-account-root `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:94J7Xw74tE;DB_PORT:3306;DB_DATABASE:mysql check db_client batch data count `echo "echo \"select count(*) from executions_loop.executions_loop_table;\" | mysql -P3306 -hmysql-yseslc-mysql.ns-kcduy.svc.cluster.local -uroot -p'94J7Xw74tE' " | kubectl exec -it mysql-yseslc-mysql-0 --namespace ns-kcduy -- bash ` check db_client batch data Success `kubectl get secrets -l app.kubernetes.io/instance=mysql-yseslc` set secret: mysql-yseslc-mysql-account-root `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:94J7Xw74tE;DB_PORT:3306;DB_DATABASE:mysql check readonly db_client batch data count `echo "echo \"select count(*) from executions_loop.executions_loop_table;\" | mysql -P3306 -h127.0.0.1 -uroot -p'94J7Xw74tE' " | kubectl exec -it mysql-yseslc-mysql-1 --namespace ns-kcduy -- bash ` check readonly db_client batch data Success 8.0.32 is less than 8.0.33 upgrade from:8.0.32 to service version:8.0.33 cluster upgrade apiVersion: operations.kubeblocks.io/v1alpha1 kind: OpsRequest metadata: generateName: mysql-yseslc-upgrade-cmpv- namespace: ns-kcduy spec: clusterName: mysql-yseslc upgrade: components: - componentName: mysql serviceVersion: 8.0.33 type: Upgrade check cluster status before ops check cluster status done cluster_status:Running `kubectl create -f test_ops_cluster_mysql-yseslc.yaml` opsrequest.operations.kubeblocks.io/mysql-yseslc-upgrade-cmpv-hp8zb created create test_ops_cluster_mysql-yseslc.yaml Success `rm -rf test_ops_cluster_mysql-yseslc.yaml` check ops status `kbcli cluster list-ops mysql-yseslc --status all --namespace ns-kcduy ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME mysql-yseslc-switchover-4bfkr ns-kcduy Switchover mysql-yseslc mysql Succeed 1/1 Sep 11,2025 20:34 UTC+0800 mysql-yseslc-upgrade-cmpv-hp8zb ns-kcduy Upgrade mysql-yseslc Running -/- Sep 11,2025 21:02 UTC+0800 check cluster status `kbcli cluster list mysql-yseslc --show-labels --namespace ns-kcduy ` NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS mysql-yseslc ns-kcduy mysql DoNotTerminate Updating Sep 11,2025 20:24 UTC+0800 app.kubernetes.io/instance=mysql-yseslc,clusterdefinition.kubeblocks.io/name=mysql cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances mysql-yseslc --namespace ns-kcduy ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME mysql-yseslc-mysql-0 ns-kcduy mysql-yseslc mysql Running secondary 0 200m / 200m 644245094400m / 644245094400m data:10Gi aks-cicdamdpool-42425418-vmss000001/10.224.0.5 Sep 11,2025 20:59 UTC+0800 mysql-yseslc-mysql-1 ns-kcduy mysql-yseslc mysql Running secondary 0 200m / 200m 644245094400m / 644245094400m data:10Gi aks-cicdamdpool-42425418-vmss000000/10.224.0.9 Sep 11,2025 20:53 UTC+0800 mysql-yseslc-proxysql-0 ns-kcduy mysql-yseslc proxysql Running 0 100m / 100m 512Mi / 512Mi aks-cicdamdpool-42425418-vmss000001/10.224.0.5 Sep 11,2025 20:42 UTC+0800 check pod status done check cluster role No resources found in ns-kcduy namespace. primary: ;secondary: mysql-yseslc-mysql-0 mysql-yseslc-mysql-1 No resources found in ns-kcduy namespace. primary: ;secondary: mysql-yseslc-mysql-0 mysql-yseslc-mysql-1 No resources found in ns-kcduy namespace. primary: ;secondary: mysql-yseslc-mysql-0 mysql-yseslc-mysql-1 No resources found in ns-kcduy namespace. primary: ;secondary: mysql-yseslc-mysql-0 mysql-yseslc-mysql-1 No resources found in ns-kcduy namespace. primary: ;secondary: mysql-yseslc-mysql-0 mysql-yseslc-mysql-1 No resources found in ns-kcduy namespace. primary: ;secondary: mysql-yseslc-mysql-0 mysql-yseslc-mysql-1 No resources found in ns-kcduy namespace. primary: ;secondary: mysql-yseslc-mysql-0 mysql-yseslc-mysql-1 No resources found in ns-kcduy namespace. primary: ;secondary: mysql-yseslc-mysql-0 mysql-yseslc-mysql-1 No resources found in ns-kcduy namespace. primary: ;secondary: mysql-yseslc-mysql-0 mysql-yseslc-mysql-1 No resources found in ns-kcduy namespace. primary: ;secondary: mysql-yseslc-mysql-0 mysql-yseslc-mysql-1 No resources found in ns-kcduy namespace. primary: ;secondary: mysql-yseslc-mysql-0 mysql-yseslc-mysql-1 No resources found in ns-kcduy namespace. primary: ;secondary: mysql-yseslc-mysql-0 mysql-yseslc-mysql-1 No resources found in ns-kcduy namespace. primary: ;secondary: mysql-yseslc-mysql-0 mysql-yseslc-mysql-1 No resources found in ns-kcduy namespace. primary: ;secondary: mysql-yseslc-mysql-0 mysql-yseslc-mysql-1 No resources found in ns-kcduy namespace. primary: ;secondary: mysql-yseslc-mysql-0 mysql-yseslc-mysql-1 No resources found in ns-kcduy namespace. primary: ;secondary: mysql-yseslc-mysql-0 mysql-yseslc-mysql-1 No resources found in ns-kcduy namespace. primary: ;secondary: mysql-yseslc-mysql-0 mysql-yseslc-mysql-1 No resources found in ns-kcduy namespace. primary: ;secondary: mysql-yseslc-mysql-0 mysql-yseslc-mysql-1 No resources found in ns-kcduy namespace. primary: ;secondary: mysql-yseslc-mysql-0 mysql-yseslc-mysql-1 No resources found in ns-kcduy namespace. primary: ;secondary: mysql-yseslc-mysql-0 mysql-yseslc-mysql-1 No resources found in ns-kcduy namespace. primary: ;secondary: mysql-yseslc-mysql-0 mysql-yseslc-mysql-1 No resources found in ns-kcduy namespace. primary: ;secondary: mysql-yseslc-mysql-0 mysql-yseslc-mysql-1 No resources found in ns-kcduy namespace. primary: ;secondary: mysql-yseslc-mysql-0 mysql-yseslc-mysql-1 No resources found in ns-kcduy namespace. primary: ;secondary: mysql-yseslc-mysql-0 mysql-yseslc-mysql-1 No resources found in ns-kcduy namespace. primary: ;secondary: mysql-yseslc-mysql-0 mysql-yseslc-mysql-1 check cluster role done primary: mysql-yseslc-mysql-0;secondary: mysql-yseslc-mysql-1 `kubectl get secrets -l app.kubernetes.io/instance=mysql-yseslc` set secret: mysql-yseslc-mysql-account-root `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:94J7Xw74tE;DB_PORT:3306;DB_DATABASE:mysql check cluster connect `echo " echo \"SHOW SLAVE STATUS\G;\" | mysql -P3306 -h127.0.0.1 -uroot -p'94J7Xw74tE' " | kubectl exec -it mysql-yseslc-mysql-1 --namespace ns-kcduy -- bash ` check cluster connect done check ops status `kbcli cluster list-ops mysql-yseslc --status all --namespace ns-kcduy ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME mysql-yseslc-switchover-4bfkr ns-kcduy Switchover mysql-yseslc mysql Succeed 1/1 Sep 11,2025 20:34 UTC+0800 mysql-yseslc-upgrade-cmpv-hp8zb ns-kcduy Upgrade mysql-yseslc mysql Succeed 2/2 Sep 11,2025 21:02 UTC+0800 check ops status done ops_status:mysql-yseslc-upgrade-cmpv-hp8zb ns-kcduy Upgrade mysql-yseslc mysql Succeed 2/2 Sep 11,2025 21:02 UTC+0800 `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge opsrequests.operations mysql-yseslc-upgrade-cmpv-hp8zb --namespace ns-kcduy ` opsrequest.operations.kubeblocks.io/mysql-yseslc-upgrade-cmpv-hp8zb patched `kbcli cluster delete-ops --name mysql-yseslc-upgrade-cmpv-hp8zb --force --auto-approve --namespace ns-kcduy ` OpsRequest mysql-yseslc-upgrade-cmpv-hp8zb deleted `kubectl get secrets -l app.kubernetes.io/instance=mysql-yseslc` set secret: mysql-yseslc-mysql-account-root `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:94J7Xw74tE;DB_PORT:3306;DB_DATABASE:mysql check db_client batch data count `echo "echo \"select count(*) from executions_loop.executions_loop_table;\" | mysql -P3306 -hmysql-yseslc-mysql.ns-kcduy.svc.cluster.local -uroot -p'94J7Xw74tE' " | kubectl exec -it mysql-yseslc-mysql-0 --namespace ns-kcduy -- bash ` check db_client batch data Success `kubectl get secrets -l app.kubernetes.io/instance=mysql-yseslc` set secret: mysql-yseslc-mysql-account-root `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:94J7Xw74tE;DB_PORT:3306;DB_DATABASE:mysql check readonly db_client batch data count `echo "echo \"select count(*) from executions_loop.executions_loop_table;\" | mysql -P3306 -h127.0.0.1 -uroot -p'94J7Xw74tE' " | kubectl exec -it mysql-yseslc-mysql-1 --namespace ns-kcduy -- bash ` check readonly db_client batch data Success 8.0.33 is less than 8.0.34 upgrade from:8.0.33 to service version:8.0.34 cluster upgrade apiVersion: operations.kubeblocks.io/v1alpha1 kind: OpsRequest metadata: generateName: mysql-yseslc-upgrade-cmpv- namespace: ns-kcduy spec: clusterName: mysql-yseslc upgrade: components: - componentName: mysql serviceVersion: 8.0.34 type: Upgrade check cluster status before ops check cluster status done cluster_status:Running `kubectl create -f test_ops_cluster_mysql-yseslc.yaml` opsrequest.operations.kubeblocks.io/mysql-yseslc-upgrade-cmpv-7kzml created create test_ops_cluster_mysql-yseslc.yaml Success `rm -rf test_ops_cluster_mysql-yseslc.yaml` check ops status `kbcli cluster list-ops mysql-yseslc --status all --namespace ns-kcduy ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME mysql-yseslc-switchover-4bfkr ns-kcduy Switchover mysql-yseslc mysql Succeed 1/1 Sep 11,2025 20:34 UTC+0800 mysql-yseslc-upgrade-cmpv-7kzml ns-kcduy Upgrade mysql-yseslc Creating -/- Sep 11,2025 21:03 UTC+0800 check cluster status `kbcli cluster list mysql-yseslc --show-labels --namespace ns-kcduy ` NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS mysql-yseslc ns-kcduy mysql DoNotTerminate Updating Sep 11,2025 20:24 UTC+0800 app.kubernetes.io/instance=mysql-yseslc,clusterdefinition.kubeblocks.io/name=mysql cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances mysql-yseslc --namespace ns-kcduy ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME mysql-yseslc-mysql-0 ns-kcduy mysql-yseslc mysql Running secondary 0 200m / 200m 644245094400m / 644245094400m data:10Gi aks-cicdamdpool-42425418-vmss000001/10.224.0.5 Sep 11,2025 20:59 UTC+0800 mysql-yseslc-mysql-1 ns-kcduy mysql-yseslc mysql Running secondary 0 200m / 200m 644245094400m / 644245094400m data:10Gi aks-cicdamdpool-42425418-vmss000000/10.224.0.9 Sep 11,2025 20:53 UTC+0800 mysql-yseslc-proxysql-0 ns-kcduy mysql-yseslc proxysql Running 0 100m / 100m 512Mi / 512Mi aks-cicdamdpool-42425418-vmss000001/10.224.0.5 Sep 11,2025 20:42 UTC+0800 check pod status done check cluster role No resources found in ns-kcduy namespace. primary: ;secondary: mysql-yseslc-mysql-0 mysql-yseslc-mysql-1 No resources found in ns-kcduy namespace. primary: ;secondary: mysql-yseslc-mysql-0 mysql-yseslc-mysql-1 No resources found in ns-kcduy namespace. primary: ;secondary: mysql-yseslc-mysql-0 mysql-yseslc-mysql-1 No resources found in ns-kcduy namespace. primary: ;secondary: mysql-yseslc-mysql-0 mysql-yseslc-mysql-1 No resources found in ns-kcduy namespace. primary: ;secondary: mysql-yseslc-mysql-0 mysql-yseslc-mysql-1 No resources found in ns-kcduy namespace. primary: ;secondary: mysql-yseslc-mysql-0 mysql-yseslc-mysql-1 No resources found in ns-kcduy namespace. primary: ;secondary: mysql-yseslc-mysql-0 mysql-yseslc-mysql-1 No resources found in ns-kcduy namespace. primary: ;secondary: mysql-yseslc-mysql-0 mysql-yseslc-mysql-1 No resources found in ns-kcduy namespace. primary: ;secondary: mysql-yseslc-mysql-0 mysql-yseslc-mysql-1 No resources found in ns-kcduy namespace. primary: ;secondary: mysql-yseslc-mysql-0 mysql-yseslc-mysql-1 No resources found in ns-kcduy namespace. primary: ;secondary: mysql-yseslc-mysql-0 mysql-yseslc-mysql-1 No resources found in ns-kcduy namespace. primary: ;secondary: mysql-yseslc-mysql-0 mysql-yseslc-mysql-1 No resources found in ns-kcduy namespace. primary: ;secondary: mysql-yseslc-mysql-0 mysql-yseslc-mysql-1 No resources found in ns-kcduy namespace. primary: ;secondary: mysql-yseslc-mysql-0 mysql-yseslc-mysql-1 No resources found in ns-kcduy namespace. primary: ;secondary: mysql-yseslc-mysql-0 mysql-yseslc-mysql-1 No resources found in ns-kcduy namespace. primary: ;secondary: mysql-yseslc-mysql-0 mysql-yseslc-mysql-1 No resources found in ns-kcduy namespace. primary: ;secondary: mysql-yseslc-mysql-0 mysql-yseslc-mysql-1 check cluster role done primary: mysql-yseslc-mysql-0;secondary: mysql-yseslc-mysql-1 `kubectl get secrets -l app.kubernetes.io/instance=mysql-yseslc` set secret: mysql-yseslc-mysql-account-root `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:94J7Xw74tE;DB_PORT:3306;DB_DATABASE:mysql check cluster connect `echo " echo \"SHOW SLAVE STATUS\G;\" | mysql -P3306 -h127.0.0.1 -uroot -p'94J7Xw74tE' " | kubectl exec -it mysql-yseslc-mysql-1 --namespace ns-kcduy -- bash ` check cluster connect done check ops status `kbcli cluster list-ops mysql-yseslc --status all --namespace ns-kcduy ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME mysql-yseslc-switchover-4bfkr ns-kcduy Switchover mysql-yseslc mysql Succeed 1/1 Sep 11,2025 20:34 UTC+0800 mysql-yseslc-upgrade-cmpv-7kzml ns-kcduy Upgrade mysql-yseslc mysql Succeed 2/2 Sep 11,2025 21:03 UTC+0800 check ops status done ops_status:mysql-yseslc-upgrade-cmpv-7kzml ns-kcduy Upgrade mysql-yseslc mysql Succeed 2/2 Sep 11,2025 21:03 UTC+0800 `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge opsrequests.operations mysql-yseslc-upgrade-cmpv-7kzml --namespace ns-kcduy ` opsrequest.operations.kubeblocks.io/mysql-yseslc-upgrade-cmpv-7kzml patched `kbcli cluster delete-ops --name mysql-yseslc-upgrade-cmpv-7kzml --force --auto-approve --namespace ns-kcduy ` OpsRequest mysql-yseslc-upgrade-cmpv-7kzml deleted `kubectl get secrets -l app.kubernetes.io/instance=mysql-yseslc` set secret: mysql-yseslc-mysql-account-root `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:94J7Xw74tE;DB_PORT:3306;DB_DATABASE:mysql check db_client batch data count `echo "echo \"select count(*) from executions_loop.executions_loop_table;\" | mysql -P3306 -hmysql-yseslc-mysql.ns-kcduy.svc.cluster.local -uroot -p'94J7Xw74tE' " | kubectl exec -it mysql-yseslc-mysql-0 --namespace ns-kcduy -- bash ` check db_client batch data Success `kubectl get secrets -l app.kubernetes.io/instance=mysql-yseslc` set secret: mysql-yseslc-mysql-account-root `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:94J7Xw74tE;DB_PORT:3306;DB_DATABASE:mysql check readonly db_client batch data count `echo "echo \"select count(*) from executions_loop.executions_loop_table;\" | mysql -P3306 -h127.0.0.1 -uroot -p'94J7Xw74tE' " | kubectl exec -it mysql-yseslc-mysql-1 --namespace ns-kcduy -- bash ` check readonly db_client batch data Success upgrade from:8.0.34 to service version:8.0.35 cluster upgrade apiVersion: operations.kubeblocks.io/v1alpha1 kind: OpsRequest metadata: generateName: mysql-yseslc-upgrade-cmpv- namespace: ns-kcduy spec: clusterName: mysql-yseslc upgrade: components: - componentName: mysql serviceVersion: 8.0.35 type: Upgrade check cluster status before ops check cluster status done cluster_status:Running `kubectl create -f test_ops_cluster_mysql-yseslc.yaml` opsrequest.operations.kubeblocks.io/mysql-yseslc-upgrade-cmpv-4rqm2 created create test_ops_cluster_mysql-yseslc.yaml Success `rm -rf test_ops_cluster_mysql-yseslc.yaml` check ops status `kbcli cluster list-ops mysql-yseslc --status all --namespace ns-kcduy ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME mysql-yseslc-switchover-4bfkr ns-kcduy Switchover mysql-yseslc mysql Succeed 1/1 Sep 11,2025 20:34 UTC+0800 mysql-yseslc-upgrade-cmpv-4rqm2 ns-kcduy Upgrade mysql-yseslc Creating -/- Sep 11,2025 21:04 UTC+0800 check cluster status `kbcli cluster list mysql-yseslc --show-labels --namespace ns-kcduy ` NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS mysql-yseslc ns-kcduy mysql DoNotTerminate Updating Sep 11,2025 20:24 UTC+0800 app.kubernetes.io/instance=mysql-yseslc,clusterdefinition.kubeblocks.io/name=mysql cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances mysql-yseslc --namespace ns-kcduy ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME mysql-yseslc-mysql-0 ns-kcduy mysql-yseslc mysql Running secondary 0 200m / 200m 644245094400m / 644245094400m data:10Gi aks-cicdamdpool-42425418-vmss000001/10.224.0.5 Sep 11,2025 20:59 UTC+0800 mysql-yseslc-mysql-1 ns-kcduy mysql-yseslc mysql Running secondary 0 200m / 200m 644245094400m / 644245094400m data:10Gi aks-cicdamdpool-42425418-vmss000000/10.224.0.9 Sep 11,2025 20:53 UTC+0800 mysql-yseslc-proxysql-0 ns-kcduy mysql-yseslc proxysql Running 0 100m / 100m 512Mi / 512Mi aks-cicdamdpool-42425418-vmss000001/10.224.0.5 Sep 11,2025 20:42 UTC+0800 check pod status done check cluster role No resources found in ns-kcduy namespace. primary: ;secondary: mysql-yseslc-mysql-0 mysql-yseslc-mysql-1 No resources found in ns-kcduy namespace. primary: ;secondary: mysql-yseslc-mysql-0 mysql-yseslc-mysql-1 No resources found in ns-kcduy namespace. primary: ;secondary: mysql-yseslc-mysql-0 mysql-yseslc-mysql-1 No resources found in ns-kcduy namespace. primary: ;secondary: mysql-yseslc-mysql-0 mysql-yseslc-mysql-1 No resources found in ns-kcduy namespace. primary: ;secondary: mysql-yseslc-mysql-0 mysql-yseslc-mysql-1 No resources found in ns-kcduy namespace. primary: ;secondary: mysql-yseslc-mysql-0 mysql-yseslc-mysql-1 No resources found in ns-kcduy namespace. primary: ;secondary: mysql-yseslc-mysql-0 mysql-yseslc-mysql-1 No resources found in ns-kcduy namespace. primary: ;secondary: mysql-yseslc-mysql-0 mysql-yseslc-mysql-1 No resources found in ns-kcduy namespace. primary: ;secondary: mysql-yseslc-mysql-0 mysql-yseslc-mysql-1 No resources found in ns-kcduy namespace. primary: ;secondary: mysql-yseslc-mysql-0 mysql-yseslc-mysql-1 No resources found in ns-kcduy namespace. primary: ;secondary: mysql-yseslc-mysql-0 mysql-yseslc-mysql-1 No resources found in ns-kcduy namespace. primary: ;secondary: mysql-yseslc-mysql-0 mysql-yseslc-mysql-1 No resources found in ns-kcduy namespace. primary: ;secondary: mysql-yseslc-mysql-0 mysql-yseslc-mysql-1 No resources found in ns-kcduy namespace. primary: ;secondary: mysql-yseslc-mysql-0 mysql-yseslc-mysql-1 No resources found in ns-kcduy namespace. primary: ;secondary: mysql-yseslc-mysql-0 mysql-yseslc-mysql-1 No resources found in ns-kcduy namespace. primary: ;secondary: mysql-yseslc-mysql-0 mysql-yseslc-mysql-1 No resources found in ns-kcduy namespace. primary: ;secondary: mysql-yseslc-mysql-0 mysql-yseslc-mysql-1 check cluster role done primary: mysql-yseslc-mysql-0;secondary: mysql-yseslc-mysql-1 `kubectl get secrets -l app.kubernetes.io/instance=mysql-yseslc` set secret: mysql-yseslc-mysql-account-root `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:94J7Xw74tE;DB_PORT:3306;DB_DATABASE:mysql check cluster connect `echo " echo \"SHOW SLAVE STATUS\G;\" | mysql -P3306 -h127.0.0.1 -uroot -p'94J7Xw74tE' " | kubectl exec -it mysql-yseslc-mysql-1 --namespace ns-kcduy -- bash ` check cluster connect done check ops status `kbcli cluster list-ops mysql-yseslc --status all --namespace ns-kcduy ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME mysql-yseslc-switchover-4bfkr ns-kcduy Switchover mysql-yseslc mysql Succeed 1/1 Sep 11,2025 20:34 UTC+0800 mysql-yseslc-upgrade-cmpv-4rqm2 ns-kcduy Upgrade mysql-yseslc mysql Succeed 2/2 Sep 11,2025 21:04 UTC+0800 check ops status done ops_status:mysql-yseslc-upgrade-cmpv-4rqm2 ns-kcduy Upgrade mysql-yseslc mysql Succeed 2/2 Sep 11,2025 21:04 UTC+0800 `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge opsrequests.operations mysql-yseslc-upgrade-cmpv-4rqm2 --namespace ns-kcduy ` opsrequest.operations.kubeblocks.io/mysql-yseslc-upgrade-cmpv-4rqm2 patched `kbcli cluster delete-ops --name mysql-yseslc-upgrade-cmpv-4rqm2 --force --auto-approve --namespace ns-kcduy ` OpsRequest mysql-yseslc-upgrade-cmpv-4rqm2 deleted `kubectl get secrets -l app.kubernetes.io/instance=mysql-yseslc` set secret: mysql-yseslc-mysql-account-root `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:94J7Xw74tE;DB_PORT:3306;DB_DATABASE:mysql check db_client batch data count `echo "echo \"select count(*) from executions_loop.executions_loop_table;\" | mysql -P3306 -hmysql-yseslc-mysql.ns-kcduy.svc.cluster.local -uroot -p'94J7Xw74tE' " | kubectl exec -it mysql-yseslc-mysql-0 --namespace ns-kcduy -- bash ` check db_client batch data Success `kubectl get secrets -l app.kubernetes.io/instance=mysql-yseslc` set secret: mysql-yseslc-mysql-account-root `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:94J7Xw74tE;DB_PORT:3306;DB_DATABASE:mysql check readonly db_client batch data count `echo "echo \"select count(*) from executions_loop.executions_loop_table;\" | mysql -P3306 -h127.0.0.1 -uroot -p'94J7Xw74tE' " | kubectl exec -it mysql-yseslc-mysql-1 --namespace ns-kcduy -- bash ` check readonly db_client batch data Success upgrade from:8.0.35 to service version:8.0.39 cluster upgrade apiVersion: operations.kubeblocks.io/v1alpha1 kind: OpsRequest metadata: generateName: mysql-yseslc-upgrade-cmpv- namespace: ns-kcduy spec: clusterName: mysql-yseslc upgrade: components: - componentName: mysql serviceVersion: 8.0.39 type: Upgrade check cluster status before ops check cluster status done cluster_status:Running `kubectl create -f test_ops_cluster_mysql-yseslc.yaml` opsrequest.operations.kubeblocks.io/mysql-yseslc-upgrade-cmpv-kzk62 created create test_ops_cluster_mysql-yseslc.yaml Success `rm -rf test_ops_cluster_mysql-yseslc.yaml` check ops status `kbcli cluster list-ops mysql-yseslc --status all --namespace ns-kcduy ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME mysql-yseslc-switchover-4bfkr ns-kcduy Switchover mysql-yseslc mysql Succeed 1/1 Sep 11,2025 20:34 UTC+0800 mysql-yseslc-upgrade-cmpv-kzk62 ns-kcduy Upgrade mysql-yseslc Creating -/- Sep 11,2025 21:05 UTC+0800 check cluster status `kbcli cluster list mysql-yseslc --show-labels --namespace ns-kcduy ` NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS mysql-yseslc ns-kcduy mysql DoNotTerminate Updating Sep 11,2025 20:24 UTC+0800 app.kubernetes.io/instance=mysql-yseslc,clusterdefinition.kubeblocks.io/name=mysql cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances mysql-yseslc --namespace ns-kcduy ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME mysql-yseslc-mysql-0 ns-kcduy mysql-yseslc mysql Running secondary 0 200m / 200m 644245094400m / 644245094400m data:10Gi aks-cicdamdpool-42425418-vmss000001/10.224.0.5 Sep 11,2025 20:59 UTC+0800 mysql-yseslc-mysql-1 ns-kcduy mysql-yseslc mysql Running secondary 0 200m / 200m 644245094400m / 644245094400m data:10Gi aks-cicdamdpool-42425418-vmss000000/10.224.0.9 Sep 11,2025 20:53 UTC+0800 mysql-yseslc-proxysql-0 ns-kcduy mysql-yseslc proxysql Running 0 100m / 100m 512Mi / 512Mi aks-cicdamdpool-42425418-vmss000001/10.224.0.5 Sep 11,2025 20:42 UTC+0800 check pod status done check cluster role No resources found in ns-kcduy namespace. primary: ;secondary: mysql-yseslc-mysql-0 mysql-yseslc-mysql-1 No resources found in ns-kcduy namespace. primary: ;secondary: mysql-yseslc-mysql-0 mysql-yseslc-mysql-1 No resources found in ns-kcduy namespace. primary: ;secondary: mysql-yseslc-mysql-0 mysql-yseslc-mysql-1 No resources found in ns-kcduy namespace. primary: ;secondary: mysql-yseslc-mysql-0 mysql-yseslc-mysql-1 No resources found in ns-kcduy namespace. primary: ;secondary: mysql-yseslc-mysql-0 mysql-yseslc-mysql-1 No resources found in ns-kcduy namespace. primary: ;secondary: mysql-yseslc-mysql-0 mysql-yseslc-mysql-1 No resources found in ns-kcduy namespace. primary: ;secondary: mysql-yseslc-mysql-0 mysql-yseslc-mysql-1 No resources found in ns-kcduy namespace. primary: ;secondary: mysql-yseslc-mysql-0 mysql-yseslc-mysql-1 No resources found in ns-kcduy namespace. primary: ;secondary: mysql-yseslc-mysql-0 mysql-yseslc-mysql-1 No resources found in ns-kcduy namespace. primary: ;secondary: mysql-yseslc-mysql-0 mysql-yseslc-mysql-1 No resources found in ns-kcduy namespace. primary: ;secondary: mysql-yseslc-mysql-0 mysql-yseslc-mysql-1 No resources found in ns-kcduy namespace. primary: ;secondary: mysql-yseslc-mysql-0 mysql-yseslc-mysql-1 No resources found in ns-kcduy namespace. primary: ;secondary: mysql-yseslc-mysql-0 mysql-yseslc-mysql-1 No resources found in ns-kcduy namespace. primary: ;secondary: mysql-yseslc-mysql-0 mysql-yseslc-mysql-1 No resources found in ns-kcduy namespace. primary: ;secondary: mysql-yseslc-mysql-0 mysql-yseslc-mysql-1 No resources found in ns-kcduy namespace. primary: ;secondary: mysql-yseslc-mysql-0 mysql-yseslc-mysql-1 No resources found in ns-kcduy namespace. primary: ;secondary: mysql-yseslc-mysql-0 mysql-yseslc-mysql-1 No resources found in ns-kcduy namespace. primary: ;secondary: mysql-yseslc-mysql-0 mysql-yseslc-mysql-1 check cluster role done primary: mysql-yseslc-mysql-0;secondary: mysql-yseslc-mysql-1 `kubectl get secrets -l app.kubernetes.io/instance=mysql-yseslc` set secret: mysql-yseslc-mysql-account-root `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:94J7Xw74tE;DB_PORT:3306;DB_DATABASE:mysql check cluster connect `echo " echo \"SHOW SLAVE STATUS\G;\" | mysql -P3306 -h127.0.0.1 -uroot -p'94J7Xw74tE' " | kubectl exec -it mysql-yseslc-mysql-1 --namespace ns-kcduy -- bash ` check cluster connect done check ops status `kbcli cluster list-ops mysql-yseslc --status all --namespace ns-kcduy ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME mysql-yseslc-switchover-4bfkr ns-kcduy Switchover mysql-yseslc mysql Succeed 1/1 Sep 11,2025 20:34 UTC+0800 mysql-yseslc-upgrade-cmpv-kzk62 ns-kcduy Upgrade mysql-yseslc mysql Succeed 2/2 Sep 11,2025 21:05 UTC+0800 check ops status done ops_status:mysql-yseslc-upgrade-cmpv-kzk62 ns-kcduy Upgrade mysql-yseslc mysql Succeed 2/2 Sep 11,2025 21:05 UTC+0800 `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge opsrequests.operations mysql-yseslc-upgrade-cmpv-kzk62 --namespace ns-kcduy ` opsrequest.operations.kubeblocks.io/mysql-yseslc-upgrade-cmpv-kzk62 patched `kbcli cluster delete-ops --name mysql-yseslc-upgrade-cmpv-kzk62 --force --auto-approve --namespace ns-kcduy ` OpsRequest mysql-yseslc-upgrade-cmpv-kzk62 deleted `kubectl get secrets -l app.kubernetes.io/instance=mysql-yseslc` set secret: mysql-yseslc-mysql-account-root `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:94J7Xw74tE;DB_PORT:3306;DB_DATABASE:mysql check db_client batch data count `echo "echo \"select count(*) from executions_loop.executions_loop_table;\" | mysql -P3306 -hmysql-yseslc-mysql.ns-kcduy.svc.cluster.local -uroot -p'94J7Xw74tE' " | kubectl exec -it mysql-yseslc-mysql-0 --namespace ns-kcduy -- bash ` check db_client batch data Success `kubectl get secrets -l app.kubernetes.io/instance=mysql-yseslc` set secret: mysql-yseslc-mysql-account-root `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:94J7Xw74tE;DB_PORT:3306;DB_DATABASE:mysql check readonly db_client batch data count `echo "echo \"select count(*) from executions_loop.executions_loop_table;\" | mysql -P3306 -h127.0.0.1 -uroot -p'94J7Xw74tE' " | kubectl exec -it mysql-yseslc-mysql-1 --namespace ns-kcduy -- bash ` check readonly db_client batch data Success downgrade from:8.0.39 to service version:8.0.35 cluster upgrade apiVersion: operations.kubeblocks.io/v1alpha1 kind: OpsRequest metadata: generateName: mysql-yseslc-upgrade-cmpv- namespace: ns-kcduy spec: clusterName: mysql-yseslc upgrade: components: - componentName: mysql serviceVersion: 8.0.35 type: Upgrade check cluster status before ops check cluster status done cluster_status:Running `kubectl create -f test_ops_cluster_mysql-yseslc.yaml` opsrequest.operations.kubeblocks.io/mysql-yseslc-upgrade-cmpv-b86nc created create test_ops_cluster_mysql-yseslc.yaml Success `rm -rf test_ops_cluster_mysql-yseslc.yaml` check ops status `kbcli cluster list-ops mysql-yseslc --status all --namespace ns-kcduy ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME mysql-yseslc-switchover-4bfkr ns-kcduy Switchover mysql-yseslc mysql Succeed 1/1 Sep 11,2025 20:34 UTC+0800 mysql-yseslc-upgrade-cmpv-b86nc ns-kcduy Upgrade mysql-yseslc Creating -/- Sep 11,2025 21:07 UTC+0800 check cluster status `kbcli cluster list mysql-yseslc --show-labels --namespace ns-kcduy ` NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS mysql-yseslc ns-kcduy mysql DoNotTerminate Updating Sep 11,2025 20:24 UTC+0800 app.kubernetes.io/instance=mysql-yseslc,clusterdefinition.kubeblocks.io/name=mysql cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances mysql-yseslc --namespace ns-kcduy ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME mysql-yseslc-mysql-0 ns-kcduy mysql-yseslc mysql Running secondary 0 200m / 200m 644245094400m / 644245094400m data:10Gi aks-cicdamdpool-42425418-vmss000001/10.224.0.5 Sep 11,2025 20:59 UTC+0800 mysql-yseslc-mysql-1 ns-kcduy mysql-yseslc mysql Running primary 0 200m / 200m 644245094400m / 644245094400m data:10Gi aks-cicdamdpool-42425418-vmss000000/10.224.0.9 Sep 11,2025 20:53 UTC+0800 mysql-yseslc-proxysql-0 ns-kcduy mysql-yseslc proxysql Running 0 100m / 100m 512Mi / 512Mi aks-cicdamdpool-42425418-vmss000001/10.224.0.5 Sep 11,2025 20:42 UTC+0800 check pod status done check cluster role check cluster role done primary: mysql-yseslc-mysql-1;secondary: mysql-yseslc-mysql-0 `kubectl get secrets -l app.kubernetes.io/instance=mysql-yseslc` set secret: mysql-yseslc-mysql-account-root `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:94J7Xw74tE;DB_PORT:3306;DB_DATABASE:mysql check cluster connect `echo " echo \"SHOW SLAVE STATUS\G;\" | mysql -P3306 -h127.0.0.1 -uroot -p'94J7Xw74tE' " | kubectl exec -it mysql-yseslc-mysql-0 --namespace ns-kcduy -- bash ` check cluster connect done check ops status `kbcli cluster list-ops mysql-yseslc --status all --namespace ns-kcduy ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME mysql-yseslc-switchover-4bfkr ns-kcduy Switchover mysql-yseslc mysql Succeed 1/1 Sep 11,2025 20:34 UTC+0800 mysql-yseslc-upgrade-cmpv-b86nc ns-kcduy Upgrade mysql-yseslc mysql Succeed 2/2 Sep 11,2025 21:07 UTC+0800 check ops status done ops_status:mysql-yseslc-upgrade-cmpv-b86nc ns-kcduy Upgrade mysql-yseslc mysql Succeed 2/2 Sep 11,2025 21:07 UTC+0800 `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge opsrequests.operations mysql-yseslc-upgrade-cmpv-b86nc --namespace ns-kcduy ` opsrequest.operations.kubeblocks.io/mysql-yseslc-upgrade-cmpv-b86nc patched `kbcli cluster delete-ops --name mysql-yseslc-upgrade-cmpv-b86nc --force --auto-approve --namespace ns-kcduy ` OpsRequest mysql-yseslc-upgrade-cmpv-b86nc deleted `kubectl get secrets -l app.kubernetes.io/instance=mysql-yseslc` set secret: mysql-yseslc-mysql-account-root `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:94J7Xw74tE;DB_PORT:3306;DB_DATABASE:mysql check db_client batch data count `echo "echo \"select count(*) from executions_loop.executions_loop_table;\" | mysql -P3306 -hmysql-yseslc-mysql.ns-kcduy.svc.cluster.local -uroot -p'94J7Xw74tE' " | kubectl exec -it mysql-yseslc-mysql-1 --namespace ns-kcduy -- bash ` check db_client batch data Success `kubectl get secrets -l app.kubernetes.io/instance=mysql-yseslc` set secret: mysql-yseslc-mysql-account-root `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:94J7Xw74tE;DB_PORT:3306;DB_DATABASE:mysql check readonly db_client batch data count `echo "echo \"select count(*) from executions_loop.executions_loop_table;\" | mysql -P3306 -h127.0.0.1 -uroot -p'94J7Xw74tE' " | kubectl exec -it mysql-yseslc-mysql-0 --namespace ns-kcduy -- bash ` check readonly db_client batch data Success upgrade from:8.0.35 to service version:8.0.36 cluster upgrade apiVersion: operations.kubeblocks.io/v1alpha1 kind: OpsRequest metadata: generateName: mysql-yseslc-upgrade-cmpv- namespace: ns-kcduy spec: clusterName: mysql-yseslc upgrade: components: - componentName: mysql serviceVersion: 8.0.36 type: Upgrade check cluster status before ops check cluster status done cluster_status:Running `kubectl create -f test_ops_cluster_mysql-yseslc.yaml` opsrequest.operations.kubeblocks.io/mysql-yseslc-upgrade-cmpv-rdjm7 created create test_ops_cluster_mysql-yseslc.yaml Success `rm -rf test_ops_cluster_mysql-yseslc.yaml` check ops status `kbcli cluster list-ops mysql-yseslc --status all --namespace ns-kcduy ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME mysql-yseslc-switchover-4bfkr ns-kcduy Switchover mysql-yseslc mysql Succeed 1/1 Sep 11,2025 20:34 UTC+0800 mysql-yseslc-upgrade-cmpv-rdjm7 ns-kcduy Upgrade mysql-yseslc Running -/- Sep 11,2025 21:08 UTC+0800 check cluster status `kbcli cluster list mysql-yseslc --show-labels --namespace ns-kcduy ` NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS mysql-yseslc ns-kcduy mysql DoNotTerminate Updating Sep 11,2025 20:24 UTC+0800 app.kubernetes.io/instance=mysql-yseslc,clusterdefinition.kubeblocks.io/name=mysql cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances mysql-yseslc --namespace ns-kcduy ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME mysql-yseslc-mysql-0 ns-kcduy mysql-yseslc mysql Running secondary 0 200m / 200m 644245094400m / 644245094400m data:10Gi aks-cicdamdpool-42425418-vmss000001/10.224.0.5 Sep 11,2025 20:59 UTC+0800 mysql-yseslc-mysql-1 ns-kcduy mysql-yseslc mysql Running secondary 0 200m / 200m 644245094400m / 644245094400m data:10Gi aks-cicdamdpool-42425418-vmss000000/10.224.0.9 Sep 11,2025 20:53 UTC+0800 mysql-yseslc-proxysql-0 ns-kcduy mysql-yseslc proxysql Running 0 100m / 100m 512Mi / 512Mi aks-cicdamdpool-42425418-vmss000001/10.224.0.5 Sep 11,2025 20:42 UTC+0800 check pod status done check cluster role No resources found in ns-kcduy namespace. primary: ;secondary: mysql-yseslc-mysql-0 mysql-yseslc-mysql-1 No resources found in ns-kcduy namespace. primary: ;secondary: mysql-yseslc-mysql-0 mysql-yseslc-mysql-1 No resources found in ns-kcduy namespace. primary: ;secondary: mysql-yseslc-mysql-0 mysql-yseslc-mysql-1 No resources found in ns-kcduy namespace. primary: ;secondary: mysql-yseslc-mysql-0 mysql-yseslc-mysql-1 No resources found in ns-kcduy namespace. primary: ;secondary: mysql-yseslc-mysql-0 mysql-yseslc-mysql-1 No resources found in ns-kcduy namespace. primary: ;secondary: mysql-yseslc-mysql-0 mysql-yseslc-mysql-1 No resources found in ns-kcduy namespace. primary: ;secondary: mysql-yseslc-mysql-0 mysql-yseslc-mysql-1 No resources found in ns-kcduy namespace. primary: ;secondary: mysql-yseslc-mysql-0 mysql-yseslc-mysql-1 No resources found in ns-kcduy namespace. primary: ;secondary: mysql-yseslc-mysql-0 mysql-yseslc-mysql-1 No resources found in ns-kcduy namespace. primary: ;secondary: mysql-yseslc-mysql-0 mysql-yseslc-mysql-1 No resources found in ns-kcduy namespace. primary: ;secondary: mysql-yseslc-mysql-0 mysql-yseslc-mysql-1 No resources found in ns-kcduy namespace. primary: ;secondary: mysql-yseslc-mysql-0 mysql-yseslc-mysql-1 No resources found in ns-kcduy namespace. primary: ;secondary: mysql-yseslc-mysql-0 mysql-yseslc-mysql-1 No resources found in ns-kcduy namespace. primary: ;secondary: mysql-yseslc-mysql-0 mysql-yseslc-mysql-1 No resources found in ns-kcduy namespace. primary: ;secondary: mysql-yseslc-mysql-0 mysql-yseslc-mysql-1 No resources found in ns-kcduy namespace. primary: ;secondary: mysql-yseslc-mysql-0 mysql-yseslc-mysql-1 No resources found in ns-kcduy namespace. primary: ;secondary: mysql-yseslc-mysql-0 mysql-yseslc-mysql-1 No resources found in ns-kcduy namespace. primary: ;secondary: mysql-yseslc-mysql-0 mysql-yseslc-mysql-1 check cluster role done primary: mysql-yseslc-mysql-1;secondary: mysql-yseslc-mysql-0 `kubectl get secrets -l app.kubernetes.io/instance=mysql-yseslc` set secret: mysql-yseslc-mysql-account-root `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:94J7Xw74tE;DB_PORT:3306;DB_DATABASE:mysql check cluster connect `echo " echo \"SHOW SLAVE STATUS\G;\" | mysql -P3306 -h127.0.0.1 -uroot -p'94J7Xw74tE' " | kubectl exec -it mysql-yseslc-mysql-0 --namespace ns-kcduy -- bash ` check cluster connect done check ops status `kbcli cluster list-ops mysql-yseslc --status all --namespace ns-kcduy ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME mysql-yseslc-switchover-4bfkr ns-kcduy Switchover mysql-yseslc mysql Succeed 1/1 Sep 11,2025 20:34 UTC+0800 mysql-yseslc-upgrade-cmpv-rdjm7 ns-kcduy Upgrade mysql-yseslc mysql Succeed 2/2 Sep 11,2025 21:08 UTC+0800 check ops status done ops_status:mysql-yseslc-upgrade-cmpv-rdjm7 ns-kcduy Upgrade mysql-yseslc mysql Succeed 2/2 Sep 11,2025 21:08 UTC+0800 `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge opsrequests.operations mysql-yseslc-upgrade-cmpv-rdjm7 --namespace ns-kcduy ` opsrequest.operations.kubeblocks.io/mysql-yseslc-upgrade-cmpv-rdjm7 patched `kbcli cluster delete-ops --name mysql-yseslc-upgrade-cmpv-rdjm7 --force --auto-approve --namespace ns-kcduy ` OpsRequest mysql-yseslc-upgrade-cmpv-rdjm7 deleted `kubectl get secrets -l app.kubernetes.io/instance=mysql-yseslc` set secret: mysql-yseslc-mysql-account-root `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:94J7Xw74tE;DB_PORT:3306;DB_DATABASE:mysql check db_client batch data count `echo "echo \"select count(*) from executions_loop.executions_loop_table;\" | mysql -P3306 -hmysql-yseslc-mysql.ns-kcduy.svc.cluster.local -uroot -p'94J7Xw74tE' " | kubectl exec -it mysql-yseslc-mysql-1 --namespace ns-kcduy -- bash ` check db_client batch data Success `kubectl get secrets -l app.kubernetes.io/instance=mysql-yseslc` set secret: mysql-yseslc-mysql-account-root `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:94J7Xw74tE;DB_PORT:3306;DB_DATABASE:mysql check readonly db_client batch data count `echo "echo \"select count(*) from executions_loop.executions_loop_table;\" | mysql -P3306 -h127.0.0.1 -uroot -p'94J7Xw74tE' " | kubectl exec -it mysql-yseslc-mysql-0 --namespace ns-kcduy -- bash ` check readonly db_client batch data Success upgrade from:8.0.36 to service version:8.0.39 cluster upgrade apiVersion: operations.kubeblocks.io/v1alpha1 kind: OpsRequest metadata: generateName: mysql-yseslc-upgrade-cmpv- namespace: ns-kcduy spec: clusterName: mysql-yseslc upgrade: components: - componentName: mysql serviceVersion: 8.0.39 type: Upgrade check cluster status before ops check cluster status done cluster_status:Running `kubectl create -f test_ops_cluster_mysql-yseslc.yaml` opsrequest.operations.kubeblocks.io/mysql-yseslc-upgrade-cmpv-c5l85 created create test_ops_cluster_mysql-yseslc.yaml Success `rm -rf test_ops_cluster_mysql-yseslc.yaml` check ops status `kbcli cluster list-ops mysql-yseslc --status all --namespace ns-kcduy ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME mysql-yseslc-switchover-4bfkr ns-kcduy Switchover mysql-yseslc mysql Succeed 1/1 Sep 11,2025 20:34 UTC+0800 mysql-yseslc-upgrade-cmpv-c5l85 ns-kcduy Upgrade mysql-yseslc Creating -/- Sep 11,2025 21:09 UTC+0800 check cluster status `kbcli cluster list mysql-yseslc --show-labels --namespace ns-kcduy ` NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS mysql-yseslc ns-kcduy mysql DoNotTerminate Updating Sep 11,2025 20:24 UTC+0800 app.kubernetes.io/instance=mysql-yseslc,clusterdefinition.kubeblocks.io/name=mysql cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances mysql-yseslc --namespace ns-kcduy ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME mysql-yseslc-mysql-0 ns-kcduy mysql-yseslc mysql Running secondary 0 200m / 200m 644245094400m / 644245094400m data:10Gi aks-cicdamdpool-42425418-vmss000001/10.224.0.5 Sep 11,2025 20:59 UTC+0800 mysql-yseslc-mysql-1 ns-kcduy mysql-yseslc mysql Running secondary 0 200m / 200m 644245094400m / 644245094400m data:10Gi aks-cicdamdpool-42425418-vmss000000/10.224.0.9 Sep 11,2025 20:53 UTC+0800 mysql-yseslc-proxysql-0 ns-kcduy mysql-yseslc proxysql Running 0 100m / 100m 512Mi / 512Mi aks-cicdamdpool-42425418-vmss000001/10.224.0.5 Sep 11,2025 20:42 UTC+0800 check pod status done check cluster role No resources found in ns-kcduy namespace. primary: ;secondary: mysql-yseslc-mysql-0 mysql-yseslc-mysql-1 No resources found in ns-kcduy namespace. primary: ;secondary: mysql-yseslc-mysql-0 mysql-yseslc-mysql-1 No resources found in ns-kcduy namespace. primary: ;secondary: mysql-yseslc-mysql-0 mysql-yseslc-mysql-1 No resources found in ns-kcduy namespace. primary: ;secondary: mysql-yseslc-mysql-0 mysql-yseslc-mysql-1 No resources found in ns-kcduy namespace. primary: ;secondary: mysql-yseslc-mysql-0 mysql-yseslc-mysql-1 No resources found in ns-kcduy namespace. primary: ;secondary: mysql-yseslc-mysql-0 mysql-yseslc-mysql-1 No resources found in ns-kcduy namespace. primary: ;secondary: mysql-yseslc-mysql-0 mysql-yseslc-mysql-1 No resources found in ns-kcduy namespace. primary: ;secondary: mysql-yseslc-mysql-0 mysql-yseslc-mysql-1 No resources found in ns-kcduy namespace. primary: ;secondary: mysql-yseslc-mysql-0 mysql-yseslc-mysql-1 No resources found in ns-kcduy namespace. primary: ;secondary: mysql-yseslc-mysql-0 mysql-yseslc-mysql-1 No resources found in ns-kcduy namespace. primary: ;secondary: mysql-yseslc-mysql-0 mysql-yseslc-mysql-1 No resources found in ns-kcduy namespace. primary: ;secondary: mysql-yseslc-mysql-0 mysql-yseslc-mysql-1 No resources found in ns-kcduy namespace. primary: ;secondary: mysql-yseslc-mysql-0 mysql-yseslc-mysql-1 No resources found in ns-kcduy namespace. primary: ;secondary: mysql-yseslc-mysql-0 mysql-yseslc-mysql-1 No resources found in ns-kcduy namespace. primary: ;secondary: mysql-yseslc-mysql-0 mysql-yseslc-mysql-1 No resources found in ns-kcduy namespace. primary: ;secondary: mysql-yseslc-mysql-0 mysql-yseslc-mysql-1 No resources found in ns-kcduy namespace. primary: ;secondary: mysql-yseslc-mysql-0 mysql-yseslc-mysql-1 No resources found in ns-kcduy namespace. primary: ;secondary: mysql-yseslc-mysql-0 mysql-yseslc-mysql-1 No resources found in ns-kcduy namespace. primary: ;secondary: mysql-yseslc-mysql-0 mysql-yseslc-mysql-1 No resources found in ns-kcduy namespace. primary: ;secondary: mysql-yseslc-mysql-0 mysql-yseslc-mysql-1 No resources found in ns-kcduy namespace. primary: ;secondary: mysql-yseslc-mysql-0 mysql-yseslc-mysql-1 No resources found in ns-kcduy namespace. primary: ;secondary: mysql-yseslc-mysql-0 mysql-yseslc-mysql-1 No resources found in ns-kcduy namespace. primary: ;secondary: mysql-yseslc-mysql-0 mysql-yseslc-mysql-1 check cluster role done primary: mysql-yseslc-mysql-1;secondary: mysql-yseslc-mysql-0 `kubectl get secrets -l app.kubernetes.io/instance=mysql-yseslc` set secret: mysql-yseslc-mysql-account-root `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:94J7Xw74tE;DB_PORT:3306;DB_DATABASE:mysql check cluster connect `echo " echo \"SHOW SLAVE STATUS\G;\" | mysql -P3306 -h127.0.0.1 -uroot -p'94J7Xw74tE' " | kubectl exec -it mysql-yseslc-mysql-0 --namespace ns-kcduy -- bash ` check cluster connect done check ops status `kbcli cluster list-ops mysql-yseslc --status all --namespace ns-kcduy ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME mysql-yseslc-switchover-4bfkr ns-kcduy Switchover mysql-yseslc mysql Succeed 1/1 Sep 11,2025 20:34 UTC+0800 mysql-yseslc-upgrade-cmpv-c5l85 ns-kcduy Upgrade mysql-yseslc mysql Succeed 2/2 Sep 11,2025 21:09 UTC+0800 check ops status done ops_status:mysql-yseslc-upgrade-cmpv-c5l85 ns-kcduy Upgrade mysql-yseslc mysql Succeed 2/2 Sep 11,2025 21:09 UTC+0800 `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge opsrequests.operations mysql-yseslc-upgrade-cmpv-c5l85 --namespace ns-kcduy ` opsrequest.operations.kubeblocks.io/mysql-yseslc-upgrade-cmpv-c5l85 patched `kbcli cluster delete-ops --name mysql-yseslc-upgrade-cmpv-c5l85 --force --auto-approve --namespace ns-kcduy ` OpsRequest mysql-yseslc-upgrade-cmpv-c5l85 deleted `kubectl get secrets -l app.kubernetes.io/instance=mysql-yseslc` set secret: mysql-yseslc-mysql-account-root `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:94J7Xw74tE;DB_PORT:3306;DB_DATABASE:mysql check db_client batch data count `echo "echo \"select count(*) from executions_loop.executions_loop_table;\" | mysql -P3306 -hmysql-yseslc-mysql.ns-kcduy.svc.cluster.local -uroot -p'94J7Xw74tE' " | kubectl exec -it mysql-yseslc-mysql-1 --namespace ns-kcduy -- bash ` check db_client batch data Success `kubectl get secrets -l app.kubernetes.io/instance=mysql-yseslc` set secret: mysql-yseslc-mysql-account-root `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:94J7Xw74tE;DB_PORT:3306;DB_DATABASE:mysql check readonly db_client batch data count `echo "echo \"select count(*) from executions_loop.executions_loop_table;\" | mysql -P3306 -h127.0.0.1 -uroot -p'94J7Xw74tE' " | kubectl exec -it mysql-yseslc-mysql-0 --namespace ns-kcduy -- bash ` check readonly db_client batch data Success downgrade from:8.0.39 to service version:8.0.36 cluster upgrade apiVersion: operations.kubeblocks.io/v1alpha1 kind: OpsRequest metadata: generateName: mysql-yseslc-upgrade-cmpv- namespace: ns-kcduy spec: clusterName: mysql-yseslc upgrade: components: - componentName: mysql serviceVersion: 8.0.36 type: Upgrade check cluster status before ops check cluster status done cluster_status:Running `kubectl create -f test_ops_cluster_mysql-yseslc.yaml` opsrequest.operations.kubeblocks.io/mysql-yseslc-upgrade-cmpv-d5492 created create test_ops_cluster_mysql-yseslc.yaml Success `rm -rf test_ops_cluster_mysql-yseslc.yaml` check ops status `kbcli cluster list-ops mysql-yseslc --status all --namespace ns-kcduy ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME mysql-yseslc-switchover-4bfkr ns-kcduy Switchover mysql-yseslc mysql Succeed 1/1 Sep 11,2025 20:34 UTC+0800 mysql-yseslc-upgrade-cmpv-d5492 ns-kcduy Upgrade mysql-yseslc Creating -/- Sep 11,2025 21:10 UTC+0800 check cluster status `kbcli cluster list mysql-yseslc --show-labels --namespace ns-kcduy ` NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS mysql-yseslc ns-kcduy mysql DoNotTerminate Updating Sep 11,2025 20:24 UTC+0800 app.kubernetes.io/instance=mysql-yseslc,clusterdefinition.kubeblocks.io/name=mysql cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances mysql-yseslc --namespace ns-kcduy ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME mysql-yseslc-mysql-0 ns-kcduy mysql-yseslc mysql Running primary 0 200m / 200m 644245094400m / 644245094400m data:10Gi aks-cicdamdpool-42425418-vmss000001/10.224.0.5 Sep 11,2025 20:59 UTC+0800 mysql-yseslc-mysql-1 ns-kcduy mysql-yseslc mysql Running secondary 0 200m / 200m 644245094400m / 644245094400m data:10Gi aks-cicdamdpool-42425418-vmss000000/10.224.0.9 Sep 11,2025 20:53 UTC+0800 mysql-yseslc-proxysql-0 ns-kcduy mysql-yseslc proxysql Running 0 100m / 100m 512Mi / 512Mi aks-cicdamdpool-42425418-vmss000001/10.224.0.5 Sep 11,2025 20:42 UTC+0800 check pod status done check cluster role check cluster role done primary: mysql-yseslc-mysql-0;secondary: mysql-yseslc-mysql-1 `kubectl get secrets -l app.kubernetes.io/instance=mysql-yseslc` set secret: mysql-yseslc-mysql-account-root `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:94J7Xw74tE;DB_PORT:3306;DB_DATABASE:mysql check cluster connect `echo " echo \"SHOW SLAVE STATUS\G;\" | mysql -P3306 -h127.0.0.1 -uroot -p'94J7Xw74tE' " | kubectl exec -it mysql-yseslc-mysql-1 --namespace ns-kcduy -- bash ` check cluster connect done check ops status `kbcli cluster list-ops mysql-yseslc --status all --namespace ns-kcduy ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME mysql-yseslc-switchover-4bfkr ns-kcduy Switchover mysql-yseslc mysql Succeed 1/1 Sep 11,2025 20:34 UTC+0800 mysql-yseslc-upgrade-cmpv-d5492 ns-kcduy Upgrade mysql-yseslc mysql Succeed 2/2 Sep 11,2025 21:10 UTC+0800 check ops status done ops_status:mysql-yseslc-upgrade-cmpv-d5492 ns-kcduy Upgrade mysql-yseslc mysql Succeed 2/2 Sep 11,2025 21:10 UTC+0800 `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge opsrequests.operations mysql-yseslc-upgrade-cmpv-d5492 --namespace ns-kcduy ` opsrequest.operations.kubeblocks.io/mysql-yseslc-upgrade-cmpv-d5492 patched `kbcli cluster delete-ops --name mysql-yseslc-upgrade-cmpv-d5492 --force --auto-approve --namespace ns-kcduy ` OpsRequest mysql-yseslc-upgrade-cmpv-d5492 deleted `kubectl get secrets -l app.kubernetes.io/instance=mysql-yseslc` set secret: mysql-yseslc-mysql-account-root `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:94J7Xw74tE;DB_PORT:3306;DB_DATABASE:mysql check db_client batch data count `echo "echo \"select count(*) from executions_loop.executions_loop_table;\" | mysql -P3306 -hmysql-yseslc-mysql.ns-kcduy.svc.cluster.local -uroot -p'94J7Xw74tE' " | kubectl exec -it mysql-yseslc-mysql-0 --namespace ns-kcduy -- bash ` check db_client batch data Success `kubectl get secrets -l app.kubernetes.io/instance=mysql-yseslc` set secret: mysql-yseslc-mysql-account-root `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:94J7Xw74tE;DB_PORT:3306;DB_DATABASE:mysql check readonly db_client batch data count `echo "echo \"select count(*) from executions_loop.executions_loop_table;\" | mysql -P3306 -h127.0.0.1 -uroot -p'94J7Xw74tE' " | kubectl exec -it mysql-yseslc-mysql-1 --namespace ns-kcduy -- bash ` check readonly db_client batch data Success upgrade from:8.0.36 to service version:8.0.37 cluster upgrade apiVersion: operations.kubeblocks.io/v1alpha1 kind: OpsRequest metadata: generateName: mysql-yseslc-upgrade-cmpv- namespace: ns-kcduy spec: clusterName: mysql-yseslc upgrade: components: - componentName: mysql serviceVersion: 8.0.37 type: Upgrade check cluster status before ops check cluster status done cluster_status:Running `kubectl create -f test_ops_cluster_mysql-yseslc.yaml` opsrequest.operations.kubeblocks.io/mysql-yseslc-upgrade-cmpv-hj8vm created create test_ops_cluster_mysql-yseslc.yaml Success `rm -rf test_ops_cluster_mysql-yseslc.yaml` check ops status `kbcli cluster list-ops mysql-yseslc --status all --namespace ns-kcduy ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME mysql-yseslc-switchover-4bfkr ns-kcduy Switchover mysql-yseslc mysql Succeed 1/1 Sep 11,2025 20:34 UTC+0800 mysql-yseslc-upgrade-cmpv-hj8vm ns-kcduy Upgrade mysql-yseslc Running -/- Sep 11,2025 21:11 UTC+0800 check cluster status `kbcli cluster list mysql-yseslc --show-labels --namespace ns-kcduy ` NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS mysql-yseslc ns-kcduy mysql DoNotTerminate Updating Sep 11,2025 20:24 UTC+0800 app.kubernetes.io/instance=mysql-yseslc,clusterdefinition.kubeblocks.io/name=mysql cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances mysql-yseslc --namespace ns-kcduy ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME mysql-yseslc-mysql-0 ns-kcduy mysql-yseslc mysql Running secondary 0 200m / 200m 644245094400m / 644245094400m data:10Gi aks-cicdamdpool-42425418-vmss000001/10.224.0.5 Sep 11,2025 20:59 UTC+0800 mysql-yseslc-mysql-1 ns-kcduy mysql-yseslc mysql Running secondary 0 200m / 200m 644245094400m / 644245094400m data:10Gi aks-cicdamdpool-42425418-vmss000000/10.224.0.9 Sep 11,2025 20:53 UTC+0800 mysql-yseslc-proxysql-0 ns-kcduy mysql-yseslc proxysql Running 0 100m / 100m 512Mi / 512Mi aks-cicdamdpool-42425418-vmss000001/10.224.0.5 Sep 11,2025 20:42 UTC+0800 check pod status done check cluster role No resources found in ns-kcduy namespace. primary: ;secondary: mysql-yseslc-mysql-0 mysql-yseslc-mysql-1 No resources found in ns-kcduy namespace. primary: ;secondary: mysql-yseslc-mysql-0 mysql-yseslc-mysql-1 No resources found in ns-kcduy namespace. primary: ;secondary: mysql-yseslc-mysql-0 mysql-yseslc-mysql-1 No resources found in ns-kcduy namespace. primary: ;secondary: mysql-yseslc-mysql-0 mysql-yseslc-mysql-1 No resources found in ns-kcduy namespace. primary: ;secondary: mysql-yseslc-mysql-0 mysql-yseslc-mysql-1 No resources found in ns-kcduy namespace. primary: ;secondary: mysql-yseslc-mysql-0 mysql-yseslc-mysql-1 No resources found in ns-kcduy namespace. primary: ;secondary: mysql-yseslc-mysql-0 mysql-yseslc-mysql-1 No resources found in ns-kcduy namespace. primary: ;secondary: mysql-yseslc-mysql-0 mysql-yseslc-mysql-1 No resources found in ns-kcduy namespace. primary: ;secondary: mysql-yseslc-mysql-0 mysql-yseslc-mysql-1 No resources found in ns-kcduy namespace. primary: ;secondary: mysql-yseslc-mysql-0 mysql-yseslc-mysql-1 No resources found in ns-kcduy namespace. primary: ;secondary: mysql-yseslc-mysql-0 mysql-yseslc-mysql-1 No resources found in ns-kcduy namespace. primary: ;secondary: mysql-yseslc-mysql-0 mysql-yseslc-mysql-1 No resources found in ns-kcduy namespace. primary: ;secondary: mysql-yseslc-mysql-0 mysql-yseslc-mysql-1 No resources found in ns-kcduy namespace. primary: ;secondary: mysql-yseslc-mysql-0 mysql-yseslc-mysql-1 No resources found in ns-kcduy namespace. primary: ;secondary: mysql-yseslc-mysql-0 mysql-yseslc-mysql-1 check cluster role done primary: mysql-yseslc-mysql-0;secondary: mysql-yseslc-mysql-1 `kubectl get secrets -l app.kubernetes.io/instance=mysql-yseslc` set secret: mysql-yseslc-mysql-account-root `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:94J7Xw74tE;DB_PORT:3306;DB_DATABASE:mysql check cluster connect `echo " echo \"SHOW SLAVE STATUS\G;\" | mysql -P3306 -h127.0.0.1 -uroot -p'94J7Xw74tE' " | kubectl exec -it mysql-yseslc-mysql-1 --namespace ns-kcduy -- bash ` check cluster connect done check ops status `kbcli cluster list-ops mysql-yseslc --status all --namespace ns-kcduy ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME mysql-yseslc-switchover-4bfkr ns-kcduy Switchover mysql-yseslc mysql Succeed 1/1 Sep 11,2025 20:34 UTC+0800 mysql-yseslc-upgrade-cmpv-hj8vm ns-kcduy Upgrade mysql-yseslc mysql Succeed 2/2 Sep 11,2025 21:11 UTC+0800 check ops status done ops_status:mysql-yseslc-upgrade-cmpv-hj8vm ns-kcduy Upgrade mysql-yseslc mysql Succeed 2/2 Sep 11,2025 21:11 UTC+0800 `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge opsrequests.operations mysql-yseslc-upgrade-cmpv-hj8vm --namespace ns-kcduy ` opsrequest.operations.kubeblocks.io/mysql-yseslc-upgrade-cmpv-hj8vm patched `kbcli cluster delete-ops --name mysql-yseslc-upgrade-cmpv-hj8vm --force --auto-approve --namespace ns-kcduy ` OpsRequest mysql-yseslc-upgrade-cmpv-hj8vm deleted `kubectl get secrets -l app.kubernetes.io/instance=mysql-yseslc` set secret: mysql-yseslc-mysql-account-root `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:94J7Xw74tE;DB_PORT:3306;DB_DATABASE:mysql check db_client batch data count `echo "echo \"select count(*) from executions_loop.executions_loop_table;\" | mysql -P3306 -hmysql-yseslc-mysql.ns-kcduy.svc.cluster.local -uroot -p'94J7Xw74tE' " | kubectl exec -it mysql-yseslc-mysql-0 --namespace ns-kcduy -- bash ` check db_client batch data Success `kubectl get secrets -l app.kubernetes.io/instance=mysql-yseslc` set secret: mysql-yseslc-mysql-account-root `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:94J7Xw74tE;DB_PORT:3306;DB_DATABASE:mysql check readonly db_client batch data count `echo "echo \"select count(*) from executions_loop.executions_loop_table;\" | mysql -P3306 -h127.0.0.1 -uroot -p'94J7Xw74tE' " | kubectl exec -it mysql-yseslc-mysql-1 --namespace ns-kcduy -- bash ` check readonly db_client batch data Success upgrade from:8.0.37 to service version:8.0.39 cluster upgrade apiVersion: operations.kubeblocks.io/v1alpha1 kind: OpsRequest metadata: generateName: mysql-yseslc-upgrade-cmpv- namespace: ns-kcduy spec: clusterName: mysql-yseslc upgrade: components: - componentName: mysql serviceVersion: 8.0.39 type: Upgrade check cluster status before ops check cluster status done cluster_status:Running `kubectl create -f test_ops_cluster_mysql-yseslc.yaml` opsrequest.operations.kubeblocks.io/mysql-yseslc-upgrade-cmpv-h9k5n created create test_ops_cluster_mysql-yseslc.yaml Success `rm -rf test_ops_cluster_mysql-yseslc.yaml` check ops status `kbcli cluster list-ops mysql-yseslc --status all --namespace ns-kcduy ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME mysql-yseslc-switchover-4bfkr ns-kcduy Switchover mysql-yseslc mysql Succeed 1/1 Sep 11,2025 20:34 UTC+0800 mysql-yseslc-upgrade-cmpv-h9k5n ns-kcduy Upgrade mysql-yseslc Running -/- Sep 11,2025 21:13 UTC+0800 check cluster status `kbcli cluster list mysql-yseslc --show-labels --namespace ns-kcduy ` NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS mysql-yseslc ns-kcduy mysql DoNotTerminate Updating Sep 11,2025 20:24 UTC+0800 app.kubernetes.io/instance=mysql-yseslc,clusterdefinition.kubeblocks.io/name=mysql cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances mysql-yseslc --namespace ns-kcduy ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME mysql-yseslc-mysql-0 ns-kcduy mysql-yseslc mysql Running secondary 0 200m / 200m 644245094400m / 644245094400m data:10Gi aks-cicdamdpool-42425418-vmss000001/10.224.0.5 Sep 11,2025 20:59 UTC+0800 mysql-yseslc-mysql-1 ns-kcduy mysql-yseslc mysql Running secondary 0 200m / 200m 644245094400m / 644245094400m data:10Gi aks-cicdamdpool-42425418-vmss000000/10.224.0.9 Sep 11,2025 20:53 UTC+0800 mysql-yseslc-proxysql-0 ns-kcduy mysql-yseslc proxysql Running 0 100m / 100m 512Mi / 512Mi aks-cicdamdpool-42425418-vmss000001/10.224.0.5 Sep 11,2025 20:42 UTC+0800 check pod status done check cluster role No resources found in ns-kcduy namespace. primary: ;secondary: mysql-yseslc-mysql-0 mysql-yseslc-mysql-1 No resources found in ns-kcduy namespace. primary: ;secondary: mysql-yseslc-mysql-0 mysql-yseslc-mysql-1 No resources found in ns-kcduy namespace. primary: ;secondary: mysql-yseslc-mysql-0 mysql-yseslc-mysql-1 No resources found in ns-kcduy namespace. primary: ;secondary: mysql-yseslc-mysql-0 mysql-yseslc-mysql-1 No resources found in ns-kcduy namespace. primary: ;secondary: mysql-yseslc-mysql-0 mysql-yseslc-mysql-1 No resources found in ns-kcduy namespace. primary: ;secondary: mysql-yseslc-mysql-0 mysql-yseslc-mysql-1 No resources found in ns-kcduy namespace. primary: ;secondary: mysql-yseslc-mysql-0 mysql-yseslc-mysql-1 No resources found in ns-kcduy namespace. primary: ;secondary: mysql-yseslc-mysql-0 mysql-yseslc-mysql-1 No resources found in ns-kcduy namespace. primary: ;secondary: mysql-yseslc-mysql-0 mysql-yseslc-mysql-1 No resources found in ns-kcduy namespace. primary: ;secondary: mysql-yseslc-mysql-0 mysql-yseslc-mysql-1 No resources found in ns-kcduy namespace. primary: ;secondary: mysql-yseslc-mysql-0 mysql-yseslc-mysql-1 No resources found in ns-kcduy namespace. primary: ;secondary: mysql-yseslc-mysql-0 mysql-yseslc-mysql-1 No resources found in ns-kcduy namespace. primary: ;secondary: mysql-yseslc-mysql-0 mysql-yseslc-mysql-1 No resources found in ns-kcduy namespace. primary: ;secondary: mysql-yseslc-mysql-0 mysql-yseslc-mysql-1 No resources found in ns-kcduy namespace. primary: ;secondary: mysql-yseslc-mysql-0 mysql-yseslc-mysql-1 No resources found in ns-kcduy namespace. primary: ;secondary: mysql-yseslc-mysql-0 mysql-yseslc-mysql-1 check cluster role done primary: mysql-yseslc-mysql-0;secondary: mysql-yseslc-mysql-1 `kubectl get secrets -l app.kubernetes.io/instance=mysql-yseslc` set secret: mysql-yseslc-mysql-account-root `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:94J7Xw74tE;DB_PORT:3306;DB_DATABASE:mysql check cluster connect `echo " echo \"SHOW SLAVE STATUS\G;\" | mysql -P3306 -h127.0.0.1 -uroot -p'94J7Xw74tE' " | kubectl exec -it mysql-yseslc-mysql-1 --namespace ns-kcduy -- bash ` check cluster connect done check ops status `kbcli cluster list-ops mysql-yseslc --status all --namespace ns-kcduy ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME mysql-yseslc-switchover-4bfkr ns-kcduy Switchover mysql-yseslc mysql Succeed 1/1 Sep 11,2025 20:34 UTC+0800 mysql-yseslc-upgrade-cmpv-h9k5n ns-kcduy Upgrade mysql-yseslc mysql Succeed 2/2 Sep 11,2025 21:13 UTC+0800 check ops status done ops_status:mysql-yseslc-upgrade-cmpv-h9k5n ns-kcduy Upgrade mysql-yseslc mysql Succeed 2/2 Sep 11,2025 21:13 UTC+0800 `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge opsrequests.operations mysql-yseslc-upgrade-cmpv-h9k5n --namespace ns-kcduy ` opsrequest.operations.kubeblocks.io/mysql-yseslc-upgrade-cmpv-h9k5n patched `kbcli cluster delete-ops --name mysql-yseslc-upgrade-cmpv-h9k5n --force --auto-approve --namespace ns-kcduy ` OpsRequest mysql-yseslc-upgrade-cmpv-h9k5n deleted `kubectl get secrets -l app.kubernetes.io/instance=mysql-yseslc` set secret: mysql-yseslc-mysql-account-root `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:94J7Xw74tE;DB_PORT:3306;DB_DATABASE:mysql check db_client batch data count `echo "echo \"select count(*) from executions_loop.executions_loop_table;\" | mysql -P3306 -hmysql-yseslc-mysql.ns-kcduy.svc.cluster.local -uroot -p'94J7Xw74tE' " | kubectl exec -it mysql-yseslc-mysql-0 --namespace ns-kcduy -- bash ` check db_client batch data Success `kubectl get secrets -l app.kubernetes.io/instance=mysql-yseslc` set secret: mysql-yseslc-mysql-account-root `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:94J7Xw74tE;DB_PORT:3306;DB_DATABASE:mysql check readonly db_client batch data count `echo "echo \"select count(*) from executions_loop.executions_loop_table;\" | mysql -P3306 -h127.0.0.1 -uroot -p'94J7Xw74tE' " | kubectl exec -it mysql-yseslc-mysql-1 --namespace ns-kcduy -- bash ` check readonly db_client batch data Success downgrade from:8.0.39 to service version:8.0.37 cluster upgrade apiVersion: operations.kubeblocks.io/v1alpha1 kind: OpsRequest metadata: generateName: mysql-yseslc-upgrade-cmpv- namespace: ns-kcduy spec: clusterName: mysql-yseslc upgrade: components: - componentName: mysql serviceVersion: 8.0.37 type: Upgrade check cluster status before ops check cluster status done cluster_status:Running `kubectl create -f test_ops_cluster_mysql-yseslc.yaml` opsrequest.operations.kubeblocks.io/mysql-yseslc-upgrade-cmpv-w5s4n created create test_ops_cluster_mysql-yseslc.yaml Success `rm -rf test_ops_cluster_mysql-yseslc.yaml` check ops status `kbcli cluster list-ops mysql-yseslc --status all --namespace ns-kcduy ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME mysql-yseslc-switchover-4bfkr ns-kcduy Switchover mysql-yseslc mysql Succeed 1/1 Sep 11,2025 20:34 UTC+0800 mysql-yseslc-upgrade-cmpv-w5s4n ns-kcduy Upgrade mysql-yseslc mysql Running 0/2 Sep 11,2025 21:14 UTC+0800 check cluster status `kbcli cluster list mysql-yseslc --show-labels --namespace ns-kcduy ` NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS mysql-yseslc ns-kcduy mysql DoNotTerminate Updating Sep 11,2025 20:24 UTC+0800 app.kubernetes.io/instance=mysql-yseslc,clusterdefinition.kubeblocks.io/name=mysql cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances mysql-yseslc --namespace ns-kcduy ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME mysql-yseslc-mysql-0 ns-kcduy mysql-yseslc mysql Running secondary 0 200m / 200m 644245094400m / 644245094400m data:10Gi aks-cicdamdpool-42425418-vmss000001/10.224.0.5 Sep 11,2025 20:59 UTC+0800 mysql-yseslc-mysql-1 ns-kcduy mysql-yseslc mysql Running primary 0 200m / 200m 644245094400m / 644245094400m data:10Gi aks-cicdamdpool-42425418-vmss000000/10.224.0.9 Sep 11,2025 20:53 UTC+0800 mysql-yseslc-proxysql-0 ns-kcduy mysql-yseslc proxysql Running 0 100m / 100m 512Mi / 512Mi aks-cicdamdpool-42425418-vmss000001/10.224.0.5 Sep 11,2025 20:42 UTC+0800 check pod status done check cluster role check cluster role done primary: mysql-yseslc-mysql-1;secondary: mysql-yseslc-mysql-0 `kubectl get secrets -l app.kubernetes.io/instance=mysql-yseslc` set secret: mysql-yseslc-mysql-account-root `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:94J7Xw74tE;DB_PORT:3306;DB_DATABASE:mysql check cluster connect `echo " echo \"SHOW SLAVE STATUS\G;\" | mysql -P3306 -h127.0.0.1 -uroot -p'94J7Xw74tE' " | kubectl exec -it mysql-yseslc-mysql-0 --namespace ns-kcduy -- bash ` check cluster connect done check ops status `kbcli cluster list-ops mysql-yseslc --status all --namespace ns-kcduy ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME mysql-yseslc-switchover-4bfkr ns-kcduy Switchover mysql-yseslc mysql Succeed 1/1 Sep 11,2025 20:34 UTC+0800 mysql-yseslc-upgrade-cmpv-w5s4n ns-kcduy Upgrade mysql-yseslc mysql Succeed 2/2 Sep 11,2025 21:14 UTC+0800 check ops status done ops_status:mysql-yseslc-upgrade-cmpv-w5s4n ns-kcduy Upgrade mysql-yseslc mysql Succeed 2/2 Sep 11,2025 21:14 UTC+0800 `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge opsrequests.operations mysql-yseslc-upgrade-cmpv-w5s4n --namespace ns-kcduy ` opsrequest.operations.kubeblocks.io/mysql-yseslc-upgrade-cmpv-w5s4n patched `kbcli cluster delete-ops --name mysql-yseslc-upgrade-cmpv-w5s4n --force --auto-approve --namespace ns-kcduy ` OpsRequest mysql-yseslc-upgrade-cmpv-w5s4n deleted `kubectl get secrets -l app.kubernetes.io/instance=mysql-yseslc` set secret: mysql-yseslc-mysql-account-root `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:94J7Xw74tE;DB_PORT:3306;DB_DATABASE:mysql check db_client batch data count `echo "echo \"select count(*) from executions_loop.executions_loop_table;\" | mysql -P3306 -hmysql-yseslc-mysql.ns-kcduy.svc.cluster.local -uroot -p'94J7Xw74tE' " | kubectl exec -it mysql-yseslc-mysql-1 --namespace ns-kcduy -- bash ` check db_client batch data Success `kubectl get secrets -l app.kubernetes.io/instance=mysql-yseslc` set secret: mysql-yseslc-mysql-account-root `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:94J7Xw74tE;DB_PORT:3306;DB_DATABASE:mysql check readonly db_client batch data count `echo "echo \"select count(*) from executions_loop.executions_loop_table;\" | mysql -P3306 -h127.0.0.1 -uroot -p'94J7Xw74tE' " | kubectl exec -it mysql-yseslc-mysql-0 --namespace ns-kcduy -- bash ` check readonly db_client batch data Success upgrade from:8.0.37 to service version:8.0.38 cluster upgrade apiVersion: operations.kubeblocks.io/v1alpha1 kind: OpsRequest metadata: generateName: mysql-yseslc-upgrade-cmpv- namespace: ns-kcduy spec: clusterName: mysql-yseslc upgrade: components: - componentName: mysql serviceVersion: 8.0.38 type: Upgrade check cluster status before ops check cluster status done cluster_status:Running `kubectl create -f test_ops_cluster_mysql-yseslc.yaml` opsrequest.operations.kubeblocks.io/mysql-yseslc-upgrade-cmpv-j5vrg created create test_ops_cluster_mysql-yseslc.yaml Success `rm -rf test_ops_cluster_mysql-yseslc.yaml` check ops status `kbcli cluster list-ops mysql-yseslc --status all --namespace ns-kcduy ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME mysql-yseslc-switchover-4bfkr ns-kcduy Switchover mysql-yseslc mysql Succeed 1/1 Sep 11,2025 20:34 UTC+0800 mysql-yseslc-upgrade-cmpv-j5vrg ns-kcduy Upgrade mysql-yseslc Sep 11,2025 21:15 UTC+0800 ops_status:mysql-yseslc-upgrade-cmpv-j5vrg ns-kcduy Upgrade mysql-yseslc Creating -/- Sep 11,2025 21:15 UTC+0800 check cluster status `kbcli cluster list mysql-yseslc --show-labels --namespace ns-kcduy ` NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS mysql-yseslc ns-kcduy mysql DoNotTerminate Updating Sep 11,2025 20:24 UTC+0800 app.kubernetes.io/instance=mysql-yseslc,clusterdefinition.kubeblocks.io/name=mysql cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances mysql-yseslc --namespace ns-kcduy ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME mysql-yseslc-mysql-0 ns-kcduy mysql-yseslc mysql Running secondary 0 200m / 200m 644245094400m / 644245094400m data:10Gi aks-cicdamdpool-42425418-vmss000001/10.224.0.5 Sep 11,2025 20:59 UTC+0800 mysql-yseslc-mysql-1 ns-kcduy mysql-yseslc mysql Running secondary 0 200m / 200m 644245094400m / 644245094400m data:10Gi aks-cicdamdpool-42425418-vmss000000/10.224.0.9 Sep 11,2025 20:53 UTC+0800 mysql-yseslc-proxysql-0 ns-kcduy mysql-yseslc proxysql Running 0 100m / 100m 512Mi / 512Mi aks-cicdamdpool-42425418-vmss000001/10.224.0.5 Sep 11,2025 20:42 UTC+0800 check pod status done check cluster role No resources found in ns-kcduy namespace. primary: ;secondary: mysql-yseslc-mysql-0 mysql-yseslc-mysql-1 No resources found in ns-kcduy namespace. primary: ;secondary: mysql-yseslc-mysql-0 mysql-yseslc-mysql-1 No resources found in ns-kcduy namespace. primary: ;secondary: mysql-yseslc-mysql-0 mysql-yseslc-mysql-1 No resources found in ns-kcduy namespace. primary: ;secondary: mysql-yseslc-mysql-0 mysql-yseslc-mysql-1 No resources found in ns-kcduy namespace. primary: ;secondary: mysql-yseslc-mysql-0 mysql-yseslc-mysql-1 No resources found in ns-kcduy namespace. primary: ;secondary: mysql-yseslc-mysql-0 mysql-yseslc-mysql-1 No resources found in ns-kcduy namespace. primary: ;secondary: mysql-yseslc-mysql-0 mysql-yseslc-mysql-1 No resources found in ns-kcduy namespace. primary: ;secondary: mysql-yseslc-mysql-0 No resources found in ns-kcduy namespace. mysql-yseslc-mysql-1 primary: ;secondary: mysql-yseslc-mysql-0 mysql-yseslc-mysql-1 No resources found in ns-kcduy namespace. primary: ;secondary: mysql-yseslc-mysql-0 mysql-yseslc-mysql-1 No resources found in ns-kcduy namespace. primary: ;secondary: mysql-yseslc-mysql-0 mysql-yseslc-mysql-1 No resources found in ns-kcduy namespace. primary: ;secondary: mysql-yseslc-mysql-0 mysql-yseslc-mysql-1 No resources found in ns-kcduy namespace. primary: ;secondary: mysql-yseslc-mysql-0 mysql-yseslc-mysql-1 No resources found in ns-kcduy namespace. primary: ;secondary: mysql-yseslc-mysql-0 mysql-yseslc-mysql-1 No resources found in ns-kcduy namespace. primary: ;secondary: mysql-yseslc-mysql-0 mysql-yseslc-mysql-1 No resources found in ns-kcduy namespace. primary: ;secondary: mysql-yseslc-mysql-0 mysql-yseslc-mysql-1 No resources found in ns-kcduy namespace. primary: ;secondary: mysql-yseslc-mysql-0 mysql-yseslc-mysql-1 No resources found in ns-kcduy namespace. primary: ;secondary: mysql-yseslc-mysql-0 mysql-yseslc-mysql-1 No resources found in ns-kcduy namespace. primary: ;secondary: mysql-yseslc-mysql-0 mysql-yseslc-mysql-1 check cluster role done primary: mysql-yseslc-mysql-1;secondary: mysql-yseslc-mysql-0 `kubectl get secrets -l app.kubernetes.io/instance=mysql-yseslc` set secret: mysql-yseslc-mysql-account-root `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:94J7Xw74tE;DB_PORT:3306;DB_DATABASE:mysql check cluster connect `echo " echo \"SHOW SLAVE STATUS\G;\" | mysql -P3306 -h127.0.0.1 -uroot -p'94J7Xw74tE' " | kubectl exec -it mysql-yseslc-mysql-0 --namespace ns-kcduy -- bash ` check cluster connect done check ops status `kbcli cluster list-ops mysql-yseslc --status all --namespace ns-kcduy ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME mysql-yseslc-switchover-4bfkr ns-kcduy Switchover mysql-yseslc mysql Succeed 1/1 Sep 11,2025 20:34 UTC+0800 mysql-yseslc-upgrade-cmpv-j5vrg ns-kcduy Upgrade mysql-yseslc mysql Succeed 2/2 Sep 11,2025 21:15 UTC+0800 check ops status done ops_status:mysql-yseslc-upgrade-cmpv-j5vrg ns-kcduy Upgrade mysql-yseslc mysql Succeed 2/2 Sep 11,2025 21:15 UTC+0800 `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge opsrequests.operations mysql-yseslc-upgrade-cmpv-j5vrg --namespace ns-kcduy ` opsrequest.operations.kubeblocks.io/mysql-yseslc-upgrade-cmpv-j5vrg patched `kbcli cluster delete-ops --name mysql-yseslc-upgrade-cmpv-j5vrg --force --auto-approve --namespace ns-kcduy ` OpsRequest mysql-yseslc-upgrade-cmpv-j5vrg deleted `kubectl get secrets -l app.kubernetes.io/instance=mysql-yseslc` set secret: mysql-yseslc-mysql-account-root `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:94J7Xw74tE;DB_PORT:3306;DB_DATABASE:mysql check db_client batch data count `echo "echo \"select count(*) from executions_loop.executions_loop_table;\" | mysql -P3306 -hmysql-yseslc-mysql.ns-kcduy.svc.cluster.local -uroot -p'94J7Xw74tE' " | kubectl exec -it mysql-yseslc-mysql-1 --namespace ns-kcduy -- bash ` check db_client batch data Success `kubectl get secrets -l app.kubernetes.io/instance=mysql-yseslc` set secret: mysql-yseslc-mysql-account-root `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:94J7Xw74tE;DB_PORT:3306;DB_DATABASE:mysql check readonly db_client batch data count `echo "echo \"select count(*) from executions_loop.executions_loop_table;\" | mysql -P3306 -h127.0.0.1 -uroot -p'94J7Xw74tE' " | kubectl exec -it mysql-yseslc-mysql-0 --namespace ns-kcduy -- bash ` check readonly db_client batch data Success upgrade from:8.0.38 to service version:8.0.39 cluster upgrade apiVersion: operations.kubeblocks.io/v1alpha1 kind: OpsRequest metadata: generateName: mysql-yseslc-upgrade-cmpv- namespace: ns-kcduy spec: clusterName: mysql-yseslc upgrade: components: - componentName: mysql serviceVersion: 8.0.39 type: Upgrade check cluster status before ops check cluster status done cluster_status:Running `kubectl create -f test_ops_cluster_mysql-yseslc.yaml` opsrequest.operations.kubeblocks.io/mysql-yseslc-upgrade-cmpv-v4spq created create test_ops_cluster_mysql-yseslc.yaml Success `rm -rf test_ops_cluster_mysql-yseslc.yaml` check ops status `kbcli cluster list-ops mysql-yseslc --status all --namespace ns-kcduy ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME mysql-yseslc-switchover-4bfkr ns-kcduy Switchover mysql-yseslc mysql Succeed 1/1 Sep 11,2025 20:34 UTC+0800 mysql-yseslc-upgrade-cmpv-v4spq ns-kcduy Upgrade mysql-yseslc Pending -/- Sep 11,2025 21:16 UTC+0800 check cluster status `kbcli cluster list mysql-yseslc --show-labels --namespace ns-kcduy ` NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS mysql-yseslc ns-kcduy mysql DoNotTerminate Updating Sep 11,2025 20:24 UTC+0800 app.kubernetes.io/instance=mysql-yseslc,clusterdefinition.kubeblocks.io/name=mysql cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances mysql-yseslc --namespace ns-kcduy ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME mysql-yseslc-mysql-0 ns-kcduy mysql-yseslc mysql Running secondary 0 200m / 200m 644245094400m / 644245094400m data:10Gi aks-cicdamdpool-42425418-vmss000001/10.224.0.5 Sep 11,2025 20:59 UTC+0800 mysql-yseslc-mysql-1 ns-kcduy mysql-yseslc mysql Running secondary 0 200m / 200m 644245094400m / 644245094400m data:10Gi aks-cicdamdpool-42425418-vmss000000/10.224.0.9 Sep 11,2025 20:53 UTC+0800 mysql-yseslc-proxysql-0 ns-kcduy mysql-yseslc proxysql Running 0 100m / 100m 512Mi / 512Mi aks-cicdamdpool-42425418-vmss000001/10.224.0.5 Sep 11,2025 20:42 UTC+0800 check pod status done check cluster role No resources found in ns-kcduy namespace. primary: ;secondary: mysql-yseslc-mysql-0 mysql-yseslc-mysql-1 No resources found in ns-kcduy namespace. primary: ;secondary: mysql-yseslc-mysql-0 mysql-yseslc-mysql-1 No resources found in ns-kcduy namespace. primary: ;secondary: mysql-yseslc-mysql-0 mysql-yseslc-mysql-1 No resources found in ns-kcduy namespace. primary: ;secondary: mysql-yseslc-mysql-0 mysql-yseslc-mysql-1 No resources found in ns-kcduy namespace. primary: ;secondary: mysql-yseslc-mysql-0 mysql-yseslc-mysql-1 No resources found in ns-kcduy namespace. primary: ;secondary: mysql-yseslc-mysql-0 mysql-yseslc-mysql-1 No resources found in ns-kcduy namespace. primary: ;secondary: mysql-yseslc-mysql-0 mysql-yseslc-mysql-1 No resources found in ns-kcduy namespace. primary: ;secondary: mysql-yseslc-mysql-0 mysql-yseslc-mysql-1 No resources found in ns-kcduy namespace. primary: ;secondary: mysql-yseslc-mysql-0 mysql-yseslc-mysql-1 No resources found in ns-kcduy namespace. primary: ;secondary: mysql-yseslc-mysql-0 mysql-yseslc-mysql-1 No resources found in ns-kcduy namespace. primary: ;secondary: mysql-yseslc-mysql-0 mysql-yseslc-mysql-1 No resources found in ns-kcduy namespace. primary: ;secondary: mysql-yseslc-mysql-0 mysql-yseslc-mysql-1 No resources found in ns-kcduy namespace. primary: ;secondary: mysql-yseslc-mysql-0 mysql-yseslc-mysql-1 No resources found in ns-kcduy namespace. primary: ;secondary: mysql-yseslc-mysql-0 mysql-yseslc-mysql-1 No resources found in ns-kcduy namespace. primary: ;secondary: mysql-yseslc-mysql-0 mysql-yseslc-mysql-1 No resources found in ns-kcduy namespace. primary: ;secondary: mysql-yseslc-mysql-0 mysql-yseslc-mysql-1 No resources found in ns-kcduy namespace. primary: ;secondary: mysql-yseslc-mysql-0 mysql-yseslc-mysql-1 No resources found in ns-kcduy namespace. primary: ;secondary: mysql-yseslc-mysql-0 mysql-yseslc-mysql-1 No resources found in ns-kcduy namespace. primary: ;secondary: mysql-yseslc-mysql-0 mysql-yseslc-mysql-1 No resources found in ns-kcduy namespace. primary: ;secondary: mysql-yseslc-mysql-0 mysql-yseslc-mysql-1 check cluster role done primary: mysql-yseslc-mysql-1;secondary: mysql-yseslc-mysql-0 `kubectl get secrets -l app.kubernetes.io/instance=mysql-yseslc` set secret: mysql-yseslc-mysql-account-root `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:94J7Xw74tE;DB_PORT:3306;DB_DATABASE:mysql check cluster connect `echo " echo \"SHOW SLAVE STATUS\G;\" | mysql -P3306 -h127.0.0.1 -uroot -p'94J7Xw74tE' " | kubectl exec -it mysql-yseslc-mysql-0 --namespace ns-kcduy -- bash ` check cluster connect done check ops status `kbcli cluster list-ops mysql-yseslc --status all --namespace ns-kcduy ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME mysql-yseslc-switchover-4bfkr ns-kcduy Switchover mysql-yseslc mysql Succeed 1/1 Sep 11,2025 20:34 UTC+0800 mysql-yseslc-upgrade-cmpv-v4spq ns-kcduy Upgrade mysql-yseslc mysql Succeed 2/2 Sep 11,2025 21:16 UTC+0800 check ops status done ops_status:mysql-yseslc-upgrade-cmpv-v4spq ns-kcduy Upgrade mysql-yseslc mysql Succeed 2/2 Sep 11,2025 21:16 UTC+0800 `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge opsrequests.operations mysql-yseslc-upgrade-cmpv-v4spq --namespace ns-kcduy ` opsrequest.operations.kubeblocks.io/mysql-yseslc-upgrade-cmpv-v4spq patched `kbcli cluster delete-ops --name mysql-yseslc-upgrade-cmpv-v4spq --force --auto-approve --namespace ns-kcduy ` OpsRequest mysql-yseslc-upgrade-cmpv-v4spq deleted `kubectl get secrets -l app.kubernetes.io/instance=mysql-yseslc` set secret: mysql-yseslc-mysql-account-root `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:94J7Xw74tE;DB_PORT:3306;DB_DATABASE:mysql check db_client batch data count `echo "echo \"select count(*) from executions_loop.executions_loop_table;\" | mysql -P3306 -hmysql-yseslc-mysql.ns-kcduy.svc.cluster.local -uroot -p'94J7Xw74tE' " | kubectl exec -it mysql-yseslc-mysql-1 --namespace ns-kcduy -- bash ` check db_client batch data Success `kubectl get secrets -l app.kubernetes.io/instance=mysql-yseslc` set secret: mysql-yseslc-mysql-account-root `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:94J7Xw74tE;DB_PORT:3306;DB_DATABASE:mysql check readonly db_client batch data count `echo "echo \"select count(*) from executions_loop.executions_loop_table;\" | mysql -P3306 -h127.0.0.1 -uroot -p'94J7Xw74tE' " | kubectl exec -it mysql-yseslc-mysql-0 --namespace ns-kcduy -- bash ` check readonly db_client batch data Success downgrade from:8.0.39 to service version:8.0.38 cluster upgrade apiVersion: operations.kubeblocks.io/v1alpha1 kind: OpsRequest metadata: generateName: mysql-yseslc-upgrade-cmpv- namespace: ns-kcduy spec: clusterName: mysql-yseslc upgrade: components: - componentName: mysql serviceVersion: 8.0.38 type: Upgrade check cluster status before ops check cluster status done cluster_status:Running `kubectl create -f test_ops_cluster_mysql-yseslc.yaml` opsrequest.operations.kubeblocks.io/mysql-yseslc-upgrade-cmpv-t74xj created create test_ops_cluster_mysql-yseslc.yaml Success `rm -rf test_ops_cluster_mysql-yseslc.yaml` check ops status `kbcli cluster list-ops mysql-yseslc --status all --namespace ns-kcduy ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME mysql-yseslc-switchover-4bfkr ns-kcduy Switchover mysql-yseslc mysql Succeed 1/1 Sep 11,2025 20:34 UTC+0800 mysql-yseslc-upgrade-cmpv-t74xj ns-kcduy Upgrade mysql-yseslc Creating -/- Sep 11,2025 21:18 UTC+0800 check cluster status `kbcli cluster list mysql-yseslc --show-labels --namespace ns-kcduy ` NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS mysql-yseslc ns-kcduy mysql DoNotTerminate Updating Sep 11,2025 20:24 UTC+0800 app.kubernetes.io/instance=mysql-yseslc,clusterdefinition.kubeblocks.io/name=mysql cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances mysql-yseslc --namespace ns-kcduy ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME mysql-yseslc-mysql-0 ns-kcduy mysql-yseslc mysql Running primary 0 200m / 200m 644245094400m / 644245094400m data:10Gi aks-cicdamdpool-42425418-vmss000001/10.224.0.5 Sep 11,2025 20:59 UTC+0800 mysql-yseslc-mysql-1 ns-kcduy mysql-yseslc mysql Running secondary 0 200m / 200m 644245094400m / 644245094400m data:10Gi aks-cicdamdpool-42425418-vmss000000/10.224.0.9 Sep 11,2025 20:53 UTC+0800 mysql-yseslc-proxysql-0 ns-kcduy mysql-yseslc proxysql Running 0 100m / 100m 512Mi / 512Mi aks-cicdamdpool-42425418-vmss000001/10.224.0.5 Sep 11,2025 20:42 UTC+0800 check pod status done check cluster role check cluster role done primary: mysql-yseslc-mysql-0;secondary: mysql-yseslc-mysql-1 `kubectl get secrets -l app.kubernetes.io/instance=mysql-yseslc` set secret: mysql-yseslc-mysql-account-root `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:94J7Xw74tE;DB_PORT:3306;DB_DATABASE:mysql check cluster connect `echo " echo \"SHOW SLAVE STATUS\G;\" | mysql -P3306 -h127.0.0.1 -uroot -p'94J7Xw74tE' " | kubectl exec -it mysql-yseslc-mysql-1 --namespace ns-kcduy -- bash ` connect checking... check cluster connect done check ops status `kbcli cluster list-ops mysql-yseslc --status all --namespace ns-kcduy ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME mysql-yseslc-switchover-4bfkr ns-kcduy Switchover mysql-yseslc mysql Succeed 1/1 Sep 11,2025 20:34 UTC+0800 mysql-yseslc-upgrade-cmpv-t74xj ns-kcduy Upgrade mysql-yseslc mysql Succeed 2/2 Sep 11,2025 21:18 UTC+0800 check ops status done ops_status:mysql-yseslc-upgrade-cmpv-t74xj ns-kcduy Upgrade mysql-yseslc mysql Succeed 2/2 Sep 11,2025 21:18 UTC+0800 `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge opsrequests.operations mysql-yseslc-upgrade-cmpv-t74xj --namespace ns-kcduy ` opsrequest.operations.kubeblocks.io/mysql-yseslc-upgrade-cmpv-t74xj patched `kbcli cluster delete-ops --name mysql-yseslc-upgrade-cmpv-t74xj --force --auto-approve --namespace ns-kcduy ` OpsRequest mysql-yseslc-upgrade-cmpv-t74xj deleted `kubectl get secrets -l app.kubernetes.io/instance=mysql-yseslc` set secret: mysql-yseslc-mysql-account-root `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:94J7Xw74tE;DB_PORT:3306;DB_DATABASE:mysql check db_client batch data count `echo "echo \"select count(*) from executions_loop.executions_loop_table;\" | mysql -P3306 -hmysql-yseslc-mysql.ns-kcduy.svc.cluster.local -uroot -p'94J7Xw74tE' " | kubectl exec -it mysql-yseslc-mysql-0 --namespace ns-kcduy -- bash ` check db_client batch data Success `kubectl get secrets -l app.kubernetes.io/instance=mysql-yseslc` set secret: mysql-yseslc-mysql-account-root `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:94J7Xw74tE;DB_PORT:3306;DB_DATABASE:mysql check readonly db_client batch data count `echo "echo \"select count(*) from executions_loop.executions_loop_table;\" | mysql -P3306 -h127.0.0.1 -uroot -p'94J7Xw74tE' " | kubectl exec -it mysql-yseslc-mysql-1 --namespace ns-kcduy -- bash ` check readonly db_client batch data Success cluster stop check cluster status before ops check cluster status done cluster_status:Running `kbcli cluster stop mysql-yseslc --auto-approve --force=true --namespace ns-kcduy ` OpsRequest mysql-yseslc-stop-tfm9d created successfully, you can view the progress: kbcli cluster describe-ops mysql-yseslc-stop-tfm9d -n ns-kcduy check ops status `kbcli cluster list-ops mysql-yseslc --status all --namespace ns-kcduy ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME mysql-yseslc-switchover-4bfkr ns-kcduy Switchover mysql-yseslc mysql Succeed 1/1 Sep 11,2025 20:34 UTC+0800 mysql-yseslc-stop-tfm9d ns-kcduy Stop mysql-yseslc Running -/- Sep 11,2025 21:19 UTC+0800 check cluster status `kbcli cluster list mysql-yseslc --show-labels --namespace ns-kcduy ` NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS mysql-yseslc ns-kcduy mysql DoNotTerminate Stopping Sep 11,2025 20:24 UTC+0800 app.kubernetes.io/instance=mysql-yseslc,clusterdefinition.kubeblocks.io/name=mysql cluster_status:Stopping cluster_status:Stopping cluster_status:Stopping cluster_status:Stopping cluster_status:Stopping cluster_status:Stopping cluster_status:Stopping cluster_status:Stopping cluster_status:Stopping cluster_status:Stopping check cluster status done cluster_status:Stopped check pod status `kbcli cluster list-instances mysql-yseslc --namespace ns-kcduy ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME check pod status done check ops status `kbcli cluster list-ops mysql-yseslc --status all --namespace ns-kcduy ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME mysql-yseslc-switchover-4bfkr ns-kcduy Switchover mysql-yseslc mysql Succeed 1/1 Sep 11,2025 20:34 UTC+0800 mysql-yseslc-stop-tfm9d ns-kcduy Stop mysql-yseslc mysql,proxysql Succeed 3/3 Sep 11,2025 21:19 UTC+0800 check ops status done ops_status:mysql-yseslc-stop-tfm9d ns-kcduy Stop mysql-yseslc mysql,proxysql Succeed 3/3 Sep 11,2025 21:19 UTC+0800 `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge opsrequests.operations mysql-yseslc-stop-tfm9d --namespace ns-kcduy ` opsrequest.operations.kubeblocks.io/mysql-yseslc-stop-tfm9d patched `kbcli cluster delete-ops --name mysql-yseslc-stop-tfm9d --force --auto-approve --namespace ns-kcduy ` OpsRequest mysql-yseslc-stop-tfm9d deleted cluster start check cluster status before ops check cluster status done cluster_status:Stopped `kbcli cluster start mysql-yseslc --force=true --namespace ns-kcduy ` OpsRequest mysql-yseslc-start-7nglx created successfully, you can view the progress: kbcli cluster describe-ops mysql-yseslc-start-7nglx -n ns-kcduy check ops status `kbcli cluster list-ops mysql-yseslc --status all --namespace ns-kcduy ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME mysql-yseslc-switchover-4bfkr ns-kcduy Switchover mysql-yseslc mysql Succeed 1/1 Sep 11,2025 20:34 UTC+0800 mysql-yseslc-start-7nglx ns-kcduy Start mysql-yseslc Creating -/- Sep 11,2025 21:20 UTC+0800 check cluster status `kbcli cluster list mysql-yseslc --show-labels --namespace ns-kcduy ` NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS mysql-yseslc ns-kcduy mysql DoNotTerminate Updating Sep 11,2025 20:24 UTC+0800 app.kubernetes.io/instance=mysql-yseslc,clusterdefinition.kubeblocks.io/name=mysql cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances mysql-yseslc --namespace ns-kcduy ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME mysql-yseslc-mysql-0 ns-kcduy mysql-yseslc mysql Running primary 0 200m / 200m 644245094400m / 644245094400m data:10Gi aks-cicdamdpool-42425418-vmss000000/10.224.0.9 Sep 11,2025 21:20 UTC+0800 mysql-yseslc-mysql-1 ns-kcduy mysql-yseslc mysql Running secondary 0 200m / 200m 644245094400m / 644245094400m data:10Gi aks-cicdamdpool-42425418-vmss000002/10.224.0.7 Sep 11,2025 21:20 UTC+0800 mysql-yseslc-proxysql-0 ns-kcduy mysql-yseslc proxysql Running 0 100m / 100m 512Mi / 512Mi aks-cicdamdpool-42425418-vmss000002/10.224.0.7 Sep 11,2025 21:21 UTC+0800 check pod status done check cluster role check cluster role done primary: mysql-yseslc-mysql-0;secondary: mysql-yseslc-mysql-1 `kubectl get secrets -l app.kubernetes.io/instance=mysql-yseslc` set secret: mysql-yseslc-mysql-account-root `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:94J7Xw74tE;DB_PORT:3306;DB_DATABASE:mysql check cluster connect `echo " echo \"SHOW SLAVE STATUS\G;\" | mysql -P3306 -h127.0.0.1 -uroot -p'94J7Xw74tE' " | kubectl exec -it mysql-yseslc-mysql-1 --namespace ns-kcduy -- bash ` check cluster connect done check ops status `kbcli cluster list-ops mysql-yseslc --status all --namespace ns-kcduy ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME mysql-yseslc-switchover-4bfkr ns-kcduy Switchover mysql-yseslc mysql Succeed 1/1 Sep 11,2025 20:34 UTC+0800 mysql-yseslc-start-7nglx ns-kcduy Start mysql-yseslc mysql,proxysql Succeed 3/3 Sep 11,2025 21:20 UTC+0800 check ops status done ops_status:mysql-yseslc-start-7nglx ns-kcduy Start mysql-yseslc mysql,proxysql Succeed 3/3 Sep 11,2025 21:20 UTC+0800 `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge opsrequests.operations mysql-yseslc-start-7nglx --namespace ns-kcduy ` opsrequest.operations.kubeblocks.io/mysql-yseslc-start-7nglx patched `kbcli cluster delete-ops --name mysql-yseslc-start-7nglx --force --auto-approve --namespace ns-kcduy ` OpsRequest mysql-yseslc-start-7nglx deleted `kubectl get secrets -l app.kubernetes.io/instance=mysql-yseslc` set secret: mysql-yseslc-mysql-account-root `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:94J7Xw74tE;DB_PORT:3306;DB_DATABASE:mysql check db_client batch data count `echo "echo \"select count(*) from executions_loop.executions_loop_table;\" | mysql -P3306 -hmysql-yseslc-mysql.ns-kcduy.svc.cluster.local -uroot -p'94J7Xw74tE' " | kubectl exec -it mysql-yseslc-mysql-0 --namespace ns-kcduy -- bash ` check db_client batch data Success `kubectl get secrets -l app.kubernetes.io/instance=mysql-yseslc` set secret: mysql-yseslc-mysql-account-root `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:94J7Xw74tE;DB_PORT:3306;DB_DATABASE:mysql check readonly db_client batch data count `echo "echo \"select count(*) from executions_loop.executions_loop_table;\" | mysql -P3306 -h127.0.0.1 -uroot -p'94J7Xw74tE' " | kubectl exec -it mysql-yseslc-mysql-1 --namespace ns-kcduy -- bash ` check readonly db_client batch data Success `kubectl get pvc -l app.kubernetes.io/instance=mysql-yseslc,apps.kubeblocks.io/component-name=mysql,apps.kubeblocks.io/vct-name=data --namespace ns-kcduy ` cluster volume-expand check cluster status before ops check cluster status done cluster_status:Running No resources found in mysql-yseslc namespace. `kbcli cluster volume-expand mysql-yseslc --auto-approve --force=true --components mysql --volume-claim-templates data --storage 11Gi --namespace ns-kcduy ` OpsRequest mysql-yseslc-volumeexpansion-gd5t7 created successfully, you can view the progress: kbcli cluster describe-ops mysql-yseslc-volumeexpansion-gd5t7 -n ns-kcduy check ops status `kbcli cluster list-ops mysql-yseslc --status all --namespace ns-kcduy ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME mysql-yseslc-switchover-4bfkr ns-kcduy Switchover mysql-yseslc mysql Succeed 1/1 Sep 11,2025 20:34 UTC+0800 mysql-yseslc-volumeexpansion-gd5t7 ns-kcduy VolumeExpansion mysql-yseslc mysql Running -/- Sep 11,2025 21:21 UTC+0800 check cluster status `kbcli cluster list mysql-yseslc --show-labels --namespace ns-kcduy ` NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS mysql-yseslc ns-kcduy mysql DoNotTerminate Updating Sep 11,2025 20:24 UTC+0800 app.kubernetes.io/instance=mysql-yseslc,clusterdefinition.kubeblocks.io/name=mysql cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances mysql-yseslc --namespace ns-kcduy ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME mysql-yseslc-mysql-0 ns-kcduy mysql-yseslc mysql Running primary 0 200m / 200m 644245094400m / 644245094400m data:11Gi aks-cicdamdpool-42425418-vmss000000/10.224.0.9 Sep 11,2025 21:20 UTC+0800 mysql-yseslc-mysql-1 ns-kcduy mysql-yseslc mysql Running secondary 0 200m / 200m 644245094400m / 644245094400m data:11Gi aks-cicdamdpool-42425418-vmss000002/10.224.0.7 Sep 11,2025 21:20 UTC+0800 mysql-yseslc-proxysql-0 ns-kcduy mysql-yseslc proxysql Running 0 100m / 100m 512Mi / 512Mi aks-cicdamdpool-42425418-vmss000002/10.224.0.7 Sep 11,2025 21:21 UTC+0800 check pod status done check cluster role check cluster role done primary: mysql-yseslc-mysql-0;secondary: mysql-yseslc-mysql-1 `kubectl get secrets -l app.kubernetes.io/instance=mysql-yseslc` set secret: mysql-yseslc-mysql-account-root `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:94J7Xw74tE;DB_PORT:3306;DB_DATABASE:mysql check cluster connect `echo " echo \"SHOW SLAVE STATUS\G;\" | mysql -P3306 -h127.0.0.1 -uroot -p'94J7Xw74tE' " | kubectl exec -it mysql-yseslc-mysql-1 --namespace ns-kcduy -- bash ` check cluster connect done No resources found in mysql-yseslc namespace. check ops status `kbcli cluster list-ops mysql-yseslc --status all --namespace ns-kcduy ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME mysql-yseslc-switchover-4bfkr ns-kcduy Switchover mysql-yseslc mysql Succeed 1/1 Sep 11,2025 20:34 UTC+0800 mysql-yseslc-volumeexpansion-gd5t7 ns-kcduy VolumeExpansion mysql-yseslc mysql Succeed 2/2 Sep 11,2025 21:21 UTC+0800 check ops status done ops_status:mysql-yseslc-volumeexpansion-gd5t7 ns-kcduy VolumeExpansion mysql-yseslc mysql Succeed 2/2 Sep 11,2025 21:21 UTC+0800 `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge opsrequests.operations mysql-yseslc-volumeexpansion-gd5t7 --namespace ns-kcduy ` opsrequest.operations.kubeblocks.io/mysql-yseslc-volumeexpansion-gd5t7 patched `kbcli cluster delete-ops --name mysql-yseslc-volumeexpansion-gd5t7 --force --auto-approve --namespace ns-kcduy ` OpsRequest mysql-yseslc-volumeexpansion-gd5t7 deleted `kubectl get secrets -l app.kubernetes.io/instance=mysql-yseslc` set secret: mysql-yseslc-mysql-account-root `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:94J7Xw74tE;DB_PORT:3306;DB_DATABASE:mysql check db_client batch data count `echo "echo \"select count(*) from executions_loop.executions_loop_table;\" | mysql -P3306 -hmysql-yseslc-mysql.ns-kcduy.svc.cluster.local -uroot -p'94J7Xw74tE' " | kubectl exec -it mysql-yseslc-mysql-0 --namespace ns-kcduy -- bash ` check db_client batch data Success `kubectl get secrets -l app.kubernetes.io/instance=mysql-yseslc` set secret: mysql-yseslc-mysql-account-root `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:94J7Xw74tE;DB_PORT:3306;DB_DATABASE:mysql check readonly db_client batch data count `echo "echo \"select count(*) from executions_loop.executions_loop_table;\" | mysql -P3306 -h127.0.0.1 -uroot -p'94J7Xw74tE' " | kubectl exec -it mysql-yseslc-mysql-1 --namespace ns-kcduy -- bash ` check readonly db_client batch data Success test failover podfailure check cluster status before cluster-failover-podfailure check cluster status done cluster_status:Running `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge PodChaos test-chaos-mesh-podfailure-mysql-yseslc --namespace ns-kcduy ` Warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely. Error from server (NotFound): podchaos.chaos-mesh.org "test-chaos-mesh-podfailure-mysql-yseslc" not found Error from server (NotFound): podchaos.chaos-mesh.org "test-chaos-mesh-podfailure-mysql-yseslc" not found apiVersion: chaos-mesh.org/v1alpha1 kind: PodChaos metadata: name: test-chaos-mesh-podfailure-mysql-yseslc namespace: ns-kcduy spec: selector: namespaces: - ns-kcduy labelSelectors: apps.kubeblocks.io/pod-name: mysql-yseslc-mysql-0 mode: all action: pod-failure duration: 2m `kubectl apply -f test-chaos-mesh-podfailure-mysql-yseslc.yaml` podchaos.chaos-mesh.org/test-chaos-mesh-podfailure-mysql-yseslc created apply test-chaos-mesh-podfailure-mysql-yseslc.yaml Success `rm -rf test-chaos-mesh-podfailure-mysql-yseslc.yaml` podfailure chaos test waiting 120 seconds check cluster status `kbcli cluster list mysql-yseslc --show-labels --namespace ns-kcduy ` NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS mysql-yseslc ns-kcduy mysql DoNotTerminate Abnormal Sep 11,2025 20:24 UTC+0800 app.kubernetes.io/instance=mysql-yseslc,clusterdefinition.kubeblocks.io/name=mysql cluster_status:Abnormal cluster_status:Updating cluster_status:Updating check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances mysql-yseslc --namespace ns-kcduy ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME mysql-yseslc-mysql-0 ns-kcduy mysql-yseslc mysql Running secondary 0 200m / 200m 644245094400m / 644245094400m data:11Gi aks-cicdamdpool-42425418-vmss000000/10.224.0.9 Sep 11,2025 21:20 UTC+0800 mysql-yseslc-mysql-1 ns-kcduy mysql-yseslc mysql Running primary 0 200m / 200m 644245094400m / 644245094400m data:11Gi aks-cicdamdpool-42425418-vmss000002/10.224.0.7 Sep 11,2025 21:20 UTC+0800 mysql-yseslc-proxysql-0 ns-kcduy mysql-yseslc proxysql Running 0 100m / 100m 512Mi / 512Mi aks-cicdamdpool-42425418-vmss000002/10.224.0.7 Sep 11,2025 21:21 UTC+0800 check pod status done check cluster role check cluster role done primary: mysql-yseslc-mysql-1;secondary: mysql-yseslc-mysql-0 `kubectl get secrets -l app.kubernetes.io/instance=mysql-yseslc` set secret: mysql-yseslc-mysql-account-root `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:94J7Xw74tE;DB_PORT:3306;DB_DATABASE:mysql check cluster connect `echo " echo \"SHOW SLAVE STATUS\G;\" | mysql -P3306 -h127.0.0.1 -uroot -p'94J7Xw74tE' " | kubectl exec -it mysql-yseslc-mysql-0 --namespace ns-kcduy -- bash ` check cluster connect done `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge PodChaos test-chaos-mesh-podfailure-mysql-yseslc --namespace ns-kcduy ` Warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely. podchaos.chaos-mesh.org "test-chaos-mesh-podfailure-mysql-yseslc" force deleted podchaos.chaos-mesh.org/test-chaos-mesh-podfailure-mysql-yseslc patched check failover pod name failover pod name:mysql-yseslc-mysql-1 failover podfailure Success `kubectl get secrets -l app.kubernetes.io/instance=mysql-yseslc` set secret: mysql-yseslc-mysql-account-root `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:94J7Xw74tE;DB_PORT:3306;DB_DATABASE:mysql check db_client batch data count `echo "echo \"select count(*) from executions_loop.executions_loop_table;\" | mysql -P3306 -hmysql-yseslc-mysql.ns-kcduy.svc.cluster.local -uroot -p'94J7Xw74tE' " | kubectl exec -it mysql-yseslc-mysql-1 --namespace ns-kcduy -- bash ` check db_client batch data Success `kubectl get secrets -l app.kubernetes.io/instance=mysql-yseslc` set secret: mysql-yseslc-mysql-account-root `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:94J7Xw74tE;DB_PORT:3306;DB_DATABASE:mysql check readonly db_client batch data count `echo "echo \"select count(*) from executions_loop.executions_loop_table;\" | mysql -P3306 -h127.0.0.1 -uroot -p'94J7Xw74tE' " | kubectl exec -it mysql-yseslc-mysql-0 --namespace ns-kcduy -- bash ` check readonly db_client batch data Success test failover networklossover check cluster status before cluster-failover-networklossover check cluster status done cluster_status:Running `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge NetworkChaos test-chaos-mesh-networklossover-mysql-yseslc --namespace ns-kcduy ` Warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely. Error from server (NotFound): networkchaos.chaos-mesh.org "test-chaos-mesh-networklossover-mysql-yseslc" not found Error from server (NotFound): networkchaos.chaos-mesh.org "test-chaos-mesh-networklossover-mysql-yseslc" not found apiVersion: chaos-mesh.org/v1alpha1 kind: NetworkChaos metadata: name: test-chaos-mesh-networklossover-mysql-yseslc namespace: ns-kcduy spec: selector: namespaces: - ns-kcduy labelSelectors: apps.kubeblocks.io/pod-name: mysql-yseslc-mysql-1 mode: all action: loss loss: loss: '100' correlation: '100' direction: to duration: 2m `kubectl apply -f test-chaos-mesh-networklossover-mysql-yseslc.yaml` networkchaos.chaos-mesh.org/test-chaos-mesh-networklossover-mysql-yseslc created apply test-chaos-mesh-networklossover-mysql-yseslc.yaml Success `rm -rf test-chaos-mesh-networklossover-mysql-yseslc.yaml` networklossover chaos test waiting 120 seconds check cluster status `kbcli cluster list mysql-yseslc --show-labels --namespace ns-kcduy ` NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS mysql-yseslc ns-kcduy mysql DoNotTerminate Running Sep 11,2025 20:24 UTC+0800 app.kubernetes.io/instance=mysql-yseslc,clusterdefinition.kubeblocks.io/name=mysql check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances mysql-yseslc --namespace ns-kcduy ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME mysql-yseslc-mysql-0 ns-kcduy mysql-yseslc mysql Running primary 0 200m / 200m 644245094400m / 644245094400m data:11Gi aks-cicdamdpool-42425418-vmss000000/10.224.0.9 Sep 11,2025 21:20 UTC+0800 mysql-yseslc-mysql-1 ns-kcduy mysql-yseslc mysql Running primary 0 200m / 200m 644245094400m / 644245094400m data:11Gi aks-cicdamdpool-42425418-vmss000002/10.224.0.7 Sep 11,2025 21:20 UTC+0800 mysql-yseslc-proxysql-0 ns-kcduy mysql-yseslc proxysql Running 0 100m / 100m 512Mi / 512Mi aks-cicdamdpool-42425418-vmss000002/10.224.0.7 Sep 11,2025 21:21 UTC+0800 check pod status done check cluster role No resources found in ns-kcduy namespace. primary: mysql-yseslc-mysql-0 mysql-yseslc-mysql-1;secondary: check cluster role done primary: mysql-yseslc-mysql-0;secondary: mysql-yseslc-mysql-1 `kubectl get secrets -l app.kubernetes.io/instance=mysql-yseslc` set secret: mysql-yseslc-mysql-account-root `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:94J7Xw74tE;DB_PORT:3306;DB_DATABASE:mysql check cluster connect `echo " echo \"SHOW SLAVE STATUS\G;\" | mysql -P3306 -h127.0.0.1 -uroot -p'94J7Xw74tE' " | kubectl exec -it mysql-yseslc-mysql-1 --namespace ns-kcduy -- bash ` check cluster connect done `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge NetworkChaos test-chaos-mesh-networklossover-mysql-yseslc --namespace ns-kcduy ` Warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely. networkchaos.chaos-mesh.org "test-chaos-mesh-networklossover-mysql-yseslc" force deleted networkchaos.chaos-mesh.org/test-chaos-mesh-networklossover-mysql-yseslc patched check failover pod name failover pod name:mysql-yseslc-mysql-0 failover networklossover Success `kubectl get secrets -l app.kubernetes.io/instance=mysql-yseslc` set secret: mysql-yseslc-mysql-account-root `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:94J7Xw74tE;DB_PORT:3306;DB_DATABASE:mysql check db_client batch data count `echo "echo \"select count(*) from executions_loop.executions_loop_table;\" | mysql -P3306 -hmysql-yseslc-mysql.ns-kcduy.svc.cluster.local -uroot -p'94J7Xw74tE' " | kubectl exec -it mysql-yseslc-mysql-0 --namespace ns-kcduy -- bash ` check db_client batch data Success `kubectl get secrets -l app.kubernetes.io/instance=mysql-yseslc` set secret: mysql-yseslc-mysql-account-root `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:94J7Xw74tE;DB_PORT:3306;DB_DATABASE:mysql check readonly db_client batch data count `echo "echo \"select count(*) from executions_loop.executions_loop_table;\" | mysql -P3306 -h127.0.0.1 -uroot -p'94J7Xw74tE' " | kubectl exec -it mysql-yseslc-mysql-1 --namespace ns-kcduy -- bash ` check readonly db_client batch data Success test failover oom check cluster status before cluster-failover-oom check cluster status done cluster_status:Running `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge StressChaos test-chaos-mesh-oom-mysql-yseslc --namespace ns-kcduy ` Warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely. Error from server (NotFound): stresschaos.chaos-mesh.org "test-chaos-mesh-oom-mysql-yseslc" not found Error from server (NotFound): stresschaos.chaos-mesh.org "test-chaos-mesh-oom-mysql-yseslc" not found apiVersion: chaos-mesh.org/v1alpha1 kind: StressChaos metadata: name: test-chaos-mesh-oom-mysql-yseslc namespace: ns-kcduy spec: selector: namespaces: - ns-kcduy labelSelectors: apps.kubeblocks.io/pod-name: mysql-yseslc-mysql-0 mode: all stressors: memory: workers: 1 size: "100GB" oomScoreAdj: -1000 duration: 2m `kubectl apply -f test-chaos-mesh-oom-mysql-yseslc.yaml` stresschaos.chaos-mesh.org/test-chaos-mesh-oom-mysql-yseslc created apply test-chaos-mesh-oom-mysql-yseslc.yaml Success `rm -rf test-chaos-mesh-oom-mysql-yseslc.yaml` check cluster status `kbcli cluster list mysql-yseslc --show-labels --namespace ns-kcduy ` NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS mysql-yseslc ns-kcduy mysql DoNotTerminate Running Sep 11,2025 20:24 UTC+0800 app.kubernetes.io/instance=mysql-yseslc,clusterdefinition.kubeblocks.io/name=mysql check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances mysql-yseslc --namespace ns-kcduy ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME mysql-yseslc-mysql-0 ns-kcduy mysql-yseslc mysql Running secondary 0 200m / 200m 644245094400m / 644245094400m data:11Gi aks-cicdamdpool-42425418-vmss000000/10.224.0.9 Sep 11,2025 21:20 UTC+0800 mysql-yseslc-mysql-1 ns-kcduy mysql-yseslc mysql Running primary 0 200m / 200m 644245094400m / 644245094400m data:11Gi aks-cicdamdpool-42425418-vmss000002/10.224.0.7 Sep 11,2025 21:20 UTC+0800 mysql-yseslc-proxysql-0 ns-kcduy mysql-yseslc proxysql Running 0 100m / 100m 512Mi / 512Mi aks-cicdamdpool-42425418-vmss000002/10.224.0.7 Sep 11,2025 21:21 UTC+0800 check pod status done check cluster role check cluster role done primary: mysql-yseslc-mysql-1;secondary: mysql-yseslc-mysql-0 `kubectl get secrets -l app.kubernetes.io/instance=mysql-yseslc` set secret: mysql-yseslc-mysql-account-root `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:94J7Xw74tE;DB_PORT:3306;DB_DATABASE:mysql check cluster connect `echo " echo \"SHOW SLAVE STATUS\G;\" | mysql -P3306 -h127.0.0.1 -uroot -p'94J7Xw74tE' " | kubectl exec -it mysql-yseslc-mysql-0 --namespace ns-kcduy -- bash ` connect checking... check cluster connect done `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge StressChaos test-chaos-mesh-oom-mysql-yseslc --namespace ns-kcduy ` Warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely. stresschaos.chaos-mesh.org "test-chaos-mesh-oom-mysql-yseslc" force deleted stresschaos.chaos-mesh.org/test-chaos-mesh-oom-mysql-yseslc patched check failover pod name failover pod name:mysql-yseslc-mysql-1 failover oom Success `kubectl get secrets -l app.kubernetes.io/instance=mysql-yseslc` set secret: mysql-yseslc-mysql-account-root `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:94J7Xw74tE;DB_PORT:3306;DB_DATABASE:mysql check db_client batch data count `echo "echo \"select count(*) from executions_loop.executions_loop_table;\" | mysql -P3306 -hmysql-yseslc-mysql.ns-kcduy.svc.cluster.local -uroot -p'94J7Xw74tE' " | kubectl exec -it mysql-yseslc-mysql-1 --namespace ns-kcduy -- bash ` check db_client batch data Success `kubectl get secrets -l app.kubernetes.io/instance=mysql-yseslc` set secret: mysql-yseslc-mysql-account-root `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:94J7Xw74tE;DB_PORT:3306;DB_DATABASE:mysql check readonly db_client batch data count `echo "echo \"select count(*) from executions_loop.executions_loop_table;\" | mysql -P3306 -h127.0.0.1 -uroot -p'94J7Xw74tE' " | kubectl exec -it mysql-yseslc-mysql-0 --namespace ns-kcduy -- bash ` check readonly db_client batch data Success test failover podkill check cluster status before cluster-failover-podkill check cluster status done cluster_status:Running `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge PodChaos test-chaos-mesh-podkill-mysql-yseslc --namespace ns-kcduy ` Warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely. Error from server (NotFound): podchaos.chaos-mesh.org "test-chaos-mesh-podkill-mysql-yseslc" not found Error from server (NotFound): podchaos.chaos-mesh.org "test-chaos-mesh-podkill-mysql-yseslc" not found apiVersion: chaos-mesh.org/v1alpha1 kind: PodChaos metadata: name: test-chaos-mesh-podkill-mysql-yseslc namespace: ns-kcduy spec: selector: namespaces: - ns-kcduy labelSelectors: apps.kubeblocks.io/pod-name: mysql-yseslc-mysql-1 mode: all action: pod-kill `kubectl apply -f test-chaos-mesh-podkill-mysql-yseslc.yaml` podchaos.chaos-mesh.org/test-chaos-mesh-podkill-mysql-yseslc created apply test-chaos-mesh-podkill-mysql-yseslc.yaml Success `rm -rf test-chaos-mesh-podkill-mysql-yseslc.yaml` check cluster status `kbcli cluster list mysql-yseslc --show-labels --namespace ns-kcduy ` NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS mysql-yseslc ns-kcduy mysql DoNotTerminate Updating Sep 11,2025 20:24 UTC+0800 app.kubernetes.io/instance=mysql-yseslc,clusterdefinition.kubeblocks.io/name=mysql cluster_status:Updating check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances mysql-yseslc --namespace ns-kcduy ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME mysql-yseslc-mysql-0 ns-kcduy mysql-yseslc mysql Running primary 0 200m / 200m 644245094400m / 644245094400m data:11Gi aks-cicdamdpool-42425418-vmss000000/10.224.0.9 Sep 11,2025 21:20 UTC+0800 mysql-yseslc-mysql-1 ns-kcduy mysql-yseslc mysql Running secondary 0 200m / 200m 644245094400m / 644245094400m data:11Gi aks-cicdamdpool-42425418-vmss000002/10.224.0.7 Sep 11,2025 21:31 UTC+0800 mysql-yseslc-proxysql-0 ns-kcduy mysql-yseslc proxysql Running 0 100m / 100m 512Mi / 512Mi aks-cicdamdpool-42425418-vmss000002/10.224.0.7 Sep 11,2025 21:21 UTC+0800 check pod status done check cluster role check cluster role done primary: mysql-yseslc-mysql-0;secondary: mysql-yseslc-mysql-1 `kubectl get secrets -l app.kubernetes.io/instance=mysql-yseslc` set secret: mysql-yseslc-mysql-account-root `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:94J7Xw74tE;DB_PORT:3306;DB_DATABASE:mysql check cluster connect `echo " echo \"SHOW SLAVE STATUS\G;\" | mysql -P3306 -h127.0.0.1 -uroot -p'94J7Xw74tE' " | kubectl exec -it mysql-yseslc-mysql-1 --namespace ns-kcduy -- bash ` check cluster connect done `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge PodChaos test-chaos-mesh-podkill-mysql-yseslc --namespace ns-kcduy ` Warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely. podchaos.chaos-mesh.org "test-chaos-mesh-podkill-mysql-yseslc" force deleted podchaos.chaos-mesh.org/test-chaos-mesh-podkill-mysql-yseslc patched check failover pod name failover pod name:mysql-yseslc-mysql-0 failover podkill Success `kubectl get secrets -l app.kubernetes.io/instance=mysql-yseslc` set secret: mysql-yseslc-mysql-account-root `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:94J7Xw74tE;DB_PORT:3306;DB_DATABASE:mysql check db_client batch data count `echo "echo \"select count(*) from executions_loop.executions_loop_table;\" | mysql -P3306 -hmysql-yseslc-mysql.ns-kcduy.svc.cluster.local -uroot -p'94J7Xw74tE' " | kubectl exec -it mysql-yseslc-mysql-0 --namespace ns-kcduy -- bash ` check db_client batch data Success `kubectl get secrets -l app.kubernetes.io/instance=mysql-yseslc` set secret: mysql-yseslc-mysql-account-root `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:94J7Xw74tE;DB_PORT:3306;DB_DATABASE:mysql check readonly db_client batch data count `echo "echo \"select count(*) from executions_loop.executions_loop_table;\" | mysql -P3306 -h127.0.0.1 -uroot -p'94J7Xw74tE' " | kubectl exec -it mysql-yseslc-mysql-1 --namespace ns-kcduy -- bash ` check readonly db_client batch data Success test failover networkbandwidthover check cluster status before cluster-failover-networkbandwidthover check cluster status done cluster_status:Running `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge NetworkChaos test-chaos-mesh-networkbandwidthover-mysql-yseslc --namespace ns-kcduy ` Warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely. Error from server (NotFound): networkchaos.chaos-mesh.org "test-chaos-mesh-networkbandwidthover-mysql-yseslc" not found Error from server (NotFound): networkchaos.chaos-mesh.org "test-chaos-mesh-networkbandwidthover-mysql-yseslc" not found apiVersion: chaos-mesh.org/v1alpha1 kind: NetworkChaos metadata: name: test-chaos-mesh-networkbandwidthover-mysql-yseslc namespace: ns-kcduy spec: selector: namespaces: - ns-kcduy labelSelectors: apps.kubeblocks.io/pod-name: mysql-yseslc-mysql-0 action: bandwidth mode: all bandwidth: rate: '1bps' limit: 20971520 buffer: 10000 duration: 2m `kubectl apply -f test-chaos-mesh-networkbandwidthover-mysql-yseslc.yaml` networkchaos.chaos-mesh.org/test-chaos-mesh-networkbandwidthover-mysql-yseslc created apply test-chaos-mesh-networkbandwidthover-mysql-yseslc.yaml Success `rm -rf test-chaos-mesh-networkbandwidthover-mysql-yseslc.yaml` networkbandwidthover chaos test waiting 120 seconds check cluster status `kbcli cluster list mysql-yseslc --show-labels --namespace ns-kcduy ` NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS mysql-yseslc ns-kcduy mysql DoNotTerminate Running Sep 11,2025 20:24 UTC+0800 app.kubernetes.io/instance=mysql-yseslc,clusterdefinition.kubeblocks.io/name=mysql check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances mysql-yseslc --namespace ns-kcduy ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME mysql-yseslc-mysql-0 ns-kcduy mysql-yseslc mysql Running primary 0 200m / 200m 644245094400m / 644245094400m data:11Gi aks-cicdamdpool-42425418-vmss000000/10.224.0.9 Sep 11,2025 21:20 UTC+0800 mysql-yseslc-mysql-1 ns-kcduy mysql-yseslc mysql Running primary 0 200m / 200m 644245094400m / 644245094400m data:11Gi aks-cicdamdpool-42425418-vmss000002/10.224.0.7 Sep 11,2025 21:31 UTC+0800 mysql-yseslc-proxysql-0 ns-kcduy mysql-yseslc proxysql Running 0 100m / 100m 512Mi / 512Mi aks-cicdamdpool-42425418-vmss000002/10.224.0.7 Sep 11,2025 21:21 UTC+0800 check pod status done check cluster role primary: mysql-yseslc-mysql-0 mysql-yseslc-mysql-1;secondary: mysql-yseslc-mysql-0 check cluster role done primary: mysql-yseslc-mysql-1;secondary: mysql-yseslc-mysql-0 `kubectl get secrets -l app.kubernetes.io/instance=mysql-yseslc` set secret: mysql-yseslc-mysql-account-root `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:94J7Xw74tE;DB_PORT:3306;DB_DATABASE:mysql check cluster connect `echo " echo \"SHOW SLAVE STATUS\G;\" | mysql -P3306 -h127.0.0.1 -uroot -p'94J7Xw74tE' " | kubectl exec -it mysql-yseslc-mysql-0 --namespace ns-kcduy -- bash ` check cluster connect done `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge NetworkChaos test-chaos-mesh-networkbandwidthover-mysql-yseslc --namespace ns-kcduy ` Warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely. networkchaos.chaos-mesh.org "test-chaos-mesh-networkbandwidthover-mysql-yseslc" force deleted networkchaos.chaos-mesh.org/test-chaos-mesh-networkbandwidthover-mysql-yseslc patched check failover pod name failover pod name:mysql-yseslc-mysql-1 failover networkbandwidthover Success `kubectl get secrets -l app.kubernetes.io/instance=mysql-yseslc` set secret: mysql-yseslc-mysql-account-root `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:94J7Xw74tE;DB_PORT:3306;DB_DATABASE:mysql check db_client batch data count `echo "echo \"select count(*) from executions_loop.executions_loop_table;\" | mysql -P3306 -hmysql-yseslc-mysql.ns-kcduy.svc.cluster.local -uroot -p'94J7Xw74tE' " | kubectl exec -it mysql-yseslc-mysql-1 --namespace ns-kcduy -- bash ` check db_client batch data Success `kubectl get secrets -l app.kubernetes.io/instance=mysql-yseslc` set secret: mysql-yseslc-mysql-account-root `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:94J7Xw74tE;DB_PORT:3306;DB_DATABASE:mysql check readonly db_client batch data count `echo "echo \"select count(*) from executions_loop.executions_loop_table;\" | mysql -P3306 -h127.0.0.1 -uroot -p'94J7Xw74tE' " | kubectl exec -it mysql-yseslc-mysql-0 --namespace ns-kcduy -- bash ` check readonly db_client batch data Success cluster mysql scale-out cluster mysql scale-out replicas: 3 check cluster status before ops check cluster status done cluster_status:Running No resources found in mysql-yseslc namespace. `kbcli cluster scale-out mysql-yseslc --auto-approve --force=true --components mysql --replicas 1 --namespace ns-kcduy ` OpsRequest mysql-yseslc-horizontalscaling-2nzn5 created successfully, you can view the progress: kbcli cluster describe-ops mysql-yseslc-horizontalscaling-2nzn5 -n ns-kcduy check ops status `kbcli cluster list-ops mysql-yseslc --status all --namespace ns-kcduy ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME mysql-yseslc-switchover-4bfkr ns-kcduy Switchover mysql-yseslc mysql Succeed 1/1 Sep 11,2025 20:34 UTC+0800 mysql-yseslc-horizontalscaling-2nzn5 ns-kcduy HorizontalScaling mysql-yseslc mysql Running 0/1 Sep 11,2025 21:33 UTC+0800 check cluster status `kbcli cluster list mysql-yseslc --show-labels --namespace ns-kcduy ` NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS mysql-yseslc ns-kcduy mysql DoNotTerminate Updating Sep 11,2025 20:24 UTC+0800 app.kubernetes.io/instance=mysql-yseslc,clusterdefinition.kubeblocks.io/name=mysql cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances mysql-yseslc --namespace ns-kcduy ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME mysql-yseslc-mysql-0 ns-kcduy mysql-yseslc mysql Running secondary 0 200m / 200m 644245094400m / 644245094400m data:11Gi aks-cicdamdpool-42425418-vmss000000/10.224.0.9 Sep 11,2025 21:20 UTC+0800 mysql-yseslc-mysql-1 ns-kcduy mysql-yseslc mysql Running primary 0 200m / 200m 644245094400m / 644245094400m data:11Gi aks-cicdamdpool-42425418-vmss000002/10.224.0.7 Sep 11,2025 21:31 UTC+0800 mysql-yseslc-mysql-2 ns-kcduy mysql-yseslc mysql Running secondary 0 200m / 200m 644245094400m / 644245094400m data:11Gi aks-cicdamdpool-42425418-vmss000001/10.224.0.5 Sep 11,2025 21:33 UTC+0800 mysql-yseslc-proxysql-0 ns-kcduy mysql-yseslc proxysql Running 0 100m / 100m 512Mi / 512Mi aks-cicdamdpool-42425418-vmss000002/10.224.0.7 Sep 11,2025 21:34 UTC+0800 check pod status done check cluster role check cluster role done primary: mysql-yseslc-mysql-1;secondary: mysql-yseslc-mysql-0 mysql-yseslc-mysql-2 `kubectl get secrets -l app.kubernetes.io/instance=mysql-yseslc` set secret: mysql-yseslc-mysql-account-root `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:94J7Xw74tE;DB_PORT:3306;DB_DATABASE:mysql check cluster connect `echo " echo \"SHOW SLAVE STATUS\G;\" | mysql -P3306 -h127.0.0.1 -uroot -p'94J7Xw74tE' " | kubectl exec -it mysql-yseslc-mysql-0 --namespace ns-kcduy -- bash ` check cluster connect done No resources found in mysql-yseslc namespace. check ops status `kbcli cluster list-ops mysql-yseslc --status all --namespace ns-kcduy ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME mysql-yseslc-switchover-4bfkr ns-kcduy Switchover mysql-yseslc mysql Succeed 1/1 Sep 11,2025 20:34 UTC+0800 mysql-yseslc-horizontalscaling-2nzn5 ns-kcduy HorizontalScaling mysql-yseslc mysql Succeed 1/1 Sep 11,2025 21:33 UTC+0800 check ops status done ops_status:mysql-yseslc-horizontalscaling-2nzn5 ns-kcduy HorizontalScaling mysql-yseslc mysql Succeed 1/1 Sep 11,2025 21:33 UTC+0800 `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge opsrequests.operations mysql-yseslc-horizontalscaling-2nzn5 --namespace ns-kcduy ` opsrequest.operations.kubeblocks.io/mysql-yseslc-horizontalscaling-2nzn5 patched `kbcli cluster delete-ops --name mysql-yseslc-horizontalscaling-2nzn5 --force --auto-approve --namespace ns-kcduy ` OpsRequest mysql-yseslc-horizontalscaling-2nzn5 deleted `kubectl get secrets -l app.kubernetes.io/instance=mysql-yseslc` set secret: mysql-yseslc-mysql-account-root `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:94J7Xw74tE;DB_PORT:3306;DB_DATABASE:mysql check db_client batch data count `echo "echo \"select count(*) from executions_loop.executions_loop_table;\" | mysql -P3306 -hmysql-yseslc-mysql.ns-kcduy.svc.cluster.local -uroot -p'94J7Xw74tE' " | kubectl exec -it mysql-yseslc-mysql-1 --namespace ns-kcduy -- bash ` check db_client batch data Success `kubectl get secrets -l app.kubernetes.io/instance=mysql-yseslc` set secret: mysql-yseslc-mysql-account-root `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:94J7Xw74tE;DB_PORT:3306;DB_DATABASE:mysql check readonly db_client batch data count `echo "echo \"select count(*) from executions_loop.executions_loop_table;\" | mysql -P3306 -h127.0.0.1 -uroot -p'94J7Xw74tE' " | kubectl exec -it mysql-yseslc-mysql-0 --namespace ns-kcduy -- bash ` check readonly db_client batch data Success cluster mysql scale-in cluster mysql scale-in replicas: 2 check cluster status before ops check cluster status done cluster_status:Running No resources found in mysql-yseslc namespace. `kbcli cluster scale-in mysql-yseslc --auto-approve --force=true --components mysql --replicas 1 --namespace ns-kcduy ` OpsRequest mysql-yseslc-horizontalscaling-hdw9z created successfully, you can view the progress: kbcli cluster describe-ops mysql-yseslc-horizontalscaling-hdw9z -n ns-kcduy check ops status `kbcli cluster list-ops mysql-yseslc --status all --namespace ns-kcduy ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME mysql-yseslc-switchover-4bfkr ns-kcduy Switchover mysql-yseslc mysql Succeed 1/1 Sep 11,2025 20:34 UTC+0800 mysql-yseslc-horizontalscaling-hdw9z ns-kcduy HorizontalScaling mysql-yseslc mysql Running -/- Sep 11,2025 21:34 UTC+0800 check cluster status `kbcli cluster list mysql-yseslc --show-labels --namespace ns-kcduy ` NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS mysql-yseslc ns-kcduy mysql DoNotTerminate Updating Sep 11,2025 20:24 UTC+0800 app.kubernetes.io/instance=mysql-yseslc,clusterdefinition.kubeblocks.io/name=mysql cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances mysql-yseslc --namespace ns-kcduy ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME mysql-yseslc-mysql-0 ns-kcduy mysql-yseslc mysql Running secondary 0 200m / 200m 644245094400m / 644245094400m data:11Gi aks-cicdamdpool-42425418-vmss000000/10.224.0.9 Sep 11,2025 21:20 UTC+0800 mysql-yseslc-mysql-1 ns-kcduy mysql-yseslc mysql Running primary 0 200m / 200m 644245094400m / 644245094400m data:11Gi aks-cicdamdpool-42425418-vmss000002/10.224.0.7 Sep 11,2025 21:31 UTC+0800 mysql-yseslc-proxysql-0 ns-kcduy mysql-yseslc proxysql Running 0 100m / 100m 512Mi / 512Mi aks-cicdamdpool-42425418-vmss000001/10.224.0.5 Sep 11,2025 21:35 UTC+0800 check pod status done check cluster role check cluster role done primary: mysql-yseslc-mysql-1;secondary: mysql-yseslc-mysql-0 `kubectl get secrets -l app.kubernetes.io/instance=mysql-yseslc` set secret: mysql-yseslc-mysql-account-root `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:94J7Xw74tE;DB_PORT:3306;DB_DATABASE:mysql check cluster connect `echo " echo \"SHOW SLAVE STATUS\G;\" | mysql -P3306 -h127.0.0.1 -uroot -p'94J7Xw74tE' " | kubectl exec -it mysql-yseslc-mysql-0 --namespace ns-kcduy -- bash ` check cluster connect done No resources found in mysql-yseslc namespace. check ops status `kbcli cluster list-ops mysql-yseslc --status all --namespace ns-kcduy ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME mysql-yseslc-switchover-4bfkr ns-kcduy Switchover mysql-yseslc mysql Succeed 1/1 Sep 11,2025 20:34 UTC+0800 mysql-yseslc-horizontalscaling-hdw9z ns-kcduy HorizontalScaling mysql-yseslc mysql Succeed 1/1 Sep 11,2025 21:34 UTC+0800 check ops status done ops_status:mysql-yseslc-horizontalscaling-hdw9z ns-kcduy HorizontalScaling mysql-yseslc mysql Succeed 1/1 Sep 11,2025 21:34 UTC+0800 `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge opsrequests.operations mysql-yseslc-horizontalscaling-hdw9z --namespace ns-kcduy ` opsrequest.operations.kubeblocks.io/mysql-yseslc-horizontalscaling-hdw9z patched `kbcli cluster delete-ops --name mysql-yseslc-horizontalscaling-hdw9z --force --auto-approve --namespace ns-kcduy ` OpsRequest mysql-yseslc-horizontalscaling-hdw9z deleted `kubectl get secrets -l app.kubernetes.io/instance=mysql-yseslc` set secret: mysql-yseslc-mysql-account-root `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:94J7Xw74tE;DB_PORT:3306;DB_DATABASE:mysql check db_client batch data count `echo "echo \"select count(*) from executions_loop.executions_loop_table;\" | mysql -P3306 -hmysql-yseslc-mysql.ns-kcduy.svc.cluster.local -uroot -p'94J7Xw74tE' " | kubectl exec -it mysql-yseslc-mysql-1 --namespace ns-kcduy -- bash ` check db_client batch data Success `kubectl get secrets -l app.kubernetes.io/instance=mysql-yseslc` set secret: mysql-yseslc-mysql-account-root `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:94J7Xw74tE;DB_PORT:3306;DB_DATABASE:mysql check readonly db_client batch data count `echo "echo \"select count(*) from executions_loop.executions_loop_table;\" | mysql -P3306 -h127.0.0.1 -uroot -p'94J7Xw74tE' " | kubectl exec -it mysql-yseslc-mysql-0 --namespace ns-kcduy -- bash ` check readonly db_client batch data Success test failover timeoffset check cluster status before cluster-failover-timeoffset check cluster status done cluster_status:Running `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge TimeChaos test-chaos-mesh-timeoffset-mysql-yseslc --namespace ns-kcduy ` Warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely. Error from server (NotFound): timechaos.chaos-mesh.org "test-chaos-mesh-timeoffset-mysql-yseslc" not found Error from server (NotFound): timechaos.chaos-mesh.org "test-chaos-mesh-timeoffset-mysql-yseslc" not found apiVersion: chaos-mesh.org/v1alpha1 kind: TimeChaos metadata: name: test-chaos-mesh-timeoffset-mysql-yseslc namespace: ns-kcduy spec: selector: namespaces: - ns-kcduy labelSelectors: apps.kubeblocks.io/pod-name: mysql-yseslc-mysql-1 mode: all timeOffset: '-10m' clockIds: - CLOCK_REALTIME duration: 2m `kubectl apply -f test-chaos-mesh-timeoffset-mysql-yseslc.yaml` timechaos.chaos-mesh.org/test-chaos-mesh-timeoffset-mysql-yseslc created apply test-chaos-mesh-timeoffset-mysql-yseslc.yaml Success `rm -rf test-chaos-mesh-timeoffset-mysql-yseslc.yaml` timeoffset chaos test waiting 120 seconds check cluster status `kbcli cluster list mysql-yseslc --show-labels --namespace ns-kcduy ` NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS mysql-yseslc ns-kcduy mysql DoNotTerminate Running Sep 11,2025 20:24 UTC+0800 app.kubernetes.io/instance=mysql-yseslc,clusterdefinition.kubeblocks.io/name=mysql check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances mysql-yseslc --namespace ns-kcduy ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME mysql-yseslc-mysql-0 ns-kcduy mysql-yseslc mysql Running secondary 0 200m / 200m 644245094400m / 644245094400m data:11Gi aks-cicdamdpool-42425418-vmss000000/10.224.0.9 Sep 11,2025 21:20 UTC+0800 mysql-yseslc-mysql-1 ns-kcduy mysql-yseslc mysql Running primary 0 200m / 200m 644245094400m / 644245094400m data:11Gi aks-cicdamdpool-42425418-vmss000002/10.224.0.7 Sep 11,2025 21:31 UTC+0800 mysql-yseslc-proxysql-0 ns-kcduy mysql-yseslc proxysql Running 0 100m / 100m 512Mi / 512Mi aks-cicdamdpool-42425418-vmss000001/10.224.0.5 Sep 11,2025 21:35 UTC+0800 check pod status done check cluster role check cluster role done primary: mysql-yseslc-mysql-1;secondary: mysql-yseslc-mysql-0 `kubectl get secrets -l app.kubernetes.io/instance=mysql-yseslc` set secret: mysql-yseslc-mysql-account-root `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:94J7Xw74tE;DB_PORT:3306;DB_DATABASE:mysql check cluster connect `echo " echo \"SHOW SLAVE STATUS\G;\" | mysql -P3306 -h127.0.0.1 -uroot -p'94J7Xw74tE' " | kubectl exec -it mysql-yseslc-mysql-0 --namespace ns-kcduy -- bash ` check cluster connect done `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge TimeChaos test-chaos-mesh-timeoffset-mysql-yseslc --namespace ns-kcduy ` Warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely. timechaos.chaos-mesh.org "test-chaos-mesh-timeoffset-mysql-yseslc" force deleted Error from server (NotFound): timechaos.chaos-mesh.org "test-chaos-mesh-timeoffset-mysql-yseslc" not found check failover pod name failover pod name:mysql-yseslc-mysql-1 failover timeoffset Success `kubectl get secrets -l app.kubernetes.io/instance=mysql-yseslc` set secret: mysql-yseslc-mysql-account-root `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:94J7Xw74tE;DB_PORT:3306;DB_DATABASE:mysql check db_client batch data count `echo "echo \"select count(*) from executions_loop.executions_loop_table;\" | mysql -P3306 -hmysql-yseslc-mysql.ns-kcduy.svc.cluster.local -uroot -p'94J7Xw74tE' " | kubectl exec -it mysql-yseslc-mysql-1 --namespace ns-kcduy -- bash ` check db_client batch data Success `kubectl get secrets -l app.kubernetes.io/instance=mysql-yseslc` set secret: mysql-yseslc-mysql-account-root `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:94J7Xw74tE;DB_PORT:3306;DB_DATABASE:mysql check readonly db_client batch data count `echo "echo \"select count(*) from executions_loop.executions_loop_table;\" | mysql -P3306 -h127.0.0.1 -uroot -p'94J7Xw74tE' " | kubectl exec -it mysql-yseslc-mysql-0 --namespace ns-kcduy -- bash ` check readonly db_client batch data Success cluster update terminationPolicy WipeOut `kbcli cluster update mysql-yseslc --termination-policy=WipeOut --namespace ns-kcduy ` cluster.apps.kubeblocks.io/mysql-yseslc updated check cluster status `kbcli cluster list mysql-yseslc --show-labels --namespace ns-kcduy ` NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS mysql-yseslc ns-kcduy mysql WipeOut Running Sep 11,2025 20:24 UTC+0800 app.kubernetes.io/instance=mysql-yseslc,clusterdefinition.kubeblocks.io/name=mysql check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances mysql-yseslc --namespace ns-kcduy ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME mysql-yseslc-mysql-0 ns-kcduy mysql-yseslc mysql Running secondary 0 200m / 200m 644245094400m / 644245094400m data:11Gi aks-cicdamdpool-42425418-vmss000000/10.224.0.9 Sep 11,2025 21:20 UTC+0800 mysql-yseslc-mysql-1 ns-kcduy mysql-yseslc mysql Running primary 0 200m / 200m 644245094400m / 644245094400m data:11Gi aks-cicdamdpool-42425418-vmss000002/10.224.0.7 Sep 11,2025 21:31 UTC+0800 mysql-yseslc-proxysql-0 ns-kcduy mysql-yseslc proxysql Running 0 100m / 100m 512Mi / 512Mi aks-cicdamdpool-42425418-vmss000001/10.224.0.5 Sep 11,2025 21:35 UTC+0800 check pod status done check cluster role check cluster role done primary: mysql-yseslc-mysql-1;secondary: mysql-yseslc-mysql-0 `kubectl get secrets -l app.kubernetes.io/instance=mysql-yseslc` set secret: mysql-yseslc-mysql-account-root `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:94J7Xw74tE;DB_PORT:3306;DB_DATABASE:mysql check cluster connect `echo " echo \"SHOW SLAVE STATUS\G;\" | mysql -P3306 -h127.0.0.1 -uroot -p'94J7Xw74tE' " | kubectl exec -it mysql-yseslc-mysql-0 --namespace ns-kcduy -- bash ` check cluster connect done `kubectl get backupschedule -l app.kubernetes.io/instance=mysql-yseslc ` `kubectl get backupschedule mysql-yseslc-mysql-backup-schedule -ojsonpath='***.spec.schedules[*].backupMethod***' ` backupschedule.dataprotection.kubeblocks.io/mysql-yseslc-mysql-backup-schedule patched backupschedule.dataprotection.kubeblocks.io/mysql-yseslc-mysql-backup-schedule patched check backup status `kbcli cluster list-backups mysql-yseslc --namespace ns-kcduy ` No backups found in ns-kcduy namespace. No backups found in ns-kcduy namespace. backup_status:-- No backups found in ns-kcduy namespace. backup_status:-- No backups found in ns-kcduy namespace. backup_status:-- No backups found in ns-kcduy namespace. backup_status:-- No backups found in ns-kcduy namespace. backup_status:-- `kubectl get backupschedule -l app.kubernetes.io/instance=mysql-yseslc ` `kubectl get backupschedule mysql-yseslc-mysql-backup-schedule -ojsonpath='***.spec.schedules[*].backupMethod***' ` backupschedule.dataprotection.kubeblocks.io/mysql-yseslc-mysql-backup-schedule patched backupschedule.dataprotection.kubeblocks.io/mysql-yseslc-mysql-backup-schedule patched backupschedule.dataprotection.kubeblocks.io/mysql-yseslc-mysql-backup-schedule patched backupschedule.dataprotection.kubeblocks.io/mysql-yseslc-mysql-backup-schedule patched (no change) backupschedule.dataprotection.kubeblocks.io/mysql-yseslc-mysql-backup-schedule patched backupschedule.dataprotection.kubeblocks.io/mysql-yseslc-mysql-backup-schedule patched (no change) backupschedule.dataprotection.kubeblocks.io/mysql-yseslc-mysql-backup-schedule patched backupschedule.dataprotection.kubeblocks.io/mysql-yseslc-mysql-backup-schedule patched (no change) backup_status:mysql-yseslc-xtrabackup-Running backup_status:mysql-yseslc-xtrabackup-Running backup_status:mysql-yseslc-xtrabackup-Running backup_status:mysql-yseslc-xtrabackup-Running check backup status done backup_status:mysql-yseslc-xtrabackup-20250911133800 ns-kcduy mysql-yseslc xtrabackup Completed 8101719 22s Delete Sep 11,2025 21:38 UTC+0800 Sep 11,2025 21:38 UTC+0800 Sep 19,2025 21:38 UTC+0800 `kubectl get backupschedule -l app.kubernetes.io/instance=mysql-yseslc ` `kubectl get backupschedule mysql-yseslc-mysql-backup-schedule -ojsonpath='***.spec.schedules[*].backupMethod***' ` backupschedule.dataprotection.kubeblocks.io/mysql-yseslc-mysql-backup-schedule patched (no change) backupschedule.dataprotection.kubeblocks.io/mysql-yseslc-mysql-backup-schedule patched (no change) backupschedule.dataprotection.kubeblocks.io/mysql-yseslc-mysql-backup-schedule patched (no change) backupschedule.dataprotection.kubeblocks.io/mysql-yseslc-mysql-backup-schedule patched (no change) backupschedule.dataprotection.kubeblocks.io/mysql-yseslc-mysql-backup-schedule patched (no change) backupschedule.dataprotection.kubeblocks.io/mysql-yseslc-mysql-backup-schedule patched (no change) backupschedule.dataprotection.kubeblocks.io/mysql-yseslc-mysql-backup-schedule patched (no change) backupschedule.dataprotection.kubeblocks.io/mysql-yseslc-mysql-backup-schedule patched (no change) cluster restore backup Error from server (NotFound): opsrequests.operations.kubeblocks.io "abk-yseslc" not found `kbcli cluster describe-backup --names mysql-yseslc-xtrabackup-20250911133800 --namespace ns-kcduy ` Name: mysql-yseslc-xtrabackup-20250911133800 Cluster: mysql-yseslc Namespace: ns-kcduy Spec: Method: xtrabackup Policy Name: mysql-yseslc-mysql-backup-policy Actions: dp-backup-0: ActionType: Job WorkloadName: dp-backup-0-mysql-yseslc-xtrabackup-20250911133800-ebac0f49 TargetPodName: mysql-yseslc-mysql-0 Phase: Completed Start Time: Sep 11,2025 21:38 UTC+0800 Completion Time: Sep 11,2025 21:38 UTC+0800 Status: Phase: Completed Total Size: 8101719 ActionSet Name: mysql-xtrabackup-br Repository: backuprepo-kbcli-test Duration: 22s Expiration Time: Sep 19,2025 21:38 UTC+0800 Start Time: Sep 11,2025 21:38 UTC+0800 Completion Time: Sep 11,2025 21:38 UTC+0800 Path: /ns-kcduy/mysql-yseslc-f366666b-b432-4de0-b2b6-426248bba9a5/mysql/mysql-yseslc-xtrabackup-20250911133800 Warning Events: `kbcli cluster restore abk-yseslc --backup mysql-yseslc-xtrabackup-20250911133800 --namespace ns-kcduy ` Cluster abk-yseslc created check cluster status `kbcli cluster list abk-yseslc --show-labels --namespace ns-kcduy ` NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS abk-yseslc ns-kcduy mysql WipeOut Creating Sep 11,2025 21:38 UTC+0800 clusterdefinition.kubeblocks.io/name=mysql cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances abk-yseslc --namespace ns-kcduy ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME abk-yseslc-mysql-0 ns-kcduy abk-yseslc mysql Running primary 0 200m / 200m 644245094400m / 644245094400m data:11Gi aks-cicdamdpool-42425418-vmss000001/10.224.0.5 Sep 11,2025 21:38 UTC+0800 abk-yseslc-mysql-1 ns-kcduy abk-yseslc mysql Running secondary 0 200m / 200m 644245094400m / 644245094400m data:11Gi aks-cicdamdpool-42425418-vmss000000/10.224.0.9 Sep 11,2025 21:39 UTC+0800 abk-yseslc-proxysql-0 ns-kcduy abk-yseslc proxysql Running 0 100m / 100m 512Mi / 512Mi aks-cicdamdpool-42425418-vmss000001/10.224.0.5 Sep 11,2025 21:40 UTC+0800 check pod status done check cluster role check cluster role done primary: abk-yseslc-mysql-0;secondary: abk-yseslc-mysql-1 `kubectl get secrets -l app.kubernetes.io/instance=abk-yseslc` set secret: abk-yseslc-mysql-account-root `kubectl get secrets abk-yseslc-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets abk-yseslc-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets abk-yseslc-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:94J7Xw74tE;DB_PORT:3306;DB_DATABASE:mysql check cluster connect `echo " echo \"SHOW SLAVE STATUS\G;\" | mysql -P3306 -h127.0.0.1 -uroot -p'94J7Xw74tE' " | kubectl exec -it abk-yseslc-mysql-1 --namespace ns-kcduy -- bash ` check cluster connect done `kbcli cluster describe-backup --names mysql-yseslc-xtrabackup-20250911133800 --namespace ns-kcduy ` Name: mysql-yseslc-xtrabackup-20250911133800 Cluster: mysql-yseslc Namespace: ns-kcduy Spec: Method: xtrabackup Policy Name: mysql-yseslc-mysql-backup-policy Actions: dp-backup-0: ActionType: Job WorkloadName: dp-backup-0-mysql-yseslc-xtrabackup-20250911133800-ebac0f49 TargetPodName: mysql-yseslc-mysql-0 Phase: Completed Start Time: Sep 11,2025 21:38 UTC+0800 Completion Time: Sep 11,2025 21:38 UTC+0800 Status: Phase: Completed Total Size: 8101719 ActionSet Name: mysql-xtrabackup-br Repository: backuprepo-kbcli-test Duration: 22s Expiration Time: Sep 19,2025 21:38 UTC+0800 Start Time: Sep 11,2025 21:38 UTC+0800 Completion Time: Sep 11,2025 21:38 UTC+0800 Path: /ns-kcduy/mysql-yseslc-f366666b-b432-4de0-b2b6-426248bba9a5/mysql/mysql-yseslc-xtrabackup-20250911133800 Warning Events: cluster connect `kubectl get secrets -l app.kubernetes.io/instance=abk-yseslc` set secret: abk-yseslc-mysql-account-root `kubectl get secrets abk-yseslc-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets abk-yseslc-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets abk-yseslc-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:94J7Xw74tE;DB_PORT:3306;DB_DATABASE:mysql Defaulted container "mysql" out of: mysql, mysql-exporter, kbagent, config-manager, init-data (init), init-xtrabackup (init), init-jemalloc (init), init-syncer (init), init-kbagent (init), kbagent-worker (init) Unable to use a TTY - input is not a terminal or the right kind of file Warning: arning] Using a password on the command line interface can be insecure. *************************** 1. row *************************** Slave_IO_State: Master_Host: mysql-yseslc-mysql-1.mysql-yseslc-mysql-headless Master_User: kbreplicator Master_Port: 3306 Connect_Retry: 60 Master_Log_File: mysql-yseslc-mysql-1-bin.000022 Read_Master_Log_Pos: 154846 Relay_Log_File: relay-bin.000001 Relay_Log_Pos: 4 Relay_Master_Log_File: mysql-yseslc-mysql-1-bin.000022 Slave_IO_Running: No Slave_SQL_Running: No Replicate_Do_DB: Replicate_Ignore_DB: Replicate_Do_Table: Replicate_Ignore_Table: Replicate_Wild_Do_Table: Replicate_Wild_Ignore_Table: Last_Errno: 0 Last_Error: Skip_Counter: 0 Exec_Master_Log_Pos: 154846 Relay_Log_Space: 157 Until_Condition: None Until_Log_File: Until_Log_Pos: 0 Master_SSL_Allowed: Yes Master_SSL_CA_File: Master_SSL_CA_Path: Master_SSL_Cert: Master_SSL_Cipher: Master_SSL_Key: Seconds_Behind_Master: NULL Master_SSL_Verify_Server_Cert: No Last_IO_Errno: 0 Last_IO_Error: Last_SQL_Errno: 0 Last_SQL_Error: Replicate_Ignore_Server_Ids: Master_Server_Id: 0 Master_UUID: f436c45e-8f0a-11f0-9fe6-4e2d0062ebce Master_Info_File: mysql.slave_master_info SQL_Delay: 0 SQL_Remaining_Delay: NULL Slave_SQL_Running_State: Master_Retry_Count: 86400 Master_Bind: Last_IO_Error_Timestamp: Last_SQL_Error_Timestamp: Master_SSL_Crl: Master_SSL_Crlpath: Retrieved_Gtid_Set: Executed_Gtid_Set: aba34ba6-8f0a-11f0-8469-16d308065a4e:1-5915, f436c45e-8f0a-11f0-9fe6-4e2d0062ebce:1-1100 Auto_Position: 1 Replicate_Rewrite_DB: Channel_Name: Master_TLS_Version: Master_public_key_path: Get_master_public_key: 0 Network_Namespace: `echo " echo \"show variables like 'max_connections';\" | mysql -h127.0.0.1 -uroot -p94J7Xw74tE -P3306 " | kubectl exec -it abk-yseslc-mysql-1 --namespace ns-kcduy -- bash ` Defaulted container "mysql" out of: mysql, mysql-exporter, kbagent, config-manager, init-data (init), init-xtrabackup (init), init-jemalloc (init), init-syncer (init), init-kbagent (init), kbagent-worker (init) Unable to use a TTY - input is not a terminal or the right kind of file Warning: arning] Using a password on the command line interface can be insecure. Variable_name Value max_connections 100 connect cluster Success set max_connections to 100 delete cluster abk-yseslc `kbcli cluster delete abk-yseslc --auto-approve --namespace ns-kcduy ` Cluster abk-yseslc deleted pod_info:abk-yseslc-mysql-0 4/4 Running 0 99s abk-yseslc-mysql-1 4/4 Running 0 38s abk-yseslc-proxysql-0 1/1 Running 0 8s pod_info:abk-yseslc-mysql-0 4/4 Running 0 119s abk-yseslc-mysql-1 4/4 Running 0 58s abk-yseslc-proxysql-0 1/1 Terminating 0 28s pod_info:abk-yseslc-mysql-0 4/4 Terminating 0 2m25s No resources found in ns-kcduy namespace. delete cluster pod done No resources found in ns-kcduy namespace. check cluster resource non-exist OK: pvc No resources found in ns-kcduy namespace. delete cluster done No resources found in ns-kcduy namespace. No resources found in ns-kcduy namespace. No resources found in ns-kcduy namespace. cluster delete backup `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge backups mysql-yseslc-xtrabackup-20250911133800 --namespace ns-kcduy ` backup.dataprotection.kubeblocks.io/mysql-yseslc-xtrabackup-20250911133800 patched `kbcli cluster delete-backup mysql-yseslc --name mysql-yseslc-xtrabackup-20250911133800 --force --auto-approve --namespace ns-kcduy ` Backup mysql-yseslc-xtrabackup-20250911133800 deleted cluster xtrabackup backup `kubectl get backuprepo backuprepo-kbcli-test -o jsonpath="***.spec.credential.name***"` `kubectl get backuprepo backuprepo-kbcli-test -o jsonpath="***.spec.credential.namespace***"` `kubectl get secrets kb-backuprepo-jtvgz -n kb-ffipo -o jsonpath="***.data.accessKeyId***"` `kubectl get secrets kb-backuprepo-jtvgz -n kb-ffipo -o jsonpath="***.data.secretAccessKey***"` KUBEBLOCKS NAMESPACE:kb-ffipo get kubeblocks namespace done `kubectl get secrets -l app.kubernetes.io/instance=kbcli-test-minio --namespace kb-ffipo -o jsonpath="***.items[0].data.root-user***"` `kubectl get secrets -l app.kubernetes.io/instance=kbcli-test-minio --namespace kb-ffipo -o jsonpath="***.items[0].data.root-password***"` minio_user:kbclitest,minio_password:kbclitest,minio_endpoint:kbcli-test-minio.kb-ffipo.svc.cluster.local:9000 list minio bucket kbcli-test `echo 'mc config host add minioserver http://kbcli-test-minio.kb-ffipo.svc.cluster.local:9000 kbclitest kbclitest;mc ls minioserver' | kubectl exec -it kbcli-test-minio-cb9fd846b-2rk2d --namespace kb-ffipo -- bash` Unable to use a TTY - input is not a terminal or the right kind of file list minio bucket done default backuprepo:backuprepo-kbcli-test exists `kbcli cluster backup mysql-yseslc --method xtrabackup --namespace ns-kcduy ` Backup backup-ns-kcduy-mysql-yseslc-20250911214151 created successfully, you can view the progress: kbcli cluster list-backups --names=backup-ns-kcduy-mysql-yseslc-20250911214151 -n ns-kcduy check backup status `kbcli cluster list-backups mysql-yseslc --namespace ns-kcduy ` NAME NAMESPACE SOURCE-CLUSTER METHOD STATUS TOTAL-SIZE DURATION DELETION-POLICY CREATE-TIME COMPLETION-TIME EXPIRATION backup-ns-kcduy-mysql-yseslc-20250911214151 ns-kcduy mysql-yseslc xtrabackup Delete Sep 11,2025 21:41 UTC+0800 backup_status:mysql-yseslc-xtrabackup-Running backup_status:mysql-yseslc-xtrabackup-Running backup_status:mysql-yseslc-xtrabackup-Running check backup status done backup_status:backup-ns-kcduy-mysql-yseslc-20250911214151 ns-kcduy mysql-yseslc xtrabackup Completed 8172619 10s Delete Sep 11,2025 21:41 UTC+0800 Sep 11,2025 21:42 UTC+0800 cluster restore backup Error from server (NotFound): opsrequests.operations.kubeblocks.io "abk-yseslc" not found `kbcli cluster describe-backup --names backup-ns-kcduy-mysql-yseslc-20250911214151 --namespace ns-kcduy ` Name: backup-ns-kcduy-mysql-yseslc-20250911214151 Cluster: mysql-yseslc Namespace: ns-kcduy Spec: Method: xtrabackup Policy Name: mysql-yseslc-mysql-backup-policy Actions: dp-backup-0: ActionType: Job WorkloadName: dp-backup-0-backup-ns-kcduy-mysql-yseslc-20250911214151-c47bedc TargetPodName: mysql-yseslc-mysql-0 Phase: Completed Start Time: Sep 11,2025 21:41 UTC+0800 Completion Time: Sep 11,2025 21:42 UTC+0800 Status: Phase: Completed Total Size: 8172619 ActionSet Name: mysql-xtrabackup-br Repository: backuprepo-kbcli-test Duration: 10s Start Time: Sep 11,2025 21:41 UTC+0800 Completion Time: Sep 11,2025 21:42 UTC+0800 Path: /ns-kcduy/mysql-yseslc-f366666b-b432-4de0-b2b6-426248bba9a5/mysql/backup-ns-kcduy-mysql-yseslc-20250911214151 Warning Events: `kbcli cluster restore abk-yseslc --backup backup-ns-kcduy-mysql-yseslc-20250911214151 --namespace ns-kcduy ` Cluster abk-yseslc created check cluster status `kbcli cluster list abk-yseslc --show-labels --namespace ns-kcduy ` NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS abk-yseslc ns-kcduy mysql WipeOut Creating Sep 11,2025 21:42 UTC+0800 clusterdefinition.kubeblocks.io/name=mysql cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances abk-yseslc --namespace ns-kcduy ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME abk-yseslc-mysql-0 ns-kcduy abk-yseslc mysql Running primary 0 200m / 200m 644245094400m / 644245094400m data:11Gi aks-cicdamdpool-42425418-vmss000001/10.224.0.5 Sep 11,2025 21:42 UTC+0800 abk-yseslc-mysql-1 ns-kcduy abk-yseslc mysql Running secondary 0 200m / 200m 644245094400m / 644245094400m data:11Gi aks-cicdamdpool-42425418-vmss000000/10.224.0.9 Sep 11,2025 21:43 UTC+0800 abk-yseslc-proxysql-0 ns-kcduy abk-yseslc proxysql Running 0 100m / 100m 512Mi / 512Mi aks-cicdamdpool-42425418-vmss000001/10.224.0.5 Sep 11,2025 21:43 UTC+0800 check pod status done check cluster role check cluster role done primary: abk-yseslc-mysql-0;secondary: abk-yseslc-mysql-1 `kubectl get secrets -l app.kubernetes.io/instance=abk-yseslc` set secret: abk-yseslc-mysql-account-root `kubectl get secrets abk-yseslc-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets abk-yseslc-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets abk-yseslc-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:94J7Xw74tE;DB_PORT:3306;DB_DATABASE:mysql check cluster connect `echo " echo \"SHOW SLAVE STATUS\G;\" | mysql -P3306 -h127.0.0.1 -uroot -p'94J7Xw74tE' " | kubectl exec -it abk-yseslc-mysql-1 --namespace ns-kcduy -- bash ` connect checking... check cluster connect done `kbcli cluster describe-backup --names backup-ns-kcduy-mysql-yseslc-20250911214151 --namespace ns-kcduy ` Name: backup-ns-kcduy-mysql-yseslc-20250911214151 Cluster: mysql-yseslc Namespace: ns-kcduy Spec: Method: xtrabackup Policy Name: mysql-yseslc-mysql-backup-policy Actions: dp-backup-0: ActionType: Job WorkloadName: dp-backup-0-backup-ns-kcduy-mysql-yseslc-20250911214151-c47bedc TargetPodName: mysql-yseslc-mysql-0 Phase: Completed Start Time: Sep 11,2025 21:41 UTC+0800 Completion Time: Sep 11,2025 21:42 UTC+0800 Status: Phase: Completed Total Size: 8172619 ActionSet Name: mysql-xtrabackup-br Repository: backuprepo-kbcli-test Duration: 10s Start Time: Sep 11,2025 21:41 UTC+0800 Completion Time: Sep 11,2025 21:42 UTC+0800 Path: /ns-kcduy/mysql-yseslc-f366666b-b432-4de0-b2b6-426248bba9a5/mysql/backup-ns-kcduy-mysql-yseslc-20250911214151 Warning Events: cluster connect `kubectl get secrets -l app.kubernetes.io/instance=abk-yseslc` set secret: abk-yseslc-mysql-account-root `kubectl get secrets abk-yseslc-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets abk-yseslc-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets abk-yseslc-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:94J7Xw74tE;DB_PORT:3306;DB_DATABASE:mysql Defaulted container "mysql" out of: mysql, mysql-exporter, kbagent, config-manager, init-data (init), init-xtrabackup (init), init-jemalloc (init), init-syncer (init), init-kbagent (init), kbagent-worker (init) Unable to use a TTY - input is not a terminal or the right kind of file Warning: arning] Using a password on the command line interface can be insecure. *************************** 1. row *************************** Slave_IO_State: Waiting for source to send event Master_Host: abk-yseslc-mysql-0.abk-yseslc-mysql-headless Master_User: kbreplicator Master_Port: 3306 Connect_Retry: 60 Master_Log_File: abk-yseslc-mysql-0-bin.000001 Read_Master_Log_Pos: 16197 Relay_Log_File: relay-bin.000002 Relay_Log_Pos: 16439 Relay_Master_Log_File: abk-yseslc-mysql-0-bin.000001 Slave_IO_Running: Yes Slave_SQL_Running: Yes Replicate_Do_DB: Replicate_Ignore_DB: Replicate_Do_Table: Replicate_Ignore_Table: Replicate_Wild_Do_Table: Replicate_Wild_Ignore_Table: Last_Errno: 0 Last_Error: Skip_Counter: 0 Exec_Master_Log_Pos: 16197 Relay_Log_Space: 16643 Until_Condition: None Until_Log_File: Until_Log_Pos: 0 Master_SSL_Allowed: Yes Master_SSL_CA_File: Master_SSL_CA_Path: Master_SSL_Cert: Master_SSL_Cipher: Master_SSL_Key: Seconds_Behind_Master: 0 Master_SSL_Verify_Server_Cert: No Last_IO_Errno: 0 Last_IO_Error: Last_SQL_Errno: 0 Last_SQL_Error: Replicate_Ignore_Server_Ids: Master_Server_Id: 1 Master_UUID: 3eb1bfca-8f15-11f0-a026-0a4bfd12689e Master_Info_File: mysql.slave_master_info SQL_Delay: 0 SQL_Remaining_Delay: NULL Slave_SQL_Running_State: Replica has read all relay log; waiting for more updates Master_Retry_Count: 86400 Master_Bind: Last_IO_Error_Timestamp: Last_SQL_Error_Timestamp: Master_SSL_Crl: Master_SSL_Crlpath: Retrieved_Gtid_Set: 3eb1bfca-8f15-11f0-a026-0a4bfd12689e:1-40 Executed_Gtid_Set: 3eb1bfca-8f15-11f0-a026-0a4bfd12689e:1-40, aba34ba6-8f0a-11f0-8469-16d308065a4e:1-5915, f436c45e-8f0a-11f0-9fe6-4e2d0062ebce:1-1322 Auto_Position: 1 Replicate_Rewrite_DB: Channel_Name: Master_TLS_Version: Master_public_key_path: Get_master_public_key: 0 Network_Namespace: `echo " echo \"show variables like 'max_connections';\" | mysql -h127.0.0.1 -uroot -p94J7Xw74tE -P3306 " | kubectl exec -it abk-yseslc-mysql-1 --namespace ns-kcduy -- bash ` Defaulted container "mysql" out of: mysql, mysql-exporter, kbagent, config-manager, init-data (init), init-xtrabackup (init), init-jemalloc (init), init-syncer (init), init-kbagent (init), kbagent-worker (init) Unable to use a TTY - input is not a terminal or the right kind of file Warning: arning] Using a password on the command line interface can be insecure. Variable_name Value max_connections 100 connect cluster Success set max_connections to 100 delete cluster abk-yseslc `kbcli cluster delete abk-yseslc --auto-approve --namespace ns-kcduy ` Cluster abk-yseslc deleted pod_info:abk-yseslc-mysql-0 4/4 Running 0 77s abk-yseslc-mysql-1 4/4 Running 0 51s abk-yseslc-proxysql-0 1/1 Running 0 12s pod_info:abk-yseslc-mysql-0 4/4 Running 0 97s abk-yseslc-mysql-1 4/4 Running 0 71s abk-yseslc-proxysql-0 1/1 Terminating 0 32s pod_info:abk-yseslc-mysql-0 4/4 Terminating 0 2m2s No resources found in ns-kcduy namespace. delete cluster pod done No resources found in ns-kcduy namespace. check cluster resource non-exist OK: pvc No resources found in ns-kcduy namespace. delete cluster done No resources found in ns-kcduy namespace. No resources found in ns-kcduy namespace. No resources found in ns-kcduy namespace. cluster rebulid instances apiVersion: operations.kubeblocks.io/v1alpha1 kind: OpsRequest metadata: generateName: mysql-yseslc-rebuildinstance- namespace: ns-kcduy spec: type: RebuildInstance clusterName: mysql-yseslc force: true rebuildFrom: - componentName: mysql instances: - name: mysql-yseslc-mysql-0 backupName: backup-ns-kcduy-mysql-yseslc-20250911214151 inPlace: false restoreEnv: - name: BACKUP_FOR_STANDBY value: "true" check cluster status before ops check cluster status done cluster_status:Running `kubectl create -f test_ops_cluster_mysql-yseslc.yaml` opsrequest.operations.kubeblocks.io/mysql-yseslc-rebuildinstance-rldww created create test_ops_cluster_mysql-yseslc.yaml Success `rm -rf test_ops_cluster_mysql-yseslc.yaml` check ops status `kbcli cluster list-ops mysql-yseslc --status all --namespace ns-kcduy ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME mysql-yseslc-switchover-4bfkr ns-kcduy Switchover mysql-yseslc mysql Succeed 1/1 Sep 11,2025 20:34 UTC+0800 mysql-yseslc-rebuildinstance-rldww ns-kcduy RebuildInstance mysql-yseslc Creating -/- Sep 11,2025 21:45 UTC+0800 ops_status:mysql-yseslc-rebuildinstance-rldww ns-kcduy RebuildInstance mysql-yseslc mysql Running 0/1 Sep 11,2025 21:45 UTC+0800 ops_status:mysql-yseslc-rebuildinstance-rldww ns-kcduy RebuildInstance mysql-yseslc mysql Running 0/1 Sep 11,2025 21:45 UTC+0800 ops_status:mysql-yseslc-rebuildinstance-rldww ns-kcduy RebuildInstance mysql-yseslc mysql Running 0/1 Sep 11,2025 21:45 UTC+0800 ops_status:mysql-yseslc-rebuildinstance-rldww ns-kcduy RebuildInstance mysql-yseslc mysql Running 0/1 Sep 11,2025 21:45 UTC+0800 ops_status:mysql-yseslc-rebuildinstance-rldww ns-kcduy RebuildInstance mysql-yseslc mysql Running 0/1 Sep 11,2025 21:45 UTC+0800 ops_status:mysql-yseslc-rebuildinstance-rldww ns-kcduy RebuildInstance mysql-yseslc mysql Running 0/1 Sep 11,2025 21:45 UTC+0800 ops_status:mysql-yseslc-rebuildinstance-rldww ns-kcduy RebuildInstance mysql-yseslc mysql Running 0/1 Sep 11,2025 21:45 UTC+0800 ops_status:mysql-yseslc-rebuildinstance-rldww ns-kcduy RebuildInstance mysql-yseslc mysql Running 0/1 Sep 11,2025 21:45 UTC+0800 ops_status:mysql-yseslc-rebuildinstance-rldww ns-kcduy RebuildInstance mysql-yseslc mysql Running 0/1 Sep 11,2025 21:45 UTC+0800 check ops status done ops_status:mysql-yseslc-rebuildinstance-rldww ns-kcduy RebuildInstance mysql-yseslc mysql Succeed 1/1 Sep 11,2025 21:45 UTC+0800 `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge opsrequests.operations mysql-yseslc-rebuildinstance-rldww --namespace ns-kcduy ` opsrequest.operations.kubeblocks.io/mysql-yseslc-rebuildinstance-rldww patched `kbcli cluster delete-ops --name mysql-yseslc-rebuildinstance-rldww --force --auto-approve --namespace ns-kcduy ` OpsRequest mysql-yseslc-rebuildinstance-rldww deleted check cluster status `kbcli cluster list mysql-yseslc --show-labels --namespace ns-kcduy ` NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS mysql-yseslc ns-kcduy mysql WipeOut Updating Sep 11,2025 20:24 UTC+0800 app.kubernetes.io/instance=mysql-yseslc,clusterdefinition.kubeblocks.io/name=mysql cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances mysql-yseslc --namespace ns-kcduy ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME mysql-yseslc-mysql-1 ns-kcduy mysql-yseslc mysql Running primary 0 200m / 200m 644245094400m / 644245094400m data:11Gi aks-cicdamdpool-42425418-vmss000002/10.224.0.7 Sep 11,2025 21:31 UTC+0800 mysql-yseslc-mysql-2 ns-kcduy mysql-yseslc mysql Running secondary 0 200m / 200m 644245094400m / 644245094400m data:11Gi aks-cicdamdpool-42425418-vmss000001/10.224.0.5 Sep 11,2025 21:45 UTC+0800 mysql-yseslc-proxysql-0 ns-kcduy mysql-yseslc proxysql Running 0 100m / 100m 512Mi / 512Mi aks-cicdamdpool-42425418-vmss000001/10.224.0.5 Sep 11,2025 21:46 UTC+0800 check pod status done check cluster role check cluster role done primary: mysql-yseslc-mysql-1;secondary: mysql-yseslc-mysql-2 `kubectl get secrets -l app.kubernetes.io/instance=mysql-yseslc` set secret: mysql-yseslc-mysql-account-root `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:94J7Xw74tE;DB_PORT:3306;DB_DATABASE:mysql check cluster connect `echo " echo \"SHOW SLAVE STATUS\G;\" | mysql -P3306 -h127.0.0.1 -uroot -p'94J7Xw74tE' " | kubectl exec -it mysql-yseslc-mysql-2 --namespace ns-kcduy -- bash ` connect checking... connect checking... check cluster connect done `kubectl get secrets -l app.kubernetes.io/instance=mysql-yseslc` set secret: mysql-yseslc-mysql-account-root `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:94J7Xw74tE;DB_PORT:3306;DB_DATABASE:mysql check db_client batch data count `echo "echo \"select count(*) from executions_loop.executions_loop_table;\" | mysql -P3306 -hmysql-yseslc-mysql.ns-kcduy.svc.cluster.local -uroot -p'94J7Xw74tE' " | kubectl exec -it mysql-yseslc-mysql-1 --namespace ns-kcduy -- bash ` check db_client batch data Success `kubectl get secrets -l app.kubernetes.io/instance=mysql-yseslc` set secret: mysql-yseslc-mysql-account-root `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:94J7Xw74tE;DB_PORT:3306;DB_DATABASE:mysql check readonly db_client batch data count `echo "echo \"select count(*) from executions_loop.executions_loop_table;\" | mysql -P3306 -h127.0.0.1 -uroot -p'94J7Xw74tE' " | kubectl exec -it mysql-yseslc-mysql-2 --namespace ns-kcduy -- bash ` check readonly db_client batch data Success cluster delete backup `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge backups backup-ns-kcduy-mysql-yseslc-20250911214151 --namespace ns-kcduy ` backup.dataprotection.kubeblocks.io/backup-ns-kcduy-mysql-yseslc-20250911214151 patched `kbcli cluster delete-backup mysql-yseslc --name backup-ns-kcduy-mysql-yseslc-20250911214151 --force --auto-approve --namespace ns-kcduy ` Backup backup-ns-kcduy-mysql-yseslc-20250911214151 deleted cluster xtrabackup backup `kubectl get backuprepo backuprepo-kbcli-test -o jsonpath="***.spec.credential.name***"` `kubectl get backuprepo backuprepo-kbcli-test -o jsonpath="***.spec.credential.namespace***"` `kubectl get secrets kb-backuprepo-jtvgz -n kb-ffipo -o jsonpath="***.data.accessKeyId***"` `kubectl get secrets kb-backuprepo-jtvgz -n kb-ffipo -o jsonpath="***.data.secretAccessKey***"` KUBEBLOCKS NAMESPACE:kb-ffipo get kubeblocks namespace done `kubectl get secrets -l app.kubernetes.io/instance=kbcli-test-minio --namespace kb-ffipo -o jsonpath="***.items[0].data.root-user***"` `kubectl get secrets -l app.kubernetes.io/instance=kbcli-test-minio --namespace kb-ffipo -o jsonpath="***.items[0].data.root-password***"` minio_user:kbclitest,minio_password:kbclitest,minio_endpoint:kbcli-test-minio.kb-ffipo.svc.cluster.local:9000 list minio bucket kbcli-test `echo 'mc config host add minioserver http://kbcli-test-minio.kb-ffipo.svc.cluster.local:9000 kbclitest kbclitest;mc ls minioserver' | kubectl exec -it kbcli-test-minio-cb9fd846b-2rk2d --namespace kb-ffipo -- bash` Unable to use a TTY - input is not a terminal or the right kind of file list minio bucket done default backuprepo:backuprepo-kbcli-test exists `kbcli cluster backup mysql-yseslc --method xtrabackup --namespace ns-kcduy ` Backup backup-ns-kcduy-mysql-yseslc-20250911214647 created successfully, you can view the progress: kbcli cluster list-backups --names=backup-ns-kcduy-mysql-yseslc-20250911214647 -n ns-kcduy check backup status `kbcli cluster list-backups mysql-yseslc --namespace ns-kcduy ` NAME NAMESPACE SOURCE-CLUSTER METHOD STATUS TOTAL-SIZE DURATION DELETION-POLICY CREATE-TIME COMPLETION-TIME EXPIRATION backup-ns-kcduy-mysql-yseslc-20250911214647 ns-kcduy mysql-yseslc xtrabackup Delete Sep 11,2025 21:46 UTC+0800 backup_status:mysql-yseslc-xtrabackup-Running backup_status:mysql-yseslc-xtrabackup-Running backup_status:mysql-yseslc-xtrabackup-Running check backup status done backup_status:backup-ns-kcduy-mysql-yseslc-20250911214647 ns-kcduy mysql-yseslc xtrabackup Completed 8018903 10s Delete Sep 11,2025 21:46 UTC+0800 Sep 11,2025 21:46 UTC+0800 `kubectl get secrets -l app.kubernetes.io/instance=mysql-yseslc` set secret: mysql-yseslc-mysql-account-root `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:94J7Xw74tE;DB_PORT:3306;DB_DATABASE:mysql `CREATE DATABASE IF NOT EXISTS kbclidb;CREATE TABLE IF NOT EXISTS kbclidb.msg (id INT UNSIGNED NOT NULL AUTO_INCREMENT,msg TEXT,time TIMESTAMP NULL,PRIMARY KEY (id)) ENGINE=InnoDB DEFAULT CHARSET=utf8mb4;insert into kbclidb.msg (msg, time) values ('kbcli-test-data-yseslc0', CURRENT_TIMESTAMP);` Defaulted container "mysql" out of: mysql, mysql-exporter, kbagent, config-manager, init-data (init), init-xtrabackup (init), init-jemalloc (init), init-syncer (init), init-kbagent (init), kbagent-worker (init) Unable to use a TTY - input is not a terminal or the right kind of file Warning: arning] Using a password on the command line interface can be insecure. `kubectl get secrets -l app.kubernetes.io/instance=mysql-yseslc` set secret: mysql-yseslc-mysql-account-root `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:94J7Xw74tE;DB_PORT:3306;DB_DATABASE:mysql `insert into kbclidb.msg (msg, time) values ('kbcli-test-data-yseslc1', CURRENT_TIMESTAMP);` Defaulted container "mysql" out of: mysql, mysql-exporter, kbagent, config-manager, init-data (init), init-xtrabackup (init), init-jemalloc (init), init-syncer (init), init-kbagent (init), kbagent-worker (init) Unable to use a TTY - input is not a terminal or the right kind of file Warning: arning] Using a password on the command line interface can be insecure. Defaulted container "mysql" out of: mysql, mysql-exporter, kbagent, config-manager, init-data (init), init-xtrabackup (init), init-jemalloc (init), init-syncer (init), init-kbagent (init), kbagent-worker (init) Unable to use a TTY - input is not a terminal or the right kind of file Warning: arning] Using a password on the command line interface can be insecure. `kubectl get secrets -l app.kubernetes.io/instance=mysql-yseslc` set secret: mysql-yseslc-mysql-account-root `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:94J7Xw74tE;DB_PORT:3306;DB_DATABASE:mysql `insert into kbclidb.msg (msg, time) values ('kbcli-test-data-yseslc2', CURRENT_TIMESTAMP);` Defaulted container "mysql" out of: mysql, mysql-exporter, kbagent, config-manager, init-data (init), init-xtrabackup (init), init-jemalloc (init), init-syncer (init), init-kbagent (init), kbagent-worker (init) Unable to use a TTY - input is not a terminal or the right kind of file Warning: arning] Using a password on the command line interface can be insecure. Defaulted container "mysql" out of: mysql, mysql-exporter, kbagent, config-manager, init-data (init), init-xtrabackup (init), init-jemalloc (init), init-syncer (init), init-kbagent (init), kbagent-worker (init) Unable to use a TTY - input is not a terminal or the right kind of file Warning: arning] Using a password on the command line interface can be insecure. `kubectl get secrets -l app.kubernetes.io/instance=mysql-yseslc` set secret: mysql-yseslc-mysql-account-root `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:94J7Xw74tE;DB_PORT:3306;DB_DATABASE:mysql `insert into kbclidb.msg (msg, time) values ('kbcli-test-data-yseslc3', CURRENT_TIMESTAMP);` Defaulted container "mysql" out of: mysql, mysql-exporter, kbagent, config-manager, init-data (init), init-xtrabackup (init), init-jemalloc (init), init-syncer (init), init-kbagent (init), kbagent-worker (init) Unable to use a TTY - input is not a terminal or the right kind of file Warning: arning] Using a password on the command line interface can be insecure. Defaulted container "mysql" out of: mysql, mysql-exporter, kbagent, config-manager, init-data (init), init-xtrabackup (init), init-jemalloc (init), init-syncer (init), init-kbagent (init), kbagent-worker (init) Unable to use a TTY - input is not a terminal or the right kind of file Warning: arning] Using a password on the command line interface can be insecure. cluster xtrabackup-inc backup `kubectl get backuprepo backuprepo-kbcli-test -o jsonpath="***.spec.credential.name***"` `kubectl get backuprepo backuprepo-kbcli-test -o jsonpath="***.spec.credential.namespace***"` `kubectl get secrets kb-backuprepo-jtvgz -n kb-ffipo -o jsonpath="***.data.accessKeyId***"` `kubectl get secrets kb-backuprepo-jtvgz -n kb-ffipo -o jsonpath="***.data.secretAccessKey***"` KUBEBLOCKS NAMESPACE:kb-ffipo get kubeblocks namespace done `kubectl get secrets -l app.kubernetes.io/instance=kbcli-test-minio --namespace kb-ffipo -o jsonpath="***.items[0].data.root-user***"` `kubectl get secrets -l app.kubernetes.io/instance=kbcli-test-minio --namespace kb-ffipo -o jsonpath="***.items[0].data.root-password***"` minio_user:kbclitest,minio_password:kbclitest,minio_endpoint:kbcli-test-minio.kb-ffipo.svc.cluster.local:9000 list minio bucket kbcli-test `echo 'mc config host add minioserver http://kbcli-test-minio.kb-ffipo.svc.cluster.local:9000 kbclitest kbclitest;mc ls minioserver' | kubectl exec -it kbcli-test-minio-cb9fd846b-2rk2d --namespace kb-ffipo -- bash` Unable to use a TTY - input is not a terminal or the right kind of file list minio bucket done default backuprepo:backuprepo-kbcli-test exists `kbcli cluster backup mysql-yseslc --method xtrabackup-inc --namespace ns-kcduy ` Backup backup-ns-kcduy-mysql-yseslc-20250911214726 created successfully, you can view the progress: kbcli cluster list-backups --names=backup-ns-kcduy-mysql-yseslc-20250911214726 -n ns-kcduy check backup status `kbcli cluster list-backups mysql-yseslc --namespace ns-kcduy ` NAME NAMESPACE SOURCE-CLUSTER METHOD STATUS TOTAL-SIZE DURATION DELETION-POLICY CREATE-TIME COMPLETION-TIME EXPIRATION backup-ns-kcduy-mysql-yseslc-20250911214647 ns-kcduy mysql-yseslc xtrabackup Completed 8018903 10s Delete Sep 11,2025 21:46 UTC+0800 Sep 11,2025 21:46 UTC+0800 backup-ns-kcduy-mysql-yseslc-20250911214726 ns-kcduy mysql-yseslc xtrabackup-inc Delete Sep 11,2025 21:47 UTC+0800 backup_status:mysql-yseslc-xtrabackup-inc-Running backup_status:mysql-yseslc-xtrabackup-inc-Running backup_status:mysql-yseslc-xtrabackup-inc-Running check backup status done backup_status:backup-ns-kcduy-mysql-yseslc-20250911214726 ns-kcduy mysql-yseslc xtrabackup-inc Completed 165661 11s Delete Sep 11,2025 21:47 UTC+0800 Sep 11,2025 21:47 UTC+0800 cluster restore backup Error from server (NotFound): opsrequests.operations.kubeblocks.io "abk-yseslc" not found `kbcli cluster describe-backup --names backup-ns-kcduy-mysql-yseslc-20250911214726 --namespace ns-kcduy ` Name: backup-ns-kcduy-mysql-yseslc-20250911214726 Cluster: mysql-yseslc Namespace: ns-kcduy Spec: Method: xtrabackup-inc Policy Name: mysql-yseslc-mysql-backup-policy Actions: dp-backup-0: ActionType: Job WorkloadName: dp-backup-0-backup-ns-kcduy-mysql-yseslc-20250911214726-f35e87c TargetPodName: mysql-yseslc-mysql-2 Phase: Completed Start Time: Sep 11,2025 21:47 UTC+0800 Completion Time: Sep 11,2025 21:47 UTC+0800 Status: Phase: Completed Total Size: 165661 ActionSet Name: mysql-xtrabackup-inc-br Repository: backuprepo-kbcli-test Duration: 11s Start Time: Sep 11,2025 21:47 UTC+0800 Completion Time: Sep 11,2025 21:47 UTC+0800 Path: /ns-kcduy/mysql-yseslc-f366666b-b432-4de0-b2b6-426248bba9a5/mysql/backup-ns-kcduy-mysql-yseslc-20250911214726 Warning Events: `kbcli cluster restore abk-yseslc --backup backup-ns-kcduy-mysql-yseslc-20250911214726 --namespace ns-kcduy ` Cluster abk-yseslc created check cluster status `kbcli cluster list abk-yseslc --show-labels --namespace ns-kcduy ` NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS abk-yseslc ns-kcduy mysql WipeOut Creating Sep 11,2025 21:47 UTC+0800 clusterdefinition.kubeblocks.io/name=mysql cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances abk-yseslc --namespace ns-kcduy ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME abk-yseslc-mysql-0 ns-kcduy abk-yseslc mysql Running primary 0 200m / 200m 644245094400m / 644245094400m data:11Gi aks-cicdamdpool-42425418-vmss000001/10.224.0.5 Sep 11,2025 21:48 UTC+0800 abk-yseslc-mysql-1 ns-kcduy abk-yseslc mysql Running secondary 0 200m / 200m 644245094400m / 644245094400m data:11Gi aks-cicdamdpool-42425418-vmss000000/10.224.0.9 Sep 11,2025 21:48 UTC+0800 abk-yseslc-proxysql-0 ns-kcduy abk-yseslc proxysql Running 0 100m / 100m 512Mi / 512Mi aks-cicdamdpool-42425418-vmss000001/10.224.0.5 Sep 11,2025 21:49 UTC+0800 check pod status done check cluster role check cluster role done primary: abk-yseslc-mysql-0;secondary: abk-yseslc-mysql-1 `kubectl get secrets -l app.kubernetes.io/instance=abk-yseslc` set secret: abk-yseslc-mysql-account-root `kubectl get secrets abk-yseslc-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets abk-yseslc-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets abk-yseslc-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:94J7Xw74tE;DB_PORT:3306;DB_DATABASE:mysql check cluster connect `echo " echo \"SHOW SLAVE STATUS\G;\" | mysql -P3306 -h127.0.0.1 -uroot -p'94J7Xw74tE' " | kubectl exec -it abk-yseslc-mysql-1 --namespace ns-kcduy -- bash ` check cluster connect done `kbcli cluster describe-backup --names backup-ns-kcduy-mysql-yseslc-20250911214726 --namespace ns-kcduy ` Name: backup-ns-kcduy-mysql-yseslc-20250911214726 Cluster: mysql-yseslc Namespace: ns-kcduy Spec: Method: xtrabackup-inc Policy Name: mysql-yseslc-mysql-backup-policy Actions: dp-backup-0: ActionType: Job WorkloadName: dp-backup-0-backup-ns-kcduy-mysql-yseslc-20250911214726-f35e87c TargetPodName: mysql-yseslc-mysql-2 Phase: Completed Start Time: Sep 11,2025 21:47 UTC+0800 Completion Time: Sep 11,2025 21:47 UTC+0800 Status: Phase: Completed Total Size: 165661 ActionSet Name: mysql-xtrabackup-inc-br Repository: backuprepo-kbcli-test Duration: 11s Start Time: Sep 11,2025 21:47 UTC+0800 Completion Time: Sep 11,2025 21:47 UTC+0800 Path: /ns-kcduy/mysql-yseslc-f366666b-b432-4de0-b2b6-426248bba9a5/mysql/backup-ns-kcduy-mysql-yseslc-20250911214726 Warning Events: `kubectl get secrets -l app.kubernetes.io/instance=abk-yseslc` set secret: abk-yseslc-mysql-account-root `kubectl get secrets abk-yseslc-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets abk-yseslc-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets abk-yseslc-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:94J7Xw74tE;DB_PORT:3306;DB_DATABASE:mysql `select * from kbclidb.msg;` Defaulted container "mysql" out of: mysql, mysql-exporter, kbagent, config-manager, init-data (init), init-xtrabackup (init), init-jemalloc (init), init-syncer (init), init-kbagent (init), kbagent-worker (init) Unable to use a TTY - input is not a terminal or the right kind of file Warning: arning] Using a password on the command line interface can be insecure. id msg time 1 kbcli-test-data-yseslc0 2025-09-11 13:47:04 2 kbcli-test-data-yseslc1 2025-09-11 13:47:05 3 kbcli-test-data-yseslc2 2025-09-11 13:47:12 4 kbcli-test-data-yseslc3 2025-09-11 13:47:19 Point-In-Time Recovery Success `kubectl get secrets -l app.kubernetes.io/instance=mysql-yseslc` set secret: mysql-yseslc-mysql-account-root `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:94J7Xw74tE;DB_PORT:3306;DB_DATABASE:mysql cluster connect `kubectl get secrets -l app.kubernetes.io/instance=abk-yseslc` set secret: abk-yseslc-mysql-account-root `kubectl get secrets abk-yseslc-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets abk-yseslc-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets abk-yseslc-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:94J7Xw74tE;DB_PORT:3306;DB_DATABASE:mysql Defaulted container "mysql" out of: mysql, mysql-exporter, kbagent, config-manager, init-data (init), init-xtrabackup (init), init-jemalloc (init), init-syncer (init), init-kbagent (init), kbagent-worker (init) Unable to use a TTY - input is not a terminal or the right kind of file Warning: arning] Using a password on the command line interface can be insecure. *************************** 1. row *************************** Slave_IO_State: Waiting for source to send event Master_Host: abk-yseslc-mysql-0.abk-yseslc-mysql-headless Master_User: kbreplicator Master_Port: 3306 Connect_Retry: 60 Master_Log_File: abk-yseslc-mysql-0-bin.000001 Read_Master_Log_Pos: 16999 Relay_Log_File: relay-bin.000002 Relay_Log_Pos: 16840 Relay_Master_Log_File: abk-yseslc-mysql-0-bin.000001 Slave_IO_Running: Yes Slave_SQL_Running: Yes Replicate_Do_DB: Replicate_Ignore_DB: Replicate_Do_Table: Replicate_Ignore_Table: Replicate_Wild_Do_Table: Replicate_Wild_Ignore_Table: Last_Errno: 0 Last_Error: Skip_Counter: 0 Exec_Master_Log_Pos: 16598 Relay_Log_Space: 17445 Until_Condition: None Until_Log_File: Until_Log_Pos: 0 Master_SSL_Allowed: Yes Master_SSL_CA_File: Master_SSL_CA_Path: Master_SSL_Cert: Master_SSL_Cipher: Master_SSL_Key: Seconds_Behind_Master: 1 Master_SSL_Verify_Server_Cert: No Last_IO_Errno: 0 Last_IO_Error: Last_SQL_Errno: 0 Last_SQL_Error: Replicate_Ignore_Server_Ids: Master_Server_Id: 1 Master_UUID: 07185249-8f16-11f0-b63c-0a4bfd12689e Master_Info_File: mysql.slave_master_info SQL_Delay: 0 SQL_Remaining_Delay: NULL Slave_SQL_Running_State: Replica has read all relay log; waiting for more updates Master_Retry_Count: 86400 Master_Bind: Last_IO_Error_Timestamp: Last_SQL_Error_Timestamp: Master_SSL_Crl: Master_SSL_Crlpath: Retrieved_Gtid_Set: 07185249-8f16-11f0-b63c-0a4bfd12689e:1-42 Executed_Gtid_Set: 07185249-8f16-11f0-b63c-0a4bfd12689e:1-42, aba34ba6-8f0a-11f0-8469-16d308065a4e:1-5915, f436c45e-8f0a-11f0-9fe6-4e2d0062ebce:1-1655 Auto_Position: 1 Replicate_Rewrite_DB: Channel_Name: Master_TLS_Version: Master_public_key_path: Get_master_public_key: 0 Network_Namespace: `echo " echo \"show variables like 'max_connections';\" | mysql -h127.0.0.1 -uroot -p94J7Xw74tE -P3306 " | kubectl exec -it abk-yseslc-mysql-1 --namespace ns-kcduy -- bash ` Defaulted container "mysql" out of: mysql, mysql-exporter, kbagent, config-manager, init-data (init), init-xtrabackup (init), init-jemalloc (init), init-syncer (init), init-kbagent (init), kbagent-worker (init) Unable to use a TTY - input is not a terminal or the right kind of file Warning: arning] Using a password on the command line interface can be insecure. Variable_name Value max_connections 100 connect cluster Success set max_connections to 100 delete cluster abk-yseslc `kbcli cluster delete abk-yseslc --auto-approve --namespace ns-kcduy ` Cluster abk-yseslc deleted pod_info:abk-yseslc-mysql-0 4/4 Running 0 76s abk-yseslc-mysql-1 4/4 Running 0 47s abk-yseslc-proxysql-0 1/1 Running 0 12s pod_info:abk-yseslc-mysql-0 4/4 Running 0 96s abk-yseslc-mysql-1 4/4 Running 0 67s abk-yseslc-proxysql-0 1/1 Terminating 0 32s pod_info:abk-yseslc-mysql-0 4/4 Terminating 0 2m1s No resources found in ns-kcduy namespace. delete cluster pod done No resources found in ns-kcduy namespace. check cluster resource non-exist OK: pvc No resources found in ns-kcduy namespace. delete cluster done No resources found in ns-kcduy namespace. No resources found in ns-kcduy namespace. No resources found in ns-kcduy namespace. cluster delete backup `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge backups backup-ns-kcduy-mysql-yseslc-20250911214647 --namespace ns-kcduy ` backup.dataprotection.kubeblocks.io/backup-ns-kcduy-mysql-yseslc-20250911214647 patched `kbcli cluster delete-backup mysql-yseslc --name backup-ns-kcduy-mysql-yseslc-20250911214647 --force --auto-approve --namespace ns-kcduy ` Backup backup-ns-kcduy-mysql-yseslc-20250911214647 deleted `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge backups backup-ns-kcduy-mysql-yseslc-20250911214726 --namespace ns-kcduy ` backup.dataprotection.kubeblocks.io/backup-ns-kcduy-mysql-yseslc-20250911214726 patched `kbcli cluster delete-backup mysql-yseslc --name backup-ns-kcduy-mysql-yseslc-20250911214726 --force --auto-approve --namespace ns-kcduy ` Backup backup-ns-kcduy-mysql-yseslc-20250911214726 deleted cluster list-logs No log files found. `kbcli cluster list-logs mysql-yseslc --namespace ns-kcduy ` Error from server (NotFound): pods "mysql-yseslc-mysql-1" not found cluster logs `kbcli cluster logs mysql-yseslc --tail 30 --namespace ns-kcduy ` Defaulted container "mysql" out of: mysql, mysql-exporter, kbagent, config-manager, init-data (init), init-xtrabackup (init), init-jemalloc (init), init-syncer (init), init-kbagent (init), kbagent-worker (init) 2025-09-11T13:46:07.866913-00:00 0 [Note] [MY-011825] [Xtrabackup] Compressing and streaming 2025-09-11T13:46:07.866937-00:00 0 [Note] [MY-011825] [Xtrabackup] Done: Compressing and streaming file 2025-09-11T13:46:07.867234-00:00 0 [Note] [MY-011825] [Xtrabackup] Compressing and streaming 2025-09-11T13:46:07.867260-00:00 0 [Note] [MY-011825] [Xtrabackup] Done: Compressing and streaming file 2025-09-11T13:46:07.869002-00:00 0 [Note] [MY-011825] [Xtrabackup] Compressing and streaming 2025-09-11T13:46:07.869039-00:00 0 [Note] [MY-011825] [Xtrabackup] Done: Compressing and streaming file 2025-09-11T13:46:07.869076-00:00 0 [Note] [MY-011825] [Xtrabackup] Executing FLUSH NO_WRITE_TO_BINLOG ENGINE LOGS... 2025-09-11T13:46:07.875248-00:00 0 [Note] [MY-011825] [Xtrabackup] The latest check point (for incremental): '289378073' 2025-09-11T13:46:07.875274-00:00 0 [Note] [MY-011825] [Xtrabackup] Stopping log copying thread at LSN 289383692 2025-09-11T13:46:07.875577-00:00 1 [Note] [MY-011825] [Xtrabackup] >> log scanned up to (289384063) 2025-09-11T13:46:08.876364-00:00 0 [Note] [MY-011825] [Xtrabackup] Executing UNLOCK INSTANCE 2025-09-11T13:46:08.876739-00:00 0 [Note] [MY-011825] [Xtrabackup] All tables unlocked 2025-09-11T13:46:08.876916-00:00 0 [Note] [MY-011825] [Xtrabackup] Compressing and streaming ib_buffer_pool to 2025-09-11T13:46:08.877063-00:00 0 [Note] [MY-011825] [Xtrabackup] Done: Compressing and streaming ib_buffer_pool to 2025-09-11T13:46:08.877139-00:00 0 [Note] [MY-011825] [Xtrabackup] Backup created in directory '/xtrabackup_backupfiles/' 2025-09-11T13:46:08.877155-00:00 0 [Note] [MY-011825] [Xtrabackup] MySQL binlog position: filename 'mysql-yseslc-mysql-1-bin.000023', position '237', GTID of the last change 'aba34ba6-8f0a-11f0-8469-16d308065a4e:1-5915,f436c45e-8f0a-11f0-9fe6-4e2d0062ebce:1-1568' 2025-09-11T13:46:08.877212-00:00 0 [Note] [MY-011825] [Xtrabackup] Compressing and streaming 2025-09-11T13:46:08.877244-00:00 0 [Note] [MY-011825] [Xtrabackup] Done: Compressing and streaming file 2025-09-11T13:46:08.877760-00:00 0 [Note] [MY-011825] [Xtrabackup] Compressing and streaming 2025-09-11T13:46:08.877805-00:00 0 [Note] [MY-011825] [Xtrabackup] Done: Compressing and streaming file 2025-09-11T13:46:09.878154-00:00 0 [Note] [MY-011825] [Xtrabackup] Transaction log of lsn (289378073) to (289384802) was copied. 2025-09-11T13:46:10.087958-00:00 0 [Note] [MY-011825] [Xtrabackup] completed OK! 2025-09-11T13:47:00Z INFO HA This member is Cluster's leader 2025-09-11T13:47:00Z DEBUG HA Refresh leader ttl 2025-09-11T13:48:01Z INFO HA This member is Cluster's leader 2025-09-11T13:48:01Z DEBUG HA Refresh leader ttl 2025-09-11T13:49:01Z INFO HA This member is Cluster's leader 2025-09-11T13:49:01Z DEBUG HA Refresh leader ttl 2025-09-11T13:50:01Z INFO HA This member is Cluster's leader 2025-09-11T13:50:01Z DEBUG HA Refresh leader ttl cluster logs slow `kbcli cluster logs mysql-yseslc --tail 30 --file-type=slow --namespace ns-kcduy ` error: can't get file path pattern by type slow cluster logs error `kbcli cluster logs mysql-yseslc --tail 30 --file-type=error --namespace ns-kcduy ` error: can't get file path pattern by type error LB_TYPE is set to: intranet cluster expose check cluster status before ops check cluster status done cluster_status:Running `kbcli cluster expose mysql-yseslc --auto-approve --force=true --type intranet --enable false --components mysql --role-selector primary --namespace ns-kcduy ` OpsRequest mysql-yseslc-expose-zpqsh created successfully, you can view the progress: kbcli cluster describe-ops mysql-yseslc-expose-zpqsh -n ns-kcduy check ops status `kbcli cluster list-ops mysql-yseslc --status all --namespace ns-kcduy ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME mysql-yseslc-switchover-4bfkr ns-kcduy Switchover mysql-yseslc mysql Succeed 1/1 Sep 11,2025 20:34 UTC+0800 mysql-yseslc-expose-zpqsh ns-kcduy Expose mysql-yseslc Running -/- Sep 11,2025 21:50 UTC+0800 check cluster status `kbcli cluster list mysql-yseslc --show-labels --namespace ns-kcduy ` NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS mysql-yseslc ns-kcduy mysql WipeOut Running Sep 11,2025 20:24 UTC+0800 app.kubernetes.io/instance=mysql-yseslc,clusterdefinition.kubeblocks.io/name=mysql check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances mysql-yseslc --namespace ns-kcduy ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME mysql-yseslc-mysql-1 ns-kcduy mysql-yseslc mysql Running primary 0 200m / 200m 644245094400m / 644245094400m data:11Gi aks-cicdamdpool-42425418-vmss000002/10.224.0.7 Sep 11,2025 21:31 UTC+0800 mysql-yseslc-mysql-2 ns-kcduy mysql-yseslc mysql Running secondary 0 200m / 200m 644245094400m / 644245094400m data:11Gi aks-cicdamdpool-42425418-vmss000001/10.224.0.5 Sep 11,2025 21:45 UTC+0800 mysql-yseslc-proxysql-0 ns-kcduy mysql-yseslc proxysql Running 0 100m / 100m 512Mi / 512Mi aks-cicdamdpool-42425418-vmss000001/10.224.0.5 Sep 11,2025 21:46 UTC+0800 check pod status done check cluster role check cluster role done primary: mysql-yseslc-mysql-1;secondary: mysql-yseslc-mysql-2 `kubectl get secrets -l app.kubernetes.io/instance=mysql-yseslc` set secret: mysql-yseslc-mysql-account-root `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:94J7Xw74tE;DB_PORT:3306;DB_DATABASE:mysql check cluster connect `echo " echo \"SHOW SLAVE STATUS\G;\" | mysql -P3306 -h127.0.0.1 -uroot -p'94J7Xw74tE' " | kubectl exec -it mysql-yseslc-mysql-2 --namespace ns-kcduy -- bash ` check cluster connect done check ops status `kbcli cluster list-ops mysql-yseslc --status all --namespace ns-kcduy ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME mysql-yseslc-switchover-4bfkr ns-kcduy Switchover mysql-yseslc mysql Succeed 1/1 Sep 11,2025 20:34 UTC+0800 mysql-yseslc-expose-zpqsh ns-kcduy Expose mysql-yseslc mysql Running 0/1 Sep 11,2025 21:50 UTC+0800 ops_status:mysql-yseslc-expose-zpqsh ns-kcduy Expose mysql-yseslc mysql Running 0/1 Sep 11,2025 21:50 UTC+0800 ops_status:mysql-yseslc-expose-zpqsh ns-kcduy Expose mysql-yseslc mysql Running 0/1 Sep 11,2025 21:50 UTC+0800 ops_status:mysql-yseslc-expose-zpqsh ns-kcduy Expose mysql-yseslc mysql Running 0/1 Sep 11,2025 21:50 UTC+0800 ops_status:mysql-yseslc-expose-zpqsh ns-kcduy Expose mysql-yseslc mysql Running 0/1 Sep 11,2025 21:50 UTC+0800 ops_status:mysql-yseslc-expose-zpqsh ns-kcduy Expose mysql-yseslc mysql Running 0/1 Sep 11,2025 21:50 UTC+0800 ops_status:mysql-yseslc-expose-zpqsh ns-kcduy Expose mysql-yseslc mysql Running 0/1 Sep 11,2025 21:50 UTC+0800 ops_status:mysql-yseslc-expose-zpqsh ns-kcduy Expose mysql-yseslc mysql Running 0/1 Sep 11,2025 21:50 UTC+0800 ops_status:mysql-yseslc-expose-zpqsh ns-kcduy Expose mysql-yseslc mysql Running 0/1 Sep 11,2025 21:50 UTC+0800 ops_status:mysql-yseslc-expose-zpqsh ns-kcduy Expose mysql-yseslc mysql Running 0/1 Sep 11,2025 21:50 UTC+0800 ops_status:mysql-yseslc-expose-zpqsh ns-kcduy Expose mysql-yseslc mysql Running 0/1 Sep 11,2025 21:50 UTC+0800 ops_status:mysql-yseslc-expose-zpqsh ns-kcduy Expose mysql-yseslc mysql Running 0/1 Sep 11,2025 21:50 UTC+0800 ops_status:mysql-yseslc-expose-zpqsh ns-kcduy Expose mysql-yseslc mysql Running 0/1 Sep 11,2025 21:50 UTC+0800 ops_status:mysql-yseslc-expose-zpqsh ns-kcduy Expose mysql-yseslc mysql Running 0/1 Sep 11,2025 21:50 UTC+0800 ops_status:mysql-yseslc-expose-zpqsh ns-kcduy Expose mysql-yseslc mysql Running 0/1 Sep 11,2025 21:50 UTC+0800 ops_status:mysql-yseslc-expose-zpqsh ns-kcduy Expose mysql-yseslc mysql Running 0/1 Sep 11,2025 21:50 UTC+0800 ops_status:mysql-yseslc-expose-zpqsh ns-kcduy Expose mysql-yseslc mysql Running 0/1 Sep 11,2025 21:50 UTC+0800 ops_status:mysql-yseslc-expose-zpqsh ns-kcduy Expose mysql-yseslc mysql Running 0/1 Sep 11,2025 21:50 UTC+0800 ops_status:mysql-yseslc-expose-zpqsh ns-kcduy Expose mysql-yseslc mysql Running 0/1 Sep 11,2025 21:50 UTC+0800 check ops status done ops_status:mysql-yseslc-expose-zpqsh ns-kcduy Expose mysql-yseslc mysql Succeed 1/1 Sep 11,2025 21:50 UTC+0800 `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge opsrequests.operations mysql-yseslc-expose-zpqsh --namespace ns-kcduy ` opsrequest.operations.kubeblocks.io/mysql-yseslc-expose-zpqsh patched `kbcli cluster delete-ops --name mysql-yseslc-expose-zpqsh --force --auto-approve --namespace ns-kcduy ` OpsRequest mysql-yseslc-expose-zpqsh deleted `kubectl get secrets -l app.kubernetes.io/instance=mysql-yseslc` set secret: mysql-yseslc-mysql-account-root `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:94J7Xw74tE;DB_PORT:3306;DB_DATABASE:mysql check db_client batch data count `echo "echo \"select count(*) from executions_loop.executions_loop_table;\" | mysql -P3306 -hmysql-yseslc-mysql.ns-kcduy.svc.cluster.local -uroot -p'94J7Xw74tE' " | kubectl exec -it mysql-yseslc-mysql-1 --namespace ns-kcduy -- bash ` check db_client batch data Success `kubectl get secrets -l app.kubernetes.io/instance=mysql-yseslc` set secret: mysql-yseslc-mysql-account-root `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysql-yseslc-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:94J7Xw74tE;DB_PORT:3306;DB_DATABASE:mysql check readonly db_client batch data count `echo "echo \"select count(*) from executions_loop.executions_loop_table;\" | mysql -P3306 -h127.0.0.1 -uroot -p'94J7Xw74tE' " | kubectl exec -it mysql-yseslc-mysql-2 --namespace ns-kcduy -- bash ` check readonly db_client batch data Success delete cluster mysql-yseslc `kbcli cluster delete mysql-yseslc --auto-approve --namespace ns-kcduy ` Cluster mysql-yseslc deleted pod_info:mysql-yseslc-mysql-1 4/4 Running 0 21m mysql-yseslc-mysql-2 4/4 Running 0 7m22s mysql-yseslc-proxysql-0 1/1 Running 0 6m7s pod_info:mysql-yseslc-mysql-1 4/4 Running 0 21m mysql-yseslc-mysql-2 4/4 Running 0 7m42s mysql-yseslc-proxysql-0 1/1 Terminating 0 6m27s pod_info:mysql-yseslc-mysql-1 4/4 Terminating 0 21m No resources found in ns-kcduy namespace. delete cluster pod done No resources found in ns-kcduy namespace. check cluster resource non-exist OK: pvc No resources found in ns-kcduy namespace. delete cluster done No resources found in ns-kcduy namespace. No resources found in ns-kcduy namespace. No resources found in ns-kcduy namespace. Mysql Test Suite All Done! Test Engine: mysql Test Type: 21 --------------------------------------Mysql Proxysql (Topology = semisync-proxysql Replicas 2) Test Result-------------------------------------- [PASSED]|[Create]|[ComponentDefinition=mysql-8.0-1.0.1;ComponentVersion=mysql;ServiceVersion=8.0.30;]|[Description=Create a cluster with the specified component definition mysql-8.0-1.0.1 and component version mysql and service version 8.0.30] [PASSED]|[Connect]|[ComponentName=mysql]|[Description=Connect to the cluster] [PASSED]|[Expose]|[Enable=true;TYPE=intranet;ComponentName=mysql]|[Description=Expose Enable the intranet service with mysql component] [PASSED]|[No-Failover]|[HA=Connection Stress;ComponentName=mysql]|[Description=Simulates conditions where pods experience connection stress either due to expected/undesired processes thereby testing the application's resilience to potential slowness/unavailability of some replicas due to high Connection load.] [PASSED]|[Failover]|[HA=Network Corrupt;Durations=2m;ComponentName=mysql]|[Description=Simulates network corrupt fault thereby testing the application's resilience to potential slowness/unavailability of some replicas due to corrupt network.] [PASSED]|[SwitchOver]|[ComponentName=mysql]|[Description=SwitchOver the cluster specify component mysql] [PASSED]|[Bench]|[ComponentName=mysql]|[Description=Bench the cluster service with mysql component] [PASSED]|[Bench]|[HostType=LB;ComponentName=mysql]|[Description=Bench the cluster LB service with mysql component] [PASSED]|[Reconfiguring]|[ComponentName=mysql;binlog_expire_logs_seconds=691200]|[Description=Reconfiguring the cluster specify component mysql set binlog_expire_logs_seconds=691200] [PASSED]|[Update]|[Monitor=true]|[Description=Update the cluster Monitor enable] [PASSED]|[No-Failover]|[HA=Network Delay;Durations=2m;ComponentName=mysql]|[Description=Simulates network delay fault thereby testing the application's resilience to potential slowness/unavailability of some replicas due to delay network.] [PASSED]|[Restart]|[-]|[Description=Restart the cluster] [PASSED]|[No-Failover]|[HA=Network Duplicate;Durations=2m;ComponentName=mysql]|[Description=Simulates network duplicate fault thereby testing the application's resilience to potential slowness/unavailability of some replicas due to duplicate network.] [PASSED]|[Failover]|[HA=Kill 1;ComponentName=mysql]|[Description=Simulates conditions where process 1 killed either due to expected/undesired processes thereby testing the application's resilience to unavailability of some replicas due to abnormal termination signals.] [PASSED]|[No-Failover]|[HA=Full CPU;Durations=2m;ComponentName=mysql]|[Description=Simulates conditions where pods experience CPU full either due to expected/undesired processes thereby testing the application's resilience to potential slowness/unavailability of some replicas due to high CPU load.] [PASSED]|[No-Failover]|[HA=DNS Error;Durations=2m;ComponentName=mysql]|[Description=Simulates conditions where pods experience DNS service errors for a period of time either due to expected/undesired processes thereby testing the application's resilience to potential slowness/unavailability of some replicas due to DNS service errors.] [PASSED]|[No-Failover]|[HA=Network Partition;Durations=2m;ComponentName=mysql]|[Description=Simulates network partition fault thereby testing the application's resilience to potential slowness/unavailability of some replicas due to partition network.] [PASSED]|[No-Failover]|[HA=DNS Random;Durations=2m;ComponentName=mysql]|[Description=Simulates conditions where pods experience random IP addresses being returned by the DNS service for a period of time either due to expected/undesired processes thereby testing the application's resilience to potential slowness/unavailability of some replicas due to the DNS service returning random IP addresses.] [PASSED]|[VerticalScaling]|[ComponentName=mysql]|[Description=VerticalScaling the cluster specify component mysql] [PASSED]|[Upgrade]|[ComponentName=mysql;ComponentVersionFrom=8.0.30;ComponentVersionTo=8.0.31]|[Description=Upgrade the cluster specify component mysql service version from 8.0.30 to 8.0.31] [PASSED]|[Upgrade]|[ComponentName=mysql;ComponentVersionFrom=8.0.31;ComponentVersionTo=8.0.32]|[Description=Upgrade the cluster specify component mysql service version from 8.0.31 to 8.0.32] [PASSED]|[Upgrade]|[ComponentName=mysql;ComponentVersionFrom=8.0.32;ComponentVersionTo=8.0.33]|[Description=Upgrade the cluster specify component mysql service version from 8.0.32 to 8.0.33] [PASSED]|[Upgrade]|[ComponentName=mysql;ComponentVersionFrom=8.0.33;ComponentVersionTo=8.0.34]|[Description=Upgrade the cluster specify component mysql service version from 8.0.33 to 8.0.34] [PASSED]|[Upgrade]|[ComponentName=mysql;ComponentVersionFrom=8.0.34;ComponentVersionTo=8.0.35]|[Description=Upgrade the cluster specify component mysql service version from 8.0.34 to 8.0.35] [PASSED]|[Upgrade]|[ComponentName=mysql;ComponentVersionFrom=8.0.35;ComponentVersionTo=8.0.39]|[Description=Upgrade the cluster specify component mysql service version from 8.0.35 to 8.0.39] [PASSED]|[Upgrade]|[ComponentName=mysql;ComponentVersionFrom=8.0.39;ComponentVersionTo=8.0.35]|[Description=Upgrade the cluster specify component mysql service version from 8.0.39 to 8.0.35] [PASSED]|[Upgrade]|[ComponentName=mysql;ComponentVersionFrom=8.0.35;ComponentVersionTo=8.0.36]|[Description=Upgrade the cluster specify component mysql service version from 8.0.35 to 8.0.36] [PASSED]|[Upgrade]|[ComponentName=mysql;ComponentVersionFrom=8.0.36;ComponentVersionTo=8.0.39]|[Description=Upgrade the cluster specify component mysql service version from 8.0.36 to 8.0.39] [PASSED]|[Upgrade]|[ComponentName=mysql;ComponentVersionFrom=8.0.39;ComponentVersionTo=8.0.36]|[Description=Upgrade the cluster specify component mysql service version from 8.0.39 to 8.0.36] [PASSED]|[Upgrade]|[ComponentName=mysql;ComponentVersionFrom=8.0.36;ComponentVersionTo=8.0.37]|[Description=Upgrade the cluster specify component mysql service version from 8.0.36 to 8.0.37] [PASSED]|[Upgrade]|[ComponentName=mysql;ComponentVersionFrom=8.0.37;ComponentVersionTo=8.0.39]|[Description=Upgrade the cluster specify component mysql service version from 8.0.37 to 8.0.39] [PASSED]|[Upgrade]|[ComponentName=mysql;ComponentVersionFrom=8.0.39;ComponentVersionTo=8.0.37]|[Description=Upgrade the cluster specify component mysql service version from 8.0.39 to 8.0.37] [PASSED]|[Upgrade]|[ComponentName=mysql;ComponentVersionFrom=8.0.37;ComponentVersionTo=8.0.38]|[Description=Upgrade the cluster specify component mysql service version from 8.0.37 to 8.0.38] [PASSED]|[Upgrade]|[ComponentName=mysql;ComponentVersionFrom=8.0.38;ComponentVersionTo=8.0.39]|[Description=Upgrade the cluster specify component mysql service version from 8.0.38 to 8.0.39] [PASSED]|[Upgrade]|[ComponentName=mysql;ComponentVersionFrom=8.0.39;ComponentVersionTo=8.0.38]|[Description=Upgrade the cluster specify component mysql service version from 8.0.39 to 8.0.38] [PASSED]|[Stop]|[-]|[Description=Stop the cluster] [PASSED]|[Start]|[-]|[Description=Start the cluster] [PASSED]|[VolumeExpansion]|[ComponentName=mysql]|[Description=VolumeExpansion the cluster specify component mysql] [PASSED]|[Failover]|[HA=Pod Failure;Durations=2m;ComponentName=mysql]|[Description=Simulates conditions where pods experience failure for a period of time either due to expected/undesired processes thereby testing the application's resilience to potential slowness/unavailability of some replicas due to failure.] [PASSED]|[Failover]|[HA=Network Loss;Durations=2m;ComponentName=mysql]|[Description=Simulates network loss fault thereby testing the application's resilience to potential slowness/unavailability of some replicas due to loss network.] [PASSED]|[Failover]|[HA=OOM;Durations=2m;ComponentName=mysql]|[Description=Simulates conditions where pods experience OOM either due to expected/undesired processes thereby testing the application's resilience to potential slowness/unavailability of some replicas due to high Memory load.] [PASSED]|[Failover]|[HA=Pod Kill;ComponentName=mysql]|[Description=Simulates conditions where pods experience kill for a period of time either due to expected/undesired processes thereby testing the application's resilience to potential slowness/unavailability of some replicas due to kill.] [PASSED]|[Failover]|[HA=Network Bandwidth;Durations=2m;ComponentName=mysql]|[Description=Simulates network bandwidth fault thereby testing the application's resilience to potential slowness/unavailability of some replicas due to bandwidth network.] [PASSED]|[HorizontalScaling Out]|[ComponentName=mysql]|[Description=HorizontalScaling Out the cluster specify component mysql] [PASSED]|[HorizontalScaling In]|[ComponentName=mysql]|[Description=HorizontalScaling In the cluster specify component mysql] [PASSED]|[No-Failover]|[HA=Time Offset;Durations=2m;ComponentName=mysql]|[Description=Simulates a time offset scenario thereby testing the application's resilience to potential slowness/unavailability of some replicas due to time offset.] [PASSED]|[Update]|[TerminationPolicy=WipeOut]|[Description=Update the cluster TerminationPolicy WipeOut] [PASSED]|[Backup]|[Schedule=true;BackupMethod=xtrabackup]|[Description=The cluster Schedule xtrabackup Backup] [PASSED]|[Restore]|[Schedule=true;BackupMethod=xtrabackup]|[Description=The cluster Schedule xtrabackup Restore] [PASSED]|[Connect]|[ComponentName=mysql]|[Description=Connect to the cluster] [PASSED]|[Delete Restore Cluster]|[Schedule=true;BackupMethod=xtrabackup]|[Description=Delete the Schedule xtrabackup restore cluster] [PASSED]|[Backup]|[BackupMethod=xtrabackup]|[Description=The cluster xtrabackup Backup] [PASSED]|[Restore]|[BackupMethod=xtrabackup]|[Description=The cluster xtrabackup Restore] [PASSED]|[Connect]|[ComponentName=mysql]|[Description=Connect to the cluster] [PASSED]|[Delete Restore Cluster]|[BackupMethod=xtrabackup]|[Description=Delete the xtrabackup restore cluster] [PASSED]|[RebuildInstance]|[ComponentName=mysql]|[Description=Rebuild the cluster instance specify component mysql] [PASSED]|[Backup]|[BackupMethod=xtrabackup]|[Description=The cluster xtrabackup Backup] [PASSED]|[Backup]|[BackupMethod=xtrabackup-inc]|[Description=The cluster xtrabackup-inc Backup] [PASSED]|[Restore Increment]|[BackupMethod=xtrabackup]|[Description=The cluster xtrabackup Restore Increment] [PASSED]|[Connect]|[ComponentName=mysql]|[Description=Connect to the cluster] [PASSED]|[Delete Restore Cluster]|[BackupMethod=xtrabackup]|[Description=Delete the xtrabackup restore cluster] [PASSED]|[Expose]|[Disable=true;TYPE=intranet;ComponentName=mysql]|[Description=Expose Disable the intranet service with mysql component] [PASSED]|[Delete]|[-]|[Description=Delete the cluster] [END]