source commons files source engines files source kubeblocks files `kubectl get namespace | grep ns-eiqjs ` `kubectl create namespace ns-eiqjs` namespace/ns-eiqjs created create namespace ns-eiqjs done download kbcli `gh release list --repo apecloud/kbcli --limit 100 | (grep "0.9" || true)` `curl -fsSL https://kubeblocks.io/installer/install_cli.sh | bash -s v0.9.4-beta.1` Your system is linux_amd64 Installing kbcli ... Downloading ... % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 32.1M 100 32.1M 0 0 96.1M 0 --:--:-- --:--:-- --:--:-- 96.1M kbcli installed successfully. Kubernetes: v1.32.5-eks-5d4a308 KubeBlocks: 0.9.4 kbcli: 0.9.4-beta.1 WARNING: version difference between kbcli (0.9.4-beta.1) and kubeblocks (0.9.4) Make sure your docker service is running and begin your journey with kbcli: kbcli playground init For more information on how to get started, please visit: https://kubeblocks.io download kbcli v0.9.4-beta.1 done Kubernetes: v1.32.5-eks-5d4a308 KubeBlocks: 0.9.4 kbcli: 0.9.4-beta.1 WARNING: version difference between kbcli (0.9.4-beta.1) and kubeblocks (0.9.4) Kubernetes Env: v1.32.5-eks-5d4a308 POD_RESOURCES: No resources found found default storage class: gp3 kubeblocks version is:0.9.4 skip upgrade kubeblocks Error: no repositories to show helm repo add chaos-mesh https://charts.chaos-mesh.org "chaos-mesh" has been added to your repositories add helm chart repo chaos-mesh success chaos mesh already installed set component name:minio set component version set component version:minio set service versions:0.9.0 set service versions sorted:0.9.0 no cluster version found set replicas first:1 set replicas third:1 set minimum cmpv service version set minimum cmpv service version replicas:1 REPORT_COUNT:1 CLUSTER_TOPOLOGY: Error from server (NotFound): clusterdefinitions.apps.kubeblocks.io "minio" not found Not found topology in cluster definition minio LIMIT_CPU:0.1 LIMIT_MEMORY:0.5 storage size: 1 No resources found in ns-eiqjs namespace. termination_policy:Delete create 2 replica Delete minio cluster check component definition set component definition by component version check cmpd by labels set component definition2: minio by component version:minio apiVersion: apps.kubeblocks.io/v1alpha1 kind: Cluster metadata: name: minio-ugzmry namespace: ns-eiqjs spec: terminationPolicy: Delete componentSpecs: - componentDef: minio name: minio replicas: 2 env: - name: MINIO_BUCKETS name: minio resources: limits: cpu: 100m memory: 0.5Gi requests: cpu: 100m memory: 0.5Gi volumeClaimTemplates: - name: data spec: storageClassName: accessModes: - ReadWriteOnce resources: requests: storage: 1Gi `kubectl apply -f test_create_minio-ugzmry.yaml` cluster.apps.kubeblocks.io/minio-ugzmry created apply test_create_minio-ugzmry.yaml Success `rm -rf test_create_minio-ugzmry.yaml` check cluster status `kbcli cluster list minio-ugzmry --show-labels --namespace ns-eiqjs ` NAME NAMESPACE CLUSTER-DEFINITION VERSION TERMINATION-POLICY STATUS CREATED-TIME LABELS minio-ugzmry ns-eiqjs Delete Jun 19,2025 18:13 UTC+0800 cluster_status: cluster_status:Creating cluster_status:Creating cluster_status:Creating check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances minio-ugzmry --namespace ns-eiqjs ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME minio-ugzmry-minio-0 ns-eiqjs minio-ugzmry minio Running readwrite us-west-2a 100m / 100m 512Mi / 512Mi data:1Gi ip-172-31-13-192.us-west-2.compute.internal/172.31.13.192 Jun 19,2025 18:13 UTC+0800 minio-ugzmry-minio-1 ns-eiqjs minio-ugzmry minio Running readwrite us-west-2a 100m / 100m 512Mi / 512Mi data:1Gi ip-172-31-1-27.us-west-2.compute.internal/172.31.1.27 Jun 19,2025 18:13 UTC+0800 check pod status done connect unsupported engine type: minio minio `kubectl get secrets -l app.kubernetes.io/instance=minio-ugzmry` `kubectl get secrets minio-ugzmry-minio-account-root -o jsonpath="***.data.username***"` `kubectl get secrets minio-ugzmry-minio-account-root -o jsonpath="***.data.password***"` `kubectl get secrets minio-ugzmry-minio-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:ioKb4N6TX0820R70;DB_PORT:9000;DB_DATABASE: check pod minio-ugzmry-minio-0 container_name minio exist password ioKb4N6TX0820R70 check pod minio-ugzmry-minio-0 container_name lorry exist password ioKb4N6TX0820R70 No container logs contain secret password. describe cluster `kbcli cluster describe minio-ugzmry --namespace ns-eiqjs ` Name: minio-ugzmry Created Time: Jun 19,2025 18:13 UTC+0800 NAMESPACE CLUSTER-DEFINITION VERSION STATUS TERMINATION-POLICY ns-eiqjs Running Delete Endpoints: COMPONENT MODE INTERNAL EXTERNAL minio ReadWrite minio-ugzmry-minio.ns-eiqjs.svc.cluster.local:9000 minio-ugzmry-minio.ns-eiqjs.svc.cluster.local:9001 Topology: COMPONENT INSTANCE ROLE STATUS AZ NODE CREATED-TIME minio minio-ugzmry-minio-0 readwrite Running us-west-2a ip-172-31-13-192.us-west-2.compute.internal/172.31.13.192 Jun 19,2025 18:13 UTC+0800 minio minio-ugzmry-minio-1 readwrite Running us-west-2a ip-172-31-1-27.us-west-2.compute.internal/172.31.1.27 Jun 19,2025 18:13 UTC+0800 Resources Allocation: COMPONENT DEDICATED CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE-SIZE STORAGE-CLASS minio false 100m / 100m 512Mi / 512Mi data:1Gi kb-default-sc Images: COMPONENT TYPE IMAGE minio docker.io/apecloud/minio:RELEASE.2024-06-29T01-20-47Z Show cluster events: kbcli cluster list-events -n ns-eiqjs minio-ugzmry `kbcli cluster label minio-ugzmry app.kubernetes.io/instance- --namespace ns-eiqjs ` label "app.kubernetes.io/instance" not found. `kbcli cluster label minio-ugzmry app.kubernetes.io/instance=minio-ugzmry --namespace ns-eiqjs ` `kbcli cluster label minio-ugzmry --list --namespace ns-eiqjs ` NAME NAMESPACE LABELS minio-ugzmry ns-eiqjs app.kubernetes.io/instance=minio-ugzmry label cluster app.kubernetes.io/instance=minio-ugzmry Success `kbcli cluster label case.name=kbcli.test1 -l app.kubernetes.io/instance=minio-ugzmry --namespace ns-eiqjs ` `kbcli cluster label minio-ugzmry --list --namespace ns-eiqjs ` NAME NAMESPACE LABELS minio-ugzmry ns-eiqjs app.kubernetes.io/instance=minio-ugzmry case.name=kbcli.test1 label cluster case.name=kbcli.test1 Success `kbcli cluster label minio-ugzmry case.name=kbcli.test2 --overwrite --namespace ns-eiqjs ` `kbcli cluster label minio-ugzmry --list --namespace ns-eiqjs ` NAME NAMESPACE LABELS minio-ugzmry ns-eiqjs app.kubernetes.io/instance=minio-ugzmry case.name=kbcli.test2 label cluster case.name=kbcli.test2 Success `kbcli cluster label minio-ugzmry case.name- --namespace ns-eiqjs ` `kbcli cluster label minio-ugzmry --list --namespace ns-eiqjs ` NAME NAMESPACE LABELS minio-ugzmry ns-eiqjs app.kubernetes.io/instance=minio-ugzmry delete cluster label case.name Success cluster connect insert batch data by db client Error from server (NotFound): pods "test-db-client-executionloop-minio-ugzmry" not found DB_CLIENT_BATCH_DATA_COUNT: `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge pods test-db-client-executionloop-minio-ugzmry --namespace ns-eiqjs ` Error from server (NotFound): pods "test-db-client-executionloop-minio-ugzmry" not found Warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely. Error from server (NotFound): pods "test-db-client-executionloop-minio-ugzmry" not found `kubectl get secrets -l app.kubernetes.io/instance=minio-ugzmry` `kubectl get secrets minio-ugzmry-minio-account-root -o jsonpath="***.data.username***"` `kubectl get secrets minio-ugzmry-minio-account-root -o jsonpath="***.data.password***"` `kubectl get secrets minio-ugzmry-minio-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:ioKb4N6TX0820R70;DB_PORT:9000;DB_DATABASE: apiVersion: v1 kind: Pod metadata: name: test-db-client-executionloop-minio-ugzmry namespace: ns-eiqjs spec: containers: - name: test-dbclient imagePullPolicy: IfNotPresent image: docker.io/apecloud/dbclient:test args: - "--host" - "minio-ugzmry-minio.ns-eiqjs.svc.cluster.local" - "--user" - "root" - "--password" - "ioKb4N6TX0820R70" - "--port" - "9000" - "--dbtype" - "minio" - "--test" - "executionloop" - "--duration" - "60" - "--interval" - "1" restartPolicy: Never `kubectl apply -f test-db-client-executionloop-minio-ugzmry.yaml` pod/test-db-client-executionloop-minio-ugzmry created apply test-db-client-executionloop-minio-ugzmry.yaml Success `rm -rf test-db-client-executionloop-minio-ugzmry.yaml` check pod status pod_status:NAME READY STATUS RESTARTS AGE test-db-client-executionloop-minio-ugzmry 0/1 ContainerCreating 0 6s pod_status:NAME READY STATUS RESTARTS AGE test-db-client-executionloop-minio-ugzmry 0/1 ContainerCreating 0 11s pod_status:NAME READY STATUS RESTARTS AGE test-db-client-executionloop-minio-ugzmry 1/1 Running 0 16s pod_status:NAME READY STATUS RESTARTS AGE test-db-client-executionloop-minio-ugzmry 1/1 Running 0 22s pod_status:NAME READY STATUS RESTARTS AGE test-db-client-executionloop-minio-ugzmry 1/1 Running 0 28s pod_status:NAME READY STATUS RESTARTS AGE test-db-client-executionloop-minio-ugzmry 1/1 Running 0 34s pod_status:NAME READY STATUS RESTARTS AGE test-db-client-executionloop-minio-ugzmry 1/1 Running 0 40s pod_status:NAME READY STATUS RESTARTS AGE test-db-client-executionloop-minio-ugzmry 1/1 Running 0 46s pod_status:NAME READY STATUS RESTARTS AGE test-db-client-executionloop-minio-ugzmry 1/1 Running 0 52s pod_status:NAME READY STATUS RESTARTS AGE test-db-client-executionloop-minio-ugzmry 1/1 Running 0 58s pod_status:NAME READY STATUS RESTARTS AGE test-db-client-executionloop-minio-ugzmry 1/1 Running 0 64s pod_status:NAME READY STATUS RESTARTS AGE test-db-client-executionloop-minio-ugzmry 1/1 Running 0 70s check pod test-db-client-executionloop-minio-ugzmry status done pod_status:NAME READY STATUS RESTARTS AGE test-db-client-executionloop-minio-ugzmry 0/1 Completed 0 76s check cluster status `kbcli cluster list minio-ugzmry --show-labels --namespace ns-eiqjs ` NAME NAMESPACE CLUSTER-DEFINITION VERSION TERMINATION-POLICY STATUS CREATED-TIME LABELS minio-ugzmry ns-eiqjs Delete Running Jun 19,2025 18:13 UTC+0800 app.kubernetes.io/instance=minio-ugzmry check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances minio-ugzmry --namespace ns-eiqjs ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME minio-ugzmry-minio-0 ns-eiqjs minio-ugzmry minio Running readwrite us-west-2a 100m / 100m 512Mi / 512Mi data:1Gi ip-172-31-13-192.us-west-2.compute.internal/172.31.13.192 Jun 19,2025 18:13 UTC+0800 minio-ugzmry-minio-1 ns-eiqjs minio-ugzmry minio Running readwrite us-west-2a 100m / 100m 512Mi / 512Mi data:1Gi ip-172-31-1-27.us-west-2.compute.internal/172.31.1.27 Jun 19,2025 18:13 UTC+0800 check pod status done connect unsupported engine type: minio minio --host minio-ugzmry-minio.ns-eiqjs.svc.cluster.local --user root --password ioKb4N6TX0820R70 --port 9000 --dbtype minio --test executionloop --duration 60 --interval 1 Execution loop start: Bucket executions-loop-bucket does not exist. Creating bucket... Bucket executions-loop-bucket created successfully. Execution loop start: executions_loop_1 [ 1s ] executions total: 15 successful: 15 failed: 0 disconnect: 0 [ 2s ] executions total: 34 successful: 34 failed: 0 disconnect: 0 [ 3s ] executions total: 52 successful: 52 failed: 0 disconnect: 0 [ 4s ] executions total: 70 successful: 70 failed: 0 disconnect: 0 [ 5s ] executions total: 89 successful: 89 failed: 0 disconnect: 0 [ 6s ] executions total: 111 successful: 111 failed: 0 disconnect: 0 [ 7s ] executions total: 130 successful: 130 failed: 0 disconnect: 0 [ 8s ] executions total: 150 successful: 150 failed: 0 disconnect: 0 [ 9s ] executions total: 171 successful: 171 failed: 0 disconnect: 0 [ 10s ] executions total: 191 successful: 191 failed: 0 disconnect: 0 [ 11s ] executions total: 210 successful: 210 failed: 0 disconnect: 0 [ 12s ] executions total: 230 successful: 230 failed: 0 disconnect: 0 [ 13s ] executions total: 251 successful: 251 failed: 0 disconnect: 0 [ 14s ] executions total: 271 successful: 271 failed: 0 disconnect: 0 [ 15s ] executions total: 293 successful: 293 failed: 0 disconnect: 0 [ 16s ] executions total: 314 successful: 314 failed: 0 disconnect: 0 [ 17s ] executions total: 333 successful: 333 failed: 0 disconnect: 0 [ 18s ] executions total: 355 successful: 355 failed: 0 disconnect: 0 [ 19s ] executions total: 377 successful: 377 failed: 0 disconnect: 0 [ 20s ] executions total: 398 successful: 398 failed: 0 disconnect: 0 [ 21s ] executions total: 417 successful: 417 failed: 0 disconnect: 0 [ 22s ] executions total: 435 successful: 435 failed: 0 disconnect: 0 [ 23s ] executions total: 453 successful: 453 failed: 0 disconnect: 0 [ 24s ] executions total: 471 successful: 471 failed: 0 disconnect: 0 [ 25s ] executions total: 487 successful: 487 failed: 0 disconnect: 0 [ 26s ] executions total: 506 successful: 506 failed: 0 disconnect: 0 [ 27s ] executions total: 522 successful: 522 failed: 0 disconnect: 0 [ 28s ] executions total: 540 successful: 540 failed: 0 disconnect: 0 [ 29s ] executions total: 558 successful: 558 failed: 0 disconnect: 0 [ 30s ] executions total: 569 successful: 569 failed: 0 disconnect: 0 [ 31s ] executions total: 587 successful: 587 failed: 0 disconnect: 0 [ 32s ] executions total: 608 successful: 608 failed: 0 disconnect: 0 [ 33s ] executions total: 630 successful: 630 failed: 0 disconnect: 0 [ 34s ] executions total: 648 successful: 648 failed: 0 disconnect: 0 [ 35s ] executions total: 667 successful: 667 failed: 0 disconnect: 0 [ 36s ] executions total: 685 successful: 685 failed: 0 disconnect: 0 [ 37s ] executions total: 705 successful: 705 failed: 0 disconnect: 0 [ 38s ] executions total: 724 successful: 724 failed: 0 disconnect: 0 [ 39s ] executions total: 745 successful: 745 failed: 0 disconnect: 0 [ 40s ] executions total: 765 successful: 765 failed: 0 disconnect: 0 [ 41s ] executions total: 784 successful: 784 failed: 0 disconnect: 0 [ 42s ] executions total: 804 successful: 804 failed: 0 disconnect: 0 [ 43s ] executions total: 824 successful: 824 failed: 0 disconnect: 0 [ 44s ] executions total: 844 successful: 844 failed: 0 disconnect: 0 [ 45s ] executions total: 867 successful: 867 failed: 0 disconnect: 0 [ 46s ] executions total: 883 successful: 883 failed: 0 disconnect: 0 [ 47s ] executions total: 900 successful: 900 failed: 0 disconnect: 0 [ 48s ] executions total: 909 successful: 909 failed: 0 disconnect: 0 [ 49s ] executions total: 931 successful: 931 failed: 0 disconnect: 0 [ 50s ] executions total: 943 successful: 943 failed: 0 disconnect: 0 [ 51s ] executions total: 952 successful: 952 failed: 0 disconnect: 0 [ 52s ] executions total: 972 successful: 972 failed: 0 disconnect: 0 [ 53s ] executions total: 990 successful: 990 failed: 0 disconnect: 0 [ 54s ] executions total: 1009 successful: 1009 failed: 0 disconnect: 0 [ 55s ] executions total: 1028 successful: 1028 failed: 0 disconnect: 0 [ 56s ] executions total: 1047 successful: 1047 failed: 0 disconnect: 0 [ 57s ] executions total: 1067 successful: 1067 failed: 0 disconnect: 0 [ 58s ] executions total: 1086 successful: 1086 failed: 0 disconnect: 0 [ 60s ] executions total: 1091 successful: 1091 failed: 0 disconnect: 0 Test Result: Total Executions: 1091 Successful Executions: 1091 Failed Executions: 0 Disconnection Counts: 0 Connection Information: Database Type: minio Host: minio-ugzmry-minio.ns-eiqjs.svc.cluster.local Port: 9000 Database: Table: User: root Org: Access Mode: mysql Test Type: executionloop Query: Duration: 60 seconds Interval: 1 seconds Bucket: DB_CLIENT_BATCH_DATA_COUNT: 1091 `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge pods test-db-client-executionloop-minio-ugzmry --namespace ns-eiqjs ` pod/test-db-client-executionloop-minio-ugzmry patched (no change) Warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely. pod "test-db-client-executionloop-minio-ugzmry" force deleted `kubectl get secrets -l app.kubernetes.io/instance=minio-ugzmry` `kubectl get secrets minio-ugzmry-minio-account-root -o jsonpath="***.data.username***"` `kubectl get secrets minio-ugzmry-minio-account-root -o jsonpath="***.data.password***"` `kubectl get secrets minio-ugzmry-minio-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:ioKb4N6TX0820R70;DB_PORT:9000;DB_DATABASE: apiVersion: v1 kind: Pod metadata: name: benchtest-minio-ugzmry namespace: ns-eiqjs spec: containers: - name: test-benchmark image: docker.io/apecloud/mc:RELEASE.2023-10-24T21-42-22Z command: ["/bin/sh"] args: ["-c", "mc config host add minioserver http://minio-ugzmry-minio.ns-eiqjs.svc.cluster.local:9000 root ioKb4N6TX0820R70 && mc mb minioserver/bucket-bewta"] restartPolicy: Never `kubectl apply -f benchtest-minio-ugzmry.yaml` pod/benchtest-minio-ugzmry created apply benchtest-minio-ugzmry.yaml Success `rm -rf benchtest-minio-ugzmry.yaml` check pod status pod_status:NAME READY STATUS RESTARTS AGE benchtest-minio-ugzmry 0/1 ContainerCreating 0 0s check pod benchtest-minio-ugzmry status done pod_status:NAME READY STATUS RESTARTS AGE benchtest-minio-ugzmry 0/1 Completed 0 5s `kubectl logs benchtest-minio-ugzmry --tail 30 --namespace ns-eiqjs ` Added `minioserver` successfully. Bucket created successfully `minioserver/bucket-bewta`. `kubectl delete pod benchtest-minio-ugzmry --force --namespace ns-eiqjs ` Warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely. pod "benchtest-minio-ugzmry" force deleted cluster vscale check cluster status before ops check cluster status done cluster_status:Running `kbcli cluster vscale minio-ugzmry --auto-approve --force=true --components minio --cpu 200m --memory 0.6Gi --namespace ns-eiqjs ` OpsRequest minio-ugzmry-verticalscaling-pvxkb created successfully, you can view the progress: kbcli cluster describe-ops minio-ugzmry-verticalscaling-pvxkb -n ns-eiqjs check ops status `kbcli cluster list-ops minio-ugzmry --status all --namespace ns-eiqjs ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME minio-ugzmry-verticalscaling-pvxkb ns-eiqjs VerticalScaling minio-ugzmry minio Running 0/2 Jun 19,2025 18:18 UTC+0800 check cluster status `kbcli cluster list minio-ugzmry --show-labels --namespace ns-eiqjs ` NAME NAMESPACE CLUSTER-DEFINITION VERSION TERMINATION-POLICY STATUS CREATED-TIME LABELS minio-ugzmry ns-eiqjs Delete Updating Jun 19,2025 18:13 UTC+0800 app.kubernetes.io/instance=minio-ugzmry cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances minio-ugzmry --namespace ns-eiqjs ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME minio-ugzmry-minio-0 ns-eiqjs minio-ugzmry minio Running readwrite us-west-2a 200m / 200m 644245094400m / 644245094400m data:1Gi ip-172-31-5-4.us-west-2.compute.internal/172.31.5.4 Jun 19,2025 18:18 UTC+0800 minio-ugzmry-minio-1 ns-eiqjs minio-ugzmry minio Running readwrite us-west-2a 200m / 200m 644245094400m / 644245094400m data:1Gi ip-172-31-1-27.us-west-2.compute.internal/172.31.1.27 Jun 19,2025 18:18 UTC+0800 check pod status done connect unsupported engine type: minio minio check ops status `kbcli cluster list-ops minio-ugzmry --status all --namespace ns-eiqjs ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME minio-ugzmry-verticalscaling-pvxkb ns-eiqjs VerticalScaling minio-ugzmry minio Succeed 2/2 Jun 19,2025 18:18 UTC+0800 check ops status done ops_status:minio-ugzmry-verticalscaling-pvxkb ns-eiqjs VerticalScaling minio-ugzmry minio Succeed 2/2 Jun 19,2025 18:18 UTC+0800 `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge opsrequests minio-ugzmry-verticalscaling-pvxkb --namespace ns-eiqjs ` opsrequest.apps.kubeblocks.io/minio-ugzmry-verticalscaling-pvxkb patched `kbcli cluster delete-ops --name minio-ugzmry-verticalscaling-pvxkb --force --auto-approve --namespace ns-eiqjs ` OpsRequest minio-ugzmry-verticalscaling-pvxkb deleted `kubectl get secrets -l app.kubernetes.io/instance=minio-ugzmry` `kubectl get secrets minio-ugzmry-minio-account-root -o jsonpath="***.data.username***"` `kubectl get secrets minio-ugzmry-minio-account-root -o jsonpath="***.data.password***"` `kubectl get secrets minio-ugzmry-minio-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:ioKb4N6TX0820R70;DB_PORT:9000;DB_DATABASE: check db_client batch data count `echo "mc config host add minioserver http://minio-ugzmry-minio.ns-eiqjs.svc.cluster.local:9000 root ioKb4N6TX0820R70;mc cat minioserver/executions-loop-bucket/executions_loop" | kubectl exec -it minio-ugzmry-minio-0 --namespace ns-eiqjs -- bash` check db_client batch data Success cluster stop check cluster status before ops check cluster status done cluster_status:Running `kbcli cluster stop minio-ugzmry --auto-approve --force=true --namespace ns-eiqjs ` OpsRequest minio-ugzmry-stop-k4l5r created successfully, you can view the progress: kbcli cluster describe-ops minio-ugzmry-stop-k4l5r -n ns-eiqjs check ops status `kbcli cluster list-ops minio-ugzmry --status all --namespace ns-eiqjs ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME minio-ugzmry-stop-k4l5r ns-eiqjs Stop minio-ugzmry minio Running 0/2 Jun 19,2025 18:19 UTC+0800 check cluster status `kbcli cluster list minio-ugzmry --show-labels --namespace ns-eiqjs ` NAME NAMESPACE CLUSTER-DEFINITION VERSION TERMINATION-POLICY STATUS CREATED-TIME LABELS minio-ugzmry ns-eiqjs Delete Stopped Jun 19,2025 18:13 UTC+0800 app.kubernetes.io/instance=minio-ugzmry check cluster status done cluster_status:Stopped check pod status `kbcli cluster list-instances minio-ugzmry --namespace ns-eiqjs ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME check pod status done check ops status `kbcli cluster list-ops minio-ugzmry --status all --namespace ns-eiqjs ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME minio-ugzmry-stop-k4l5r ns-eiqjs Stop minio-ugzmry minio Succeed 2/2 Jun 19,2025 18:19 UTC+0800 check ops status done ops_status:minio-ugzmry-stop-k4l5r ns-eiqjs Stop minio-ugzmry minio Succeed 2/2 Jun 19,2025 18:19 UTC+0800 `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge opsrequests minio-ugzmry-stop-k4l5r --namespace ns-eiqjs ` opsrequest.apps.kubeblocks.io/minio-ugzmry-stop-k4l5r patched `kbcli cluster delete-ops --name minio-ugzmry-stop-k4l5r --force --auto-approve --namespace ns-eiqjs ` OpsRequest minio-ugzmry-stop-k4l5r deleted cluster start check cluster status before ops check cluster status done cluster_status:Stopped `kbcli cluster start minio-ugzmry --force=true --namespace ns-eiqjs ` OpsRequest minio-ugzmry-start-llmmn created successfully, you can view the progress: kbcli cluster describe-ops minio-ugzmry-start-llmmn -n ns-eiqjs check ops status `kbcli cluster list-ops minio-ugzmry --status all --namespace ns-eiqjs ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME minio-ugzmry-start-llmmn ns-eiqjs Start minio-ugzmry minio Running 0/2 Jun 19,2025 18:19 UTC+0800 check cluster status `kbcli cluster list minio-ugzmry --show-labels --namespace ns-eiqjs ` NAME NAMESPACE CLUSTER-DEFINITION VERSION TERMINATION-POLICY STATUS CREATED-TIME LABELS minio-ugzmry ns-eiqjs Delete Updating Jun 19,2025 18:13 UTC+0800 app.kubernetes.io/instance=minio-ugzmry cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances minio-ugzmry --namespace ns-eiqjs ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME minio-ugzmry-minio-0 ns-eiqjs minio-ugzmry minio Running readwrite us-west-2a 200m / 200m 644245094400m / 644245094400m data:1Gi ip-172-31-1-27.us-west-2.compute.internal/172.31.1.27 Jun 19,2025 18:19 UTC+0800 minio-ugzmry-minio-1 ns-eiqjs minio-ugzmry minio Running readwrite us-west-2a 200m / 200m 644245094400m / 644245094400m data:1Gi ip-172-31-3-103.us-west-2.compute.internal/172.31.3.103 Jun 19,2025 18:20 UTC+0800 check pod status done connect unsupported engine type: minio minio check ops status `kbcli cluster list-ops minio-ugzmry --status all --namespace ns-eiqjs ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME minio-ugzmry-start-llmmn ns-eiqjs Start minio-ugzmry minio Succeed 2/2 Jun 19,2025 18:19 UTC+0800 check ops status done ops_status:minio-ugzmry-start-llmmn ns-eiqjs Start minio-ugzmry minio Succeed 2/2 Jun 19,2025 18:19 UTC+0800 `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge opsrequests minio-ugzmry-start-llmmn --namespace ns-eiqjs ` opsrequest.apps.kubeblocks.io/minio-ugzmry-start-llmmn patched `kbcli cluster delete-ops --name minio-ugzmry-start-llmmn --force --auto-approve --namespace ns-eiqjs ` OpsRequest minio-ugzmry-start-llmmn deleted `kubectl get secrets -l app.kubernetes.io/instance=minio-ugzmry` `kubectl get secrets minio-ugzmry-minio-account-root -o jsonpath="***.data.username***"` `kubectl get secrets minio-ugzmry-minio-account-root -o jsonpath="***.data.password***"` `kubectl get secrets minio-ugzmry-minio-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:ioKb4N6TX0820R70;DB_PORT:9000;DB_DATABASE: check db_client batch data count `echo "mc config host add minioserver http://minio-ugzmry-minio.ns-eiqjs.svc.cluster.local:9000 root ioKb4N6TX0820R70;mc cat minioserver/executions-loop-bucket/executions_loop" | kubectl exec -it minio-ugzmry-minio-0 --namespace ns-eiqjs -- bash` check db_client batch data Success cluster restart check cluster status before ops check cluster status done cluster_status:Running `kbcli cluster restart minio-ugzmry --auto-approve --force=true --namespace ns-eiqjs ` OpsRequest minio-ugzmry-restart-xspr7 created successfully, you can view the progress: kbcli cluster describe-ops minio-ugzmry-restart-xspr7 -n ns-eiqjs check ops status `kbcli cluster list-ops minio-ugzmry --status all --namespace ns-eiqjs ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME minio-ugzmry-restart-xspr7 ns-eiqjs Restart minio-ugzmry minio Running 0/2 Jun 19,2025 18:21 UTC+0800 check cluster status `kbcli cluster list minio-ugzmry --show-labels --namespace ns-eiqjs ` NAME NAMESPACE CLUSTER-DEFINITION VERSION TERMINATION-POLICY STATUS CREATED-TIME LABELS minio-ugzmry ns-eiqjs Delete Updating Jun 19,2025 18:13 UTC+0800 app.kubernetes.io/instance=minio-ugzmry cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances minio-ugzmry --namespace ns-eiqjs ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME minio-ugzmry-minio-0 ns-eiqjs minio-ugzmry minio Running readwrite us-west-2a 200m / 200m 644245094400m / 644245094400m data:1Gi ip-172-31-1-27.us-west-2.compute.internal/172.31.1.27 Jun 19,2025 18:21 UTC+0800 minio-ugzmry-minio-1 ns-eiqjs minio-ugzmry minio Running readwrite us-west-2a 200m / 200m 644245094400m / 644245094400m data:1Gi ip-172-31-3-103.us-west-2.compute.internal/172.31.3.103 Jun 19,2025 18:21 UTC+0800 check pod status done connect unsupported engine type: minio minio check ops status `kbcli cluster list-ops minio-ugzmry --status all --namespace ns-eiqjs ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME minio-ugzmry-restart-xspr7 ns-eiqjs Restart minio-ugzmry minio Succeed 2/2 Jun 19,2025 18:21 UTC+0800 check ops status done ops_status:minio-ugzmry-restart-xspr7 ns-eiqjs Restart minio-ugzmry minio Succeed 2/2 Jun 19,2025 18:21 UTC+0800 `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge opsrequests minio-ugzmry-restart-xspr7 --namespace ns-eiqjs ` opsrequest.apps.kubeblocks.io/minio-ugzmry-restart-xspr7 patched `kbcli cluster delete-ops --name minio-ugzmry-restart-xspr7 --force --auto-approve --namespace ns-eiqjs ` OpsRequest minio-ugzmry-restart-xspr7 deleted `kubectl get secrets -l app.kubernetes.io/instance=minio-ugzmry` `kubectl get secrets minio-ugzmry-minio-account-root -o jsonpath="***.data.username***"` `kubectl get secrets minio-ugzmry-minio-account-root -o jsonpath="***.data.password***"` `kubectl get secrets minio-ugzmry-minio-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:ioKb4N6TX0820R70;DB_PORT:9000;DB_DATABASE: check db_client batch data count `echo "mc config host add minioserver http://minio-ugzmry-minio.ns-eiqjs.svc.cluster.local:9000 root ioKb4N6TX0820R70;mc cat minioserver/executions-loop-bucket/executions_loop" | kubectl exec -it minio-ugzmry-minio-0 --namespace ns-eiqjs -- bash` check db_client batch data Success `kubectl get pvc -l app.kubernetes.io/instance=minio-ugzmry,apps.kubeblocks.io/component-name=minio,apps.kubeblocks.io/vct-name=data --namespace ns-eiqjs ` cluster volume-expand check cluster status before ops check cluster status done cluster_status:Running No resources found in minio-ugzmry namespace. `kbcli cluster volume-expand minio-ugzmry --auto-approve --force=true --components minio --volume-claim-templates data --storage 6Gi --namespace ns-eiqjs ` OpsRequest minio-ugzmry-volumeexpansion-dz5jr created successfully, you can view the progress: kbcli cluster describe-ops minio-ugzmry-volumeexpansion-dz5jr -n ns-eiqjs check ops status `kbcli cluster list-ops minio-ugzmry --status all --namespace ns-eiqjs ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME minio-ugzmry-volumeexpansion-dz5jr ns-eiqjs VolumeExpansion minio-ugzmry minio Running 0/2 Jun 19,2025 18:22 UTC+0800 check cluster status `kbcli cluster list minio-ugzmry --show-labels --namespace ns-eiqjs ` NAME NAMESPACE CLUSTER-DEFINITION VERSION TERMINATION-POLICY STATUS CREATED-TIME LABELS minio-ugzmry ns-eiqjs Delete Updating Jun 19,2025 18:13 UTC+0800 app.kubernetes.io/instance=minio-ugzmry cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances minio-ugzmry --namespace ns-eiqjs ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME minio-ugzmry-minio-0 ns-eiqjs minio-ugzmry minio Running readwrite us-west-2a 200m / 200m 644245094400m / 644245094400m data:6Gi ip-172-31-1-27.us-west-2.compute.internal/172.31.1.27 Jun 19,2025 18:21 UTC+0800 minio-ugzmry-minio-1 ns-eiqjs minio-ugzmry minio Running readwrite us-west-2a 200m / 200m 644245094400m / 644245094400m data:6Gi ip-172-31-3-103.us-west-2.compute.internal/172.31.3.103 Jun 19,2025 18:21 UTC+0800 check pod status done connect unsupported engine type: minio minio No resources found in minio-ugzmry namespace. check ops status `kbcli cluster list-ops minio-ugzmry --status all --namespace ns-eiqjs ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME minio-ugzmry-volumeexpansion-dz5jr ns-eiqjs VolumeExpansion minio-ugzmry minio Succeed 2/2 Jun 19,2025 18:22 UTC+0800 check ops status done ops_status:minio-ugzmry-volumeexpansion-dz5jr ns-eiqjs VolumeExpansion minio-ugzmry minio Succeed 2/2 Jun 19,2025 18:22 UTC+0800 `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge opsrequests minio-ugzmry-volumeexpansion-dz5jr --namespace ns-eiqjs ` opsrequest.apps.kubeblocks.io/minio-ugzmry-volumeexpansion-dz5jr patched `kbcli cluster delete-ops --name minio-ugzmry-volumeexpansion-dz5jr --force --auto-approve --namespace ns-eiqjs ` OpsRequest minio-ugzmry-volumeexpansion-dz5jr deleted `kubectl get secrets -l app.kubernetes.io/instance=minio-ugzmry` `kubectl get secrets minio-ugzmry-minio-account-root -o jsonpath="***.data.username***"` `kubectl get secrets minio-ugzmry-minio-account-root -o jsonpath="***.data.password***"` `kubectl get secrets minio-ugzmry-minio-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:ioKb4N6TX0820R70;DB_PORT:9000;DB_DATABASE: check db_client batch data count `echo "mc config host add minioserver http://minio-ugzmry-minio.ns-eiqjs.svc.cluster.local:9000 root ioKb4N6TX0820R70;mc cat minioserver/executions-loop-bucket/executions_loop" | kubectl exec -it minio-ugzmry-minio-0 --namespace ns-eiqjs -- bash` check db_client batch data Success test failover connectionstress check node drain check node drain success Error from server (NotFound): pods "test-db-client-connectionstress-minio-ugzmry" not found `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge pods test-db-client-connectionstress-minio-ugzmry --namespace ns-eiqjs ` Error from server (NotFound): pods "test-db-client-connectionstress-minio-ugzmry" not found Warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely. Error from server (NotFound): pods "test-db-client-connectionstress-minio-ugzmry" not found `kubectl get secrets -l app.kubernetes.io/instance=minio-ugzmry` `kubectl get secrets minio-ugzmry-minio-account-root -o jsonpath="***.data.username***"` `kubectl get secrets minio-ugzmry-minio-account-root -o jsonpath="***.data.password***"` `kubectl get secrets minio-ugzmry-minio-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:ioKb4N6TX0820R70;DB_PORT:9000;DB_DATABASE: apiVersion: v1 kind: Pod metadata: name: test-db-client-connectionstress-minio-ugzmry namespace: ns-eiqjs spec: containers: - name: test-dbclient imagePullPolicy: IfNotPresent image: docker.io/apecloud/dbclient:test args: - "--host" - "minio-ugzmry-minio.ns-eiqjs.svc.cluster.local" - "--user" - "root" - "--password" - "ioKb4N6TX0820R70" - "--port" - "9000" - "--database" - "" - "--dbtype" - "minio" - "--test" - "connectionstress" - "--connections" - "1024" - "--duration" - "60" restartPolicy: Never `kubectl apply -f test-db-client-connectionstress-minio-ugzmry.yaml` pod/test-db-client-connectionstress-minio-ugzmry created apply test-db-client-connectionstress-minio-ugzmry.yaml Success `rm -rf test-db-client-connectionstress-minio-ugzmry.yaml` check pod status pod_status:NAME READY STATUS RESTARTS AGE test-db-client-connectionstress-minio-ugzmry 0/1 ContainerCreating 0 6s pod_status:NAME READY STATUS RESTARTS AGE test-db-client-connectionstress-minio-ugzmry 1/1 Running 0 11s pod_status:NAME READY STATUS RESTARTS AGE test-db-client-connectionstress-minio-ugzmry 1/1 Running 0 17s pod_status:NAME READY STATUS RESTARTS AGE test-db-client-connectionstress-minio-ugzmry 1/1 Running 0 23s check pod test-db-client-connectionstress-minio-ugzmry status done pod_status:NAME READY STATUS RESTARTS AGE test-db-client-connectionstress-minio-ugzmry 0/1 Completed 0 29s check cluster status `kbcli cluster list minio-ugzmry --show-labels --namespace ns-eiqjs ` NAME NAMESPACE CLUSTER-DEFINITION VERSION TERMINATION-POLICY STATUS CREATED-TIME LABELS minio-ugzmry ns-eiqjs Delete Running Jun 19,2025 18:13 UTC+0800 app.kubernetes.io/instance=minio-ugzmry check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances minio-ugzmry --namespace ns-eiqjs ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME minio-ugzmry-minio-0 ns-eiqjs minio-ugzmry minio Running readwrite us-west-2a 200m / 200m 644245094400m / 644245094400m data:6Gi ip-172-31-1-27.us-west-2.compute.internal/172.31.1.27 Jun 19,2025 18:21 UTC+0800 minio-ugzmry-minio-1 ns-eiqjs minio-ugzmry minio Running readwrite us-west-2a 200m / 200m 644245094400m / 644245094400m data:6Gi ip-172-31-3-103.us-west-2.compute.internal/172.31.3.103 Jun 19,2025 18:21 UTC+0800 check pod status done connect unsupported engine type: minio minio 2025-06-19T10:15:43.559Z, executions-loop-bucket 2025-06-19T10:18:04.858Z, bucket-bewta 2025-06-19T10:15:43.559Z, executions-loop-bucket 2025-06-19T10:18:04.858Z, bucket-bewta 2025-06-19T10:15:43.559Z, executions-loop-bucket 2025-06-19T10:18:04.858Z, bucket-bewta 2025-06-19T10:15:43.559Z, executions-loop-bucket 2025-06-19T10:18:04.858Z, bucket-bewta 2025-06-19T10:15:43.559Z, executions-loop-bucket 2025-06-19T10:18:04.858Z, bucket-bewta 2025-06-19T10:15:43.559Z, executions-loop-bucket 2025-06-19T10:18:04.858Z, bucket-bewta 2025-06-19T10:15:43.559Z, executions-loop-bucket 2025-06-19T10:18:04.858Z, bucket-bewta 2025-06-19T10:15:43.559Z, executions-loop-bucket 2025-06-19T10:18:04.858Z, bucket-bewta 2025-06-19T10:15:43.559Z, executions-loop-bucket 2025-06-19T10:18:04.858Z, bucket-bewta 2025-06-19T10:15:43.559Z, executions-loop-bucket 2025-06-19T10:18:04.858Z, bucket-bewta 2025-06-19T10:15:43.559Z, executions-loop-bucket 2025-06-19T10:18:04.858Z, bucket-bewta 2025-06-19T10:15:43.559Z, executions-loop-bucket 2025-06-19T10:18:04.858Z, bucket-bewta 2025-06-19T10:15:43.559Z, executions-loop-bucket 2025-06-19T10:18:04.858Z, bucket-bewta 2025-06-19T10:15:43.559Z, executions-loop-bucket 2025-06-19T10:18:04.858Z, bucket-bewta 2025-06-19T10:15:43.559Z, executions-loop-bucket 2025-06-19T10:18:04.858Z, bucket-bewta 2025-06-19T10:15:43.559Z, executions-loop-bucket 2025-06-19T10:18:04.858Z, bucket-bewta 2025-06-19T10:15:43.559Z, executions-loop-bucket 2025-06-19T10:18:04.858Z, bucket-bewta 2025-06-19T10:15:43.559Z, executions-loop-bucket 2025-06-19T10:18:04.858Z, bucket-bewta 2025-06-19T10:15:43.559Z, executions-loop-bucket 2025-06-19T10:18:04.858Z, bucket-bewta 2025-06-19T10:15:43.559Z, executions-loop-bucket 2025-06-19T10:18:04.858Z, bucket-bewta 2025-06-19T10:15:43.559Z, executions-loop-bucket 2025-06-19T10:18:04.858Z, bucket-bewta 2025-06-19T10:15:43.559Z, executions-loop-bucket 2025-06-19T10:18:04.858Z, bucket-bewta 2025-06-19T10:15:43.559Z, executions-loop-bucket 2025-06-19T10:18:04.858Z, bucket-bewta 2025-06-19T10:15:43.559Z, executions-loop-bucket 2025-06-19T10:18:04.858Z, bucket-bewta 2025-06-19T10:15:43.559Z, executions-loop-bucket 2025-06-19T10:18:04.858Z, bucket-bewta 2025-06-19T10:15:43.559Z, executions-loop-bucket 2025-06-19T10:18:04.858Z, bucket-bewta 2025-06-19T10:15:43.559Z, executions-loop-bucket 2025-06-19T10:18:04.858Z, bucket-bewta 2025-06-19T10:15:43.559Z, executions-loop-bucket 2025-06-19T10:18:04.858Z, bucket-bewta 2025-06-19T10:15:43.559Z, executions-loop-bucket 2025-06-19T10:18:04.858Z, bucket-bewta 2025-06-19T10:15:43.559Z, executions-loop-bucket 2025-06-19T10:18:04.858Z, bucket-bewta 2025-06-19T10:15:43.559Z, executions-loop-bucket 2025-06-19T10:18:04.858Z, bucket-bewta 2025-06-19T10:15:43.559Z, executions-loop-bucket 2025-06-19T10:18:04.858Z, bucket-bewta 2025-06-19T10:15:43.559Z, executions-loop-bucket 2025-06-19T10:18:04.858Z, bucket-bewta 2025-06-19T10:15:43.559Z, executions-loop-bucket 2025-06-19T10:18:04.858Z, bucket-bewta 2025-06-19T10:15:43.559Z, executions-loop-bucket 2025-06-19T10:18:04.858Z, bucket-bewta 2025-06-19T10:15:43.559Z, executions-loop-bucket 2025-06-19T10:18:04.858Z, bucket-bewta 2025-06-19T10:15:43.559Z, executions-loop-bucket 2025-06-19T10:18:04.858Z, bucket-bewta 2025-06-19T10:15:43.559Z, executions-loop-bucket 2025-06-19T10:18:04.858Z, bucket-bewta 2025-06-19T10:15:43.559Z, executions-loop-bucket 2025-06-19T10:18:04.858Z, bucket-bewta 2025-06-19T10:15:43.559Z, executions-loop-bucket 2025-06-19T10:18:04.858Z, bucket-bewta 2025-06-19T10:15:43.559Z, executions-loop-bucket 2025-06-19T10:18:04.858Z, bucket-bewta 2025-06-19T10:15:43.559Z, executions-loop-bucket 2025-06-19T10:18:04.858Z, bucket-bewta 2025-06-19T10:15:43.559Z, executions-loop-bucket Test Result: null Connection Information: Database Type: minio Host: minio-ugzmry-minio.ns-eiqjs.svc.cluster.local Port: 9000 Database: Table: User: root Org: Access Mode: mysql Test Type: connectionstress Connection Count: 1024 Duration: 60 seconds `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge pods test-db-client-connectionstress-minio-ugzmry --namespace ns-eiqjs ` pod/test-db-client-connectionstress-minio-ugzmry patched (no change) Warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely. pod "test-db-client-connectionstress-minio-ugzmry" force deleted check failover pod name failover pod name:minio-ugzmry-minio-0 failover connectionstress Success `kubectl get secrets -l app.kubernetes.io/instance=minio-ugzmry` `kubectl get secrets minio-ugzmry-minio-account-root -o jsonpath="***.data.username***"` `kubectl get secrets minio-ugzmry-minio-account-root -o jsonpath="***.data.password***"` `kubectl get secrets minio-ugzmry-minio-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:ioKb4N6TX0820R70;DB_PORT:9000;DB_DATABASE: check db_client batch data count `echo "mc config host add minioserver http://minio-ugzmry-minio.ns-eiqjs.svc.cluster.local:9000 root ioKb4N6TX0820R70;mc cat minioserver/executions-loop-bucket/executions_loop" | kubectl exec -it minio-ugzmry-minio-0 --namespace ns-eiqjs -- bash` check db_client batch data Success cluster update terminationPolicy WipeOut `kbcli cluster update minio-ugzmry --termination-policy=WipeOut --namespace ns-eiqjs ` cluster.apps.kubeblocks.io/minio-ugzmry updated check cluster status `kbcli cluster list minio-ugzmry --show-labels --namespace ns-eiqjs ` NAME NAMESPACE CLUSTER-DEFINITION VERSION TERMINATION-POLICY STATUS CREATED-TIME LABELS minio-ugzmry ns-eiqjs WipeOut Running Jun 19,2025 18:13 UTC+0800 app.kubernetes.io/instance=minio-ugzmry check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances minio-ugzmry --namespace ns-eiqjs ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME minio-ugzmry-minio-0 ns-eiqjs minio-ugzmry minio Running readwrite us-west-2a 200m / 200m 644245094400m / 644245094400m data:6Gi ip-172-31-1-27.us-west-2.compute.internal/172.31.1.27 Jun 19,2025 18:21 UTC+0800 minio-ugzmry-minio-1 ns-eiqjs minio-ugzmry minio Running readwrite us-west-2a 200m / 200m 644245094400m / 644245094400m data:6Gi ip-172-31-3-103.us-west-2.compute.internal/172.31.3.103 Jun 19,2025 18:21 UTC+0800 check pod status done connect unsupported engine type: minio minio cluster list-logs `kbcli cluster list-logs minio-ugzmry --namespace ns-eiqjs ` No log files found. You can enable the log feature with the kbcli command below. kbcli cluster update minio-ugzmry --enable-all-logs=true --namespace ns-eiqjs Error from server (NotFound): pods "minio-ugzmry-minio-0" not found cluster logs `kbcli cluster logs minio-ugzmry --tail 30 --namespace ns-eiqjs ` Defaulted container "minio" out of: minio, lorry, init (init), init-lorry (init) 6: internal/logger/logger.go:268:logger.LogIf() 5: cmd/logging.go:156:cmd.storageLogIf() 4: cmd/erasure-server-pool.go:2604:cmd.(*erasureServerPools).Health() 3: cmd/server-main.go:924:cmd.serverMain.func11() 2: cmd/server-main.go:561:cmd.bootstrapTrace() 1: cmd/server-main.go:923:cmd.serverMain() Waiting for all MinIO sub-systems to be initialize... Configured max API requests per node based on available memory: 136 All MinIO sub-systems initialized successfully in 5.446442ms MinIO Object Storage Server Copyright: 2015-2025 MinIO, Inc. License: GNU AGPLv3 - https://www.gnu.org/licenses/agpl-3.0.html Version: RELEASE.2024-06-29T01-20-47Z (go1.22.4 linux/amd64) API: http://172.31.11.45:9000 http://127.0.0.1:9000 WebUI: http://172.31.11.45:9001 http://127.0.0.1:9001 Docs: https://min.io/docs/minio/linux/index.html Use `mc admin info` to look for latest server/drive info Status: 1 Online, 1 Offline. API: SYSTEM.peers Time: 10:21:37 UTC 06/19/2025 DeploymentID: 3a13ef18-d61d-468b-9891-dd1f030fc78e Error: Drive: http://minio-ugzmry-minio-1.minio-ugzmry-minio-headless.ns-eiqjs.svc.cluster.local:9000/data returned drive not found (*fmt.wrapError) endpoint="http://minio-ugzmry-minio-1.minio-ugzmry-minio-headless.ns-eiqjs.svc.cluster.local:9000/data" 4: internal/logger/logger.go:258:logger.LogAlwaysIf() 3: cmd/logging.go:65:cmd.peersLogAlwaysIf() 2: cmd/prepare-storage.go:51:cmd.init.func22.1() 1: cmd/erasure-sets.go:234:cmd.(*erasureSets).connectDisks.func2() delete cluster minio-ugzmry `kbcli cluster delete minio-ugzmry --auto-approve --namespace ns-eiqjs ` Cluster minio-ugzmry deleted pod_info:minio-ugzmry-minio-0 2/2 Running 0 3m10s minio-ugzmry-minio-1 2/2 Running 0 3m32s No resources found in ns-eiqjs namespace. delete cluster pod done No resources found in ns-eiqjs namespace. check cluster resource non-exist OK: pvc No resources found in ns-eiqjs namespace. delete cluster done No resources found in ns-eiqjs namespace. No resources found in ns-eiqjs namespace. No resources found in ns-eiqjs namespace. Minio Test Suite All Done! --------------------------------------Minio (Topology = Replicas 2) Test Result-------------------------------------- [PASSED]|[Create]|[ClusterDefinition=minio;]|[Description=Create a cluster with the specified cluster definition minio] [PASSED]|[Bench]|[ComponentName=minio]|[Description=Bench the cluster service with minio component] [PASSED]|[VerticalScaling]|[ComponentName=minio]|[Description=VerticalScaling the cluster specify component minio] [PASSED]|[Stop]|[-]|[Description=Stop the cluster] [PASSED]|[Start]|[-]|[Description=Start the cluster] [PASSED]|[Restart]|[-]|[Description=Restart the cluster] [PASSED]|[VolumeExpansion]|[ComponentName=minio]|[Description=VolumeExpansion the cluster specify component minio] [PASSED]|[Failover]|[HA=Connection Stress;ComponentName=minio]|[Description=Simulates conditions where pods experience connection stress either due to expected/undesired processes thereby testing the application's resilience to potential slowness/unavailability of some replicas due to high Connection load.] [PASSED]|[Update]|[TerminationPolicy=WipeOut]|[Description=Update the cluster TerminationPolicy WipeOut] [PASSED]|[Delete]|[-]|[Description=Delete the cluster] [END]