source commons files source engines files source kubeblocks files `kubectl get namespace | grep ns-uykdh ` `kubectl create namespace ns-uykdh` namespace/ns-uykdh created create namespace ns-uykdh done download kbcli `gh release list --repo apecloud/kbcli --limit 100 | (grep "1.0" || true)` `curl -fsSL https://kubeblocks.io/installer/install_cli.sh | bash -s v1.0.0` Your system is linux_amd64 Installing kbcli ... Downloading ... % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 33.6M 100 33.6M 0 0 151M 0 --:--:-- --:--:-- --:--:-- 151M kbcli installed successfully. Kubernetes: v1.32.5-eks-5d4a308 KubeBlocks: 1.0.0 kbcli: 1.0.0 Make sure your docker service is running and begin your journey with kbcli: kbcli playground init For more information on how to get started, please visit: https://kubeblocks.io download kbcli v1.0.0 done Kubernetes: v1.32.5-eks-5d4a308 KubeBlocks: 1.0.0 kbcli: 1.0.0 Kubernetes Env: v1.32.5-eks-5d4a308 check snapshot controller check snapshot controller done eks default-vsc found POD_RESOURCES: No resources found found default storage class: gp3 KubeBlocks version is:1.0.0 skip upgrade KubeBlocks current KubeBlocks version: 1.0.0 Error: no repositories to show helm repo add chaos-mesh https://charts.chaos-mesh.org "chaos-mesh" has been added to your repositories add helm chart repo chaos-mesh success chaos mesh already installed create apecloud_mysql cluster mysqlo-szrijg check component definition set component name:mysql CLUSTER_TOPOLOGY:apecloud-mysql topology apecloud-mysql found in cluster definition apecloud-mysql set apecloud-mysql component definition set apecloud-mysql component definition apecloud-mysql-1.0.0-alpha.0 LIMIT_CPU:0.1 LIMIT_MEMORY:0.5 storage size: 1 No resources found in ns-uykdh namespace. create 3 replica WipeOut apecloud-mysql cluster check component definition set component definition by component version no component definitions found apiVersion: apps.kubeblocks.io/v1 kind: Cluster metadata: name: mysqlo-szrijg namespace: ns-uykdh labels: app.kubernetes.io/instance: mysqlo-szrijg spec: clusterDef: apecloud-mysql topology: apecloud-mysql terminationPolicy: WipeOut componentSpecs: - name: mysql serviceVersion: 8.0.30 disableExporter: true replicas: 3 resources: requests: cpu: 100m memory: 0.5Gi limits: cpu: 100m memory: 0.5Gi volumeClaimTemplates: - name: data spec: storageClassName: accessModes: - ReadWriteOnce resources: requests: storage: 1Gi `kubectl apply -f test_create_mysqlo-szrijg.yaml` cluster.apps.kubeblocks.io/mysqlo-szrijg created apply test_create_mysqlo-szrijg.yaml Success `rm -rf test_create_mysqlo-szrijg.yaml` check cluster status `kbcli cluster list mysqlo-szrijg --show-labels --namespace ns-uykdh ` NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS mysqlo-szrijg ns-uykdh apecloud-mysql WipeOut Creating May 28,2025 11:38 UTC+0800 app.kubernetes.io/instance=mysqlo-szrijg,clusterdefinition.kubeblocks.io/name=apecloud-mysql cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Failed cluster_status:Failed check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances mysqlo-szrijg --namespace ns-uykdh ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME mysqlo-szrijg-mysql-0 ns-uykdh mysqlo-szrijg mysql Running leader us-west-2a 100m / 100m 512Mi / 512Mi data:1Gi ip-172-31-9-61.us-west-2.compute.internal/172.31.9.61 May 28,2025 11:38 UTC+0800 mysqlo-szrijg-mysql-1 ns-uykdh mysqlo-szrijg mysql Running follower us-west-2a 100m / 100m 512Mi / 512Mi data:1Gi ip-172-31-5-12.us-west-2.compute.internal/172.31.5.12 May 28,2025 11:39 UTC+0800 mysqlo-szrijg-mysql-2 ns-uykdh mysqlo-szrijg mysql Running follower us-west-2a 100m / 100m 512Mi / 512Mi data:1Gi ip-172-31-9-66.us-west-2.compute.internal/172.31.9.66 May 28,2025 11:40 UTC+0800 check pod status done check cluster role check cluster role done leader: mysqlo-szrijg-mysql-0;follower: mysqlo-szrijg-mysql-1 mysqlo-szrijg-mysql-2 `kubectl get secrets -l app.kubernetes.io/instance=mysqlo-szrijg` set secret: mysqlo-szrijg-mysql-account-root `kubectl get secrets mysqlo-szrijg-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysqlo-szrijg-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysqlo-szrijg-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:b1ByKL231w4A32w0;DB_PORT:3306;DB_DATABASE:mysql check cluster connect `echo " echo \"\" | mysql -P3306 -hmysqlo-szrijg-mysql.ns-uykdh.svc.cluster.local -uroot -p'b1ByKL231w4A32w0' " | kubectl exec -it mysqlo-szrijg-mysql-0 --namespace ns-uykdh -- bash` check cluster connect done `kubectl get secrets -l app.kubernetes.io/instance=mysqlo-szrijg` set secret: mysqlo-szrijg-mysql-account-root `kubectl get secrets mysqlo-szrijg-mysql-account-root -o jsonpath="***.data.username***"` `kubectl get secrets mysqlo-szrijg-mysql-account-root -o jsonpath="***.data.password***"` `kubectl get secrets mysqlo-szrijg-mysql-account-root -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:b1ByKL231w4A32w0;DB_PORT:3306;DB_DATABASE:mysql check pod mysqlo-szrijg-mysql-0 container_name mysql exist password b1ByKL231w4A32w0 check pod mysqlo-szrijg-mysql-0 container_name vtablet exist password b1ByKL231w4A32w0 check pod mysqlo-szrijg-mysql-0 container_name kbagent exist password b1ByKL231w4A32w0 check pod mysqlo-szrijg-mysql-0 container_name config-manager exist password b1ByKL231w4A32w0 No container logs contain secret password. check component definition set component name:orchestrator set component version set component version:orchestrator set service versions:3.2.6 set service versions sorted:3.2.6 set orchestrator component definition set orchestrator component definition orchestrator-raft-1.0.0-alpha.0 set replicas first:3,3.2.6 set replicas third:3,3.2.6 set replicas fourth:3,3.2.6 set minimum cmpv service version set minimum cmpv service version replicas:3,3.2.6 REPORT_COUNT:1 CLUSTER_TOPOLOGY:raft topology raft found in cluster definition orchestrator set orchestrator component definition set orchestrator component definition orchestrator-raft-1.0.0-alpha.0 LIMIT_CPU:0.5 LIMIT_MEMORY:0.5 storage size: 1 No resources found in ns-uykdh namespace. termination_policy:Delete create 3 replica Delete orchestrator cluster check component definition set component definition by component version check cmpd by labels check cmpd by compDefs set component definition: orchestrator-shared-backend-1.0.0-alpha.0 by component version:orchestrator apiVersion: apps.kubeblocks.io/v1 kind: Cluster metadata: name: orch-szrijg namespace: ns-uykdh spec: clusterDef: orchestrator topology: raft terminationPolicy: Delete services: - name: orchestrator componentSelector: orchestrator spec: ports: - name: orc-http port: 80 componentSpecs: - name: orchestrator serviceVersion: 3.2.6 replicas: 3 resources: requests: cpu: 500m memory: 0.5Gi limits: cpu: 500m memory: 0.5Gi volumeClaimTemplates: - name: data spec: storageClassName: accessModes: - ReadWriteOnce resources: requests: storage: 1Gi `kubectl apply -f test_create_orch-szrijg.yaml` cluster.apps.kubeblocks.io/orch-szrijg created apply test_create_orch-szrijg.yaml Success `rm -rf test_create_orch-szrijg.yaml` check cluster status `kbcli cluster list orch-szrijg --show-labels --namespace ns-uykdh ` NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS orch-szrijg ns-uykdh orchestrator Delete Creating May 28,2025 11:44 UTC+0800 clusterdefinition.kubeblocks.io/name=orchestrator cluster_status:Creating cluster_status:Creating cluster_status:Creating check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances orch-szrijg --namespace ns-uykdh ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME orch-szrijg-orchestrator-0 ns-uykdh orch-szrijg orchestrator Running primary us-west-2a 500m / 500m 512Mi / 512Mi data:1Gi ip-172-31-14-41.us-west-2.compute.internal/172.31.14.41 May 28,2025 11:44 UTC+0800 orch-szrijg-orchestrator-1 ns-uykdh orch-szrijg orchestrator Running secondary us-west-2a 500m / 500m 512Mi / 512Mi data:1Gi ip-172-31-9-231.us-west-2.compute.internal/172.31.9.231 May 28,2025 11:44 UTC+0800 orch-szrijg-orchestrator-2 ns-uykdh orch-szrijg orchestrator Running secondary us-west-2a 500m / 500m 512Mi / 512Mi data:1Gi ip-172-31-9-61.us-west-2.compute.internal/172.31.9.61 May 28,2025 11:45 UTC+0800 check pod status done check cluster connect ` echo 'curl -s http://orch-szrijg-orchestrator:80/api/health ' | kubectl exec -it orch-szrijg-orchestrator-0 --namespace ns-uykdh -- bash` check cluster connect done `kubectl get secrets -l app.kubernetes.io/instance=orch-szrijg` set secret: orch-szrijg-orchestrator-account-orchestrator `kubectl get secrets orch-szrijg-orchestrator-account-orchestrator -o jsonpath="***.data.username***"` `kubectl get secrets orch-szrijg-orchestrator-account-orchestrator -o jsonpath="***.data.password***"` `kubectl get secrets orch-szrijg-orchestrator-account-orchestrator -o jsonpath="***.data.port***"` DB_USERNAME:orchestrator;DB_PASSWORD:A50tHtrX8Q749h22;DB_PORT:3306;DB_DATABASE:mysql check pod orch-szrijg-orchestrator-0 container_name orchestrator exist password A50tHtrX8Q749h22 check pod orch-szrijg-orchestrator-0 container_name kbagent exist password A50tHtrX8Q749h22 No container logs contain secret password. describe cluster `kbcli cluster describe orch-szrijg --namespace ns-uykdh ` Name: orch-szrijg Created Time: May 28,2025 11:44 UTC+0800 NAMESPACE CLUSTER-DEFINITION TOPOLOGY STATUS TERMINATION-POLICY ns-uykdh orchestrator raft Running Delete Endpoints: COMPONENT INTERNAL EXTERNAL orchestrator orch-szrijg-orchestrator.ns-uykdh.svc.cluster.local:80 Topology: COMPONENT SERVICE-VERSION INSTANCE ROLE STATUS AZ NODE CREATED-TIME orchestrator 3.2.6 orch-szrijg-orchestrator-0 primary Running us-west-2a ip-172-31-14-41.us-west-2.compute.internal/172.31.14.41 May 28,2025 11:44 UTC+0800 orchestrator 3.2.6 orch-szrijg-orchestrator-1 secondary Running us-west-2a ip-172-31-9-231.us-west-2.compute.internal/172.31.9.231 May 28,2025 11:44 UTC+0800 orchestrator 3.2.6 orch-szrijg-orchestrator-2 secondary Running us-west-2a ip-172-31-9-61.us-west-2.compute.internal/172.31.9.61 May 28,2025 11:45 UTC+0800 Resources Allocation: COMPONENT INSTANCE-TEMPLATE CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE-SIZE STORAGE-CLASS orchestrator 500m / 500m 512Mi / 512Mi data:1Gi kb-default-sc Images: COMPONENT COMPONENT-DEFINITION IMAGE orchestrator orchestrator-raft-1.0.0-alpha.0 docker.io/apecloud/orchestrator:v3.2.6 Show cluster events: kbcli cluster list-events -n ns-uykdh orch-szrijg `kbcli cluster label orch-szrijg app.kubernetes.io/instance- --namespace ns-uykdh ` label "app.kubernetes.io/instance" not found. `kbcli cluster label orch-szrijg app.kubernetes.io/instance=orch-szrijg --namespace ns-uykdh ` `kbcli cluster label orch-szrijg --list --namespace ns-uykdh ` NAME NAMESPACE LABELS orch-szrijg ns-uykdh app.kubernetes.io/instance=orch-szrijg clusterdefinition.kubeblocks.io/name=orchestrator label cluster app.kubernetes.io/instance=orch-szrijg Success `kbcli cluster label case.name=kbcli.test1 -l app.kubernetes.io/instance=orch-szrijg --namespace ns-uykdh ` `kbcli cluster label orch-szrijg --list --namespace ns-uykdh ` NAME NAMESPACE LABELS orch-szrijg ns-uykdh app.kubernetes.io/instance=orch-szrijg case.name=kbcli.test1 clusterdefinition.kubeblocks.io/name=orchestrator label cluster case.name=kbcli.test1 Success `kbcli cluster label orch-szrijg case.name=kbcli.test2 --overwrite --namespace ns-uykdh ` `kbcli cluster label orch-szrijg --list --namespace ns-uykdh ` NAME NAMESPACE LABELS orch-szrijg ns-uykdh app.kubernetes.io/instance=orch-szrijg case.name=kbcli.test2 clusterdefinition.kubeblocks.io/name=orchestrator label cluster case.name=kbcli.test2 Success `kbcli cluster label orch-szrijg case.name- --namespace ns-uykdh ` `kbcli cluster label orch-szrijg --list --namespace ns-uykdh ` NAME NAMESPACE LABELS orch-szrijg ns-uykdh app.kubernetes.io/instance=orch-szrijg clusterdefinition.kubeblocks.io/name=orchestrator delete cluster label case.name Success cluster connect ` echo 'curl -s http://orch-szrijg-orchestrator:80/api/health ' | kubectl exec -it orch-szrijg-orchestrator-0 --namespace ns-uykdh -- bash ` Defaulted container "orchestrator" out of: orchestrator, kbagent, init-kbagent (init), kbagent-worker (init) Unable to use a TTY - input is not a terminal or the right kind of file ***"Code":"OK","Message":"Application node is healthy","Details":***"Healthy":true,"Hostname":"orch-szrijg-orchestrator-0","Token":"d14f8891e09cbceb8b6d04d535b51376d7d67b560febfe8c383acd13a29912a5","IsActiveNode":true,"ActiveNode":***"Hostname":"172.31.10.9:10008","Token":"","AppVersion":"","FirstSeenActive":"","LastSeenActive":"","ExtraInfo":"","Command":"","DBBackend":"","LastReported":"0001-01-01T00:00:00Z"***,"Error":null,"AvailableNodes":[***"Hostname":"orch-szrijg-orchestrator-0","Token":"d14f8891e09cbceb8b6d04d535b51376d7d67b560febfe8c383acd13a29912a5","AppVersion":"3.2.6","FirstSeenActive":"2025-05-28T03:44:35Z","LastSeenActive":"2025-05-28T03:46:04Z","ExtraInfo":"","Command":"","DBBackend":"/data/sqlite/orchestrator.db","LastReported":"0001-01-01T00:00:00Z"***],"RaftLeader":"172.31.10.9:10008","IsRaftLeader":true,"RaftLeaderURI":"http://orch-szrijg-orchestrator-0.orch-szrijg-orchestrator-headless.ns-uykdh.svc.cluster.local:3000","RaftAdvertise":"orch-szrijg-orchestrator-0.orch-szrijg-orchestrator-headless.ns-uykdh.svc.cluster.local","RaftHealthyMembers":["orch-szrijg-orchestrator-0.orch-szrijg-orchestrator-headless.ns-uykdh.svc.cluster.local","orch-szrijg-orchestrator-1.orch-szrijg-orchestrator-headless.ns-uykdh.svc.cluster.local","orch-szrijg-orchestrator-2.orch-szrijg-orchestrator-headless.ns-uykdh.svc.cluster.local"]*** connect cluster Success 6 cluster restart check cluster status before ops check cluster status done cluster_status:Running `kbcli cluster restart orch-szrijg --auto-approve --force=true --namespace ns-uykdh ` OpsRequest orch-szrijg-restart-cz545 created successfully, you can view the progress: kbcli cluster describe-ops orch-szrijg-restart-cz545 -n ns-uykdh check ops status `kbcli cluster list-ops orch-szrijg --status all --namespace ns-uykdh ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME orch-szrijg-restart-cz545 ns-uykdh Restart orch-szrijg orchestrator Running 0/3 May 28,2025 11:46 UTC+0800 check cluster status `kbcli cluster list orch-szrijg --show-labels --namespace ns-uykdh ` NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS orch-szrijg ns-uykdh orchestrator Delete Updating May 28,2025 11:44 UTC+0800 app.kubernetes.io/instance=orch-szrijg,clusterdefinition.kubeblocks.io/name=orchestrator cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances orch-szrijg --namespace ns-uykdh ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME orch-szrijg-orchestrator-0 ns-uykdh orch-szrijg orchestrator Running secondary us-west-2a 500m / 500m 512Mi / 512Mi data:1Gi ip-172-31-14-41.us-west-2.compute.internal/172.31.14.41 May 28,2025 11:48 UTC+0800 orch-szrijg-orchestrator-1 ns-uykdh orch-szrijg orchestrator Running secondary us-west-2a 500m / 500m 512Mi / 512Mi data:1Gi ip-172-31-9-231.us-west-2.compute.internal/172.31.9.231 May 28,2025 11:47 UTC+0800 orch-szrijg-orchestrator-2 ns-uykdh orch-szrijg orchestrator Running secondary us-west-2a 500m / 500m 512Mi / 512Mi data:1Gi ip-172-31-5-250.us-west-2.compute.internal/172.31.5.250 May 28,2025 11:46 UTC+0800 check pod status done check cluster connect ` echo 'curl -s http://orch-szrijg-orchestrator:80/api/health ' | kubectl exec -it orch-szrijg-orchestrator-0 --namespace ns-uykdh -- bash` check cluster connect done check ops status `kbcli cluster list-ops orch-szrijg --status all --namespace ns-uykdh ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME orch-szrijg-restart-cz545 ns-uykdh Restart orch-szrijg orchestrator Succeed 3/3 May 28,2025 11:46 UTC+0800 check ops status done ops_status:orch-szrijg-restart-cz545 ns-uykdh Restart orch-szrijg orchestrator Succeed 3/3 May 28,2025 11:46 UTC+0800 `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge opsrequests.operations orch-szrijg-restart-cz545 --namespace ns-uykdh ` opsrequest.operations.kubeblocks.io/orch-szrijg-restart-cz545 patched `kbcli cluster delete-ops --name orch-szrijg-restart-cz545 --force --auto-approve --namespace ns-uykdh ` OpsRequest orch-szrijg-restart-cz545 deleted cluster hscale offline instances apiVersion: operations.kubeblocks.io/v1alpha1 kind: OpsRequest metadata: generateName: orch-szrijg-hscaleoffinstance- labels: app.kubernetes.io/instance: orch-szrijg app.kubernetes.io/managed-by: kubeblocks namespace: ns-uykdh spec: type: HorizontalScaling clusterName: orch-szrijg force: true horizontalScaling: - componentName: orchestrator scaleIn: onlineInstancesToOffline: - orch-szrijg-orchestrator-0 check cluster status before ops check cluster status done cluster_status:Running `kubectl create -f test_ops_cluster_orch-szrijg.yaml` opsrequest.operations.kubeblocks.io/orch-szrijg-hscaleoffinstance-ggt42 created create test_ops_cluster_orch-szrijg.yaml Success `rm -rf test_ops_cluster_orch-szrijg.yaml` check ops status `kbcli cluster list-ops orch-szrijg --status all --namespace ns-uykdh ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME orch-szrijg-hscaleoffinstance-ggt42 ns-uykdh HorizontalScaling orch-szrijg orchestrator Running 0/1 May 28,2025 11:55 UTC+0800 check cluster status `kbcli cluster list orch-szrijg --show-labels --namespace ns-uykdh ` NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS orch-szrijg ns-uykdh orchestrator Delete Updating May 28,2025 11:44 UTC+0800 app.kubernetes.io/instance=orch-szrijg,clusterdefinition.kubeblocks.io/name=orchestrator cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances orch-szrijg --namespace ns-uykdh ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME orch-szrijg-orchestrator-1 ns-uykdh orch-szrijg orchestrator Running secondary us-west-2a 500m / 500m 512Mi / 512Mi data:1Gi ip-172-31-9-231.us-west-2.compute.internal/172.31.9.231 May 28,2025 11:47 UTC+0800 orch-szrijg-orchestrator-2 ns-uykdh orch-szrijg orchestrator Running secondary us-west-2a 500m / 500m 512Mi / 512Mi data:1Gi ip-172-31-5-250.us-west-2.compute.internal/172.31.5.250 May 28,2025 11:46 UTC+0800 check pod status done check cluster connect ` echo 'curl -s http://orch-szrijg-orchestrator:80/api/health ' | kubectl exec -it orch-szrijg-orchestrator-1 --namespace ns-uykdh -- bash` check cluster connect done check ops status `kbcli cluster list-ops orch-szrijg --status all --namespace ns-uykdh ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME orch-szrijg-hscaleoffinstance-ggt42 ns-uykdh HorizontalScaling orch-szrijg orchestrator Succeed 1/1 May 28,2025 11:55 UTC+0800 check ops status done ops_status:orch-szrijg-hscaleoffinstance-ggt42 ns-uykdh HorizontalScaling orch-szrijg orchestrator Succeed 1/1 May 28,2025 11:55 UTC+0800 `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge opsrequests.operations orch-szrijg-hscaleoffinstance-ggt42 --namespace ns-uykdh ` opsrequest.operations.kubeblocks.io/orch-szrijg-hscaleoffinstance-ggt42 patched `kbcli cluster delete-ops --name orch-szrijg-hscaleoffinstance-ggt42 --force --auto-approve --namespace ns-uykdh ` OpsRequest orch-szrijg-hscaleoffinstance-ggt42 deleted cluster hscale online instances apiVersion: operations.kubeblocks.io/v1alpha1 kind: OpsRequest metadata: generateName: orch-szrijg-hscaleoninstance- labels: app.kubernetes.io/instance: orch-szrijg app.kubernetes.io/managed-by: kubeblocks namespace: ns-uykdh spec: type: HorizontalScaling clusterName: orch-szrijg force: true horizontalScaling: - componentName: orchestrator scaleOut: offlineInstancesToOnline: - orch-szrijg-orchestrator-0 check cluster status before ops check cluster status done cluster_status:Running `kubectl create -f test_ops_cluster_orch-szrijg.yaml` opsrequest.operations.kubeblocks.io/orch-szrijg-hscaleoninstance-wnkng created create test_ops_cluster_orch-szrijg.yaml Success `rm -rf test_ops_cluster_orch-szrijg.yaml` check ops status `kbcli cluster list-ops orch-szrijg --status all --namespace ns-uykdh ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME orch-szrijg-hscaleoninstance-wnkng ns-uykdh HorizontalScaling orch-szrijg orchestrator Running 0/1 May 28,2025 12:01 UTC+0800 check cluster status `kbcli cluster list orch-szrijg --show-labels --namespace ns-uykdh ` NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS orch-szrijg ns-uykdh orchestrator Delete Updating May 28,2025 11:44 UTC+0800 app.kubernetes.io/instance=orch-szrijg,clusterdefinition.kubeblocks.io/name=orchestrator cluster_status:Updating check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances orch-szrijg --namespace ns-uykdh ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME orch-szrijg-orchestrator-0 ns-uykdh orch-szrijg orchestrator Running secondary us-west-2a 500m / 500m 512Mi / 512Mi data:1Gi ip-172-31-13-212.us-west-2.compute.internal/172.31.13.212 May 28,2025 12:01 UTC+0800 orch-szrijg-orchestrator-1 ns-uykdh orch-szrijg orchestrator Running secondary us-west-2a 500m / 500m 512Mi / 512Mi data:1Gi ip-172-31-12-133.us-west-2.compute.internal/172.31.12.133 May 28,2025 12:01 UTC+0800 orch-szrijg-orchestrator-2 ns-uykdh orch-szrijg orchestrator Running secondary us-west-2a 500m / 500m 512Mi / 512Mi data:1Gi ip-172-31-5-250.us-west-2.compute.internal/172.31.5.250 May 28,2025 11:46 UTC+0800 check pod status done check cluster connect ` echo 'curl -s http://orch-szrijg-orchestrator:80/api/health ' | kubectl exec -it orch-szrijg-orchestrator-0 --namespace ns-uykdh -- bash` check cluster connect done check ops status `kbcli cluster list-ops orch-szrijg --status all --namespace ns-uykdh ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME orch-szrijg-hscaleoninstance-wnkng ns-uykdh HorizontalScaling orch-szrijg orchestrator Succeed 1/1 May 28,2025 12:01 UTC+0800 check ops status done ops_status:orch-szrijg-hscaleoninstance-wnkng ns-uykdh HorizontalScaling orch-szrijg orchestrator Succeed 1/1 May 28,2025 12:01 UTC+0800 `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge opsrequests.operations orch-szrijg-hscaleoninstance-wnkng --namespace ns-uykdh ` opsrequest.operations.kubeblocks.io/orch-szrijg-hscaleoninstance-wnkng patched `kbcli cluster delete-ops --name orch-szrijg-hscaleoninstance-wnkng --force --auto-approve --namespace ns-uykdh ` OpsRequest orch-szrijg-hscaleoninstance-wnkng deleted cluster stop check cluster status before ops check cluster status done cluster_status:Running `kbcli cluster stop orch-szrijg --auto-approve --force=true --namespace ns-uykdh ` OpsRequest orch-szrijg-stop-56kqz created successfully, you can view the progress: kbcli cluster describe-ops orch-szrijg-stop-56kqz -n ns-uykdh check ops status `kbcli cluster list-ops orch-szrijg --status all --namespace ns-uykdh ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME orch-szrijg-stop-56kqz ns-uykdh Stop orch-szrijg orchestrator Running 0/3 May 28,2025 12:09 UTC+0800 check cluster status `kbcli cluster list orch-szrijg --show-labels --namespace ns-uykdh ` NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS orch-szrijg ns-uykdh orchestrator Delete Stopping May 28,2025 11:44 UTC+0800 app.kubernetes.io/instance=orch-szrijg,clusterdefinition.kubeblocks.io/name=orchestrator cluster_status:Stopping cluster_status:Stopping cluster_status:Stopping cluster_status:Stopping cluster_status:Stopping cluster_status:Stopping cluster_status:Stopping cluster_status:Stopping cluster_status:Stopping cluster_status:Stopping cluster_status:Stopping cluster_status:Stopping cluster_status:Stopping cluster_status:Stopping check cluster status done cluster_status:Stopped check pod status `kbcli cluster list-instances orch-szrijg --namespace ns-uykdh ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME check pod status done check ops status `kbcli cluster list-ops orch-szrijg --status all --namespace ns-uykdh ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME orch-szrijg-stop-56kqz ns-uykdh Stop orch-szrijg orchestrator Succeed 3/3 May 28,2025 12:09 UTC+0800 check ops status done ops_status:orch-szrijg-stop-56kqz ns-uykdh Stop orch-szrijg orchestrator Succeed 3/3 May 28,2025 12:09 UTC+0800 `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge opsrequests.operations orch-szrijg-stop-56kqz --namespace ns-uykdh ` opsrequest.operations.kubeblocks.io/orch-szrijg-stop-56kqz patched `kbcli cluster delete-ops --name orch-szrijg-stop-56kqz --force --auto-approve --namespace ns-uykdh ` OpsRequest orch-szrijg-stop-56kqz deleted cluster start check cluster status before ops check cluster status done cluster_status:Stopped `kbcli cluster start orch-szrijg --force=true --namespace ns-uykdh ` OpsRequest orch-szrijg-start-spr5t created successfully, you can view the progress: kbcli cluster describe-ops orch-szrijg-start-spr5t -n ns-uykdh check ops status `kbcli cluster list-ops orch-szrijg --status all --namespace ns-uykdh ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME orch-szrijg-start-spr5t ns-uykdh Start orch-szrijg orchestrator Running 0/3 May 28,2025 12:10 UTC+0800 check cluster status `kbcli cluster list orch-szrijg --show-labels --namespace ns-uykdh ` NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS orch-szrijg ns-uykdh orchestrator Delete Updating May 28,2025 11:44 UTC+0800 app.kubernetes.io/instance=orch-szrijg,clusterdefinition.kubeblocks.io/name=orchestrator cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances orch-szrijg --namespace ns-uykdh ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME orch-szrijg-orchestrator-0 ns-uykdh orch-szrijg orchestrator Running secondary us-west-2a 500m / 500m 512Mi / 512Mi data:1Gi ip-172-31-5-250.us-west-2.compute.internal/172.31.5.250 May 28,2025 12:10 UTC+0800 orch-szrijg-orchestrator-1 ns-uykdh orch-szrijg orchestrator Running primary us-west-2a 500m / 500m 512Mi / 512Mi data:1Gi ip-172-31-12-133.us-west-2.compute.internal/172.31.12.133 May 28,2025 12:11 UTC+0800 orch-szrijg-orchestrator-2 ns-uykdh orch-szrijg orchestrator Running secondary us-west-2a 500m / 500m 512Mi / 512Mi data:1Gi ip-172-31-14-41.us-west-2.compute.internal/172.31.14.41 May 28,2025 12:11 UTC+0800 check pod status done check cluster connect ` echo 'curl -s http://orch-szrijg-orchestrator:80/api/health ' | kubectl exec -it orch-szrijg-orchestrator-0 --namespace ns-uykdh -- bash` check cluster connect done check ops status `kbcli cluster list-ops orch-szrijg --status all --namespace ns-uykdh ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME orch-szrijg-start-spr5t ns-uykdh Start orch-szrijg orchestrator Succeed 3/3 May 28,2025 12:10 UTC+0800 check ops status done ops_status:orch-szrijg-start-spr5t ns-uykdh Start orch-szrijg orchestrator Succeed 3/3 May 28,2025 12:10 UTC+0800 `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge opsrequests.operations orch-szrijg-start-spr5t --namespace ns-uykdh ` opsrequest.operations.kubeblocks.io/orch-szrijg-start-spr5t patched `kbcli cluster delete-ops --name orch-szrijg-start-spr5t --force --auto-approve --namespace ns-uykdh ` OpsRequest orch-szrijg-start-spr5t deleted check cluster status before ops check cluster status done cluster_status:Running `kbcli cluster vscale orch-szrijg --auto-approve --force=true --components orchestrator --cpu 600m --memory 0.6Gi --namespace ns-uykdh ` OpsRequest orch-szrijg-verticalscaling-xfmsr created successfully, you can view the progress: kbcli cluster describe-ops orch-szrijg-verticalscaling-xfmsr -n ns-uykdh check ops status `kbcli cluster list-ops orch-szrijg --status all --namespace ns-uykdh ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME orch-szrijg-verticalscaling-xfmsr ns-uykdh VerticalScaling orch-szrijg orchestrator Running 0/3 May 28,2025 12:11 UTC+0800 check cluster status `kbcli cluster list orch-szrijg --show-labels --namespace ns-uykdh ` NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS orch-szrijg ns-uykdh orchestrator Delete Updating May 28,2025 11:44 UTC+0800 app.kubernetes.io/instance=orch-szrijg,clusterdefinition.kubeblocks.io/name=orchestrator cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances orch-szrijg --namespace ns-uykdh ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME orch-szrijg-orchestrator-0 ns-uykdh orch-szrijg orchestrator Running secondary us-west-2a 600m / 600m 644245094400m / 644245094400m data:1Gi ip-172-31-5-250.us-west-2.compute.internal/172.31.5.250 May 28,2025 12:14 UTC+0800 orch-szrijg-orchestrator-1 ns-uykdh orch-szrijg orchestrator Running secondary us-west-2a 600m / 600m 644245094400m / 644245094400m data:1Gi ip-172-31-12-133.us-west-2.compute.internal/172.31.12.133 May 28,2025 12:13 UTC+0800 orch-szrijg-orchestrator-2 ns-uykdh orch-szrijg orchestrator Running secondary us-west-2a 600m / 600m 644245094400m / 644245094400m data:1Gi ip-172-31-11-43.us-west-2.compute.internal/172.31.11.43 May 28,2025 12:12 UTC+0800 check pod status done check cluster connect ` echo 'curl -s http://orch-szrijg-orchestrator:80/api/health ' | kubectl exec -it orch-szrijg-orchestrator-0 --namespace ns-uykdh -- bash` check cluster connect done check ops status `kbcli cluster list-ops orch-szrijg --status all --namespace ns-uykdh ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME orch-szrijg-verticalscaling-xfmsr ns-uykdh VerticalScaling orch-szrijg orchestrator Succeed 3/3 May 28,2025 12:11 UTC+0800 check ops status done ops_status:orch-szrijg-verticalscaling-xfmsr ns-uykdh VerticalScaling orch-szrijg orchestrator Succeed 3/3 May 28,2025 12:11 UTC+0800 `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge opsrequests.operations orch-szrijg-verticalscaling-xfmsr --namespace ns-uykdh ` opsrequest.operations.kubeblocks.io/orch-szrijg-verticalscaling-xfmsr patched `kbcli cluster delete-ops --name orch-szrijg-verticalscaling-xfmsr --force --auto-approve --namespace ns-uykdh ` OpsRequest orch-szrijg-verticalscaling-xfmsr deleted cluster orchestrator scale-out check cluster status before ops check cluster status done cluster_status:Running No resources found in orch-szrijg namespace. `kbcli cluster scale-out orch-szrijg --auto-approve --force=true --components orchestrator --replicas 1 --namespace ns-uykdh ` OpsRequest orch-szrijg-horizontalscaling-jtnnx created successfully, you can view the progress: kbcli cluster describe-ops orch-szrijg-horizontalscaling-jtnnx -n ns-uykdh check ops status `kbcli cluster list-ops orch-szrijg --status all --namespace ns-uykdh ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME orch-szrijg-horizontalscaling-jtnnx ns-uykdh HorizontalScaling orch-szrijg orchestrator Running 0/1 May 28,2025 12:14 UTC+0800 cluster restart `kbcli cluster restart orch-szrijg --auto-approve --force=true --namespace ns-uykdh ` OpsRequest orch-szrijg-restart-k28jm created successfully, you can view the progress: kbcli cluster describe-ops orch-szrijg-restart-k28jm -n ns-uykdh check ops status `kbcli cluster list-ops orch-szrijg --status all --namespace ns-uykdh ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME orch-szrijg-horizontalscaling-jtnnx ns-uykdh HorizontalScaling orch-szrijg orchestrator Running 0/1 May 28,2025 12:14 UTC+0800 orch-szrijg-restart-k28jm ns-uykdh Restart orch-szrijg orchestrator Running 0/4 May 28,2025 12:14 UTC+0800 check cluster status `kbcli cluster list orch-szrijg --show-labels --namespace ns-uykdh ` NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS orch-szrijg ns-uykdh orchestrator Delete Updating May 28,2025 11:44 UTC+0800 app.kubernetes.io/instance=orch-szrijg,clusterdefinition.kubeblocks.io/name=orchestrator cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances orch-szrijg --namespace ns-uykdh ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME orch-szrijg-orchestrator-0 ns-uykdh orch-szrijg orchestrator Running secondary us-west-2a 600m / 600m 644245094400m / 644245094400m data:1Gi ip-172-31-5-250.us-west-2.compute.internal/172.31.5.250 May 28,2025 12:18 UTC+0800 orch-szrijg-orchestrator-1 ns-uykdh orch-szrijg orchestrator Running secondary us-west-2a 600m / 600m 644245094400m / 644245094400m data:1Gi ip-172-31-12-133.us-west-2.compute.internal/172.31.12.133 May 28,2025 12:17 UTC+0800 orch-szrijg-orchestrator-2 ns-uykdh orch-szrijg orchestrator Running primary us-west-2a 600m / 600m 644245094400m / 644245094400m data:1Gi ip-172-31-11-43.us-west-2.compute.internal/172.31.11.43 May 28,2025 12:16 UTC+0800 orch-szrijg-orchestrator-3 ns-uykdh orch-szrijg orchestrator Running secondary us-west-2a 600m / 600m 644245094400m / 644245094400m data:1Gi ip-172-31-8-55.us-west-2.compute.internal/172.31.8.55 May 28,2025 12:15 UTC+0800 check pod status done check cluster connect ` echo 'curl -s http://orch-szrijg-orchestrator:80/api/health ' | kubectl exec -it orch-szrijg-orchestrator-0 --namespace ns-uykdh -- bash` check cluster connect done check ops status `kbcli cluster list-ops orch-szrijg --status all --namespace ns-uykdh ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME orch-szrijg-horizontalscaling-jtnnx ns-uykdh HorizontalScaling orch-szrijg orchestrator Succeed 1/1 May 28,2025 12:14 UTC+0800 orch-szrijg-restart-k28jm ns-uykdh Restart orch-szrijg orchestrator Succeed 4/4 May 28,2025 12:14 UTC+0800 check ops status done ops_status:orch-szrijg-restart-k28jm ns-uykdh Restart orch-szrijg orchestrator Succeed 4/4 May 28,2025 12:14 UTC+0800 `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge opsrequests.operations orch-szrijg-restart-k28jm --namespace ns-uykdh ` opsrequest.operations.kubeblocks.io/orch-szrijg-restart-k28jm patched `kbcli cluster delete-ops --name orch-szrijg-restart-k28jm --force --auto-approve --namespace ns-uykdh ` OpsRequest orch-szrijg-restart-k28jm deleted check cluster status `kbcli cluster list orch-szrijg --show-labels --namespace ns-uykdh ` NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS orch-szrijg ns-uykdh orchestrator Delete Running May 28,2025 11:44 UTC+0800 app.kubernetes.io/instance=orch-szrijg,clusterdefinition.kubeblocks.io/name=orchestrator check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances orch-szrijg --namespace ns-uykdh ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME orch-szrijg-orchestrator-0 ns-uykdh orch-szrijg orchestrator Running secondary us-west-2a 600m / 600m 644245094400m / 644245094400m data:1Gi ip-172-31-5-250.us-west-2.compute.internal/172.31.5.250 May 28,2025 12:18 UTC+0800 orch-szrijg-orchestrator-1 ns-uykdh orch-szrijg orchestrator Running secondary us-west-2a 600m / 600m 644245094400m / 644245094400m data:1Gi ip-172-31-12-133.us-west-2.compute.internal/172.31.12.133 May 28,2025 12:17 UTC+0800 orch-szrijg-orchestrator-2 ns-uykdh orch-szrijg orchestrator Running primary us-west-2a 600m / 600m 644245094400m / 644245094400m data:1Gi ip-172-31-11-43.us-west-2.compute.internal/172.31.11.43 May 28,2025 12:16 UTC+0800 orch-szrijg-orchestrator-3 ns-uykdh orch-szrijg orchestrator Running secondary us-west-2a 600m / 600m 644245094400m / 644245094400m data:1Gi ip-172-31-8-55.us-west-2.compute.internal/172.31.8.55 May 28,2025 12:15 UTC+0800 check pod status done check cluster connect ` echo 'curl -s http://orch-szrijg-orchestrator:80/api/health ' | kubectl exec -it orch-szrijg-orchestrator-0 --namespace ns-uykdh -- bash` check cluster connect done No resources found in orch-szrijg namespace. check ops status `kbcli cluster list-ops orch-szrijg --status all --namespace ns-uykdh ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME orch-szrijg-horizontalscaling-jtnnx ns-uykdh HorizontalScaling orch-szrijg orchestrator Succeed 1/1 May 28,2025 12:14 UTC+0800 check ops status done ops_status:orch-szrijg-horizontalscaling-jtnnx ns-uykdh HorizontalScaling orch-szrijg orchestrator Succeed 1/1 May 28,2025 12:14 UTC+0800 `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge opsrequests.operations orch-szrijg-horizontalscaling-jtnnx --namespace ns-uykdh ` opsrequest.operations.kubeblocks.io/orch-szrijg-horizontalscaling-jtnnx patched `kbcli cluster delete-ops --name orch-szrijg-horizontalscaling-jtnnx --force --auto-approve --namespace ns-uykdh ` OpsRequest orch-szrijg-horizontalscaling-jtnnx deleted cluster orchestrator scale-in check cluster status before ops check cluster status done cluster_status:Running No resources found in orch-szrijg namespace. `kbcli cluster scale-in orch-szrijg --auto-approve --force=true --components orchestrator --replicas 1 --namespace ns-uykdh ` OpsRequest orch-szrijg-horizontalscaling-ccwmz created successfully, you can view the progress: kbcli cluster describe-ops orch-szrijg-horizontalscaling-ccwmz -n ns-uykdh check ops status `kbcli cluster list-ops orch-szrijg --status all --namespace ns-uykdh ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME orch-szrijg-horizontalscaling-ccwmz ns-uykdh HorizontalScaling orch-szrijg orchestrator Running 0/1 May 28,2025 12:19 UTC+0800 cluster restart `kbcli cluster restart orch-szrijg --auto-approve --force=true --namespace ns-uykdh ` OpsRequest orch-szrijg-restart-wc45l created successfully, you can view the progress: kbcli cluster describe-ops orch-szrijg-restart-wc45l -n ns-uykdh check ops status `kbcli cluster list-ops orch-szrijg --status all --namespace ns-uykdh ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME orch-szrijg-horizontalscaling-ccwmz ns-uykdh HorizontalScaling orch-szrijg orchestrator Running 0/1 May 28,2025 12:19 UTC+0800 orch-szrijg-restart-wc45l ns-uykdh Restart orch-szrijg orchestrator Running 0/3 May 28,2025 12:19 UTC+0800 check cluster status `kbcli cluster list orch-szrijg --show-labels --namespace ns-uykdh ` NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS orch-szrijg ns-uykdh orchestrator Delete Updating May 28,2025 11:44 UTC+0800 app.kubernetes.io/instance=orch-szrijg,clusterdefinition.kubeblocks.io/name=orchestrator cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances orch-szrijg --namespace ns-uykdh ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME orch-szrijg-orchestrator-0 ns-uykdh orch-szrijg orchestrator Running primary us-west-2a 600m / 600m 644245094400m / 644245094400m data:1Gi ip-172-31-5-250.us-west-2.compute.internal/172.31.5.250 May 28,2025 12:21 UTC+0800 orch-szrijg-orchestrator-1 ns-uykdh orch-szrijg orchestrator Running secondary us-west-2a 600m / 600m 644245094400m / 644245094400m data:1Gi ip-172-31-12-133.us-west-2.compute.internal/172.31.12.133 May 28,2025 12:19 UTC+0800 orch-szrijg-orchestrator-2 ns-uykdh orch-szrijg orchestrator Running secondary us-west-2a 600m / 600m 644245094400m / 644245094400m data:1Gi ip-172-31-6-100.us-west-2.compute.internal/172.31.6.100 May 28,2025 12:20 UTC+0800 check pod status done check cluster connect ` echo 'curl -s http://orch-szrijg-orchestrator:80/api/health ' | kubectl exec -it orch-szrijg-orchestrator-0 --namespace ns-uykdh -- bash` check cluster connect done check ops status `kbcli cluster list-ops orch-szrijg --status all --namespace ns-uykdh ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME orch-szrijg-horizontalscaling-ccwmz ns-uykdh HorizontalScaling orch-szrijg orchestrator Succeed 1/1 May 28,2025 12:19 UTC+0800 orch-szrijg-restart-wc45l ns-uykdh Restart orch-szrijg orchestrator Succeed 3/3 May 28,2025 12:19 UTC+0800 check ops status done ops_status:orch-szrijg-restart-wc45l ns-uykdh Restart orch-szrijg orchestrator Succeed 3/3 May 28,2025 12:19 UTC+0800 `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge opsrequests.operations orch-szrijg-restart-wc45l --namespace ns-uykdh ` opsrequest.operations.kubeblocks.io/orch-szrijg-restart-wc45l patched `kbcli cluster delete-ops --name orch-szrijg-restart-wc45l --force --auto-approve --namespace ns-uykdh ` OpsRequest orch-szrijg-restart-wc45l deleted check cluster status `kbcli cluster list orch-szrijg --show-labels --namespace ns-uykdh ` NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS orch-szrijg ns-uykdh orchestrator Delete Running May 28,2025 11:44 UTC+0800 app.kubernetes.io/instance=orch-szrijg,clusterdefinition.kubeblocks.io/name=orchestrator check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances orch-szrijg --namespace ns-uykdh ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME orch-szrijg-orchestrator-0 ns-uykdh orch-szrijg orchestrator Running primary us-west-2a 600m / 600m 644245094400m / 644245094400m data:1Gi ip-172-31-5-250.us-west-2.compute.internal/172.31.5.250 May 28,2025 12:21 UTC+0800 orch-szrijg-orchestrator-1 ns-uykdh orch-szrijg orchestrator Running secondary us-west-2a 600m / 600m 644245094400m / 644245094400m data:1Gi ip-172-31-12-133.us-west-2.compute.internal/172.31.12.133 May 28,2025 12:19 UTC+0800 orch-szrijg-orchestrator-2 ns-uykdh orch-szrijg orchestrator Running secondary us-west-2a 600m / 600m 644245094400m / 644245094400m data:1Gi ip-172-31-6-100.us-west-2.compute.internal/172.31.6.100 May 28,2025 12:20 UTC+0800 check pod status done check cluster connect ` echo 'curl -s http://orch-szrijg-orchestrator:80/api/health ' | kubectl exec -it orch-szrijg-orchestrator-0 --namespace ns-uykdh -- bash` check cluster connect done No resources found in orch-szrijg namespace. check ops status `kbcli cluster list-ops orch-szrijg --status all --namespace ns-uykdh ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME orch-szrijg-horizontalscaling-ccwmz ns-uykdh HorizontalScaling orch-szrijg orchestrator Succeed 1/1 May 28,2025 12:19 UTC+0800 check ops status done ops_status:orch-szrijg-horizontalscaling-ccwmz ns-uykdh HorizontalScaling orch-szrijg orchestrator Succeed 1/1 May 28,2025 12:19 UTC+0800 `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge opsrequests.operations orch-szrijg-horizontalscaling-ccwmz --namespace ns-uykdh ` opsrequest.operations.kubeblocks.io/orch-szrijg-horizontalscaling-ccwmz patched `kbcli cluster delete-ops --name orch-szrijg-horizontalscaling-ccwmz --force --auto-approve --namespace ns-uykdh ` OpsRequest orch-szrijg-horizontalscaling-ccwmz deleted `kubectl get pvc -l app.kubernetes.io/instance=orch-szrijg,apps.kubeblocks.io/component-name=orchestrator,apps.kubeblocks.io/vct-name=data --namespace ns-uykdh ` cluster volume-expand check cluster status before ops check cluster status done cluster_status:Running No resources found in orch-szrijg namespace. `kbcli cluster volume-expand orch-szrijg --auto-approve --force=true --components orchestrator --volume-claim-templates data --storage 3Gi --namespace ns-uykdh ` OpsRequest orch-szrijg-volumeexpansion-8v6z2 created successfully, you can view the progress: kbcli cluster describe-ops orch-szrijg-volumeexpansion-8v6z2 -n ns-uykdh check ops status `kbcli cluster list-ops orch-szrijg --status all --namespace ns-uykdh ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME orch-szrijg-volumeexpansion-8v6z2 ns-uykdh VolumeExpansion orch-szrijg orchestrator Running 0/3 May 28,2025 12:22 UTC+0800 check cluster status `kbcli cluster list orch-szrijg --show-labels --namespace ns-uykdh ` NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS orch-szrijg ns-uykdh orchestrator Delete Updating May 28,2025 11:44 UTC+0800 app.kubernetes.io/instance=orch-szrijg,clusterdefinition.kubeblocks.io/name=orchestrator cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances orch-szrijg --namespace ns-uykdh ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME orch-szrijg-orchestrator-0 ns-uykdh orch-szrijg orchestrator Running primary us-west-2a 600m / 600m 644245094400m / 644245094400m data:3Gi ip-172-31-5-250.us-west-2.compute.internal/172.31.5.250 May 28,2025 12:21 UTC+0800 orch-szrijg-orchestrator-1 ns-uykdh orch-szrijg orchestrator Running secondary us-west-2a 600m / 600m 644245094400m / 644245094400m data:3Gi ip-172-31-12-133.us-west-2.compute.internal/172.31.12.133 May 28,2025 12:19 UTC+0800 orch-szrijg-orchestrator-2 ns-uykdh orch-szrijg orchestrator Running secondary us-west-2a 600m / 600m 644245094400m / 644245094400m data:3Gi ip-172-31-6-100.us-west-2.compute.internal/172.31.6.100 May 28,2025 12:20 UTC+0800 check pod status done check cluster connect ` echo 'curl -s http://orch-szrijg-orchestrator:80/api/health ' | kubectl exec -it orch-szrijg-orchestrator-0 --namespace ns-uykdh -- bash` check cluster connect done No resources found in orch-szrijg namespace. check ops status `kbcli cluster list-ops orch-szrijg --status all --namespace ns-uykdh ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME orch-szrijg-volumeexpansion-8v6z2 ns-uykdh VolumeExpansion orch-szrijg orchestrator Succeed 3/3 May 28,2025 12:22 UTC+0800 check ops status done ops_status:orch-szrijg-volumeexpansion-8v6z2 ns-uykdh VolumeExpansion orch-szrijg orchestrator Succeed 3/3 May 28,2025 12:22 UTC+0800 `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge opsrequests.operations orch-szrijg-volumeexpansion-8v6z2 --namespace ns-uykdh ` opsrequest.operations.kubeblocks.io/orch-szrijg-volumeexpansion-8v6z2 patched `kbcli cluster delete-ops --name orch-szrijg-volumeexpansion-8v6z2 --force --auto-approve --namespace ns-uykdh ` OpsRequest orch-szrijg-volumeexpansion-8v6z2 deleted cluster does not need to check monitor currently check cluster status `kbcli cluster list orch-szrijg --show-labels --namespace ns-uykdh ` NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS orch-szrijg ns-uykdh orchestrator Delete Running May 28,2025 11:44 UTC+0800 app.kubernetes.io/instance=orch-szrijg,clusterdefinition.kubeblocks.io/name=orchestrator check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances orch-szrijg --namespace ns-uykdh ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME orch-szrijg-orchestrator-0 ns-uykdh orch-szrijg orchestrator Running primary us-west-2a 600m / 600m 644245094400m / 644245094400m data:3Gi ip-172-31-5-250.us-west-2.compute.internal/172.31.5.250 May 28,2025 12:21 UTC+0800 orch-szrijg-orchestrator-1 ns-uykdh orch-szrijg orchestrator Running secondary us-west-2a 600m / 600m 644245094400m / 644245094400m data:3Gi ip-172-31-12-133.us-west-2.compute.internal/172.31.12.133 May 28,2025 12:19 UTC+0800 orch-szrijg-orchestrator-2 ns-uykdh orch-szrijg orchestrator Running secondary us-west-2a 600m / 600m 644245094400m / 644245094400m data:3Gi ip-172-31-6-100.us-west-2.compute.internal/172.31.6.100 May 28,2025 12:20 UTC+0800 check pod status done check cluster connect ` echo 'curl -s http://orch-szrijg-orchestrator:80/api/health ' | kubectl exec -it orch-szrijg-orchestrator-0 --namespace ns-uykdh -- bash` check cluster connect done cluster update terminationPolicy WipeOut `kbcli cluster update orch-szrijg --termination-policy=WipeOut --namespace ns-uykdh ` cluster.apps.kubeblocks.io/orch-szrijg updated check cluster status `kbcli cluster list orch-szrijg --show-labels --namespace ns-uykdh ` NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS orch-szrijg ns-uykdh orchestrator WipeOut Running May 28,2025 11:44 UTC+0800 app.kubernetes.io/instance=orch-szrijg,clusterdefinition.kubeblocks.io/name=orchestrator check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances orch-szrijg --namespace ns-uykdh ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME orch-szrijg-orchestrator-0 ns-uykdh orch-szrijg orchestrator Running primary us-west-2a 600m / 600m 644245094400m / 644245094400m data:3Gi ip-172-31-5-250.us-west-2.compute.internal/172.31.5.250 May 28,2025 12:21 UTC+0800 orch-szrijg-orchestrator-1 ns-uykdh orch-szrijg orchestrator Running secondary us-west-2a 600m / 600m 644245094400m / 644245094400m data:3Gi ip-172-31-12-133.us-west-2.compute.internal/172.31.12.133 May 28,2025 12:19 UTC+0800 orch-szrijg-orchestrator-2 ns-uykdh orch-szrijg orchestrator Running secondary us-west-2a 600m / 600m 644245094400m / 644245094400m data:3Gi ip-172-31-6-100.us-west-2.compute.internal/172.31.6.100 May 28,2025 12:20 UTC+0800 check pod status done check cluster connect ` echo 'curl -s http://orch-szrijg-orchestrator:80/api/health ' | kubectl exec -it orch-szrijg-orchestrator-0 --namespace ns-uykdh -- bash` check cluster connect done cluster list-logs `kbcli cluster list-logs orch-szrijg --namespace ns-uykdh ` No log files found. Error from server (NotFound): pods "orch-szrijg-orchestrator-0" not found cluster logs `kbcli cluster logs orch-szrijg --tail 30 --namespace ns-uykdh ` Defaulted container "orchestrator" out of: orchestrator, kbagent, init-kbagent (init), kbagent-worker (init) [martini] Started GET /api/leader-check for 127.0.0.1:40538 [martini] Completed 200 OK in 556.823µs [martini] Started GET /api/health for 172.31.5.250:47502 [martini] Completed 200 OK in 1.600449ms [martini] Started GET /api/raft-follower-health-report/56778eda/orch-szrijg-orchestrator-0.orch-szrijg-orchestrator-headless.ns-uykdh.svc.cluster.local/orch-szrijg-orchestrator-0.orch-szrijg-orchestrator-headless.ns-uykdh.svc.cluster.local for 172.31.14.199:54740 [martini] Completed 200 OK in 2.216543ms [martini] Started GET /api/leader-check for 127.0.0.1:40714 [martini] Completed 200 OK in 482.142µs [martini] Started GET /api/raft-follower-health-report/56778eda/orch-szrijg-orchestrator-2.orch-szrijg-orchestrator-headless.ns-uykdh.svc.cluster.local/orch-szrijg-orchestrator-2.orch-szrijg-orchestrator-headless.ns-uykdh.svc.cluster.local for 172.31.10.208:45068 [martini] Completed 200 OK in 1.333317ms [martini] Started GET /api/raft-follower-health-report/56778eda/orch-szrijg-orchestrator-1.orch-szrijg-orchestrator-headless.ns-uykdh.svc.cluster.local/orch-szrijg-orchestrator-1.orch-szrijg-orchestrator-headless.ns-uykdh.svc.cluster.local for 172.31.12.73:59296 [martini] Completed 200 OK in 1.042786ms [martini] Started GET /api/health for 172.31.5.250:49018 [martini] Completed 200 OK in 2.381263ms [martini] Started GET /api/leader-check for 127.0.0.1:40720 [martini] Completed 200 OK in 424.193µs [martini] Started GET /api/raft-follower-health-report/de1f0494/orch-szrijg-orchestrator-0.orch-szrijg-orchestrator-headless.ns-uykdh.svc.cluster.local/orch-szrijg-orchestrator-0.orch-szrijg-orchestrator-headless.ns-uykdh.svc.cluster.local for 172.31.14.199:54740 [martini] Completed 200 OK in 1.115156ms [martini] Started GET /api/leader-check for 127.0.0.1:59962 [martini] Completed 200 OK in 566.323µs [martini] Started GET /api/raft-follower-health-report/de1f0494/orch-szrijg-orchestrator-1.orch-szrijg-orchestrator-headless.ns-uykdh.svc.cluster.local/orch-szrijg-orchestrator-1.orch-szrijg-orchestrator-headless.ns-uykdh.svc.cluster.local for 172.31.12.73:59296 [martini] Completed 200 OK in 1.055125ms [martini] Started GET /api/raft-follower-health-report/de1f0494/orch-szrijg-orchestrator-2.orch-szrijg-orchestrator-headless.ns-uykdh.svc.cluster.local/orch-szrijg-orchestrator-2.orch-szrijg-orchestrator-headless.ns-uykdh.svc.cluster.local for 172.31.10.208:45068 [martini] Completed 200 OK in 1.053786ms [martini] Started GET /api/health for 172.31.5.250:42572 [martini] Completed 200 OK in 1.355157ms [martini] Started GET /api/health for 172.31.5.250:14923 [martini] Completed 200 OK in 470.103µs [martini] Started GET /api/leader-check for 127.0.0.1:59964 [martini] Completed 200 OK in 459.333µs delete cluster orch-szrijg `kbcli cluster delete orch-szrijg --auto-approve --namespace ns-uykdh ` Cluster orch-szrijg deleted pod_info:orch-szrijg-orchestrator-0 2/2 Terminating 0 2m38s orch-szrijg-orchestrator-1 2/2 Terminating 0 4m14s orch-szrijg-orchestrator-2 2/2 Terminating 0 3m26s pod_info:orch-szrijg-orchestrator-0 2/2 Terminating 0 2m59s orch-szrijg-orchestrator-1 2/2 Terminating 0 4m35s orch-szrijg-orchestrator-2 2/2 Terminating 0 3m47s No resources found in ns-uykdh namespace. delete cluster pod done No resources found in ns-uykdh namespace. check cluster resource non-exist OK: pvc No resources found in ns-uykdh namespace. delete cluster done No resources found in ns-uykdh namespace. No resources found in ns-uykdh namespace. No resources found in ns-uykdh namespace. Orchestrator Cluster Test Suite All Done! delete cluster mysqlo-szrijg `kbcli cluster delete mysqlo-szrijg --auto-approve --namespace ns-uykdh ` Cluster mysqlo-szrijg deleted pod_info:mysqlo-szrijg-mysql-0 4/4 Terminating 0 46m mysqlo-szrijg-mysql-1 4/4 Terminating 0 45m mysqlo-szrijg-mysql-2 4/4 Terminating 0 44m pod_info:mysqlo-szrijg-mysql-0 4/4 Terminating 0 46m mysqlo-szrijg-mysql-1 4/4 Terminating 0 45m mysqlo-szrijg-mysql-2 4/4 Terminating 0 44m No resources found in ns-uykdh namespace. delete cluster pod done No resources found in ns-uykdh namespace. check cluster resource non-exist OK: pvc No resources found in ns-uykdh namespace. delete cluster done No resources found in ns-uykdh namespace. No resources found in ns-uykdh namespace. No resources found in ns-uykdh namespace. [PASSED]|[Create]|[ComponentDefinition=apecloud-mysql-1.0.0-alpha.0;ServiceVersion=8.0.30;]|[Description=Create a cluster with the specified component definition apecloud-mysql-1.0.0-alpha.0 and service version 8.0.30] --------------------------------------Orchestrator (Topology = raft Replicas 3) Test Result-------------------------------------- [PASSED]|[Create]|[ComponentDefinition=orchestrator-shared-backend-1.0.0-alpha.0;ComponentVersion=orchestrator;ServiceVersion=3.2.6;]|[Description=Create a cluster with the specified component definition orchestrator-shared-backend-1.0.0-alpha.0 and component version orchestrator and service version 3.2.6] [PASSED]|[Connect]|[ComponentName=orchestrator]|[Description=Connect to the cluster] [PASSED]|[Restart]|[-]|[Description=Restart the cluster] [PASSED]|[HscaleOfflineInstances]|[ComponentName=orchestrator]|[Description=Hscale the cluster instances offline specify component orchestrator] [PASSED]|[HscaleOnlineInstances]|[ComponentName=orchestrator]|[Description=Hscale the cluster instances online specify component orchestrator] [PASSED]|[Stop]|[-]|[Description=Stop the cluster] [PASSED]|[Start]|[-]|[Description=Start the cluster] [PASSED]|[VerticalScaling]|[ComponentName=orchestrator]|[Description=VerticalScaling the cluster specify component orchestrator] [PASSED]|[HorizontalScaling Out]|[ComponentName=orchestrator]|[Description=HorizontalScaling Out the cluster specify component orchestrator] [PASSED]|[HorizontalScaling In]|[ComponentName=orchestrator]|[Description=HorizontalScaling In the cluster specify component orchestrator] [PASSED]|[VolumeExpansion]|[ComponentName=orchestrator]|[Description=VolumeExpansion the cluster specify component orchestrator] [PASSED]|[Update]|[Monitor=true]|[Description=Update the cluster Monitor enable] [PASSED]|[Update]|[TerminationPolicy=WipeOut]|[Description=Update the cluster TerminationPolicy WipeOut] [PASSED]|[Delete]|[-]|[Description=Delete the cluster] [END]