source commons files source engines files source kubeblocks files `kubectl get namespace | grep ns-kvlyi ` `kubectl create namespace ns-kvlyi` namespace/ns-kvlyi created create namespace ns-kvlyi done download kbcli `gh release list --repo apecloud/kbcli --limit 100 | (grep "1.0" || true)` `curl -fsSL https://kubeblocks.io/installer/install_cli.sh | bash -s v1.0.0` Your system is linux_amd64 Installing kbcli ... Downloading ... % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 33.6M 100 33.6M 0 0 158M 0 --:--:-- --:--:-- --:--:-- 158M kbcli installed successfully. Kubernetes: v1.32.5-eks-5d4a308 KubeBlocks: 1.0.0 kbcli: 1.0.0 Make sure your docker service is running and begin your journey with kbcli: kbcli playground init For more information on how to get started, please visit: https://kubeblocks.io download kbcli v1.0.0 done Kubernetes: v1.32.5-eks-5d4a308 KubeBlocks: 1.0.0 kbcli: 1.0.0 Kubernetes Env: v1.32.5-eks-5d4a308 check snapshot controller check snapshot controller done eks default-vsc found POD_RESOURCES: No resources found found default storage class: gp3 KubeBlocks version is:1.0.0 skip upgrade KubeBlocks current KubeBlocks version: 1.0.0 Error: no repositories to show helm repo add chaos-mesh https://charts.chaos-mesh.org "chaos-mesh" has been added to your repositories add helm chart repo chaos-mesh success chaos mesh already installed check component definition set component name:etcd set component version set component version:etcd set service versions:3.5.15,3.5.6 set service versions sorted:3.5.6,3.5.15 set etcd component definition set etcd component definition etcd-3-1.0.0-alpha.0 set replicas first:3,3.5.6|3,3.5.15 set replicas third:3,3.5.6 set replicas fourth:3,3.5.6 set minimum cmpv service version set minimum cmpv service version replicas:3,3.5.6 REPORT_COUNT:1 Not support cluster topology for etcd set etcd component definition set etcd component definition etcd-3-1.0.0-alpha.0 LIMIT_CPU:0.1 LIMIT_MEMORY:0.5 storage size: 1 No resources found in ns-kvlyi namespace. termination_policy:DoNotTerminate create 3 replica DoNotTerminate etcd cluster check component definition set component definition by component version check cmpd by labels set component definition1: etcd-3-1.0.0-alpha.0 by component version:etcd apiVersion: apps.kubeblocks.io/v1 kind: Cluster metadata: name: etcd-cuefmg namespace: ns-kvlyi spec: terminationPolicy: DoNotTerminate componentSpecs: - name: etcd componentDef: etcd-3-1.0.0-alpha.0 tls: false replicas: 3 resources: requests: cpu: 100m memory: 0.5Gi limits: cpu: 100m memory: 0.5Gi volumeClaimTemplates: - name: data spec: storageClassName: accessModes: - ReadWriteOnce resources: requests: storage: 1Gi `kubectl apply -f test_create_etcd-cuefmg.yaml` cluster.apps.kubeblocks.io/etcd-cuefmg created apply test_create_etcd-cuefmg.yaml Success `rm -rf test_create_etcd-cuefmg.yaml` check cluster status `kbcli cluster list etcd-cuefmg --show-labels --namespace ns-kvlyi ` NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS etcd-cuefmg ns-kvlyi DoNotTerminate Creating May 28,2025 11:39 UTC+0800 cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances etcd-cuefmg --namespace ns-kvlyi ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME etcd-cuefmg-etcd-0 ns-kvlyi etcd-cuefmg etcd Running leader us-west-2a 100m / 100m 512Mi / 512Mi data:1Gi ip-172-31-2-57.us-west-2.compute.internal/172.31.2.57 May 28,2025 11:39 UTC+0800 etcd-cuefmg-etcd-1 ns-kvlyi etcd-cuefmg etcd Running follower us-west-2a 100m / 100m 512Mi / 512Mi data:1Gi ip-172-31-3-65.us-west-2.compute.internal/172.31.3.65 May 28,2025 11:39 UTC+0800 etcd-cuefmg-etcd-2 ns-kvlyi etcd-cuefmg etcd Running follower us-west-2a 100m / 100m 512Mi / 512Mi data:1Gi ip-172-31-8-141.us-west-2.compute.internal/172.31.8.141 May 28,2025 11:40 UTC+0800 check pod status done check cluster role check cluster role done leader: etcd-cuefmg-etcd-0;follower: etcd-cuefmg-etcd-1 etcd-cuefmg-etcd-2 connect unsupported engine type: etcd etcd-3-1.0.0-alpha.0 `kubectl get secrets -l app.kubernetes.io/instance=etcd-cuefmg` No resources found in ns-kvlyi namespace. Not found cluster secret DB_USERNAME:;DB_PASSWORD:;DB_PORT:;DB_DATABASE: There is no password in Type: 15. describe cluster `kbcli cluster describe etcd-cuefmg --namespace ns-kvlyi ` Name: etcd-cuefmg Created Time: May 28,2025 11:39 UTC+0800 NAMESPACE CLUSTER-DEFINITION TOPOLOGY STATUS TERMINATION-POLICY ns-kvlyi Running DoNotTerminate Endpoints: COMPONENT INTERNAL EXTERNAL Topology: COMPONENT SERVICE-VERSION INSTANCE ROLE STATUS AZ NODE CREATED-TIME etcd 3.5.15 etcd-cuefmg-etcd-0 leader Running us-west-2a ip-172-31-2-57.us-west-2.compute.internal/172.31.2.57 May 28,2025 11:39 UTC+0800 etcd 3.5.15 etcd-cuefmg-etcd-1 follower Running us-west-2a ip-172-31-3-65.us-west-2.compute.internal/172.31.3.65 May 28,2025 11:39 UTC+0800 etcd 3.5.15 etcd-cuefmg-etcd-2 follower Running us-west-2a ip-172-31-8-141.us-west-2.compute.internal/172.31.8.141 May 28,2025 11:40 UTC+0800 Resources Allocation: COMPONENT INSTANCE-TEMPLATE CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE-SIZE STORAGE-CLASS etcd 100m / 100m 512Mi / 512Mi data:1Gi kb-default-sc Images: COMPONENT COMPONENT-DEFINITION IMAGE etcd etcd-3-1.0.0-alpha.0 docker.io/apecloud/etcd:v3.5.15 Data Protection: BACKUP-REPO AUTO-BACKUP BACKUP-SCHEDULE BACKUP-METHOD BACKUP-RETENTION RECOVERABLE-TIME Show cluster events: kbcli cluster list-events -n ns-kvlyi etcd-cuefmg `kbcli cluster label etcd-cuefmg app.kubernetes.io/instance- --namespace ns-kvlyi ` label "app.kubernetes.io/instance" not found. `kbcli cluster label etcd-cuefmg app.kubernetes.io/instance=etcd-cuefmg --namespace ns-kvlyi ` `kbcli cluster label etcd-cuefmg --list --namespace ns-kvlyi ` NAME NAMESPACE LABELS etcd-cuefmg ns-kvlyi app.kubernetes.io/instance=etcd-cuefmg label cluster app.kubernetes.io/instance=etcd-cuefmg Success `kbcli cluster label case.name=kbcli.test1 -l app.kubernetes.io/instance=etcd-cuefmg --namespace ns-kvlyi ` `kbcli cluster label etcd-cuefmg --list --namespace ns-kvlyi ` NAME NAMESPACE LABELS etcd-cuefmg ns-kvlyi app.kubernetes.io/instance=etcd-cuefmg case.name=kbcli.test1 label cluster case.name=kbcli.test1 Success `kbcli cluster label etcd-cuefmg case.name=kbcli.test2 --overwrite --namespace ns-kvlyi ` `kbcli cluster label etcd-cuefmg --list --namespace ns-kvlyi ` NAME NAMESPACE LABELS etcd-cuefmg ns-kvlyi app.kubernetes.io/instance=etcd-cuefmg case.name=kbcli.test2 label cluster case.name=kbcli.test2 Success `kbcli cluster label etcd-cuefmg case.name- --namespace ns-kvlyi ` `kbcli cluster label etcd-cuefmg --list --namespace ns-kvlyi ` NAME NAMESPACE LABELS etcd-cuefmg ns-kvlyi app.kubernetes.io/instance=etcd-cuefmg delete cluster label case.name Success 1 check cluster status before ops check cluster status done cluster_status:Running `kbcli cluster vscale etcd-cuefmg --auto-approve --force=true --components etcd --cpu 200m --memory 0.6Gi --namespace ns-kvlyi ` OpsRequest etcd-cuefmg-verticalscaling-jj99p created successfully, you can view the progress: kbcli cluster describe-ops etcd-cuefmg-verticalscaling-jj99p -n ns-kvlyi check ops status `kbcli cluster list-ops etcd-cuefmg --status all --namespace ns-kvlyi ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME etcd-cuefmg-verticalscaling-jj99p ns-kvlyi VerticalScaling etcd-cuefmg etcd Running 0/3 May 28,2025 11:42 UTC+0800 check cluster status `kbcli cluster list etcd-cuefmg --show-labels --namespace ns-kvlyi ` NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS etcd-cuefmg ns-kvlyi DoNotTerminate Updating May 28,2025 11:39 UTC+0800 app.kubernetes.io/instance=etcd-cuefmg cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances etcd-cuefmg --namespace ns-kvlyi ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME etcd-cuefmg-etcd-0 ns-kvlyi etcd-cuefmg etcd Running follower us-west-2a 200m / 200m 644245094400m / 644245094400m data:1Gi ip-172-31-2-57.us-west-2.compute.internal/172.31.2.57 May 28,2025 11:45 UTC+0800 etcd-cuefmg-etcd-1 ns-kvlyi etcd-cuefmg etcd Running follower us-west-2a 200m / 200m 644245094400m / 644245094400m data:1Gi ip-172-31-9-141.us-west-2.compute.internal/172.31.9.141 May 28,2025 11:43 UTC+0800 etcd-cuefmg-etcd-2 ns-kvlyi etcd-cuefmg etcd Running leader us-west-2a 200m / 200m 644245094400m / 644245094400m data:1Gi ip-172-31-8-141.us-west-2.compute.internal/172.31.8.141 May 28,2025 11:42 UTC+0800 check pod status done check cluster role check cluster role done leader: etcd-cuefmg-etcd-2;follower: etcd-cuefmg-etcd-0 etcd-cuefmg-etcd-1 connect unsupported engine type: etcd etcd-3-1.0.0-alpha.0 check ops status `kbcli cluster list-ops etcd-cuefmg --status all --namespace ns-kvlyi ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME etcd-cuefmg-verticalscaling-jj99p ns-kvlyi VerticalScaling etcd-cuefmg etcd Succeed 3/3 May 28,2025 11:42 UTC+0800 check ops status done ops_status:etcd-cuefmg-verticalscaling-jj99p ns-kvlyi VerticalScaling etcd-cuefmg etcd Succeed 3/3 May 28,2025 11:42 UTC+0800 `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge opsrequests.operations etcd-cuefmg-verticalscaling-jj99p --namespace ns-kvlyi ` opsrequest.operations.kubeblocks.io/etcd-cuefmg-verticalscaling-jj99p patched `kbcli cluster delete-ops --name etcd-cuefmg-verticalscaling-jj99p --force --auto-approve --namespace ns-kvlyi ` OpsRequest etcd-cuefmg-verticalscaling-jj99p deleted cluster stop check cluster status before ops check cluster status done cluster_status:Running `kbcli cluster stop etcd-cuefmg --auto-approve --force=true --namespace ns-kvlyi ` OpsRequest etcd-cuefmg-stop-ns9rs created successfully, you can view the progress: kbcli cluster describe-ops etcd-cuefmg-stop-ns9rs -n ns-kvlyi check ops status `kbcli cluster list-ops etcd-cuefmg --status all --namespace ns-kvlyi ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME etcd-cuefmg-stop-ns9rs ns-kvlyi Stop etcd-cuefmg etcd Running 0/3 May 28,2025 11:46 UTC+0800 check cluster status `kbcli cluster list etcd-cuefmg --show-labels --namespace ns-kvlyi ` NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS etcd-cuefmg ns-kvlyi DoNotTerminate Stopped May 28,2025 11:39 UTC+0800 app.kubernetes.io/instance=etcd-cuefmg check cluster status done cluster_status:Stopped check pod status `kbcli cluster list-instances etcd-cuefmg --namespace ns-kvlyi ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME check pod status done check ops status `kbcli cluster list-ops etcd-cuefmg --status all --namespace ns-kvlyi ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME etcd-cuefmg-stop-ns9rs ns-kvlyi Stop etcd-cuefmg etcd Succeed 3/3 May 28,2025 11:46 UTC+0800 check ops status done ops_status:etcd-cuefmg-stop-ns9rs ns-kvlyi Stop etcd-cuefmg etcd Succeed 3/3 May 28,2025 11:46 UTC+0800 `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge opsrequests.operations etcd-cuefmg-stop-ns9rs --namespace ns-kvlyi ` opsrequest.operations.kubeblocks.io/etcd-cuefmg-stop-ns9rs patched `kbcli cluster delete-ops --name etcd-cuefmg-stop-ns9rs --force --auto-approve --namespace ns-kvlyi ` OpsRequest etcd-cuefmg-stop-ns9rs deleted cluster start check cluster status before ops check cluster status done cluster_status:Stopped `kbcli cluster start etcd-cuefmg --force=true --namespace ns-kvlyi ` OpsRequest etcd-cuefmg-start-hc7kv created successfully, you can view the progress: kbcli cluster describe-ops etcd-cuefmg-start-hc7kv -n ns-kvlyi check ops status `kbcli cluster list-ops etcd-cuefmg --status all --namespace ns-kvlyi ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME etcd-cuefmg-start-hc7kv ns-kvlyi Start etcd-cuefmg etcd Running 0/3 May 28,2025 11:47 UTC+0800 check cluster status `kbcli cluster list etcd-cuefmg --show-labels --namespace ns-kvlyi ` NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS etcd-cuefmg ns-kvlyi DoNotTerminate Updating May 28,2025 11:39 UTC+0800 app.kubernetes.io/instance=etcd-cuefmg cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances etcd-cuefmg --namespace ns-kvlyi ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME etcd-cuefmg-etcd-0 ns-kvlyi etcd-cuefmg etcd Running leader us-west-2a 200m / 200m 644245094400m / 644245094400m data:1Gi ip-172-31-13-166.us-west-2.compute.internal/172.31.13.166 May 28,2025 11:47 UTC+0800 etcd-cuefmg-etcd-1 ns-kvlyi etcd-cuefmg etcd Running follower us-west-2a 200m / 200m 644245094400m / 644245094400m data:1Gi ip-172-31-11-30.us-west-2.compute.internal/172.31.11.30 May 28,2025 11:47 UTC+0800 etcd-cuefmg-etcd-2 ns-kvlyi etcd-cuefmg etcd Running follower us-west-2a 200m / 200m 644245094400m / 644245094400m data:1Gi ip-172-31-9-141.us-west-2.compute.internal/172.31.9.141 May 28,2025 11:47 UTC+0800 check pod status done check cluster role check cluster role done leader: etcd-cuefmg-etcd-0;follower: etcd-cuefmg-etcd-1 etcd-cuefmg-etcd-2 connect unsupported engine type: etcd etcd-3-1.0.0-alpha.0 check ops status `kbcli cluster list-ops etcd-cuefmg --status all --namespace ns-kvlyi ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME etcd-cuefmg-start-hc7kv ns-kvlyi Start etcd-cuefmg etcd Succeed 3/3 May 28,2025 11:47 UTC+0800 check ops status done ops_status:etcd-cuefmg-start-hc7kv ns-kvlyi Start etcd-cuefmg etcd Succeed 3/3 May 28,2025 11:47 UTC+0800 `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge opsrequests.operations etcd-cuefmg-start-hc7kv --namespace ns-kvlyi ` opsrequest.operations.kubeblocks.io/etcd-cuefmg-start-hc7kv patched `kbcli cluster delete-ops --name etcd-cuefmg-start-hc7kv --force --auto-approve --namespace ns-kvlyi ` OpsRequest etcd-cuefmg-start-hc7kv deleted cluster restart check cluster status before ops check cluster status done cluster_status:Running `kbcli cluster restart etcd-cuefmg --auto-approve --force=true --namespace ns-kvlyi ` OpsRequest etcd-cuefmg-restart-bsfrp created successfully, you can view the progress: kbcli cluster describe-ops etcd-cuefmg-restart-bsfrp -n ns-kvlyi check ops status `kbcli cluster list-ops etcd-cuefmg --status all --namespace ns-kvlyi ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME etcd-cuefmg-restart-bsfrp ns-kvlyi Restart etcd-cuefmg etcd Running 0/3 May 28,2025 11:49 UTC+0800 check cluster status `kbcli cluster list etcd-cuefmg --show-labels --namespace ns-kvlyi ` NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS etcd-cuefmg ns-kvlyi DoNotTerminate Updating May 28,2025 11:39 UTC+0800 app.kubernetes.io/instance=etcd-cuefmg cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances etcd-cuefmg --namespace ns-kvlyi ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME etcd-cuefmg-etcd-0 ns-kvlyi etcd-cuefmg etcd Running follower us-west-2a 200m / 200m 644245094400m / 644245094400m data:1Gi ip-172-31-13-166.us-west-2.compute.internal/172.31.13.166 May 28,2025 11:52 UTC+0800 etcd-cuefmg-etcd-1 ns-kvlyi etcd-cuefmg etcd Running follower us-west-2a 200m / 200m 644245094400m / 644245094400m data:1Gi ip-172-31-9-141.us-west-2.compute.internal/172.31.9.141 May 28,2025 11:50 UTC+0800 etcd-cuefmg-etcd-2 ns-kvlyi etcd-cuefmg etcd Running leader us-west-2a 200m / 200m 644245094400m / 644245094400m data:1Gi ip-172-31-11-162.us-west-2.compute.internal/172.31.11.162 May 28,2025 11:49 UTC+0800 check pod status done check cluster role check cluster role done leader: etcd-cuefmg-etcd-2;follower: etcd-cuefmg-etcd-0 etcd-cuefmg-etcd-1 connect unsupported engine type: etcd etcd-3-1.0.0-alpha.0 check ops status `kbcli cluster list-ops etcd-cuefmg --status all --namespace ns-kvlyi ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME etcd-cuefmg-restart-bsfrp ns-kvlyi Restart etcd-cuefmg etcd Succeed 3/3 May 28,2025 11:49 UTC+0800 check ops status done ops_status:etcd-cuefmg-restart-bsfrp ns-kvlyi Restart etcd-cuefmg etcd Succeed 3/3 May 28,2025 11:49 UTC+0800 `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge opsrequests.operations etcd-cuefmg-restart-bsfrp --namespace ns-kvlyi ` opsrequest.operations.kubeblocks.io/etcd-cuefmg-restart-bsfrp patched `kbcli cluster delete-ops --name etcd-cuefmg-restart-bsfrp --force --auto-approve --namespace ns-kvlyi ` OpsRequest etcd-cuefmg-restart-bsfrp deleted `kubectl get pvc -l app.kubernetes.io/instance=etcd-cuefmg,apps.kubeblocks.io/component-name=etcd,apps.kubeblocks.io/vct-name=data --namespace ns-kvlyi ` cluster volume-expand check cluster status before ops check cluster status done cluster_status:Running No resources found in etcd-cuefmg namespace. `kbcli cluster volume-expand etcd-cuefmg --auto-approve --force=true --components etcd --volume-claim-templates data --storage 6Gi --namespace ns-kvlyi ` OpsRequest etcd-cuefmg-volumeexpansion-7q84j created successfully, you can view the progress: kbcli cluster describe-ops etcd-cuefmg-volumeexpansion-7q84j -n ns-kvlyi check ops status `kbcli cluster list-ops etcd-cuefmg --status all --namespace ns-kvlyi ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME etcd-cuefmg-volumeexpansion-7q84j ns-kvlyi VolumeExpansion etcd-cuefmg etcd Running 0/3 May 28,2025 11:53 UTC+0800 check cluster status `kbcli cluster list etcd-cuefmg --show-labels --namespace ns-kvlyi ` NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS etcd-cuefmg ns-kvlyi DoNotTerminate Updating May 28,2025 11:39 UTC+0800 app.kubernetes.io/instance=etcd-cuefmg cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances etcd-cuefmg --namespace ns-kvlyi ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME etcd-cuefmg-etcd-0 ns-kvlyi etcd-cuefmg etcd Running follower us-west-2a 200m / 200m 644245094400m / 644245094400m data:6Gi ip-172-31-13-166.us-west-2.compute.internal/172.31.13.166 May 28,2025 11:52 UTC+0800 etcd-cuefmg-etcd-1 ns-kvlyi etcd-cuefmg etcd Running follower us-west-2a 200m / 200m 644245094400m / 644245094400m data:6Gi ip-172-31-9-141.us-west-2.compute.internal/172.31.9.141 May 28,2025 11:50 UTC+0800 etcd-cuefmg-etcd-2 ns-kvlyi etcd-cuefmg etcd Running leader us-west-2a 200m / 200m 644245094400m / 644245094400m data:6Gi ip-172-31-11-162.us-west-2.compute.internal/172.31.11.162 May 28,2025 11:49 UTC+0800 check pod status done check cluster role check cluster role done leader: etcd-cuefmg-etcd-2;follower: etcd-cuefmg-etcd-0 etcd-cuefmg-etcd-1 connect unsupported engine type: etcd etcd-3-1.0.0-alpha.0 No resources found in etcd-cuefmg namespace. check ops status `kbcli cluster list-ops etcd-cuefmg --status all --namespace ns-kvlyi ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME etcd-cuefmg-volumeexpansion-7q84j ns-kvlyi VolumeExpansion etcd-cuefmg etcd Succeed 3/3 May 28,2025 11:53 UTC+0800 check ops status done ops_status:etcd-cuefmg-volumeexpansion-7q84j ns-kvlyi VolumeExpansion etcd-cuefmg etcd Succeed 3/3 May 28,2025 11:53 UTC+0800 `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge opsrequests.operations etcd-cuefmg-volumeexpansion-7q84j --namespace ns-kvlyi ` opsrequest.operations.kubeblocks.io/etcd-cuefmg-volumeexpansion-7q84j patched `kbcli cluster delete-ops --name etcd-cuefmg-volumeexpansion-7q84j --force --auto-approve --namespace ns-kvlyi ` OpsRequest etcd-cuefmg-volumeexpansion-7q84j deleted skip hscale out: new pod role is none cluster update terminationPolicy WipeOut `kbcli cluster update etcd-cuefmg --termination-policy=WipeOut --namespace ns-kvlyi ` cluster.apps.kubeblocks.io/etcd-cuefmg updated check cluster status `kbcli cluster list etcd-cuefmg --show-labels --namespace ns-kvlyi ` NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS etcd-cuefmg ns-kvlyi WipeOut Running May 28,2025 11:39 UTC+0800 app.kubernetes.io/instance=etcd-cuefmg check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances etcd-cuefmg --namespace ns-kvlyi ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME etcd-cuefmg-etcd-0 ns-kvlyi etcd-cuefmg etcd Running follower us-west-2a 200m / 200m 644245094400m / 644245094400m data:6Gi ip-172-31-13-166.us-west-2.compute.internal/172.31.13.166 May 28,2025 11:52 UTC+0800 etcd-cuefmg-etcd-1 ns-kvlyi etcd-cuefmg etcd Running follower us-west-2a 200m / 200m 644245094400m / 644245094400m data:6Gi ip-172-31-9-141.us-west-2.compute.internal/172.31.9.141 May 28,2025 11:50 UTC+0800 etcd-cuefmg-etcd-2 ns-kvlyi etcd-cuefmg etcd Running leader us-west-2a 200m / 200m 644245094400m / 644245094400m data:6Gi ip-172-31-11-162.us-west-2.compute.internal/172.31.11.162 May 28,2025 11:49 UTC+0800 check pod status done check cluster role check cluster role done leader: etcd-cuefmg-etcd-2;follower: etcd-cuefmg-etcd-0 etcd-cuefmg-etcd-1 connect unsupported engine type: etcd etcd-3-1.0.0-alpha.0 cluster list-logs `kbcli cluster list-logs etcd-cuefmg --namespace ns-kvlyi ` No log files found. Error from server (NotFound): pods "etcd-cuefmg-etcd-2" not found cluster logs `kbcli cluster logs etcd-cuefmg --tail 30 --namespace ns-kvlyi ` Defaulted container "etcd" out of: etcd, kbagent, inject-bash (init), init-kbagent (init), kbagent-worker (init) ***"level":"info","ts":"2025-05-28T03:52:17.572368Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"95c9edd6d00abc18 received MsgVoteResp from 95c9edd6d00abc18 at term 7"*** ***"level":"info","ts":"2025-05-28T03:52:17.572390Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"95c9edd6d00abc18 [logterm: 6, index: 21] sent MsgVote request to 5675edbeb05a89a2 at term 7"*** ***"level":"info","ts":"2025-05-28T03:52:17.572403Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"95c9edd6d00abc18 [logterm: 6, index: 21] sent MsgVote request to 6986ff937c7fbc2f at term 7"*** ***"level":"info","ts":"2025-05-28T03:52:17.572420Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"raft.node: 95c9edd6d00abc18 lost leader 5675edbeb05a89a2 at term 7"*** ***"level":"info","ts":"2025-05-28T03:52:17.576008Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"95c9edd6d00abc18 received MsgVoteResp from 5675edbeb05a89a2 at term 7"*** ***"level":"info","ts":"2025-05-28T03:52:17.576064Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"95c9edd6d00abc18 has received 2 MsgVoteResp votes and 0 vote rejections"*** ***"level":"info","ts":"2025-05-28T03:52:17.576083Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"95c9edd6d00abc18 became leader at term 7"*** ***"level":"info","ts":"2025-05-28T03:52:17.576098Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"raft.node: 95c9edd6d00abc18 elected leader 95c9edd6d00abc18 at term 7"*** ***"level":"warn","ts":"2025-05-28T03:52:17.672709Z","caller":"rafthttp/stream.go:421","msg":"lost TCP streaming connection with remote peer","stream-reader-type":"stream MsgApp v2","local-member-id":"95c9edd6d00abc18","remote-peer-id":"5675edbeb05a89a2","error":"EOF"*** ***"level":"warn","ts":"2025-05-28T03:52:17.672927Z","caller":"rafthttp/stream.go:421","msg":"lost TCP streaming connection with remote peer","stream-reader-type":"stream Message","local-member-id":"95c9edd6d00abc18","remote-peer-id":"5675edbeb05a89a2","error":"EOF"*** ***"level":"warn","ts":"2025-05-28T03:52:17.730813Z","caller":"rafthttp/peer_status.go:66","msg":"peer became inactive (message send to peer failed)","peer-id":"5675edbeb05a89a2","error":"failed to dial 5675edbeb05a89a2 on stream Message (peer 5675edbeb05a89a2 failed to find local node 95c9edd6d00abc18)"*** ***"level":"warn","ts":"2025-05-28T03:52:18.005609Z","caller":"rafthttp/stream.go:223","msg":"lost TCP streaming connection with remote peer","stream-writer-type":"stream Message","local-member-id":"95c9edd6d00abc18","remote-peer-id":"5675edbeb05a89a2"*** ***"level":"warn","ts":"2025-05-28T03:52:23.582033Z","caller":"etcdserver/cluster_util.go:294","msg":"failed to reach the peer URL","address":"http://etcd-cuefmg-etcd-0.etcd-cuefmg-etcd-headless.ns-kvlyi.svc.cluster.local:2380/version","remote-member-id":"5675edbeb05a89a2","error":"Get \"http://etcd-cuefmg-etcd-0.etcd-cuefmg-etcd-headless.ns-kvlyi.svc.cluster.local:2380/version\": dial tcp 172.31.13.125:2380: i/o timeout"*** ***"level":"warn","ts":"2025-05-28T03:52:23.582156Z","caller":"etcdserver/cluster_util.go:158","msg":"failed to get version","remote-member-id":"5675edbeb05a89a2","error":"Get \"http://etcd-cuefmg-etcd-0.etcd-cuefmg-etcd-headless.ns-kvlyi.svc.cluster.local:2380/version\": dial tcp 172.31.13.125:2380: i/o timeout"*** ***"level":"warn","ts":"2025-05-28T03:52:23.596656Z","caller":"rafthttp/stream.go:194","msg":"lost TCP streaming connection with remote peer","stream-writer-type":"stream MsgApp v2","local-member-id":"95c9edd6d00abc18","remote-peer-id":"5675edbeb05a89a2"*** ***"level":"warn","ts":"2025-05-28T03:52:27.587834Z","caller":"etcdserver/cluster_util.go:294","msg":"failed to reach the peer URL","address":"http://etcd-cuefmg-etcd-0.etcd-cuefmg-etcd-headless.ns-kvlyi.svc.cluster.local:2380/version","remote-member-id":"5675edbeb05a89a2","error":"Get \"http://etcd-cuefmg-etcd-0.etcd-cuefmg-etcd-headless.ns-kvlyi.svc.cluster.local:2380/version\": dial tcp: lookup etcd-cuefmg-etcd-0.etcd-cuefmg-etcd-headless.ns-kvlyi.svc.cluster.local on 10.100.0.10:53: no such host"*** ***"level":"warn","ts":"2025-05-28T03:52:27.587911Z","caller":"etcdserver/cluster_util.go:158","msg":"failed to get version","remote-member-id":"5675edbeb05a89a2","error":"Get \"http://etcd-cuefmg-etcd-0.etcd-cuefmg-etcd-headless.ns-kvlyi.svc.cluster.local:2380/version\": dial tcp: lookup etcd-cuefmg-etcd-0.etcd-cuefmg-etcd-headless.ns-kvlyi.svc.cluster.local on 10.100.0.10:53: no such host"*** ***"level":"warn","ts":"2025-05-28T03:52:28.603805Z","caller":"rafthttp/probing_status.go:68","msg":"prober detected unhealthy status","round-tripper-name":"ROUND_TRIPPER_RAFT_MESSAGE","remote-peer-id":"5675edbeb05a89a2","rtt":"2.261511ms","error":"dial tcp: lookup etcd-cuefmg-etcd-0.etcd-cuefmg-etcd-headless.ns-kvlyi.svc.cluster.local on 10.100.0.10:53: no such host"*** ***"level":"warn","ts":"2025-05-28T03:52:28.603863Z","caller":"rafthttp/probing_status.go:68","msg":"prober detected unhealthy status","round-tripper-name":"ROUND_TRIPPER_SNAPSHOT","remote-peer-id":"5675edbeb05a89a2","rtt":"805.843µs","error":"dial tcp: lookup etcd-cuefmg-etcd-0.etcd-cuefmg-etcd-headless.ns-kvlyi.svc.cluster.local on 10.100.0.10:53: no such host"*** ***"level":"warn","ts":"2025-05-28T03:52:31.593788Z","caller":"etcdserver/cluster_util.go:294","msg":"failed to reach the peer URL","address":"http://etcd-cuefmg-etcd-0.etcd-cuefmg-etcd-headless.ns-kvlyi.svc.cluster.local:2380/version","remote-member-id":"5675edbeb05a89a2","error":"Get \"http://etcd-cuefmg-etcd-0.etcd-cuefmg-etcd-headless.ns-kvlyi.svc.cluster.local:2380/version\": dial tcp: lookup etcd-cuefmg-etcd-0.etcd-cuefmg-etcd-headless.ns-kvlyi.svc.cluster.local on 10.100.0.10:53: no such host"*** ***"level":"warn","ts":"2025-05-28T03:52:31.593901Z","caller":"etcdserver/cluster_util.go:158","msg":"failed to get version","remote-member-id":"5675edbeb05a89a2","error":"Get \"http://etcd-cuefmg-etcd-0.etcd-cuefmg-etcd-headless.ns-kvlyi.svc.cluster.local:2380/version\": dial tcp: lookup etcd-cuefmg-etcd-0.etcd-cuefmg-etcd-headless.ns-kvlyi.svc.cluster.local on 10.100.0.10:53: no such host"*** ***"level":"warn","ts":"2025-05-28T03:52:33.604124Z","caller":"rafthttp/probing_status.go:68","msg":"prober detected unhealthy status","round-tripper-name":"ROUND_TRIPPER_RAFT_MESSAGE","remote-peer-id":"5675edbeb05a89a2","rtt":"2.261511ms","error":"dial tcp 172.31.0.41:2380: connect: connection refused"*** ***"level":"warn","ts":"2025-05-28T03:52:33.604147Z","caller":"rafthttp/probing_status.go:68","msg":"prober detected unhealthy status","round-tripper-name":"ROUND_TRIPPER_SNAPSHOT","remote-peer-id":"5675edbeb05a89a2","rtt":"805.843µs","error":"dial tcp 172.31.0.41:2380: connect: connection refused"*** ***"level":"info","ts":"2025-05-28T03:52:34.232504Z","caller":"rafthttp/peer_status.go:53","msg":"peer became active","peer-id":"5675edbeb05a89a2"*** ***"level":"info","ts":"2025-05-28T03:52:34.232571Z","caller":"rafthttp/stream.go:412","msg":"established TCP streaming connection with remote peer","stream-reader-type":"stream MsgApp v2","local-member-id":"95c9edd6d00abc18","remote-peer-id":"5675edbeb05a89a2"*** ***"level":"info","ts":"2025-05-28T03:52:34.233362Z","caller":"rafthttp/stream.go:412","msg":"established TCP streaming connection with remote peer","stream-reader-type":"stream Message","local-member-id":"95c9edd6d00abc18","remote-peer-id":"5675edbeb05a89a2"*** ***"level":"info","ts":"2025-05-28T03:52:34.234017Z","caller":"rafthttp/stream.go:249","msg":"set message encoder","from":"95c9edd6d00abc18","to":"5675edbeb05a89a2","stream-type":"stream Message"*** ***"level":"info","ts":"2025-05-28T03:52:34.234071Z","caller":"rafthttp/stream.go:274","msg":"established TCP streaming connection with remote peer","stream-writer-type":"stream Message","local-member-id":"95c9edd6d00abc18","remote-peer-id":"5675edbeb05a89a2"*** ***"level":"info","ts":"2025-05-28T03:52:34.234260Z","caller":"rafthttp/stream.go:249","msg":"set message encoder","from":"95c9edd6d00abc18","to":"5675edbeb05a89a2","stream-type":"stream MsgApp v2"*** ***"level":"info","ts":"2025-05-28T03:52:34.234308Z","caller":"rafthttp/stream.go:274","msg":"established TCP streaming connection with remote peer","stream-writer-type":"stream MsgApp v2","local-member-id":"95c9edd6d00abc18","remote-peer-id":"5675edbeb05a89a2"*** delete cluster etcd-cuefmg `kbcli cluster delete etcd-cuefmg --auto-approve --namespace ns-kvlyi ` Cluster etcd-cuefmg deleted pod_info:etcd-cuefmg-etcd-0 2/2 Terminating 0 3m23s etcd-cuefmg-etcd-1 2/2 Terminating 0 4m47s etcd-cuefmg-etcd-2 2/2 Terminating 0 6m23s No resources found in ns-kvlyi namespace. delete cluster pod done No resources found in ns-kvlyi namespace. check cluster resource non-exist OK: pvc No resources found in ns-kvlyi namespace. delete cluster done No resources found in ns-kvlyi namespace. No resources found in ns-kvlyi namespace. No resources found in ns-kvlyi namespace. Etcd Test Suite All Done! --------------------------------------Etcd (Topology = Replicas 3) Test Result-------------------------------------- [PASSED]|[Create]|[ComponentDefinition=etcd-3-1.0.0-alpha.0;ComponentVersion=etcd;ServiceVersion=3.5.6;]|[Description=Create a cluster with the specified component definition etcd-3-1.0.0-alpha.0 and component version etcd and service version 3.5.6] [PASSED]|[VerticalScaling]|[ComponentName=etcd]|[Description=VerticalScaling the cluster specify component etcd] [PASSED]|[Stop]|[-]|[Description=Stop the cluster] [PASSED]|[Start]|[-]|[Description=Start the cluster] [PASSED]|[Restart]|[-]|[Description=Restart the cluster] [PASSED]|[VolumeExpansion]|[ComponentName=etcd]|[Description=VolumeExpansion the cluster specify component etcd] [PASSED]|[Update]|[TerminationPolicy=WipeOut]|[Description=Update the cluster TerminationPolicy WipeOut] [PASSED]|[Delete]|[-]|[Description=Delete the cluster] [END]