source commons files source engines files source kubeblocks files `kubectl get namespace | grep ns-yeajl ` `kubectl create namespace ns-yeajl` namespace/ns-yeajl created create namespace ns-yeajl done download kbcli `gh release list --repo apecloud/kbcli --limit 100 | (grep "0.9" || true)` `curl -fsSL https://kubeblocks.io/installer/install_cli.sh | bash -s v0.9.4-beta.1` Your system is linux_amd64 Installing kbcli ... Downloading ... % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 71 32.1M 71 22.9M 0 0 89.1M 0 --:--:-- --:--:-- --:--:-- 89.1M 100 32.1M 100 32.1M 0 0 112M 0 --:--:-- --:--:-- --:--:-- 328M kbcli installed successfully. Kubernetes: v1.32.5-eks-5d4a308 KubeBlocks: 0.9.4 kbcli: 0.9.4-beta.1 WARNING: version difference between kbcli (0.9.4-beta.1) and kubeblocks (0.9.4) Make sure your docker service is running and begin your journey with kbcli: kbcli playground init For more information on how to get started, please visit: https://kubeblocks.io download kbcli v0.9.4-beta.1 done Kubernetes: v1.32.5-eks-5d4a308 KubeBlocks: 0.9.4 kbcli: 0.9.4-beta.1 WARNING: version difference between kbcli (0.9.4-beta.1) and kubeblocks (0.9.4) Kubernetes Env: v1.32.5-eks-5d4a308 POD_RESOURCES: No resources found found default storage class: gp3 kubeblocks version is:0.9.4 skip upgrade kubeblocks Error: no repositories to show helm repo add chaos-mesh https://charts.chaos-mesh.org "chaos-mesh" has been added to your repositories add helm chart repo chaos-mesh success chaos mesh already installed check cluster definition set component name:etcd LIMIT_CPU:0.1 LIMIT_MEMORY:0.5 storage size: 1 No resources found in ns-yeajl namespace. create 1 replica WipeOut etcd cluster check cluster version check cluster definition `kbcli cluster create etcdm-svztsn --termination-policy=WipeOut --cluster-definition=etcd --enable-all-logs=false --cluster-version=etcd-v3.5.6 --set cpu=100m,memory=0.5Gi,replicas=1,storage=1Gi --namespace ns-yeajl ` Cluster etcdm-svztsn created check cluster status `kbcli cluster list etcdm-svztsn --show-labels --namespace ns-yeajl ` NAME NAMESPACE CLUSTER-DEFINITION VERSION TERMINATION-POLICY STATUS CREATED-TIME LABELS etcdm-svztsn ns-yeajl etcd etcd-v3.5.6 WipeOut Jun 19,2025 18:12 UTC+0800 clusterdefinition.kubeblocks.io/name=etcd,clusterversion.kubeblocks.io/name=etcd-v3.5.6 cluster_status:Creating check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances etcdm-svztsn --namespace ns-yeajl ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME etcdm-svztsn-etcd-0 ns-yeajl etcdm-svztsn etcd Running leader us-west-2a 100m / 100m 512Mi / 512Mi data:1Gi ip-172-31-0-143.us-west-2.compute.internal/172.31.0.143 Jun 19,2025 18:13 UTC+0800 check pod status done connect unsupported engine type: etcd `kubectl get secrets -l app.kubernetes.io/instance=etcdm-svztsn` `kubectl get secrets etcdm-svztsn-conn-credential -o jsonpath="***.data.username***"` `kubectl get secrets etcdm-svztsn-conn-credential -o jsonpath="***.data.password***"` `kubectl get secrets etcdm-svztsn-conn-credential -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:;DB_PORT:2379;DB_DATABASE: There is no password in Type: 15. check cluster definition set component name:pulsar-broker LIMIT_CPU:0.1 LIMIT_MEMORY:0.5 storage size: 1 No resources found in ns-yeajl namespace. create 1 replica WipeOut pulsar cluster check cluster version check cluster definition apiVersion: apps.kubeblocks.io/v1alpha1 kind: Cluster metadata: name: pulsarm-svztsn namespace: ns-yeajl annotations: "kubeblocks.io/extra-env": '***"KB_PULSAR_BROKER_NODEPORT": "false"***' spec: services: - name: proxy serviceName: proxy componentSelector: pulsar-proxy spec: type: ports: - name: pulsar port: 6650 targetPort: 6650 - name: http port: 80 targetPort: 8080 - name: broker-bootstrap serviceName: broker-bootstrap componentSelector: pulsar-broker spec: type: ports: - name: pulsar port: 6650 targetPort: 6650 - name: http port: 80 targetPort: 8080 - name: kafka-client port: 9092 targetPort: 9092 - name: zookeeper serviceName: zookeeper componentSelector: zookeeper spec: type: ClusterIP ports: - name: client port: 2181 targetPort: 2181 clusterDefinitionRef: pulsar clusterVersionRef: pulsar-2.11.2 terminationPolicy: WipeOut componentSpecs: - name: pulsar-broker componentDefRef: pulsar-broker replicas: 1 resources: requests: cpu: 500m memory: 0.5Gi limits: cpu: 500m memory: 0.5Gi - name: bookies componentDefRef: bookies replicas: 3 resources: requests: cpu: 500m memory: 0.5Gi limits: cpu: 500m memory: 0.5Gi volumeClaimTemplates: - name: ledgers spec: storageClassName: accessModes: - ReadWriteOnce resources: requests: storage: 1Gi - name: journal spec: storageClassName: accessModes: - ReadWriteOnce resources: requests: storage: 1Gi - name: bookies-recovery componentDefRef: bookies-recovery replicas: 1 resources: requests: cpu: 500m memory: 0.5Gi limits: cpu: 500m memory: 0.5Gi - name: zookeeper componentDefRef: zookeeper replicas: 3 resources: requests: cpu: 100m memory: 0.5Gi limits: cpu: 100m memory: 0.5Gi volumeClaimTemplates: - name: data spec: storageClassName: accessModes: - ReadWriteOnce resources: requests: storage: 1Gi - name: pulsar-proxy componentDefRef: pulsar-proxy replicas: 1 resources: requests: cpu: 100m memory: 0.5Gi limits: cpu: 100m memory: 0.5Gi `kubectl apply -f test_create_pulsarm-svztsn.yaml` cluster.apps.kubeblocks.io/pulsarm-svztsn created apply test_create_pulsarm-svztsn.yaml Success `rm -rf test_create_pulsarm-svztsn.yaml` check cluster status `kbcli cluster list pulsarm-svztsn --show-labels --namespace ns-yeajl ` NAME NAMESPACE CLUSTER-DEFINITION VERSION TERMINATION-POLICY STATUS CREATED-TIME LABELS pulsarm-svztsn ns-yeajl pulsar pulsar-2.11.2 WipeOut Jun 19,2025 18:13 UTC+0800 clusterdefinition.kubeblocks.io/name=pulsar,clusterversion.kubeblocks.io/name=pulsar-2.11.2 cluster_status: cluster_status:Creating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances pulsarm-svztsn --namespace ns-yeajl ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME pulsarm-svztsn-bookies-0 ns-yeajl pulsarm-svztsn bookies Running us-west-2a 500m / 500m 512Mi / 512Mi ledgers:1Gi ip-172-31-0-143.us-west-2.compute.internal/172.31.0.143 Jun 19,2025 18:13 UTC+0800 journal:1Gi pulsarm-svztsn-bookies-1 ns-yeajl pulsarm-svztsn bookies Running us-west-2a 500m / 500m 512Mi / 512Mi ledgers:1Gi ip-172-31-3-155.us-west-2.compute.internal/172.31.3.155 Jun 19,2025 18:13 UTC+0800 journal:1Gi pulsarm-svztsn-bookies-2 ns-yeajl pulsarm-svztsn bookies Running us-west-2a 500m / 500m 512Mi / 512Mi ledgers:1Gi ip-172-31-14-171.us-west-2.compute.internal/172.31.14.171 Jun 19,2025 18:13 UTC+0800 journal:1Gi pulsarm-svztsn-bookies-recovery-0 ns-yeajl pulsarm-svztsn bookies-recovery Running us-west-2a 500m / 500m 512Mi / 512Mi ip-172-31-6-174.us-west-2.compute.internal/172.31.6.174 Jun 19,2025 18:13 UTC+0800 pulsarm-svztsn-pulsar-broker-0 ns-yeajl pulsarm-svztsn pulsar-broker Running us-west-2a 500m / 500m 512Mi / 512Mi ip-172-31-9-240.us-west-2.compute.internal/172.31.9.240 Jun 19,2025 18:13 UTC+0800 pulsarm-svztsn-pulsar-proxy-0 ns-yeajl pulsarm-svztsn pulsar-proxy Running us-west-2a 100m / 100m 512Mi / 512Mi ip-172-31-14-68.us-west-2.compute.internal/172.31.14.68 Jun 19,2025 18:13 UTC+0800 pulsarm-svztsn-zookeeper-0 ns-yeajl pulsarm-svztsn zookeeper Running us-west-2a 100m / 100m 512Mi / 512Mi data:1Gi ip-172-31-15-30.us-west-2.compute.internal/172.31.15.30 Jun 19,2025 18:13 UTC+0800 pulsarm-svztsn-zookeeper-1 ns-yeajl pulsarm-svztsn zookeeper Running us-west-2a 100m / 100m 512Mi / 512Mi data:1Gi ip-172-31-14-68.us-west-2.compute.internal/172.31.14.68 Jun 19,2025 18:13 UTC+0800 pulsarm-svztsn-zookeeper-2 ns-yeajl pulsarm-svztsn zookeeper Running us-west-2a 100m / 100m 512Mi / 512Mi data:1Gi ip-172-31-15-52.us-west-2.compute.internal/172.31.15.52 Jun 19,2025 18:13 UTC+0800 check pod status done check cluster connect `echo '' | kbcli cluster connect pulsarm-svztsn --namespace ns-yeajl` check cluster connect done `kubectl get secrets -l app.kubernetes.io/instance=pulsarm-svztsn` `kubectl get secrets pulsarm-svztsn-conn-credential -o jsonpath="***.data.username***"` `kubectl get secrets pulsarm-svztsn-conn-credential -o jsonpath="***.data.password***"` `kubectl get secrets pulsarm-svztsn-conn-credential -o jsonpath="***.data.port***"` DB_USERNAME:admin;DB_PASSWORD:;DB_PORT:6650;DB_DATABASE: There is no password in Type: 8. check cluster definition set component name:milvus set component version No resources found no component version found no cluster version found unsupported component definition not found component version set replicas first:1 set replicas third:1 set minimum cmpv service version set minimum cmpv service version replicas:1 REPORT_COUNT:1 CLUSTER_TOPOLOGY: set cluster topology: cluster LIMIT_CPU:0.5 LIMIT_MEMORY:0.5 storage size: 1 No resources found in ns-yeajl namespace. termination_policy:WipeOut create 1 replica WipeOut milvus cluster check cluster definition check component definition set component definition by component version no component definitions found apiVersion: apps.kubeblocks.io/v1alpha1 kind: Cluster metadata: name: milvus-svztsn namespace: ns-yeajl spec: clusterDefinitionRef: milvus topology: cluster terminationPolicy: WipeOut componentSpecs: - name: proxy replicas: 1 resources: limits: cpu: 500m memory: 0.5Gi requests: cpu: 500m memory: 0.5Gi serviceRefs: - cluster: etcdm-svztsn name: milvus-meta-storage - cluster: pulsarm-svztsn name: milvus-log-storage - name: milvus-object-storage namespace: ns-yeajl clusterServiceSelector: cluster: miniom-svztsn service: component: minio service: headless port: http credential: component: minio name: admin - name: mixcoord replicas: 1 resources: limits: cpu: 500m memory: 0.5Gi requests: cpu: 500m memory: 0.5Gi serviceRefs: - cluster: etcdm-svztsn name: milvus-meta-storage - cluster: pulsarm-svztsn name: milvus-log-storage - name: milvus-object-storage namespace: ns-yeajl clusterServiceSelector: cluster: miniom-svztsn service: component: minio service: headless port: http credential: component: minio name: admin - name: datanode replicas: 1 resources: limits: cpu: 500m memory: 0.5Gi requests: cpu: 500m memory: 0.5Gi serviceRefs: - cluster: etcdm-svztsn name: milvus-meta-storage - cluster: pulsarm-svztsn name: milvus-log-storage - name: milvus-object-storage namespace: ns-yeajl clusterServiceSelector: cluster: miniom-svztsn service: component: minio service: headless port: http credential: component: minio name: admin - name: indexnode replicas: 1 resources: limits: cpu: 500m memory: 0.5Gi requests: cpu: 500m memory: 0.5Gi serviceRefs: - cluster: etcdm-svztsn name: milvus-meta-storage - cluster: pulsarm-svztsn name: milvus-log-storage - name: milvus-object-storage namespace: ns-yeajl clusterServiceSelector: cluster: miniom-svztsn service: component: minio service: headless port: http credential: component: minio name: admin - name: querynode replicas: 1 resources: limits: cpu: 500m memory: 0.5Gi requests: cpu: 500m memory: 0.5Gi serviceRefs: - cluster: etcdm-svztsn name: milvus-meta-storage - cluster: pulsarm-svztsn name: milvus-log-storage - name: milvus-object-storage namespace: ns-yeajl clusterServiceSelector: cluster: miniom-svztsn service: component: minio service: headless port: http credential: component: minio name: admin --- apiVersion: apps.kubeblocks.io/v1alpha1 kind: Cluster metadata: name: miniom-svztsn namespace: ns-yeajl spec: terminationPolicy: WipeOut componentSpecs: - name: minio componentDef: milvus-minio-0.9.0 replicas: 1 resources: limits: cpu: 500m memory: 0.5Gi requests: cpu: 500m memory: 0.5Gi volumeClaimTemplates: - name: data spec: storageClassName: accessModes: - ReadWriteOnce resources: requests: storage: 1Gi `kubectl apply -f test_create_milvus-svztsn.yaml` cluster.apps.kubeblocks.io/milvus-svztsn created cluster.apps.kubeblocks.io/miniom-svztsn created apply test_create_milvus-svztsn.yaml Success `rm -rf test_create_milvus-svztsn.yaml` check cluster status `kbcli cluster list milvus-svztsn --show-labels --namespace ns-yeajl ` NAME NAMESPACE CLUSTER-DEFINITION VERSION TERMINATION-POLICY STATUS CREATED-TIME LABELS milvus-svztsn ns-yeajl milvus WipeOut Jun 19,2025 18:17 UTC+0800 clusterdefinition.kubeblocks.io/name=milvus,clusterversion.kubeblocks.io/name= cluster_status: cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances milvus-svztsn --namespace ns-yeajl ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME milvus-svztsn-datanode-0 ns-yeajl milvus-svztsn datanode Running us-west-2a 500m / 500m 512Mi / 512Mi ip-172-31-4-106.us-west-2.compute.internal/172.31.4.106 Jun 19,2025 18:17 UTC+0800 milvus-svztsn-indexnode-0 ns-yeajl milvus-svztsn indexnode Running us-west-2a 500m / 500m 512Mi / 512Mi ip-172-31-3-155.us-west-2.compute.internal/172.31.3.155 Jun 19,2025 18:17 UTC+0800 milvus-svztsn-mixcoord-0 ns-yeajl milvus-svztsn mixcoord Running us-west-2a 500m / 500m 512Mi / 512Mi ip-172-31-4-106.us-west-2.compute.internal/172.31.4.106 Jun 19,2025 18:17 UTC+0800 milvus-svztsn-proxy-0 ns-yeajl milvus-svztsn proxy Running us-west-2a 500m / 500m 512Mi / 512Mi ip-172-31-8-74.us-west-2.compute.internal/172.31.8.74 Jun 19,2025 18:17 UTC+0800 milvus-svztsn-querynode-0 ns-yeajl milvus-svztsn querynode Running us-west-2a 500m / 500m 512Mi / 512Mi ip-172-31-1-145.us-west-2.compute.internal/172.31.1.145 Jun 19,2025 18:17 UTC+0800 check pod status done connect unsupported engine type: milvus `kubectl get secrets -l app.kubernetes.io/instance=milvus-svztsn` No resources found in ns-yeajl namespace. Not found cluster secret DB_USERNAME:admin;DB_PASSWORD:;DB_PORT:6650;DB_DATABASE: There is no password in Type: 28. get cluster component definition describe cluster `kbcli cluster describe milvus-svztsn --namespace ns-yeajl ` Name: milvus-svztsn Created Time: Jun 19,2025 18:17 UTC+0800 NAMESPACE CLUSTER-DEFINITION VERSION STATUS TERMINATION-POLICY ns-yeajl milvus Running WipeOut Endpoints: COMPONENT MODE INTERNAL EXTERNAL proxy ReadWrite milvus-svztsn-proxy.ns-yeajl.svc.cluster.local:19530 milvus-svztsn-proxy.ns-yeajl.svc.cluster.local:9091 Topology: COMPONENT INSTANCE ROLE STATUS AZ NODE CREATED-TIME datanode milvus-svztsn-datanode-0 Running us-west-2a ip-172-31-4-106.us-west-2.compute.internal/172.31.4.106 Jun 19,2025 18:17 UTC+0800 indexnode milvus-svztsn-indexnode-0 Running us-west-2a ip-172-31-3-155.us-west-2.compute.internal/172.31.3.155 Jun 19,2025 18:17 UTC+0800 mixcoord milvus-svztsn-mixcoord-0 Running us-west-2a ip-172-31-4-106.us-west-2.compute.internal/172.31.4.106 Jun 19,2025 18:17 UTC+0800 proxy milvus-svztsn-proxy-0 Running us-west-2a ip-172-31-8-74.us-west-2.compute.internal/172.31.8.74 Jun 19,2025 18:17 UTC+0800 querynode milvus-svztsn-querynode-0 Running us-west-2a ip-172-31-1-145.us-west-2.compute.internal/172.31.1.145 Jun 19,2025 18:17 UTC+0800 Resources Allocation: COMPONENT DEDICATED CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE-SIZE STORAGE-CLASS proxy false 500m / 500m 512Mi / 512Mi mixcoord false 500m / 500m 512Mi / 512Mi datanode false 500m / 500m 512Mi / 512Mi indexnode false 500m / 500m 512Mi / 512Mi querynode false 500m / 500m 512Mi / 512Mi Images: COMPONENT TYPE IMAGE proxy docker.io/apecloud/milvus:v2.3.2 mixcoord docker.io/apecloud/milvus:v2.3.2 datanode docker.io/apecloud/milvus:v2.3.2 indexnode docker.io/apecloud/milvus:v2.3.2 querynode docker.io/apecloud/milvus:v2.3.2 Show cluster events: kbcli cluster list-events -n ns-yeajl milvus-svztsn `kbcli cluster label milvus-svztsn app.kubernetes.io/instance- --namespace ns-yeajl ` label "app.kubernetes.io/instance" not found. `kbcli cluster label milvus-svztsn app.kubernetes.io/instance=milvus-svztsn --namespace ns-yeajl ` `kbcli cluster label milvus-svztsn --list --namespace ns-yeajl ` NAME NAMESPACE LABELS milvus-svztsn ns-yeajl app.kubernetes.io/instance=milvus-svztsn clusterdefinition.kubeblocks.io/name=milvus clusterversion.kubeblocks.io/name= label cluster app.kubernetes.io/instance=milvus-svztsn Success `kbcli cluster label case.name=kbcli.test1 -l app.kubernetes.io/instance=milvus-svztsn --namespace ns-yeajl ` `kbcli cluster label milvus-svztsn --list --namespace ns-yeajl ` NAME NAMESPACE LABELS milvus-svztsn ns-yeajl app.kubernetes.io/instance=milvus-svztsn case.name=kbcli.test1 clusterdefinition.kubeblocks.io/name=milvus clusterversion.kubeblocks.io/name= label cluster case.name=kbcli.test1 Success `kbcli cluster label milvus-svztsn case.name=kbcli.test2 --overwrite --namespace ns-yeajl ` `kbcli cluster label milvus-svztsn --list --namespace ns-yeajl ` NAME NAMESPACE LABELS milvus-svztsn ns-yeajl app.kubernetes.io/instance=milvus-svztsn case.name=kbcli.test2 clusterdefinition.kubeblocks.io/name=milvus clusterversion.kubeblocks.io/name= label cluster case.name=kbcli.test2 Success `kbcli cluster label milvus-svztsn case.name- --namespace ns-yeajl ` `kbcli cluster label milvus-svztsn --list --namespace ns-yeajl ` NAME NAMESPACE LABELS milvus-svztsn ns-yeajl app.kubernetes.io/instance=milvus-svztsn clusterdefinition.kubeblocks.io/name=milvus clusterversion.kubeblocks.io/name= delete cluster label case.name Success check component querynode exists `kubectl get components -l app.kubernetes.io/instance=milvus-svztsn,apps.kubeblocks.io/component-name=querynode --namespace ns-yeajl | (grep "querynode" || true )` cluster restart check cluster status before ops check cluster status done cluster_status:Running `kbcli cluster restart milvus-svztsn --auto-approve --force=true --components querynode --namespace ns-yeajl ` OpsRequest milvus-svztsn-restart-tm48x created successfully, you can view the progress: kbcli cluster describe-ops milvus-svztsn-restart-tm48x -n ns-yeajl check ops status `kbcli cluster list-ops milvus-svztsn --status all --namespace ns-yeajl ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME milvus-svztsn-restart-tm48x ns-yeajl Restart milvus-svztsn querynode Running 0/1 Jun 19,2025 18:19 UTC+0800 check cluster status `kbcli cluster list milvus-svztsn --show-labels --namespace ns-yeajl ` NAME NAMESPACE CLUSTER-DEFINITION VERSION TERMINATION-POLICY STATUS CREATED-TIME LABELS milvus-svztsn ns-yeajl milvus WipeOut Updating Jun 19,2025 18:17 UTC+0800 app.kubernetes.io/instance=milvus-svztsn,clusterdefinition.kubeblocks.io/name=milvus,clusterversion.kubeblocks.io/name= cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances milvus-svztsn --namespace ns-yeajl ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME milvus-svztsn-datanode-0 ns-yeajl milvus-svztsn datanode Running us-west-2a 500m / 500m 512Mi / 512Mi ip-172-31-4-106.us-west-2.compute.internal/172.31.4.106 Jun 19,2025 18:17 UTC+0800 milvus-svztsn-indexnode-0 ns-yeajl milvus-svztsn indexnode Running us-west-2a 500m / 500m 512Mi / 512Mi ip-172-31-3-155.us-west-2.compute.internal/172.31.3.155 Jun 19,2025 18:17 UTC+0800 milvus-svztsn-mixcoord-0 ns-yeajl milvus-svztsn mixcoord Running us-west-2a 500m / 500m 512Mi / 512Mi ip-172-31-4-106.us-west-2.compute.internal/172.31.4.106 Jun 19,2025 18:17 UTC+0800 milvus-svztsn-proxy-0 ns-yeajl milvus-svztsn proxy Running us-west-2a 500m / 500m 512Mi / 512Mi ip-172-31-8-74.us-west-2.compute.internal/172.31.8.74 Jun 19,2025 18:17 UTC+0800 milvus-svztsn-querynode-0 ns-yeajl milvus-svztsn querynode Running us-west-2a 500m / 500m 512Mi / 512Mi ip-172-31-1-184.us-west-2.compute.internal/172.31.1.184 Jun 19,2025 18:19 UTC+0800 check pod status done connect unsupported engine type: milvus milvus-proxy-0.9.0 check ops status `kbcli cluster list-ops milvus-svztsn --status all --namespace ns-yeajl ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME milvus-svztsn-restart-tm48x ns-yeajl Restart milvus-svztsn querynode Succeed 1/1 Jun 19,2025 18:19 UTC+0800 check ops status done ops_status:milvus-svztsn-restart-tm48x ns-yeajl Restart milvus-svztsn querynode Succeed 1/1 Jun 19,2025 18:19 UTC+0800 `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge opsrequests milvus-svztsn-restart-tm48x --namespace ns-yeajl ` opsrequest.apps.kubeblocks.io/milvus-svztsn-restart-tm48x patched `kbcli cluster delete-ops --name milvus-svztsn-restart-tm48x --force --auto-approve --namespace ns-yeajl ` OpsRequest milvus-svztsn-restart-tm48x deleted check component querynode exists `kubectl get components -l app.kubernetes.io/instance=milvus-svztsn,apps.kubeblocks.io/component-name=querynode --namespace ns-yeajl | (grep "querynode" || true )` cluster vscale check cluster status before ops check cluster status done cluster_status:Running `kbcli cluster vscale milvus-svztsn --auto-approve --force=true --components querynode --cpu 600m --memory 0.6Gi --namespace ns-yeajl ` OpsRequest milvus-svztsn-verticalscaling-6pr9p created successfully, you can view the progress: kbcli cluster describe-ops milvus-svztsn-verticalscaling-6pr9p -n ns-yeajl check ops status `kbcli cluster list-ops milvus-svztsn --status all --namespace ns-yeajl ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME milvus-svztsn-verticalscaling-6pr9p ns-yeajl VerticalScaling milvus-svztsn querynode Running 0/1 Jun 19,2025 18:22 UTC+0800 check cluster status `kbcli cluster list milvus-svztsn --show-labels --namespace ns-yeajl ` NAME NAMESPACE CLUSTER-DEFINITION VERSION TERMINATION-POLICY STATUS CREATED-TIME LABELS milvus-svztsn ns-yeajl milvus WipeOut Updating Jun 19,2025 18:17 UTC+0800 app.kubernetes.io/instance=milvus-svztsn,clusterdefinition.kubeblocks.io/name=milvus,clusterversion.kubeblocks.io/name= cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances milvus-svztsn --namespace ns-yeajl ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME milvus-svztsn-datanode-0 ns-yeajl milvus-svztsn datanode Running us-west-2a 500m / 500m 512Mi / 512Mi ip-172-31-4-106.us-west-2.compute.internal/172.31.4.106 Jun 19,2025 18:17 UTC+0800 milvus-svztsn-indexnode-0 ns-yeajl milvus-svztsn indexnode Running us-west-2a 500m / 500m 512Mi / 512Mi ip-172-31-3-155.us-west-2.compute.internal/172.31.3.155 Jun 19,2025 18:17 UTC+0800 milvus-svztsn-mixcoord-0 ns-yeajl milvus-svztsn mixcoord Running us-west-2a 500m / 500m 512Mi / 512Mi ip-172-31-4-106.us-west-2.compute.internal/172.31.4.106 Jun 19,2025 18:17 UTC+0800 milvus-svztsn-proxy-0 ns-yeajl milvus-svztsn proxy Running us-west-2a 500m / 500m 512Mi / 512Mi ip-172-31-8-74.us-west-2.compute.internal/172.31.8.74 Jun 19,2025 18:17 UTC+0800 milvus-svztsn-querynode-0 ns-yeajl milvus-svztsn querynode Running us-west-2a 600m / 600m 644245094400m / 644245094400m ip-172-31-1-184.us-west-2.compute.internal/172.31.1.184 Jun 19,2025 18:22 UTC+0800 check pod status done connect unsupported engine type: milvus milvus-proxy-0.9.0 check ops status `kbcli cluster list-ops milvus-svztsn --status all --namespace ns-yeajl ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME milvus-svztsn-verticalscaling-6pr9p ns-yeajl VerticalScaling milvus-svztsn querynode Succeed 1/1 Jun 19,2025 18:22 UTC+0800 check ops status done ops_status:milvus-svztsn-verticalscaling-6pr9p ns-yeajl VerticalScaling milvus-svztsn querynode Succeed 1/1 Jun 19,2025 18:22 UTC+0800 `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge opsrequests milvus-svztsn-verticalscaling-6pr9p --namespace ns-yeajl ` opsrequest.apps.kubeblocks.io/milvus-svztsn-verticalscaling-6pr9p patched `kbcli cluster delete-ops --name milvus-svztsn-verticalscaling-6pr9p --force --auto-approve --namespace ns-yeajl ` OpsRequest milvus-svztsn-verticalscaling-6pr9p deleted 1 cluster stop check cluster status before ops check cluster status done cluster_status:Running `kbcli cluster stop milvus-svztsn --auto-approve --force=true --namespace ns-yeajl ` OpsRequest milvus-svztsn-stop-jpdks created successfully, you can view the progress: kbcli cluster describe-ops milvus-svztsn-stop-jpdks -n ns-yeajl check ops status `kbcli cluster list-ops milvus-svztsn --status all --namespace ns-yeajl ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME milvus-svztsn-stop-jpdks ns-yeajl Stop milvus-svztsn datanode,indexnode,mixcoord,proxy,querynode Running 0/5 Jun 19,2025 18:23 UTC+0800 check cluster status `kbcli cluster list milvus-svztsn --show-labels --namespace ns-yeajl ` NAME NAMESPACE CLUSTER-DEFINITION VERSION TERMINATION-POLICY STATUS CREATED-TIME LABELS milvus-svztsn ns-yeajl milvus WipeOut Stopping Jun 19,2025 18:17 UTC+0800 app.kubernetes.io/instance=milvus-svztsn,clusterdefinition.kubeblocks.io/name=milvus,clusterversion.kubeblocks.io/name= cluster_status:Stopping cluster_status:Stopping cluster_status:Stopping cluster_status:Stopping check cluster status done cluster_status:Stopped check pod status `kbcli cluster list-instances milvus-svztsn --namespace ns-yeajl ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME check pod status done check ops status `kbcli cluster list-ops milvus-svztsn --status all --namespace ns-yeajl ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME milvus-svztsn-stop-jpdks ns-yeajl Stop milvus-svztsn datanode,indexnode,mixcoord,proxy,querynode Succeed 5/5 Jun 19,2025 18:23 UTC+0800 check ops status done ops_status:milvus-svztsn-stop-jpdks ns-yeajl Stop milvus-svztsn datanode,indexnode,mixcoord,proxy,querynode Succeed 5/5 Jun 19,2025 18:23 UTC+0800 `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge opsrequests milvus-svztsn-stop-jpdks --namespace ns-yeajl ` opsrequest.apps.kubeblocks.io/milvus-svztsn-stop-jpdks patched `kbcli cluster delete-ops --name milvus-svztsn-stop-jpdks --force --auto-approve --namespace ns-yeajl ` OpsRequest milvus-svztsn-stop-jpdks deleted cluster start check cluster status before ops check cluster status done cluster_status:Stopped `kbcli cluster start milvus-svztsn --force=true --namespace ns-yeajl ` OpsRequest milvus-svztsn-start-8fqz9 created successfully, you can view the progress: kbcli cluster describe-ops milvus-svztsn-start-8fqz9 -n ns-yeajl check ops status `kbcli cluster list-ops milvus-svztsn --status all --namespace ns-yeajl ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME milvus-svztsn-start-8fqz9 ns-yeajl Start milvus-svztsn Running -/- Jun 19,2025 18:24 UTC+0800 check cluster status `kbcli cluster list milvus-svztsn --show-labels --namespace ns-yeajl ` NAME NAMESPACE CLUSTER-DEFINITION VERSION TERMINATION-POLICY STATUS CREATED-TIME LABELS milvus-svztsn ns-yeajl milvus WipeOut Updating Jun 19,2025 18:17 UTC+0800 app.kubernetes.io/instance=milvus-svztsn,clusterdefinition.kubeblocks.io/name=milvus,clusterversion.kubeblocks.io/name= cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances milvus-svztsn --namespace ns-yeajl ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME milvus-svztsn-datanode-0 ns-yeajl milvus-svztsn datanode Running us-west-2a 500m / 500m 512Mi / 512Mi ip-172-31-10-215.us-west-2.compute.internal/172.31.10.215 Jun 19,2025 18:24 UTC+0800 milvus-svztsn-indexnode-0 ns-yeajl milvus-svztsn indexnode Running us-west-2a 500m / 500m 512Mi / 512Mi ip-172-31-14-246.us-west-2.compute.internal/172.31.14.246 Jun 19,2025 18:24 UTC+0800 milvus-svztsn-mixcoord-0 ns-yeajl milvus-svztsn mixcoord Running us-west-2a 500m / 500m 512Mi / 512Mi ip-172-31-4-106.us-west-2.compute.internal/172.31.4.106 Jun 19,2025 18:24 UTC+0800 milvus-svztsn-proxy-0 ns-yeajl milvus-svztsn proxy Running us-west-2a 500m / 500m 512Mi / 512Mi ip-172-31-1-162.us-west-2.compute.internal/172.31.1.162 Jun 19,2025 18:24 UTC+0800 milvus-svztsn-querynode-0 ns-yeajl milvus-svztsn querynode Running us-west-2a 600m / 600m 644245094400m / 644245094400m ip-172-31-1-184.us-west-2.compute.internal/172.31.1.184 Jun 19,2025 18:24 UTC+0800 check pod status done connect unsupported engine type: milvus milvus-proxy-0.9.0 check ops status `kbcli cluster list-ops milvus-svztsn --status all --namespace ns-yeajl ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME milvus-svztsn-start-8fqz9 ns-yeajl Start milvus-svztsn datanode,indexnode,mixcoord,proxy,querynode Succeed 5/5 Jun 19,2025 18:24 UTC+0800 check ops status done ops_status:milvus-svztsn-start-8fqz9 ns-yeajl Start milvus-svztsn datanode,indexnode,mixcoord,proxy,querynode Succeed 5/5 Jun 19,2025 18:24 UTC+0800 `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge opsrequests milvus-svztsn-start-8fqz9 --namespace ns-yeajl ` opsrequest.apps.kubeblocks.io/milvus-svztsn-start-8fqz9 patched `kbcli cluster delete-ops --name milvus-svztsn-start-8fqz9 --force --auto-approve --namespace ns-yeajl ` OpsRequest milvus-svztsn-start-8fqz9 deleted skip cluster HorizontalScaling Out check component datanode exists `kubectl get components -l app.kubernetes.io/instance=milvus-svztsn,apps.kubeblocks.io/component-name=datanode --namespace ns-yeajl | (grep "datanode" || true )` check component mixcoord exists `kubectl get components -l app.kubernetes.io/instance=milvus-svztsn,apps.kubeblocks.io/component-name=mixcoord --namespace ns-yeajl | (grep "mixcoord" || true )` check component proxy exists `kubectl get components -l app.kubernetes.io/instance=milvus-svztsn,apps.kubeblocks.io/component-name=proxy --namespace ns-yeajl | (grep "proxy" || true )` cluster vscale check cluster status before ops check cluster status done cluster_status:Running `kbcli cluster vscale milvus-svztsn --auto-approve --force=true --components datanode,mixcoord,proxy --cpu 600m --memory 0.6Gi --namespace ns-yeajl ` OpsRequest milvus-svztsn-verticalscaling-mcrxc created successfully, you can view the progress: kbcli cluster describe-ops milvus-svztsn-verticalscaling-mcrxc -n ns-yeajl check ops status `kbcli cluster list-ops milvus-svztsn --status all --namespace ns-yeajl ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME milvus-svztsn-verticalscaling-mcrxc ns-yeajl VerticalScaling milvus-svztsn datanode,mixcoord,proxy Running 0/3 Jun 19,2025 18:26 UTC+0800 check cluster status `kbcli cluster list milvus-svztsn --show-labels --namespace ns-yeajl ` NAME NAMESPACE CLUSTER-DEFINITION VERSION TERMINATION-POLICY STATUS CREATED-TIME LABELS milvus-svztsn ns-yeajl milvus WipeOut Updating Jun 19,2025 18:17 UTC+0800 app.kubernetes.io/instance=milvus-svztsn,clusterdefinition.kubeblocks.io/name=milvus,clusterversion.kubeblocks.io/name= cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances milvus-svztsn --namespace ns-yeajl ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME milvus-svztsn-datanode-0 ns-yeajl milvus-svztsn datanode Running us-west-2a 600m / 600m 644245094400m / 644245094400m ip-172-31-10-215.us-west-2.compute.internal/172.31.10.215 Jun 19,2025 18:26 UTC+0800 milvus-svztsn-indexnode-0 ns-yeajl milvus-svztsn indexnode Running us-west-2a 500m / 500m 512Mi / 512Mi ip-172-31-14-246.us-west-2.compute.internal/172.31.14.246 Jun 19,2025 18:24 UTC+0800 milvus-svztsn-mixcoord-0 ns-yeajl milvus-svztsn mixcoord Running us-west-2a 600m / 600m 644245094400m / 644245094400m ip-172-31-4-106.us-west-2.compute.internal/172.31.4.106 Jun 19,2025 18:27 UTC+0800 milvus-svztsn-proxy-0 ns-yeajl milvus-svztsn proxy Running us-west-2a 600m / 600m 644245094400m / 644245094400m ip-172-31-1-162.us-west-2.compute.internal/172.31.1.162 Jun 19,2025 18:27 UTC+0800 milvus-svztsn-querynode-0 ns-yeajl milvus-svztsn querynode Running us-west-2a 600m / 600m 644245094400m / 644245094400m ip-172-31-1-184.us-west-2.compute.internal/172.31.1.184 Jun 19,2025 18:24 UTC+0800 check pod status done connect unsupported engine type: milvus milvus-proxy-0.9.0 check ops status `kbcli cluster list-ops milvus-svztsn --status all --namespace ns-yeajl ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME milvus-svztsn-verticalscaling-mcrxc ns-yeajl VerticalScaling milvus-svztsn datanode,mixcoord,proxy Succeed 3/3 Jun 19,2025 18:26 UTC+0800 check ops status done ops_status:milvus-svztsn-verticalscaling-mcrxc ns-yeajl VerticalScaling milvus-svztsn datanode,mixcoord,proxy Succeed 3/3 Jun 19,2025 18:26 UTC+0800 `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge opsrequests milvus-svztsn-verticalscaling-mcrxc --namespace ns-yeajl ` opsrequest.apps.kubeblocks.io/milvus-svztsn-verticalscaling-mcrxc patched `kbcli cluster delete-ops --name milvus-svztsn-verticalscaling-mcrxc --force --auto-approve --namespace ns-yeajl ` OpsRequest milvus-svztsn-verticalscaling-mcrxc deleted check component indexnode exists `kubectl get components -l app.kubernetes.io/instance=milvus-svztsn,apps.kubeblocks.io/component-name=indexnode --namespace ns-yeajl | (grep "indexnode" || true )` cluster vscale check cluster status before ops check cluster status done cluster_status:Running `kbcli cluster vscale milvus-svztsn --auto-approve --force=true --components indexnode --cpu 600m --memory 0.6Gi --namespace ns-yeajl ` OpsRequest milvus-svztsn-verticalscaling-lzw9d created successfully, you can view the progress: kbcli cluster describe-ops milvus-svztsn-verticalscaling-lzw9d -n ns-yeajl check ops status `kbcli cluster list-ops milvus-svztsn --status all --namespace ns-yeajl ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME milvus-svztsn-verticalscaling-lzw9d ns-yeajl VerticalScaling milvus-svztsn indexnode Running 0/1 Jun 19,2025 18:29 UTC+0800 check cluster status `kbcli cluster list milvus-svztsn --show-labels --namespace ns-yeajl ` NAME NAMESPACE CLUSTER-DEFINITION VERSION TERMINATION-POLICY STATUS CREATED-TIME LABELS milvus-svztsn ns-yeajl milvus WipeOut Updating Jun 19,2025 18:17 UTC+0800 app.kubernetes.io/instance=milvus-svztsn,clusterdefinition.kubeblocks.io/name=milvus,clusterversion.kubeblocks.io/name= cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances milvus-svztsn --namespace ns-yeajl ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME milvus-svztsn-datanode-0 ns-yeajl milvus-svztsn datanode Running us-west-2a 600m / 600m 644245094400m / 644245094400m ip-172-31-10-215.us-west-2.compute.internal/172.31.10.215 Jun 19,2025 18:26 UTC+0800 milvus-svztsn-indexnode-0 ns-yeajl milvus-svztsn indexnode Running us-west-2a 600m / 600m 644245094400m / 644245094400m ip-172-31-1-145.us-west-2.compute.internal/172.31.1.145 Jun 19,2025 18:29 UTC+0800 milvus-svztsn-mixcoord-0 ns-yeajl milvus-svztsn mixcoord Running us-west-2a 600m / 600m 644245094400m / 644245094400m ip-172-31-4-106.us-west-2.compute.internal/172.31.4.106 Jun 19,2025 18:27 UTC+0800 milvus-svztsn-proxy-0 ns-yeajl milvus-svztsn proxy Running us-west-2a 600m / 600m 644245094400m / 644245094400m ip-172-31-1-162.us-west-2.compute.internal/172.31.1.162 Jun 19,2025 18:27 UTC+0800 milvus-svztsn-querynode-0 ns-yeajl milvus-svztsn querynode Running us-west-2a 600m / 600m 644245094400m / 644245094400m ip-172-31-1-184.us-west-2.compute.internal/172.31.1.184 Jun 19,2025 18:24 UTC+0800 check pod status done connect unsupported engine type: milvus milvus-proxy-0.9.0 check ops status `kbcli cluster list-ops milvus-svztsn --status all --namespace ns-yeajl ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME milvus-svztsn-verticalscaling-lzw9d ns-yeajl VerticalScaling milvus-svztsn indexnode Succeed 1/1 Jun 19,2025 18:29 UTC+0800 check ops status done ops_status:milvus-svztsn-verticalscaling-lzw9d ns-yeajl VerticalScaling milvus-svztsn indexnode Succeed 1/1 Jun 19,2025 18:29 UTC+0800 `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge opsrequests milvus-svztsn-verticalscaling-lzw9d --namespace ns-yeajl ` opsrequest.apps.kubeblocks.io/milvus-svztsn-verticalscaling-lzw9d patched `kbcli cluster delete-ops --name milvus-svztsn-verticalscaling-lzw9d --force --auto-approve --namespace ns-yeajl ` OpsRequest milvus-svztsn-verticalscaling-lzw9d deleted cluster restart check cluster status before ops check cluster status done cluster_status:Running `kbcli cluster restart milvus-svztsn --auto-approve --force=true --namespace ns-yeajl ` OpsRequest milvus-svztsn-restart-9dpn2 created successfully, you can view the progress: kbcli cluster describe-ops milvus-svztsn-restart-9dpn2 -n ns-yeajl check ops status `kbcli cluster list-ops milvus-svztsn --status all --namespace ns-yeajl ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME milvus-svztsn-restart-9dpn2 ns-yeajl Restart milvus-svztsn proxy,mixcoord,datanode,indexnode,querynode Running 0/5 Jun 19,2025 18:31 UTC+0800 check cluster status `kbcli cluster list milvus-svztsn --show-labels --namespace ns-yeajl ` NAME NAMESPACE CLUSTER-DEFINITION VERSION TERMINATION-POLICY STATUS CREATED-TIME LABELS milvus-svztsn ns-yeajl milvus WipeOut Updating Jun 19,2025 18:17 UTC+0800 app.kubernetes.io/instance=milvus-svztsn,clusterdefinition.kubeblocks.io/name=milvus,clusterversion.kubeblocks.io/name= cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances milvus-svztsn --namespace ns-yeajl ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME milvus-svztsn-datanode-0 ns-yeajl milvus-svztsn datanode Running us-west-2a 600m / 600m 644245094400m / 644245094400m ip-172-31-1-145.us-west-2.compute.internal/172.31.1.145 Jun 19,2025 18:31 UTC+0800 milvus-svztsn-indexnode-0 ns-yeajl milvus-svztsn indexnode Running us-west-2a 600m / 600m 644245094400m / 644245094400m ip-172-31-10-215.us-west-2.compute.internal/172.31.10.215 Jun 19,2025 18:31 UTC+0800 milvus-svztsn-mixcoord-0 ns-yeajl milvus-svztsn mixcoord Running us-west-2a 600m / 600m 644245094400m / 644245094400m ip-172-31-14-246.us-west-2.compute.internal/172.31.14.246 Jun 19,2025 18:31 UTC+0800 milvus-svztsn-proxy-0 ns-yeajl milvus-svztsn proxy Running us-west-2a 600m / 600m 644245094400m / 644245094400m ip-172-31-1-162.us-west-2.compute.internal/172.31.1.162 Jun 19,2025 18:31 UTC+0800 milvus-svztsn-querynode-0 ns-yeajl milvus-svztsn querynode Running us-west-2a 600m / 600m 644245094400m / 644245094400m ip-172-31-1-184.us-west-2.compute.internal/172.31.1.184 Jun 19,2025 18:31 UTC+0800 check pod status done connect unsupported engine type: milvus milvus-proxy-0.9.0 check ops status `kbcli cluster list-ops milvus-svztsn --status all --namespace ns-yeajl ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME milvus-svztsn-restart-9dpn2 ns-yeajl Restart milvus-svztsn proxy,mixcoord,datanode,indexnode,querynode Succeed 5/5 Jun 19,2025 18:31 UTC+0800 check ops status done ops_status:milvus-svztsn-restart-9dpn2 ns-yeajl Restart milvus-svztsn proxy,mixcoord,datanode,indexnode,querynode Succeed 5/5 Jun 19,2025 18:31 UTC+0800 `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge opsrequests milvus-svztsn-restart-9dpn2 --namespace ns-yeajl ` opsrequest.apps.kubeblocks.io/milvus-svztsn-restart-9dpn2 patched `kbcli cluster delete-ops --name milvus-svztsn-restart-9dpn2 --force --auto-approve --namespace ns-yeajl ` OpsRequest milvus-svztsn-restart-9dpn2 deleted cluster update terminationPolicy WipeOut `kbcli cluster update milvus-svztsn --termination-policy=WipeOut --namespace ns-yeajl ` cluster.apps.kubeblocks.io/milvus-svztsn updated (no change) check cluster status `kbcli cluster list milvus-svztsn --show-labels --namespace ns-yeajl ` NAME NAMESPACE CLUSTER-DEFINITION VERSION TERMINATION-POLICY STATUS CREATED-TIME LABELS milvus-svztsn ns-yeajl milvus WipeOut Running Jun 19,2025 18:17 UTC+0800 app.kubernetes.io/instance=milvus-svztsn,clusterdefinition.kubeblocks.io/name=milvus,clusterversion.kubeblocks.io/name= check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances milvus-svztsn --namespace ns-yeajl ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME milvus-svztsn-datanode-0 ns-yeajl milvus-svztsn datanode Running us-west-2a 600m / 600m 644245094400m / 644245094400m ip-172-31-1-145.us-west-2.compute.internal/172.31.1.145 Jun 19,2025 18:31 UTC+0800 milvus-svztsn-indexnode-0 ns-yeajl milvus-svztsn indexnode Running us-west-2a 600m / 600m 644245094400m / 644245094400m ip-172-31-10-215.us-west-2.compute.internal/172.31.10.215 Jun 19,2025 18:31 UTC+0800 milvus-svztsn-mixcoord-0 ns-yeajl milvus-svztsn mixcoord Running us-west-2a 600m / 600m 644245094400m / 644245094400m ip-172-31-14-246.us-west-2.compute.internal/172.31.14.246 Jun 19,2025 18:31 UTC+0800 milvus-svztsn-proxy-0 ns-yeajl milvus-svztsn proxy Running us-west-2a 600m / 600m 644245094400m / 644245094400m ip-172-31-1-162.us-west-2.compute.internal/172.31.1.162 Jun 19,2025 18:31 UTC+0800 milvus-svztsn-querynode-0 ns-yeajl milvus-svztsn querynode Running us-west-2a 600m / 600m 644245094400m / 644245094400m ip-172-31-1-184.us-west-2.compute.internal/172.31.1.184 Jun 19,2025 18:31 UTC+0800 check pod status done connect unsupported engine type: milvus milvus-proxy-0.9.0 cluster list-logs `kbcli cluster list-logs milvus-svztsn --namespace ns-yeajl ` No log files found. You can enable the log feature with the kbcli command below. kbcli cluster update milvus-svztsn --enable-all-logs=true --namespace ns-yeajl cluster logs `kbcli cluster logs milvus-svztsn --tail 30 --namespace ns-yeajl ` Defaulted container "datanode" out of: datanode, setup (init) [2025/06/19 10:32:05.306 +00:00] [DEBUG] [sessionutil/session_util.go:249] ["Session connect to etcd success"] [2025/06/19 10:32:05.307 +00:00] [DEBUG] [sessionutil/session_util.go:566] ["SessionUtil GetSessions"] [prefix=datacoord] [key=datacoord] [address=172.31.11.122:13333] [2025/06/19 10:32:05.309 +00:00] [INFO] [datanode/service.go:285] ["DataCoord client is ready for DataNode"] [2025/06/19 10:32:05.309 +00:00] [INFO] [sync/once.go:74] ["DataNode server initializing"] [TimeTickChannelName=milvus-svztsn-datacoord-timetick-channel] [2025/06/19 10:32:05.309 +00:00] [DEBUG] [sessionutil/session_util.go:234] ["Session try to connect to etcd"] [2025/06/19 10:32:05.309 +00:00] [DEBUG] [sessionutil/session_util.go:249] ["Session connect to etcd success"] [2025/06/19 10:32:05.311 +00:00] [DEBUG] [sessionutil/session_util.go:292] [getServerID] [reuse=true] [2025/06/19 10:32:05.313 +00:00] [DEBUG] [sessionutil/session_util.go:350] ["Session get serverID success"] [key=id] [ServerId=20] [2025/06/19 10:32:05.313 +00:00] [INFO] [sessionutil/session_util.go:266] ["start server"] [name=datanode] [address=172.31.6.89:21124] [id=20] [2025/06/19 10:32:05.314 +00:00] [INFO] [sessionutil/session_util.go:1167] ["save server info into file"] [content="datanode-20\n"] [filePath=/tmp/milvus/server_id_8] [2025/06/19 10:32:05.314 +00:00] [INFO] [datanode/data_node.go:244] ["DataNode server init rateCollector done"] ["node ID"=20] [2025/06/19 10:32:05.314 +00:00] [INFO] [datanode/data_node.go:247] ["DataNode server init dispatcher client done"] ["node ID"=20] [2025/06/19 10:32:05.314 +00:00] [INFO] [dependency/factory.go:84] ["try to init mq"] [standalone=false] [mqType=pulsar] [2025/06/19 10:32:05.314 +00:00] [INFO] [datanode/data_node.go:260] ["DataNode server init succeeded"] [MsgChannelSubName=milvus-svztsn-dataNode] [2025/06/19 10:32:05.314 +00:00] [INFO] [datanode/service.go:297] ["current DataNode state"] [state=Initializing] [2025/06/19 10:32:05.314 +00:00] [INFO] [datanode/service.go:192] ["DataNode gRPC services successfully initialized"] [2025/06/19 10:32:05.315 +00:00] [INFO] [datanode/data_node.go:316] ["start id allocator done"] [role=datanode] [2025/06/19 10:32:05.319 +00:00] [INFO] [storage/minio_chunk_manager.go:86] ["minio chunk manager init success."] [bucketname=milvus-svztsn] [root=files] [2025/06/19 10:32:05.319 +00:00] [DEBUG] [sessionutil/session_util.go:413] ["service begin to register to etcd"] [serverName=datanode] [ServerID=20] [2025/06/19 10:32:05.320 +00:00] [INFO] [datanode/data_node.go:295] ["DataNode Background GC Start"] [2025/06/19 10:32:05.320 +00:00] [INFO] [datanode/event_manager.go:48] ["Start watch channel"] [prefix=channelwatch/20] [2025/06/19 10:32:05.324 +00:00] [INFO] [sessionutil/session_util.go:442] ["put session key into etcd"] [key=milvus-svztsn/meta/session/datanode-20] [value="***\"ServerID\":20,\"ServerName\":\"datanode\",\"Address\":\"172.31.6.89:21124\",\"TriggerKill\":true,\"Version\":\"2.3.2\",\"IndexEngineVersion\":***,\"LeaseID\":3037281607697801272,\"HostName\":\"milvus-svztsn-datanode-0\"***"] [2025/06/19 10:32:05.324 +00:00] [INFO] [sessionutil/session_util.go:452] ["Service registered successfully"] [ServerName=datanode] [serverID=20] [2025/06/19 10:32:05.324 +00:00] [INFO] [datanode/data_node.go:184] ["DataNode Register Finished"] [2025/06/19 10:32:05.326 +00:00] [INFO] [datanode/service.go:197] ["DataNode gRPC services successfully started"] [2025/06/19 10:32:05.326 +00:00] [DEBUG] [components/data_node.go:57] ["Datanode successfully started"] [2025/06/19 10:32:05.326 +00:00] [INFO] [logutil/logutil.go:163] ["Log directory"] [configDir=] [2025/06/19 10:32:05.326 +00:00] [INFO] [logutil/logutil.go:164] ["Set log file to "] [path=] [2025/06/19 10:32:05.326 +00:00] [INFO] [tracer/tracer.go:71] ["Init tracer finished"] [Exporter=stdout] [2025/06/19 10:32:05.329 +00:00] [INFO] [sessionutil/session_util.go:859] ["register session success"] [role=datanode] [key=milvus-svztsn/meta/session/datanode-20] delete cluster milvus-svztsn `kbcli cluster delete milvus-svztsn --auto-approve --namespace ns-yeajl ` Cluster milvus-svztsn deleted pod_info:milvus-svztsn-datanode-0 1/1 Running 0 2m42s milvus-svztsn-indexnode-0 1/1 Running 0 2m42s milvus-svztsn-mixcoord-0 1/1 Running 0 2m42s milvus-svztsn-proxy-0 1/1 Running 0 2m12s milvus-svztsn-querynode-0 1/1 Running 0 2m42s pod_info:milvus-svztsn-proxy-0 1/1 Terminating 0 2m33s No resources found in ns-yeajl namespace. delete cluster pod done No resources found in ns-yeajl namespace. check cluster resource non-exist OK: pvc No resources found in ns-yeajl namespace. delete cluster done No resources found in ns-yeajl namespace. No resources found in ns-yeajl namespace. No resources found in ns-yeajl namespace. LIMIT_CPU:0.5 LIMIT_MEMORY:0.5 storage size: 1 No resources found in ns-yeajl namespace. termination_policy:Halt create 1 replica Halt milvus cluster check cluster definition check component definition set component definition by component version no component definitions found apiVersion: apps.kubeblocks.io/v1alpha1 kind: Cluster metadata: name: milvus-svztsn namespace: ns-yeajl spec: clusterDefinitionRef: milvus topology: standalone terminationPolicy: Halt componentSpecs: - name: milvus disableExporter: true replicas: 1 resources: requests: cpu: 500m memory: 0.5Gi limits: cpu: 500m memory: 0.5Gi volumeClaimTemplates: - name: data spec: storageClassName: accessModes: - ReadWriteOnce resources: requests: storage: 1Gi - name: etcd replicas: 1 resources: limits: cpu: 500m memory: 0.5Gi requests: cpu: 500m memory: 0.5Gi volumeClaimTemplates: - name: data spec: storageClassName: accessModes: - ReadWriteOnce resources: requests: storage: 1Gi - name: minio replicas: 1 resources: limits: cpu: 500m memory: 0.5Gi requests: cpu: 500m memory: 0.5Gi volumeClaimTemplates: - name: data spec: storageClassName: accessModes: - ReadWriteOnce resources: requests: storage: 1Gi `kubectl apply -f test_create_milvus-svztsn.yaml` cluster.apps.kubeblocks.io/milvus-svztsn created apply test_create_milvus-svztsn.yaml Success `rm -rf test_create_milvus-svztsn.yaml` check cluster status `kbcli cluster list milvus-svztsn --show-labels --namespace ns-yeajl ` NAME NAMESPACE CLUSTER-DEFINITION VERSION TERMINATION-POLICY STATUS CREATED-TIME LABELS milvus-svztsn ns-yeajl milvus Halt Creating Jun 19,2025 18:34 UTC+0800 clusterdefinition.kubeblocks.io/name=milvus,clusterversion.kubeblocks.io/name= cluster_status:Creating cluster_status:Creating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances milvus-svztsn --namespace ns-yeajl ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME milvus-svztsn-etcd-0 ns-yeajl milvus-svztsn etcd Running leader us-west-2a 500m / 500m 512Mi / 512Mi data:1Gi ip-172-31-10-215.us-west-2.compute.internal/172.31.10.215 Jun 19,2025 18:34 UTC+0800 milvus-svztsn-milvus-0 ns-yeajl milvus-svztsn milvus Running us-west-2a 500m / 500m 512Mi / 512Mi data:1Gi ip-172-31-4-106.us-west-2.compute.internal/172.31.4.106 Jun 19,2025 18:35 UTC+0800 milvus-svztsn-minio-0 ns-yeajl milvus-svztsn minio Running us-west-2a 500m / 500m 512Mi / 512Mi data:1Gi ip-172-31-1-145.us-west-2.compute.internal/172.31.1.145 Jun 19,2025 18:34 UTC+0800 check pod status done connect unsupported engine type: milvus milvus-proxy-0.9.0 `kubectl get secrets -l app.kubernetes.io/instance=milvus-svztsn` `kubectl get secrets milvus-svztsn-minio-account-admin -o jsonpath="***.data.username***"` `kubectl get secrets milvus-svztsn-minio-account-admin -o jsonpath="***.data.password***"` `kubectl get secrets milvus-svztsn-minio-account-admin -o jsonpath="***.data.port***"` DB_USERNAME:admin;DB_PASSWORD:ZxXsuLJKrwC5729Z;DB_PORT:6650;DB_DATABASE: check pod milvus-svztsn-milvus-0 container_name milvus exist password ZxXsuLJKrwC5729Z No container logs contain secret password. describe cluster `kbcli cluster describe milvus-svztsn --namespace ns-yeajl ` Name: milvus-svztsn Created Time: Jun 19,2025 18:34 UTC+0800 NAMESPACE CLUSTER-DEFINITION VERSION STATUS TERMINATION-POLICY ns-yeajl milvus Running Halt Endpoints: COMPONENT MODE INTERNAL EXTERNAL Topology: COMPONENT INSTANCE ROLE STATUS AZ NODE CREATED-TIME etcd milvus-svztsn-etcd-0 leader Running us-west-2a ip-172-31-10-215.us-west-2.compute.internal/172.31.10.215 Jun 19,2025 18:34 UTC+0800 milvus milvus-svztsn-milvus-0 Running us-west-2a ip-172-31-4-106.us-west-2.compute.internal/172.31.4.106 Jun 19,2025 18:35 UTC+0800 minio milvus-svztsn-minio-0 Running us-west-2a ip-172-31-1-145.us-west-2.compute.internal/172.31.1.145 Jun 19,2025 18:34 UTC+0800 Resources Allocation: COMPONENT DEDICATED CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE-SIZE STORAGE-CLASS etcd false 500m / 500m 512Mi / 512Mi data:1Gi kb-default-sc minio false 500m / 500m 512Mi / 512Mi data:1Gi kb-default-sc milvus false 500m / 500m 512Mi / 512Mi data:1Gi kb-default-sc Images: COMPONENT TYPE IMAGE etcd docker.io/apecloud/etcd:v3.5.6 minio docker.io/apecloud/minio:RELEASE.2022-03-17T06-34-49Z milvus docker.io/apecloud/milvus:v2.3.2 Show cluster events: kbcli cluster list-events -n ns-yeajl milvus-svztsn `kbcli cluster label milvus-svztsn app.kubernetes.io/instance- --namespace ns-yeajl ` label "app.kubernetes.io/instance" not found. `kbcli cluster label milvus-svztsn app.kubernetes.io/instance=milvus-svztsn --namespace ns-yeajl ` `kbcli cluster label milvus-svztsn --list --namespace ns-yeajl ` NAME NAMESPACE LABELS milvus-svztsn ns-yeajl app.kubernetes.io/instance=milvus-svztsn clusterdefinition.kubeblocks.io/name=milvus clusterversion.kubeblocks.io/name= label cluster app.kubernetes.io/instance=milvus-svztsn Success `kbcli cluster label case.name=kbcli.test1 -l app.kubernetes.io/instance=milvus-svztsn --namespace ns-yeajl ` `kbcli cluster label milvus-svztsn --list --namespace ns-yeajl ` NAME NAMESPACE LABELS milvus-svztsn ns-yeajl app.kubernetes.io/instance=milvus-svztsn case.name=kbcli.test1 clusterdefinition.kubeblocks.io/name=milvus clusterversion.kubeblocks.io/name= label cluster case.name=kbcli.test1 Success `kbcli cluster label milvus-svztsn case.name=kbcli.test2 --overwrite --namespace ns-yeajl ` `kbcli cluster label milvus-svztsn --list --namespace ns-yeajl ` NAME NAMESPACE LABELS milvus-svztsn ns-yeajl app.kubernetes.io/instance=milvus-svztsn case.name=kbcli.test2 clusterdefinition.kubeblocks.io/name=milvus clusterversion.kubeblocks.io/name= label cluster case.name=kbcli.test2 Success `kbcli cluster label milvus-svztsn case.name- --namespace ns-yeajl ` `kbcli cluster label milvus-svztsn --list --namespace ns-yeajl ` NAME NAMESPACE LABELS milvus-svztsn ns-yeajl app.kubernetes.io/instance=milvus-svztsn clusterdefinition.kubeblocks.io/name=milvus clusterversion.kubeblocks.io/name= delete cluster label case.name Success check component minio exists `kubectl get components -l app.kubernetes.io/instance=milvus-svztsn,apps.kubeblocks.io/component-name=minio --namespace ns-yeajl | (grep "minio" || true )` `kubectl get pvc -l app.kubernetes.io/instance=milvus-svztsn,apps.kubeblocks.io/component-name=minio,apps.kubeblocks.io/vct-name=data --namespace ns-yeajl ` cluster volume-expand check cluster status before ops check cluster status done cluster_status:Running No resources found in milvus-svztsn namespace. `kbcli cluster volume-expand milvus-svztsn --auto-approve --force=true --components minio --volume-claim-templates data --storage 2Gi --namespace ns-yeajl ` OpsRequest milvus-svztsn-volumeexpansion-h8x5g created successfully, you can view the progress: kbcli cluster describe-ops milvus-svztsn-volumeexpansion-h8x5g -n ns-yeajl check ops status `kbcli cluster list-ops milvus-svztsn --status all --namespace ns-yeajl ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME milvus-svztsn-volumeexpansion-h8x5g ns-yeajl VolumeExpansion milvus-svztsn minio Running 0/1 Jun 19,2025 18:37 UTC+0800 check cluster status `kbcli cluster list milvus-svztsn --show-labels --namespace ns-yeajl ` NAME NAMESPACE CLUSTER-DEFINITION VERSION TERMINATION-POLICY STATUS CREATED-TIME LABELS milvus-svztsn ns-yeajl milvus Halt Updating Jun 19,2025 18:34 UTC+0800 app.kubernetes.io/instance=milvus-svztsn,clusterdefinition.kubeblocks.io/name=milvus,clusterversion.kubeblocks.io/name= cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances milvus-svztsn --namespace ns-yeajl ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME milvus-svztsn-etcd-0 ns-yeajl milvus-svztsn etcd Running leader us-west-2a 500m / 500m 512Mi / 512Mi data:1Gi ip-172-31-10-215.us-west-2.compute.internal/172.31.10.215 Jun 19,2025 18:34 UTC+0800 milvus-svztsn-milvus-0 ns-yeajl milvus-svztsn milvus Running us-west-2a 500m / 500m 512Mi / 512Mi data:1Gi ip-172-31-4-106.us-west-2.compute.internal/172.31.4.106 Jun 19,2025 18:35 UTC+0800 milvus-svztsn-minio-0 ns-yeajl milvus-svztsn minio Running us-west-2a 500m / 500m 512Mi / 512Mi data:2Gi ip-172-31-1-145.us-west-2.compute.internal/172.31.1.145 Jun 19,2025 18:34 UTC+0800 check pod status done connect unsupported engine type: milvus milvus-proxy-0.9.0 No resources found in milvus-svztsn namespace. check ops status `kbcli cluster list-ops milvus-svztsn --status all --namespace ns-yeajl ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME milvus-svztsn-volumeexpansion-h8x5g ns-yeajl VolumeExpansion milvus-svztsn minio Succeed 1/1 Jun 19,2025 18:37 UTC+0800 check ops status done ops_status:milvus-svztsn-volumeexpansion-h8x5g ns-yeajl VolumeExpansion milvus-svztsn minio Succeed 1/1 Jun 19,2025 18:37 UTC+0800 `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge opsrequests milvus-svztsn-volumeexpansion-h8x5g --namespace ns-yeajl ` opsrequest.apps.kubeblocks.io/milvus-svztsn-volumeexpansion-h8x5g patched `kbcli cluster delete-ops --name milvus-svztsn-volumeexpansion-h8x5g --force --auto-approve --namespace ns-yeajl ` OpsRequest milvus-svztsn-volumeexpansion-h8x5g deleted cluster stop check cluster status before ops check cluster status done cluster_status:Running `kbcli cluster stop milvus-svztsn --auto-approve --force=true --namespace ns-yeajl ` OpsRequest milvus-svztsn-stop-64xsp created successfully, you can view the progress: kbcli cluster describe-ops milvus-svztsn-stop-64xsp -n ns-yeajl check ops status `kbcli cluster list-ops milvus-svztsn --status all --namespace ns-yeajl ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME milvus-svztsn-stop-64xsp ns-yeajl Stop milvus-svztsn etcd,milvus,minio Running 0/3 Jun 19,2025 18:39 UTC+0800 check cluster status `kbcli cluster list milvus-svztsn --show-labels --namespace ns-yeajl ` NAME NAMESPACE CLUSTER-DEFINITION VERSION TERMINATION-POLICY STATUS CREATED-TIME LABELS milvus-svztsn ns-yeajl milvus Halt Stopping Jun 19,2025 18:34 UTC+0800 app.kubernetes.io/instance=milvus-svztsn,clusterdefinition.kubeblocks.io/name=milvus,clusterversion.kubeblocks.io/name= cluster_status:Stopping cluster_status:Stopping cluster_status:Stopping cluster_status:Stopping check cluster status done cluster_status:Stopped check pod status `kbcli cluster list-instances milvus-svztsn --namespace ns-yeajl ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME check pod status done check ops status `kbcli cluster list-ops milvus-svztsn --status all --namespace ns-yeajl ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME milvus-svztsn-stop-64xsp ns-yeajl Stop milvus-svztsn etcd,milvus,minio Succeed 3/3 Jun 19,2025 18:39 UTC+0800 check ops status done ops_status:milvus-svztsn-stop-64xsp ns-yeajl Stop milvus-svztsn etcd,milvus,minio Succeed 3/3 Jun 19,2025 18:39 UTC+0800 `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge opsrequests milvus-svztsn-stop-64xsp --namespace ns-yeajl ` opsrequest.apps.kubeblocks.io/milvus-svztsn-stop-64xsp patched `kbcli cluster delete-ops --name milvus-svztsn-stop-64xsp --force --auto-approve --namespace ns-yeajl ` OpsRequest milvus-svztsn-stop-64xsp deleted cluster start check cluster status before ops check cluster status done cluster_status:Stopped `kbcli cluster start milvus-svztsn --force=true --namespace ns-yeajl ` OpsRequest milvus-svztsn-start-fnvg8 created successfully, you can view the progress: kbcli cluster describe-ops milvus-svztsn-start-fnvg8 -n ns-yeajl check ops status `kbcli cluster list-ops milvus-svztsn --status all --namespace ns-yeajl ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME milvus-svztsn-start-fnvg8 ns-yeajl Start milvus-svztsn etcd,milvus,minio Running 0/3 Jun 19,2025 18:40 UTC+0800 check cluster status `kbcli cluster list milvus-svztsn --show-labels --namespace ns-yeajl ` NAME NAMESPACE CLUSTER-DEFINITION VERSION TERMINATION-POLICY STATUS CREATED-TIME LABELS milvus-svztsn ns-yeajl milvus Halt Updating Jun 19,2025 18:34 UTC+0800 app.kubernetes.io/instance=milvus-svztsn,clusterdefinition.kubeblocks.io/name=milvus,clusterversion.kubeblocks.io/name= cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances milvus-svztsn --namespace ns-yeajl ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME milvus-svztsn-etcd-0 ns-yeajl milvus-svztsn etcd Running leader us-west-2a 500m / 500m 512Mi / 512Mi data:1Gi ip-172-31-10-215.us-west-2.compute.internal/172.31.10.215 Jun 19,2025 18:40 UTC+0800 milvus-svztsn-milvus-0 ns-yeajl milvus-svztsn milvus Running us-west-2a 500m / 500m 512Mi / 512Mi data:1Gi ip-172-31-1-145.us-west-2.compute.internal/172.31.1.145 Jun 19,2025 18:40 UTC+0800 milvus-svztsn-minio-0 ns-yeajl milvus-svztsn minio Running us-west-2a 500m / 500m 512Mi / 512Mi data:2Gi ip-172-31-4-106.us-west-2.compute.internal/172.31.4.106 Jun 19,2025 18:40 UTC+0800 check pod status done connect unsupported engine type: milvus milvus-proxy-0.9.0 check ops status `kbcli cluster list-ops milvus-svztsn --status all --namespace ns-yeajl ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME milvus-svztsn-start-fnvg8 ns-yeajl Start milvus-svztsn etcd,milvus,minio Succeed 3/3 Jun 19,2025 18:40 UTC+0800 check ops status done ops_status:milvus-svztsn-start-fnvg8 ns-yeajl Start milvus-svztsn etcd,milvus,minio Succeed 3/3 Jun 19,2025 18:40 UTC+0800 `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge opsrequests milvus-svztsn-start-fnvg8 --namespace ns-yeajl ` opsrequest.apps.kubeblocks.io/milvus-svztsn-start-fnvg8 patched `kbcli cluster delete-ops --name milvus-svztsn-start-fnvg8 --force --auto-approve --namespace ns-yeajl ` OpsRequest milvus-svztsn-start-fnvg8 deleted cluster restart check cluster status before ops check cluster status done cluster_status:Running `kbcli cluster restart milvus-svztsn --auto-approve --force=true --components milvus --namespace ns-yeajl ` OpsRequest milvus-svztsn-restart-b2h52 created successfully, you can view the progress: kbcli cluster describe-ops milvus-svztsn-restart-b2h52 -n ns-yeajl check ops status `kbcli cluster list-ops milvus-svztsn --status all --namespace ns-yeajl ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME milvus-svztsn-restart-b2h52 ns-yeajl Restart milvus-svztsn milvus Running 0/1 Jun 19,2025 18:42 UTC+0800 check cluster status `kbcli cluster list milvus-svztsn --show-labels --namespace ns-yeajl ` NAME NAMESPACE CLUSTER-DEFINITION VERSION TERMINATION-POLICY STATUS CREATED-TIME LABELS milvus-svztsn ns-yeajl milvus Halt Updating Jun 19,2025 18:34 UTC+0800 app.kubernetes.io/instance=milvus-svztsn,clusterdefinition.kubeblocks.io/name=milvus,clusterversion.kubeblocks.io/name= cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances milvus-svztsn --namespace ns-yeajl ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME milvus-svztsn-etcd-0 ns-yeajl milvus-svztsn etcd Running leader us-west-2a 500m / 500m 512Mi / 512Mi data:1Gi ip-172-31-10-215.us-west-2.compute.internal/172.31.10.215 Jun 19,2025 18:40 UTC+0800 milvus-svztsn-milvus-0 ns-yeajl milvus-svztsn milvus Running us-west-2a 500m / 500m 512Mi / 512Mi data:1Gi ip-172-31-1-145.us-west-2.compute.internal/172.31.1.145 Jun 19,2025 18:42 UTC+0800 milvus-svztsn-minio-0 ns-yeajl milvus-svztsn minio Running us-west-2a 500m / 500m 512Mi / 512Mi data:2Gi ip-172-31-4-106.us-west-2.compute.internal/172.31.4.106 Jun 19,2025 18:40 UTC+0800 check pod status done connect unsupported engine type: milvus milvus-proxy-0.9.0 check ops status `kbcli cluster list-ops milvus-svztsn --status all --namespace ns-yeajl ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME milvus-svztsn-restart-b2h52 ns-yeajl Restart milvus-svztsn milvus Succeed 1/1 Jun 19,2025 18:42 UTC+0800 check ops status done ops_status:milvus-svztsn-restart-b2h52 ns-yeajl Restart milvus-svztsn milvus Succeed 1/1 Jun 19,2025 18:42 UTC+0800 `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge opsrequests milvus-svztsn-restart-b2h52 --namespace ns-yeajl ` opsrequest.apps.kubeblocks.io/milvus-svztsn-restart-b2h52 patched `kbcli cluster delete-ops --name milvus-svztsn-restart-b2h52 --force --auto-approve --namespace ns-yeajl ` OpsRequest milvus-svztsn-restart-b2h52 deleted skip cluster HorizontalScaling Out cluster restart check cluster status before ops check cluster status done cluster_status:Running `kbcli cluster restart milvus-svztsn --auto-approve --force=true --namespace ns-yeajl ` OpsRequest milvus-svztsn-restart-9w95m created successfully, you can view the progress: kbcli cluster describe-ops milvus-svztsn-restart-9w95m -n ns-yeajl check ops status `kbcli cluster list-ops milvus-svztsn --status all --namespace ns-yeajl ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME milvus-svztsn-restart-9w95m ns-yeajl Restart milvus-svztsn etcd,minio,milvus Running 0/3 Jun 19,2025 18:44 UTC+0800 check cluster status `kbcli cluster list milvus-svztsn --show-labels --namespace ns-yeajl ` NAME NAMESPACE CLUSTER-DEFINITION VERSION TERMINATION-POLICY STATUS CREATED-TIME LABELS milvus-svztsn ns-yeajl milvus Halt Updating Jun 19,2025 18:34 UTC+0800 app.kubernetes.io/instance=milvus-svztsn,clusterdefinition.kubeblocks.io/name=milvus,clusterversion.kubeblocks.io/name= cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances milvus-svztsn --namespace ns-yeajl ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME milvus-svztsn-etcd-0 ns-yeajl milvus-svztsn etcd Running leader us-west-2a 500m / 500m 512Mi / 512Mi data:1Gi ip-172-31-10-215.us-west-2.compute.internal/172.31.10.215 Jun 19,2025 18:44 UTC+0800 milvus-svztsn-milvus-0 ns-yeajl milvus-svztsn milvus Running us-west-2a 500m / 500m 512Mi / 512Mi data:1Gi ip-172-31-1-145.us-west-2.compute.internal/172.31.1.145 Jun 19,2025 18:44 UTC+0800 milvus-svztsn-minio-0 ns-yeajl milvus-svztsn minio Running us-west-2a 500m / 500m 512Mi / 512Mi data:2Gi ip-172-31-4-106.us-west-2.compute.internal/172.31.4.106 Jun 19,2025 18:44 UTC+0800 check pod status done connect unsupported engine type: milvus milvus-proxy-0.9.0 check ops status `kbcli cluster list-ops milvus-svztsn --status all --namespace ns-yeajl ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME milvus-svztsn-restart-9w95m ns-yeajl Restart milvus-svztsn etcd,minio,milvus Succeed 3/3 Jun 19,2025 18:44 UTC+0800 check ops status done ops_status:milvus-svztsn-restart-9w95m ns-yeajl Restart milvus-svztsn etcd,minio,milvus Succeed 3/3 Jun 19,2025 18:44 UTC+0800 `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge opsrequests milvus-svztsn-restart-9w95m --namespace ns-yeajl ` opsrequest.apps.kubeblocks.io/milvus-svztsn-restart-9w95m patched `kbcli cluster delete-ops --name milvus-svztsn-restart-9w95m --force --auto-approve --namespace ns-yeajl ` OpsRequest milvus-svztsn-restart-9w95m deleted check component etcd exists `kubectl get components -l app.kubernetes.io/instance=milvus-svztsn,apps.kubeblocks.io/component-name=etcd --namespace ns-yeajl | (grep "etcd" || true )` cluster vscale check cluster status before ops check cluster status done cluster_status:Running `kbcli cluster vscale milvus-svztsn --auto-approve --force=true --components etcd --cpu 600m --memory 0.6Gi --namespace ns-yeajl ` OpsRequest milvus-svztsn-verticalscaling-b4mmk created successfully, you can view the progress: kbcli cluster describe-ops milvus-svztsn-verticalscaling-b4mmk -n ns-yeajl check ops status `kbcli cluster list-ops milvus-svztsn --status all --namespace ns-yeajl ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME milvus-svztsn-verticalscaling-b4mmk ns-yeajl VerticalScaling milvus-svztsn etcd Running 0/1 Jun 19,2025 18:46 UTC+0800 check cluster status `kbcli cluster list milvus-svztsn --show-labels --namespace ns-yeajl ` NAME NAMESPACE CLUSTER-DEFINITION VERSION TERMINATION-POLICY STATUS CREATED-TIME LABELS milvus-svztsn ns-yeajl milvus Halt Updating Jun 19,2025 18:34 UTC+0800 app.kubernetes.io/instance=milvus-svztsn,clusterdefinition.kubeblocks.io/name=milvus,clusterversion.kubeblocks.io/name= cluster_status:Updating cluster_status:Updating check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances milvus-svztsn --namespace ns-yeajl ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME milvus-svztsn-etcd-0 ns-yeajl milvus-svztsn etcd Running leader us-west-2a 600m / 600m 644245094400m / 644245094400m data:1Gi ip-172-31-10-215.us-west-2.compute.internal/172.31.10.215 Jun 19,2025 18:46 UTC+0800 milvus-svztsn-milvus-0 ns-yeajl milvus-svztsn milvus Running us-west-2a 500m / 500m 512Mi / 512Mi data:1Gi ip-172-31-1-145.us-west-2.compute.internal/172.31.1.145 Jun 19,2025 18:44 UTC+0800 milvus-svztsn-minio-0 ns-yeajl milvus-svztsn minio Running us-west-2a 500m / 500m 512Mi / 512Mi data:2Gi ip-172-31-4-106.us-west-2.compute.internal/172.31.4.106 Jun 19,2025 18:44 UTC+0800 check pod status done connect unsupported engine type: milvus milvus-proxy-0.9.0 check ops status `kbcli cluster list-ops milvus-svztsn --status all --namespace ns-yeajl ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME milvus-svztsn-verticalscaling-b4mmk ns-yeajl VerticalScaling milvus-svztsn etcd Succeed 1/1 Jun 19,2025 18:46 UTC+0800 check ops status done ops_status:milvus-svztsn-verticalscaling-b4mmk ns-yeajl VerticalScaling milvus-svztsn etcd Succeed 1/1 Jun 19,2025 18:46 UTC+0800 `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge opsrequests milvus-svztsn-verticalscaling-b4mmk --namespace ns-yeajl ` opsrequest.apps.kubeblocks.io/milvus-svztsn-verticalscaling-b4mmk patched `kbcli cluster delete-ops --name milvus-svztsn-verticalscaling-b4mmk --force --auto-approve --namespace ns-yeajl ` OpsRequest milvus-svztsn-verticalscaling-b4mmk deleted 1 check component minio exists `kubectl get components -l app.kubernetes.io/instance=milvus-svztsn,apps.kubeblocks.io/component-name=minio --namespace ns-yeajl | (grep "minio" || true )` cluster vscale check cluster status before ops check cluster status done cluster_status:Running `kbcli cluster vscale milvus-svztsn --auto-approve --force=true --components minio --cpu 600m --memory 0.6Gi --namespace ns-yeajl ` OpsRequest milvus-svztsn-verticalscaling-wb7gf created successfully, you can view the progress: kbcli cluster describe-ops milvus-svztsn-verticalscaling-wb7gf -n ns-yeajl check ops status `kbcli cluster list-ops milvus-svztsn --status all --namespace ns-yeajl ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME milvus-svztsn-verticalscaling-wb7gf ns-yeajl VerticalScaling milvus-svztsn minio Running 0/1 Jun 19,2025 18:47 UTC+0800 check cluster status `kbcli cluster list milvus-svztsn --show-labels --namespace ns-yeajl ` NAME NAMESPACE CLUSTER-DEFINITION VERSION TERMINATION-POLICY STATUS CREATED-TIME LABELS milvus-svztsn ns-yeajl milvus Halt Updating Jun 19,2025 18:34 UTC+0800 app.kubernetes.io/instance=milvus-svztsn,clusterdefinition.kubeblocks.io/name=milvus,clusterversion.kubeblocks.io/name= cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances milvus-svztsn --namespace ns-yeajl ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME milvus-svztsn-etcd-0 ns-yeajl milvus-svztsn etcd Running leader us-west-2a 600m / 600m 644245094400m / 644245094400m data:1Gi ip-172-31-10-215.us-west-2.compute.internal/172.31.10.215 Jun 19,2025 18:46 UTC+0800 milvus-svztsn-milvus-0 ns-yeajl milvus-svztsn milvus Running us-west-2a 500m / 500m 512Mi / 512Mi data:1Gi ip-172-31-1-145.us-west-2.compute.internal/172.31.1.145 Jun 19,2025 18:44 UTC+0800 milvus-svztsn-minio-0 ns-yeajl milvus-svztsn minio Running us-west-2a 600m / 600m 644245094400m / 644245094400m data:2Gi ip-172-31-1-184.us-west-2.compute.internal/172.31.1.184 Jun 19,2025 18:47 UTC+0800 check pod status done connect unsupported engine type: milvus milvus-proxy-0.9.0 check ops status `kbcli cluster list-ops milvus-svztsn --status all --namespace ns-yeajl ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME milvus-svztsn-verticalscaling-wb7gf ns-yeajl VerticalScaling milvus-svztsn minio Succeed 1/1 Jun 19,2025 18:47 UTC+0800 check ops status done ops_status:milvus-svztsn-verticalscaling-wb7gf ns-yeajl VerticalScaling milvus-svztsn minio Succeed 1/1 Jun 19,2025 18:47 UTC+0800 `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge opsrequests milvus-svztsn-verticalscaling-wb7gf --namespace ns-yeajl ` opsrequest.apps.kubeblocks.io/milvus-svztsn-verticalscaling-wb7gf patched `kbcli cluster delete-ops --name milvus-svztsn-verticalscaling-wb7gf --force --auto-approve --namespace ns-yeajl ` OpsRequest milvus-svztsn-verticalscaling-wb7gf deleted cluster vscale check cluster status before ops check cluster status done cluster_status:Running `kbcli cluster vscale milvus-svztsn --auto-approve --force=true --components milvus --cpu 600m --memory 0.6Gi --namespace ns-yeajl ` OpsRequest milvus-svztsn-verticalscaling-cvjth created successfully, you can view the progress: kbcli cluster describe-ops milvus-svztsn-verticalscaling-cvjth -n ns-yeajl check ops status `kbcli cluster list-ops milvus-svztsn --status all --namespace ns-yeajl ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME milvus-svztsn-verticalscaling-cvjth ns-yeajl VerticalScaling milvus-svztsn milvus Running 0/1 Jun 19,2025 18:48 UTC+0800 check cluster status `kbcli cluster list milvus-svztsn --show-labels --namespace ns-yeajl ` NAME NAMESPACE CLUSTER-DEFINITION VERSION TERMINATION-POLICY STATUS CREATED-TIME LABELS milvus-svztsn ns-yeajl milvus Halt Updating Jun 19,2025 18:34 UTC+0800 app.kubernetes.io/instance=milvus-svztsn,clusterdefinition.kubeblocks.io/name=milvus,clusterversion.kubeblocks.io/name= cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances milvus-svztsn --namespace ns-yeajl ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME milvus-svztsn-etcd-0 ns-yeajl milvus-svztsn etcd Running leader us-west-2a 600m / 600m 644245094400m / 644245094400m data:1Gi ip-172-31-10-215.us-west-2.compute.internal/172.31.10.215 Jun 19,2025 18:46 UTC+0800 milvus-svztsn-milvus-0 ns-yeajl milvus-svztsn milvus Running us-west-2a 600m / 600m 644245094400m / 644245094400m data:1Gi ip-172-31-1-145.us-west-2.compute.internal/172.31.1.145 Jun 19,2025 18:48 UTC+0800 milvus-svztsn-minio-0 ns-yeajl milvus-svztsn minio Running us-west-2a 600m / 600m 644245094400m / 644245094400m data:2Gi ip-172-31-1-184.us-west-2.compute.internal/172.31.1.184 Jun 19,2025 18:47 UTC+0800 check pod status done connect unsupported engine type: milvus milvus-proxy-0.9.0 check ops status `kbcli cluster list-ops milvus-svztsn --status all --namespace ns-yeajl ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME milvus-svztsn-verticalscaling-cvjth ns-yeajl VerticalScaling milvus-svztsn milvus Succeed 1/1 Jun 19,2025 18:48 UTC+0800 check ops status done ops_status:milvus-svztsn-verticalscaling-cvjth ns-yeajl VerticalScaling milvus-svztsn milvus Succeed 1/1 Jun 19,2025 18:48 UTC+0800 `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge opsrequests milvus-svztsn-verticalscaling-cvjth --namespace ns-yeajl ` opsrequest.apps.kubeblocks.io/milvus-svztsn-verticalscaling-cvjth patched `kbcli cluster delete-ops --name milvus-svztsn-verticalscaling-cvjth --force --auto-approve --namespace ns-yeajl ` OpsRequest milvus-svztsn-verticalscaling-cvjth deleted check component etcd exists `kubectl get components -l app.kubernetes.io/instance=milvus-svztsn,apps.kubeblocks.io/component-name=etcd --namespace ns-yeajl | (grep "etcd" || true )` `kubectl get pvc -l app.kubernetes.io/instance=milvus-svztsn,apps.kubeblocks.io/component-name=etcd,apps.kubeblocks.io/vct-name=data --namespace ns-yeajl ` cluster volume-expand check cluster status before ops check cluster status done cluster_status:Running No resources found in milvus-svztsn namespace. `kbcli cluster volume-expand milvus-svztsn --auto-approve --force=true --components etcd --volume-claim-templates data --storage 5Gi --namespace ns-yeajl ` OpsRequest milvus-svztsn-volumeexpansion-sz4kv created successfully, you can view the progress: kbcli cluster describe-ops milvus-svztsn-volumeexpansion-sz4kv -n ns-yeajl check ops status `kbcli cluster list-ops milvus-svztsn --status all --namespace ns-yeajl ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME milvus-svztsn-volumeexpansion-sz4kv ns-yeajl VolumeExpansion milvus-svztsn etcd Running 0/1 Jun 19,2025 18:50 UTC+0800 check cluster status `kbcli cluster list milvus-svztsn --show-labels --namespace ns-yeajl ` NAME NAMESPACE CLUSTER-DEFINITION VERSION TERMINATION-POLICY STATUS CREATED-TIME LABELS milvus-svztsn ns-yeajl milvus Halt Updating Jun 19,2025 18:34 UTC+0800 app.kubernetes.io/instance=milvus-svztsn,clusterdefinition.kubeblocks.io/name=milvus,clusterversion.kubeblocks.io/name= cluster_status:Updating cluster_status:Updating check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances milvus-svztsn --namespace ns-yeajl ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME milvus-svztsn-etcd-0 ns-yeajl milvus-svztsn etcd Running leader us-west-2a 600m / 600m 644245094400m / 644245094400m data:5Gi ip-172-31-10-215.us-west-2.compute.internal/172.31.10.215 Jun 19,2025 18:46 UTC+0800 milvus-svztsn-milvus-0 ns-yeajl milvus-svztsn milvus Running us-west-2a 600m / 600m 644245094400m / 644245094400m data:1Gi ip-172-31-1-145.us-west-2.compute.internal/172.31.1.145 Jun 19,2025 18:48 UTC+0800 milvus-svztsn-minio-0 ns-yeajl milvus-svztsn minio Running us-west-2a 600m / 600m 644245094400m / 644245094400m data:2Gi ip-172-31-1-184.us-west-2.compute.internal/172.31.1.184 Jun 19,2025 18:47 UTC+0800 check pod status done connect unsupported engine type: milvus milvus-proxy-0.9.0 No resources found in milvus-svztsn namespace. check ops status `kbcli cluster list-ops milvus-svztsn --status all --namespace ns-yeajl ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME milvus-svztsn-volumeexpansion-sz4kv ns-yeajl VolumeExpansion milvus-svztsn etcd Succeed 1/1 Jun 19,2025 18:50 UTC+0800 check ops status done ops_status:milvus-svztsn-volumeexpansion-sz4kv ns-yeajl VolumeExpansion milvus-svztsn etcd Succeed 1/1 Jun 19,2025 18:50 UTC+0800 `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge opsrequests milvus-svztsn-volumeexpansion-sz4kv --namespace ns-yeajl ` opsrequest.apps.kubeblocks.io/milvus-svztsn-volumeexpansion-sz4kv patched `kbcli cluster delete-ops --name milvus-svztsn-volumeexpansion-sz4kv --force --auto-approve --namespace ns-yeajl ` OpsRequest milvus-svztsn-volumeexpansion-sz4kv deleted `kubectl get pvc -l app.kubernetes.io/instance=milvus-svztsn,apps.kubeblocks.io/component-name=milvus,apps.kubeblocks.io/vct-name=data --namespace ns-yeajl ` cluster volume-expand check cluster status before ops check cluster status done cluster_status:Running No resources found in milvus-svztsn namespace. `kbcli cluster volume-expand milvus-svztsn --auto-approve --force=true --components milvus --volume-claim-templates data --storage 4Gi --namespace ns-yeajl ` OpsRequest milvus-svztsn-volumeexpansion-28q4v created successfully, you can view the progress: kbcli cluster describe-ops milvus-svztsn-volumeexpansion-28q4v -n ns-yeajl check ops status `kbcli cluster list-ops milvus-svztsn --status all --namespace ns-yeajl ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME milvus-svztsn-volumeexpansion-28q4v ns-yeajl VolumeExpansion milvus-svztsn milvus Running 0/1 Jun 19,2025 18:50 UTC+0800 check cluster status `kbcli cluster list milvus-svztsn --show-labels --namespace ns-yeajl ` NAME NAMESPACE CLUSTER-DEFINITION VERSION TERMINATION-POLICY STATUS CREATED-TIME LABELS milvus-svztsn ns-yeajl milvus Halt Updating Jun 19,2025 18:34 UTC+0800 app.kubernetes.io/instance=milvus-svztsn,clusterdefinition.kubeblocks.io/name=milvus,clusterversion.kubeblocks.io/name= check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances milvus-svztsn --namespace ns-yeajl ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME milvus-svztsn-etcd-0 ns-yeajl milvus-svztsn etcd Running leader us-west-2a 600m / 600m 644245094400m / 644245094400m data:5Gi ip-172-31-10-215.us-west-2.compute.internal/172.31.10.215 Jun 19,2025 18:46 UTC+0800 milvus-svztsn-milvus-0 ns-yeajl milvus-svztsn milvus Running us-west-2a 600m / 600m 644245094400m / 644245094400m data:4Gi ip-172-31-1-145.us-west-2.compute.internal/172.31.1.145 Jun 19,2025 18:48 UTC+0800 milvus-svztsn-minio-0 ns-yeajl milvus-svztsn minio Running us-west-2a 600m / 600m 644245094400m / 644245094400m data:2Gi ip-172-31-1-184.us-west-2.compute.internal/172.31.1.184 Jun 19,2025 18:47 UTC+0800 check pod status done connect unsupported engine type: milvus milvus-proxy-0.9.0 No resources found in milvus-svztsn namespace. check ops status `kbcli cluster list-ops milvus-svztsn --status all --namespace ns-yeajl ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME milvus-svztsn-volumeexpansion-28q4v ns-yeajl VolumeExpansion milvus-svztsn milvus Succeed 1/1 Jun 19,2025 18:50 UTC+0800 check ops status done ops_status:milvus-svztsn-volumeexpansion-28q4v ns-yeajl VolumeExpansion milvus-svztsn milvus Succeed 1/1 Jun 19,2025 18:50 UTC+0800 `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge opsrequests milvus-svztsn-volumeexpansion-28q4v --namespace ns-yeajl ` opsrequest.apps.kubeblocks.io/milvus-svztsn-volumeexpansion-28q4v patched `kbcli cluster delete-ops --name milvus-svztsn-volumeexpansion-28q4v --force --auto-approve --namespace ns-yeajl ` OpsRequest milvus-svztsn-volumeexpansion-28q4v deleted cluster update terminationPolicy WipeOut `kbcli cluster update milvus-svztsn --termination-policy=WipeOut --namespace ns-yeajl ` cluster.apps.kubeblocks.io/milvus-svztsn updated check cluster status `kbcli cluster list milvus-svztsn --show-labels --namespace ns-yeajl ` NAME NAMESPACE CLUSTER-DEFINITION VERSION TERMINATION-POLICY STATUS CREATED-TIME LABELS milvus-svztsn ns-yeajl milvus WipeOut Running Jun 19,2025 18:34 UTC+0800 app.kubernetes.io/instance=milvus-svztsn,clusterdefinition.kubeblocks.io/name=milvus,clusterversion.kubeblocks.io/name= check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances milvus-svztsn --namespace ns-yeajl ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME milvus-svztsn-etcd-0 ns-yeajl milvus-svztsn etcd Running leader us-west-2a 600m / 600m 644245094400m / 644245094400m data:5Gi ip-172-31-10-215.us-west-2.compute.internal/172.31.10.215 Jun 19,2025 18:46 UTC+0800 milvus-svztsn-milvus-0 ns-yeajl milvus-svztsn milvus Running us-west-2a 600m / 600m 644245094400m / 644245094400m data:4Gi ip-172-31-1-145.us-west-2.compute.internal/172.31.1.145 Jun 19,2025 18:48 UTC+0800 milvus-svztsn-minio-0 ns-yeajl milvus-svztsn minio Running us-west-2a 600m / 600m 644245094400m / 644245094400m data:2Gi ip-172-31-1-184.us-west-2.compute.internal/172.31.1.184 Jun 19,2025 18:47 UTC+0800 check pod status done connect unsupported engine type: milvus milvus-proxy-0.9.0 cluster list-logs `kbcli cluster list-logs milvus-svztsn --namespace ns-yeajl ` No log files found. You can enable the log feature with the kbcli command below. kbcli cluster update milvus-svztsn --enable-all-logs=true --namespace ns-yeajl Error from server (NotFound): pods "milvus-svztsn-milvus-0" not found cluster logs `kbcli cluster logs milvus-svztsn --tail 30 --namespace ns-yeajl ` Defaulted container "etcd" out of: etcd, lorry, action-0, init-lorry (init), role-agent-installer (init) ***"level":"info","ts":"2025-06-19T10:47:02.292Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"newRaft bc42c097c93798f6 [peers: [], term: 4, commit: 669, applied: 0, lastindex: 669, lastterm: 4]"*** ***"level":"warn","ts":"2025-06-19T10:47:02.294Z","caller":"auth/store.go:1234","msg":"simple token is not cryptographically signed"*** ***"level":"info","ts":"2025-06-19T10:47:02.300Z","caller":"mvcc/kvstore.go:393","msg":"kvstore restored","current-rev":237*** ***"level":"info","ts":"2025-06-19T10:47:02.329Z","caller":"etcdserver/quota.go:94","msg":"enabled backend quota with default value","quota-name":"v3-applier","quota-size-bytes":2147483648,"quota-size":"2.1 GB"*** ***"level":"info","ts":"2025-06-19T10:47:02.332Z","caller":"etcdserver/corrupt.go:95","msg":"starting initial corruption check","local-member-id":"bc42c097c93798f6","timeout":"7s"*** ***"level":"info","ts":"2025-06-19T10:47:02.332Z","caller":"etcdserver/corrupt.go:165","msg":"initial corruption checking passed; no corruption","local-member-id":"bc42c097c93798f6"*** ***"level":"info","ts":"2025-06-19T10:47:02.332Z","caller":"etcdserver/server.go:854","msg":"starting etcd server","local-member-id":"bc42c097c93798f6","local-server-version":"3.5.6","cluster-version":"to_be_decided"*** ***"level":"info","ts":"2025-06-19T10:47:02.335Z","caller":"embed/etcd.go:275","msg":"now serving peer/client/metrics","local-member-id":"bc42c097c93798f6","initial-advertise-peer-urls":["http://milvus-svztsn-etcd-0.milvus-svztsn-etcd-headless.ns-yeajl.svc.cluster.local:2380"],"listen-peer-urls":["http://0.0.0.0:2380"],"advertise-client-urls":["http://milvus-svztsn-etcd-0.milvus-svztsn-etcd-headless.ns-yeajl.svc.cluster.local:2379"],"listen-client-urls":["http://0.0.0.0:2379"],"listen-metrics-urls":[]*** ***"level":"info","ts":"2025-06-19T10:47:02.335Z","caller":"etcdserver/server.go:754","msg":"starting initial election tick advance","election-ticks":10*** ***"level":"info","ts":"2025-06-19T10:47:02.335Z","caller":"fileutil/purge.go:44","msg":"started to purge file","dir":"/var/run/etcd/default.etcd/member/snap","suffix":"snap.db","max":5,"interval":"30s"*** ***"level":"info","ts":"2025-06-19T10:47:02.335Z","caller":"fileutil/purge.go:44","msg":"started to purge file","dir":"/var/run/etcd/default.etcd/member/snap","suffix":"snap","max":5,"interval":"30s"*** ***"level":"info","ts":"2025-06-19T10:47:02.335Z","caller":"fileutil/purge.go:44","msg":"started to purge file","dir":"/var/run/etcd/default.etcd/member/wal","suffix":"wal","max":5,"interval":"30s"*** ***"level":"info","ts":"2025-06-19T10:47:02.335Z","caller":"embed/etcd.go:586","msg":"serving peer traffic","address":"[::]:2380"*** ***"level":"info","ts":"2025-06-19T10:47:02.335Z","caller":"embed/etcd.go:558","msg":"cmux::serve","address":"[::]:2380"*** ***"level":"info","ts":"2025-06-19T10:47:02.336Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"bc42c097c93798f6 switched to configuration voters=(13565616785741814006)"*** ***"level":"info","ts":"2025-06-19T10:47:02.336Z","caller":"membership/cluster.go:421","msg":"added member","cluster-id":"dd57a2093a111e0e","local-member-id":"bc42c097c93798f6","added-peer-id":"bc42c097c93798f6","added-peer-peer-urls":["http://milvus-svztsn-etcd-0.milvus-svztsn-etcd-headless.ns-yeajl.svc.cluster.local:2380"]*** ***"level":"info","ts":"2025-06-19T10:47:02.336Z","caller":"membership/cluster.go:584","msg":"set initial cluster version","cluster-id":"dd57a2093a111e0e","local-member-id":"bc42c097c93798f6","cluster-version":"3.5"*** ***"level":"info","ts":"2025-06-19T10:47:02.336Z","caller":"api/capability.go:75","msg":"enabled capabilities for version","cluster-version":"3.5"*** ***"level":"info","ts":"2025-06-19T10:47:03.793Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"bc42c097c93798f6 is starting a new election at term 4"*** ***"level":"info","ts":"2025-06-19T10:47:03.793Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"bc42c097c93798f6 became pre-candidate at term 4"*** ***"level":"info","ts":"2025-06-19T10:47:03.793Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"bc42c097c93798f6 received MsgPreVoteResp from bc42c097c93798f6 at term 4"*** ***"level":"info","ts":"2025-06-19T10:47:03.793Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"bc42c097c93798f6 became candidate at term 5"*** ***"level":"info","ts":"2025-06-19T10:47:03.794Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"bc42c097c93798f6 received MsgVoteResp from bc42c097c93798f6 at term 5"*** ***"level":"info","ts":"2025-06-19T10:47:03.794Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"bc42c097c93798f6 became leader at term 5"*** ***"level":"info","ts":"2025-06-19T10:47:03.794Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"raft.node: bc42c097c93798f6 elected leader bc42c097c93798f6 at term 5"*** ***"level":"info","ts":"2025-06-19T10:47:03.798Z","caller":"etcdserver/server.go:2054","msg":"published local member to cluster through raft","local-member-id":"bc42c097c93798f6","local-member-attributes":"***Name:milvus-svztsn-etcd-0 ClientURLs:[http://milvus-svztsn-etcd-0.milvus-svztsn-etcd-headless.ns-yeajl.svc.cluster.local:2379]***","request-path":"/0/members/bc42c097c93798f6/attributes","cluster-id":"dd57a2093a111e0e","publish-timeout":"7s"*** ***"level":"info","ts":"2025-06-19T10:47:03.798Z","caller":"embed/serve.go:100","msg":"ready to serve client requests"*** ***"level":"info","ts":"2025-06-19T10:47:03.799Z","caller":"etcdmain/main.go:44","msg":"notifying init daemon"*** ***"level":"info","ts":"2025-06-19T10:47:03.799Z","caller":"etcdmain/main.go:50","msg":"successfully notified init daemon"*** ***"level":"info","ts":"2025-06-19T10:47:03.799Z","caller":"embed/serve.go:146","msg":"serving client traffic insecurely; this is strongly discouraged!","address":"[::]:2379"*** delete cluster milvus-svztsn `kbcli cluster delete milvus-svztsn --auto-approve --namespace ns-yeajl ` Cluster milvus-svztsn deleted pod_info:milvus-svztsn-etcd-0 3/3 Running 0 4m50s milvus-svztsn-milvus-0 0/1 Completed 0 3m26s milvus-svztsn-minio-0 1/1 Running 0 4m13s No resources found in ns-yeajl namespace. delete cluster pod done No resources found in ns-yeajl namespace. check cluster resource non-exist OK: pvc No resources found in ns-yeajl namespace. delete cluster done No resources found in ns-yeajl namespace. No resources found in ns-yeajl namespace. No resources found in ns-yeajl namespace. Milvus Test Suite All Done! delete cluster etcdm-svztsn `kbcli cluster delete etcdm-svztsn --auto-approve --namespace ns-yeajl ` Cluster etcdm-svztsn deleted pod_info:etcdm-svztsn-etcd-0 0/2 Completed 0 39m No resources found in ns-yeajl namespace. delete cluster pod done No resources found in ns-yeajl namespace. check cluster resource non-exist OK: pvc No resources found in ns-yeajl namespace. delete cluster done No resources found in ns-yeajl namespace. No resources found in ns-yeajl namespace. No resources found in ns-yeajl namespace. delete cluster pulsarm-svztsn `kbcli cluster delete pulsarm-svztsn --auto-approve --namespace ns-yeajl ` Cluster pulsarm-svztsn deleted pod_info:pulsarm-svztsn-bookies-0 1/1 Running 0 38m pulsarm-svztsn-bookies-1 1/1 Running 0 38m pulsarm-svztsn-bookies-2 1/1 Running 0 38m pulsarm-svztsn-bookies-recovery-0 1/1 Running 0 38m pulsarm-svztsn-pulsar-broker-0 2/2 Running 0 38m pulsarm-svztsn-pulsar-proxy-0 1/1 Running 0 38m pulsarm-svztsn-zookeeper-0 1/1 Running 0 38m pulsarm-svztsn-zookeeper-1 1/1 Running 0 38m pulsarm-svztsn-zookeeper-2 1/1 Running 0 38m pod_info:pulsarm-svztsn-pulsar-broker-0 2/2 Terminating 0 39m No resources found in ns-yeajl namespace. delete cluster pod done No resources found in ns-yeajl namespace. check cluster resource non-exist OK: pvc No resources found in ns-yeajl namespace. delete cluster done No resources found in ns-yeajl namespace. No resources found in ns-yeajl namespace. No resources found in ns-yeajl namespace. delete cluster miniom-svztsn `kbcli cluster delete miniom-svztsn --auto-approve --namespace ns-yeajl ` Cluster miniom-svztsn deleted pod_info:miniom-svztsn-minio-0 1/1 Terminating 0 36m No resources found in ns-yeajl namespace. delete cluster pod done No resources found in ns-yeajl namespace. check cluster resource non-exist OK: pvc No resources found in ns-yeajl namespace. delete cluster done No resources found in ns-yeajl namespace. No resources found in ns-yeajl namespace. No resources found in ns-yeajl namespace. [PASSED]|[Create]|[ClusterDefinition=etcd;ClusterVersion=etcd-v3.5.6;]|[Description=Create a cluster with the specified cluster definition etcd and cluster version etcd-v3.5.6] [PASSED]|[Create]|[ClusterDefinition=pulsar;ClusterVersion=pulsar-2.11.2;]|[Description=Create a cluster with the specified cluster definition pulsar and cluster version pulsar-2.11.2] --------------------------------------Milvus (Topology = cluster Replicas 1) Test Result-------------------------------------- [PASSED]|[Create]|[ClusterDefinition=milvus;]|[Description=Create a cluster with the specified cluster definition milvus] [PASSED]|[Restart]|[ComponentName=querynode]|[Description=Restart the cluster specify component querynode] [PASSED]|[VerticalScaling]|[ComponentName=querynode]|[Description=VerticalScaling the cluster specify component querynode] [PASSED]|[Stop]|[-]|[Description=Stop the cluster] [PASSED]|[Start]|[-]|[Description=Start the cluster] [PASSED]|[VerticalScaling]|[ComponentName=datanode,mixcoord,proxy]|[Description=VerticalScaling the cluster specify component datanode,mixcoord,proxy] [PASSED]|[VerticalScaling]|[ComponentName=indexnode]|[Description=VerticalScaling the cluster specify component indexnode] [PASSED]|[Restart]|[-]|[Description=Restart the cluster] [PASSED]|[Update]|[TerminationPolicy=WipeOut]|[Description=Update the cluster TerminationPolicy WipeOut] [PASSED]|[Delete]|[-]|[Description=Delete the cluster] --------------------------------------Milvus (Topology = standalone Replicas 1) Test Result-------------------------------------- [PASSED]|[Create]|[ClusterDefinition=milvus;]|[Description=Create a cluster with the specified cluster definition milvus] [PASSED]|[VolumeExpansion]|[ComponentName=minio]|[Description=VolumeExpansion the cluster specify component minio] [PASSED]|[Stop]|[-]|[Description=Stop the cluster] [PASSED]|[Start]|[-]|[Description=Start the cluster] [PASSED]|[Restart]|[ComponentName=milvus]|[Description=Restart the cluster specify component milvus] [PASSED]|[Restart]|[-]|[Description=Restart the cluster] [PASSED]|[VerticalScaling]|[ComponentName=etcd]|[Description=VerticalScaling the cluster specify component etcd] [PASSED]|[VerticalScaling]|[ComponentName=minio]|[Description=VerticalScaling the cluster specify component minio] [PASSED]|[VerticalScaling]|[ComponentName=milvus]|[Description=VerticalScaling the cluster specify component milvus] [PASSED]|[VolumeExpansion]|[ComponentName=etcd]|[Description=VolumeExpansion the cluster specify component etcd] [PASSED]|[VolumeExpansion]|[ComponentName=milvus]|[Description=VolumeExpansion the cluster specify component milvus] [PASSED]|[Update]|[TerminationPolicy=WipeOut]|[Description=Update the cluster TerminationPolicy WipeOut] [PASSED]|[Delete]|[-]|[Description=Delete the cluster] [END]