bash test/kbcli/test_kbcli_0.9.sh --type 25 --version 0.9.5 --generate-output true --chaos-mesh true --drain-node true --random-namespace true --region eastus --cloud-provider aks CURRENT_TEST_DIR:test/kbcli source commons files source engines files source kubeblocks files `kubectl get namespace | grep ns-nvunr ` `kubectl create namespace ns-nvunr` namespace/ns-nvunr created create namespace ns-nvunr done download kbcli `gh release list --repo apecloud/kbcli --limit 100 | (grep "0.9" || true)` `curl -fsSL https://kubeblocks.io/installer/install_cli.sh | bash -s v0.9.5-beta.8` Your system is linux_amd64 Installing kbcli ... Downloading ... % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 32.1M 100 32.1M 0 0 126M 0 --:--:-- --:--:-- --:--:-- 126M kbcli installed successfully. Kubernetes: v1.32.6 KubeBlocks: 0.9.5 kbcli: 0.9.5-beta.8 WARNING: version difference between kbcli (0.9.5-beta.8) and kubeblocks (0.9.5) Make sure your docker service is running and begin your journey with kbcli: kbcli playground init For more information on how to get started, please visit: https://kubeblocks.io download kbcli v0.9.5-beta.8 done Kubernetes: v1.32.6 KubeBlocks: 0.9.5 kbcli: 0.9.5-beta.8 WARNING: version difference between kbcli (0.9.5-beta.8) and kubeblocks (0.9.5) Kubernetes Env: v1.32.6 POD_RESOURCES: aks kb-default-sc found aks default-vsc found found default storage class: default kubeblocks version is:0.9.5 skip upgrade kubeblocks Error: no repositories to show helm repo add chaos-mesh https://charts.chaos-mesh.org "chaos-mesh" has been added to your repositories add helm chart repo chaos-mesh success chaos mesh already installed check cluster definition set component name:elasticsearch set component version set component version:elasticsearch set service versions:7.10.1,7.7.1,7.8.1,8.1.3,8.15.5,8.8.2,8.9.1 set service versions sorted:7.7.1,7.8.1,7.10.1,8.1.3,8.8.2,8.9.1,8.15.5 no cluster version found set elasticsearch component definition set elasticsearch component definition elasticsearch-7 REPORT_COUNT 0:0 set replicas first:3,7.7.1|3,7.8.1|3,7.10.1|3,8.1.3|3,8.8.2|3,8.9.1|3,8.15.5 set replicas third:3,7.7.1 set replicas fourth:3,7.7.1 set minimum cmpv service version set minimum cmpv service version replicas:3,7.7.1 REPORT_COUNT:1 CLUSTER_TOPOLOGY:multi-node topology multi-node found in cluster definition elasticsearch LIMIT_CPU:0.5 LIMIT_MEMORY:2 storage size: 20 No resources found in ns-nvunr namespace. termination_policy:WipeOut create 3 replica WipeOut elasticsearch cluster check cluster definition check component definition set component definition by component version check cmpd by labels set component definition1: elasticsearch-7 by component version:elasticsearch apiVersion: apps.kubeblocks.io/v1alpha1 kind: Cluster metadata: name: elastics-twagzs namespace: ns-nvunr annotations: kubeblocks.io/extra-env: '***"mdit-roles":"master,data,ingest,transform","mode":"multi-node"***' spec: terminationPolicy: WipeOut componentSpecs: - name: mdit componentDef: elasticsearch-7 serviceAccountName: kb-elastics-twagzs monitor: true disableExporter: false podUpdatePolicy: Recreate replicas: 3 resources: requests: cpu: 500m memory: 2Gi limits: cpu: 500m memory: 2Gi volumeClaimTemplates: - name: data spec: storageClassName: accessModes: - ReadWriteOnce resources: requests: storage: 20Gi services: tls: false - name: kibana componentDef: kibana-7 serviceAccountName: kb-elastics-twagzs replicas: 1 podUpdatePolicy: Recreate disableExporter: false resources: requests: cpu: 500m memory: 2Gi limits: cpu: 500m memory: 2Gi services: tls: false `kubectl apply -f test_create_elastics-twagzs.yaml` cluster.apps.kubeblocks.io/elastics-twagzs created apply test_create_elastics-twagzs.yaml Success `rm -rf test_create_elastics-twagzs.yaml` check cluster status `kbcli cluster list elastics-twagzs --show-labels --namespace ns-nvunr ` NAME NAMESPACE CLUSTER-DEFINITION VERSION TERMINATION-POLICY STATUS CREATED-TIME LABELS elastics-twagzs ns-nvunr WipeOut Sep 01,2025 11:23 UTC+0800 cluster_status: cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Updating cluster_status:Updating check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances elastics-twagzs --namespace ns-nvunr ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME elastics-twagzs-kibana-0 ns-nvunr elastics-twagzs kibana Running 0 500m / 500m 2Gi / 2Gi aks-cicdamdpool-38368475-vmss000000/10.224.0.5 Sep 01,2025 11:23 UTC+0800 elastics-twagzs-mdit-0 ns-nvunr elastics-twagzs mdit Running 0 500m / 500m 2Gi / 2Gi data:20Gi aks-cicdamdpool-38368475-vmss000000/10.224.0.5 Sep 01,2025 11:23 UTC+0800 elastics-twagzs-mdit-1 ns-nvunr elastics-twagzs mdit Running 0 500m / 500m 2Gi / 2Gi data:20Gi aks-cicdamdpool-38368475-vmss000000/10.224.0.5 Sep 01,2025 11:23 UTC+0800 elastics-twagzs-mdit-2 ns-nvunr elastics-twagzs mdit Running 0 500m / 500m 2Gi / 2Gi data:20Gi aks-cicdamdpool-38368475-vmss000000/10.224.0.5 Sep 01,2025 11:23 UTC+0800 check pod status done No resources found in ns-nvunr namespace. check cluster connect `echo "curl http://elastics-twagzs-mdit-http.ns-nvunr.svc.cluster.local:9200/_cluster/health\?pretty " | kubectl exec -it elastics-twagzs-mdit-0 --namespace ns-nvunr -- sh` check cluster connect done `kubectl get secrets -l app.kubernetes.io/instance=elastics-twagzs` set secret: elastics-twagzs-mdit-account-elastic `kubectl get secrets elastics-twagzs-mdit-account-elastic -o jsonpath="***.data.username***"` `kubectl get secrets elastics-twagzs-mdit-account-elastic -o jsonpath="***.data.password***"` `kubectl get secrets elastics-twagzs-mdit-account-elastic -o jsonpath="***.data.port***"` DB_USERNAME:elastic;DB_PASSWORD:O56ffV183D;DB_PORT:9200;DB_DATABASE:elastic check pod elastics-twagzs-mdit-0 container_name elasticsearch exist password O56ffV183D check pod elastics-twagzs-mdit-0 container_name exporter exist password O56ffV183D check pod elastics-twagzs-mdit-0 container_name agent exist password O56ffV183D check pod elastics-twagzs-mdit-0 container_name lorry exist password O56ffV183D No container logs contain secret password. describe cluster `kbcli cluster describe elastics-twagzs --namespace ns-nvunr ` Name: elastics-twagzs Created Time: Sep 01,2025 11:23 UTC+0800 NAMESPACE CLUSTER-DEFINITION VERSION STATUS TERMINATION-POLICY ns-nvunr Running WipeOut Endpoints: COMPONENT MODE INTERNAL EXTERNAL mdit ReadWrite elastics-twagzs-mdit-agent.ns-nvunr.svc.cluster.local:8080 elastics-twagzs-mdit-http.ns-nvunr.svc.cluster.local:9200 kibana ReadWrite elastics-twagzs-kibana-http.ns-nvunr.svc.cluster.local:5601 Topology: COMPONENT INSTANCE ROLE STATUS AZ NODE CREATED-TIME kibana elastics-twagzs-kibana-0 Running 0 aks-cicdamdpool-38368475-vmss000000/10.224.0.5 Sep 01,2025 11:23 UTC+0800 mdit elastics-twagzs-mdit-0 Running 0 aks-cicdamdpool-38368475-vmss000000/10.224.0.5 Sep 01,2025 11:23 UTC+0800 mdit elastics-twagzs-mdit-1 Running 0 aks-cicdamdpool-38368475-vmss000000/10.224.0.5 Sep 01,2025 11:23 UTC+0800 mdit elastics-twagzs-mdit-2 Running 0 aks-cicdamdpool-38368475-vmss000000/10.224.0.5 Sep 01,2025 11:23 UTC+0800 Resources Allocation: COMPONENT DEDICATED CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE-SIZE STORAGE-CLASS mdit false 500m / 500m 2Gi / 2Gi data:20Gi default kibana false 500m / 500m 2Gi / 2Gi Images: COMPONENT TYPE IMAGE mdit docker.io/apecloud/elasticsearch:7.10.1 kibana docker.io/apecloud/kibana:7.10.1 Data Protection: BACKUP-REPO AUTO-BACKUP BACKUP-SCHEDULE BACKUP-METHOD BACKUP-RETENTION RECOVERABLE-TIME Show cluster events: kbcli cluster list-events -n ns-nvunr elastics-twagzs `kbcli cluster label elastics-twagzs app.kubernetes.io/instance- --namespace ns-nvunr ` label "app.kubernetes.io/instance" not found. `kbcli cluster label elastics-twagzs app.kubernetes.io/instance=elastics-twagzs --namespace ns-nvunr ` `kbcli cluster label elastics-twagzs --list --namespace ns-nvunr ` NAME NAMESPACE LABELS elastics-twagzs ns-nvunr app.kubernetes.io/instance=elastics-twagzs label cluster app.kubernetes.io/instance=elastics-twagzs Success `kbcli cluster label case.name=kbcli.test1 -l app.kubernetes.io/instance=elastics-twagzs --namespace ns-nvunr ` `kbcli cluster label elastics-twagzs --list --namespace ns-nvunr ` NAME NAMESPACE LABELS elastics-twagzs ns-nvunr app.kubernetes.io/instance=elastics-twagzs case.name=kbcli.test1 label cluster case.name=kbcli.test1 Success `kbcli cluster label elastics-twagzs case.name=kbcli.test2 --overwrite --namespace ns-nvunr ` `kbcli cluster label elastics-twagzs --list --namespace ns-nvunr ` NAME NAMESPACE LABELS elastics-twagzs ns-nvunr app.kubernetes.io/instance=elastics-twagzs case.name=kbcli.test2 label cluster case.name=kbcli.test2 Success `kbcli cluster label elastics-twagzs case.name- --namespace ns-nvunr ` `kbcli cluster label elastics-twagzs --list --namespace ns-nvunr ` NAME NAMESPACE LABELS elastics-twagzs ns-nvunr app.kubernetes.io/instance=elastics-twagzs delete cluster label case.name Success cluster connect No resources found in ns-nvunr namespace. `echo "curl http://elastics-twagzs-mdit-http.ns-nvunr.svc.cluster.local:9200/_cluster/health\?pretty " | kubectl exec -it elastics-twagzs-mdit-0 --namespace ns-nvunr -- sh ` Defaulted container "elasticsearch" out of: elasticsearch, exporter, agent, lorry, prepare-plugins (init), install-plugins (init), init-lorry (init) Unable to use a TTY - input is not a terminal or the right kind of file % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 469 100 469 0 0 58625 0 --:--:-- --:--:-- --:--:-- 58625 *** "cluster_name" : "elastics-twagzs", "status" : "green", "timed_out" : false, "number_of_nodes" : 3, "number_of_data_nodes" : 3, "active_primary_shards" : 6, "active_shards" : 12, "relocating_shards" : 0, "initializing_shards" : 0, "unassigned_shards" : 0, "delayed_unassigned_shards" : 0, "number_of_pending_tasks" : 0, "number_of_in_flight_fetch" : 0, "task_max_waiting_in_queue_millis" : 0, "active_shards_percent_as_number" : 100.0 *** connect cluster Success insert batch data by db client Error from server (NotFound): pods "test-db-client-executionloop-elastics-twagzs" not found DB_CLIENT_BATCH_DATA_COUNT: `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge pods test-db-client-executionloop-elastics-twagzs --namespace ns-nvunr ` Error from server (NotFound): pods "test-db-client-executionloop-elastics-twagzs" not found Warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely. Error from server (NotFound): pods "test-db-client-executionloop-elastics-twagzs" not found `kubectl get secrets -l app.kubernetes.io/instance=elastics-twagzs` set secret: elastics-twagzs-mdit-account-elastic `kubectl get secrets elastics-twagzs-mdit-account-elastic -o jsonpath="***.data.username***"` `kubectl get secrets elastics-twagzs-mdit-account-elastic -o jsonpath="***.data.password***"` `kubectl get secrets elastics-twagzs-mdit-account-elastic -o jsonpath="***.data.port***"` DB_USERNAME:elastic;DB_PASSWORD:O56ffV183D;DB_PORT:9200;DB_DATABASE:elastic No resources found in ns-nvunr namespace. apiVersion: v1 kind: Pod metadata: name: test-db-client-executionloop-elastics-twagzs namespace: ns-nvunr spec: containers: - name: test-dbclient imagePullPolicy: IfNotPresent image: docker.io/apecloud/dbclient:test args: - "--host" - "elastics-twagzs-mdit-http.ns-nvunr.svc.cluster.local" - "--user" - "elastic" - "--password" - "O56ffV183D" - "--port" - "9200" - "--dbtype" - "elasticsearch7" - "--test" - "executionloop" - "--duration" - "60" - "--interval" - "1" restartPolicy: Never `kubectl apply -f test-db-client-executionloop-elastics-twagzs.yaml` pod/test-db-client-executionloop-elastics-twagzs created apply test-db-client-executionloop-elastics-twagzs.yaml Success `rm -rf test-db-client-executionloop-elastics-twagzs.yaml` check pod status pod_status:NAME READY STATUS RESTARTS AGE test-db-client-executionloop-elastics-twagzs 1/1 Running 0 5s pod_status:NAME READY STATUS RESTARTS AGE test-db-client-executionloop-elastics-twagzs 1/1 Running 0 9s pod_status:NAME READY STATUS RESTARTS AGE test-db-client-executionloop-elastics-twagzs 1/1 Running 0 14s pod_status:NAME READY STATUS RESTARTS AGE test-db-client-executionloop-elastics-twagzs 1/1 Running 0 19s pod_status:NAME READY STATUS RESTARTS AGE test-db-client-executionloop-elastics-twagzs 1/1 Running 0 25s pod_status:NAME READY STATUS RESTARTS AGE test-db-client-executionloop-elastics-twagzs 1/1 Running 0 30s pod_status:NAME READY STATUS RESTARTS AGE test-db-client-executionloop-elastics-twagzs 1/1 Running 0 35s pod_status:NAME READY STATUS RESTARTS AGE test-db-client-executionloop-elastics-twagzs 1/1 Running 0 40s pod_status:NAME READY STATUS RESTARTS AGE test-db-client-executionloop-elastics-twagzs 1/1 Running 0 45s pod_status:NAME READY STATUS RESTARTS AGE test-db-client-executionloop-elastics-twagzs 1/1 Running 0 50s pod_status:NAME READY STATUS RESTARTS AGE test-db-client-executionloop-elastics-twagzs 1/1 Running 0 55s pod_status:NAME READY STATUS RESTARTS AGE test-db-client-executionloop-elastics-twagzs 1/1 Running 0 60s pod_status:NAME READY STATUS RESTARTS AGE test-db-client-executionloop-elastics-twagzs 1/1 Running 0 66s pod_status:NAME READY STATUS RESTARTS AGE test-db-client-executionloop-elastics-twagzs 1/1 Running 0 71s pod_status:NAME READY STATUS RESTARTS AGE test-db-client-executionloop-elastics-twagzs 1/1 Running 0 76s pod_status:NAME READY STATUS RESTARTS AGE test-db-client-executionloop-elastics-twagzs 1/1 Running 0 81s pod_status:NAME READY STATUS RESTARTS AGE test-db-client-executionloop-elastics-twagzs 1/1 Running 0 86s pod_status:NAME READY STATUS RESTARTS AGE test-db-client-executionloop-elastics-twagzs 1/1 Running 0 91s pod_status:NAME READY STATUS RESTARTS AGE test-db-client-executionloop-elastics-twagzs 1/1 Running 0 97s pod_status:NAME READY STATUS RESTARTS AGE test-db-client-executionloop-elastics-twagzs 1/1 Running 0 102s pod_status:NAME READY STATUS RESTARTS AGE test-db-client-executionloop-elastics-twagzs 1/1 Running 0 107s pod_status:NAME READY STATUS RESTARTS AGE test-db-client-executionloop-elastics-twagzs 1/1 Running 0 112s pod_status:NAME READY STATUS RESTARTS AGE test-db-client-executionloop-elastics-twagzs 1/1 Running 0 117s pod_status:NAME READY STATUS RESTARTS AGE test-db-client-executionloop-elastics-twagzs 1/1 Running 0 2m2s pod_status:NAME READY STATUS RESTARTS AGE test-db-client-executionloop-elastics-twagzs 1/1 Running 0 2m7s pod_status:NAME READY STATUS RESTARTS AGE test-db-client-executionloop-elastics-twagzs 1/1 Running 0 2m13s pod_status:NAME READY STATUS RESTARTS AGE test-db-client-executionloop-elastics-twagzs 1/1 Running 0 2m18s pod_status:NAME READY STATUS RESTARTS AGE test-db-client-executionloop-elastics-twagzs 1/1 Running 0 2m23s pod_status:NAME READY STATUS RESTARTS AGE test-db-client-executionloop-elastics-twagzs 1/1 Running 0 2m28s pod_status:NAME READY STATUS RESTARTS AGE test-db-client-executionloop-elastics-twagzs 1/1 Running 0 2m33s pod_status:NAME READY STATUS RESTARTS AGE test-db-client-executionloop-elastics-twagzs 1/1 Running 0 2m38s pod_status:NAME READY STATUS RESTARTS AGE test-db-client-executionloop-elastics-twagzs 1/1 Running 0 2m43s pod_status:NAME READY STATUS RESTARTS AGE test-db-client-executionloop-elastics-twagzs 1/1 Running 0 2m48s pod_status:NAME READY STATUS RESTARTS AGE test-db-client-executionloop-elastics-twagzs 1/1 Running 0 2m54s pod_status:NAME READY STATUS RESTARTS AGE test-db-client-executionloop-elastics-twagzs 1/1 Running 0 2m59s pod_status:NAME READY STATUS RESTARTS AGE test-db-client-executionloop-elastics-twagzs 1/1 Running 0 3m4s pod_status:NAME READY STATUS RESTARTS AGE test-db-client-executionloop-elastics-twagzs 1/1 Running 0 3m9s pod_status:NAME READY STATUS RESTARTS AGE test-db-client-executionloop-elastics-twagzs 1/1 Running 0 3m14s pod_status:NAME READY STATUS RESTARTS AGE test-db-client-executionloop-elastics-twagzs 1/1 Running 0 3m19s pod_status:NAME READY STATUS RESTARTS AGE test-db-client-executionloop-elastics-twagzs 1/1 Running 0 3m24s pod_status:NAME READY STATUS RESTARTS AGE test-db-client-executionloop-elastics-twagzs 1/1 Running 0 3m30s pod_status:NAME READY STATUS RESTARTS AGE test-db-client-executionloop-elastics-twagzs 1/1 Running 0 3m35s pod_status:NAME READY STATUS RESTARTS AGE test-db-client-executionloop-elastics-twagzs 1/1 Running 0 3m40s pod_status:NAME READY STATUS RESTARTS AGE test-db-client-executionloop-elastics-twagzs 1/1 Running 0 3m45s pod_status:NAME READY STATUS RESTARTS AGE test-db-client-executionloop-elastics-twagzs 1/1 Running 0 3m50s pod_status:NAME READY STATUS RESTARTS AGE test-db-client-executionloop-elastics-twagzs 1/1 Running 0 3m55s pod_status:NAME READY STATUS RESTARTS AGE test-db-client-executionloop-elastics-twagzs 1/1 Running 0 4m pod_status:NAME READY STATUS RESTARTS AGE test-db-client-executionloop-elastics-twagzs 1/1 Running 0 4m6s pod_status:NAME READY STATUS RESTARTS AGE test-db-client-executionloop-elastics-twagzs 1/1 Running 0 4m11s pod_status:NAME READY STATUS RESTARTS AGE test-db-client-executionloop-elastics-twagzs 1/1 Running 0 4m16s pod_status:NAME READY STATUS RESTARTS AGE test-db-client-executionloop-elastics-twagzs 1/1 Running 0 4m21s pod_status:NAME READY STATUS RESTARTS AGE test-db-client-executionloop-elastics-twagzs 1/1 Running 0 4m26s pod_status:NAME READY STATUS RESTARTS AGE test-db-client-executionloop-elastics-twagzs 1/1 Running 0 4m31s pod_status:NAME READY STATUS RESTARTS AGE test-db-client-executionloop-elastics-twagzs 1/1 Running 0 4m36s pod_status:NAME READY STATUS RESTARTS AGE test-db-client-executionloop-elastics-twagzs 1/1 Running 0 4m42s pod_status:NAME READY STATUS RESTARTS AGE test-db-client-executionloop-elastics-twagzs 1/1 Running 0 4m47s pod_status:NAME READY STATUS RESTARTS AGE test-db-client-executionloop-elastics-twagzs 1/1 Running 0 4m52s pod_status:NAME READY STATUS RESTARTS AGE test-db-client-executionloop-elastics-twagzs 1/1 Running 0 4m57s pod_status:NAME READY STATUS RESTARTS AGE test-db-client-executionloop-elastics-twagzs 1/1 Running 0 5m2s pod_status:NAME READY STATUS RESTARTS AGE test-db-client-executionloop-elastics-twagzs 1/1 Running 0 5m7s pod_status:NAME READY STATUS RESTARTS AGE test-db-client-executionloop-elastics-twagzs 1/1 Running 0 5m12s check pod test-db-client-executionloop-elastics-twagzs status timeout --------------------------------------get pod test-db-client-executionloop-elastics-twagzs yaml-------------------------------------- `kubectl get pod test-db-client-executionloop-elastics-twagzs -o yaml --namespace ns-nvunr ` apiVersion: v1 kind: Pod metadata: annotations: kubectl.kubernetes.io/last-applied-configuration: | ***"apiVersion":"v1","kind":"Pod","metadata":***"annotations":***,"name":"test-db-client-executionloop-elastics-twagzs","namespace":"ns-nvunr"***,"spec":***"containers":[***"args":["--host","elastics-twagzs-mdit-http.ns-nvunr.svc.cluster.local","--user","elastic","--password","O56ffV183D","--port","9200","--dbtype","elasticsearch7","--test","executionloop","--duration","60","--interval","1"],"image":"docker.io/apecloud/dbclient:test","imagePullPolicy":"IfNotPresent","name":"test-dbclient"***],"restartPolicy":"Never"*** creationTimestamp: "2025-09-01T03:29:46Z" name: test-db-client-executionloop-elastics-twagzs namespace: ns-nvunr resourceVersion: "22781" uid: 6ca99922-6db1-4ae4-8fa3-7440fd70f96d spec: containers: - args: - --host - elastics-twagzs-mdit-http.ns-nvunr.svc.cluster.local - --user - elastic - --password - O56ffV183D - --port - "9200" - --dbtype - elasticsearch7 - --test - executionloop - --duration - "60" - --interval - "1" image: docker.io/apecloud/dbclient:test imagePullPolicy: IfNotPresent name: test-dbclient resources: *** terminationMessagePath: /dev/termination-log terminationMessagePolicy: File volumeMounts: - mountPath: /var/run/secrets/kubernetes.io/serviceaccount name: kube-api-access-qmsd5 readOnly: true dnsPolicy: ClusterFirst enableServiceLinks: true nodeName: aks-cicdamdpool-38368475-vmss000006 preemptionPolicy: PreemptLowerPriority priority: 0 restartPolicy: Never schedulerName: default-scheduler securityContext: *** serviceAccount: default serviceAccountName: default terminationGracePeriodSeconds: 30 tolerations: - effect: NoExecute key: node.kubernetes.io/not-ready operator: Exists tolerationSeconds: 300 - effect: NoExecute key: node.kubernetes.io/unreachable operator: Exists tolerationSeconds: 300 volumes: - name: kube-api-access-qmsd5 projected: defaultMode: 420 sources: - serviceAccountToken: expirationSeconds: 3607 path: token - configMap: items: - key: ca.crt path: ca.crt name: kube-root-ca.crt - downwardAPI: items: - fieldRef: apiVersion: v1 fieldPath: metadata.namespace path: namespace status: conditions: - lastProbeTime: null lastTransitionTime: "2025-09-01T03:29:48Z" status: "True" type: PodReadyToStartContainers - lastProbeTime: null lastTransitionTime: "2025-09-01T03:29:46Z" status: "True" type: Initialized - lastProbeTime: null lastTransitionTime: "2025-09-01T03:29:48Z" status: "True" type: Ready - lastProbeTime: null lastTransitionTime: "2025-09-01T03:29:48Z" status: "True" type: ContainersReady - lastProbeTime: null lastTransitionTime: "2025-09-01T03:29:46Z" status: "True" type: PodScheduled containerStatuses: - containerID: containerd://4aaa1abf2e3f5ca486e649fc26749e575eda2e7d751f2e32b2aa7e5a1a6ccfeb image: docker.io/apecloud/dbclient:test imageID: docker.io/apecloud/dbclient@sha256:6d32d449788e773a6752c7d724e94a02514804c479bdb5947621426175339bd0 lastState: *** name: test-dbclient ready: true restartCount: 0 started: true state: running: startedAt: "2025-09-01T03:29:47Z" volumeMounts: - mountPath: /var/run/secrets/kubernetes.io/serviceaccount name: kube-api-access-qmsd5 readOnly: true recursiveReadOnly: Disabled hostIP: 10.224.0.10 hostIPs: - ip: 10.224.0.10 phase: Running podIP: 10.244.1.86 podIPs: - ip: 10.244.1.86 qosClass: BestEffort startTime: "2025-09-01T03:29:46Z" ------------------------------------------------------------------------------------------------------------------ --------------------------------------describe pod test-db-client-executionloop-elastics-twagzs-------------------------------------- `kubectl describe pod test-db-client-executionloop-elastics-twagzs --namespace ns-nvunr ` Name: test-db-client-executionloop-elastics-twagzs Namespace: ns-nvunr Priority: 0 Service Account: default Node: aks-cicdamdpool-38368475-vmss000006/10.224.0.10 Start Time: Mon, 01 Sep 2025 11:29:46 +0800 Labels: Annotations: Status: Running IP: 10.244.1.86 IPs: IP: 10.244.1.86 Containers: test-dbclient: Container ID: containerd://4aaa1abf2e3f5ca486e649fc26749e575eda2e7d751f2e32b2aa7e5a1a6ccfeb Image: docker.io/apecloud/dbclient:test Image ID: docker.io/apecloud/dbclient@sha256:6d32d449788e773a6752c7d724e94a02514804c479bdb5947621426175339bd0 Port: Host Port: Args: --host elastics-twagzs-mdit-http.ns-nvunr.svc.cluster.local --user elastic --password O56ffV183D --port 9200 --dbtype elasticsearch7 --test executionloop --duration 60 --interval 1 State: Running Started: Mon, 01 Sep 2025 11:29:47 +0800 Ready: True Restart Count: 0 Environment: Mounts: /var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-qmsd5 (ro) Conditions: Type Status PodReadyToStartContainers True Initialized True Ready True ContainersReady True PodScheduled True Volumes: kube-api-access-qmsd5: Type: Projected (a volume that contains injected data from multiple sources) TokenExpirationSeconds: 3607 ConfigMapName: kube-root-ca.crt ConfigMapOptional: DownwardAPI: true QoS Class: BestEffort Node-Selectors: Tolerations: node.kubernetes.io/not-ready:NoExecute op=Exists for 300s node.kubernetes.io/unreachable:NoExecute op=Exists for 300s Events: Type Reason Age From Message ---- ------ ---- ---- ------- Normal Scheduled 5m13s default-scheduler Successfully assigned ns-nvunr/test-db-client-executionloop-elastics-twagzs to aks-cicdamdpool-38368475-vmss000006 Normal Pulled 5m13s kubelet Container image "docker.io/apecloud/dbclient:test" already present on machine Normal Created 5m13s kubelet Created container: test-dbclient Normal Started 5m13s kubelet Started container test-dbclient ------------------------------------------------------------------------------------------------------------------ --------------------------------------pod test-db-client-executionloop-elastics-twagzs-------------------------------------- `kubectl logs test-db-client-executionloop-elastics-twagzs --namespace ns-nvunr --tail 500` --host elastics-twagzs-mdit-http.ns-nvunr.svc.cluster.local --user elastic --password O56ffV183D --port 9200 --dbtype elasticsearch7 --test executionloop --duration 60 --interval 1 SLF4J(I): Connected with provider of type [ch.qos.logback.classic.spi.LogbackServiceProvider] Execution loop start: Index executions_loop_index already exists. Delete index executions_loop_index Execution loop failed: method [DELETE], host [http://elastics-twagzs-mdit-http.ns-nvunr.svc.cluster.local:9200], URI [/executions_loop_index], status line [HTTP/1.1 404 Not Found] ***"error":***"root_cause":[***"type":"index_not_found_exception","reason":"no such index [executions_loop_index]","index_uuid":"_na_","resource.type":"index_or_alias","resource.id":"executions_loop_index","index":"executions_loop_index"***],"type":"index_not_found_exception","reason":"no such index [executions_loop_index]","index_uuid":"_na_","resource.type":"index_or_alias","resource.id":"executions_loop_index","index":"executions_loop_index"***,"status":404*** [2025-09-01 03:29:48.892] Connection error occurred! Index executions_loop_index already exists. Delete index executions_loop_index Execution loop failed: method [DELETE], host [http://elastics-twagzs-mdit-http.ns-nvunr.svc.cluster.local:9200], URI [/executions_loop_index], status line [HTTP/1.1 404 Not Found] ***"error":***"root_cause":[***"type":"index_not_found_exception","reason":"no such index [executions_loop_index]","index_uuid":"_na_","resource.type":"index_or_alias","resource.id":"executions_loop_index","index":"executions_loop_index"***],"type":"index_not_found_exception","reason":"no such index [executions_loop_index]","index_uuid":"_na_","resource.type":"index_or_alias","resource.id":"executions_loop_index","index":"executions_loop_index"***,"status":404*** [ 1s ] executions total: 2 successful: 0 failed: 2 disconnect: 1 Index executions_loop_index already exists. Delete index executions_loop_index Execution loop failed: method [DELETE], host [http://elastics-twagzs-mdit-http.ns-nvunr.svc.cluster.local:9200], URI [/executions_loop_index], status line [HTTP/1.1 404 Not Found] ***"error":***"root_cause":[***"type":"index_not_found_exception","reason":"no such index [executions_loop_index]","index_uuid":"_na_","resource.type":"index_or_alias","resource.id":"executions_loop_index","index":"executions_loop_index"***],"type":"index_not_found_exception","reason":"no such index [executions_loop_index]","index_uuid":"_na_","resource.type":"index_or_alias","resource.id":"executions_loop_index","index":"executions_loop_index"***,"status":404*** [ 2s ] executions total: 3 successful: 0 failed: 3 disconnect: 1 Index executions_loop_index already exists. Delete index executions_loop_index Execution loop failed: method [DELETE], host [http://elastics-twagzs-mdit-http.ns-nvunr.svc.cluster.local:9200], URI [/executions_loop_index], status line [HTTP/1.1 404 Not Found] ***"error":***"root_cause":[***"type":"index_not_found_exception","reason":"no such index [executions_loop_index]","index_uuid":"_na_","resource.type":"index_or_alias","resource.id":"executions_loop_index","index":"executions_loop_index"***],"type":"index_not_found_exception","reason":"no such index [executions_loop_index]","index_uuid":"_na_","resource.type":"index_or_alias","resource.id":"executions_loop_index","index":"executions_loop_index"***,"status":404*** [ 3s ] executions total: 4 successful: 0 failed: 4 disconnect: 1 Index executions_loop_index already exists. Delete index executions_loop_index Execution loop failed: method [DELETE], host [http://elastics-twagzs-mdit-http.ns-nvunr.svc.cluster.local:9200], URI [/executions_loop_index], status line [HTTP/1.1 404 Not Found] ***"error":***"root_cause":[***"type":"index_not_found_exception","reason":"no such index [executions_loop_index]","index_uuid":"_na_","resource.type":"index_or_alias","resource.id":"executions_loop_index","index":"executions_loop_index"***],"type":"index_not_found_exception","reason":"no such index [executions_loop_index]","index_uuid":"_na_","resource.type":"index_or_alias","resource.id":"executions_loop_index","index":"executions_loop_index"***,"status":404*** [ 4s ] executions total: 5 successful: 0 failed: 5 disconnect: 1 Index executions_loop_index already exists. Delete index executions_loop_index Execution loop failed: method [DELETE], host [http://elastics-twagzs-mdit-http.ns-nvunr.svc.cluster.local:9200], URI [/executions_loop_index], status line [HTTP/1.1 404 Not Found] ***"error":***"root_cause":[***"type":"index_not_found_exception","reason":"no such index [executions_loop_index]","index_uuid":"_na_","resource.type":"index_or_alias","resource.id":"executions_loop_index","index":"executions_loop_index"***],"type":"index_not_found_exception","reason":"no such index [executions_loop_index]","index_uuid":"_na_","resource.type":"index_or_alias","resource.id":"executions_loop_index","index":"executions_loop_index"***,"status":404*** [ 5s ] executions total: 6 successful: 0 failed: 6 disconnect: 1 Index executions_loop_index already exists. Delete index executions_loop_index Execution loop failed: method [DELETE], host [http://elastics-twagzs-mdit-http.ns-nvunr.svc.cluster.local:9200], URI [/executions_loop_index], status line [HTTP/1.1 404 Not Found] ***"error":***"root_cause":[***"type":"index_not_found_exception","reason":"no such index [executions_loop_index]","index_uuid":"_na_","resource.type":"index_or_alias","resource.id":"executions_loop_index","index":"executions_loop_index"***],"type":"index_not_found_exception","reason":"no such index [executions_loop_index]","index_uuid":"_na_","resource.type":"index_or_alias","resource.id":"executions_loop_index","index":"executions_loop_index"***,"status":404*** [ 6s ] executions total: 7 successful: 0 failed: 7 disconnect: 1 Index executions_loop_index already exists. Delete index executions_loop_index Execution loop failed: method [DELETE], host [http://elastics-twagzs-mdit-http.ns-nvunr.svc.cluster.local:9200], URI [/executions_loop_index], status line [HTTP/1.1 404 Not Found] ***"error":***"root_cause":[***"type":"index_not_found_exception","reason":"no such index [executions_loop_index]","resource.type":"index_or_alias","resource.id":"executions_loop_index","index_uuid":"_na_","index":"executions_loop_index"***],"type":"index_not_found_exception","reason":"no such index [executions_loop_index]","resource.type":"index_or_alias","resource.id":"executions_loop_index","index_uuid":"_na_","index":"executions_loop_index"***,"status":404*** [ 7s ] executions total: 8 successful: 0 failed: 8 disconnect: 1 Index executions_loop_index already exists. Delete index executions_loop_index Execution loop failed: method [DELETE], host [http://elastics-twagzs-mdit-http.ns-nvunr.svc.cluster.local:9200], URI [/executions_loop_index], status line [HTTP/1.1 404 Not Found] ***"error":***"root_cause":[***"type":"index_not_found_exception","reason":"no such index [executions_loop_index]","resource.type":"index_or_alias","resource.id":"executions_loop_index","index_uuid":"_na_","index":"executions_loop_index"***],"type":"index_not_found_exception","reason":"no such index [executions_loop_index]","resource.type":"index_or_alias","resource.id":"executions_loop_index","index_uuid":"_na_","index":"executions_loop_index"***,"status":404*** [ 8s ] executions total: 9 successful: 0 failed: 9 disconnect: 1 Index executions_loop_index already exists. Delete index executions_loop_index Execution loop failed: method [DELETE], host [http://elastics-twagzs-mdit-http.ns-nvunr.svc.cluster.local:9200], URI [/executions_loop_index], status line [HTTP/1.1 404 Not Found] ***"error":***"root_cause":[***"type":"index_not_found_exception","reason":"no such index [executions_loop_index]","resource.type":"index_or_alias","resource.id":"executions_loop_index","index_uuid":"_na_","index":"executions_loop_index"***],"type":"index_not_found_exception","reason":"no such index [executions_loop_index]","resource.type":"index_or_alias","resource.id":"executions_loop_index","index_uuid":"_na_","index":"executions_loop_index"***,"status":404*** [ 9s ] executions total: 10 successful: 0 failed: 10 disconnect: 1 Index executions_loop_index already exists. Delete index executions_loop_index Execution loop failed: method [DELETE], host [http://elastics-twagzs-mdit-http.ns-nvunr.svc.cluster.local:9200], URI [/executions_loop_index], status line [HTTP/1.1 404 Not Found] ***"error":***"root_cause":[***"type":"index_not_found_exception","reason":"no such index [executions_loop_index]","index_uuid":"_na_","resource.type":"index_or_alias","resource.id":"executions_loop_index","index":"executions_loop_index"***],"type":"index_not_found_exception","reason":"no such index [executions_loop_index]","index_uuid":"_na_","resource.type":"index_or_alias","resource.id":"executions_loop_index","index":"executions_loop_index"***,"status":404*** [ 10s ] executions total: 11 successful: 0 failed: 11 disconnect: 1 Index executions_loop_index already exists. Delete index executions_loop_index Execution loop failed: method [DELETE], host [http://elastics-twagzs-mdit-http.ns-nvunr.svc.cluster.local:9200], URI [/executions_loop_index], status line [HTTP/1.1 404 Not Found] ***"error":***"root_cause":[***"type":"index_not_found_exception","reason":"no such index [executions_loop_index]","index_uuid":"_na_","resource.type":"index_or_alias","resource.id":"executions_loop_index","index":"executions_loop_index"***],"type":"index_not_found_exception","reason":"no such index [executions_loop_index]","index_uuid":"_na_","resource.type":"index_or_alias","resource.id":"executions_loop_index","index":"executions_loop_index"***,"status":404*** [ 11s ] executions total: 12 successful: 0 failed: 12 disconnect: 1 Index executions_loop_index already exists. Delete index executions_loop_index Execution loop failed: method [DELETE], host [http://elastics-twagzs-mdit-http.ns-nvunr.svc.cluster.local:9200], URI [/executions_loop_index], status line [HTTP/1.1 404 Not Found] ***"error":***"root_cause":[***"type":"index_not_found_exception","reason":"no such index [executions_loop_index]","index_uuid":"_na_","resource.type":"index_or_alias","resource.id":"executions_loop_index","index":"executions_loop_index"***],"type":"index_not_found_exception","reason":"no such index [executions_loop_index]","index_uuid":"_na_","resource.type":"index_or_alias","resource.id":"executions_loop_index","index":"executions_loop_index"***,"status":404*** [ 12s ] executions total: 13 successful: 0 failed: 13 disconnect: 1 Index executions_loop_index already exists. Delete index executions_loop_index Execution loop failed: method [DELETE], host [http://elastics-twagzs-mdit-http.ns-nvunr.svc.cluster.local:9200], URI [/executions_loop_index], status line [HTTP/1.1 404 Not Found] ***"error":***"root_cause":[***"type":"index_not_found_exception","reason":"no such index [executions_loop_index]","index_uuid":"_na_","resource.type":"index_or_alias","resource.id":"executions_loop_index","index":"executions_loop_index"***],"type":"index_not_found_exception","reason":"no such index [executions_loop_index]","index_uuid":"_na_","resource.type":"index_or_alias","resource.id":"executions_loop_index","index":"executions_loop_index"***,"status":404*** [ 13s ] executions total: 14 successful: 0 failed: 14 disconnect: 1 Index executions_loop_index already exists. Delete index executions_loop_index Execution loop failed: method [DELETE], host [http://elastics-twagzs-mdit-http.ns-nvunr.svc.cluster.local:9200], URI [/executions_loop_index], status line [HTTP/1.1 404 Not Found] ***"error":***"root_cause":[***"type":"index_not_found_exception","reason":"no such index [executions_loop_index]","resource.type":"index_or_alias","resource.id":"executions_loop_index","index_uuid":"_na_","index":"executions_loop_index"***],"type":"index_not_found_exception","reason":"no such index [executions_loop_index]","resource.type":"index_or_alias","resource.id":"executions_loop_index","index_uuid":"_na_","index":"executions_loop_index"***,"status":404*** [ 14s ] executions total: 15 successful: 0 failed: 15 disconnect: 1 Index executions_loop_index already exists. Delete index executions_loop_index Execution loop failed: method [DELETE], host [http://elastics-twagzs-mdit-http.ns-nvunr.svc.cluster.local:9200], URI [/executions_loop_index], status line [HTTP/1.1 404 Not Found] ***"error":***"root_cause":[***"type":"index_not_found_exception","reason":"no such index [executions_loop_index]","resource.type":"index_or_alias","resource.id":"executions_loop_index","index_uuid":"_na_","index":"executions_loop_index"***],"type":"index_not_found_exception","reason":"no such index [executions_loop_index]","resource.type":"index_or_alias","resource.id":"executions_loop_index","index_uuid":"_na_","index":"executions_loop_index"***,"status":404*** [ 15s ] executions total: 16 successful: 0 failed: 16 disconnect: 1 Index executions_loop_index already exists. Delete index executions_loop_index Execution loop failed: method [DELETE], host [http://elastics-twagzs-mdit-http.ns-nvunr.svc.cluster.local:9200], URI [/executions_loop_index], status line [HTTP/1.1 404 Not Found] ***"error":***"root_cause":[***"type":"index_not_found_exception","reason":"no such index [executions_loop_index]","index_uuid":"_na_","resource.type":"index_or_alias","resource.id":"executions_loop_index","index":"executions_loop_index"***],"type":"index_not_found_exception","reason":"no such index [executions_loop_index]","index_uuid":"_na_","resource.type":"index_or_alias","resource.id":"executions_loop_index","index":"executions_loop_index"***,"status":404*** [ 16s ] executions total: 17 successful: 0 failed: 17 disconnect: 1 Index executions_loop_index already exists. Delete index executions_loop_index Execution loop failed: method [DELETE], host [http://elastics-twagzs-mdit-http.ns-nvunr.svc.cluster.local:9200], URI [/executions_loop_index], status line [HTTP/1.1 404 Not Found] ***"error":***"root_cause":[***"type":"index_not_found_exception","reason":"no such index [executions_loop_index]","index_uuid":"_na_","resource.type":"index_or_alias","resource.id":"executions_loop_index","index":"executions_loop_index"***],"type":"index_not_found_exception","reason":"no such index [executions_loop_index]","index_uuid":"_na_","resource.type":"index_or_alias","resource.id":"executions_loop_index","index":"executions_loop_index"***,"status":404*** [ 17s ] executions total: 18 successful: 0 failed: 18 disconnect: 1 Index executions_loop_index already exists. Delete index executions_loop_index Execution loop failed: method [DELETE], host [http://elastics-twagzs-mdit-http.ns-nvunr.svc.cluster.local:9200], URI [/executions_loop_index], status line [HTTP/1.1 404 Not Found] ***"error":***"root_cause":[***"type":"index_not_found_exception","reason":"no such index [executions_loop_index]","index_uuid":"_na_","resource.type":"index_or_alias","resource.id":"executions_loop_index","index":"executions_loop_index"***],"type":"index_not_found_exception","reason":"no such index [executions_loop_index]","index_uuid":"_na_","resource.type":"index_or_alias","resource.id":"executions_loop_index","index":"executions_loop_index"***,"status":404*** [ 18s ] executions total: 19 successful: 0 failed: 19 disconnect: 1 Index executions_loop_index already exists. Delete index executions_loop_index Execution loop failed: method [DELETE], host [http://elastics-twagzs-mdit-http.ns-nvunr.svc.cluster.local:9200], URI [/executions_loop_index], status line [HTTP/1.1 404 Not Found] ***"error":***"root_cause":[***"type":"index_not_found_exception","reason":"no such index [executions_loop_index]","resource.type":"index_or_alias","resource.id":"executions_loop_index","index_uuid":"_na_","index":"executions_loop_index"***],"type":"index_not_found_exception","reason":"no such index [executions_loop_index]","resource.type":"index_or_alias","resource.id":"executions_loop_index","index_uuid":"_na_","index":"executions_loop_index"***,"status":404*** [ 19s ] executions total: 20 successful: 0 failed: 20 disconnect: 1 Index executions_loop_index already exists. Delete index executions_loop_index Execution loop failed: method [DELETE], host [http://elastics-twagzs-mdit-http.ns-nvunr.svc.cluster.local:9200], URI [/executions_loop_index], status line [HTTP/1.1 404 Not Found] ***"error":***"root_cause":[***"type":"index_not_found_exception","reason":"no such index [executions_loop_index]","resource.type":"index_or_alias","resource.id":"executions_loop_index","index_uuid":"_na_","index":"executions_loop_index"***],"type":"index_not_found_exception","reason":"no such index [executions_loop_index]","resource.type":"index_or_alias","resource.id":"executions_loop_index","index_uuid":"_na_","index":"executions_loop_index"***,"status":404*** [ 20s ] executions total: 21 successful: 0 failed: 21 disconnect: 1 Index executions_loop_index already exists. Delete index executions_loop_index Execution loop failed: method [DELETE], host [http://elastics-twagzs-mdit-http.ns-nvunr.svc.cluster.local:9200], URI [/executions_loop_index], status line [HTTP/1.1 404 Not Found] ***"error":***"root_cause":[***"type":"index_not_found_exception","reason":"no such index [executions_loop_index]","index_uuid":"_na_","resource.type":"index_or_alias","resource.id":"executions_loop_index","index":"executions_loop_index"***],"type":"index_not_found_exception","reason":"no such index [executions_loop_index]","index_uuid":"_na_","resource.type":"index_or_alias","resource.id":"executions_loop_index","index":"executions_loop_index"***,"status":404*** [ 21s ] executions total: 22 successful: 0 failed: 22 disconnect: 1 Index executions_loop_index already exists. Delete index executions_loop_index Execution loop failed: method [DELETE], host [http://elastics-twagzs-mdit-http.ns-nvunr.svc.cluster.local:9200], URI [/executions_loop_index], status line [HTTP/1.1 404 Not Found] ***"error":***"root_cause":[***"type":"index_not_found_exception","reason":"no such index [executions_loop_index]","resource.type":"index_or_alias","resource.id":"executions_loop_index","index_uuid":"_na_","index":"executions_loop_index"***],"type":"index_not_found_exception","reason":"no such index [executions_loop_index]","resource.type":"index_or_alias","resource.id":"executions_loop_index","index_uuid":"_na_","index":"executions_loop_index"***,"status":404*** [ 22s ] executions total: 23 successful: 0 failed: 23 disconnect: 1 Index executions_loop_index already exists. Delete index executions_loop_index Execution loop failed: method [DELETE], host [http://elastics-twagzs-mdit-http.ns-nvunr.svc.cluster.local:9200], URI [/executions_loop_index], status line [HTTP/1.1 404 Not Found] ***"error":***"root_cause":[***"type":"index_not_found_exception","reason":"no such index [executions_loop_index]","resource.type":"index_or_alias","resource.id":"executions_loop_index","index_uuid":"_na_","index":"executions_loop_index"***],"type":"index_not_found_exception","reason":"no such index [executions_loop_index]","resource.type":"index_or_alias","resource.id":"executions_loop_index","index_uuid":"_na_","index":"executions_loop_index"***,"status":404*** [ 23s ] executions total: 24 successful: 0 failed: 24 disconnect: 1 Index executions_loop_index already exists. Delete index executions_loop_index Execution loop failed: method [DELETE], host [http://elastics-twagzs-mdit-http.ns-nvunr.svc.cluster.local:9200], URI [/executions_loop_index], status line [HTTP/1.1 404 Not Found] ***"error":***"root_cause":[***"type":"index_not_found_exception","reason":"no such index [executions_loop_index]","resource.type":"index_or_alias","resource.id":"executions_loop_index","index_uuid":"_na_","index":"executions_loop_index"***],"type":"index_not_found_exception","reason":"no such index [executions_loop_index]","resource.type":"index_or_alias","resource.id":"executions_loop_index","index_uuid":"_na_","index":"executions_loop_index"***,"status":404*** [ 24s ] executions total: 25 successful: 0 failed: 25 disconnect: 1 Index executions_loop_index already exists. Delete index executions_loop_index Execution loop failed: method [DELETE], host [http://elastics-twagzs-mdit-http.ns-nvunr.svc.cluster.local:9200], URI [/executions_loop_index], status line [HTTP/1.1 404 Not Found] ***"error":***"root_cause":[***"type":"index_not_found_exception","reason":"no such index [executions_loop_index]","index_uuid":"_na_","resource.type":"index_or_alias","resource.id":"executions_loop_index","index":"executions_loop_index"***],"type":"index_not_found_exception","reason":"no such index [executions_loop_index]","index_uuid":"_na_","resource.type":"index_or_alias","resource.id":"executions_loop_index","index":"executions_loop_index"***,"status":404*** [ 25s ] executions total: 26 successful: 0 failed: 26 disconnect: 1 Index executions_loop_index already exists. Delete index executions_loop_index Execution loop failed: method [DELETE], host [http://elastics-twagzs-mdit-http.ns-nvunr.svc.cluster.local:9200], URI [/executions_loop_index], status line [HTTP/1.1 404 Not Found] ***"error":***"root_cause":[***"type":"index_not_found_exception","reason":"no such index [executions_loop_index]","index_uuid":"_na_","resource.type":"index_or_alias","resource.id":"executions_loop_index","index":"executions_loop_index"***],"type":"index_not_found_exception","reason":"no such index [executions_loop_index]","index_uuid":"_na_","resource.type":"index_or_alias","resource.id":"executions_loop_index","index":"executions_loop_index"***,"status":404*** [ 26s ] executions total: 27 successful: 0 failed: 27 disconnect: 1 Index executions_loop_index already exists. Delete index executions_loop_index Execution loop failed: method [DELETE], host [http://elastics-twagzs-mdit-http.ns-nvunr.svc.cluster.local:9200], URI [/executions_loop_index], status line [HTTP/1.1 404 Not Found] ***"error":***"root_cause":[***"type":"index_not_found_exception","reason":"no such index [executions_loop_index]","resource.type":"index_or_alias","resource.id":"executions_loop_index","index_uuid":"_na_","index":"executions_loop_index"***],"type":"index_not_found_exception","reason":"no such index [executions_loop_index]","resource.type":"index_or_alias","resource.id":"executions_loop_index","index_uuid":"_na_","index":"executions_loop_index"***,"status":404*** [ 27s ] executions total: 28 successful: 0 failed: 28 disconnect: 1 Index executions_loop_index already exists. Delete index executions_loop_index Execution loop failed: method [DELETE], host [http://elastics-twagzs-mdit-http.ns-nvunr.svc.cluster.local:9200], URI [/executions_loop_index], status line [HTTP/1.1 404 Not Found] ***"error":***"root_cause":[***"type":"index_not_found_exception","reason":"no such index [executions_loop_index]","index_uuid":"_na_","resource.type":"index_or_alias","resource.id":"executions_loop_index","index":"executions_loop_index"***],"type":"index_not_found_exception","reason":"no such index [executions_loop_index]","index_uuid":"_na_","resource.type":"index_or_alias","resource.id":"executions_loop_index","index":"executions_loop_index"***,"status":404*** [ 28s ] executions total: 29 successful: 0 failed: 29 disconnect: 1 Index executions_loop_index already exists. Delete index executions_loop_index Execution loop failed: method [DELETE], host [http://elastics-twagzs-mdit-http.ns-nvunr.svc.cluster.local:9200], URI [/executions_loop_index], status line [HTTP/1.1 404 Not Found] ***"error":***"root_cause":[***"type":"index_not_found_exception","reason":"no such index [executions_loop_index]","index_uuid":"_na_","resource.type":"index_or_alias","resource.id":"executions_loop_index","index":"executions_loop_index"***],"type":"index_not_found_exception","reason":"no such index [executions_loop_index]","index_uuid":"_na_","resource.type":"index_or_alias","resource.id":"executions_loop_index","index":"executions_loop_index"***,"status":404*** [ 29s ] executions total: 30 successful: 0 failed: 30 disconnect: 1 Index executions_loop_index already exists. Delete index executions_loop_index Execution loop failed: method [DELETE], host [http://elastics-twagzs-mdit-http.ns-nvunr.svc.cluster.local:9200], URI [/executions_loop_index], status line [HTTP/1.1 404 Not Found] ***"error":***"root_cause":[***"type":"index_not_found_exception","reason":"no such index [executions_loop_index]","index_uuid":"_na_","resource.type":"index_or_alias","resource.id":"executions_loop_index","index":"executions_loop_index"***],"type":"index_not_found_exception","reason":"no such index [executions_loop_index]","index_uuid":"_na_","resource.type":"index_or_alias","resource.id":"executions_loop_index","index":"executions_loop_index"***,"status":404*** [ 30s ] executions total: 31 successful: 0 failed: 31 disconnect: 1 Index executions_loop_index already exists. Delete index executions_loop_index Execution loop failed: method [DELETE], host [http://elastics-twagzs-mdit-http.ns-nvunr.svc.cluster.local:9200], URI [/executions_loop_index], status line [HTTP/1.1 404 Not Found] ***"error":***"root_cause":[***"type":"index_not_found_exception","reason":"no such index [executions_loop_index]","index_uuid":"_na_","resource.type":"index_or_alias","resource.id":"executions_loop_index","index":"executions_loop_index"***],"type":"index_not_found_exception","reason":"no such index [executions_loop_index]","index_uuid":"_na_","resource.type":"index_or_alias","resource.id":"executions_loop_index","index":"executions_loop_index"***,"status":404*** [ 31s ] executions total: 32 successful: 0 failed: 32 disconnect: 1 Index executions_loop_index already exists. Delete index executions_loop_index Execution loop failed: method [DELETE], host [http://elastics-twagzs-mdit-http.ns-nvunr.svc.cluster.local:9200], URI [/executions_loop_index], status line [HTTP/1.1 404 Not Found] ***"error":***"root_cause":[***"type":"index_not_found_exception","reason":"no such index [executions_loop_index]","resource.type":"index_or_alias","resource.id":"executions_loop_index","index_uuid":"_na_","index":"executions_loop_index"***],"type":"index_not_found_exception","reason":"no such index [executions_loop_index]","resource.type":"index_or_alias","resource.id":"executions_loop_index","index_uuid":"_na_","index":"executions_loop_index"***,"status":404*** [ 32s ] executions total: 33 successful: 0 failed: 33 disconnect: 1 Index executions_loop_index already exists. Delete index executions_loop_index Execution loop failed: method [DELETE], host [http://elastics-twagzs-mdit-http.ns-nvunr.svc.cluster.local:9200], URI [/executions_loop_index], status line [HTTP/1.1 404 Not Found] ***"error":***"root_cause":[***"type":"index_not_found_exception","reason":"no such index [executions_loop_index]","index_uuid":"_na_","resource.type":"index_or_alias","resource.id":"executions_loop_index","index":"executions_loop_index"***],"type":"index_not_found_exception","reason":"no such index [executions_loop_index]","index_uuid":"_na_","resource.type":"index_or_alias","resource.id":"executions_loop_index","index":"executions_loop_index"***,"status":404*** [ 33s ] executions total: 34 successful: 0 failed: 34 disconnect: 1 Index executions_loop_index already exists. Delete index executions_loop_index Execution loop failed: method [DELETE], host [http://elastics-twagzs-mdit-http.ns-nvunr.svc.cluster.local:9200], URI [/executions_loop_index], status line [HTTP/1.1 404 Not Found] ***"error":***"root_cause":[***"type":"index_not_found_exception","reason":"no such index [executions_loop_index]","resource.type":"index_or_alias","resource.id":"executions_loop_index","index_uuid":"_na_","index":"executions_loop_index"***],"type":"index_not_found_exception","reason":"no such index [executions_loop_index]","resource.type":"index_or_alias","resource.id":"executions_loop_index","index_uuid":"_na_","index":"executions_loop_index"***,"status":404*** [ 34s ] executions total: 35 successful: 0 failed: 35 disconnect: 1 Index executions_loop_index already exists. Delete index executions_loop_index Execution loop failed: method [DELETE], host [http://elastics-twagzs-mdit-http.ns-nvunr.svc.cluster.local:9200], URI [/executions_loop_index], status line [HTTP/1.1 404 Not Found] ***"error":***"root_cause":[***"type":"index_not_found_exception","reason":"no such index [executions_loop_index]","index_uuid":"_na_","resource.type":"index_or_alias","resource.id":"executions_loop_index","index":"executions_loop_index"***],"type":"index_not_found_exception","reason":"no such index [executions_loop_index]","index_uuid":"_na_","resource.type":"index_or_alias","resource.id":"executions_loop_index","index":"executions_loop_index"***,"status":404*** [ 35s ] executions total: 36 successful: 0 failed: 36 disconnect: 1 Index executions_loop_index already exists. Delete index executions_loop_index Execution loop failed: method [DELETE], host [http://elastics-twagzs-mdit-http.ns-nvunr.svc.cluster.local:9200], URI [/executions_loop_index], status line [HTTP/1.1 404 Not Found] ***"error":***"root_cause":[***"type":"index_not_found_exception","reason":"no such index [executions_loop_index]","index_uuid":"_na_","resource.type":"index_or_alias","resource.id":"executions_loop_index","index":"executions_loop_index"***],"type":"index_not_found_exception","reason":"no such index [executions_loop_index]","index_uuid":"_na_","resource.type":"index_or_alias","resource.id":"executions_loop_index","index":"executions_loop_index"***,"status":404*** [ 36s ] executions total: 37 successful: 0 failed: 37 disconnect: 1 Index executions_loop_index already exists. Delete index executions_loop_index Execution loop failed: method [DELETE], host [http://elastics-twagzs-mdit-http.ns-nvunr.svc.cluster.local:9200], URI [/executions_loop_index], status line [HTTP/1.1 404 Not Found] ***"error":***"root_cause":[***"type":"index_not_found_exception","reason":"no such index [executions_loop_index]","index_uuid":"_na_","resource.type":"index_or_alias","resource.id":"executions_loop_index","index":"executions_loop_index"***],"type":"index_not_found_exception","reason":"no such index [executions_loop_index]","index_uuid":"_na_","resource.type":"index_or_alias","resource.id":"executions_loop_index","index":"executions_loop_index"***,"status":404*** [ 37s ] executions total: 38 successful: 0 failed: 38 disconnect: 1 Index executions_loop_index already exists. Delete index executions_loop_index Execution loop failed: method [DELETE], host [http://elastics-twagzs-mdit-http.ns-nvunr.svc.cluster.local:9200], URI [/executions_loop_index], status line [HTTP/1.1 404 Not Found] ***"error":***"root_cause":[***"type":"index_not_found_exception","reason":"no such index [executions_loop_index]","index_uuid":"_na_","resource.type":"index_or_alias","resource.id":"executions_loop_index","index":"executions_loop_index"***],"type":"index_not_found_exception","reason":"no such index [executions_loop_index]","index_uuid":"_na_","resource.type":"index_or_alias","resource.id":"executions_loop_index","index":"executions_loop_index"***,"status":404*** [ 38s ] executions total: 39 successful: 0 failed: 39 disconnect: 1 Index executions_loop_index already exists. Delete index executions_loop_index Execution loop failed: method [DELETE], host [http://elastics-twagzs-mdit-http.ns-nvunr.svc.cluster.local:9200], URI [/executions_loop_index], status line [HTTP/1.1 404 Not Found] ***"error":***"root_cause":[***"type":"index_not_found_exception","reason":"no such index [executions_loop_index]","index_uuid":"_na_","resource.type":"index_or_alias","resource.id":"executions_loop_index","index":"executions_loop_index"***],"type":"index_not_found_exception","reason":"no such index [executions_loop_index]","index_uuid":"_na_","resource.type":"index_or_alias","resource.id":"executions_loop_index","index":"executions_loop_index"***,"status":404*** [ 39s ] executions total: 40 successful: 0 failed: 40 disconnect: 1 Index executions_loop_index already exists. Delete index executions_loop_index Execution loop failed: method [DELETE], host [http://elastics-twagzs-mdit-http.ns-nvunr.svc.cluster.local:9200], URI [/executions_loop_index], status line [HTTP/1.1 404 Not Found] ***"error":***"root_cause":[***"type":"index_not_found_exception","reason":"no such index [executions_loop_index]","resource.type":"index_or_alias","resource.id":"executions_loop_index","index_uuid":"_na_","index":"executions_loop_index"***],"type":"index_not_found_exception","reason":"no such index [executions_loop_index]","resource.type":"index_or_alias","resource.id":"executions_loop_index","index_uuid":"_na_","index":"executions_loop_index"***,"status":404*** [ 40s ] executions total: 41 successful: 0 failed: 41 disconnect: 1 Index executions_loop_index already exists. Delete index executions_loop_index Execution loop failed: method [DELETE], host [http://elastics-twagzs-mdit-http.ns-nvunr.svc.cluster.local:9200], URI [/executions_loop_index], status line [HTTP/1.1 404 Not Found] ***"error":***"root_cause":[***"type":"index_not_found_exception","reason":"no such index [executions_loop_index]","index_uuid":"_na_","resource.type":"index_or_alias","resource.id":"executions_loop_index","index":"executions_loop_index"***],"type":"index_not_found_exception","reason":"no such index [executions_loop_index]","index_uuid":"_na_","resource.type":"index_or_alias","resource.id":"executions_loop_index","index":"executions_loop_index"***,"status":404*** [ 41s ] executions total: 42 successful: 0 failed: 42 disconnect: 1 Index executions_loop_index already exists. Delete index executions_loop_index Execution loop failed: method [DELETE], host [http://elastics-twagzs-mdit-http.ns-nvunr.svc.cluster.local:9200], URI [/executions_loop_index], status line [HTTP/1.1 404 Not Found] ***"error":***"root_cause":[***"type":"index_not_found_exception","reason":"no such index [executions_loop_index]","index_uuid":"_na_","resource.type":"index_or_alias","resource.id":"executions_loop_index","index":"executions_loop_index"***],"type":"index_not_found_exception","reason":"no such index [executions_loop_index]","index_uuid":"_na_","resource.type":"index_or_alias","resource.id":"executions_loop_index","index":"executions_loop_index"***,"status":404*** [ 42s ] executions total: 43 successful: 0 failed: 43 disconnect: 1 Index executions_loop_index already exists. Delete index executions_loop_index Execution loop failed: method [DELETE], host [http://elastics-twagzs-mdit-http.ns-nvunr.svc.cluster.local:9200], URI [/executions_loop_index], status line [HTTP/1.1 404 Not Found] ***"error":***"root_cause":[***"type":"index_not_found_exception","reason":"no such index [executions_loop_index]","resource.type":"index_or_alias","resource.id":"executions_loop_index","index_uuid":"_na_","index":"executions_loop_index"***],"type":"index_not_found_exception","reason":"no such index [executions_loop_index]","resource.type":"index_or_alias","resource.id":"executions_loop_index","index_uuid":"_na_","index":"executions_loop_index"***,"status":404*** [ 43s ] executions total: 44 successful: 0 failed: 44 disconnect: 1 Index executions_loop_index already exists. Delete index executions_loop_index Execution loop failed: method [DELETE], host [http://elastics-twagzs-mdit-http.ns-nvunr.svc.cluster.local:9200], URI [/executions_loop_index], status line [HTTP/1.1 404 Not Found] ***"error":***"root_cause":[***"type":"index_not_found_exception","reason":"no such index [executions_loop_index]","resource.type":"index_or_alias","resource.id":"executions_loop_index","index_uuid":"_na_","index":"executions_loop_index"***],"type":"index_not_found_exception","reason":"no such index [executions_loop_index]","resource.type":"index_or_alias","resource.id":"executions_loop_index","index_uuid":"_na_","index":"executions_loop_index"***,"status":404*** [ 44s ] executions total: 45 successful: 0 failed: 45 disconnect: 1 Index executions_loop_index already exists. Delete index executions_loop_index Execution loop failed: method [DELETE], host [http://elastics-twagzs-mdit-http.ns-nvunr.svc.cluster.local:9200], URI [/executions_loop_index], status line [HTTP/1.1 404 Not Found] ***"error":***"root_cause":[***"type":"index_not_found_exception","reason":"no such index [executions_loop_index]","index_uuid":"_na_","resource.type":"index_or_alias","resource.id":"executions_loop_index","index":"executions_loop_index"***],"type":"index_not_found_exception","reason":"no such index [executions_loop_index]","index_uuid":"_na_","resource.type":"index_or_alias","resource.id":"executions_loop_index","index":"executions_loop_index"***,"status":404*** [ 45s ] executions total: 46 successful: 0 failed: 46 disconnect: 1 Index executions_loop_index already exists. Delete index executions_loop_index Execution loop failed: method [DELETE], host [http://elastics-twagzs-mdit-http.ns-nvunr.svc.cluster.local:9200], URI [/executions_loop_index], status line [HTTP/1.1 404 Not Found] ***"error":***"root_cause":[***"type":"index_not_found_exception","reason":"no such index [executions_loop_index]","index_uuid":"_na_","resource.type":"index_or_alias","resource.id":"executions_loop_index","index":"executions_loop_index"***],"type":"index_not_found_exception","reason":"no such index [executions_loop_index]","index_uuid":"_na_","resource.type":"index_or_alias","resource.id":"executions_loop_index","index":"executions_loop_index"***,"status":404*** [ 46s ] executions total: 47 successful: 0 failed: 47 disconnect: 1 Index executions_loop_index already exists. Delete index executions_loop_index Execution loop failed: method [DELETE], host [http://elastics-twagzs-mdit-http.ns-nvunr.svc.cluster.local:9200], URI [/executions_loop_index], status line [HTTP/1.1 404 Not Found] ***"error":***"root_cause":[***"type":"index_not_found_exception","reason":"no such index [executions_loop_index]","resource.type":"index_or_alias","resource.id":"executions_loop_index","index_uuid":"_na_","index":"executions_loop_index"***],"type":"index_not_found_exception","reason":"no such index [executions_loop_index]","resource.type":"index_or_alias","resource.id":"executions_loop_index","index_uuid":"_na_","index":"executions_loop_index"***,"status":404*** [ 47s ] executions total: 48 successful: 0 failed: 48 disconnect: 1 Index executions_loop_index already exists. Delete index executions_loop_index Execution loop failed: method [DELETE], host [http://elastics-twagzs-mdit-http.ns-nvunr.svc.cluster.local:9200], URI [/executions_loop_index], status line [HTTP/1.1 404 Not Found] ***"error":***"root_cause":[***"type":"index_not_found_exception","reason":"no such index [executions_loop_index]","index_uuid":"_na_","resource.type":"index_or_alias","resource.id":"executions_loop_index","index":"executions_loop_index"***],"type":"index_not_found_exception","reason":"no such index [executions_loop_index]","index_uuid":"_na_","resource.type":"index_or_alias","resource.id":"executions_loop_index","index":"executions_loop_index"***,"status":404*** [ 48s ] executions total: 49 successful: 0 failed: 49 disconnect: 1 Index executions_loop_index already exists. Delete index executions_loop_index Execution loop failed: method [DELETE], host [http://elastics-twagzs-mdit-http.ns-nvunr.svc.cluster.local:9200], URI [/executions_loop_index], status line [HTTP/1.1 404 Not Found] ***"error":***"root_cause":[***"type":"index_not_found_exception","reason":"no such index [executions_loop_index]","resource.type":"index_or_alias","resource.id":"executions_loop_index","index_uuid":"_na_","index":"executions_loop_index"***],"type":"index_not_found_exception","reason":"no such index [executions_loop_index]","resource.type":"index_or_alias","resource.id":"executions_loop_index","index_uuid":"_na_","index":"executions_loop_index"***,"status":404*** [ 49s ] executions total: 50 successful: 0 failed: 50 disconnect: 1 Index executions_loop_index already exists. Delete index executions_loop_index Execution loop failed: method [DELETE], host [http://elastics-twagzs-mdit-http.ns-nvunr.svc.cluster.local:9200], URI [/executions_loop_index], status line [HTTP/1.1 404 Not Found] ***"error":***"root_cause":[***"type":"index_not_found_exception","reason":"no such index [executions_loop_index]","index_uuid":"_na_","resource.type":"index_or_alias","resource.id":"executions_loop_index","index":"executions_loop_index"***],"type":"index_not_found_exception","reason":"no such index [executions_loop_index]","index_uuid":"_na_","resource.type":"index_or_alias","resource.id":"executions_loop_index","index":"executions_loop_index"***,"status":404*** [ 50s ] executions total: 51 successful: 0 failed: 51 disconnect: 1 Index executions_loop_index already exists. Delete index executions_loop_index Execution loop failed: method [DELETE], host [http://elastics-twagzs-mdit-http.ns-nvunr.svc.cluster.local:9200], URI [/executions_loop_index], status line [HTTP/1.1 404 Not Found] ***"error":***"root_cause":[***"type":"index_not_found_exception","reason":"no such index [executions_loop_index]","index_uuid":"_na_","resource.type":"index_or_alias","resource.id":"executions_loop_index","index":"executions_loop_index"***],"type":"index_not_found_exception","reason":"no such index [executions_loop_index]","index_uuid":"_na_","resource.type":"index_or_alias","resource.id":"executions_loop_index","index":"executions_loop_index"***,"status":404*** [ 51s ] executions total: 52 successful: 0 failed: 52 disconnect: 1 Index executions_loop_index already exists. Delete index executions_loop_index Execution loop failed: method [DELETE], host [http://elastics-twagzs-mdit-http.ns-nvunr.svc.cluster.local:9200], URI [/executions_loop_index], status line [HTTP/1.1 404 Not Found] ***"error":***"root_cause":[***"type":"index_not_found_exception","reason":"no such index [executions_loop_index]","resource.type":"index_or_alias","resource.id":"executions_loop_index","index_uuid":"_na_","index":"executions_loop_index"***],"type":"index_not_found_exception","reason":"no such index [executions_loop_index]","resource.type":"index_or_alias","resource.id":"executions_loop_index","index_uuid":"_na_","index":"executions_loop_index"***,"status":404*** [ 52s ] executions total: 53 successful: 0 failed: 53 disconnect: 1 Index executions_loop_index already exists. Delete index executions_loop_index Execution loop failed: method [DELETE], host [http://elastics-twagzs-mdit-http.ns-nvunr.svc.cluster.local:9200], URI [/executions_loop_index], status line [HTTP/1.1 404 Not Found] ***"error":***"root_cause":[***"type":"index_not_found_exception","reason":"no such index [executions_loop_index]","index_uuid":"_na_","resource.type":"index_or_alias","resource.id":"executions_loop_index","index":"executions_loop_index"***],"type":"index_not_found_exception","reason":"no such index [executions_loop_index]","index_uuid":"_na_","resource.type":"index_or_alias","resource.id":"executions_loop_index","index":"executions_loop_index"***,"status":404*** [ 53s ] executions total: 54 successful: 0 failed: 54 disconnect: 1 Index executions_loop_index already exists. Delete index executions_loop_index Execution loop failed: method [DELETE], host [http://elastics-twagzs-mdit-http.ns-nvunr.svc.cluster.local:9200], URI [/executions_loop_index], status line [HTTP/1.1 404 Not Found] ***"error":***"root_cause":[***"type":"index_not_found_exception","reason":"no such index [executions_loop_index]","index_uuid":"_na_","resource.type":"index_or_alias","resource.id":"executions_loop_index","index":"executions_loop_index"***],"type":"index_not_found_exception","reason":"no such index [executions_loop_index]","index_uuid":"_na_","resource.type":"index_or_alias","resource.id":"executions_loop_index","index":"executions_loop_index"***,"status":404*** [ 54s ] executions total: 55 successful: 0 failed: 55 disconnect: 1 Index executions_loop_index already exists. Delete index executions_loop_index Execution loop failed: method [DELETE], host [http://elastics-twagzs-mdit-http.ns-nvunr.svc.cluster.local:9200], URI [/executions_loop_index], status line [HTTP/1.1 404 Not Found] ***"error":***"root_cause":[***"type":"index_not_found_exception","reason":"no such index [executions_loop_index]","index_uuid":"_na_","resource.type":"index_or_alias","resource.id":"executions_loop_index","index":"executions_loop_index"***],"type":"index_not_found_exception","reason":"no such index [executions_loop_index]","index_uuid":"_na_","resource.type":"index_or_alias","resource.id":"executions_loop_index","index":"executions_loop_index"***,"status":404*** [ 55s ] executions total: 56 successful: 0 failed: 56 disconnect: 1 Index executions_loop_index already exists. Delete index executions_loop_index Execution loop failed: method [DELETE], host [http://elastics-twagzs-mdit-http.ns-nvunr.svc.cluster.local:9200], URI [/executions_loop_index], status line [HTTP/1.1 404 Not Found] ***"error":***"root_cause":[***"type":"index_not_found_exception","reason":"no such index [executions_loop_index]","resource.type":"index_or_alias","resource.id":"executions_loop_index","index_uuid":"_na_","index":"executions_loop_index"***],"type":"index_not_found_exception","reason":"no such index [executions_loop_index]","resource.type":"index_or_alias","resource.id":"executions_loop_index","index_uuid":"_na_","index":"executions_loop_index"***,"status":404*** [ 56s ] executions total: 57 successful: 0 failed: 57 disconnect: 1 Index executions_loop_index already exists. Delete index executions_loop_index Execution loop failed: method [DELETE], host [http://elastics-twagzs-mdit-http.ns-nvunr.svc.cluster.local:9200], URI [/executions_loop_index], status line [HTTP/1.1 404 Not Found] ***"error":***"root_cause":[***"type":"index_not_found_exception","reason":"no such index [executions_loop_index]","index_uuid":"_na_","resource.type":"index_or_alias","resource.id":"executions_loop_index","index":"executions_loop_index"***],"type":"index_not_found_exception","reason":"no such index [executions_loop_index]","index_uuid":"_na_","resource.type":"index_or_alias","resource.id":"executions_loop_index","index":"executions_loop_index"***,"status":404*** [ 57s ] executions total: 58 successful: 0 failed: 58 disconnect: 1 Index executions_loop_index already exists. Delete index executions_loop_index Execution loop failed: method [DELETE], host [http://elastics-twagzs-mdit-http.ns-nvunr.svc.cluster.local:9200], URI [/executions_loop_index], status line [HTTP/1.1 404 Not Found] ***"error":***"root_cause":[***"type":"index_not_found_exception","reason":"no such index [executions_loop_index]","index_uuid":"_na_","resource.type":"index_or_alias","resource.id":"executions_loop_index","index":"executions_loop_index"***],"type":"index_not_found_exception","reason":"no such index [executions_loop_index]","index_uuid":"_na_","resource.type":"index_or_alias","resource.id":"executions_loop_index","index":"executions_loop_index"***,"status":404*** [ 58s ] executions total: 59 successful: 0 failed: 59 disconnect: 1 Index executions_loop_index already exists. Delete index executions_loop_index Execution loop failed: method [DELETE], host [http://elastics-twagzs-mdit-http.ns-nvunr.svc.cluster.local:9200], URI [/executions_loop_index], status line [HTTP/1.1 404 Not Found] ***"error":***"root_cause":[***"type":"index_not_found_exception","reason":"no such index [executions_loop_index]","index_uuid":"_na_","resource.type":"index_or_alias","resource.id":"executions_loop_index","index":"executions_loop_index"***],"type":"index_not_found_exception","reason":"no such index [executions_loop_index]","index_uuid":"_na_","resource.type":"index_or_alias","resource.id":"executions_loop_index","index":"executions_loop_index"***,"status":404*** [ 60s ] executions total: 60 successful: 0 failed: 60 disconnect: 1 Test Result: Total Executions: 60 Successful Executions: 0 Failed Executions: 60 Disconnection Counts: 1 Connection Information: Database Type: elasticsearch7 Host: elastics-twagzs-mdit-http.ns-nvunr.svc.cluster.local Port: 9200 Database: Table: User: elastic Org: Access Mode: mysql Test Type: executionloop Query: Duration: 60 seconds Interval: 1 seconds ------------------------------------------------------------------------------------------------------------------ check cluster status `kbcli cluster list elastics-twagzs --show-labels --namespace ns-nvunr ` NAME NAMESPACE CLUSTER-DEFINITION VERSION TERMINATION-POLICY STATUS CREATED-TIME LABELS elastics-twagzs ns-nvunr WipeOut Running Sep 01,2025 11:23 UTC+0800 app.kubernetes.io/instance=elastics-twagzs check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances elastics-twagzs --namespace ns-nvunr ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME elastics-twagzs-kibana-0 ns-nvunr elastics-twagzs kibana Running 0 500m / 500m 2Gi / 2Gi aks-cicdamdpool-38368475-vmss000000/10.224.0.5 Sep 01,2025 11:23 UTC+0800 elastics-twagzs-mdit-0 ns-nvunr elastics-twagzs mdit Running 0 500m / 500m 2Gi / 2Gi data:20Gi aks-cicdamdpool-38368475-vmss000000/10.224.0.5 Sep 01,2025 11:23 UTC+0800 elastics-twagzs-mdit-1 ns-nvunr elastics-twagzs mdit Running 0 500m / 500m 2Gi / 2Gi data:20Gi aks-cicdamdpool-38368475-vmss000000/10.224.0.5 Sep 01,2025 11:23 UTC+0800 elastics-twagzs-mdit-2 ns-nvunr elastics-twagzs mdit Running 0 500m / 500m 2Gi / 2Gi data:20Gi aks-cicdamdpool-38368475-vmss000000/10.224.0.5 Sep 01,2025 11:23 UTC+0800 check pod status done No resources found in ns-nvunr namespace. check cluster connect `echo "curl http://elastics-twagzs-mdit-http.ns-nvunr.svc.cluster.local:9200/_cluster/health\?pretty " | kubectl exec -it elastics-twagzs-mdit-0 --namespace ns-nvunr -- sh` check cluster connect done [ 43s ] executions total: 44 successful: 0 failed: 44 disconnect: 1 Index executions_loop_index already exists. Delete index executions_loop_index Execution loop failed: method [DELETE], host [http://elastics-twagzs-mdit-http.ns-nvunr.svc.cluster.local:9200], URI [/executions_loop_index], status line [HTTP/1.1 404 Not Found] ***"error":***"root_cause":[***"type":"index_not_found_exception","reason":"no such index [executions_loop_index]","resource.type":"index_or_alias","resource.id":"executions_loop_index","index_uuid":"_na_","index":"executions_loop_index"***],"type":"index_not_found_exception","reason":"no such index [executions_loop_index]","resource.type":"index_or_alias","resource.id":"executions_loop_index","index_uuid":"_na_","index":"executions_loop_index"***,"status":404*** [ 44s ] executions total: 45 successful: 0 failed: 45 disconnect: 1 Index executions_loop_index already exists. Delete index executions_loop_index Execution loop failed: method [DELETE], host [http://elastics-twagzs-mdit-http.ns-nvunr.svc.cluster.local:9200], URI [/executions_loop_index], status line [HTTP/1.1 404 Not Found] ***"error":***"root_cause":[***"type":"index_not_found_exception","reason":"no such index [executions_loop_index]","index_uuid":"_na_","resource.type":"index_or_alias","resource.id":"executions_loop_index","index":"executions_loop_index"***],"type":"index_not_found_exception","reason":"no such index [executions_loop_index]","index_uuid":"_na_","resource.type":"index_or_alias","resource.id":"executions_loop_index","index":"executions_loop_index"***,"status":404*** [ 45s ] executions total: 46 successful: 0 failed: 46 disconnect: 1 Index executions_loop_index already exists. Delete index executions_loop_index Execution loop failed: method [DELETE], host [http://elastics-twagzs-mdit-http.ns-nvunr.svc.cluster.local:9200], URI [/executions_loop_index], status line [HTTP/1.1 404 Not Found] ***"error":***"root_cause":[***"type":"index_not_found_exception","reason":"no such index [executions_loop_index]","index_uuid":"_na_","resource.type":"index_or_alias","resource.id":"executions_loop_index","index":"executions_loop_index"***],"type":"index_not_found_exception","reason":"no such index [executions_loop_index]","index_uuid":"_na_","resource.type":"index_or_alias","resource.id":"executions_loop_index","index":"executions_loop_index"***,"status":404*** [ 46s ] executions total: 47 successful: 0 failed: 47 disconnect: 1 Index executions_loop_index already exists. Delete index executions_loop_index Execution loop failed: method [DELETE], host [http://elastics-twagzs-mdit-http.ns-nvunr.svc.cluster.local:9200], URI [/executions_loop_index], status line [HTTP/1.1 404 Not Found] ***"error":***"root_cause":[***"type":"index_not_found_exception","reason":"no such index [executions_loop_index]","resource.type":"index_or_alias","resource.id":"executions_loop_index","index_uuid":"_na_","index":"executions_loop_index"***],"type":"index_not_found_exception","reason":"no such index [executions_loop_index]","resource.type":"index_or_alias","resource.id":"executions_loop_index","index_uuid":"_na_","index":"executions_loop_index"***,"status":404*** [ 47s ] executions total: 48 successful: 0 failed: 48 disconnect: 1 Index executions_loop_index already exists. Delete index executions_loop_index Execution loop failed: method [DELETE], host [http://elastics-twagzs-mdit-http.ns-nvunr.svc.cluster.local:9200], URI [/executions_loop_index], status line [HTTP/1.1 404 Not Found] ***"error":***"root_cause":[***"type":"index_not_found_exception","reason":"no such index [executions_loop_index]","index_uuid":"_na_","resource.type":"index_or_alias","resource.id":"executions_loop_index","index":"executions_loop_index"***],"type":"index_not_found_exception","reason":"no such index [executions_loop_index]","index_uuid":"_na_","resource.type":"index_or_alias","resource.id":"executions_loop_index","index":"executions_loop_index"***,"status":404*** [ 48s ] executions total: 49 successful: 0 failed: 49 disconnect: 1 Index executions_loop_index already exists. Delete index executions_loop_index Execution loop failed: method [DELETE], host [http://elastics-twagzs-mdit-http.ns-nvunr.svc.cluster.local:9200], URI [/executions_loop_index], status line [HTTP/1.1 404 Not Found] ***"error":***"root_cause":[***"type":"index_not_found_exception","reason":"no such index [executions_loop_index]","resource.type":"index_or_alias","resource.id":"executions_loop_index","index_uuid":"_na_","index":"executions_loop_index"***],"type":"index_not_found_exception","reason":"no such index [executions_loop_index]","resource.type":"index_or_alias","resource.id":"executions_loop_index","index_uuid":"_na_","index":"executions_loop_index"***,"status":404*** [ 49s ] executions total: 50 successful: 0 failed: 50 disconnect: 1 Index executions_loop_index already exists. Delete index executions_loop_index Execution loop failed: method [DELETE], host [http://elastics-twagzs-mdit-http.ns-nvunr.svc.cluster.local:9200], URI [/executions_loop_index], status line [HTTP/1.1 404 Not Found] ***"error":***"root_cause":[***"type":"index_not_found_exception","reason":"no such index [executions_loop_index]","index_uuid":"_na_","resource.type":"index_or_alias","resource.id":"executions_loop_index","index":"executions_loop_index"***],"type":"index_not_found_exception","reason":"no such index [executions_loop_index]","index_uuid":"_na_","resource.type":"index_or_alias","resource.id":"executions_loop_index","index":"executions_loop_index"***,"status":404*** [ 50s ] executions total: 51 successful: 0 failed: 51 disconnect: 1 Index executions_loop_index already exists. Delete index executions_loop_index Execution loop failed: method [DELETE], host [http://elastics-twagzs-mdit-http.ns-nvunr.svc.cluster.local:9200], URI [/executions_loop_index], status line [HTTP/1.1 404 Not Found] ***"error":***"root_cause":[***"type":"index_not_found_exception","reason":"no such index [executions_loop_index]","index_uuid":"_na_","resource.type":"index_or_alias","resource.id":"executions_loop_index","index":"executions_loop_index"***],"type":"index_not_found_exception","reason":"no such index [executions_loop_index]","index_uuid":"_na_","resource.type":"index_or_alias","resource.id":"executions_loop_index","index":"executions_loop_index"***,"status":404*** [ 51s ] executions total: 52 successful: 0 failed: 52 disconnect: 1 Index executions_loop_index already exists. Delete index executions_loop_index Execution loop failed: method [DELETE], host [http://elastics-twagzs-mdit-http.ns-nvunr.svc.cluster.local:9200], URI [/executions_loop_index], status line [HTTP/1.1 404 Not Found] ***"error":***"root_cause":[***"type":"index_not_found_exception","reason":"no such index [executions_loop_index]","resource.type":"index_or_alias","resource.id":"executions_loop_index","index_uuid":"_na_","index":"executions_loop_index"***],"type":"index_not_found_exception","reason":"no such index [executions_loop_index]","resource.type":"index_or_alias","resource.id":"executions_loop_index","index_uuid":"_na_","index":"executions_loop_index"***,"status":404*** [ 52s ] executions total: 53 successful: 0 failed: 53 disconnect: 1 Index executions_loop_index already exists. Delete index executions_loop_index Execution loop failed: method [DELETE], host [http://elastics-twagzs-mdit-http.ns-nvunr.svc.cluster.local:9200], URI [/executions_loop_index], status line [HTTP/1.1 404 Not Found] ***"error":***"root_cause":[***"type":"index_not_found_exception","reason":"no such index [executions_loop_index]","index_uuid":"_na_","resource.type":"index_or_alias","resource.id":"executions_loop_index","index":"executions_loop_index"***],"type":"index_not_found_exception","reason":"no such index [executions_loop_index]","index_uuid":"_na_","resource.type":"index_or_alias","resource.id":"executions_loop_index","index":"executions_loop_index"***,"status":404*** [ 53s ] executions total: 54 successful: 0 failed: 54 disconnect: 1 Index executions_loop_index already exists. Delete index executions_loop_index Execution loop failed: method [DELETE], host [http://elastics-twagzs-mdit-http.ns-nvunr.svc.cluster.local:9200], URI [/executions_loop_index], status line [HTTP/1.1 404 Not Found] ***"error":***"root_cause":[***"type":"index_not_found_exception","reason":"no such index [executions_loop_index]","index_uuid":"_na_","resource.type":"index_or_alias","resource.id":"executions_loop_index","index":"executions_loop_index"***],"type":"index_not_found_exception","reason":"no such index [executions_loop_index]","index_uuid":"_na_","resource.type":"index_or_alias","resource.id":"executions_loop_index","index":"executions_loop_index"***,"status":404*** [ 54s ] executions total: 55 successful: 0 failed: 55 disconnect: 1 Index executions_loop_index already exists. Delete index executions_loop_index Execution loop failed: method [DELETE], host [http://elastics-twagzs-mdit-http.ns-nvunr.svc.cluster.local:9200], URI [/executions_loop_index], status line [HTTP/1.1 404 Not Found] ***"error":***"root_cause":[***"type":"index_not_found_exception","reason":"no such index [executions_loop_index]","index_uuid":"_na_","resource.type":"index_or_alias","resource.id":"executions_loop_index","index":"executions_loop_index"***],"type":"index_not_found_exception","reason":"no such index [executions_loop_index]","index_uuid":"_na_","resource.type":"index_or_alias","resource.id":"executions_loop_index","index":"executions_loop_index"***,"status":404*** [ 55s ] executions total: 56 successful: 0 failed: 56 disconnect: 1 Index executions_loop_index already exists. Delete index executions_loop_index Execution loop failed: method [DELETE], host [http://elastics-twagzs-mdit-http.ns-nvunr.svc.cluster.local:9200], URI [/executions_loop_index], status line [HTTP/1.1 404 Not Found] ***"error":***"root_cause":[***"type":"index_not_found_exception","reason":"no such index [executions_loop_index]","resource.type":"index_or_alias","resource.id":"executions_loop_index","index_uuid":"_na_","index":"executions_loop_index"***],"type":"index_not_found_exception","reason":"no such index [executions_loop_index]","resource.type":"index_or_alias","resource.id":"executions_loop_index","index_uuid":"_na_","index":"executions_loop_index"***,"status":404*** [ 56s ] executions total: 57 successful: 0 failed: 57 disconnect: 1 Index executions_loop_index already exists. Delete index executions_loop_index Execution loop failed: method [DELETE], host [http://elastics-twagzs-mdit-http.ns-nvunr.svc.cluster.local:9200], URI [/executions_loop_index], status line [HTTP/1.1 404 Not Found] ***"error":***"root_cause":[***"type":"index_not_found_exception","reason":"no such index [executions_loop_index]","index_uuid":"_na_","resource.type":"index_or_alias","resource.id":"executions_loop_index","index":"executions_loop_index"***],"type":"index_not_found_exception","reason":"no such index [executions_loop_index]","index_uuid":"_na_","resource.type":"index_or_alias","resource.id":"executions_loop_index","index":"executions_loop_index"***,"status":404*** [ 57s ] executions total: 58 successful: 0 failed: 58 disconnect: 1 Index executions_loop_index already exists. Delete index executions_loop_index Execution loop failed: method [DELETE], host [http://elastics-twagzs-mdit-http.ns-nvunr.svc.cluster.local:9200], URI [/executions_loop_index], status line [HTTP/1.1 404 Not Found] ***"error":***"root_cause":[***"type":"index_not_found_exception","reason":"no such index [executions_loop_index]","index_uuid":"_na_","resource.type":"index_or_alias","resource.id":"executions_loop_index","index":"executions_loop_index"***],"type":"index_not_found_exception","reason":"no such index [executions_loop_index]","index_uuid":"_na_","resource.type":"index_or_alias","resource.id":"executions_loop_index","index":"executions_loop_index"***,"status":404*** [ 58s ] executions total: 59 successful: 0 failed: 59 disconnect: 1 Index executions_loop_index already exists. Delete index executions_loop_index Execution loop failed: method [DELETE], host [http://elastics-twagzs-mdit-http.ns-nvunr.svc.cluster.local:9200], URI [/executions_loop_index], status line [HTTP/1.1 404 Not Found] ***"error":***"root_cause":[***"type":"index_not_found_exception","reason":"no such index [executions_loop_index]","index_uuid":"_na_","resource.type":"index_or_alias","resource.id":"executions_loop_index","index":"executions_loop_index"***],"type":"index_not_found_exception","reason":"no such index [executions_loop_index]","index_uuid":"_na_","resource.type":"index_or_alias","resource.id":"executions_loop_index","index":"executions_loop_index"***,"status":404*** [ 60s ] executions total: 60 successful: 0 failed: 60 disconnect: 1 Test Result: Total Executions: 60 Successful Executions: 0 Failed Executions: 60 Disconnection Counts: 1 Connection Information: Database Type: elasticsearch7 Host: elastics-twagzs-mdit-http.ns-nvunr.svc.cluster.local Port: 9200 Database: Table: User: elastic Org: Access Mode: mysql Test Type: executionloop Query: Duration: 60 seconds Interval: 1 seconds DB_CLIENT_BATCH_DATA_COUNT: 0 `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge pods test-db-client-executionloop-elastics-twagzs --namespace ns-nvunr ` pod/test-db-client-executionloop-elastics-twagzs patched (no change) Warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely. pod "test-db-client-executionloop-elastics-twagzs" force deleted No resources found in ns-nvunr namespace. `echo "curl -X POST 'elastics-twagzs-mdit-http.ns-nvunr.svc.cluster.local:9200/boss/_doc/1?pretty' -H 'Content-Type: application/json' -d '***\"datainsert\":\"smmqn\"***'" | kubectl exec -it elastics-twagzs-mdit-0 --namespace ns-nvunr -- sh` Defaulted container "elasticsearch" out of: elasticsearch, exporter, agent, lorry, prepare-plugins (init), install-plugins (init), init-lorry (init) Unable to use a TTY - input is not a terminal or the right kind of file % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 240 100 218 100 22 368 37 --:--:-- --:--:-- --:--:-- 405 100 240 100 218 100 22 368 37 --:--:-- --:--:-- --:--:-- 405 *** "_index" : "boss", "_type" : "_doc", "_id" : "1", "_version" : 1, "result" : "created", "_shards" : *** "total" : 2, "successful" : 1, "failed" : 0 ***, "_seq_no" : 0, "_primary_term" : 1 *** add consistent data smmqn Success check component kibana exists `kubectl get components -l app.kubernetes.io/instance=elastics-twagzs,apps.kubeblocks.io/component-name=kibana --namespace ns-nvunr | (grep "kibana" || true )` cluster vscale check cluster status before ops check cluster status done cluster_status:Running `kbcli cluster vscale elastics-twagzs --auto-approve --force=true --components kibana --cpu 600m --memory 2.1Gi --namespace ns-nvunr ` OpsRequest elastics-twagzs-verticalscaling-n6hh6 created successfully, you can view the progress: kbcli cluster describe-ops elastics-twagzs-verticalscaling-n6hh6 -n ns-nvunr check ops status `kbcli cluster list-ops elastics-twagzs --status all --namespace ns-nvunr ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME elastics-twagzs-verticalscaling-n6hh6 ns-nvunr VerticalScaling elastics-twagzs kibana Creating -/- Sep 01,2025 11:35 UTC+0800 check cluster status `kbcli cluster list elastics-twagzs --show-labels --namespace ns-nvunr ` NAME NAMESPACE CLUSTER-DEFINITION VERSION TERMINATION-POLICY STATUS CREATED-TIME LABELS elastics-twagzs ns-nvunr WipeOut Updating Sep 01,2025 11:23 UTC+0800 app.kubernetes.io/instance=elastics-twagzs cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances elastics-twagzs --namespace ns-nvunr ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME elastics-twagzs-kibana-0 ns-nvunr elastics-twagzs kibana Running 0 600m / 600m 2254857830400m / 2254857830400m aks-cicdamdpool-38368475-vmss000000/10.224.0.5 Sep 01,2025 11:35 UTC+0800 elastics-twagzs-mdit-0 ns-nvunr elastics-twagzs mdit Running 0 500m / 500m 2Gi / 2Gi data:20Gi aks-cicdamdpool-38368475-vmss000000/10.224.0.5 Sep 01,2025 11:23 UTC+0800 elastics-twagzs-mdit-1 ns-nvunr elastics-twagzs mdit Running 0 500m / 500m 2Gi / 2Gi data:20Gi aks-cicdamdpool-38368475-vmss000000/10.224.0.5 Sep 01,2025 11:23 UTC+0800 elastics-twagzs-mdit-2 ns-nvunr elastics-twagzs mdit Running 0 500m / 500m 2Gi / 2Gi data:20Gi aks-cicdamdpool-38368475-vmss000000/10.224.0.5 Sep 01,2025 11:23 UTC+0800 check pod status done No resources found in ns-nvunr namespace. check cluster connect `echo "curl http://elastics-twagzs-mdit-http.ns-nvunr.svc.cluster.local:9200/_cluster/health\?pretty " | kubectl exec -it elastics-twagzs-mdit-0 --namespace ns-nvunr -- sh` check cluster connect done check ops status `kbcli cluster list-ops elastics-twagzs --status all --namespace ns-nvunr ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME elastics-twagzs-verticalscaling-n6hh6 ns-nvunr VerticalScaling elastics-twagzs kibana Succeed 1/1 Sep 01,2025 11:35 UTC+0800 check ops status done ops_status:elastics-twagzs-verticalscaling-n6hh6 ns-nvunr VerticalScaling elastics-twagzs kibana Succeed 1/1 Sep 01,2025 11:35 UTC+0800 `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge opsrequests elastics-twagzs-verticalscaling-n6hh6 --namespace ns-nvunr ` opsrequest.apps.kubeblocks.io/elastics-twagzs-verticalscaling-n6hh6 patched `kbcli cluster delete-ops --name elastics-twagzs-verticalscaling-n6hh6 --force --auto-approve --namespace ns-nvunr ` OpsRequest elastics-twagzs-verticalscaling-n6hh6 deleted No resources found in ns-nvunr namespace. check db_client batch data count `echo "curl -X GET 'elastics-twagzs-mdit-http.ns-nvunr.svc.cluster.local:9200/executions_loop_index/_search' -H 'Content-Type: application/json' -d '***\"size\": 0,\"track_total_hits\": true***' " | kubectl exec -it elastics-twagzs-mdit-0 --namespace ns-nvunr -- sh ` check db_client batch data Success test failover connectionstress check cluster status before cluster-failover-connectionstress check cluster status done cluster_status:Running check node drain check node drain success Error from server (NotFound): pods "test-db-client-connectionstress-elastics-twagzs" not found `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge pods test-db-client-connectionstress-elastics-twagzs --namespace ns-nvunr ` Error from server (NotFound): pods "test-db-client-connectionstress-elastics-twagzs" not found Warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely. Error from server (NotFound): pods "test-db-client-connectionstress-elastics-twagzs" not found `kubectl get secrets -l app.kubernetes.io/instance=elastics-twagzs` set secret: elastics-twagzs-mdit-account-elastic `kubectl get secrets elastics-twagzs-mdit-account-elastic -o jsonpath="***.data.username***"` `kubectl get secrets elastics-twagzs-mdit-account-elastic -o jsonpath="***.data.password***"` `kubectl get secrets elastics-twagzs-mdit-account-elastic -o jsonpath="***.data.port***"` DB_USERNAME:elastic;DB_PASSWORD:O56ffV183D;DB_PORT:9200;DB_DATABASE:elastic No resources found in ns-nvunr namespace. apiVersion: v1 kind: Pod metadata: name: test-db-client-connectionstress-elastics-twagzs namespace: ns-nvunr spec: containers: - name: test-dbclient imagePullPolicy: IfNotPresent image: docker.io/apecloud/dbclient:test args: - "--host" - "elastics-twagzs-mdit-http.ns-nvunr.svc.cluster.local" - "--user" - "elastic" - "--password" - "O56ffV183D" - "--port" - "9200" - "--database" - "elastic" - "--dbtype" - "elasticsearch7" - "--test" - "connectionstress" - "--connections" - "1024" - "--duration" - "60" restartPolicy: Never `kubectl apply -f test-db-client-connectionstress-elastics-twagzs.yaml` pod/test-db-client-connectionstress-elastics-twagzs created apply test-db-client-connectionstress-elastics-twagzs.yaml Success `rm -rf test-db-client-connectionstress-elastics-twagzs.yaml` check pod status pod_status:NAME READY STATUS RESTARTS AGE test-db-client-connectionstress-elastics-twagzs 1/1 Running 0 5s check pod test-db-client-connectionstress-elastics-twagzs status done pod_status:NAME READY STATUS RESTARTS AGE test-db-client-connectionstress-elastics-twagzs 0/1 Completed 0 17s check cluster status `kbcli cluster list elastics-twagzs --show-labels --namespace ns-nvunr ` NAME NAMESPACE CLUSTER-DEFINITION VERSION TERMINATION-POLICY STATUS CREATED-TIME LABELS elastics-twagzs ns-nvunr WipeOut Running Sep 01,2025 11:23 UTC+0800 app.kubernetes.io/instance=elastics-twagzs check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances elastics-twagzs --namespace ns-nvunr ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME elastics-twagzs-kibana-0 ns-nvunr elastics-twagzs kibana Running 0 600m / 600m 2254857830400m / 2254857830400m aks-cicdamdpool-38368475-vmss000000/10.224.0.5 Sep 01,2025 11:35 UTC+0800 elastics-twagzs-mdit-0 ns-nvunr elastics-twagzs mdit Running 0 500m / 500m 2Gi / 2Gi data:20Gi aks-cicdamdpool-38368475-vmss000000/10.224.0.5 Sep 01,2025 11:23 UTC+0800 elastics-twagzs-mdit-1 ns-nvunr elastics-twagzs mdit Running 0 500m / 500m 2Gi / 2Gi data:20Gi aks-cicdamdpool-38368475-vmss000000/10.224.0.5 Sep 01,2025 11:23 UTC+0800 elastics-twagzs-mdit-2 ns-nvunr elastics-twagzs mdit Running 0 500m / 500m 2Gi / 2Gi data:20Gi aks-cicdamdpool-38368475-vmss000000/10.224.0.5 Sep 01,2025 11:23 UTC+0800 check pod status done No resources found in ns-nvunr namespace. check cluster connect `echo "curl http://elastics-twagzs-mdit-http.ns-nvunr.svc.cluster.local:9200/_cluster/health\?pretty " | kubectl exec -it elastics-twagzs-mdit-0 --namespace ns-nvunr -- sh` check cluster connect done --host elastics-twagzs-mdit-http.ns-nvunr.svc.cluster.local --user elastic --password O56ffV183D --port 9200 --database elastic --dbtype elasticsearch7 --test connectionstress --connections 1024 --duration 60 SLF4J(I): Connected with provider of type [ch.qos.logback.classic.spi.LogbackServiceProvider] Test Result: Created 1024 connections Connection Information: Database Type: elasticsearch7 Host: elastics-twagzs-mdit-http.ns-nvunr.svc.cluster.local Port: 9200 Database: elastic Table: User: elastic Org: Access Mode: mysql Test Type: connectionstress Connection Count: 1024 Duration: 60 seconds `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge pods test-db-client-connectionstress-elastics-twagzs --namespace ns-nvunr ` pod/test-db-client-connectionstress-elastics-twagzs patched (no change) Warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely. pod "test-db-client-connectionstress-elastics-twagzs" force deleted check failover pod name failover pod name:elastics-twagzs-mdit-0 failover connectionstress Success No resources found in ns-nvunr namespace. check db_client batch data count `echo "curl -X GET 'elastics-twagzs-mdit-http.ns-nvunr.svc.cluster.local:9200/executions_loop_index/_search' -H 'Content-Type: application/json' -d '***\"size\": 0,\"track_total_hits\": true***' " | kubectl exec -it elastics-twagzs-mdit-0 --namespace ns-nvunr -- sh ` check db_client batch data Success `kubectl get pvc -l app.kubernetes.io/instance=elastics-twagzs,apps.kubeblocks.io/component-name=mdit,apps.kubeblocks.io/vct-name=data --namespace ns-nvunr ` cluster volume-expand check cluster status before ops check cluster status done cluster_status:Running No resources found in elastics-twagzs namespace. `kbcli cluster volume-expand elastics-twagzs --auto-approve --force=true --components mdit --volume-claim-templates data --storage 24Gi --namespace ns-nvunr ` OpsRequest elastics-twagzs-volumeexpansion-9cwpb created successfully, you can view the progress: kbcli cluster describe-ops elastics-twagzs-volumeexpansion-9cwpb -n ns-nvunr check ops status `kbcli cluster list-ops elastics-twagzs --status all --namespace ns-nvunr ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME elastics-twagzs-volumeexpansion-9cwpb ns-nvunr VolumeExpansion elastics-twagzs mdit Pending -/- Sep 01,2025 11:37 UTC+0800 ops_status:elastics-twagzs-volumeexpansion-9cwpb ns-nvunr VolumeExpansion elastics-twagzs mdit Creating -/- Sep 01,2025 11:37 UTC+0800 check cluster status `kbcli cluster list elastics-twagzs --show-labels --namespace ns-nvunr ` NAME NAMESPACE CLUSTER-DEFINITION VERSION TERMINATION-POLICY STATUS CREATED-TIME LABELS elastics-twagzs ns-nvunr WipeOut Updating Sep 01,2025 11:23 UTC+0800 app.kubernetes.io/instance=elastics-twagzs cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances elastics-twagzs --namespace ns-nvunr ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME elastics-twagzs-kibana-0 ns-nvunr elastics-twagzs kibana Running 0 600m / 600m 2254857830400m / 2254857830400m aks-cicdamdpool-38368475-vmss000000/10.224.0.5 Sep 01,2025 11:35 UTC+0800 elastics-twagzs-mdit-0 ns-nvunr elastics-twagzs mdit Running 0 500m / 500m 2Gi / 2Gi data:24Gi aks-cicdamdpool-38368475-vmss000000/10.224.0.5 Sep 01,2025 11:23 UTC+0800 elastics-twagzs-mdit-1 ns-nvunr elastics-twagzs mdit Running 0 500m / 500m 2Gi / 2Gi data:24Gi aks-cicdamdpool-38368475-vmss000000/10.224.0.5 Sep 01,2025 11:23 UTC+0800 elastics-twagzs-mdit-2 ns-nvunr elastics-twagzs mdit Running 0 500m / 500m 2Gi / 2Gi data:24Gi aks-cicdamdpool-38368475-vmss000000/10.224.0.5 Sep 01,2025 11:23 UTC+0800 check pod status done No resources found in ns-nvunr namespace. check cluster connect `echo "curl http://elastics-twagzs-mdit-http.ns-nvunr.svc.cluster.local:9200/_cluster/health\?pretty " | kubectl exec -it elastics-twagzs-mdit-0 --namespace ns-nvunr -- sh` check cluster connect done No resources found in elastics-twagzs namespace. check ops status `kbcli cluster list-ops elastics-twagzs --status all --namespace ns-nvunr ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME elastics-twagzs-volumeexpansion-9cwpb ns-nvunr VolumeExpansion elastics-twagzs mdit Succeed 3/3 Sep 01,2025 11:37 UTC+0800 check ops status done ops_status:elastics-twagzs-volumeexpansion-9cwpb ns-nvunr VolumeExpansion elastics-twagzs mdit Succeed 3/3 Sep 01,2025 11:37 UTC+0800 `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge opsrequests elastics-twagzs-volumeexpansion-9cwpb --namespace ns-nvunr ` opsrequest.apps.kubeblocks.io/elastics-twagzs-volumeexpansion-9cwpb patched `kbcli cluster delete-ops --name elastics-twagzs-volumeexpansion-9cwpb --force --auto-approve --namespace ns-nvunr ` OpsRequest elastics-twagzs-volumeexpansion-9cwpb deleted No resources found in ns-nvunr namespace. check db_client batch data count `echo "curl -X GET 'elastics-twagzs-mdit-http.ns-nvunr.svc.cluster.local:9200/executions_loop_index/_search' -H 'Content-Type: application/json' -d '***\"size\": 0,\"track_total_hits\": true***' " | kubectl exec -it elastics-twagzs-mdit-0 --namespace ns-nvunr -- sh ` check db_client batch data Success cluster restart check cluster status before ops check cluster status done cluster_status:Running `kbcli cluster restart elastics-twagzs --auto-approve --force=true --components mdit --namespace ns-nvunr ` OpsRequest elastics-twagzs-restart-78zcs created successfully, you can view the progress: kbcli cluster describe-ops elastics-twagzs-restart-78zcs -n ns-nvunr check ops status `kbcli cluster list-ops elastics-twagzs --status all --namespace ns-nvunr ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME elastics-twagzs-restart-78zcs ns-nvunr Restart elastics-twagzs mdit Creating -/- Sep 01,2025 11:43 UTC+0800 check cluster status `kbcli cluster list elastics-twagzs --show-labels --namespace ns-nvunr ` NAME NAMESPACE CLUSTER-DEFINITION VERSION TERMINATION-POLICY STATUS CREATED-TIME LABELS elastics-twagzs ns-nvunr WipeOut Updating Sep 01,2025 11:23 UTC+0800 app.kubernetes.io/instance=elastics-twagzs cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances elastics-twagzs --namespace ns-nvunr ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME elastics-twagzs-kibana-0 ns-nvunr elastics-twagzs kibana Running 0 600m / 600m 2254857830400m / 2254857830400m aks-cicdamdpool-38368475-vmss000006/10.224.0.10 Sep 01,2025 11:44 UTC+0800 elastics-twagzs-mdit-0 ns-nvunr elastics-twagzs mdit Running 0 500m / 500m 2Gi / 2Gi data:24Gi aks-cicdamdpool-38368475-vmss000006/10.224.0.10 Sep 01,2025 11:45 UTC+0800 elastics-twagzs-mdit-1 ns-nvunr elastics-twagzs mdit Running 0 500m / 500m 2Gi / 2Gi data:24Gi aks-cicdamdpool-38368475-vmss000006/10.224.0.10 Sep 01,2025 11:44 UTC+0800 elastics-twagzs-mdit-2 ns-nvunr elastics-twagzs mdit Running 0 500m / 500m 2Gi / 2Gi data:24Gi aks-cicdamdpool-38368475-vmss000006/10.224.0.10 Sep 01,2025 11:44 UTC+0800 check pod status done No resources found in ns-nvunr namespace. check cluster connect `echo "curl http://elastics-twagzs-mdit-http.ns-nvunr.svc.cluster.local:9200/_cluster/health\?pretty " | kubectl exec -it elastics-twagzs-mdit-0 --namespace ns-nvunr -- sh` check cluster connect done check ops status `kbcli cluster list-ops elastics-twagzs --status all --namespace ns-nvunr ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME elastics-twagzs-restart-78zcs ns-nvunr Restart elastics-twagzs mdit Succeed 3/3 Sep 01,2025 11:43 UTC+0800 check ops status done ops_status:elastics-twagzs-restart-78zcs ns-nvunr Restart elastics-twagzs mdit Succeed 3/3 Sep 01,2025 11:43 UTC+0800 `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge opsrequests elastics-twagzs-restart-78zcs --namespace ns-nvunr ` opsrequest.apps.kubeblocks.io/elastics-twagzs-restart-78zcs patched `kbcli cluster delete-ops --name elastics-twagzs-restart-78zcs --force --auto-approve --namespace ns-nvunr ` OpsRequest elastics-twagzs-restart-78zcs deleted No resources found in ns-nvunr namespace. check db_client batch data count `echo "curl -X GET 'elastics-twagzs-mdit-http.ns-nvunr.svc.cluster.local:9200/executions_loop_index/_search' -H 'Content-Type: application/json' -d '***\"size\": 0,\"track_total_hits\": true***' " | kubectl exec -it elastics-twagzs-mdit-0 --namespace ns-nvunr -- sh ` check db_client batch data Success cluster hscale check cluster status before ops check cluster status done cluster_status:Running No resources found in elastics-twagzs namespace. `kbcli cluster hscale elastics-twagzs --auto-approve --force=true --components mdit --replicas 4 --namespace ns-nvunr ` OpsRequest elastics-twagzs-horizontalscaling-pqlml created successfully, you can view the progress: kbcli cluster describe-ops elastics-twagzs-horizontalscaling-pqlml -n ns-nvunr check ops status `kbcli cluster list-ops elastics-twagzs --status all --namespace ns-nvunr ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME elastics-twagzs-horizontalscaling-pqlml ns-nvunr HorizontalScaling elastics-twagzs mdit Pending -/- Sep 01,2025 11:47 UTC+0800 check cluster status `kbcli cluster list elastics-twagzs --show-labels --namespace ns-nvunr ` NAME NAMESPACE CLUSTER-DEFINITION VERSION TERMINATION-POLICY STATUS CREATED-TIME LABELS elastics-twagzs ns-nvunr WipeOut Updating Sep 01,2025 11:23 UTC+0800 app.kubernetes.io/instance=elastics-twagzs cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances elastics-twagzs --namespace ns-nvunr ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME elastics-twagzs-kibana-0 ns-nvunr elastics-twagzs kibana Running 0 600m / 600m 2254857830400m / 2254857830400m aks-cicdamdpool-38368475-vmss000006/10.224.0.10 Sep 01,2025 11:44 UTC+0800 elastics-twagzs-mdit-0 ns-nvunr elastics-twagzs mdit Running 0 500m / 500m 2Gi / 2Gi data:24Gi aks-cicdamdpool-38368475-vmss000006/10.224.0.10 Sep 01,2025 11:45 UTC+0800 elastics-twagzs-mdit-1 ns-nvunr elastics-twagzs mdit Running 0 500m / 500m 2Gi / 2Gi data:24Gi aks-cicdamdpool-38368475-vmss000006/10.224.0.10 Sep 01,2025 11:44 UTC+0800 elastics-twagzs-mdit-2 ns-nvunr elastics-twagzs mdit Running 0 500m / 500m 2Gi / 2Gi data:24Gi aks-cicdamdpool-38368475-vmss000006/10.224.0.10 Sep 01,2025 11:44 UTC+0800 elastics-twagzs-mdit-3 ns-nvunr elastics-twagzs mdit Running 0 500m / 500m 2Gi / 2Gi data:24Gi aks-cicdamdpool-38368475-vmss000000/10.224.0.5 Sep 01,2025 11:47 UTC+0800 check pod status done No resources found in ns-nvunr namespace. check cluster connect `echo "curl http://elastics-twagzs-mdit-http.ns-nvunr.svc.cluster.local:9200/_cluster/health\?pretty " | kubectl exec -it elastics-twagzs-mdit-0 --namespace ns-nvunr -- sh` check cluster connect done No resources found in elastics-twagzs namespace. check ops status `kbcli cluster list-ops elastics-twagzs --status all --namespace ns-nvunr ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME elastics-twagzs-horizontalscaling-pqlml ns-nvunr HorizontalScaling elastics-twagzs mdit Succeed 1/1 Sep 01,2025 11:47 UTC+0800 check ops status done ops_status:elastics-twagzs-horizontalscaling-pqlml ns-nvunr HorizontalScaling elastics-twagzs mdit Succeed 1/1 Sep 01,2025 11:47 UTC+0800 `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge opsrequests elastics-twagzs-horizontalscaling-pqlml --namespace ns-nvunr ` opsrequest.apps.kubeblocks.io/elastics-twagzs-horizontalscaling-pqlml patched `kbcli cluster delete-ops --name elastics-twagzs-horizontalscaling-pqlml --force --auto-approve --namespace ns-nvunr ` OpsRequest elastics-twagzs-horizontalscaling-pqlml deleted No resources found in ns-nvunr namespace. check db_client batch data count `echo "curl -X GET 'elastics-twagzs-mdit-http.ns-nvunr.svc.cluster.local:9200/executions_loop_index/_search' -H 'Content-Type: application/json' -d '***\"size\": 0,\"track_total_hits\": true***' " | kubectl exec -it elastics-twagzs-mdit-0 --namespace ns-nvunr -- sh ` check db_client batch data Success cluster hscale check cluster status before ops check cluster status done cluster_status:Running No resources found in elastics-twagzs namespace. `kbcli cluster hscale elastics-twagzs --auto-approve --force=true --components mdit --replicas 3 --namespace ns-nvunr ` OpsRequest elastics-twagzs-horizontalscaling-fffqx created successfully, you can view the progress: kbcli cluster describe-ops elastics-twagzs-horizontalscaling-fffqx -n ns-nvunr check ops status `kbcli cluster list-ops elastics-twagzs --status all --namespace ns-nvunr ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME elastics-twagzs-horizontalscaling-fffqx ns-nvunr HorizontalScaling elastics-twagzs mdit Creating -/- Sep 01,2025 11:49 UTC+0800 check cluster status `kbcli cluster list elastics-twagzs --show-labels --namespace ns-nvunr ` NAME NAMESPACE CLUSTER-DEFINITION VERSION TERMINATION-POLICY STATUS CREATED-TIME LABELS elastics-twagzs ns-nvunr WipeOut Updating Sep 01,2025 11:23 UTC+0800 app.kubernetes.io/instance=elastics-twagzs cluster_status:Updating cluster_status:Updating check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances elastics-twagzs --namespace ns-nvunr ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME elastics-twagzs-kibana-0 ns-nvunr elastics-twagzs kibana Running 0 600m / 600m 2254857830400m / 2254857830400m aks-cicdamdpool-38368475-vmss000006/10.224.0.10 Sep 01,2025 11:44 UTC+0800 elastics-twagzs-mdit-0 ns-nvunr elastics-twagzs mdit Running 0 500m / 500m 2Gi / 2Gi data:24Gi aks-cicdamdpool-38368475-vmss000006/10.224.0.10 Sep 01,2025 11:45 UTC+0800 elastics-twagzs-mdit-1 ns-nvunr elastics-twagzs mdit Running 0 500m / 500m 2Gi / 2Gi data:24Gi aks-cicdamdpool-38368475-vmss000006/10.224.0.10 Sep 01,2025 11:44 UTC+0800 elastics-twagzs-mdit-2 ns-nvunr elastics-twagzs mdit Running 0 500m / 500m 2Gi / 2Gi data:24Gi aks-cicdamdpool-38368475-vmss000006/10.224.0.10 Sep 01,2025 11:44 UTC+0800 check pod status done No resources found in ns-nvunr namespace. check cluster connect `echo "curl http://elastics-twagzs-mdit-http.ns-nvunr.svc.cluster.local:9200/_cluster/health\?pretty " | kubectl exec -it elastics-twagzs-mdit-0 --namespace ns-nvunr -- sh` check cluster connect done No resources found in elastics-twagzs namespace. check ops status `kbcli cluster list-ops elastics-twagzs --status all --namespace ns-nvunr ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME elastics-twagzs-horizontalscaling-fffqx ns-nvunr HorizontalScaling elastics-twagzs mdit Succeed 1/1 Sep 01,2025 11:49 UTC+0800 check ops status done ops_status:elastics-twagzs-horizontalscaling-fffqx ns-nvunr HorizontalScaling elastics-twagzs mdit Succeed 1/1 Sep 01,2025 11:49 UTC+0800 `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge opsrequests elastics-twagzs-horizontalscaling-fffqx --namespace ns-nvunr ` opsrequest.apps.kubeblocks.io/elastics-twagzs-horizontalscaling-fffqx patched `kbcli cluster delete-ops --name elastics-twagzs-horizontalscaling-fffqx --force --auto-approve --namespace ns-nvunr ` OpsRequest elastics-twagzs-horizontalscaling-fffqx deleted No resources found in ns-nvunr namespace. check db_client batch data count `echo "curl -X GET 'elastics-twagzs-mdit-http.ns-nvunr.svc.cluster.local:9200/executions_loop_index/_search' -H 'Content-Type: application/json' -d '***\"size\": 0,\"track_total_hits\": true***' " | kubectl exec -it elastics-twagzs-mdit-0 --namespace ns-nvunr -- sh ` check db_client batch data Success cluster restart check cluster status before ops check cluster status done cluster_status:Running `kbcli cluster restart elastics-twagzs --auto-approve --force=true --namespace ns-nvunr ` OpsRequest elastics-twagzs-restart-m7575 created successfully, you can view the progress: kbcli cluster describe-ops elastics-twagzs-restart-m7575 -n ns-nvunr check ops status `kbcli cluster list-ops elastics-twagzs --status all --namespace ns-nvunr ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME elastics-twagzs-restart-m7575 ns-nvunr Restart elastics-twagzs mdit,kibana Creating -/- Sep 01,2025 11:50 UTC+0800 ops_status:elastics-twagzs-restart-m7575 ns-nvunr Restart elastics-twagzs mdit,kibana Creating -/- Sep 01,2025 11:50 UTC+0800 check cluster status `kbcli cluster list elastics-twagzs --show-labels --namespace ns-nvunr ` NAME NAMESPACE CLUSTER-DEFINITION VERSION TERMINATION-POLICY STATUS CREATED-TIME LABELS elastics-twagzs ns-nvunr WipeOut Updating Sep 01,2025 11:23 UTC+0800 app.kubernetes.io/instance=elastics-twagzs cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances elastics-twagzs --namespace ns-nvunr ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME elastics-twagzs-kibana-0 ns-nvunr elastics-twagzs kibana Running 0 600m / 600m 2254857830400m / 2254857830400m aks-cicdamdpool-38368475-vmss000006/10.224.0.10 Sep 01,2025 11:55 UTC+0800 elastics-twagzs-mdit-0 ns-nvunr elastics-twagzs mdit Running 0 500m / 500m 2Gi / 2Gi data:24Gi aks-cicdamdpool-38368475-vmss000006/10.224.0.10 Sep 01,2025 11:59 UTC+0800 elastics-twagzs-mdit-1 ns-nvunr elastics-twagzs mdit Running 0 500m / 500m 2Gi / 2Gi data:24Gi aks-cicdamdpool-38368475-vmss000007/10.224.0.9 Sep 01,2025 11:53 UTC+0800 elastics-twagzs-mdit-2 ns-nvunr elastics-twagzs mdit Running 0 500m / 500m 2Gi / 2Gi data:24Gi aks-cicdamdpool-38368475-vmss000006/10.224.0.10 Sep 01,2025 11:55 UTC+0800 check pod status done No resources found in ns-nvunr namespace. check cluster connect `echo "curl http://elastics-twagzs-mdit-http.ns-nvunr.svc.cluster.local:9200/_cluster/health\?pretty " | kubectl exec -it elastics-twagzs-mdit-0 --namespace ns-nvunr -- sh` check cluster connect done check ops status `kbcli cluster list-ops elastics-twagzs --status all --namespace ns-nvunr ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME elastics-twagzs-restart-m7575 ns-nvunr Restart elastics-twagzs mdit,kibana Succeed 4/4 Sep 01,2025 11:50 UTC+0800 check ops status done ops_status:elastics-twagzs-restart-m7575 ns-nvunr Restart elastics-twagzs mdit,kibana Succeed 4/4 Sep 01,2025 11:50 UTC+0800 `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge opsrequests elastics-twagzs-restart-m7575 --namespace ns-nvunr ` opsrequest.apps.kubeblocks.io/elastics-twagzs-restart-m7575 patched `kbcli cluster delete-ops --name elastics-twagzs-restart-m7575 --force --auto-approve --namespace ns-nvunr ` OpsRequest elastics-twagzs-restart-m7575 deleted No resources found in ns-nvunr namespace. check db_client batch data count `echo "curl -X GET 'elastics-twagzs-mdit-http.ns-nvunr.svc.cluster.local:9200/executions_loop_index/_search' -H 'Content-Type: application/json' -d '***\"size\": 0,\"track_total_hits\": true***' " | kubectl exec -it elastics-twagzs-mdit-0 --namespace ns-nvunr -- sh ` check db_client batch data Success cluster hscale offline instances apiVersion: apps.kubeblocks.io/v1alpha1 kind: OpsRequest metadata: generateName: elastics-twagzs-hscaleoffinstance- labels: app.kubernetes.io/instance: elastics-twagzs app.kubernetes.io/managed-by: kubeblocks namespace: ns-nvunr spec: type: HorizontalScaling clusterName: elastics-twagzs force: true horizontalScaling: - componentName: mdit scaleIn: onlineInstancesToOffline: - elastics-twagzs-mdit-0 check cluster status before ops check cluster status done cluster_status:Running `kubectl create -f test_ops_cluster_elastics-twagzs.yaml` opsrequest.apps.kubeblocks.io/elastics-twagzs-hscaleoffinstance-wjggs created create test_ops_cluster_elastics-twagzs.yaml Success `rm -rf test_ops_cluster_elastics-twagzs.yaml` check ops status `kbcli cluster list-ops elastics-twagzs --status all --namespace ns-nvunr ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME elastics-twagzs-hscaleoffinstance-wjggs ns-nvunr HorizontalScaling elastics-twagzs mdit Creating -/- Sep 01,2025 12:01 UTC+0800 check cluster status `kbcli cluster list elastics-twagzs --show-labels --namespace ns-nvunr ` NAME NAMESPACE CLUSTER-DEFINITION VERSION TERMINATION-POLICY STATUS CREATED-TIME LABELS elastics-twagzs ns-nvunr WipeOut Updating Sep 01,2025 11:23 UTC+0800 app.kubernetes.io/instance=elastics-twagzs cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances elastics-twagzs --namespace ns-nvunr ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME elastics-twagzs-kibana-0 ns-nvunr elastics-twagzs kibana Running 0 600m / 600m 2254857830400m / 2254857830400m aks-cicdamdpool-38368475-vmss000006/10.224.0.10 Sep 01,2025 11:55 UTC+0800 elastics-twagzs-mdit-1 ns-nvunr elastics-twagzs mdit Running 0 500m / 500m 2Gi / 2Gi data:24Gi aks-cicdamdpool-38368475-vmss000006/10.224.0.10 Sep 01,2025 12:01 UTC+0800 elastics-twagzs-mdit-2 ns-nvunr elastics-twagzs mdit Running 0 500m / 500m 2Gi / 2Gi data:24Gi aks-cicdamdpool-38368475-vmss000006/10.224.0.10 Sep 01,2025 11:55 UTC+0800 check pod status done No resources found in ns-nvunr namespace. check cluster connect `echo "curl http://elastics-twagzs-mdit-http.ns-nvunr.svc.cluster.local:9200/_cluster/health\?pretty " | kubectl exec -it elastics-twagzs-mdit-1 --namespace ns-nvunr -- sh` check cluster connect done check ops status `kbcli cluster list-ops elastics-twagzs --status all --namespace ns-nvunr ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME elastics-twagzs-hscaleoffinstance-wjggs ns-nvunr HorizontalScaling elastics-twagzs mdit Succeed 1/1 Sep 01,2025 12:01 UTC+0800 check ops status done ops_status:elastics-twagzs-hscaleoffinstance-wjggs ns-nvunr HorizontalScaling elastics-twagzs mdit Succeed 1/1 Sep 01,2025 12:01 UTC+0800 `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge opsrequests elastics-twagzs-hscaleoffinstance-wjggs --namespace ns-nvunr ` opsrequest.apps.kubeblocks.io/elastics-twagzs-hscaleoffinstance-wjggs patched `kbcli cluster delete-ops --name elastics-twagzs-hscaleoffinstance-wjggs --force --auto-approve --namespace ns-nvunr ` OpsRequest elastics-twagzs-hscaleoffinstance-wjggs deleted No resources found in ns-nvunr namespace. check db_client batch data count `echo "curl -X GET 'elastics-twagzs-mdit-http.ns-nvunr.svc.cluster.local:9200/executions_loop_index/_search' -H 'Content-Type: application/json' -d '***\"size\": 0,\"track_total_hits\": true***' " | kubectl exec -it elastics-twagzs-mdit-1 --namespace ns-nvunr -- sh ` check db_client batch data Success cluster hscale online instances apiVersion: apps.kubeblocks.io/v1alpha1 kind: OpsRequest metadata: generateName: elastics-twagzs-hscaleoninstance- labels: app.kubernetes.io/instance: elastics-twagzs app.kubernetes.io/managed-by: kubeblocks namespace: ns-nvunr spec: type: HorizontalScaling clusterName: elastics-twagzs force: true horizontalScaling: - componentName: mdit scaleOut: offlineInstancesToOnline: - elastics-twagzs-mdit-0 check cluster status before ops check cluster status done cluster_status:Running `kubectl create -f test_ops_cluster_elastics-twagzs.yaml` opsrequest.apps.kubeblocks.io/elastics-twagzs-hscaleoninstance-pgkzl created create test_ops_cluster_elastics-twagzs.yaml Success `rm -rf test_ops_cluster_elastics-twagzs.yaml` check ops status `kbcli cluster list-ops elastics-twagzs --status all --namespace ns-nvunr ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME elastics-twagzs-hscaleoninstance-pgkzl ns-nvunr HorizontalScaling elastics-twagzs mdit Creating -/- Sep 01,2025 12:03 UTC+0800 check cluster status `kbcli cluster list elastics-twagzs --show-labels --namespace ns-nvunr ` NAME NAMESPACE CLUSTER-DEFINITION VERSION TERMINATION-POLICY STATUS CREATED-TIME LABELS elastics-twagzs ns-nvunr WipeOut Updating Sep 01,2025 11:23 UTC+0800 app.kubernetes.io/instance=elastics-twagzs cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances elastics-twagzs --namespace ns-nvunr ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME elastics-twagzs-kibana-0 ns-nvunr elastics-twagzs kibana Running 0 600m / 600m 2254857830400m / 2254857830400m aks-cicdamdpool-38368475-vmss000006/10.224.0.10 Sep 01,2025 11:55 UTC+0800 elastics-twagzs-mdit-0 ns-nvunr elastics-twagzs mdit Running 0 500m / 500m 2Gi / 2Gi data:24Gi aks-cicdamdpool-38368475-vmss000000/10.224.0.5 Sep 01,2025 12:03 UTC+0800 elastics-twagzs-mdit-1 ns-nvunr elastics-twagzs mdit Running 0 500m / 500m 2Gi / 2Gi data:24Gi aks-cicdamdpool-38368475-vmss000006/10.224.0.10 Sep 01,2025 12:01 UTC+0800 elastics-twagzs-mdit-2 ns-nvunr elastics-twagzs mdit Running 0 500m / 500m 2Gi / 2Gi data:24Gi aks-cicdamdpool-38368475-vmss000006/10.224.0.10 Sep 01,2025 11:55 UTC+0800 check pod status done No resources found in ns-nvunr namespace. check cluster connect `echo "curl http://elastics-twagzs-mdit-http.ns-nvunr.svc.cluster.local:9200/_cluster/health\?pretty " | kubectl exec -it elastics-twagzs-mdit-0 --namespace ns-nvunr -- sh` check cluster connect done check ops status `kbcli cluster list-ops elastics-twagzs --status all --namespace ns-nvunr ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME elastics-twagzs-hscaleoninstance-pgkzl ns-nvunr HorizontalScaling elastics-twagzs mdit Succeed 1/1 Sep 01,2025 12:03 UTC+0800 check ops status done ops_status:elastics-twagzs-hscaleoninstance-pgkzl ns-nvunr HorizontalScaling elastics-twagzs mdit Succeed 1/1 Sep 01,2025 12:03 UTC+0800 `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge opsrequests elastics-twagzs-hscaleoninstance-pgkzl --namespace ns-nvunr ` opsrequest.apps.kubeblocks.io/elastics-twagzs-hscaleoninstance-pgkzl patched `kbcli cluster delete-ops --name elastics-twagzs-hscaleoninstance-pgkzl --force --auto-approve --namespace ns-nvunr ` OpsRequest elastics-twagzs-hscaleoninstance-pgkzl deleted No resources found in ns-nvunr namespace. check db_client batch data count `echo "curl -X GET 'elastics-twagzs-mdit-http.ns-nvunr.svc.cluster.local:9200/executions_loop_index/_search' -H 'Content-Type: application/json' -d '***\"size\": 0,\"track_total_hits\": true***' " | kubectl exec -it elastics-twagzs-mdit-0 --namespace ns-nvunr -- sh ` check db_client batch data Success cluster stop check cluster status before ops check cluster status done cluster_status:Running `kbcli cluster stop elastics-twagzs --auto-approve --force=true --namespace ns-nvunr ` OpsRequest elastics-twagzs-stop-dwp2l created successfully, you can view the progress: kbcli cluster describe-ops elastics-twagzs-stop-dwp2l -n ns-nvunr check ops status `kbcli cluster list-ops elastics-twagzs --status all --namespace ns-nvunr ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME elastics-twagzs-stop-dwp2l ns-nvunr Stop elastics-twagzs Creating -/- Sep 01,2025 12:05 UTC+0800 check cluster status `kbcli cluster list elastics-twagzs --show-labels --namespace ns-nvunr ` NAME NAMESPACE CLUSTER-DEFINITION VERSION TERMINATION-POLICY STATUS CREATED-TIME LABELS elastics-twagzs ns-nvunr WipeOut Stopping Sep 01,2025 11:23 UTC+0800 app.kubernetes.io/instance=elastics-twagzs cluster_status:Stopping cluster_status:Stopping cluster_status:Stopping cluster_status:Stopping cluster_status:Stopping cluster_status:Stopping cluster_status:Stopping check cluster status done cluster_status:Stopped check pod status `kbcli cluster list-instances elastics-twagzs --namespace ns-nvunr ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME check pod status done check ops status `kbcli cluster list-ops elastics-twagzs --status all --namespace ns-nvunr ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME elastics-twagzs-stop-dwp2l ns-nvunr Stop elastics-twagzs kibana,mdit Succeed 4/4 Sep 01,2025 12:05 UTC+0800 check ops status done ops_status:elastics-twagzs-stop-dwp2l ns-nvunr Stop elastics-twagzs kibana,mdit Succeed 4/4 Sep 01,2025 12:05 UTC+0800 `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge opsrequests elastics-twagzs-stop-dwp2l --namespace ns-nvunr ` opsrequest.apps.kubeblocks.io/elastics-twagzs-stop-dwp2l patched `kbcli cluster delete-ops --name elastics-twagzs-stop-dwp2l --force --auto-approve --namespace ns-nvunr ` OpsRequest elastics-twagzs-stop-dwp2l deleted cluster start check cluster status before ops check cluster status done cluster_status:Stopped `kbcli cluster start elastics-twagzs --force=true --namespace ns-nvunr ` OpsRequest elastics-twagzs-start-g58jk created successfully, you can view the progress: kbcli cluster describe-ops elastics-twagzs-start-g58jk -n ns-nvunr check ops status `kbcli cluster list-ops elastics-twagzs --status all --namespace ns-nvunr ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME elastics-twagzs-start-g58jk ns-nvunr Start elastics-twagzs Running -/- Sep 01,2025 12:07 UTC+0800 check cluster status `kbcli cluster list elastics-twagzs --show-labels --namespace ns-nvunr ` NAME NAMESPACE CLUSTER-DEFINITION VERSION TERMINATION-POLICY STATUS CREATED-TIME LABELS elastics-twagzs ns-nvunr WipeOut Updating Sep 01,2025 11:23 UTC+0800 app.kubernetes.io/instance=elastics-twagzs cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances elastics-twagzs --namespace ns-nvunr ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME elastics-twagzs-kibana-0 ns-nvunr elastics-twagzs kibana Running 0 600m / 600m 2254857830400m / 2254857830400m aks-cicdamdpool-38368475-vmss000000/10.224.0.5 Sep 01,2025 12:07 UTC+0800 elastics-twagzs-mdit-0 ns-nvunr elastics-twagzs mdit Running 0 500m / 500m 2Gi / 2Gi data:24Gi aks-cicdamdpool-38368475-vmss000006/10.224.0.10 Sep 01,2025 12:07 UTC+0800 elastics-twagzs-mdit-1 ns-nvunr elastics-twagzs mdit Running 0 500m / 500m 2Gi / 2Gi data:24Gi aks-cicdamdpool-38368475-vmss000006/10.224.0.10 Sep 01,2025 12:07 UTC+0800 elastics-twagzs-mdit-2 ns-nvunr elastics-twagzs mdit Running 0 500m / 500m 2Gi / 2Gi data:24Gi aks-cicdamdpool-38368475-vmss000000/10.224.0.5 Sep 01,2025 12:07 UTC+0800 check pod status done No resources found in ns-nvunr namespace. check cluster connect `echo "curl http://elastics-twagzs-mdit-http.ns-nvunr.svc.cluster.local:9200/_cluster/health\?pretty " | kubectl exec -it elastics-twagzs-mdit-0 --namespace ns-nvunr -- sh` check cluster connect done check ops status `kbcli cluster list-ops elastics-twagzs --status all --namespace ns-nvunr ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME elastics-twagzs-start-g58jk ns-nvunr Start elastics-twagzs kibana,mdit Succeed 4/4 Sep 01,2025 12:07 UTC+0800 check ops status done ops_status:elastics-twagzs-start-g58jk ns-nvunr Start elastics-twagzs kibana,mdit Succeed 4/4 Sep 01,2025 12:07 UTC+0800 `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge opsrequests elastics-twagzs-start-g58jk --namespace ns-nvunr ` opsrequest.apps.kubeblocks.io/elastics-twagzs-start-g58jk patched `kbcli cluster delete-ops --name elastics-twagzs-start-g58jk --force --auto-approve --namespace ns-nvunr ` OpsRequest elastics-twagzs-start-g58jk deleted No resources found in ns-nvunr namespace. check db_client batch data count `echo "curl -X GET 'elastics-twagzs-mdit-http.ns-nvunr.svc.cluster.local:9200/executions_loop_index/_search' -H 'Content-Type: application/json' -d '***\"size\": 0,\"track_total_hits\": true***' " | kubectl exec -it elastics-twagzs-mdit-0 --namespace ns-nvunr -- sh ` check db_client batch data Success cluster vscale check cluster status before ops check cluster status done cluster_status:Running `kbcli cluster vscale elastics-twagzs --auto-approve --force=true --components mdit --cpu 600m --memory 2.1Gi --namespace ns-nvunr ` OpsRequest elastics-twagzs-verticalscaling-grtpq created successfully, you can view the progress: kbcli cluster describe-ops elastics-twagzs-verticalscaling-grtpq -n ns-nvunr check ops status `kbcli cluster list-ops elastics-twagzs --status all --namespace ns-nvunr ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME elastics-twagzs-verticalscaling-grtpq ns-nvunr VerticalScaling elastics-twagzs mdit Running -/- Sep 01,2025 12:10 UTC+0800 check cluster status `kbcli cluster list elastics-twagzs --show-labels --namespace ns-nvunr ` NAME NAMESPACE CLUSTER-DEFINITION VERSION TERMINATION-POLICY STATUS CREATED-TIME LABELS elastics-twagzs ns-nvunr WipeOut Updating Sep 01,2025 11:23 UTC+0800 app.kubernetes.io/instance=elastics-twagzs cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances elastics-twagzs --namespace ns-nvunr ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME elastics-twagzs-kibana-0 ns-nvunr elastics-twagzs kibana Running 0 600m / 600m 2254857830400m / 2254857830400m aks-cicdamdpool-38368475-vmss000000/10.224.0.5 Sep 01,2025 12:07 UTC+0800 elastics-twagzs-mdit-0 ns-nvunr elastics-twagzs mdit Running 0 600m / 600m 2254857830400m / 2254857830400m data:24Gi aks-cicdamdpool-38368475-vmss000006/10.224.0.10 Sep 01,2025 12:14 UTC+0800 elastics-twagzs-mdit-1 ns-nvunr elastics-twagzs mdit Running 0 600m / 600m 2254857830400m / 2254857830400m data:24Gi aks-cicdamdpool-38368475-vmss000000/10.224.0.5 Sep 01,2025 12:12 UTC+0800 elastics-twagzs-mdit-2 ns-nvunr elastics-twagzs mdit Running 0 600m / 600m 2254857830400m / 2254857830400m data:24Gi aks-cicdamdpool-38368475-vmss000000/10.224.0.5 Sep 01,2025 12:10 UTC+0800 check pod status done No resources found in ns-nvunr namespace. check cluster connect `echo "curl http://elastics-twagzs-mdit-http.ns-nvunr.svc.cluster.local:9200/_cluster/health\?pretty " | kubectl exec -it elastics-twagzs-mdit-0 --namespace ns-nvunr -- sh` check cluster connect done check ops status `kbcli cluster list-ops elastics-twagzs --status all --namespace ns-nvunr ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME elastics-twagzs-verticalscaling-grtpq ns-nvunr VerticalScaling elastics-twagzs mdit Succeed 3/3 Sep 01,2025 12:10 UTC+0800 check ops status done ops_status:elastics-twagzs-verticalscaling-grtpq ns-nvunr VerticalScaling elastics-twagzs mdit Succeed 3/3 Sep 01,2025 12:10 UTC+0800 `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge opsrequests elastics-twagzs-verticalscaling-grtpq --namespace ns-nvunr ` opsrequest.apps.kubeblocks.io/elastics-twagzs-verticalscaling-grtpq patched `kbcli cluster delete-ops --name elastics-twagzs-verticalscaling-grtpq --force --auto-approve --namespace ns-nvunr ` OpsRequest elastics-twagzs-verticalscaling-grtpq deleted No resources found in ns-nvunr namespace. check db_client batch data count `echo "curl -X GET 'elastics-twagzs-mdit-http.ns-nvunr.svc.cluster.local:9200/executions_loop_index/_search' -H 'Content-Type: application/json' -d '***\"size\": 0,\"track_total_hits\": true***' " | kubectl exec -it elastics-twagzs-mdit-0 --namespace ns-nvunr -- sh ` check db_client batch data Success check component kibana exists `kubectl get components -l app.kubernetes.io/instance=elastics-twagzs,apps.kubeblocks.io/component-name=kibana --namespace ns-nvunr | (grep "kibana" || true )` cluster restart check cluster status before ops check cluster status done cluster_status:Running `kbcli cluster restart elastics-twagzs --auto-approve --force=true --components kibana --namespace ns-nvunr ` OpsRequest elastics-twagzs-restart-cpdjs created successfully, you can view the progress: kbcli cluster describe-ops elastics-twagzs-restart-cpdjs -n ns-nvunr check ops status `kbcli cluster list-ops elastics-twagzs --status all --namespace ns-nvunr ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME elastics-twagzs-restart-cpdjs ns-nvunr Restart elastics-twagzs kibana Pending -/- Sep 01,2025 12:15 UTC+0800 check cluster status `kbcli cluster list elastics-twagzs --show-labels --namespace ns-nvunr ` NAME NAMESPACE CLUSTER-DEFINITION VERSION TERMINATION-POLICY STATUS CREATED-TIME LABELS elastics-twagzs ns-nvunr WipeOut Updating Sep 01,2025 11:23 UTC+0800 app.kubernetes.io/instance=elastics-twagzs cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances elastics-twagzs --namespace ns-nvunr ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME elastics-twagzs-kibana-0 ns-nvunr elastics-twagzs kibana Running 0 600m / 600m 2254857830400m / 2254857830400m aks-cicdamdpool-38368475-vmss000000/10.224.0.5 Sep 01,2025 12:16 UTC+0800 elastics-twagzs-mdit-0 ns-nvunr elastics-twagzs mdit Running 0 600m / 600m 2254857830400m / 2254857830400m data:24Gi aks-cicdamdpool-38368475-vmss000006/10.224.0.10 Sep 01,2025 12:14 UTC+0800 elastics-twagzs-mdit-1 ns-nvunr elastics-twagzs mdit Running 0 600m / 600m 2254857830400m / 2254857830400m data:24Gi aks-cicdamdpool-38368475-vmss000000/10.224.0.5 Sep 01,2025 12:12 UTC+0800 elastics-twagzs-mdit-2 ns-nvunr elastics-twagzs mdit Running 0 600m / 600m 2254857830400m / 2254857830400m data:24Gi aks-cicdamdpool-38368475-vmss000000/10.224.0.5 Sep 01,2025 12:10 UTC+0800 check pod status done No resources found in ns-nvunr namespace. check cluster connect `echo "curl http://elastics-twagzs-mdit-http.ns-nvunr.svc.cluster.local:9200/_cluster/health\?pretty " | kubectl exec -it elastics-twagzs-mdit-0 --namespace ns-nvunr -- sh` check cluster connect done check ops status `kbcli cluster list-ops elastics-twagzs --status all --namespace ns-nvunr ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME elastics-twagzs-restart-cpdjs ns-nvunr Restart elastics-twagzs kibana Succeed 1/1 Sep 01,2025 12:15 UTC+0800 check ops status done ops_status:elastics-twagzs-restart-cpdjs ns-nvunr Restart elastics-twagzs kibana Succeed 1/1 Sep 01,2025 12:15 UTC+0800 `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge opsrequests elastics-twagzs-restart-cpdjs --namespace ns-nvunr ` opsrequest.apps.kubeblocks.io/elastics-twagzs-restart-cpdjs patched `kbcli cluster delete-ops --name elastics-twagzs-restart-cpdjs --force --auto-approve --namespace ns-nvunr ` OpsRequest elastics-twagzs-restart-cpdjs deleted No resources found in ns-nvunr namespace. check db_client batch data count `echo "curl -X GET 'elastics-twagzs-mdit-http.ns-nvunr.svc.cluster.local:9200/executions_loop_index/_search' -H 'Content-Type: application/json' -d '***\"size\": 0,\"track_total_hits\": true***' " | kubectl exec -it elastics-twagzs-mdit-0 --namespace ns-nvunr -- sh ` check db_client batch data Success cluster update terminationPolicy WipeOut `kbcli cluster update elastics-twagzs --termination-policy=WipeOut --namespace ns-nvunr ` cluster.apps.kubeblocks.io/elastics-twagzs updated (no change) check cluster status `kbcli cluster list elastics-twagzs --show-labels --namespace ns-nvunr ` NAME NAMESPACE CLUSTER-DEFINITION VERSION TERMINATION-POLICY STATUS CREATED-TIME LABELS elastics-twagzs ns-nvunr WipeOut Running Sep 01,2025 11:23 UTC+0800 app.kubernetes.io/instance=elastics-twagzs check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances elastics-twagzs --namespace ns-nvunr ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME elastics-twagzs-kibana-0 ns-nvunr elastics-twagzs kibana Running 0 600m / 600m 2254857830400m / 2254857830400m aks-cicdamdpool-38368475-vmss000000/10.224.0.5 Sep 01,2025 12:16 UTC+0800 elastics-twagzs-mdit-0 ns-nvunr elastics-twagzs mdit Running 0 600m / 600m 2254857830400m / 2254857830400m data:24Gi aks-cicdamdpool-38368475-vmss000006/10.224.0.10 Sep 01,2025 12:14 UTC+0800 elastics-twagzs-mdit-1 ns-nvunr elastics-twagzs mdit Running 0 600m / 600m 2254857830400m / 2254857830400m data:24Gi aks-cicdamdpool-38368475-vmss000000/10.224.0.5 Sep 01,2025 12:12 UTC+0800 elastics-twagzs-mdit-2 ns-nvunr elastics-twagzs mdit Running 0 600m / 600m 2254857830400m / 2254857830400m data:24Gi aks-cicdamdpool-38368475-vmss000000/10.224.0.5 Sep 01,2025 12:10 UTC+0800 check pod status done No resources found in ns-nvunr namespace. check cluster connect `echo "curl http://elastics-twagzs-mdit-http.ns-nvunr.svc.cluster.local:9200/_cluster/health\?pretty " | kubectl exec -it elastics-twagzs-mdit-0 --namespace ns-nvunr -- sh` check cluster connect done cluster list-logs `kbcli cluster list-logs elastics-twagzs --namespace ns-nvunr ` No log files found. You can enable the log feature with the kbcli command below. kbcli cluster update elastics-twagzs --enable-all-logs=true --namespace ns-nvunr Error from server (NotFound): pods "elastics-twagzs-mdit-0" not found cluster logs `kbcli cluster logs elastics-twagzs --tail 30 --namespace ns-nvunr ` ***"type":"log","@timestamp":"2025-09-01T04:16:29Z","tags":["info","plugins-system"],"pid":11,"message":"Setting up [96] plugins: [taskManager,licensing,globalSearch,globalSearchProviders,code,usageCollection,xpackLegacy,telemetryCollectionManager,telemetry,telemetryCollectionXpack,kibanaUsageCollection,securityOss,newsfeed,mapsLegacy,kibanaLegacy,translations,share,legacyExport,embeddable,uiActionsEnhanced,esUiShared,expressions,data,home,observability,cloud,console,consoleExtensions,apmOss,searchprofiler,painlessLab,grokdebugger,management,indexPatternManagement,advancedSettings,fileUpload,savedObjects,dashboard,visualizations,visTypeVega,visTypeTimelion,timelion,features,upgradeAssistant,security,snapshotRestore,encryptedSavedObjects,ingestManager,indexManagement,remoteClusters,crossClusterReplication,indexLifecycleManagement,enterpriseSearch,dashboardMode,beatsManagement,transform,ingestPipelines,maps,licenseManagement,graph,dataEnhanced,visTypeTable,visTypeMarkdown,tileMap,regionMap,inputControlVis,visualize,charts,lens,visTypeVislib,visTypeTimeseries,rollup,visTypeTagcloud,visTypeMetric,watcher,discover,discoverEnhanced,savedObjectsManagement,spaces,reporting,lists,eventLog,actions,case,alerts,stackAlerts,triggersActionsUi,ml,securitySolution,infra,monitoring,logstash,apm,uptime,bfetch,canvas]"*** ***"type":"log","@timestamp":"2025-09-01T04:16:29Z","tags":["warning","plugins","security","config"],"pid":11,"message":"Generating a random key for xpack.security.encryptionKey. To prevent sessions from being invalidated on restart, please set xpack.security.encryptionKey in kibana.yml"*** ***"type":"log","@timestamp":"2025-09-01T04:16:29Z","tags":["warning","plugins","security","config"],"pid":11,"message":"Session cookies will be transmitted over insecure connections. This is not recommended."*** ***"type":"log","@timestamp":"2025-09-01T04:16:29Z","tags":["warning","plugins","encryptedSavedObjects","config"],"pid":11,"message":"Generating a random key for xpack.encryptedSavedObjects.encryptionKey. To be able to decrypt encrypted saved objects attributes after restart, please set xpack.encryptedSavedObjects.encryptionKey in kibana.yml"*** ***"type":"log","@timestamp":"2025-09-01T04:16:29Z","tags":["warning","plugins","ingestManager"],"pid":11,"message":"Fleet APIs are disabled due to the Encrypted Saved Objects plugin using an ephemeral encryption key. Please set xpack.encryptedSavedObjects.encryptionKey in kibana.yml."*** ***"type":"log","@timestamp":"2025-09-01T04:16:30Z","tags":["warning","plugins","reporting","config"],"pid":11,"message":"Generating a random key for xpack.reporting.encryptionKey. To prevent sessions from being invalidated on restart, please set xpack.reporting.encryptionKey in kibana.yml"*** ***"type":"log","@timestamp":"2025-09-01T04:16:30Z","tags":["warning","plugins","reporting","config"],"pid":11,"message":"Chromium sandbox provides an additional layer of protection, but is not supported for Linux CentOS 8.2.2004 OS. Automatically setting 'xpack.reporting.capture.browser.chromium.disableSandbox: true'."*** ***"type":"log","@timestamp":"2025-09-01T04:16:30Z","tags":["warning","plugins","actions","actions"],"pid":11,"message":"APIs are disabled due to the Encrypted Saved Objects plugin using an ephemeral encryption key. Please set xpack.encryptedSavedObjects.encryptionKey in kibana.yml."*** ***"type":"log","@timestamp":"2025-09-01T04:16:30Z","tags":["warning","plugins","alerts","plugins","alerting"],"pid":11,"message":"APIs are disabled due to the Encrypted Saved Objects plugin using an ephemeral encryption key. Please set xpack.encryptedSavedObjects.encryptionKey in kibana.yml."*** ***"type":"log","@timestamp":"2025-09-01T04:16:30Z","tags":["info","plugins","monitoring","monitoring"],"pid":11,"message":"config sourced from: production cluster"*** ***"type":"log","@timestamp":"2025-09-01T04:16:30Z","tags":["info","savedobjects-service"],"pid":11,"message":"Waiting until all Elasticsearch nodes are compatible with Kibana before starting saved objects migrations..."*** ***"type":"log","@timestamp":"2025-09-01T04:16:31Z","tags":["info","savedobjects-service"],"pid":11,"message":"Starting saved objects migrations"*** ***"type":"log","@timestamp":"2025-09-01T04:16:31Z","tags":["info","plugins-system"],"pid":11,"message":"Starting [96] plugins: [taskManager,licensing,globalSearch,globalSearchProviders,code,usageCollection,xpackLegacy,telemetryCollectionManager,telemetry,telemetryCollectionXpack,kibanaUsageCollection,securityOss,newsfeed,mapsLegacy,kibanaLegacy,translations,share,legacyExport,embeddable,uiActionsEnhanced,esUiShared,expressions,data,home,observability,cloud,console,consoleExtensions,apmOss,searchprofiler,painlessLab,grokdebugger,management,indexPatternManagement,advancedSettings,fileUpload,savedObjects,dashboard,visualizations,visTypeVega,visTypeTimelion,timelion,features,upgradeAssistant,security,snapshotRestore,encryptedSavedObjects,ingestManager,indexManagement,remoteClusters,crossClusterReplication,indexLifecycleManagement,enterpriseSearch,dashboardMode,beatsManagement,transform,ingestPipelines,maps,licenseManagement,graph,dataEnhanced,visTypeTable,visTypeMarkdown,tileMap,regionMap,inputControlVis,visualize,charts,lens,visTypeVislib,visTypeTimeseries,rollup,visTypeTagcloud,visTypeMetric,watcher,discover,discoverEnhanced,savedObjectsManagement,spaces,reporting,lists,eventLog,actions,case,alerts,stackAlerts,triggersActionsUi,ml,securitySolution,infra,monitoring,logstash,apm,uptime,bfetch,canvas]"*** ***"type":"log","@timestamp":"2025-09-01T04:16:31Z","tags":["info","plugins","taskManager","taskManager"],"pid":11,"message":"TaskManager is identified by the Kibana UUID: 8dcfa280-413b-4e65-9b5d-0af4a2fbc377"*** ***"type":"log","@timestamp":"2025-09-01T04:16:31Z","tags":["info","plugins","crossClusterReplication"],"pid":11,"message":"Your basic license does not support crossClusterReplication. Please upgrade your license."*** ***"type":"log","@timestamp":"2025-09-01T04:16:31Z","tags":["info","plugins","watcher"],"pid":11,"message":"Your basic license does not support watcher. Please upgrade your license."*** ***"type":"log","@timestamp":"2025-09-01T04:16:31Z","tags":["info","plugins","monitoring","monitoring","kibana-monitoring"],"pid":11,"message":"Starting monitoring stats collection"*** ***"type":"log","@timestamp":"2025-09-01T04:16:32Z","tags":["error","elasticsearch","data"],"pid":11,"message":"[version_conflict_engine_exception]: [task:Lens-lens_telemetry]: version conflict, document already exists (current version [4])"*** ***"type":"log","@timestamp":"2025-09-01T04:16:32Z","tags":["error","elasticsearch","data"],"pid":11,"message":"[version_conflict_engine_exception]: [task:Actions-actions_telemetry]: version conflict, document already exists (current version [4])"*** ***"type":"log","@timestamp":"2025-09-01T04:16:32Z","tags":["error","elasticsearch","data"],"pid":11,"message":"[version_conflict_engine_exception]: [task:Alerting-alerting_telemetry]: version conflict, document already exists (current version [4])"*** ***"type":"log","@timestamp":"2025-09-01T04:16:32Z","tags":["error","elasticsearch","data"],"pid":11,"message":"[version_conflict_engine_exception]: [task:endpoint:user-artifact-packager:1.0.0]: version conflict, document already exists (current version [109])"*** ***"type":"log","@timestamp":"2025-09-01T04:16:32Z","tags":["error","elasticsearch","data"],"pid":11,"message":"[version_conflict_engine_exception]: [task:apm-telemetry-task]: version conflict, document already exists (current version [4])"*** ***"type":"log","@timestamp":"2025-09-01T04:16:32Z","tags":["listening","info"],"pid":11,"message":"Server running at http://10.244.5.118:5601"*** ***"type":"log","@timestamp":"2025-09-01T04:16:33Z","tags":["info","http","server","Kibana"],"pid":11,"message":"http server running at http://10.244.5.118:5601"*** ***"type":"log","@timestamp":"2025-09-01T04:16:35Z","tags":["warning","plugins","reporting"],"pid":11,"message":"Enabling the Chromium sandbox provides an additional layer of protection."*** ***"type":"response","@timestamp":"2025-09-01T04:16:47Z","tags":[],"pid":11,"method":"get","statusCode":200,"req":***"url":"/app/kibana","method":"get","headers":***"host":"10.244.5.118:5601","user-agent":"curl/7.61.1","accept":"*/*"***,"remoteAddress":"10.244.5.118","userAgent":"curl/7.61.1"***,"res":***"statusCode":200,"responseTime":48,"contentLength":9***,"message":"GET /app/kibana 200 48ms - 9.0B"*** ***"type":"response","@timestamp":"2025-09-01T04:16:57Z","tags":[],"pid":11,"method":"get","statusCode":200,"req":***"url":"/app/kibana","method":"get","headers":***"host":"10.244.5.118:5601","user-agent":"curl/7.61.1","accept":"*/*"***,"remoteAddress":"10.244.5.118","userAgent":"curl/7.61.1"***,"res":***"statusCode":200,"responseTime":19,"contentLength":9***,"message":"GET /app/kibana 200 19ms - 9.0B"*** ***"type":"response","@timestamp":"2025-09-01T04:17:07Z","tags":[],"pid":11,"method":"get","statusCode":200,"req":***"url":"/app/kibana","method":"get","headers":***"host":"10.244.5.118:5601","user-agent":"curl/7.61.1","accept":"*/*"***,"remoteAddress":"10.244.5.118","userAgent":"curl/7.61.1"***,"res":***"statusCode":200,"responseTime":25,"contentLength":9***,"message":"GET /app/kibana 200 25ms - 9.0B"*** ***"type":"response","@timestamp":"2025-09-01T04:17:17Z","tags":[],"pid":11,"method":"get","statusCode":200,"req":***"url":"/app/kibana","method":"get","headers":***"host":"10.244.5.118:5601","user-agent":"curl/7.61.1","accept":"*/*"***,"remoteAddress":"10.244.5.118","userAgent":"curl/7.61.1"***,"res":***"statusCode":200,"responseTime":31,"contentLength":9***,"message":"GET /app/kibana 200 31ms - 9.0B"*** ***"type":"response","@timestamp":"2025-09-01T04:17:27Z","tags":[],"pid":11,"method":"get","statusCode":200,"req":***"url":"/app/kibana","method":"get","headers":***"host":"10.244.5.118:5601","user-agent":"curl/7.61.1","accept":"*/*"***,"remoteAddress":"10.244.5.118","userAgent":"curl/7.61.1"***,"res":***"statusCode":200,"responseTime":28,"contentLength":9***,"message":"GET /app/kibana 200 28ms - 9.0B"*** delete cluster elastics-twagzs `kbcli cluster delete elastics-twagzs --auto-approve --namespace ns-nvunr ` Cluster elastics-twagzs deleted pod_info:elastics-twagzs-kibana-0 1/1 Running 0 79s elastics-twagzs-mdit-0 4/4 Running 0 3m elastics-twagzs-mdit-1 4/4 Running 0 5m12s elastics-twagzs-mdit-2 4/4 Running 0 6m46s pod_info:elastics-twagzs-kibana-0 1/1 Terminating 0 99s elastics-twagzs-mdit-0 2/4 Terminating 0 3m20s elastics-twagzs-mdit-1 2/4 Terminating 0 5m32s elastics-twagzs-mdit-2 2/4 Terminating 0 7m6s No resources found in ns-nvunr namespace. delete cluster pod done No resources found in ns-nvunr namespace. check cluster resource non-exist OK: pvc No resources found in ns-nvunr namespace. delete cluster done No resources found in ns-nvunr namespace. No resources found in ns-nvunr namespace. No resources found in ns-nvunr namespace. ElasticSearch Test Suite All Done! --------------------------------------ElasticSearch (Topology = multi-node Replicas 3) Test Result-------------------------------------- [PASSED]|[Create]|[Topology=multi-node;ComponentVersion=elasticsearch;ServiceVersion=7.7.1;]|[Description=Create a cluster with the specified topology multi-node and component version elasticsearch and service version 7.7.1] [PASSED]|[Connect]|[ComponentName=mdit]|[Description=Connect to the cluster] [PASSED]|[AddData]|[Values=smmqn]|[Description=Add data to the cluster] [PASSED]|[VerticalScaling]|[ComponentName=kibana]|[Description=VerticalScaling the cluster specify component kibana] [PASSED]|[No-Failover]|[HA=Connection Stress;ComponentName=mdit]|[Description=Simulates conditions where pods experience connection stress either due to expected/undesired processes thereby testing the application's resilience to potential slowness/unavailability of some replicas due to high Connection load.] [PASSED]|[VolumeExpansion]|[ComponentName=mdit]|[Description=VolumeExpansion the cluster specify component mdit] [PASSED]|[Restart]|[ComponentName=mdit]|[Description=Restart the cluster specify component mdit] [PASSED]|[HorizontalScaling Out]|[ComponentName=mdit]|[Description=HorizontalScaling Out the cluster specify component mdit] [PASSED]|[HorizontalScaling In]|[ComponentName=mdit]|[Description=HorizontalScaling In the cluster specify component mdit] [PASSED]|[Restart]|[-]|[Description=Restart the cluster] [PASSED]|[HscaleOfflineInstances]|[ComponentName=mdit]|[Description=Hscale the cluster instances offline specify component mdit] [PASSED]|[HscaleOnlineInstances]|[ComponentName=mdit]|[Description=Hscale the cluster instances online specify component mdit] [PASSED]|[Stop]|[-]|[Description=Stop the cluster] [PASSED]|[Start]|[-]|[Description=Start the cluster] [PASSED]|[VerticalScaling]|[ComponentName=mdit]|[Description=VerticalScaling the cluster specify component mdit] [PASSED]|[Restart]|[ComponentName=kibana]|[Description=Restart the cluster specify component kibana] [PASSED]|[Update]|[TerminationPolicy=WipeOut]|[Description=Update the cluster TerminationPolicy WipeOut] [PASSED]|[Delete]|[-]|[Description=Delete the cluster] [END]