source commons files source engines files source kubeblocks files `kubectl get namespace | grep ns-wzxqi ` `kubectl create namespace ns-wzxqi` namespace/ns-wzxqi created create namespace ns-wzxqi done download kbcli `gh release list --repo apecloud/kbcli --limit 100 | (grep "0.9" || true)` `curl -fsSL https://kubeblocks.io/installer/install_cli.sh | bash -s v0.9.4-beta.1` Your system is linux_amd64 Installing kbcli ... Downloading ... % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 32.1M 0 254k 0 0 1009k 0 0:00:32 --:--:-- 0:00:32 1009k 100 32.1M 100 32.1M 0 0 91.2M 0 --:--:-- --:--:-- --:--:-- 319M kbcli installed successfully. Kubernetes: v1.32.5-eks-5d4a308 KubeBlocks: 0.9.4 kbcli: 0.9.4-beta.1 WARNING: version difference between kbcli (0.9.4-beta.1) and kubeblocks (0.9.4) Make sure your docker service is running and begin your journey with kbcli: kbcli playground init For more information on how to get started, please visit: https://kubeblocks.io download kbcli v0.9.4-beta.1 done Kubernetes: v1.32.5-eks-5d4a308 KubeBlocks: 0.9.4 kbcli: 0.9.4-beta.1 WARNING: version difference between kbcli (0.9.4-beta.1) and kubeblocks (0.9.4) Kubernetes Env: v1.32.5-eks-5d4a308 POD_RESOURCES: No resources found found default storage class: gp3 kubeblocks version is:0.9.4 skip upgrade kubeblocks Error: no repositories to show helm repo add chaos-mesh https://charts.chaos-mesh.org "chaos-mesh" has been added to your repositories add helm chart repo chaos-mesh success chaos mesh already installed check cluster definition set component name:backend set component version set component version:loki set service versions:1.0.0 set service versions sorted:1.0.0 no cluster version found set loki component definition KUBEBLOCKS NAMESPACE:kb-zkhtd get kubeblocks namespace done annotate loki cmpd apps.kubeblocks.io/skip-immutable-check=true componentdefinition.apps.kubeblocks.io/loki-backend annotated componentdefinition.apps.kubeblocks.io/loki-gateway annotated componentdefinition.apps.kubeblocks.io/loki-read annotated componentdefinition.apps.kubeblocks.io/loki-write annotated get helm repo list success `helm repo remove kbcli-test-enterprise ` Error: no repo named "kbcli-test-enterprise" found "kbcli-test-enterprise" has been added to your repositories add helm chart repo success `helm repo update kbcli-test-enterprise ` Hang tight while we grab the latest from your chart repositories... ...Successfully got an update from the "kbcli-test-enterprise" chart repository Update Complete. ⎈Happy Helming!⎈ KUBEBLOCKS NAMESPACE:kb-zkhtd get kubeblocks namespace done `helm upgrade --install --namespace kb-zkhtd kb-addon-loki kbcli-test-enterprise/loki --version 0.9.1 --set image.registry=docker.io --set images.registry=docker.io ` Release "kb-addon-loki" has been upgraded. Happy Helming! NAME: kb-addon-loki LAST DEPLOYED: Thu Jun 19 18:13:27 2025 NAMESPACE: kb-zkhtd STATUS: deployed REVISION: 2 TEST SUITE: None NOTES: Release Information: Commit ID: "f40adbdb0f04987566c99567b1cf4c8b83b8e3d1" Commit Time: "2025-04-27 15:18:42 +0800" Release Branch: "v0.9.4" Release Time: "2025-06-19 17:31:43 +0800" Enterprise: "true" set component version set component version:loki set service versions:1.0.0 set service versions sorted:1.0.0 set replicas first:1,1.0.0 set replicas third:1,1.0.0 set replicas fourth:1,1.0.0 set minimum cmpv service version set minimum cmpv service version replicas:1,1.0.0 REPORT_COUNT:1 CLUSTER_TOPOLOGY: set cluster topology: loki-cluster LIMIT_CPU:0.1 LIMIT_MEMORY:0.5 storage size: 1 No resources found in ns-wzxqi namespace. termination_policy:Delete create 1 replica Delete loki cluster check cluster definition check component definition set component definition by component version check cmpd by labels set component definition2: loki-backend by component version:loki apiVersion: apps.kubeblocks.io/v1alpha1 kind: Cluster metadata: name: loki-bthspz namespace: ns-wzxqi spec: clusterDefinitionRef: loki topology: loki-cluster terminationPolicy: Delete services: - name: default serviceName: memberlist spec: ports: - name: tcp port: 7946 targetPort: http-memberlist protocol: TCP selector: app.kubernetes.io/instance: loki-bthspz app.kubernetes.io/part-of: memberlist componentSpecs: - name: backend serviceVersion: 1.0.0 disableExporter: true replicas: 1 env: - name: STORAGE_TYPE value: local resources: requests: cpu: 100m memory: 0.5Gi limits: cpu: 100m memory: 0.5Gi volumeClaimTemplates: - name: data spec: storageClassName: accessModes: - ReadWriteOnce resources: requests: storage: 1Gi - name: write serviceVersion: 1.0.0 disableExporter: true replicas: 1 env: - name: STORAGE_TYPE value: local resources: requests: cpu: 100m memory: 0.5Gi limits: cpu: 100m memory: 0.5Gi - name: read serviceVersion: 1.0.0 disableExporter: true replicas: 1 env: - name: STORAGE_TYPE value: local resources: requests: cpu: 100m memory: 0.5Gi limits: cpu: 100m memory: 0.5Gi - name: gateway serviceVersion: 1.0.0 disableExporter: true replicas: 1 resources: requests: cpu: 100m memory: 0.5Gi limits: cpu: 100m memory: 0.5Gi `kubectl apply -f test_create_loki-bthspz.yaml` cluster.apps.kubeblocks.io/loki-bthspz created apply test_create_loki-bthspz.yaml Success `rm -rf test_create_loki-bthspz.yaml` check cluster status `kbcli cluster list loki-bthspz --show-labels --namespace ns-wzxqi ` NAME NAMESPACE CLUSTER-DEFINITION VERSION TERMINATION-POLICY STATUS CREATED-TIME LABELS loki-bthspz ns-wzxqi loki Delete Creating Jun 19,2025 18:13 UTC+0800 clusterdefinition.kubeblocks.io/name=loki,clusterversion.kubeblocks.io/name= cluster_status:Creating cluster_status:Creating cluster_status:Updating cluster_status:Updating cluster_status:Updating check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances loki-bthspz --namespace ns-wzxqi ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME loki-bthspz-backend-0 ns-wzxqi loki-bthspz backend Running us-west-2a 100m / 100m 512Mi / 512Mi data:1Gi ip-172-31-7-83.us-west-2.compute.internal/172.31.7.83 Jun 19,2025 18:13 UTC+0800 loki-bthspz-gateway-0 ns-wzxqi loki-bthspz gateway Running us-west-2a 100m / 100m 512Mi / 512Mi ip-172-31-6-223.us-west-2.compute.internal/172.31.6.223 Jun 19,2025 18:15 UTC+0800 loki-bthspz-read-0 ns-wzxqi loki-bthspz read Running us-west-2a 100m / 100m 512Mi / 512Mi ip-172-31-0-64.us-west-2.compute.internal/172.31.0.64 Jun 19,2025 18:14 UTC+0800 loki-bthspz-write-0 ns-wzxqi loki-bthspz write Running us-west-2a 100m / 100m 512Mi / 512Mi ip-172-31-10-42.us-west-2.compute.internal/172.31.10.42 Jun 19,2025 18:14 UTC+0800 check pod status done connect unsupported engine type: loki loki-backend `kubectl get secrets -l app.kubernetes.io/instance=loki-bthspz` No resources found in ns-wzxqi namespace. Not found cluster secret DB_USERNAME:;DB_PASSWORD:;DB_PORT:;DB_DATABASE: There is no password in Type: 54. describe cluster `kbcli cluster describe loki-bthspz --namespace ns-wzxqi ` Name: loki-bthspz Created Time: Jun 19,2025 18:13 UTC+0800 NAMESPACE CLUSTER-DEFINITION VERSION STATUS TERMINATION-POLICY ns-wzxqi loki Running Delete Endpoints: COMPONENT MODE INTERNAL EXTERNAL write ReadWrite loki-bthspz-write.ns-wzxqi.svc.cluster.local:3100 loki-bthspz-write.ns-wzxqi.svc.cluster.local:9095 read ReadWrite loki-bthspz-read.ns-wzxqi.svc.cluster.local:3100 loki-bthspz-read.ns-wzxqi.svc.cluster.local:9095 backend ReadWrite loki-bthspz-backend.ns-wzxqi.svc.cluster.local:3100 loki-bthspz-backend.ns-wzxqi.svc.cluster.local:9095 gateway ReadWrite loki-bthspz-gateway.ns-wzxqi.svc.cluster.local:80 Topology: COMPONENT INSTANCE ROLE STATUS AZ NODE CREATED-TIME backend loki-bthspz-backend-0 Running us-west-2a ip-172-31-7-83.us-west-2.compute.internal/172.31.7.83 Jun 19,2025 18:13 UTC+0800 gateway loki-bthspz-gateway-0 Running us-west-2a ip-172-31-6-223.us-west-2.compute.internal/172.31.6.223 Jun 19,2025 18:15 UTC+0800 read loki-bthspz-read-0 Running us-west-2a ip-172-31-0-64.us-west-2.compute.internal/172.31.0.64 Jun 19,2025 18:14 UTC+0800 write loki-bthspz-write-0 Running us-west-2a ip-172-31-10-42.us-west-2.compute.internal/172.31.10.42 Jun 19,2025 18:14 UTC+0800 Resources Allocation: COMPONENT DEDICATED CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE-SIZE STORAGE-CLASS write false 100m / 100m 512Mi / 512Mi read false 100m / 100m 512Mi / 512Mi backend false 100m / 100m 512Mi / 512Mi data:1Gi kb-default-sc gateway false 100m / 100m 512Mi / 512Mi Images: COMPONENT TYPE IMAGE write docker.io/apecloud/loki:2.9.4 read docker.io/apecloud/loki:2.9.4 backend docker.io/apecloud/loki:2.9.4 gateway docker.io/apecloud/nginx-unprivileged:1.24-alpine Show cluster events: kbcli cluster list-events -n ns-wzxqi loki-bthspz `kbcli cluster label loki-bthspz app.kubernetes.io/instance- --namespace ns-wzxqi ` label "app.kubernetes.io/instance" not found. `kbcli cluster label loki-bthspz app.kubernetes.io/instance=loki-bthspz --namespace ns-wzxqi ` `kbcli cluster label loki-bthspz --list --namespace ns-wzxqi ` NAME NAMESPACE LABELS loki-bthspz ns-wzxqi app.kubernetes.io/instance=loki-bthspz clusterdefinition.kubeblocks.io/name=loki clusterversion.kubeblocks.io/name= label cluster app.kubernetes.io/instance=loki-bthspz Success `kbcli cluster label case.name=kbcli.test1 -l app.kubernetes.io/instance=loki-bthspz --namespace ns-wzxqi ` `kbcli cluster label loki-bthspz --list --namespace ns-wzxqi ` NAME NAMESPACE LABELS loki-bthspz ns-wzxqi app.kubernetes.io/instance=loki-bthspz case.name=kbcli.test1 clusterdefinition.kubeblocks.io/name=loki clusterversion.kubeblocks.io/name= label cluster case.name=kbcli.test1 Success `kbcli cluster label loki-bthspz case.name=kbcli.test2 --overwrite --namespace ns-wzxqi ` `kbcli cluster label loki-bthspz --list --namespace ns-wzxqi ` NAME NAMESPACE LABELS loki-bthspz ns-wzxqi app.kubernetes.io/instance=loki-bthspz case.name=kbcli.test2 clusterdefinition.kubeblocks.io/name=loki clusterversion.kubeblocks.io/name= label cluster case.name=kbcli.test2 Success `kbcli cluster label loki-bthspz case.name- --namespace ns-wzxqi ` `kbcli cluster label loki-bthspz --list --namespace ns-wzxqi ` NAME NAMESPACE LABELS loki-bthspz ns-wzxqi app.kubernetes.io/instance=loki-bthspz clusterdefinition.kubeblocks.io/name=loki clusterversion.kubeblocks.io/name= delete cluster label case.name Success cluster connect kbcli unsupported engine type: backend check component backend exists `kubectl get components -l app.kubernetes.io/instance=loki-bthspz,apps.kubeblocks.io/component-name=backend --namespace ns-wzxqi | (grep "backend" || true )` check component gateway exists `kubectl get components -l app.kubernetes.io/instance=loki-bthspz,apps.kubeblocks.io/component-name=gateway --namespace ns-wzxqi | (grep "gateway" || true )` cluster restart check cluster status before ops check cluster status done cluster_status:Running `kbcli cluster restart loki-bthspz --auto-approve --force=true --components backend,gateway --namespace ns-wzxqi ` OpsRequest loki-bthspz-restart-465jz created successfully, you can view the progress: kbcli cluster describe-ops loki-bthspz-restart-465jz -n ns-wzxqi check ops status `kbcli cluster list-ops loki-bthspz --status all --namespace ns-wzxqi ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME loki-bthspz-restart-465jz ns-wzxqi Restart loki-bthspz backend,gateway Running 0/2 Jun 19,2025 18:16 UTC+0800 check cluster status `kbcli cluster list loki-bthspz --show-labels --namespace ns-wzxqi ` NAME NAMESPACE CLUSTER-DEFINITION VERSION TERMINATION-POLICY STATUS CREATED-TIME LABELS loki-bthspz ns-wzxqi loki Delete Updating Jun 19,2025 18:13 UTC+0800 app.kubernetes.io/instance=loki-bthspz,clusterdefinition.kubeblocks.io/name=loki,clusterversion.kubeblocks.io/name= cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances loki-bthspz --namespace ns-wzxqi ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME loki-bthspz-backend-0 ns-wzxqi loki-bthspz backend Running us-west-2a 100m / 100m 512Mi / 512Mi data:1Gi ip-172-31-7-83.us-west-2.compute.internal/172.31.7.83 Jun 19,2025 18:16 UTC+0800 loki-bthspz-gateway-0 ns-wzxqi loki-bthspz gateway Running us-west-2a 100m / 100m 512Mi / 512Mi ip-172-31-6-223.us-west-2.compute.internal/172.31.6.223 Jun 19,2025 18:16 UTC+0800 loki-bthspz-read-0 ns-wzxqi loki-bthspz read Running us-west-2a 100m / 100m 512Mi / 512Mi ip-172-31-0-64.us-west-2.compute.internal/172.31.0.64 Jun 19,2025 18:14 UTC+0800 loki-bthspz-write-0 ns-wzxqi loki-bthspz write Running us-west-2a 100m / 100m 512Mi / 512Mi ip-172-31-10-42.us-west-2.compute.internal/172.31.10.42 Jun 19,2025 18:14 UTC+0800 check pod status done connect unsupported engine type: loki loki-backend check ops status `kbcli cluster list-ops loki-bthspz --status all --namespace ns-wzxqi ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME loki-bthspz-restart-465jz ns-wzxqi Restart loki-bthspz backend,gateway Succeed 2/2 Jun 19,2025 18:16 UTC+0800 check ops status done ops_status:loki-bthspz-restart-465jz ns-wzxqi Restart loki-bthspz backend,gateway Succeed 2/2 Jun 19,2025 18:16 UTC+0800 `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge opsrequests loki-bthspz-restart-465jz --namespace ns-wzxqi ` opsrequest.apps.kubeblocks.io/loki-bthspz-restart-465jz patched `kbcli cluster delete-ops --name loki-bthspz-restart-465jz --force --auto-approve --namespace ns-wzxqi ` OpsRequest loki-bthspz-restart-465jz deleted cluster vscale check cluster status before ops check cluster status done cluster_status:Running `kbcli cluster vscale loki-bthspz --auto-approve --force=true --components backend --cpu 200m --memory 0.6Gi --namespace ns-wzxqi ` OpsRequest loki-bthspz-verticalscaling-xszhp created successfully, you can view the progress: kbcli cluster describe-ops loki-bthspz-verticalscaling-xszhp -n ns-wzxqi check ops status `kbcli cluster list-ops loki-bthspz --status all --namespace ns-wzxqi ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME loki-bthspz-verticalscaling-xszhp ns-wzxqi VerticalScaling loki-bthspz backend Running 0/1 Jun 19,2025 18:17 UTC+0800 check cluster status `kbcli cluster list loki-bthspz --show-labels --namespace ns-wzxqi ` NAME NAMESPACE CLUSTER-DEFINITION VERSION TERMINATION-POLICY STATUS CREATED-TIME LABELS loki-bthspz ns-wzxqi loki Delete Updating Jun 19,2025 18:13 UTC+0800 app.kubernetes.io/instance=loki-bthspz,clusterdefinition.kubeblocks.io/name=loki,clusterversion.kubeblocks.io/name= cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances loki-bthspz --namespace ns-wzxqi ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME loki-bthspz-backend-0 ns-wzxqi loki-bthspz backend Running us-west-2a 200m / 200m 644245094400m / 644245094400m data:1Gi ip-172-31-7-83.us-west-2.compute.internal/172.31.7.83 Jun 19,2025 18:17 UTC+0800 loki-bthspz-gateway-0 ns-wzxqi loki-bthspz gateway Running us-west-2a 100m / 100m 512Mi / 512Mi ip-172-31-6-223.us-west-2.compute.internal/172.31.6.223 Jun 19,2025 18:16 UTC+0800 loki-bthspz-read-0 ns-wzxqi loki-bthspz read Running us-west-2a 100m / 100m 512Mi / 512Mi ip-172-31-0-64.us-west-2.compute.internal/172.31.0.64 Jun 19,2025 18:14 UTC+0800 loki-bthspz-write-0 ns-wzxqi loki-bthspz write Running us-west-2a 100m / 100m 512Mi / 512Mi ip-172-31-10-42.us-west-2.compute.internal/172.31.10.42 Jun 19,2025 18:14 UTC+0800 check pod status done connect unsupported engine type: loki loki-backend check ops status `kbcli cluster list-ops loki-bthspz --status all --namespace ns-wzxqi ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME loki-bthspz-verticalscaling-xszhp ns-wzxqi VerticalScaling loki-bthspz backend Succeed 1/1 Jun 19,2025 18:17 UTC+0800 check ops status done ops_status:loki-bthspz-verticalscaling-xszhp ns-wzxqi VerticalScaling loki-bthspz backend Succeed 1/1 Jun 19,2025 18:17 UTC+0800 `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge opsrequests loki-bthspz-verticalscaling-xszhp --namespace ns-wzxqi ` opsrequest.apps.kubeblocks.io/loki-bthspz-verticalscaling-xszhp patched `kbcli cluster delete-ops --name loki-bthspz-verticalscaling-xszhp --force --auto-approve --namespace ns-wzxqi ` OpsRequest loki-bthspz-verticalscaling-xszhp deleted cluster update monitor KUBEBLOCKS NAMESPACE:kb-zkhtd get kubeblocks namespace done check addon prometheus enabled check addon prometheus enabled done check addon grafana enabled check addon grafana enabled done check addon apecloud-otel-collector enabled check addon apecloud-otel-collector enabled done kubectl patch cluster loki-bthspz --namespace ns-wzxqi --type json -p '[***"op": "replace", "path": "/spec/componentSpecs/0/disableExporter", "value": false***]' cluster.apps.kubeblocks.io/loki-bthspz patched check cluster status `kbcli cluster list loki-bthspz --show-labels --namespace ns-wzxqi ` NAME NAMESPACE CLUSTER-DEFINITION VERSION TERMINATION-POLICY STATUS CREATED-TIME LABELS loki-bthspz ns-wzxqi loki Delete Running Jun 19,2025 18:13 UTC+0800 app.kubernetes.io/instance=loki-bthspz,clusterdefinition.kubeblocks.io/name=loki,clusterversion.kubeblocks.io/name= check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances loki-bthspz --namespace ns-wzxqi ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME loki-bthspz-backend-0 ns-wzxqi loki-bthspz backend Running us-west-2a 200m / 200m 644245094400m / 644245094400m data:1Gi ip-172-31-7-83.us-west-2.compute.internal/172.31.7.83 Jun 19,2025 18:17 UTC+0800 loki-bthspz-gateway-0 ns-wzxqi loki-bthspz gateway Running us-west-2a 100m / 100m 512Mi / 512Mi ip-172-31-6-223.us-west-2.compute.internal/172.31.6.223 Jun 19,2025 18:16 UTC+0800 loki-bthspz-read-0 ns-wzxqi loki-bthspz read Running us-west-2a 100m / 100m 512Mi / 512Mi ip-172-31-0-64.us-west-2.compute.internal/172.31.0.64 Jun 19,2025 18:14 UTC+0800 loki-bthspz-write-0 ns-wzxqi loki-bthspz write Running us-west-2a 100m / 100m 512Mi / 512Mi ip-172-31-10-42.us-west-2.compute.internal/172.31.10.42 Jun 19,2025 18:14 UTC+0800 check pod status done connect unsupported engine type: loki loki-backend create curl-jq pod loki-bthspz-kb-curl `kubectl run --namespace kb-zkhtd loki-bthspz-kb-curl --restart='Never' --image docker.io/apecloud/curl-jq:0.1.0 --command -- sleep infinity ` pod/loki-bthspz-kb-curl created check pod status pod_status:NAME READY STATUS RESTARTS AGE loki-bthspz-kb-curl 0/1 ContainerCreating 0 1s check pod loki-bthspz-kb-curl status done `kubectl wait --for=condition=Ready pod loki-bthspz-kb-curl --namespace kb-zkhtd` pod/loki-bthspz-kb-curl condition met pod_status:NAME READY STATUS RESTARTS AGE loki-bthspz-kb-curl 1/1 Running 0 6s kubectl exec -it loki-bthspz-kb-curl --namespace kb-zkhtd -- curl -G "http://kb-addon-prometheus-server:80/api/v1/query" -d "query=sum(k8s_pod_cpu_limit)" `kubectl exec -it loki-bthspz-kb-curl --namespace kb-zkhtd -- curl -G "http://kb-addon-prometheus-server:80/api/v1/query" -d "query=sum(k8s_pod_cpu_limit)"` Unable to use a TTY - input is not a terminal or the right kind of file % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 122 100 122 0 0 33973 0 --:--:-- --:--:-- --:--:-- 40666 monitor_result:***"status":"success","data":***"resultType":"vector","result":[***"metric":***,"value":[1750328312.896,"11.799999999999999"]***]*** k8s_pod_cpu_limit: 1750328312.896 monitor cluster Success `kubectl delete pod loki-bthspz-kb-curl --namespace kb-zkhtd --force` Warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely. pod "loki-bthspz-kb-curl" force deleted check cluster status `kbcli cluster list loki-bthspz --show-labels --namespace ns-wzxqi ` NAME NAMESPACE CLUSTER-DEFINITION VERSION TERMINATION-POLICY STATUS CREATED-TIME LABELS loki-bthspz ns-wzxqi loki Delete Running Jun 19,2025 18:13 UTC+0800 app.kubernetes.io/instance=loki-bthspz,clusterdefinition.kubeblocks.io/name=loki,clusterversion.kubeblocks.io/name= check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances loki-bthspz --namespace ns-wzxqi ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME loki-bthspz-backend-0 ns-wzxqi loki-bthspz backend Running us-west-2a 200m / 200m 644245094400m / 644245094400m data:1Gi ip-172-31-7-83.us-west-2.compute.internal/172.31.7.83 Jun 19,2025 18:17 UTC+0800 loki-bthspz-gateway-0 ns-wzxqi loki-bthspz gateway Running us-west-2a 100m / 100m 512Mi / 512Mi ip-172-31-6-223.us-west-2.compute.internal/172.31.6.223 Jun 19,2025 18:16 UTC+0800 loki-bthspz-read-0 ns-wzxqi loki-bthspz read Running us-west-2a 100m / 100m 512Mi / 512Mi ip-172-31-0-64.us-west-2.compute.internal/172.31.0.64 Jun 19,2025 18:14 UTC+0800 loki-bthspz-write-0 ns-wzxqi loki-bthspz write Running us-west-2a 100m / 100m 512Mi / 512Mi ip-172-31-10-42.us-west-2.compute.internal/172.31.10.42 Jun 19,2025 18:14 UTC+0800 check pod status done connect unsupported engine type: loki loki-backend cluster hscale check cluster status before ops check cluster status done cluster_status:Running No resources found in loki-bthspz namespace. `kbcli cluster hscale loki-bthspz --auto-approve --force=true --components backend --replicas 2 --namespace ns-wzxqi ` OpsRequest loki-bthspz-horizontalscaling-4k6jh created successfully, you can view the progress: kbcli cluster describe-ops loki-bthspz-horizontalscaling-4k6jh -n ns-wzxqi check ops status `kbcli cluster list-ops loki-bthspz --status all --namespace ns-wzxqi ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME loki-bthspz-horizontalscaling-4k6jh ns-wzxqi HorizontalScaling loki-bthspz backend Pending -/- Jun 19,2025 18:18 UTC+0800 ops_status:loki-bthspz-horizontalscaling-4k6jh ns-wzxqi HorizontalScaling loki-bthspz backend Pending -/- Jun 19,2025 18:18 UTC+0800 check cluster status `kbcli cluster list loki-bthspz --show-labels --namespace ns-wzxqi ` NAME NAMESPACE CLUSTER-DEFINITION VERSION TERMINATION-POLICY STATUS CREATED-TIME LABELS loki-bthspz ns-wzxqi loki Delete Updating Jun 19,2025 18:13 UTC+0800 app.kubernetes.io/instance=loki-bthspz,clusterdefinition.kubeblocks.io/name=loki,clusterversion.kubeblocks.io/name= cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances loki-bthspz --namespace ns-wzxqi ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME loki-bthspz-backend-0 ns-wzxqi loki-bthspz backend Running us-west-2a 200m / 200m 644245094400m / 644245094400m data:1Gi ip-172-31-7-83.us-west-2.compute.internal/172.31.7.83 Jun 19,2025 18:17 UTC+0800 loki-bthspz-backend-1 ns-wzxqi loki-bthspz backend Running us-west-2a 200m / 200m 644245094400m / 644245094400m data:1Gi ip-172-31-10-205.us-west-2.compute.internal/172.31.10.205 Jun 19,2025 18:18 UTC+0800 loki-bthspz-gateway-0 ns-wzxqi loki-bthspz gateway Running us-west-2a 100m / 100m 512Mi / 512Mi ip-172-31-6-223.us-west-2.compute.internal/172.31.6.223 Jun 19,2025 18:16 UTC+0800 loki-bthspz-read-0 ns-wzxqi loki-bthspz read Running us-west-2a 100m / 100m 512Mi / 512Mi ip-172-31-0-64.us-west-2.compute.internal/172.31.0.64 Jun 19,2025 18:14 UTC+0800 loki-bthspz-write-0 ns-wzxqi loki-bthspz write Running us-west-2a 100m / 100m 512Mi / 512Mi ip-172-31-10-42.us-west-2.compute.internal/172.31.10.42 Jun 19,2025 18:14 UTC+0800 check pod status done connect unsupported engine type: loki loki-backend No resources found in loki-bthspz namespace. check ops status `kbcli cluster list-ops loki-bthspz --status all --namespace ns-wzxqi ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME loki-bthspz-horizontalscaling-4k6jh ns-wzxqi HorizontalScaling loki-bthspz backend Succeed 1/1 Jun 19,2025 18:18 UTC+0800 check ops status done ops_status:loki-bthspz-horizontalscaling-4k6jh ns-wzxqi HorizontalScaling loki-bthspz backend Succeed 1/1 Jun 19,2025 18:18 UTC+0800 `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge opsrequests loki-bthspz-horizontalscaling-4k6jh --namespace ns-wzxqi ` opsrequest.apps.kubeblocks.io/loki-bthspz-horizontalscaling-4k6jh patched `kbcli cluster delete-ops --name loki-bthspz-horizontalscaling-4k6jh --force --auto-approve --namespace ns-wzxqi ` OpsRequest loki-bthspz-horizontalscaling-4k6jh deleted cluster hscale check cluster status before ops check cluster status done cluster_status:Running No resources found in loki-bthspz namespace. `kbcli cluster hscale loki-bthspz --auto-approve --force=true --components backend --replicas 1 --namespace ns-wzxqi ` OpsRequest loki-bthspz-horizontalscaling-qhq22 created successfully, you can view the progress: kbcli cluster describe-ops loki-bthspz-horizontalscaling-qhq22 -n ns-wzxqi check ops status `kbcli cluster list-ops loki-bthspz --status all --namespace ns-wzxqi ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME loki-bthspz-horizontalscaling-qhq22 ns-wzxqi HorizontalScaling loki-bthspz backend Running 0/1 Jun 19,2025 18:19 UTC+0800 check cluster status `kbcli cluster list loki-bthspz --show-labels --namespace ns-wzxqi ` NAME NAMESPACE CLUSTER-DEFINITION VERSION TERMINATION-POLICY STATUS CREATED-TIME LABELS loki-bthspz ns-wzxqi loki Delete Running Jun 19,2025 18:13 UTC+0800 app.kubernetes.io/instance=loki-bthspz,clusterdefinition.kubeblocks.io/name=loki,clusterversion.kubeblocks.io/name= check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances loki-bthspz --namespace ns-wzxqi ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME loki-bthspz-backend-0 ns-wzxqi loki-bthspz backend Running us-west-2a 200m / 200m 644245094400m / 644245094400m data:1Gi ip-172-31-7-83.us-west-2.compute.internal/172.31.7.83 Jun 19,2025 18:17 UTC+0800 loki-bthspz-gateway-0 ns-wzxqi loki-bthspz gateway Running us-west-2a 100m / 100m 512Mi / 512Mi ip-172-31-6-223.us-west-2.compute.internal/172.31.6.223 Jun 19,2025 18:16 UTC+0800 loki-bthspz-read-0 ns-wzxqi loki-bthspz read Running us-west-2a 100m / 100m 512Mi / 512Mi ip-172-31-0-64.us-west-2.compute.internal/172.31.0.64 Jun 19,2025 18:14 UTC+0800 loki-bthspz-write-0 ns-wzxqi loki-bthspz write Running us-west-2a 100m / 100m 512Mi / 512Mi ip-172-31-10-42.us-west-2.compute.internal/172.31.10.42 Jun 19,2025 18:14 UTC+0800 check pod status done connect unsupported engine type: loki loki-backend No resources found in loki-bthspz namespace. check ops status `kbcli cluster list-ops loki-bthspz --status all --namespace ns-wzxqi ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME loki-bthspz-horizontalscaling-qhq22 ns-wzxqi HorizontalScaling loki-bthspz backend Succeed 1/1 Jun 19,2025 18:19 UTC+0800 check ops status done ops_status:loki-bthspz-horizontalscaling-qhq22 ns-wzxqi HorizontalScaling loki-bthspz backend Succeed 1/1 Jun 19,2025 18:19 UTC+0800 `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge opsrequests loki-bthspz-horizontalscaling-qhq22 --namespace ns-wzxqi ` opsrequest.apps.kubeblocks.io/loki-bthspz-horizontalscaling-qhq22 patched `kbcli cluster delete-ops --name loki-bthspz-horizontalscaling-qhq22 --force --auto-approve --namespace ns-wzxqi ` OpsRequest loki-bthspz-horizontalscaling-qhq22 deleted check component write exists `kubectl get components -l app.kubernetes.io/instance=loki-bthspz,apps.kubeblocks.io/component-name=write --namespace ns-wzxqi | (grep "write" || true )` check component read exists `kubectl get components -l app.kubernetes.io/instance=loki-bthspz,apps.kubeblocks.io/component-name=read --namespace ns-wzxqi | (grep "read" || true )` cluster restart check cluster status before ops check cluster status done cluster_status:Running `kbcli cluster restart loki-bthspz --auto-approve --force=true --components write,read --namespace ns-wzxqi ` OpsRequest loki-bthspz-restart-85vbs created successfully, you can view the progress: kbcli cluster describe-ops loki-bthspz-restart-85vbs -n ns-wzxqi check ops status `kbcli cluster list-ops loki-bthspz --status all --namespace ns-wzxqi ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME loki-bthspz-restart-85vbs ns-wzxqi Restart loki-bthspz write,read Creating -/- Jun 19,2025 18:20 UTC+0800 check cluster status `kbcli cluster list loki-bthspz --show-labels --namespace ns-wzxqi ` NAME NAMESPACE CLUSTER-DEFINITION VERSION TERMINATION-POLICY STATUS CREATED-TIME LABELS loki-bthspz ns-wzxqi loki Delete Updating Jun 19,2025 18:13 UTC+0800 app.kubernetes.io/instance=loki-bthspz,clusterdefinition.kubeblocks.io/name=loki,clusterversion.kubeblocks.io/name= cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances loki-bthspz --namespace ns-wzxqi ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME loki-bthspz-backend-0 ns-wzxqi loki-bthspz backend Running us-west-2a 200m / 200m 644245094400m / 644245094400m data:1Gi ip-172-31-7-83.us-west-2.compute.internal/172.31.7.83 Jun 19,2025 18:17 UTC+0800 loki-bthspz-gateway-0 ns-wzxqi loki-bthspz gateway Running us-west-2a 100m / 100m 512Mi / 512Mi ip-172-31-6-223.us-west-2.compute.internal/172.31.6.223 Jun 19,2025 18:16 UTC+0800 loki-bthspz-read-0 ns-wzxqi loki-bthspz read Running us-west-2a 100m / 100m 512Mi / 512Mi ip-172-31-5-4.us-west-2.compute.internal/172.31.5.4 Jun 19,2025 18:20 UTC+0800 loki-bthspz-write-0 ns-wzxqi loki-bthspz write Running us-west-2a 100m / 100m 512Mi / 512Mi ip-172-31-5-4.us-west-2.compute.internal/172.31.5.4 Jun 19,2025 18:20 UTC+0800 check pod status done connect unsupported engine type: loki loki-backend check ops status `kbcli cluster list-ops loki-bthspz --status all --namespace ns-wzxqi ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME loki-bthspz-restart-85vbs ns-wzxqi Restart loki-bthspz write,read Succeed 2/2 Jun 19,2025 18:20 UTC+0800 check ops status done ops_status:loki-bthspz-restart-85vbs ns-wzxqi Restart loki-bthspz write,read Succeed 2/2 Jun 19,2025 18:20 UTC+0800 `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge opsrequests loki-bthspz-restart-85vbs --namespace ns-wzxqi ` opsrequest.apps.kubeblocks.io/loki-bthspz-restart-85vbs patched `kbcli cluster delete-ops --name loki-bthspz-restart-85vbs --force --auto-approve --namespace ns-wzxqi ` OpsRequest loki-bthspz-restart-85vbs deleted cluster stop check cluster status before ops check cluster status done cluster_status:Running `kbcli cluster stop loki-bthspz --auto-approve --force=true --namespace ns-wzxqi ` OpsRequest loki-bthspz-stop-q7swn created successfully, you can view the progress: kbcli cluster describe-ops loki-bthspz-stop-q7swn -n ns-wzxqi check ops status `kbcli cluster list-ops loki-bthspz --status all --namespace ns-wzxqi ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME loki-bthspz-stop-q7swn ns-wzxqi Stop loki-bthspz backend,gateway,read,write Running 0/4 Jun 19,2025 18:21 UTC+0800 check cluster status `kbcli cluster list loki-bthspz --show-labels --namespace ns-wzxqi ` NAME NAMESPACE CLUSTER-DEFINITION VERSION TERMINATION-POLICY STATUS CREATED-TIME LABELS loki-bthspz ns-wzxqi loki Delete Stopped Jun 19,2025 18:13 UTC+0800 app.kubernetes.io/instance=loki-bthspz,clusterdefinition.kubeblocks.io/name=loki,clusterversion.kubeblocks.io/name= check cluster status done cluster_status:Stopped check pod status `kbcli cluster list-instances loki-bthspz --namespace ns-wzxqi ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME check pod status done check ops status `kbcli cluster list-ops loki-bthspz --status all --namespace ns-wzxqi ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME loki-bthspz-stop-q7swn ns-wzxqi Stop loki-bthspz backend,gateway,read,write Succeed 4/4 Jun 19,2025 18:21 UTC+0800 check ops status done ops_status:loki-bthspz-stop-q7swn ns-wzxqi Stop loki-bthspz backend,gateway,read,write Succeed 4/4 Jun 19,2025 18:21 UTC+0800 `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge opsrequests loki-bthspz-stop-q7swn --namespace ns-wzxqi ` opsrequest.apps.kubeblocks.io/loki-bthspz-stop-q7swn patched `kbcli cluster delete-ops --name loki-bthspz-stop-q7swn --force --auto-approve --namespace ns-wzxqi ` OpsRequest loki-bthspz-stop-q7swn deleted cluster start check cluster status before ops check cluster status done cluster_status:Stopped `kbcli cluster start loki-bthspz --force=true --namespace ns-wzxqi ` OpsRequest loki-bthspz-start-94sk2 created successfully, you can view the progress: kbcli cluster describe-ops loki-bthspz-start-94sk2 -n ns-wzxqi check ops status `kbcli cluster list-ops loki-bthspz --status all --namespace ns-wzxqi ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME loki-bthspz-start-94sk2 ns-wzxqi Start loki-bthspz backend,gateway,read,write Running 0/4 Jun 19,2025 18:21 UTC+0800 check cluster status `kbcli cluster list loki-bthspz --show-labels --namespace ns-wzxqi ` NAME NAMESPACE CLUSTER-DEFINITION VERSION TERMINATION-POLICY STATUS CREATED-TIME LABELS loki-bthspz ns-wzxqi loki Delete Updating Jun 19,2025 18:13 UTC+0800 app.kubernetes.io/instance=loki-bthspz,clusterdefinition.kubeblocks.io/name=loki,clusterversion.kubeblocks.io/name= cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances loki-bthspz --namespace ns-wzxqi ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME loki-bthspz-backend-0 ns-wzxqi loki-bthspz backend Running us-west-2a 200m / 200m 644245094400m / 644245094400m data:1Gi ip-172-31-10-205.us-west-2.compute.internal/172.31.10.205 Jun 19,2025 18:21 UTC+0800 loki-bthspz-gateway-0 ns-wzxqi loki-bthspz gateway Running us-west-2a 100m / 100m 512Mi / 512Mi ip-172-31-13-192.us-west-2.compute.internal/172.31.13.192 Jun 19,2025 18:21 UTC+0800 loki-bthspz-read-0 ns-wzxqi loki-bthspz read Running us-west-2a 100m / 100m 512Mi / 512Mi ip-172-31-13-192.us-west-2.compute.internal/172.31.13.192 Jun 19,2025 18:21 UTC+0800 loki-bthspz-write-0 ns-wzxqi loki-bthspz write Running us-west-2a 100m / 100m 512Mi / 512Mi ip-172-31-13-192.us-west-2.compute.internal/172.31.13.192 Jun 19,2025 18:21 UTC+0800 check pod status done connect unsupported engine type: loki loki-backend check ops status `kbcli cluster list-ops loki-bthspz --status all --namespace ns-wzxqi ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME loki-bthspz-start-94sk2 ns-wzxqi Start loki-bthspz backend,gateway,read,write Succeed 4/4 Jun 19,2025 18:21 UTC+0800 check ops status done ops_status:loki-bthspz-start-94sk2 ns-wzxqi Start loki-bthspz backend,gateway,read,write Succeed 4/4 Jun 19,2025 18:21 UTC+0800 `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge opsrequests loki-bthspz-start-94sk2 --namespace ns-wzxqi ` opsrequest.apps.kubeblocks.io/loki-bthspz-start-94sk2 patched `kbcli cluster delete-ops --name loki-bthspz-start-94sk2 --force --auto-approve --namespace ns-wzxqi ` OpsRequest loki-bthspz-start-94sk2 deleted cluster restart check cluster status before ops check cluster status done cluster_status:Running `kbcli cluster restart loki-bthspz --auto-approve --force=true --namespace ns-wzxqi ` OpsRequest loki-bthspz-restart-jxwpd created successfully, you can view the progress: kbcli cluster describe-ops loki-bthspz-restart-jxwpd -n ns-wzxqi check ops status `kbcli cluster list-ops loki-bthspz --status all --namespace ns-wzxqi ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME loki-bthspz-restart-jxwpd ns-wzxqi Restart loki-bthspz write,read,backend,gateway Running 0/4 Jun 19,2025 18:22 UTC+0800 check cluster status `kbcli cluster list loki-bthspz --show-labels --namespace ns-wzxqi ` NAME NAMESPACE CLUSTER-DEFINITION VERSION TERMINATION-POLICY STATUS CREATED-TIME LABELS loki-bthspz ns-wzxqi loki Delete Updating Jun 19,2025 18:13 UTC+0800 app.kubernetes.io/instance=loki-bthspz,clusterdefinition.kubeblocks.io/name=loki,clusterversion.kubeblocks.io/name= cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances loki-bthspz --namespace ns-wzxqi ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME loki-bthspz-backend-0 ns-wzxqi loki-bthspz backend Running us-west-2a 200m / 200m 644245094400m / 644245094400m data:1Gi ip-172-31-1-25.us-west-2.compute.internal/172.31.1.25 Jun 19,2025 18:23 UTC+0800 loki-bthspz-gateway-0 ns-wzxqi loki-bthspz gateway Running us-west-2a 100m / 100m 512Mi / 512Mi ip-172-31-7-83.us-west-2.compute.internal/172.31.7.83 Jun 19,2025 18:23 UTC+0800 loki-bthspz-read-0 ns-wzxqi loki-bthspz read Running us-west-2a 100m / 100m 512Mi / 512Mi ip-172-31-10-205.us-west-2.compute.internal/172.31.10.205 Jun 19,2025 18:23 UTC+0800 loki-bthspz-write-0 ns-wzxqi loki-bthspz write Running us-west-2a 100m / 100m 512Mi / 512Mi ip-172-31-8-60.us-west-2.compute.internal/172.31.8.60 Jun 19,2025 18:23 UTC+0800 check pod status done connect unsupported engine type: loki loki-backend check ops status `kbcli cluster list-ops loki-bthspz --status all --namespace ns-wzxqi ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME loki-bthspz-restart-jxwpd ns-wzxqi Restart loki-bthspz write,read,backend,gateway Succeed 4/4 Jun 19,2025 18:22 UTC+0800 check ops status done ops_status:loki-bthspz-restart-jxwpd ns-wzxqi Restart loki-bthspz write,read,backend,gateway Succeed 4/4 Jun 19,2025 18:22 UTC+0800 `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge opsrequests loki-bthspz-restart-jxwpd --namespace ns-wzxqi ` opsrequest.apps.kubeblocks.io/loki-bthspz-restart-jxwpd patched `kbcli cluster delete-ops --name loki-bthspz-restart-jxwpd --force --auto-approve --namespace ns-wzxqi ` OpsRequest loki-bthspz-restart-jxwpd deleted check component write exists `kubectl get components -l app.kubernetes.io/instance=loki-bthspz,apps.kubeblocks.io/component-name=write --namespace ns-wzxqi | (grep "write" || true )` check component read exists `kubectl get components -l app.kubernetes.io/instance=loki-bthspz,apps.kubeblocks.io/component-name=read --namespace ns-wzxqi | (grep "read" || true )` check component gateway exists `kubectl get components -l app.kubernetes.io/instance=loki-bthspz,apps.kubeblocks.io/component-name=gateway --namespace ns-wzxqi | (grep "gateway" || true )` cluster vscale check cluster status before ops check cluster status done cluster_status:Running `kbcli cluster vscale loki-bthspz --auto-approve --force=true --components write,read,gateway --cpu 200m --memory 0.6Gi --namespace ns-wzxqi ` OpsRequest loki-bthspz-verticalscaling-tszpr created successfully, you can view the progress: kbcli cluster describe-ops loki-bthspz-verticalscaling-tszpr -n ns-wzxqi check ops status `kbcli cluster list-ops loki-bthspz --status all --namespace ns-wzxqi ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME loki-bthspz-verticalscaling-tszpr ns-wzxqi VerticalScaling loki-bthspz write,read,gateway Running 0/3 Jun 19,2025 18:24 UTC+0800 check cluster status `kbcli cluster list loki-bthspz --show-labels --namespace ns-wzxqi ` NAME NAMESPACE CLUSTER-DEFINITION VERSION TERMINATION-POLICY STATUS CREATED-TIME LABELS loki-bthspz ns-wzxqi loki Delete Updating Jun 19,2025 18:13 UTC+0800 app.kubernetes.io/instance=loki-bthspz,clusterdefinition.kubeblocks.io/name=loki,clusterversion.kubeblocks.io/name= cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances loki-bthspz --namespace ns-wzxqi ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME loki-bthspz-backend-0 ns-wzxqi loki-bthspz backend Running us-west-2a 200m / 200m 644245094400m / 644245094400m data:1Gi ip-172-31-1-25.us-west-2.compute.internal/172.31.1.25 Jun 19,2025 18:23 UTC+0800 loki-bthspz-gateway-0 ns-wzxqi loki-bthspz gateway Running us-west-2a 200m / 200m 644245094400m / 644245094400m ip-172-31-8-193.us-west-2.compute.internal/172.31.8.193 Jun 19,2025 18:24 UTC+0800 loki-bthspz-read-0 ns-wzxqi loki-bthspz read Running us-west-2a 200m / 200m 644245094400m / 644245094400m ip-172-31-10-110.us-west-2.compute.internal/172.31.10.110 Jun 19,2025 18:24 UTC+0800 loki-bthspz-write-0 ns-wzxqi loki-bthspz write Running us-west-2a 200m / 200m 644245094400m / 644245094400m ip-172-31-7-83.us-west-2.compute.internal/172.31.7.83 Jun 19,2025 18:24 UTC+0800 check pod status done connect unsupported engine type: loki loki-backend check ops status `kbcli cluster list-ops loki-bthspz --status all --namespace ns-wzxqi ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME loki-bthspz-verticalscaling-tszpr ns-wzxqi VerticalScaling loki-bthspz write,read,gateway Succeed 3/3 Jun 19,2025 18:24 UTC+0800 check ops status done ops_status:loki-bthspz-verticalscaling-tszpr ns-wzxqi VerticalScaling loki-bthspz write,read,gateway Succeed 3/3 Jun 19,2025 18:24 UTC+0800 `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge opsrequests loki-bthspz-verticalscaling-tszpr --namespace ns-wzxqi ` opsrequest.apps.kubeblocks.io/loki-bthspz-verticalscaling-tszpr patched `kbcli cluster delete-ops --name loki-bthspz-verticalscaling-tszpr --force --auto-approve --namespace ns-wzxqi ` OpsRequest loki-bthspz-verticalscaling-tszpr deleted `kubectl get pvc -l app.kubernetes.io/instance=loki-bthspz,apps.kubeblocks.io/component-name=backend,apps.kubeblocks.io/vct-name=data --namespace ns-wzxqi ` cluster volume-expand check cluster status before ops check cluster status done cluster_status:Running No resources found in loki-bthspz namespace. `kbcli cluster volume-expand loki-bthspz --auto-approve --force=true --components backend --volume-claim-templates data --storage 2Gi --namespace ns-wzxqi ` OpsRequest loki-bthspz-volumeexpansion-fnmg6 created successfully, you can view the progress: kbcli cluster describe-ops loki-bthspz-volumeexpansion-fnmg6 -n ns-wzxqi check ops status `kbcli cluster list-ops loki-bthspz --status all --namespace ns-wzxqi ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME loki-bthspz-volumeexpansion-fnmg6 ns-wzxqi VolumeExpansion loki-bthspz backend Running 0/1 Jun 19,2025 18:25 UTC+0800 check cluster status `kbcli cluster list loki-bthspz --show-labels --namespace ns-wzxqi ` NAME NAMESPACE CLUSTER-DEFINITION VERSION TERMINATION-POLICY STATUS CREATED-TIME LABELS loki-bthspz ns-wzxqi loki Delete Updating Jun 19,2025 18:13 UTC+0800 app.kubernetes.io/instance=loki-bthspz,clusterdefinition.kubeblocks.io/name=loki,clusterversion.kubeblocks.io/name= cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances loki-bthspz --namespace ns-wzxqi ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME loki-bthspz-backend-0 ns-wzxqi loki-bthspz backend Running us-west-2a 200m / 200m 644245094400m / 644245094400m data:2Gi ip-172-31-1-25.us-west-2.compute.internal/172.31.1.25 Jun 19,2025 18:23 UTC+0800 loki-bthspz-gateway-0 ns-wzxqi loki-bthspz gateway Running us-west-2a 200m / 200m 644245094400m / 644245094400m ip-172-31-8-193.us-west-2.compute.internal/172.31.8.193 Jun 19,2025 18:24 UTC+0800 loki-bthspz-read-0 ns-wzxqi loki-bthspz read Running us-west-2a 200m / 200m 644245094400m / 644245094400m ip-172-31-10-110.us-west-2.compute.internal/172.31.10.110 Jun 19,2025 18:24 UTC+0800 loki-bthspz-write-0 ns-wzxqi loki-bthspz write Running us-west-2a 200m / 200m 644245094400m / 644245094400m ip-172-31-7-83.us-west-2.compute.internal/172.31.7.83 Jun 19,2025 18:24 UTC+0800 check pod status done connect unsupported engine type: loki loki-backend No resources found in loki-bthspz namespace. check ops status `kbcli cluster list-ops loki-bthspz --status all --namespace ns-wzxqi ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME loki-bthspz-volumeexpansion-fnmg6 ns-wzxqi VolumeExpansion loki-bthspz backend Succeed 1/1 Jun 19,2025 18:25 UTC+0800 check ops status done ops_status:loki-bthspz-volumeexpansion-fnmg6 ns-wzxqi VolumeExpansion loki-bthspz backend Succeed 1/1 Jun 19,2025 18:25 UTC+0800 `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge opsrequests loki-bthspz-volumeexpansion-fnmg6 --namespace ns-wzxqi ` opsrequest.apps.kubeblocks.io/loki-bthspz-volumeexpansion-fnmg6 patched `kbcli cluster delete-ops --name loki-bthspz-volumeexpansion-fnmg6 --force --auto-approve --namespace ns-wzxqi ` OpsRequest loki-bthspz-volumeexpansion-fnmg6 deleted check component write exists `kubectl get components -l app.kubernetes.io/instance=loki-bthspz,apps.kubeblocks.io/component-name=write --namespace ns-wzxqi | (grep "write" || true )` check component read exists `kubectl get components -l app.kubernetes.io/instance=loki-bthspz,apps.kubeblocks.io/component-name=read --namespace ns-wzxqi | (grep "read" || true )` check component gateway exists `kubectl get components -l app.kubernetes.io/instance=loki-bthspz,apps.kubeblocks.io/component-name=gateway --namespace ns-wzxqi | (grep "gateway" || true )` cluster hscale check cluster status before ops check cluster status done cluster_status:Running No resources found in loki-bthspz namespace. `kbcli cluster hscale loki-bthspz --auto-approve --force=true --components write,read,gateway --replicas 2 --namespace ns-wzxqi ` OpsRequest loki-bthspz-horizontalscaling-8tgw7 created successfully, you can view the progress: kbcli cluster describe-ops loki-bthspz-horizontalscaling-8tgw7 -n ns-wzxqi check ops status `kbcli cluster list-ops loki-bthspz --status all --namespace ns-wzxqi ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME loki-bthspz-horizontalscaling-8tgw7 ns-wzxqi HorizontalScaling loki-bthspz write,read,gateway Running 0/3 Jun 19,2025 18:26 UTC+0800 check cluster status `kbcli cluster list loki-bthspz --show-labels --namespace ns-wzxqi ` NAME NAMESPACE CLUSTER-DEFINITION VERSION TERMINATION-POLICY STATUS CREATED-TIME LABELS loki-bthspz ns-wzxqi loki Delete Updating Jun 19,2025 18:13 UTC+0800 app.kubernetes.io/instance=loki-bthspz,clusterdefinition.kubeblocks.io/name=loki,clusterversion.kubeblocks.io/name= cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances loki-bthspz --namespace ns-wzxqi ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME loki-bthspz-backend-0 ns-wzxqi loki-bthspz backend Running us-west-2a 200m / 200m 644245094400m / 644245094400m data:2Gi ip-172-31-1-25.us-west-2.compute.internal/172.31.1.25 Jun 19,2025 18:23 UTC+0800 loki-bthspz-gateway-0 ns-wzxqi loki-bthspz gateway Running us-west-2a 200m / 200m 644245094400m / 644245094400m ip-172-31-8-193.us-west-2.compute.internal/172.31.8.193 Jun 19,2025 18:24 UTC+0800 loki-bthspz-gateway-1 ns-wzxqi loki-bthspz gateway Running us-west-2a 200m / 200m 644245094400m / 644245094400m ip-172-31-10-42.us-west-2.compute.internal/172.31.10.42 Jun 19,2025 18:26 UTC+0800 loki-bthspz-read-0 ns-wzxqi loki-bthspz read Running us-west-2a 200m / 200m 644245094400m / 644245094400m ip-172-31-10-110.us-west-2.compute.internal/172.31.10.110 Jun 19,2025 18:24 UTC+0800 loki-bthspz-read-1 ns-wzxqi loki-bthspz read Running us-west-2a 200m / 200m 644245094400m / 644245094400m ip-172-31-3-103.us-west-2.compute.internal/172.31.3.103 Jun 19,2025 18:26 UTC+0800 loki-bthspz-write-0 ns-wzxqi loki-bthspz write Running us-west-2a 200m / 200m 644245094400m / 644245094400m ip-172-31-7-83.us-west-2.compute.internal/172.31.7.83 Jun 19,2025 18:24 UTC+0800 loki-bthspz-write-1 ns-wzxqi loki-bthspz write Running us-west-2a 200m / 200m 644245094400m / 644245094400m ip-172-31-3-103.us-west-2.compute.internal/172.31.3.103 Jun 19,2025 18:26 UTC+0800 check pod status done connect unsupported engine type: loki loki-backend No resources found in loki-bthspz namespace. check ops status `kbcli cluster list-ops loki-bthspz --status all --namespace ns-wzxqi ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME loki-bthspz-horizontalscaling-8tgw7 ns-wzxqi HorizontalScaling loki-bthspz write,read,gateway Succeed 3/3 Jun 19,2025 18:26 UTC+0800 check ops status done ops_status:loki-bthspz-horizontalscaling-8tgw7 ns-wzxqi HorizontalScaling loki-bthspz write,read,gateway Succeed 3/3 Jun 19,2025 18:26 UTC+0800 `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge opsrequests loki-bthspz-horizontalscaling-8tgw7 --namespace ns-wzxqi ` opsrequest.apps.kubeblocks.io/loki-bthspz-horizontalscaling-8tgw7 patched `kbcli cluster delete-ops --name loki-bthspz-horizontalscaling-8tgw7 --force --auto-approve --namespace ns-wzxqi ` OpsRequest loki-bthspz-horizontalscaling-8tgw7 deleted check component write exists `kubectl get components -l app.kubernetes.io/instance=loki-bthspz,apps.kubeblocks.io/component-name=write --namespace ns-wzxqi | (grep "write" || true )` check component read exists `kubectl get components -l app.kubernetes.io/instance=loki-bthspz,apps.kubeblocks.io/component-name=read --namespace ns-wzxqi | (grep "read" || true )` check component gateway exists `kubectl get components -l app.kubernetes.io/instance=loki-bthspz,apps.kubeblocks.io/component-name=gateway --namespace ns-wzxqi | (grep "gateway" || true )` cluster hscale check cluster status before ops check cluster status done cluster_status:Running No resources found in loki-bthspz namespace. `kbcli cluster hscale loki-bthspz --auto-approve --force=true --components write,read,gateway --replicas 1 --namespace ns-wzxqi ` OpsRequest loki-bthspz-horizontalscaling-wts58 created successfully, you can view the progress: kbcli cluster describe-ops loki-bthspz-horizontalscaling-wts58 -n ns-wzxqi check ops status `kbcli cluster list-ops loki-bthspz --status all --namespace ns-wzxqi ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME loki-bthspz-horizontalscaling-wts58 ns-wzxqi HorizontalScaling loki-bthspz write,read,gateway Running 0/3 Jun 19,2025 18:27 UTC+0800 check cluster status `kbcli cluster list loki-bthspz --show-labels --namespace ns-wzxqi ` NAME NAMESPACE CLUSTER-DEFINITION VERSION TERMINATION-POLICY STATUS CREATED-TIME LABELS loki-bthspz ns-wzxqi loki Delete Running Jun 19,2025 18:13 UTC+0800 app.kubernetes.io/instance=loki-bthspz,clusterdefinition.kubeblocks.io/name=loki,clusterversion.kubeblocks.io/name= check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances loki-bthspz --namespace ns-wzxqi ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME loki-bthspz-backend-0 ns-wzxqi loki-bthspz backend Running us-west-2a 200m / 200m 644245094400m / 644245094400m data:2Gi ip-172-31-1-25.us-west-2.compute.internal/172.31.1.25 Jun 19,2025 18:23 UTC+0800 loki-bthspz-gateway-0 ns-wzxqi loki-bthspz gateway Running us-west-2a 200m / 200m 644245094400m / 644245094400m ip-172-31-8-193.us-west-2.compute.internal/172.31.8.193 Jun 19,2025 18:24 UTC+0800 loki-bthspz-read-0 ns-wzxqi loki-bthspz read Running us-west-2a 200m / 200m 644245094400m / 644245094400m ip-172-31-10-110.us-west-2.compute.internal/172.31.10.110 Jun 19,2025 18:24 UTC+0800 loki-bthspz-write-0 ns-wzxqi loki-bthspz write Running us-west-2a 200m / 200m 644245094400m / 644245094400m ip-172-31-7-83.us-west-2.compute.internal/172.31.7.83 Jun 19,2025 18:24 UTC+0800 check pod status done connect unsupported engine type: loki loki-backend No resources found in loki-bthspz namespace. check ops status `kbcli cluster list-ops loki-bthspz --status all --namespace ns-wzxqi ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME loki-bthspz-horizontalscaling-wts58 ns-wzxqi HorizontalScaling loki-bthspz write,read,gateway Succeed 3/3 Jun 19,2025 18:27 UTC+0800 check ops status done ops_status:loki-bthspz-horizontalscaling-wts58 ns-wzxqi HorizontalScaling loki-bthspz write,read,gateway Succeed 3/3 Jun 19,2025 18:27 UTC+0800 `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge opsrequests loki-bthspz-horizontalscaling-wts58 --namespace ns-wzxqi ` opsrequest.apps.kubeblocks.io/loki-bthspz-horizontalscaling-wts58 patched `kbcli cluster delete-ops --name loki-bthspz-horizontalscaling-wts58 --force --auto-approve --namespace ns-wzxqi ` OpsRequest loki-bthspz-horizontalscaling-wts58 deleted cluster update terminationPolicy WipeOut `kbcli cluster update loki-bthspz --termination-policy=WipeOut --namespace ns-wzxqi ` cluster.apps.kubeblocks.io/loki-bthspz updated check cluster status `kbcli cluster list loki-bthspz --show-labels --namespace ns-wzxqi ` NAME NAMESPACE CLUSTER-DEFINITION VERSION TERMINATION-POLICY STATUS CREATED-TIME LABELS loki-bthspz ns-wzxqi loki WipeOut Running Jun 19,2025 18:13 UTC+0800 app.kubernetes.io/instance=loki-bthspz,clusterdefinition.kubeblocks.io/name=loki,clusterversion.kubeblocks.io/name= check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances loki-bthspz --namespace ns-wzxqi ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME loki-bthspz-backend-0 ns-wzxqi loki-bthspz backend Running us-west-2a 200m / 200m 644245094400m / 644245094400m data:2Gi ip-172-31-1-25.us-west-2.compute.internal/172.31.1.25 Jun 19,2025 18:23 UTC+0800 loki-bthspz-gateway-0 ns-wzxqi loki-bthspz gateway Running us-west-2a 200m / 200m 644245094400m / 644245094400m ip-172-31-8-193.us-west-2.compute.internal/172.31.8.193 Jun 19,2025 18:24 UTC+0800 loki-bthspz-read-0 ns-wzxqi loki-bthspz read Running us-west-2a 200m / 200m 644245094400m / 644245094400m ip-172-31-10-110.us-west-2.compute.internal/172.31.10.110 Jun 19,2025 18:24 UTC+0800 loki-bthspz-write-0 ns-wzxqi loki-bthspz write Running us-west-2a 200m / 200m 644245094400m / 644245094400m ip-172-31-7-83.us-west-2.compute.internal/172.31.7.83 Jun 19,2025 18:24 UTC+0800 check pod status done connect unsupported engine type: loki loki-backend cluster list-logs `kbcli cluster list-logs loki-bthspz --namespace ns-wzxqi ` No log files found. You can enable the log feature with the kbcli command below. kbcli cluster update loki-bthspz --enable-all-logs=true --namespace ns-wzxqi Error from server (NotFound): pods "loki-bthspz-backend-0" not found cluster logs `kbcli cluster logs loki-bthspz --tail 30 --namespace ns-wzxqi ` Defaulted container "backend" out of: backend, init (init) level=info ts=2025-06-19T10:23:20.081637016Z caller=ringmanager.go:188 msg="index gateway is JOINING in the ring" level=info ts=2025-06-19T10:23:20.081858798Z caller=ringmanager.go:197 msg="waiting until index gateway is ACTIVE in the ring" level=info ts=2025-06-19T10:23:20.161331715Z caller=ringmanager.go:218 msg="scheduler is ACTIVE in the ring" level=info ts=2025-06-19T10:23:20.161425786Z caller=module_service.go:82 msg=initialising module=query-scheduler level=info ts=2025-06-19T10:23:20.276066294Z caller=ringmanager.go:201 msg="index gateway is ACTIVE in the ring" level=info ts=2025-06-19T10:23:20.276199145Z caller=module_service.go:82 msg=initialising module=store level=info ts=2025-06-19T10:23:20.276237945Z caller=module_service.go:82 msg=initialising module=ruler level=info ts=2025-06-19T10:23:20.276277306Z caller=ruler.go:528 msg="ruler up and running" level=info ts=2025-06-19T10:23:20.276344166Z caller=module_service.go:82 msg=initialising module=index-gateway level=info ts=2025-06-19T10:23:20.927982739Z caller=compactor.go:409 msg="waiting until compactor is ACTIVE in the ring" level=info ts=2025-06-19T10:23:21.108640407Z caller=compactor.go:413 msg="compactor is ACTIVE in the ring" level=info ts=2025-06-19T10:23:21.108726448Z caller=loki.go:505 msg="Loki started" level=warn ts=2025-06-19T10:23:21.661963842Z caller=memberlist_client.go:595 msg="joining memberlist cluster: failed to reach any nodes" retries=1 err="1 error occurred:\n\t* Failed to join 10.100.103.255:7946: dial tcp 10.100.103.255:7946: connect: connection refused\n\n" level=info ts=2025-06-19T10:23:23.161620186Z caller=scheduler.go:615 msg="this scheduler is in the ReplicationSet, will now accept requests." level=warn ts=2025-06-19T10:23:24.255132409Z caller=memberlist_client.go:595 msg="joining memberlist cluster: failed to reach any nodes" retries=2 err="1 error occurred:\n\t* Failed to join 10.100.103.255:7946: dial tcp 10.100.103.255:7946: connect: connection refused\n\n" level=info ts=2025-06-19T10:23:26.109133633Z caller=compactor.go:474 msg="this instance has been chosen to run the compactor, starting compactor" level=info ts=2025-06-19T10:23:26.109262114Z caller=compactor.go:503 msg="waiting 5m0s for ring to stay stable and previous compactions to finish before starting compactor" level=warn ts=2025-06-19T10:23:31.410609723Z caller=memberlist_client.go:595 msg="joining memberlist cluster: failed to reach any nodes" retries=3 err="1 error occurred:\n\t* Failed to join 10.100.103.255:7946: dial tcp 10.100.103.255:7946: connect: connection refused\n\n" level=info ts=2025-06-19T10:23:46.580150338Z caller=memberlist_client.go:592 msg="joining memberlist cluster succeeded" reached_nodes=1 elapsed_time=26.755476961s level=warn ts=2025-06-19T10:24:15.325662811Z caller=tcp_transport.go:253 component="memberlist TCPTransport" msg="failed to read message type" err=EOF remote=172.31.5.82:51280 level=info ts=2025-06-19T10:28:19.919366293Z caller=table_manager.go:228 index-store=boltdb-shipper-2022-01-11 msg="syncing tables" level=info ts=2025-06-19T10:28:19.919424903Z caller=table_manager.go:271 index-store=boltdb-shipper-2022-01-11 msg="query readiness setup completed" duration=2.91µs distinct_users_len=0 distinct_users= level=info ts=2025-06-19T10:28:26.109800192Z caller=compactor.go:508 msg="compactor startup delay completed" level=info ts=2025-06-19T10:28:26.109871233Z caller=compactor.go:562 msg="compactor started" level=info ts=2025-06-19T10:28:26.109911063Z caller=compactor.go:517 msg="applying retention with compaction" level=info ts=2025-06-19T10:28:26.109888323Z caller=marker.go:177 msg="mark processor started" workers=500 delay=2h0m0s level=info ts=2025-06-19T10:28:26.109988124Z caller=expiration.go:78 msg="overall smallest retention period 1750156106.109, default smallest retention period 1750156106.109" ts=2025-06-19T10:28:26.110054644Z caller=spanlogger.go:86 level=info msg="building table names cache" level=info ts=2025-06-19T10:28:26.110099965Z caller=marker.go:202 msg="no marks file found" ts=2025-06-19T10:28:26.110177385Z caller=spanlogger.go:86 level=info msg="table names cache built" duration=108.131µs delete cluster loki-bthspz `kbcli cluster delete loki-bthspz --auto-approve --namespace ns-wzxqi ` Cluster loki-bthspz deleted pod_info:loki-bthspz-backend-0 1/1 Running 0 5m30s loki-bthspz-gateway-0 1/1 Running 0 4m19s loki-bthspz-read-0 1/1 Running 0 4m16s loki-bthspz-write-0 1/1 Running 0 4m16s No resources found in ns-wzxqi namespace. delete cluster pod done No resources found in ns-wzxqi namespace. check cluster resource non-exist OK: pvc No resources found in ns-wzxqi namespace. delete cluster done No resources found in ns-wzxqi namespace. No resources found in ns-wzxqi namespace. No resources found in ns-wzxqi namespace. Loki Test Suite All Done! --------------------------------------Loki (Topology = loki-cluster Replicas 1) Test Result-------------------------------------- [PASSED]|[Create]|[Topology=loki-cluster;ComponentVersion=loki;ServiceVersion=1.0.0;]|[Description=Create a cluster with the specified topology loki-cluster and component version loki and service version 1.0.0] [PASSED]|[Restart]|[ComponentName=backend,gateway]|[Description=Restart the cluster specify component backend,gateway] [PASSED]|[VerticalScaling]|[ComponentName=backend]|[Description=VerticalScaling the cluster specify component backend] [PASSED]|[Check Monitor]|[Enable=true]|[Description=Check Monitor Enable] [PASSED]|[Update]|[Monitor=true]|[Description=Update the cluster Monitor enable] [PASSED]|[HorizontalScaling Out]|[ComponentName=backend]|[Description=HorizontalScaling Out the cluster specify component backend] [PASSED]|[HorizontalScaling In]|[ComponentName=backend]|[Description=HorizontalScaling In the cluster specify component backend] [PASSED]|[Restart]|[ComponentName=write,read]|[Description=Restart the cluster specify component write,read] [PASSED]|[Stop]|[-]|[Description=Stop the cluster] [PASSED]|[Start]|[-]|[Description=Start the cluster] [PASSED]|[Restart]|[-]|[Description=Restart the cluster] [PASSED]|[VerticalScaling]|[ComponentName=write,read,gateway]|[Description=VerticalScaling the cluster specify component write,read,gateway] [PASSED]|[VolumeExpansion]|[ComponentName=backend]|[Description=VolumeExpansion the cluster specify component backend] [PASSED]|[HorizontalScaling Out]|[ComponentName=write,read,gateway]|[Description=HorizontalScaling Out the cluster specify component write,read,gateway] [PASSED]|[HorizontalScaling In]|[ComponentName=write,read,gateway]|[Description=HorizontalScaling In the cluster specify component write,read,gateway] [PASSED]|[Update]|[TerminationPolicy=WipeOut]|[Description=Update the cluster TerminationPolicy WipeOut] [PASSED]|[Delete]|[-]|[Description=Delete the cluster] [END]