source commons files source engines files source kubeblocks files `kubectl get namespace | grep ns-jlcfp ` `kubectl create namespace ns-jlcfp` namespace/ns-jlcfp created create namespace ns-jlcfp done download kbcli `gh release list --repo apecloud/kbcli --limit 100 | (grep "0.9" || true)` `curl -fsSL https://kubeblocks.io/installer/install_cli.sh | bash -s v0.9.4-beta.1` Your system is linux_amd64 Installing kbcli ... Downloading ... % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 32.1M 100 32.1M 0 0 47.9M 0 --:--:-- --:--:-- --:--:-- 47.9M kbcli installed successfully. Kubernetes: v1.32.5-eks-5d4a308 KubeBlocks: 0.9.4 kbcli: 0.9.4-beta.1 WARNING: version difference between kbcli (0.9.4-beta.1) and kubeblocks (0.9.4) Make sure your docker service is running and begin your journey with kbcli: kbcli playground init For more information on how to get started, please visit: https://kubeblocks.io download kbcli v0.9.4-beta.1 done Kubernetes: v1.32.5-eks-5d4a308 KubeBlocks: 0.9.4 kbcli: 0.9.4-beta.1 WARNING: version difference between kbcli (0.9.4-beta.1) and kubeblocks (0.9.4) Kubernetes Env: v1.32.5-eks-5d4a308 POD_RESOURCES: No resources found found default storage class: gp3 kubeblocks version is:0.9.4 skip upgrade kubeblocks Error: no repositories to show helm repo add chaos-mesh https://charts.chaos-mesh.org "chaos-mesh" has been added to your repositories add helm chart repo chaos-mesh success chaos mesh already installed check cluster definition set component name:ggml set component version No resources found no component version found unsupported component definition not found component version set replicas first:2 set replicas third:2 set minimum cmpv service version set minimum cmpv service version replicas:2 REPORT_COUNT:1 CLUSTER_TOPOLOGY: Not found topology in cluster definition ggml LIMIT_CPU:1 LIMIT_MEMORY:6 storage size: 20 No resources found in ns-jlcfp namespace. termination_policy:WipeOut create 2 replica WipeOut ggml cluster check cluster version check cluster definition `kbcli cluster create ggml-wjerys --termination-policy=WipeOut --cluster-definition=ggml --enable-all-logs=false --cluster-version=ggml-baichuan2-7b-4q --set cpu=1000m,memory=6Gi,replicas=2,storage=20Gi --namespace ns-jlcfp ` Cluster ggml-wjerys created check cluster status `kbcli cluster list ggml-wjerys --show-labels --namespace ns-jlcfp ` NAME NAMESPACE CLUSTER-DEFINITION VERSION TERMINATION-POLICY STATUS CREATED-TIME LABELS ggml-wjerys ns-jlcfp ggml ggml-baichuan2-7b-4q WipeOut Jun 19,2025 18:12 UTC+0800 clusterdefinition.kubeblocks.io/name=ggml,clusterversion.kubeblocks.io/name=ggml-baichuan2-7b-4q cluster_status: cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances ggml-wjerys --namespace ns-jlcfp ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME ggml-wjerys-ggml-0 ns-jlcfp ggml-wjerys ggml Running us-west-2a 1 / 1 6Gi / 6Gi data:20Gi ip-172-31-7-91.us-west-2.compute.internal/172.31.7.91 Jun 19,2025 18:13 UTC+0800 ggml-wjerys-ggml-1 ns-jlcfp ggml-wjerys ggml Running us-west-2a 1 / 1 6Gi / 6Gi data:20Gi ip-172-31-9-240.us-west-2.compute.internal/172.31.9.240 Jun 19,2025 18:17 UTC+0800 check pod status done connect unsupported engine type: ggml `kubectl get secrets -l app.kubernetes.io/instance=ggml-wjerys` `kubectl get secrets ggml-wjerys-conn-credential -o jsonpath="***.data.username***"` `kubectl get secrets ggml-wjerys-conn-credential -o jsonpath="***.data.password***"` `kubectl get secrets ggml-wjerys-conn-credential -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:;DB_PORT:;DB_DATABASE: There is no password in Type: 31. describe cluster `kbcli cluster describe ggml-wjerys --namespace ns-jlcfp ` Name: ggml-wjerys Created Time: Jun 19,2025 18:12 UTC+0800 NAMESPACE CLUSTER-DEFINITION VERSION STATUS TERMINATION-POLICY ns-jlcfp ggml ggml-baichuan2-7b-4q Running WipeOut Endpoints: COMPONENT MODE INTERNAL EXTERNAL ggml ReadWrite ggml-wjerys-ggml.ns-jlcfp.svc.cluster.local:8000 Topology: COMPONENT INSTANCE ROLE STATUS AZ NODE CREATED-TIME ggml ggml-wjerys-ggml-0 Running us-west-2a ip-172-31-7-91.us-west-2.compute.internal/172.31.7.91 Jun 19,2025 18:13 UTC+0800 ggml ggml-wjerys-ggml-1 Running us-west-2a ip-172-31-9-240.us-west-2.compute.internal/172.31.9.240 Jun 19,2025 18:17 UTC+0800 Resources Allocation: COMPONENT DEDICATED CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE-SIZE STORAGE-CLASS ggml false 1 / 1 6Gi / 6Gi data:20Gi kb-default-sc Images: COMPONENT TYPE IMAGE ggml ggml docker.io/apecloud/llama-cpp-python:latest-new Show cluster events: kbcli cluster list-events -n ns-jlcfp ggml-wjerys `kbcli cluster label ggml-wjerys app.kubernetes.io/instance- --namespace ns-jlcfp ` label "app.kubernetes.io/instance" not found. `kbcli cluster label ggml-wjerys app.kubernetes.io/instance=ggml-wjerys --namespace ns-jlcfp ` `kbcli cluster label ggml-wjerys --list --namespace ns-jlcfp ` NAME NAMESPACE LABELS ggml-wjerys ns-jlcfp app.kubernetes.io/instance=ggml-wjerys clusterdefinition.kubeblocks.io/name=ggml clusterversion.kubeblocks.io/name=ggml-baichuan2-7b-4q label cluster app.kubernetes.io/instance=ggml-wjerys Success `kbcli cluster label case.name=kbcli.test1 -l app.kubernetes.io/instance=ggml-wjerys --namespace ns-jlcfp ` `kbcli cluster label ggml-wjerys --list --namespace ns-jlcfp ` NAME NAMESPACE LABELS ggml-wjerys ns-jlcfp app.kubernetes.io/instance=ggml-wjerys case.name=kbcli.test1 clusterdefinition.kubeblocks.io/name=ggml clusterversion.kubeblocks.io/name=ggml-baichuan2-7b-4q label cluster case.name=kbcli.test1 Success `kbcli cluster label ggml-wjerys case.name=kbcli.test2 --overwrite --namespace ns-jlcfp ` `kbcli cluster label ggml-wjerys --list --namespace ns-jlcfp ` NAME NAMESPACE LABELS ggml-wjerys ns-jlcfp app.kubernetes.io/instance=ggml-wjerys case.name=kbcli.test2 clusterdefinition.kubeblocks.io/name=ggml clusterversion.kubeblocks.io/name=ggml-baichuan2-7b-4q label cluster case.name=kbcli.test2 Success `kbcli cluster label ggml-wjerys case.name- --namespace ns-jlcfp ` `kbcli cluster label ggml-wjerys --list --namespace ns-jlcfp ` NAME NAMESPACE LABELS ggml-wjerys ns-jlcfp app.kubernetes.io/instance=ggml-wjerys clusterdefinition.kubeblocks.io/name=ggml clusterversion.kubeblocks.io/name=ggml-baichuan2-7b-4q delete cluster label case.name Success cluster connect create curl-jq pod ggml-wjerys-curl-jq `kubectl run --namespace ns-jlcfp ggml-wjerys-curl-jq --restart='Never' --image docker.io/apecloud/curl-jq:0.1.0 --command -- sleep infinity ` pod/ggml-wjerys-curl-jq created check pod status pod_status:NAME READY STATUS RESTARTS AGE ggml-wjerys-curl-jq 0/1 ContainerCreating 0 1s check pod ggml-wjerys-curl-jq status done `kubectl wait --for=condition=Ready pod ggml-wjerys-curl-jq --namespace ns-jlcfp` pod/ggml-wjerys-curl-jq condition met pod_status:NAME READY STATUS RESTARTS AGE ggml-wjerys-curl-jq 1/1 Running 0 6s `kubectl get secrets -l app.kubernetes.io/instance=ggml-wjerys` `kubectl get secrets ggml-wjerys-conn-credential -o jsonpath="***.data.username***"` `kubectl get secrets ggml-wjerys-conn-credential -o jsonpath="***.data.password***"` `kubectl get secrets ggml-wjerys-conn-credential -o jsonpath="***.data.port***"` DB_USERNAME:root;DB_PASSWORD:;DB_PORT:;DB_DATABASE: `echo "curl -X POST 'ggml-wjerys-ggml-0.ggml-wjerys-ggml-headless:8000/v1/completions' -H 'Content-Type: application/json' -d '***\"prompt\": \"世界第二高峰是哪座\", \"temperature\": 0, \"max_tokens\": 64***' " | kubectl exec -it ggml-wjerys-curl-jq --namespace ns-jlcfp -- sh ` Unable to use a TTY - input is not a terminal or the right kind of file % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 77 0 0 100 77 0 64 0:00:01 0:00:01 --:--:-- 64 100 77 0 0 100 77 0 34 0:00:02 0:00:02 --:--:-- 34 100 77 0 0 100 77 0 24 0:00:03 0:00:03 --:--:-- 24 100 77 0 0 100 77 0 18 0:00:04 0:00:04 --:--:-- 18 100 77 0 0 100 77 0 14 0:00:05 0:00:05 --:--:-- 14 100 77 0 0 100 77 0 12 0:00:06 0:00:06 --:--:-- 0 100 77 0 0 100 77 0 10 0:00:07 0:00:07 --:--:-- 0 100 77 0 0 100 77 0 9 0:00:08 0:00:08 --:--:-- 0 100 77 0 0 100 77 0 8 0:00:09 0:00:09 --:--:-- 0 100 77 0 0 100 77 0 7 0:00:11 0:00:10 0:00:01 0 100 77 0 0 100 77 0 6 0:00:12 0:00:11 0:00:01 0 100 77 0 0 100 77 0 6 0:00:12 0:00:12 --:--:-- 0 100 77 0 0 100 77 0 5 0:00:15 0:00:13 0:00:02 0 100 77 0 0 100 77 0 5 0:00:15 0:00:14 0:00:01 0 100 77 0 0 100 77 0 5 0:00:15 0:00:15 --:--:-- 0 100 77 0 0 100 77 0 4 0:00:19 0:00:16 0:00:03 0 100 77 0 0 100 77 0 4 0:00:19 0:00:17 0:00:02 0 100 77 0 0 100 77 0 4 0:00:19 0:00:18 0:00:01 0 100 77 0 0 100 77 0 4 0:00:19 0:00:19 --:--:-- 0 100 77 0 0 100 77 0 3 0:00:25 0:00:20 0:00:05 0 100 77 0 0 100 77 0 3 0:00:25 0:00:21 0:00:04 0 100 77 0 0 100 77 0 3 0:00:25 0:00:22 0:00:03 0 100 77 0 0 100 77 0 3 0:00:25 0:00:23 0:00:02 0 100 77 0 0 100 77 0 3 0:00:25 0:00:24 0:00:01 0 100 77 0 0 100 77 0 3 0:00:25 0:00:25 --:--:-- 0 100 77 0 0 100 77 0 2 0:00:38 0:00:26 0:00:12 0 100 77 0 0 100 77 0 2 0:00:38 0:00:27 0:00:11 0 100 77 0 0 100 77 0 2 0:00:38 0:00:28 0:00:10 0 100 77 0 0 100 77 0 2 0:00:38 0:00:29 0:00:09 0 100 77 0 0 100 77 0 2 0:00:38 0:00:30 0:00:08 0 100 77 0 0 100 77 0 2 0:00:38 0:00:31 0:00:07 0 100 77 0 0 100 77 0 2 0:00:38 0:00:32 0:00:06 0 100 77 0 0 100 77 0 2 0:00:38 0:00:33 0:00:05 0 100 77 0 0 100 77 0 2 0:00:38 0:00:34 0:00:04 0 100 77 0 0 100 77 0 2 0:00:38 0:00:35 0:00:03 0 100 77 0 0 100 77 0 2 0:00:38 0:00:36 0:00:02 0 100 77 0 0 100 77 0 2 0:00:38 0:00:37 0:00:01 0 100 77 0 0 100 77 0 2 0:00:38 0:00:38 --:--:-- 0 100 77 0 0 100 77 0 1 0:01:17 0:00:39 0:00:38 0 100 77 0 0 100 77 0 1 0:01:17 0:00:40 0:00:37 0 100 77 0 0 100 77 0 1 0:01:17 0:00:41 0:00:36 0 100 77 0 0 100 77 0 1 0:01:17 0:00:42 0:00:35 0 100 77 0 0 100 77 0 1 0:01:17 0:00:43 0:00:34 0 100 77 0 0 100 77 0 1 0:01:17 0:00:44 0:00:33 0 100 77 0 0 100 77 0 1 0:01:17 0:00:45 0:00:32 0 100 77 0 0 100 77 0 1 0:01:17 0:00:46 0:00:31 0 100 77 0 0 100 77 0 1 0:01:17 0:00:47 0:00:30 0 100 77 0 0 100 77 0 1 0:01:17 0:00:48 0:00:29 0 100 77 0 0 100 77 0 1 0:01:17 0:00:49 0:00:28 0 100 77 0 0 100 77 0 1 0:01:17 0:00:50 0:00:27 0 100 77 0 0 100 77 0 1 0:01:17 0:00:51 0:00:26 0 100 77 0 0 100 77 0 1 0:01:17 0:00:52 0:00:25 0 100 77 0 0 100 77 0 1 0:01:17 0:00:53 0:00:24 0 100 77 0 0 100 77 0 1 0:01:17 0:00:54 0:00:23 0 100 77 0 0 100 77 0 1 0:01:17 0:00:55 0:00:22 0 100 77 0 0 100 77 0 1 0:01:17 0:00:56 0:00:21 0 100 77 0 0 100 77 0 1 0:01:17 0:00:57 0:00:20 0 100 77 0 0 100 77 0 1 0:01:17 0:00:58 0:00:19 0 100 77 0 0 100 77 0 1 0:01:17 0:00:59 0:00:18 0 100 77 0 0 100 77 0 1 0:01:17 0:01:00 0:00:17 0 100 77 0 0 100 77 0 1 0:01:17 0:01:01 0:00:16 0 100 77 0 0 100 77 0 1 0:01:17 0:01:02 0:00:15 0 100 77 0 0 100 77 0 1 0:01:17 0:01:03 0:00:14 0 100 77 0 0 100 77 0 1 0:01:17 0:01:04 0:00:13 0 100 77 0 0 100 77 0 1 0:01:17 0:01:05 0:00:12 0 100 77 0 0 100 77 0 1 0:01:17 0:01:06 0:00:11 0 100 77 0 0 100 77 0 1 0:01:17 0:01:07 0:00:10 0 100 77 0 0 100 77 0 1 0:01:17 0:01:08 0:00:09 0 100 77 0 0 100 77 0 1 0:01:17 0:01:09 0:00:08 0 100 77 0 0 100 77 0 1 0:01:17 0:01:10 0:00:07 0 100 77 0 0 100 77 0 1 0:01:17 0:01:11 0:00:06 0 100 77 0 0 100 77 0 1 0:01:17 0:01:12 0:00:05 0 100 77 0 0 100 77 0 1 0:01:17 0:01:13 0:00:04 0 100 77 0 0 100 77 0 1 0:01:17 0:01:14 0:00:03 0 100 77 0 0 100 77 0 1 0:01:17 0:01:15 0:00:02 0 100 77 0 0 100 77 0 1 0:01:17 0:01:16 0:00:01 0 100 77 0 0 0 77 0 0 --:--:-- 0:01:17 --:--:-- 0 100 77 0 0 0 77 0 0 --:--:-- 0:01:18 --:--:-- 0 100 77 0 0 0 77 0 0 --:--:-- 0:01:19 --:--:-- 0 100 77 0 0 0 77 0 0 --:--:-- 0:01:20 --:--:-- 0 100 77 0 0 0 77 0 0 --:--:-- 0:01:21 --:--:-- 0 100 77 0 0 0 77 0 0 --:--:-- 0:01:22 --:--:-- 0 100 77 0 0 0 77 0 0 --:--:-- 0:01:23 --:--:-- 0 100 77 0 0 0 77 0 0 --:--:-- 0:01:24 --:--:-- 0 100 77 0 0 0 77 0 0 --:--:-- 0:01:25 --:--:-- 0 100 77 0 0 0 77 0 0 --:--:-- 0:01:26 --:--:-- 0 100 603 100 526 0 77 6 0 0:01:27 0:01:27 --:--:-- 108 100 603 100 526 0 77 6 0 0:01:27 0:01:27 --:--:-- 137 ***"id":"cmpl-51de2258-83f4-457f-b328-ca1d6e9b9552","object":"text_completion","created":1750328443,"model":"/models/ggml-model-q4.gguf","choices":[***"text":"山峰 [答案] 珠穆朗玛峰 [解析]根据资料可知\"世界最高山峰\"指的是珠穆朗玛峰,\"世界第二高峰\"自然就是仅次于珠穆朗玛峰的山峰—K2山脉的主峰—乔戈里峰/喀喇昆仑山脉的主峰—乔戈里","index":0,"logprobs":null,"finish_reason":"length"***],"usage":***"prompt_tokens":7,"completion_tokens":64,"total_tokens":71*** connect cluster Success `kubectl delete pod ggml-wjerys-curl-jq --force --namespace ns-jlcfp ` Warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely. pod "ggml-wjerys-curl-jq" force deleted cluster stop check cluster status before ops check cluster status done cluster_status:Running `kbcli cluster stop ggml-wjerys --auto-approve --force=true --namespace ns-jlcfp ` OpsRequest ggml-wjerys-stop-bmmsj created successfully, you can view the progress: kbcli cluster describe-ops ggml-wjerys-stop-bmmsj -n ns-jlcfp check ops status `kbcli cluster list-ops ggml-wjerys --status all --namespace ns-jlcfp ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME ggml-wjerys-stop-bmmsj ns-jlcfp Stop ggml-wjerys ggml Running 0/2 Jun 19,2025 18:22 UTC+0800 check cluster status `kbcli cluster list ggml-wjerys --show-labels --namespace ns-jlcfp ` NAME NAMESPACE CLUSTER-DEFINITION VERSION TERMINATION-POLICY STATUS CREATED-TIME LABELS ggml-wjerys ns-jlcfp ggml ggml-baichuan2-7b-4q WipeOut Stopping Jun 19,2025 18:12 UTC+0800 app.kubernetes.io/instance=ggml-wjerys,clusterdefinition.kubeblocks.io/name=ggml,clusterversion.kubeblocks.io/name=ggml-baichuan2-7b-4q cluster_status:Stopping cluster_status:Stopping cluster_status:Stopping cluster_status:Stopping cluster_status:Stopping cluster_status:Stopping cluster_status:Stopping cluster_status:Stopping cluster_status:Stopping cluster_status:Stopping check cluster status done cluster_status:Stopped check pod status `kbcli cluster list-instances ggml-wjerys --namespace ns-jlcfp ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME check pod status done check ops status `kbcli cluster list-ops ggml-wjerys --status all --namespace ns-jlcfp ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME ggml-wjerys-stop-bmmsj ns-jlcfp Stop ggml-wjerys ggml Succeed 2/2 Jun 19,2025 18:22 UTC+0800 check ops status done ops_status:ggml-wjerys-stop-bmmsj ns-jlcfp Stop ggml-wjerys ggml Succeed 2/2 Jun 19,2025 18:22 UTC+0800 `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge opsrequests ggml-wjerys-stop-bmmsj --namespace ns-jlcfp ` opsrequest.apps.kubeblocks.io/ggml-wjerys-stop-bmmsj patched `kbcli cluster delete-ops --name ggml-wjerys-stop-bmmsj --force --auto-approve --namespace ns-jlcfp ` OpsRequest ggml-wjerys-stop-bmmsj deleted cluster start check cluster status before ops check cluster status done cluster_status:Stopped `kbcli cluster start ggml-wjerys --force=true --namespace ns-jlcfp ` OpsRequest ggml-wjerys-start-pq7fw created successfully, you can view the progress: kbcli cluster describe-ops ggml-wjerys-start-pq7fw -n ns-jlcfp check ops status `kbcli cluster list-ops ggml-wjerys --status all --namespace ns-jlcfp ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME ggml-wjerys-start-pq7fw ns-jlcfp Start ggml-wjerys ggml Running 0/2 Jun 19,2025 18:23 UTC+0800 check cluster status `kbcli cluster list ggml-wjerys --show-labels --namespace ns-jlcfp ` NAME NAMESPACE CLUSTER-DEFINITION VERSION TERMINATION-POLICY STATUS CREATED-TIME LABELS ggml-wjerys ns-jlcfp ggml ggml-baichuan2-7b-4q WipeOut Updating Jun 19,2025 18:12 UTC+0800 app.kubernetes.io/instance=ggml-wjerys,clusterdefinition.kubeblocks.io/name=ggml,clusterversion.kubeblocks.io/name=ggml-baichuan2-7b-4q cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances ggml-wjerys --namespace ns-jlcfp ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME ggml-wjerys-ggml-0 ns-jlcfp ggml-wjerys ggml Running us-west-2a 1 / 1 6Gi / 6Gi data:20Gi ip-172-31-7-91.us-west-2.compute.internal/172.31.7.91 Jun 19,2025 18:23 UTC+0800 ggml-wjerys-ggml-1 ns-jlcfp ggml-wjerys ggml Running us-west-2a 1 / 1 6Gi / 6Gi data:20Gi ip-172-31-9-240.us-west-2.compute.internal/172.31.9.240 Jun 19,2025 18:24 UTC+0800 check pod status done connect unsupported engine type: ggml check ops status `kbcli cluster list-ops ggml-wjerys --status all --namespace ns-jlcfp ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME ggml-wjerys-start-pq7fw ns-jlcfp Start ggml-wjerys ggml Succeed 2/2 Jun 19,2025 18:23 UTC+0800 check ops status done ops_status:ggml-wjerys-start-pq7fw ns-jlcfp Start ggml-wjerys ggml Succeed 2/2 Jun 19,2025 18:23 UTC+0800 `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge opsrequests ggml-wjerys-start-pq7fw --namespace ns-jlcfp ` opsrequest.apps.kubeblocks.io/ggml-wjerys-start-pq7fw patched `kbcli cluster delete-ops --name ggml-wjerys-start-pq7fw --force --auto-approve --namespace ns-jlcfp ` OpsRequest ggml-wjerys-start-pq7fw deleted cluster restart check cluster status before ops check cluster status done cluster_status:Running `kbcli cluster restart ggml-wjerys --auto-approve --force=true --namespace ns-jlcfp ` OpsRequest ggml-wjerys-restart-22k2d created successfully, you can view the progress: kbcli cluster describe-ops ggml-wjerys-restart-22k2d -n ns-jlcfp check ops status `kbcli cluster list-ops ggml-wjerys --status all --namespace ns-jlcfp ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME ggml-wjerys-restart-22k2d ns-jlcfp Restart ggml-wjerys ggml Running -/- Jun 19,2025 18:24 UTC+0800 check cluster status `kbcli cluster list ggml-wjerys --show-labels --namespace ns-jlcfp ` NAME NAMESPACE CLUSTER-DEFINITION VERSION TERMINATION-POLICY STATUS CREATED-TIME LABELS ggml-wjerys ns-jlcfp ggml ggml-baichuan2-7b-4q WipeOut Updating Jun 19,2025 18:12 UTC+0800 app.kubernetes.io/instance=ggml-wjerys,clusterdefinition.kubeblocks.io/name=ggml,clusterversion.kubeblocks.io/name=ggml-baichuan2-7b-4q cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances ggml-wjerys --namespace ns-jlcfp ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME ggml-wjerys-ggml-0 ns-jlcfp ggml-wjerys ggml Running us-west-2a 1 / 1 6Gi / 6Gi data:20Gi ip-172-31-7-91.us-west-2.compute.internal/172.31.7.91 Jun 19,2025 18:26 UTC+0800 ggml-wjerys-ggml-1 ns-jlcfp ggml-wjerys ggml Running us-west-2a 1 / 1 6Gi / 6Gi data:20Gi ip-172-31-9-240.us-west-2.compute.internal/172.31.9.240 Jun 19,2025 18:25 UTC+0800 check pod status done connect unsupported engine type: ggml check ops status `kbcli cluster list-ops ggml-wjerys --status all --namespace ns-jlcfp ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME ggml-wjerys-restart-22k2d ns-jlcfp Restart ggml-wjerys ggml Succeed 2/2 Jun 19,2025 18:24 UTC+0800 check ops status done ops_status:ggml-wjerys-restart-22k2d ns-jlcfp Restart ggml-wjerys ggml Succeed 2/2 Jun 19,2025 18:24 UTC+0800 `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge opsrequests ggml-wjerys-restart-22k2d --namespace ns-jlcfp ` opsrequest.apps.kubeblocks.io/ggml-wjerys-restart-22k2d patched `kbcli cluster delete-ops --name ggml-wjerys-restart-22k2d --force --auto-approve --namespace ns-jlcfp ` OpsRequest ggml-wjerys-restart-22k2d deleted cluster update terminationPolicy WipeOut `kbcli cluster update ggml-wjerys --termination-policy=WipeOut --namespace ns-jlcfp ` cluster.apps.kubeblocks.io/ggml-wjerys updated (no change) check cluster status `kbcli cluster list ggml-wjerys --show-labels --namespace ns-jlcfp ` NAME NAMESPACE CLUSTER-DEFINITION VERSION TERMINATION-POLICY STATUS CREATED-TIME LABELS ggml-wjerys ns-jlcfp ggml ggml-baichuan2-7b-4q WipeOut Running Jun 19,2025 18:12 UTC+0800 app.kubernetes.io/instance=ggml-wjerys,clusterdefinition.kubeblocks.io/name=ggml,clusterversion.kubeblocks.io/name=ggml-baichuan2-7b-4q check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances ggml-wjerys --namespace ns-jlcfp ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME ggml-wjerys-ggml-0 ns-jlcfp ggml-wjerys ggml Running us-west-2a 1 / 1 6Gi / 6Gi data:20Gi ip-172-31-7-91.us-west-2.compute.internal/172.31.7.91 Jun 19,2025 18:26 UTC+0800 ggml-wjerys-ggml-1 ns-jlcfp ggml-wjerys ggml Running us-west-2a 1 / 1 6Gi / 6Gi data:20Gi ip-172-31-9-240.us-west-2.compute.internal/172.31.9.240 Jun 19,2025 18:25 UTC+0800 check pod status done connect unsupported engine type: ggml cluster list-logs `kbcli cluster list-logs ggml-wjerys --namespace ns-jlcfp ` No log files found. You can enable the log feature with the kbcli command below. kbcli cluster update ggml-wjerys --enable-all-logs=true --namespace ns-jlcfp Error from server (NotFound): pods "ggml-wjerys-ggml-0" not found cluster logs `kbcli cluster logs ggml-wjerys --tail 30 --namespace ns-jlcfp ` Defaulted container "ggml" out of: ggml, download (init) python3 -m pip install -e . Obtaining file:///app Installing build dependencies: started Installing build dependencies: finished with status 'done' Checking if build backend supports build_editable: started Checking if build backend supports build_editable: finished with status 'done' Getting requirements to build editable: started Getting requirements to build editable: finished with status 'done' Installing backend dependencies: started Installing backend dependencies: finished with status 'done' Preparing editable metadata (pyproject.toml): started Preparing editable metadata (pyproject.toml): finished with status 'done' Requirement already satisfied: typing-extensions>=4.5.0 in /usr/local/lib/python3.12/site-packages (from llama_cpp_python==0.2.11) (4.8.0) Requirement already satisfied: numpy>=1.20.0 in /usr/local/lib/python3.12/site-packages (from llama_cpp_python==0.2.11) (1.26.1) Requirement already satisfied: diskcache>=5.6.1 in /usr/local/lib/python3.12/site-packages (from llama_cpp_python==0.2.11) (5.6.3) Building wheels for collected packages: llama_cpp_python Building editable for llama_cpp_python (pyproject.toml): started delete cluster ggml-wjerys `kbcli cluster delete ggml-wjerys --auto-approve --namespace ns-jlcfp ` Cluster ggml-wjerys deleted pod_info:ggml-wjerys-ggml-0 1/1 Terminating 0 59s ggml-wjerys-ggml-1 1/1 Terminating 0 2m7s pod_info:ggml-wjerys-ggml-0 1/1 Terminating 0 80s ggml-wjerys-ggml-1 1/1 Terminating 0 2m28s No resources found in ns-jlcfp namespace. delete cluster pod done No resources found in ns-jlcfp namespace. check cluster resource non-exist OK: pvc No resources found in ns-jlcfp namespace. delete cluster done No resources found in ns-jlcfp namespace. No resources found in ns-jlcfp namespace. No resources found in ns-jlcfp namespace. Ggml Test Suite All Done! --------------------------------------GGML (Topology = Replicas 2) Test Result-------------------------------------- [PASSED]|[Create]|[ClusterDefinition=ggml;ClusterVersion=ggml-baichuan2-7b-4q;]|[Description=Create a cluster with the specified cluster definition ggml and cluster version ggml-baichuan2-7b-4q] [PASSED]|[Connect]|[ComponentName=ggml]|[Description=Connect to the cluster] [PASSED]|[Stop]|[-]|[Description=Stop the cluster] [PASSED]|[Start]|[-]|[Description=Start the cluster] [PASSED]|[Restart]|[-]|[Description=Restart the cluster] [PASSED]|[Update]|[TerminationPolicy=WipeOut]|[Description=Update the cluster TerminationPolicy WipeOut] [PASSED]|[Delete]|[-]|[Description=Delete the cluster] [END]