KubeBlocks version is:1.0.2 skip upgrade KubeBlocks current KubeBlocks version: 1.0.2 helm repo chaos-mesh https://charts.chaos-mesh.org exists chaos mesh already installed check component definition set component name:mongodb set component version set component version:mongodb set service versions:8.0.17,7.0.28,6.0.27,5.0.29,4.4.29 set service versions sorted:4.4.29,5.0.29,6.0.27,7.0.28,8.0.17 set mongodb component definition set mongodb component definition mongo-shard-1.0.2 REPORT_COUNT 0: 0 set replicas first:3,4.4.29|3,5.0.29|3,6.0.27|3,7.0.28|3,8.0.17 set replicas third:3,4.4.29 set replicas fourth:3,4.4.29 set minimum cmpv service version set minimum cmpv service version replicas:3,4.4.29 set replicas end:3,4.4.29 REPORT_COUNT:1 CLUSTER_TOPOLOGY:replicaset cluster definition topology: replicaset sharding topology replicaset found in cluster definition mongodb set mongodb component definition set mongodb component definition mongodb-1.0.2 LIMIT_CPU:0.1 LIMIT_MEMORY:0.5 storage size: 20 CLUSTER_NAME:mongodb-eflsbm No resources found in default namespace. pod_info: termination_policy:WipeOut create 3 replica WipeOut mongodb cluster check component definition set component definition by component version check cmpd by labels check cmpd by compDefs set component definition: mongodb-1.0.2 by component version:mongodb apiVersion: apps.kubeblocks.io/v1 kind: Cluster metadata: name: mongodb-eflsbm namespace: default spec: clusterDef: mongodb topology: replicaset terminationPolicy: WipeOut componentSpecs: - name: mongodb serviceVersion: 4.4.29 replicas: 3 resources: limits: cpu: 100m memory: 0.5Gi requests: cpu: 100m memory: 0.5Gi volumeClaimTemplates: - name: data spec: storageClassName: accessModes: - ReadWriteOnce resources: requests: storage: 20Gi `kubectl apply -f test_create_mongodb-eflsbm.yaml` cluster.apps.kubeblocks.io/mongodb-eflsbm created apply test_create_mongodb-eflsbm.yaml Success `rm -rf test_create_mongodb-eflsbm.yaml` check cluster status `kbcli cluster list mongodb-eflsbm --show-labels --namespace default ` NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS mongodb-eflsbm default mongodb WipeOut Creating Feb 12,2026 12:11 UTC+0800 clusterdefinition.kubeblocks.io/name=mongodb cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances mongodb-eflsbm --namespace default ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME mongodb-eflsbm-mongodb-0 default mongodb-eflsbm mongodb Running primary cn-guangzhou-b 100m / 100m 512Mi / 512Mi data:20Gi 192.168.0.200/192.168.0.200 Feb 12,2026 12:11 UTC+0800 mongodb-eflsbm-mongodb-1 default mongodb-eflsbm mongodb Running secondary cn-guangzhou-b 100m / 100m 512Mi / 512Mi data:20Gi 192.168.0.13/192.168.0.13 Feb 12,2026 12:11 UTC+0800 mongodb-eflsbm-mongodb-2 default mongodb-eflsbm mongodb Running secondary cn-guangzhou-b 100m / 100m 512Mi / 512Mi data:20Gi 192.168.0.159/192.168.0.159 Feb 12,2026 12:11 UTC+0800 check pod status done check cluster role check cluster role done primary: mongodb-eflsbm-mongodb-0;secondary: mongodb-eflsbm-mongodb-1 mongodb-eflsbm-mongodb-2 `kubectl get secrets -l app.kubernetes.io/instance=mongodb-eflsbm` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.username}"` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.password}"` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.port}"` DB_USERNAME:root;DB_PASSWORD:403nfj8Y0jh2R14x;DB_PORT:27017;DB_DATABASE: No resources found in default namespace. check cluster connect `echo " echo \"\" | mongo --host mongodb-eflsbm-mongodb-mongodb.default.svc.cluster.local --port 27017 -u root -p 403nfj8Y0jh2R14x --authenticationDatabase admin admin " | kubectl exec -it mongodb-eflsbm-mongodb-0 --namespace default -- bash` check cluster connect done `kubectl get secrets -l app.kubernetes.io/instance=mongodb-eflsbm` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.username}"` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.password}"` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.port}"` DB_USERNAME:root;DB_PASSWORD:403nfj8Y0jh2R14x;DB_PORT:27017;DB_DATABASE: check pod mongodb-eflsbm-mongodb-0 container_name mongodb exist password 403nfj8Y0jh2R14x Container mongodb logs contain secret password:2026-02-12T04:11:37Z INFO MongoDB Create user: root, passwd: 403nfj8Y0jh2R14x, roles: map[db:admin role:root] describe cluster `kbcli cluster describe mongodb-eflsbm --namespace default ` Name: mongodb-eflsbm Created Time: Feb 12,2026 12:11 UTC+0800 NAMESPACE CLUSTER-DEFINITION TOPOLOGY STATUS TERMINATION-POLICY default mongodb replicaset Running WipeOut Endpoints: COMPONENT INTERNAL EXTERNAL mongodb mongodb-eflsbm-mongodb.default.svc.cluster.local:27017 mongodb-eflsbm-mongodb-mongodb.default.svc.cluster.local:27017 mongodb-eflsbm-mongodb-mongodb-ro.default.svc.cluster.local:27017 Topology: COMPONENT SERVICE-VERSION INSTANCE ROLE STATUS AZ NODE CREATED-TIME mongodb 4.4.29 mongodb-eflsbm-mongodb-0 primary Running cn-guangzhou-b 192.168.0.200/192.168.0.200 Feb 12,2026 12:11 UTC+0800 mongodb 4.4.29 mongodb-eflsbm-mongodb-1 secondary Running cn-guangzhou-b 192.168.0.13/192.168.0.13 Feb 12,2026 12:11 UTC+0800 mongodb 4.4.29 mongodb-eflsbm-mongodb-2 secondary Running cn-guangzhou-b 192.168.0.159/192.168.0.159 Feb 12,2026 12:11 UTC+0800 Resources Allocation: COMPONENT INSTANCE-TEMPLATE CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE-SIZE STORAGE-CLASS mongodb 100m / 100m 512Mi / 512Mi data:20Gi ebs-ssd Images: COMPONENT COMPONENT-DEFINITION IMAGE mongodb mongodb-1.0.2 apecloud-registry.cn-zhangjiakou.cr.aliyuncs.com/apecloud/percona-server-mongodb:4.4.29-multi apecloud-registry.cn-zhangjiakou.cr.aliyuncs.com/apecloud/percona-backup-mongodb:2.5.0-multi apecloud-registry.cn-zhangjiakou.cr.aliyuncs.com/apecloud/mongodb_exporter:0.44.0 Data Protection: BACKUP-REPO AUTO-BACKUP BACKUP-SCHEDULE BACKUP-METHOD BACKUP-RETENTION RECOVERABLE-TIME Show cluster events: kbcli cluster list-events -n default mongodb-eflsbm `kbcli cluster label mongodb-eflsbm app.kubernetes.io/instance- --namespace default ` label "app.kubernetes.io/instance" not found. `kbcli cluster label mongodb-eflsbm app.kubernetes.io/instance=mongodb-eflsbm --namespace default ` `kbcli cluster label mongodb-eflsbm --list --namespace default ` NAME NAMESPACE LABELS mongodb-eflsbm default app.kubernetes.io/instance=mongodb-eflsbm clusterdefinition.kubeblocks.io/name=mongodb label cluster app.kubernetes.io/instance=mongodb-eflsbm Success `kbcli cluster label case.name=kbcli.test1 -l app.kubernetes.io/instance=mongodb-eflsbm --namespace default ` `kbcli cluster label mongodb-eflsbm --list --namespace default ` NAME NAMESPACE LABELS mongodb-eflsbm default app.kubernetes.io/instance=mongodb-eflsbm case.name=kbcli.test1 clusterdefinition.kubeblocks.io/name=mongodb label cluster case.name=kbcli.test1 Success `kbcli cluster label mongodb-eflsbm case.name=kbcli.test2 --overwrite --namespace default ` `kbcli cluster label mongodb-eflsbm --list --namespace default ` NAME NAMESPACE LABELS mongodb-eflsbm default app.kubernetes.io/instance=mongodb-eflsbm case.name=kbcli.test2 clusterdefinition.kubeblocks.io/name=mongodb label cluster case.name=kbcli.test2 Success `kbcli cluster label mongodb-eflsbm case.name- --namespace default ` `kbcli cluster label mongodb-eflsbm --list --namespace default ` NAME NAMESPACE LABELS mongodb-eflsbm default app.kubernetes.io/instance=mongodb-eflsbm clusterdefinition.kubeblocks.io/name=mongodb delete cluster label case.name Success list-accounts on characterType mongodb is not supported yet cluster connect `kubectl get secrets -l app.kubernetes.io/instance=mongodb-eflsbm` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.username}"` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.password}"` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.port}"` DB_USERNAME:root;DB_PASSWORD:403nfj8Y0jh2R14x;DB_PORT:27017;DB_DATABASE: No resources found in default namespace. `echo " echo \"rs.status()\" | mongo --host mongodb-eflsbm-mongodb-mongodb.default.svc.cluster.local --port 27017 -u root -p 403nfj8Y0jh2R14x --authenticationDatabase admin admin " | kubectl exec -it mongodb-eflsbm-mongodb-0 --namespace default -- bash ` Defaulted container "mongodb" out of: mongodb, mongodb-backup-agent, exporter, kbagent, init-syncer (init), init-kubectl (init), init-pbm-agent (init), init-kbagent (init), kbagent-worker (init) Unable to use a TTY - input is not a terminal or the right kind of file Percona Server for MongoDB shell version v4.4.29-28 connecting to: mongodb://mongodb-eflsbm-mongodb-mongodb.default.svc.cluster.local:27017/admin?authSource=admin&compressors=disabled&gssapiServiceName=mongodb Implicit session: session { "id" : UUID("e31969ce-aea6-4900-b095-7a8135a1fa96") } Percona Server for MongoDB server version: v4.4.29-28 { "set" : "mongodb-eflsbm-mongodb", "date" : ISODate("2026-02-12T04:13:02.606Z"), "myState" : 1, "term" : NumberLong(1), "syncSourceHost" : "", "syncSourceId" : -1, "heartbeatIntervalMillis" : NumberLong(2000), "majorityVoteCount" : 2, "writeMajorityCount" : 2, "votingMembersCount" : 3, "writableVotingMembersCount" : 3, "optimes" : { "lastCommittedOpTime" : { "ts" : Timestamp(1770869580, 2), "t" : NumberLong(1) }, "lastCommittedWallTime" : ISODate("2026-02-12T04:13:00.353Z"), "readConcernMajorityOpTime" : { "ts" : Timestamp(1770869580, 2), "t" : NumberLong(1) }, "readConcernMajorityWallTime" : ISODate("2026-02-12T04:13:00.353Z"), "appliedOpTime" : { "ts" : Timestamp(1770869580, 2), "t" : NumberLong(1) }, "durableOpTime" : { "ts" : Timestamp(1770869580, 2), "t" : NumberLong(1) }, "lastAppliedWallTime" : ISODate("2026-02-12T04:13:00.353Z"), "lastDurableWallTime" : ISODate("2026-02-12T04:13:00.353Z") }, "lastStableRecoveryTimestamp" : Timestamp(1770869548, 4), "electionCandidateMetrics" : { "lastElectionReason" : "electionTimeout", "lastElectionDate" : ISODate("2026-02-12T04:11:32.199Z"), "electionTerm" : NumberLong(1), "lastCommittedOpTimeAtElection" : { "ts" : Timestamp(0, 0), "t" : NumberLong(-1) }, "lastSeenOpTimeAtElection" : { "ts" : Timestamp(1770869492, 1), "t" : NumberLong(-1) }, "numVotesNeeded" : 1, "priorityAtElection" : 2, "electionTimeoutMillis" : NumberLong(10000), "newTermStartDate" : ISODate("2026-02-12T04:11:32.302Z"), "wMajorityWriteAvailabilityDate" : ISODate("2026-02-12T04:11:32.398Z") }, "members" : [ { "_id" : 0, "name" : "mongodb-eflsbm-mongodb-0.mongodb-eflsbm-mongodb-headless.default.svc:27017", "health" : 1, "state" : 1, "stateStr" : "PRIMARY", "uptime" : 98, "optime" : { "ts" : Timestamp(1770869580, 2), "t" : NumberLong(1) }, "optimeDate" : ISODate("2026-02-12T04:13:00Z"), "lastAppliedWallTime" : ISODate("2026-02-12T04:13:00.353Z"), "lastDurableWallTime" : ISODate("2026-02-12T04:13:00.353Z"), "syncSourceHost" : "", "syncSourceId" : -1, "infoMessage" : "Could not find member to sync from", "electionTime" : Timestamp(1770869492, 2), "electionDate" : ISODate("2026-02-12T04:11:32Z"), "configVersion" : 3, "configTerm" : 1, "self" : true, "lastHeartbeatMessage" : "" }, { "_id" : 1, "name" : "mongodb-eflsbm-mongodb-1.mongodb-eflsbm-mongodb-headless.default.svc:27017", "health" : 1, "state" : 2, "stateStr" : "SECONDARY", "uptime" : 54, "optime" : { "ts" : Timestamp(1770869580, 2), "t" : NumberLong(1) }, "optimeDurable" : { "ts" : Timestamp(1770869580, 2), "t" : NumberLong(1) }, "optimeDate" : ISODate("2026-02-12T04:13:00Z"), "optimeDurableDate" : ISODate("2026-02-12T04:13:00Z"), "lastAppliedWallTime" : ISODate("2026-02-12T04:13:00.353Z"), "lastDurableWallTime" : ISODate("2026-02-12T04:13:00.353Z"), "lastHeartbeat" : ISODate("2026-02-12T04:13:01.218Z"), "lastHeartbeatRecv" : ISODate("2026-02-12T04:13:01.212Z"), "pingMs" : NumberLong(0), "lastHeartbeatMessage" : "", "syncSourceHost" : "mongodb-eflsbm-mongodb-0.mongodb-eflsbm-mongodb-headless.default.svc:27017", "syncSourceId" : 0, "infoMessage" : "", "configVersion" : 3, "configTerm" : 1 }, { "_id" : 2, "name" : "mongodb-eflsbm-mongodb-2.mongodb-eflsbm-mongodb-headless.default.svc:27017", "health" : 1, "state" : 2, "stateStr" : "SECONDARY", "uptime" : 29, "optime" : { "ts" : Timestamp(1770869580, 2), "t" : NumberLong(1) }, "optimeDurable" : { "ts" : Timestamp(1770869580, 2), "t" : NumberLong(1) }, "optimeDate" : ISODate("2026-02-12T04:13:00Z"), "optimeDurableDate" : ISODate("2026-02-12T04:13:00Z"), "lastAppliedWallTime" : ISODate("2026-02-12T04:13:00.353Z"), "lastDurableWallTime" : ISODate("2026-02-12T04:13:00.353Z"), "lastHeartbeat" : ISODate("2026-02-12T04:13:01.218Z"), "lastHeartbeatRecv" : ISODate("2026-02-12T04:13:00.914Z"), "pingMs" : NumberLong(0), "lastHeartbeatMessage" : "", "syncSourceHost" : "mongodb-eflsbm-mongodb-1.mongodb-eflsbm-mongodb-headless.default.svc:27017", "syncSourceId" : 1, "infoMessage" : "", "configVersion" : 3, "configTerm" : 1 } ], "ok" : 1, "$clusterTime" : { "clusterTime" : Timestamp(1770869580, 2), "signature" : { "hash" : BinData(0,"AAAAAAAAAAAAAAAAAAAAAAAAAAA="), "keyId" : NumberLong(0) } }, "operationTime" : Timestamp(1770869580, 2) } bye connect cluster Success insert batch data by db client error: error from server (NotFound): pods "test-db-client-executionloop-mongodb-eflsbm" not found in namespace "default" `kubectl patch -p '{"metadata":{"finalizers":[]}}' --type=merge pods test-db-client-executionloop-mongodb-eflsbm --namespace default ` Error from server (NotFound): pods "test-db-client-executionloop-mongodb-eflsbm" not found Warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely. Error from server (NotFound): pods "test-db-client-executionloop-mongodb-eflsbm" not found `kubectl get secrets -l app.kubernetes.io/instance=mongodb-eflsbm` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.username}"` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.password}"` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.port}"` DB_USERNAME:root;DB_PASSWORD:403nfj8Y0jh2R14x;DB_PORT:27017;DB_DATABASE: apiVersion: v1 kind: Pod metadata: name: test-db-client-executionloop-mongodb-eflsbm namespace: default spec: containers: - name: test-dbclient imagePullPolicy: IfNotPresent image: apecloud-registry.cn-zhangjiakou.cr.aliyuncs.com/apecloud/dbclient:test args: - "--host" - "mongodb-eflsbm-mongodb.default.svc.cluster.local" - "--user" - "root" - "--password" - "403nfj8Y0jh2R14x" - "--port" - "27017" - "--dbtype" - "mongodb" - "--test" - "executionloop" - "--duration" - "60" - "--interval" - "1" restartPolicy: Never `kubectl apply -f test-db-client-executionloop-mongodb-eflsbm.yaml` pod/test-db-client-executionloop-mongodb-eflsbm created apply test-db-client-executionloop-mongodb-eflsbm.yaml Success `rm -rf test-db-client-executionloop-mongodb-eflsbm.yaml` check pod status pod_status:NAME READY STATUS RESTARTS AGE test-db-client-executionloop-mongodb-eflsbm 1/1 Running 0 5s pod_status:NAME READY STATUS RESTARTS AGE test-db-client-executionloop-mongodb-eflsbm 1/1 Running 0 9s pod_status:NAME READY STATUS RESTARTS AGE test-db-client-executionloop-mongodb-eflsbm 1/1 Running 0 14s pod_status:NAME READY STATUS RESTARTS AGE test-db-client-executionloop-mongodb-eflsbm 1/1 Running 0 20s pod_status:NAME READY STATUS RESTARTS AGE test-db-client-executionloop-mongodb-eflsbm 1/1 Running 0 25s pod_status:NAME READY STATUS RESTARTS AGE test-db-client-executionloop-mongodb-eflsbm 1/1 Running 0 30s pod_status:NAME READY STATUS RESTARTS AGE test-db-client-executionloop-mongodb-eflsbm 1/1 Running 0 35s pod_status:NAME READY STATUS RESTARTS AGE test-db-client-executionloop-mongodb-eflsbm 1/1 Running 0 41s pod_status:NAME READY STATUS RESTARTS AGE test-db-client-executionloop-mongodb-eflsbm 1/1 Running 0 46s pod_status:NAME READY STATUS RESTARTS AGE test-db-client-executionloop-mongodb-eflsbm 1/1 Running 0 51s pod_status:NAME READY STATUS RESTARTS AGE test-db-client-executionloop-mongodb-eflsbm 1/1 Running 0 56s pod_status:NAME READY STATUS RESTARTS AGE test-db-client-executionloop-mongodb-eflsbm 1/1 Running 0 61s check pod test-db-client-executionloop-mongodb-eflsbm status done pod_status:NAME READY STATUS RESTARTS AGE test-db-client-executionloop-mongodb-eflsbm 0/1 Completed 0 67s check cluster status `kbcli cluster list mongodb-eflsbm --show-labels --namespace default ` NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS mongodb-eflsbm default mongodb WipeOut Running Feb 12,2026 12:11 UTC+0800 app.kubernetes.io/instance=mongodb-eflsbm,clusterdefinition.kubeblocks.io/name=mongodb check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances mongodb-eflsbm --namespace default ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME mongodb-eflsbm-mongodb-0 default mongodb-eflsbm mongodb Running primary cn-guangzhou-b 100m / 100m 512Mi / 512Mi data:20Gi 192.168.0.200/192.168.0.200 Feb 12,2026 12:11 UTC+0800 mongodb-eflsbm-mongodb-1 default mongodb-eflsbm mongodb Running secondary cn-guangzhou-b 100m / 100m 512Mi / 512Mi data:20Gi 192.168.0.13/192.168.0.13 Feb 12,2026 12:11 UTC+0800 mongodb-eflsbm-mongodb-2 default mongodb-eflsbm mongodb Running secondary cn-guangzhou-b 100m / 100m 512Mi / 512Mi data:20Gi 192.168.0.159/192.168.0.159 Feb 12,2026 12:11 UTC+0800 check pod status done check cluster role check cluster role done primary: mongodb-eflsbm-mongodb-0;secondary: mongodb-eflsbm-mongodb-1 mongodb-eflsbm-mongodb-2 `kubectl get secrets -l app.kubernetes.io/instance=mongodb-eflsbm` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.username}"` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.password}"` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.port}"` DB_USERNAME:root;DB_PASSWORD:403nfj8Y0jh2R14x;DB_PORT:27017;DB_DATABASE: No resources found in default namespace. check cluster connect `echo " echo \"\" | mongo --host mongodb-eflsbm-mongodb-mongodb.default.svc.cluster.local --port 27017 -u root -p 403nfj8Y0jh2R14x --authenticationDatabase admin admin " | kubectl exec -it mongodb-eflsbm-mongodb-0 --namespace default -- bash` check cluster connect done Inserted document: BsonObjectId{value=698d538d73690325e5e14c6e} Inserted document: BsonObjectId{value=698d538d73690325e5e14c6f} Inserted document: BsonObjectId{value=698d538d73690325e5e14c70} Inserted document: BsonObjectId{value=698d538d73690325e5e14c71} Inserted document: BsonObjectId{value=698d538d73690325e5e14c72} Inserted document: BsonObjectId{value=698d538d73690325e5e14c73} Inserted document: BsonObjectId{value=698d538d73690325e5e14c74} Inserted document: BsonObjectId{value=698d538d73690325e5e14c75} Inserted document: BsonObjectId{value=698d538d73690325e5e14c76} Inserted document: BsonObjectId{value=698d538d73690325e5e14c77} Inserted document: BsonObjectId{value=698d538d73690325e5e14c78} Inserted document: BsonObjectId{value=698d538d73690325e5e14c79} Inserted document: BsonObjectId{value=698d538d73690325e5e14c7a} Inserted document: BsonObjectId{value=698d538d73690325e5e14c7b} Inserted document: BsonObjectId{value=698d538d73690325e5e14c7c} Inserted document: BsonObjectId{value=698d538d73690325e5e14c7d} Inserted document: BsonObjectId{value=698d538d73690325e5e14c7e} Inserted document: BsonObjectId{value=698d538d73690325e5e14c7f} Inserted document: BsonObjectId{value=698d538d73690325e5e14c80} Inserted document: BsonObjectId{value=698d538d73690325e5e14c81} Inserted document: BsonObjectId{value=698d538d73690325e5e14c82} Inserted document: BsonObjectId{value=698d538d73690325e5e14c83} Inserted document: BsonObjectId{value=698d538d73690325e5e14c84} Inserted document: BsonObjectId{value=698d538d73690325e5e14c85} Inserted document: BsonObjectId{value=698d538d73690325e5e14c86} Inserted document: BsonObjectId{value=698d538d73690325e5e14c87} Inserted document: BsonObjectId{value=698d538d73690325e5e14c88} Inserted document: BsonObjectId{value=698d538d73690325e5e14c89} Inserted document: BsonObjectId{value=698d538d73690325e5e14c8a} Inserted document: BsonObjectId{value=698d538d73690325e5e14c8b} Inserted document: BsonObjectId{value=698d538d73690325e5e14c8c} Inserted document: BsonObjectId{value=698d538d73690325e5e14c8d} Inserted document: BsonObjectId{value=698d538d73690325e5e14c8e} Inserted document: BsonObjectId{value=698d538d73690325e5e14c8f} Inserted document: BsonObjectId{value=698d538d73690325e5e14c90} Inserted document: BsonObjectId{value=698d538d73690325e5e14c91} Inserted document: BsonObjectId{value=698d538d73690325e5e14c92} Inserted document: BsonObjectId{value=698d538d73690325e5e14c93} Inserted document: BsonObjectId{value=698d538d73690325e5e14c94} Inserted document: BsonObjectId{value=698d538d73690325e5e14c95} Inserted document: BsonObjectId{value=698d538d73690325e5e14c96} Inserted document: BsonObjectId{value=698d538d73690325e5e14c97} Inserted document: BsonObjectId{value=698d538d73690325e5e14c98} Inserted document: BsonObjectId{value=698d538d73690325e5e14c99} Inserted document: BsonObjectId{value=698d538d73690325e5e14c9a} Inserted document: BsonObjectId{value=698d538d73690325e5e14c9b} Inserted document: BsonObjectId{value=698d538d73690325e5e14c9c} Inserted document: BsonObjectId{value=698d538d73690325e5e14c9d} Inserted document: BsonObjectId{value=698d538d73690325e5e14c9e} Inserted document: BsonObjectId{value=698d538d73690325e5e14c9f} Inserted document: BsonObjectId{value=698d538d73690325e5e14ca0} Inserted document: BsonObjectId{value=698d538d73690325e5e14ca1} Inserted document: BsonObjectId{value=698d538d73690325e5e14ca2} Inserted document: BsonObjectId{value=698d538d73690325e5e14ca3} Inserted document: BsonObjectId{value=698d538d73690325e5e14ca4} Inserted document: BsonObjectId{value=698d538d73690325e5e14ca5} Inserted document: BsonObjectId{value=698d538d73690325e5e14ca6} Inserted document: BsonObjectId{value=698d538d73690325e5e14ca7} Inserted document: BsonObjectId{value=698d538d73690325e5e14ca8} Inserted document: BsonObjectId{value=698d538d73690325e5e14ca9} Inserted document: BsonObjectId{value=698d538d73690325e5e14caa} Inserted document: BsonObjectId{value=698d538d73690325e5e14cab} Inserted document: BsonObjectId{value=698d538d73690325e5e14cac} Inserted document: BsonObjectId{value=698d538d73690325e5e14cad} Inserted document: BsonObjectId{value=698d538d73690325e5e14cae} Inserted document: BsonObjectId{value=698d538d73690325e5e14caf} Inserted document: BsonObjectId{value=698d538d73690325e5e14cb0} Inserted document: BsonObjectId{value=698d538d73690325e5e14cb1} Inserted document: BsonObjectId{value=698d538d73690325e5e14cb2} Inserted document: BsonObjectId{value=698d538d73690325e5e14cb3} Inserted document: BsonObjectId{value=698d538d73690325e5e14cb4} Inserted document: BsonObjectId{value=698d538d73690325e5e14cb5} Inserted document: BsonObjectId{value=698d538d73690325e5e14cb6} Inserted document: BsonObjectId{value=698d538d73690325e5e14cb7} Inserted document: BsonObjectId{value=698d538d73690325e5e14cb8} Inserted document: BsonObjectId{value=698d538d73690325e5e14cb9} Inserted document: BsonObjectId{value=698d538d73690325e5e14cba} Inserted document: BsonObjectId{value=698d538d73690325e5e14cbb} Inserted document: BsonObjectId{value=698d538d73690325e5e14cbc} Inserted document: BsonObjectId{value=698d538d73690325e5e14cbd} [ 60s ] executions total: 23155 successful: 23154 failed: 1 disconnect: 1 Test Result: Total Executions: 23155 Successful Executions: 23154 Failed Executions: 1 Disconnection Counts: 1 Connection Information: Database Type: mongodb Host: mongodb-eflsbm-mongodb.default.svc.cluster.local Port: 27017 Database: Table: User: root Org: Access Mode: mysql Test Type: executionloop Query: Duration: 60 seconds Interval: 1 seconds DB_CLIENT_BATCH_DATA_COUNT: 23154 `kubectl patch -p '{"metadata":{"finalizers":[]}}' --type=merge pods test-db-client-executionloop-mongodb-eflsbm --namespace default ` pod/test-db-client-executionloop-mongodb-eflsbm patched (no change) Warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely. pod "test-db-client-executionloop-mongodb-eflsbm" force deleted `kubectl get secrets -l app.kubernetes.io/instance=mongodb-eflsbm` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.username}"` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.password}"` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.port}"` DB_USERNAME:root;DB_PASSWORD:403nfj8Y0jh2R14x;DB_PORT:27017;DB_DATABASE: No resources found in default namespace. `echo "echo \"db.col.remove({}) ; db.col.insertOne({a:'nelsi'})\" | mongo --host mongodb-eflsbm-mongodb-mongodb.default.svc.cluster.local --port 27017 -u root -p 403nfj8Y0jh2R14x --authenticationDatabase admin admin " | kubectl exec -it mongodb-eflsbm-mongodb-0 --namespace default -- bash ` Defaulted container "mongodb" out of: mongodb, mongodb-backup-agent, exporter, kbagent, init-syncer (init), init-kubectl (init), init-pbm-agent (init), init-kbagent (init), kbagent-worker (init) Unable to use a TTY - input is not a terminal or the right kind of file Percona Server for MongoDB shell version v4.4.29-28 connecting to: mongodb://mongodb-eflsbm-mongodb-mongodb.default.svc.cluster.local:27017/admin?authSource=admin&compressors=disabled&gssapiServiceName=mongodb Implicit session: session { "id" : UUID("bdd263e5-0f8c-40b1-9627-191a15ba4059") } Percona Server for MongoDB server version: v4.4.29-28 { "acknowledged" : true, "insertedId" : ObjectId("698d539a50ef62d9286bd4cf") } bye add consistent data nelsi Success `kubectl get secrets -l app.kubernetes.io/instance=mongodb-eflsbm` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.username}"` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.password}"` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.port}"` DB_USERNAME:root;DB_PASSWORD:403nfj8Y0jh2R14x;DB_PORT:27017;DB_DATABASE: No resources found in default namespace. `echo "echo \"db.col.remove({}) ; db.col.insertOne({a:'nelsi'})\" | mongo --host mongodb-eflsbm-mongodb-mongodb-ro.default.svc.cluster.local --port 27017 -u root -p 403nfj8Y0jh2R14x --authenticationDatabase admin admin " | kubectl exec -it mongodb-eflsbm-mongodb-1 --namespace default -- bash ` Defaulted container "mongodb" out of: mongodb, mongodb-backup-agent, exporter, kbagent, init-syncer (init), init-kubectl (init), init-pbm-agent (init), init-kbagent (init), kbagent-worker (init) Unable to use a TTY - input is not a terminal or the right kind of file Percona Server for MongoDB shell version v4.4.29-28 connecting to: mongodb://mongodb-eflsbm-mongodb-mongodb-ro.default.svc.cluster.local:27017/admin?authSource=admin&compressors=disabled&gssapiServiceName=mongodb Implicit session: session { "id" : UUID("30c6ea7a-8485-43a9-8ce9-60624cba25bb") } Percona Server for MongoDB server version: v4.4.29-28 uncaught exception: WriteCommandError({ "topologyVersion" : { "processId" : ObjectId("698d53283dfd2109e356ec17"), "counter" : NumberLong(3) }, "operationTime" : Timestamp(1770869670, 2), "ok" : 0, "errmsg" : "not master", "code" : 10107, "codeName" : "NotWritablePrimary", "$clusterTime" : { "clusterTime" : Timestamp(1770869670, 2), "signature" : { "hash" : BinData(0,"AAAAAAAAAAAAAAAAAAAAAAAAAAA="), "keyId" : NumberLong(0) } } }) : WriteCommandError({ "topologyVersion" : { "processId" : ObjectId("698d53283dfd2109e356ec17"), "counter" : NumberLong(3) }, "operationTime" : Timestamp(1770869670, 2), "ok" : 0, "errmsg" : "not master", "code" : 10107, "codeName" : "NotWritablePrimary", "$clusterTime" : { "clusterTime" : Timestamp(1770869670, 2), "signature" : { "hash" : BinData(0,"AAAAAAAAAAAAAAAAAAAAAAAAAAA="), "keyId" : NumberLong(0) } } }) WriteCommandError@src/mongo/shell/bulk_api.js:417:48 executeBatch@src/mongo/shell/bulk_api.js:915:23 Bulk/this.execute@src/mongo/shell/bulk_api.js:1163:21 DBCollection.prototype.insertOne@src/mongo/shell/crud_api.js:264:9 @(shell):1:21 bye command terminated with exit code 1 check add consistent data readonly Success cluster rebuild instances apiVersion: operations.kubeblocks.io/v1alpha1 kind: OpsRequest metadata: generateName: mongodb-eflsbm-rebuildinstance- namespace: default spec: type: RebuildInstance clusterName: mongodb-eflsbm force: true rebuildFrom: - componentName: mongodb instances: - name: mongodb-eflsbm-mongodb-1 inPlace: false check cluster status before ops check cluster status done cluster_status:Running `kubectl create -f test_ops_cluster_mongodb-eflsbm.yaml` opsrequest.operations.kubeblocks.io/mongodb-eflsbm-rebuildinstance-tcv7g created create test_ops_cluster_mongodb-eflsbm.yaml Success `rm -rf test_ops_cluster_mongodb-eflsbm.yaml` check ops status `kbcli cluster list-ops mongodb-eflsbm --status all --namespace default ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME mongodb-eflsbm-rebuildinstance-tcv7g default RebuildInstance mongodb-eflsbm mongodb Running 0/1 Feb 12,2026 12:14 UTC+0800 ops_status:mongodb-eflsbm-rebuildinstance-tcv7g default RebuildInstance mongodb-eflsbm mongodb Running 0/1 Feb 12,2026 12:14 UTC+0800 ops_status:mongodb-eflsbm-rebuildinstance-tcv7g default RebuildInstance mongodb-eflsbm mongodb Running 0/1 Feb 12,2026 12:14 UTC+0800 ops_status:mongodb-eflsbm-rebuildinstance-tcv7g default RebuildInstance mongodb-eflsbm mongodb Running 0/1 Feb 12,2026 12:14 UTC+0800 ops_status:mongodb-eflsbm-rebuildinstance-tcv7g default RebuildInstance mongodb-eflsbm mongodb Running 0/1 Feb 12,2026 12:14 UTC+0800 ops_status:mongodb-eflsbm-rebuildinstance-tcv7g default RebuildInstance mongodb-eflsbm mongodb Running 0/1 Feb 12,2026 12:14 UTC+0800 ops_status:mongodb-eflsbm-rebuildinstance-tcv7g default RebuildInstance mongodb-eflsbm mongodb Running 0/1 Feb 12,2026 12:14 UTC+0800 ops_status:mongodb-eflsbm-rebuildinstance-tcv7g default RebuildInstance mongodb-eflsbm mongodb Running 0/1 Feb 12,2026 12:14 UTC+0800 ops_status:mongodb-eflsbm-rebuildinstance-tcv7g default RebuildInstance mongodb-eflsbm mongodb Running 0/1 Feb 12,2026 12:14 UTC+0800 ops_status:mongodb-eflsbm-rebuildinstance-tcv7g default RebuildInstance mongodb-eflsbm mongodb Running 0/1 Feb 12,2026 12:14 UTC+0800 ops_status:mongodb-eflsbm-rebuildinstance-tcv7g default RebuildInstance mongodb-eflsbm mongodb Running 0/1 Feb 12,2026 12:14 UTC+0800 check ops status done ops_status:mongodb-eflsbm-rebuildinstance-tcv7g default RebuildInstance mongodb-eflsbm mongodb Succeed 1/1 Feb 12,2026 12:14 UTC+0800 `kubectl patch -p '{"metadata":{"finalizers":[]}}' --type=merge opsrequests.operations mongodb-eflsbm-rebuildinstance-tcv7g --namespace default ` opsrequest.operations.kubeblocks.io/mongodb-eflsbm-rebuildinstance-tcv7g patched `kbcli cluster delete-ops --name mongodb-eflsbm-rebuildinstance-tcv7g --force --auto-approve --namespace default ` OpsRequest mongodb-eflsbm-rebuildinstance-tcv7g deleted check cluster status `kbcli cluster list mongodb-eflsbm --show-labels --namespace default ` NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS mongodb-eflsbm default mongodb WipeOut Running Feb 12,2026 12:11 UTC+0800 app.kubernetes.io/instance=mongodb-eflsbm,clusterdefinition.kubeblocks.io/name=mongodb check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances mongodb-eflsbm --namespace default ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME mongodb-eflsbm-mongodb-0 default mongodb-eflsbm mongodb Running primary cn-guangzhou-b 100m / 100m 512Mi / 512Mi data:20Gi 192.168.0.200/192.168.0.200 Feb 12,2026 12:11 UTC+0800 mongodb-eflsbm-mongodb-2 default mongodb-eflsbm mongodb Running secondary cn-guangzhou-b 100m / 100m 512Mi / 512Mi data:20Gi 192.168.0.159/192.168.0.159 Feb 12,2026 12:11 UTC+0800 mongodb-eflsbm-mongodb-3 default mongodb-eflsbm mongodb Running secondary cn-guangzhou-b 100m / 100m 512Mi / 512Mi data:20Gi 192.168.0.199/192.168.0.199 Feb 12,2026 12:14 UTC+0800 check pod status done check cluster role check cluster role done primary: mongodb-eflsbm-mongodb-0;secondary: mongodb-eflsbm-mongodb-2 mongodb-eflsbm-mongodb-3 `kubectl get secrets -l app.kubernetes.io/instance=mongodb-eflsbm` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.username}"` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.password}"` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.port}"` DB_USERNAME:root;DB_PASSWORD:403nfj8Y0jh2R14x;DB_PORT:27017;DB_DATABASE: No resources found in default namespace. check cluster connect `echo " echo \"\" | mongo --host mongodb-eflsbm-mongodb-mongodb.default.svc.cluster.local --port 27017 -u root -p 403nfj8Y0jh2R14x --authenticationDatabase admin admin " | kubectl exec -it mongodb-eflsbm-mongodb-0 --namespace default -- bash` check cluster connect done `kubectl get secrets -l app.kubernetes.io/instance=mongodb-eflsbm` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.username}"` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.password}"` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.port}"` DB_USERNAME:root;DB_PASSWORD:403nfj8Y0jh2R14x;DB_PORT:27017;DB_DATABASE: No resources found in default namespace. `echo "echo \"db.col.find()\" | mongo --host mongodb-eflsbm-mongodb-mongodb.default.svc.cluster.local --port 27017 -u root -p 403nfj8Y0jh2R14x --authenticationDatabase admin admin " | kubectl exec -it mongodb-eflsbm-mongodb-0 --namespace default -- bash ` check data: Defaulted container "mongodb" out of: mongodb, mongodb-backup-agent, exporter, kbagent, init-syncer (init), init-kubectl (init), init-pbm-agent (init), init-kbagent (init), kbagent-worker (init) Unable to use a TTY - input is not a terminal or the right kind of file Percona Server for MongoDB shell version v4.4.29-28 connecting to: mongodb://mongodb-eflsbm-mongodb-mongodb.default.svc.cluster.local:27017/admin?authSource=admin&compressors=disabled&gssapiServiceName=mongodb Implicit session: session { "id" : UUID("434f7fb9-8b12-40a8-aa3b-3c38a237d0c7") } Percona Server for MongoDB server version: v4.4.29-28 { "_id" : ObjectId("698d539a50ef62d9286bd4cf"), "a" : "nelsi" } bye check cluster data consistent Success `kubectl get secrets -l app.kubernetes.io/instance=mongodb-eflsbm` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.username}"` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.password}"` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.port}"` DB_USERNAME:root;DB_PASSWORD:403nfj8Y0jh2R14x;DB_PORT:27017;DB_DATABASE: No resources found in default namespace. `echo "echo \"db.col.find().readPref('secondary')\" | mongo --host mongodb-eflsbm-mongodb-mongodb-ro.default.svc.cluster.local --port 27017 -u root -p 403nfj8Y0jh2R14x --authenticationDatabase admin admin " | kubectl exec -it mongodb-eflsbm-mongodb-2 --namespace default -- bash ` check readonly data: Defaulted container "mongodb" out of: mongodb, mongodb-backup-agent, exporter, kbagent, init-syncer (init), init-kubectl (init), init-pbm-agent (init), init-kbagent (init), kbagent-worker (init) Unable to use a TTY - input is not a terminal or the right kind of file Percona Server for MongoDB shell version v4.4.29-28 connecting to: mongodb://mongodb-eflsbm-mongodb-mongodb-ro.default.svc.cluster.local:27017/admin?authSource=admin&compressors=disabled&gssapiServiceName=mongodb Implicit session: session { "id" : UUID("17b97c28-0036-4b19-be64-d0a1670b7a8e") } Percona Server for MongoDB server version: v4.4.29-28 { "_id" : ObjectId("698d539a50ef62d9286bd4cf"), "a" : "nelsi" } bye check cluster readonly data consistent Success `kubectl get secrets -l app.kubernetes.io/instance=mongodb-eflsbm` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.username}"` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.password}"` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.port}"` DB_USERNAME:root;DB_PASSWORD:403nfj8Y0jh2R14x;DB_PORT:27017;DB_DATABASE: No resources found in default namespace. check db_client batch data count `echo "echo \"db.executions_loop_table.estimatedDocumentCount();\" | mongo --host mongodb-eflsbm-mongodb-mongodb.default.svc.cluster.local --port 27017 -u root -p 403nfj8Y0jh2R14x --authenticationDatabase admin admin " | kubectl exec -it mongodb-eflsbm-mongodb-0 --namespace default -- bash ` check db_client batch [23154] equal [23154] data Success test switchover cluster promote check cluster status before ops check cluster status done cluster_status:Running `kbcli cluster promote mongodb-eflsbm --auto-approve --force=true --instance mongodb-eflsbm-mongodb-0 --candidate mongodb-eflsbm-mongodb-2 --namespace default ` OpsRequest mongodb-eflsbm-switchover-96hfd created successfully, you can view the progress: kbcli cluster describe-ops mongodb-eflsbm-switchover-96hfd -n default check ops status `kbcli cluster list-ops mongodb-eflsbm --status all --namespace default ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME mongodb-eflsbm-switchover-96hfd default Switchover mongodb-eflsbm mongodb-eflsbm-mongodb Running 0/1 Feb 12,2026 12:15 UTC+0800 check cluster status `kbcli cluster list mongodb-eflsbm --show-labels --namespace default ` NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS mongodb-eflsbm default mongodb WipeOut Running Feb 12,2026 12:11 UTC+0800 app.kubernetes.io/instance=mongodb-eflsbm,clusterdefinition.kubeblocks.io/name=mongodb check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances mongodb-eflsbm --namespace default ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME mongodb-eflsbm-mongodb-0 default mongodb-eflsbm mongodb Running primary cn-guangzhou-b 100m / 100m 512Mi / 512Mi data:20Gi 192.168.0.200/192.168.0.200 Feb 12,2026 12:11 UTC+0800 mongodb-eflsbm-mongodb-2 default mongodb-eflsbm mongodb Running secondary cn-guangzhou-b 100m / 100m 512Mi / 512Mi data:20Gi 192.168.0.159/192.168.0.159 Feb 12,2026 12:11 UTC+0800 mongodb-eflsbm-mongodb-3 default mongodb-eflsbm mongodb Running secondary cn-guangzhou-b 100m / 100m 512Mi / 512Mi data:20Gi 192.168.0.199/192.168.0.199 Feb 12,2026 12:14 UTC+0800 check pod status done check cluster role check cluster role done primary: mongodb-eflsbm-mongodb-0;secondary: mongodb-eflsbm-mongodb-2 mongodb-eflsbm-mongodb-3 `kubectl get secrets -l app.kubernetes.io/instance=mongodb-eflsbm` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.username}"` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.password}"` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.port}"` DB_USERNAME:root;DB_PASSWORD:403nfj8Y0jh2R14x;DB_PORT:27017;DB_DATABASE: No resources found in default namespace. check cluster connect `echo " echo \"\" | mongo --host mongodb-eflsbm-mongodb-mongodb.default.svc.cluster.local --port 27017 -u root -p 403nfj8Y0jh2R14x --authenticationDatabase admin admin " | kubectl exec -it mongodb-eflsbm-mongodb-0 --namespace default -- bash` check cluster connect done check ops status `kbcli cluster list-ops mongodb-eflsbm --status all --namespace default ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME mongodb-eflsbm-switchover-96hfd default Switchover mongodb-eflsbm mongodb-eflsbm-mongodb Succeed 1/1 Feb 12,2026 12:15 UTC+0800 check ops status done ops_status:mongodb-eflsbm-switchover-96hfd default Switchover mongodb-eflsbm mongodb-eflsbm-mongodb Succeed 1/1 Feb 12,2026 12:15 UTC+0800 `kubectl patch -p '{"metadata":{"finalizers":[]}}' --type=merge opsrequests.operations mongodb-eflsbm-switchover-96hfd --namespace default ` opsrequest.operations.kubeblocks.io/mongodb-eflsbm-switchover-96hfd patched `kbcli cluster delete-ops --name mongodb-eflsbm-switchover-96hfd --force --auto-approve --namespace default ` OpsRequest mongodb-eflsbm-switchover-96hfd deleted `kubectl get secrets -l app.kubernetes.io/instance=mongodb-eflsbm` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.username}"` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.password}"` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.port}"` DB_USERNAME:root;DB_PASSWORD:403nfj8Y0jh2R14x;DB_PORT:27017;DB_DATABASE: No resources found in default namespace. `echo "echo \"db.col.find()\" | mongo --host mongodb-eflsbm-mongodb-mongodb.default.svc.cluster.local --port 27017 -u root -p 403nfj8Y0jh2R14x --authenticationDatabase admin admin " | kubectl exec -it mongodb-eflsbm-mongodb-2 --namespace default -- bash ` check data: Defaulted container "mongodb" out of: mongodb, mongodb-backup-agent, exporter, kbagent, init-syncer (init), init-kubectl (init), init-pbm-agent (init), init-kbagent (init), kbagent-worker (init) Unable to use a TTY - input is not a terminal or the right kind of file Percona Server for MongoDB shell version v4.4.29-28 connecting to: mongodb://mongodb-eflsbm-mongodb-mongodb.default.svc.cluster.local:27017/admin?authSource=admin&compressors=disabled&gssapiServiceName=mongodb Implicit session: session { "id" : UUID("39990c46-2000-4c8c-b23a-0fa946623f02") } Percona Server for MongoDB server version: v4.4.29-28 { "_id" : ObjectId("698d539a50ef62d9286bd4cf"), "a" : "nelsi" } bye check cluster data consistent Success `kubectl get secrets -l app.kubernetes.io/instance=mongodb-eflsbm` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.username}"` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.password}"` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.port}"` DB_USERNAME:root;DB_PASSWORD:403nfj8Y0jh2R14x;DB_PORT:27017;DB_DATABASE: No resources found in default namespace. `echo "echo \"db.col.find().readPref('secondary')\" | mongo --host mongodb-eflsbm-mongodb-mongodb-ro.default.svc.cluster.local --port 27017 -u root -p 403nfj8Y0jh2R14x --authenticationDatabase admin admin " | kubectl exec -it mongodb-eflsbm-mongodb-0 --namespace default -- bash ` check readonly data: Defaulted container "mongodb" out of: mongodb, mongodb-backup-agent, exporter, kbagent, init-syncer (init), init-kubectl (init), init-pbm-agent (init), init-kbagent (init), kbagent-worker (init) Unable to use a TTY - input is not a terminal or the right kind of file Percona Server for MongoDB shell version v4.4.29-28 connecting to: mongodb://mongodb-eflsbm-mongodb-mongodb-ro.default.svc.cluster.local:27017/admin?authSource=admin&compressors=disabled&gssapiServiceName=mongodb Implicit session: session { "id" : UUID("4bfdfe4b-70c5-4575-aa51-1d4f15b270fb") } Percona Server for MongoDB server version: v4.4.29-28 { "_id" : ObjectId("698d539a50ef62d9286bd4cf"), "a" : "nelsi" } bye check cluster readonly data consistent Success `kubectl get secrets -l app.kubernetes.io/instance=mongodb-eflsbm` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.username}"` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.password}"` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.port}"` DB_USERNAME:root;DB_PASSWORD:403nfj8Y0jh2R14x;DB_PORT:27017;DB_DATABASE: No resources found in default namespace. check db_client batch data count `echo "echo \"db.executions_loop_table.estimatedDocumentCount();\" | mongo --host mongodb-eflsbm-mongodb-mongodb.default.svc.cluster.local --port 27017 -u root -p 403nfj8Y0jh2R14x --authenticationDatabase admin admin " | kubectl exec -it mongodb-eflsbm-mongodb-2 --namespace default -- bash ` check db_client batch [23154] equal [23154] data Success switchover pod:mongodb-eflsbm-mongodb-2 switchover success cluster does not need to check monitor currently check cluster status `kbcli cluster list mongodb-eflsbm --show-labels --namespace default ` NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS mongodb-eflsbm default mongodb WipeOut Running Feb 12,2026 12:11 UTC+0800 app.kubernetes.io/instance=mongodb-eflsbm,clusterdefinition.kubeblocks.io/name=mongodb check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances mongodb-eflsbm --namespace default ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME mongodb-eflsbm-mongodb-0 default mongodb-eflsbm mongodb Running secondary cn-guangzhou-b 100m / 100m 512Mi / 512Mi data:20Gi 192.168.0.200/192.168.0.200 Feb 12,2026 12:11 UTC+0800 mongodb-eflsbm-mongodb-2 default mongodb-eflsbm mongodb Running primary cn-guangzhou-b 100m / 100m 512Mi / 512Mi data:20Gi 192.168.0.159/192.168.0.159 Feb 12,2026 12:11 UTC+0800 mongodb-eflsbm-mongodb-3 default mongodb-eflsbm mongodb Running secondary cn-guangzhou-b 100m / 100m 512Mi / 512Mi data:20Gi 192.168.0.199/192.168.0.199 Feb 12,2026 12:14 UTC+0800 check pod status done check cluster role check cluster role done primary: mongodb-eflsbm-mongodb-2;secondary: mongodb-eflsbm-mongodb-0 mongodb-eflsbm-mongodb-3 `kubectl get secrets -l app.kubernetes.io/instance=mongodb-eflsbm` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.username}"` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.password}"` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.port}"` DB_USERNAME:root;DB_PASSWORD:403nfj8Y0jh2R14x;DB_PORT:27017;DB_DATABASE: No resources found in default namespace. check cluster connect `echo " echo \"\" | mongo --host mongodb-eflsbm-mongodb-mongodb.default.svc.cluster.local --port 27017 -u root -p 403nfj8Y0jh2R14x --authenticationDatabase admin admin " | kubectl exec -it mongodb-eflsbm-mongodb-2 --namespace default -- bash` check cluster connect done test failover networkdelay check cluster status before cluster-failover-networkdelay check cluster status done cluster_status:Running `kubectl patch -p '{"metadata":{"finalizers":[]}}' --type=merge NetworkChaos test-chaos-mesh-networkdelay-mongodb-eflsbm --namespace default ` Warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely. Error from server (NotFound): networkchaos.chaos-mesh.org "test-chaos-mesh-networkdelay-mongodb-eflsbm" not found Error from server (NotFound): networkchaos.chaos-mesh.org "test-chaos-mesh-networkdelay-mongodb-eflsbm" not found apiVersion: chaos-mesh.org/v1alpha1 kind: NetworkChaos metadata: name: test-chaos-mesh-networkdelay-mongodb-eflsbm namespace: default spec: selector: namespaces: - default labelSelectors: apps.kubeblocks.io/pod-name: mongodb-eflsbm-mongodb-2 mode: all action: delay delay: latency: 2000ms correlation: '100' jitter: 0ms direction: to duration: 2m `kubectl apply -f test-chaos-mesh-networkdelay-mongodb-eflsbm.yaml` networkchaos.chaos-mesh.org/test-chaos-mesh-networkdelay-mongodb-eflsbm created apply test-chaos-mesh-networkdelay-mongodb-eflsbm.yaml Success `rm -rf test-chaos-mesh-networkdelay-mongodb-eflsbm.yaml` networkdelay chaos test waiting 120 seconds check cluster status `kbcli cluster list mongodb-eflsbm --show-labels --namespace default ` NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS mongodb-eflsbm default mongodb WipeOut Running Feb 12,2026 12:11 UTC+0800 app.kubernetes.io/instance=mongodb-eflsbm,clusterdefinition.kubeblocks.io/name=mongodb check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances mongodb-eflsbm --namespace default ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME mongodb-eflsbm-mongodb-0 default mongodb-eflsbm mongodb Running secondary cn-guangzhou-b 100m / 100m 512Mi / 512Mi data:20Gi 192.168.0.200/192.168.0.200 Feb 12,2026 12:11 UTC+0800 mongodb-eflsbm-mongodb-2 default mongodb-eflsbm mongodb Running primary cn-guangzhou-b 100m / 100m 512Mi / 512Mi data:20Gi 192.168.0.159/192.168.0.159 Feb 12,2026 12:11 UTC+0800 mongodb-eflsbm-mongodb-3 default mongodb-eflsbm mongodb Running secondary cn-guangzhou-b 100m / 100m 512Mi / 512Mi data:20Gi 192.168.0.199/192.168.0.199 Feb 12,2026 12:14 UTC+0800 check pod status done check cluster role check cluster role done primary: mongodb-eflsbm-mongodb-2;secondary: mongodb-eflsbm-mongodb-0 mongodb-eflsbm-mongodb-3 `kubectl get secrets -l app.kubernetes.io/instance=mongodb-eflsbm` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.username}"` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.password}"` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.port}"` DB_USERNAME:root;DB_PASSWORD:403nfj8Y0jh2R14x;DB_PORT:27017;DB_DATABASE: No resources found in default namespace. check cluster connect `echo " echo \"\" | mongo --host mongodb-eflsbm-mongodb-mongodb.default.svc.cluster.local --port 27017 -u root -p 403nfj8Y0jh2R14x --authenticationDatabase admin admin " | kubectl exec -it mongodb-eflsbm-mongodb-2 --namespace default -- bash` check cluster connect done `kubectl patch -p '{"metadata":{"finalizers":[]}}' --type=merge NetworkChaos test-chaos-mesh-networkdelay-mongodb-eflsbm --namespace default ` Warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely. networkchaos.chaos-mesh.org "test-chaos-mesh-networkdelay-mongodb-eflsbm" force deleted Error from server (NotFound): networkchaos.chaos-mesh.org "test-chaos-mesh-networkdelay-mongodb-eflsbm" not found check failover pod name failover pod name:mongodb-eflsbm-mongodb-2 failover networkdelay Success `kubectl get secrets -l app.kubernetes.io/instance=mongodb-eflsbm` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.username}"` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.password}"` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.port}"` DB_USERNAME:root;DB_PASSWORD:403nfj8Y0jh2R14x;DB_PORT:27017;DB_DATABASE: No resources found in default namespace. `echo "echo \"db.col.find()\" | mongo --host mongodb-eflsbm-mongodb-mongodb.default.svc.cluster.local --port 27017 -u root -p 403nfj8Y0jh2R14x --authenticationDatabase admin admin " | kubectl exec -it mongodb-eflsbm-mongodb-2 --namespace default -- bash ` check data: Defaulted container "mongodb" out of: mongodb, mongodb-backup-agent, exporter, kbagent, init-syncer (init), init-kubectl (init), init-pbm-agent (init), init-kbagent (init), kbagent-worker (init) Unable to use a TTY - input is not a terminal or the right kind of file Percona Server for MongoDB shell version v4.4.29-28 connecting to: mongodb://mongodb-eflsbm-mongodb-mongodb.default.svc.cluster.local:27017/admin?authSource=admin&compressors=disabled&gssapiServiceName=mongodb Implicit session: session { "id" : UUID("5ffb0baa-ba81-4a6f-a9ed-efcf1ded293a") } Percona Server for MongoDB server version: v4.4.29-28 { "_id" : ObjectId("698d539a50ef62d9286bd4cf"), "a" : "nelsi" } bye check cluster data consistent Success `kubectl get secrets -l app.kubernetes.io/instance=mongodb-eflsbm` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.username}"` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.password}"` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.port}"` DB_USERNAME:root;DB_PASSWORD:403nfj8Y0jh2R14x;DB_PORT:27017;DB_DATABASE: No resources found in default namespace. `echo "echo \"db.col.find().readPref('secondary')\" | mongo --host mongodb-eflsbm-mongodb-mongodb-ro.default.svc.cluster.local --port 27017 -u root -p 403nfj8Y0jh2R14x --authenticationDatabase admin admin " | kubectl exec -it mongodb-eflsbm-mongodb-0 --namespace default -- bash ` check readonly data: Defaulted container "mongodb" out of: mongodb, mongodb-backup-agent, exporter, kbagent, init-syncer (init), init-kubectl (init), init-pbm-agent (init), init-kbagent (init), kbagent-worker (init) Unable to use a TTY - input is not a terminal or the right kind of file Percona Server for MongoDB shell version v4.4.29-28 connecting to: mongodb://mongodb-eflsbm-mongodb-mongodb-ro.default.svc.cluster.local:27017/admin?authSource=admin&compressors=disabled&gssapiServiceName=mongodb Implicit session: session { "id" : UUID("94bebc34-4f28-450c-95b1-cc4f79c1b57d") } Percona Server for MongoDB server version: v4.4.29-28 { "_id" : ObjectId("698d539a50ef62d9286bd4cf"), "a" : "nelsi" } bye check cluster readonly data consistent Success `kubectl get secrets -l app.kubernetes.io/instance=mongodb-eflsbm` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.username}"` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.password}"` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.port}"` DB_USERNAME:root;DB_PASSWORD:403nfj8Y0jh2R14x;DB_PORT:27017;DB_DATABASE: No resources found in default namespace. check db_client batch data count `echo "echo \"db.executions_loop_table.estimatedDocumentCount();\" | mongo --host mongodb-eflsbm-mongodb-mongodb.default.svc.cluster.local --port 27017 -u root -p 403nfj8Y0jh2R14x --authenticationDatabase admin admin " | kubectl exec -it mongodb-eflsbm-mongodb-2 --namespace default -- bash ` check db_client batch [23154] equal [23154] data Success test failover networklossover check cluster status before cluster-failover-networklossover check cluster status done cluster_status:Running `kubectl patch -p '{"metadata":{"finalizers":[]}}' --type=merge NetworkChaos test-chaos-mesh-networklossover-mongodb-eflsbm --namespace default ` Warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely. Error from server (NotFound): networkchaos.chaos-mesh.org "test-chaos-mesh-networklossover-mongodb-eflsbm" not found Error from server (NotFound): networkchaos.chaos-mesh.org "test-chaos-mesh-networklossover-mongodb-eflsbm" not found apiVersion: chaos-mesh.org/v1alpha1 kind: NetworkChaos metadata: name: test-chaos-mesh-networklossover-mongodb-eflsbm namespace: default spec: selector: namespaces: - default labelSelectors: apps.kubeblocks.io/pod-name: mongodb-eflsbm-mongodb-2 mode: all action: loss loss: loss: '100' correlation: '100' direction: to duration: 2m `kubectl apply -f test-chaos-mesh-networklossover-mongodb-eflsbm.yaml` networkchaos.chaos-mesh.org/test-chaos-mesh-networklossover-mongodb-eflsbm created apply test-chaos-mesh-networklossover-mongodb-eflsbm.yaml Success `rm -rf test-chaos-mesh-networklossover-mongodb-eflsbm.yaml` networklossover chaos test waiting 120 seconds check cluster status `kbcli cluster list mongodb-eflsbm --show-labels --namespace default ` NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS mongodb-eflsbm default mongodb WipeOut Running Feb 12,2026 12:11 UTC+0800 app.kubernetes.io/instance=mongodb-eflsbm,clusterdefinition.kubeblocks.io/name=mongodb check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances mongodb-eflsbm --namespace default ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME mongodb-eflsbm-mongodb-0 default mongodb-eflsbm mongodb Running secondary cn-guangzhou-b 100m / 100m 512Mi / 512Mi data:20Gi 192.168.0.200/192.168.0.200 Feb 12,2026 12:11 UTC+0800 mongodb-eflsbm-mongodb-2 default mongodb-eflsbm mongodb Running secondary cn-guangzhou-b 100m / 100m 512Mi / 512Mi data:20Gi 192.168.0.159/192.168.0.159 Feb 12,2026 12:11 UTC+0800 mongodb-eflsbm-mongodb-3 default mongodb-eflsbm mongodb Running primary cn-guangzhou-b 100m / 100m 512Mi / 512Mi data:20Gi 192.168.0.199/192.168.0.199 Feb 12,2026 12:14 UTC+0800 check pod status done check cluster role check cluster role done primary: mongodb-eflsbm-mongodb-3;secondary: mongodb-eflsbm-mongodb-0 mongodb-eflsbm-mongodb-2 `kubectl get secrets -l app.kubernetes.io/instance=mongodb-eflsbm` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.username}"` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.password}"` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.port}"` DB_USERNAME:root;DB_PASSWORD:403nfj8Y0jh2R14x;DB_PORT:27017;DB_DATABASE: No resources found in default namespace. check cluster connect `echo " echo \"\" | mongo --host mongodb-eflsbm-mongodb-mongodb.default.svc.cluster.local --port 27017 -u root -p 403nfj8Y0jh2R14x --authenticationDatabase admin admin " | kubectl exec -it mongodb-eflsbm-mongodb-3 --namespace default -- bash` check cluster connect done `kubectl patch -p '{"metadata":{"finalizers":[]}}' --type=merge NetworkChaos test-chaos-mesh-networklossover-mongodb-eflsbm --namespace default ` Warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely. networkchaos.chaos-mesh.org "test-chaos-mesh-networklossover-mongodb-eflsbm" force deleted Error from server (NotFound): networkchaos.chaos-mesh.org "test-chaos-mesh-networklossover-mongodb-eflsbm" not found check failover pod name failover pod name:mongodb-eflsbm-mongodb-3 failover networklossover Success `kubectl get secrets -l app.kubernetes.io/instance=mongodb-eflsbm` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.username}"` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.password}"` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.port}"` DB_USERNAME:root;DB_PASSWORD:403nfj8Y0jh2R14x;DB_PORT:27017;DB_DATABASE: No resources found in default namespace. `echo "echo \"db.col.find()\" | mongo --host mongodb-eflsbm-mongodb-mongodb.default.svc.cluster.local --port 27017 -u root -p 403nfj8Y0jh2R14x --authenticationDatabase admin admin " | kubectl exec -it mongodb-eflsbm-mongodb-3 --namespace default -- bash ` check data: Defaulted container "mongodb" out of: mongodb, mongodb-backup-agent, exporter, kbagent, init-syncer (init), init-kubectl (init), init-pbm-agent (init), init-kbagent (init), kbagent-worker (init) Unable to use a TTY - input is not a terminal or the right kind of file Percona Server for MongoDB shell version v4.4.29-28 connecting to: mongodb://mongodb-eflsbm-mongodb-mongodb.default.svc.cluster.local:27017/admin?authSource=admin&compressors=disabled&gssapiServiceName=mongodb Implicit session: session { "id" : UUID("3d221cb3-ae85-44bb-89c5-c7df6f7a9c86") } Percona Server for MongoDB server version: v4.4.29-28 { "_id" : ObjectId("698d539a50ef62d9286bd4cf"), "a" : "nelsi" } bye check cluster data consistent Success `kubectl get secrets -l app.kubernetes.io/instance=mongodb-eflsbm` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.username}"` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.password}"` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.port}"` DB_USERNAME:root;DB_PASSWORD:403nfj8Y0jh2R14x;DB_PORT:27017;DB_DATABASE: No resources found in default namespace. `echo "echo \"db.col.find().readPref('secondary')\" | mongo --host mongodb-eflsbm-mongodb-mongodb-ro.default.svc.cluster.local --port 27017 -u root -p 403nfj8Y0jh2R14x --authenticationDatabase admin admin " | kubectl exec -it mongodb-eflsbm-mongodb-0 --namespace default -- bash ` check readonly data: Defaulted container "mongodb" out of: mongodb, mongodb-backup-agent, exporter, kbagent, init-syncer (init), init-kubectl (init), init-pbm-agent (init), init-kbagent (init), kbagent-worker (init) Unable to use a TTY - input is not a terminal or the right kind of file Percona Server for MongoDB shell version v4.4.29-28 connecting to: mongodb://mongodb-eflsbm-mongodb-mongodb-ro.default.svc.cluster.local:27017/admin?authSource=admin&compressors=disabled&gssapiServiceName=mongodb Implicit session: session { "id" : UUID("8e68311d-2805-4dcf-9718-237a166d5da2") } Percona Server for MongoDB server version: v4.4.29-28 { "_id" : ObjectId("698d539a50ef62d9286bd4cf"), "a" : "nelsi" } bye check cluster readonly data consistent Success `kubectl get secrets -l app.kubernetes.io/instance=mongodb-eflsbm` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.username}"` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.password}"` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.port}"` DB_USERNAME:root;DB_PASSWORD:403nfj8Y0jh2R14x;DB_PORT:27017;DB_DATABASE: No resources found in default namespace. check db_client batch data count `echo "echo \"db.executions_loop_table.estimatedDocumentCount();\" | mongo --host mongodb-eflsbm-mongodb-mongodb.default.svc.cluster.local --port 27017 -u root -p 403nfj8Y0jh2R14x --authenticationDatabase admin admin " | kubectl exec -it mongodb-eflsbm-mongodb-3 --namespace default -- bash ` check db_client batch [23154] equal [23154] data Success test failover dnsrandom check cluster status before cluster-failover-dnsrandom check cluster status done cluster_status:Running `kubectl patch -p '{"metadata":{"finalizers":[]}}' --type=merge DNSChaos test-chaos-mesh-dnsrandom-mongodb-eflsbm --namespace default ` Warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely. Error from server (NotFound): dnschaos.chaos-mesh.org "test-chaos-mesh-dnsrandom-mongodb-eflsbm" not found Error from server (NotFound): dnschaos.chaos-mesh.org "test-chaos-mesh-dnsrandom-mongodb-eflsbm" not found apiVersion: chaos-mesh.org/v1alpha1 kind: DNSChaos metadata: name: test-chaos-mesh-dnsrandom-mongodb-eflsbm namespace: default spec: selector: namespaces: - default labelSelectors: apps.kubeblocks.io/pod-name: mongodb-eflsbm-mongodb-3 mode: all action: random duration: 2m `kubectl apply -f test-chaos-mesh-dnsrandom-mongodb-eflsbm.yaml` dnschaos.chaos-mesh.org/test-chaos-mesh-dnsrandom-mongodb-eflsbm created apply test-chaos-mesh-dnsrandom-mongodb-eflsbm.yaml Success `rm -rf test-chaos-mesh-dnsrandom-mongodb-eflsbm.yaml` dnsrandom chaos test waiting 120 seconds check cluster status `kbcli cluster list mongodb-eflsbm --show-labels --namespace default ` NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS mongodb-eflsbm default mongodb WipeOut Running Feb 12,2026 12:11 UTC+0800 app.kubernetes.io/instance=mongodb-eflsbm,clusterdefinition.kubeblocks.io/name=mongodb check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances mongodb-eflsbm --namespace default ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME mongodb-eflsbm-mongodb-0 default mongodb-eflsbm mongodb Running secondary cn-guangzhou-b 100m / 100m 512Mi / 512Mi data:20Gi 192.168.0.200/192.168.0.200 Feb 12,2026 12:11 UTC+0800 mongodb-eflsbm-mongodb-2 default mongodb-eflsbm mongodb Running secondary cn-guangzhou-b 100m / 100m 512Mi / 512Mi data:20Gi 192.168.0.159/192.168.0.159 Feb 12,2026 12:11 UTC+0800 mongodb-eflsbm-mongodb-3 default mongodb-eflsbm mongodb Running primary cn-guangzhou-b 100m / 100m 512Mi / 512Mi data:20Gi 192.168.0.199/192.168.0.199 Feb 12,2026 12:14 UTC+0800 check pod status done check cluster role check cluster role done primary: mongodb-eflsbm-mongodb-3;secondary: mongodb-eflsbm-mongodb-0 mongodb-eflsbm-mongodb-2 `kubectl get secrets -l app.kubernetes.io/instance=mongodb-eflsbm` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.username}"` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.password}"` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.port}"` DB_USERNAME:root;DB_PASSWORD:403nfj8Y0jh2R14x;DB_PORT:27017;DB_DATABASE: No resources found in default namespace. check cluster connect `echo " echo \"\" | mongo --host mongodb-eflsbm-mongodb-mongodb.default.svc.cluster.local --port 27017 -u root -p 403nfj8Y0jh2R14x --authenticationDatabase admin admin " | kubectl exec -it mongodb-eflsbm-mongodb-3 --namespace default -- bash` check cluster connect done `kubectl patch -p '{"metadata":{"finalizers":[]}}' --type=merge DNSChaos test-chaos-mesh-dnsrandom-mongodb-eflsbm --namespace default ` Warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely. dnschaos.chaos-mesh.org "test-chaos-mesh-dnsrandom-mongodb-eflsbm" force deleted Error from server (NotFound): dnschaos.chaos-mesh.org "test-chaos-mesh-dnsrandom-mongodb-eflsbm" not found check failover pod name failover pod name:mongodb-eflsbm-mongodb-3 failover dnsrandom Success `kubectl get secrets -l app.kubernetes.io/instance=mongodb-eflsbm` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.username}"` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.password}"` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.port}"` DB_USERNAME:root;DB_PASSWORD:403nfj8Y0jh2R14x;DB_PORT:27017;DB_DATABASE: No resources found in default namespace. `echo "echo \"db.col.find()\" | mongo --host mongodb-eflsbm-mongodb-mongodb.default.svc.cluster.local --port 27017 -u root -p 403nfj8Y0jh2R14x --authenticationDatabase admin admin " | kubectl exec -it mongodb-eflsbm-mongodb-3 --namespace default -- bash ` check data: Defaulted container "mongodb" out of: mongodb, mongodb-backup-agent, exporter, kbagent, init-syncer (init), init-kubectl (init), init-pbm-agent (init), init-kbagent (init), kbagent-worker (init) Unable to use a TTY - input is not a terminal or the right kind of file Percona Server for MongoDB shell version v4.4.29-28 connecting to: mongodb://mongodb-eflsbm-mongodb-mongodb.default.svc.cluster.local:27017/admin?authSource=admin&compressors=disabled&gssapiServiceName=mongodb Implicit session: session { "id" : UUID("381a4c45-f479-44e4-ac70-6db2a188613f") } Percona Server for MongoDB server version: v4.4.29-28 { "_id" : ObjectId("698d539a50ef62d9286bd4cf"), "a" : "nelsi" } bye check cluster data consistent Success `kubectl get secrets -l app.kubernetes.io/instance=mongodb-eflsbm` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.username}"` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.password}"` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.port}"` DB_USERNAME:root;DB_PASSWORD:403nfj8Y0jh2R14x;DB_PORT:27017;DB_DATABASE: No resources found in default namespace. `echo "echo \"db.col.find().readPref('secondary')\" | mongo --host mongodb-eflsbm-mongodb-mongodb-ro.default.svc.cluster.local --port 27017 -u root -p 403nfj8Y0jh2R14x --authenticationDatabase admin admin " | kubectl exec -it mongodb-eflsbm-mongodb-0 --namespace default -- bash ` check readonly data: Defaulted container "mongodb" out of: mongodb, mongodb-backup-agent, exporter, kbagent, init-syncer (init), init-kubectl (init), init-pbm-agent (init), init-kbagent (init), kbagent-worker (init) Unable to use a TTY - input is not a terminal or the right kind of file Percona Server for MongoDB shell version v4.4.29-28 connecting to: mongodb://mongodb-eflsbm-mongodb-mongodb-ro.default.svc.cluster.local:27017/admin?authSource=admin&compressors=disabled&gssapiServiceName=mongodb Implicit session: session { "id" : UUID("4391bbcd-80ce-453b-b45a-7690f541a4f6") } Percona Server for MongoDB server version: v4.4.29-28 { "_id" : ObjectId("698d539a50ef62d9286bd4cf"), "a" : "nelsi" } bye check cluster readonly data consistent Success `kubectl get secrets -l app.kubernetes.io/instance=mongodb-eflsbm` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.username}"` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.password}"` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.port}"` DB_USERNAME:root;DB_PASSWORD:403nfj8Y0jh2R14x;DB_PORT:27017;DB_DATABASE: No resources found in default namespace. check db_client batch data count `echo "echo \"db.executions_loop_table.estimatedDocumentCount();\" | mongo --host mongodb-eflsbm-mongodb-mongodb.default.svc.cluster.local --port 27017 -u root -p 403nfj8Y0jh2R14x --authenticationDatabase admin admin " | kubectl exec -it mongodb-eflsbm-mongodb-3 --namespace default -- bash ` check db_client batch [23154] equal [23154] data Success test failover networkpartition check cluster status before cluster-failover-networkpartition check cluster status done cluster_status:Running `kubectl patch -p '{"metadata":{"finalizers":[]}}' --type=merge NetworkChaos test-chaos-mesh-networkpartition-mongodb-eflsbm --namespace default ` Warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely. Error from server (NotFound): networkchaos.chaos-mesh.org "test-chaos-mesh-networkpartition-mongodb-eflsbm" not found Error from server (NotFound): networkchaos.chaos-mesh.org "test-chaos-mesh-networkpartition-mongodb-eflsbm" not found apiVersion: chaos-mesh.org/v1alpha1 kind: NetworkChaos metadata: name: test-chaos-mesh-networkpartition-mongodb-eflsbm namespace: default spec: selector: namespaces: - default labelSelectors: apps.kubeblocks.io/pod-name: mongodb-eflsbm-mongodb-3 action: partition mode: all target: mode: all selector: namespaces: - default labelSelectors: apps.kubeblocks.io/pod-name: mongodb-eflsbm-mongodb-0 direction: to duration: 2m `kubectl apply -f test-chaos-mesh-networkpartition-mongodb-eflsbm.yaml` networkchaos.chaos-mesh.org/test-chaos-mesh-networkpartition-mongodb-eflsbm created apply test-chaos-mesh-networkpartition-mongodb-eflsbm.yaml Success `rm -rf test-chaos-mesh-networkpartition-mongodb-eflsbm.yaml` networkpartition chaos test waiting 120 seconds check cluster status `kbcli cluster list mongodb-eflsbm --show-labels --namespace default ` NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS mongodb-eflsbm default mongodb WipeOut Running Feb 12,2026 12:11 UTC+0800 app.kubernetes.io/instance=mongodb-eflsbm,clusterdefinition.kubeblocks.io/name=mongodb check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances mongodb-eflsbm --namespace default ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME mongodb-eflsbm-mongodb-0 default mongodb-eflsbm mongodb Running secondary cn-guangzhou-b 100m / 100m 512Mi / 512Mi data:20Gi 192.168.0.200/192.168.0.200 Feb 12,2026 12:11 UTC+0800 mongodb-eflsbm-mongodb-2 default mongodb-eflsbm mongodb Running secondary cn-guangzhou-b 100m / 100m 512Mi / 512Mi data:20Gi 192.168.0.159/192.168.0.159 Feb 12,2026 12:11 UTC+0800 mongodb-eflsbm-mongodb-3 default mongodb-eflsbm mongodb Running primary cn-guangzhou-b 100m / 100m 512Mi / 512Mi data:20Gi 192.168.0.199/192.168.0.199 Feb 12,2026 12:14 UTC+0800 check pod status done check cluster role check cluster role done primary: mongodb-eflsbm-mongodb-3;secondary: mongodb-eflsbm-mongodb-0 mongodb-eflsbm-mongodb-2 `kubectl get secrets -l app.kubernetes.io/instance=mongodb-eflsbm` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.username}"` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.password}"` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.port}"` DB_USERNAME:root;DB_PASSWORD:403nfj8Y0jh2R14x;DB_PORT:27017;DB_DATABASE: No resources found in default namespace. check cluster connect `echo " echo \"\" | mongo --host mongodb-eflsbm-mongodb-mongodb.default.svc.cluster.local --port 27017 -u root -p 403nfj8Y0jh2R14x --authenticationDatabase admin admin " | kubectl exec -it mongodb-eflsbm-mongodb-3 --namespace default -- bash` check cluster connect done `kubectl patch -p '{"metadata":{"finalizers":[]}}' --type=merge NetworkChaos test-chaos-mesh-networkpartition-mongodb-eflsbm --namespace default ` Warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely. networkchaos.chaos-mesh.org "test-chaos-mesh-networkpartition-mongodb-eflsbm" force deleted Error from server (NotFound): networkchaos.chaos-mesh.org "test-chaos-mesh-networkpartition-mongodb-eflsbm" not found check failover pod name failover pod name:mongodb-eflsbm-mongodb-3 failover networkpartition Success `kubectl get secrets -l app.kubernetes.io/instance=mongodb-eflsbm` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.username}"` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.password}"` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.port}"` DB_USERNAME:root;DB_PASSWORD:403nfj8Y0jh2R14x;DB_PORT:27017;DB_DATABASE: No resources found in default namespace. `echo "echo \"db.col.find()\" | mongo --host mongodb-eflsbm-mongodb-mongodb.default.svc.cluster.local --port 27017 -u root -p 403nfj8Y0jh2R14x --authenticationDatabase admin admin " | kubectl exec -it mongodb-eflsbm-mongodb-3 --namespace default -- bash ` check data: Defaulted container "mongodb" out of: mongodb, mongodb-backup-agent, exporter, kbagent, init-syncer (init), init-kubectl (init), init-pbm-agent (init), init-kbagent (init), kbagent-worker (init) Unable to use a TTY - input is not a terminal or the right kind of file Percona Server for MongoDB shell version v4.4.29-28 connecting to: mongodb://mongodb-eflsbm-mongodb-mongodb.default.svc.cluster.local:27017/admin?authSource=admin&compressors=disabled&gssapiServiceName=mongodb Implicit session: session { "id" : UUID("a6dd4a59-b818-4e39-a1e7-325018f76db9") } Percona Server for MongoDB server version: v4.4.29-28 { "_id" : ObjectId("698d539a50ef62d9286bd4cf"), "a" : "nelsi" } bye check cluster data consistent Success `kubectl get secrets -l app.kubernetes.io/instance=mongodb-eflsbm` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.username}"` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.password}"` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.port}"` DB_USERNAME:root;DB_PASSWORD:403nfj8Y0jh2R14x;DB_PORT:27017;DB_DATABASE: No resources found in default namespace. `echo "echo \"db.col.find().readPref('secondary')\" | mongo --host mongodb-eflsbm-mongodb-mongodb-ro.default.svc.cluster.local --port 27017 -u root -p 403nfj8Y0jh2R14x --authenticationDatabase admin admin " | kubectl exec -it mongodb-eflsbm-mongodb-0 --namespace default -- bash ` check readonly data: Defaulted container "mongodb" out of: mongodb, mongodb-backup-agent, exporter, kbagent, init-syncer (init), init-kubectl (init), init-pbm-agent (init), init-kbagent (init), kbagent-worker (init) Unable to use a TTY - input is not a terminal or the right kind of file Percona Server for MongoDB shell version v4.4.29-28 connecting to: mongodb://mongodb-eflsbm-mongodb-mongodb-ro.default.svc.cluster.local:27017/admin?authSource=admin&compressors=disabled&gssapiServiceName=mongodb Implicit session: session { "id" : UUID("3837de5d-2004-4d6f-9fbb-ebf4153022f8") } Percona Server for MongoDB server version: v4.4.29-28 { "_id" : ObjectId("698d539a50ef62d9286bd4cf"), "a" : "nelsi" } bye check cluster readonly data consistent Success `kubectl get secrets -l app.kubernetes.io/instance=mongodb-eflsbm` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.username}"` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.password}"` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.port}"` DB_USERNAME:root;DB_PASSWORD:403nfj8Y0jh2R14x;DB_PORT:27017;DB_DATABASE: No resources found in default namespace. check db_client batch data count `echo "echo \"db.executions_loop_table.estimatedDocumentCount();\" | mongo --host mongodb-eflsbm-mongodb-mongodb.default.svc.cluster.local --port 27017 -u root -p 403nfj8Y0jh2R14x --authenticationDatabase admin admin " | kubectl exec -it mongodb-eflsbm-mongodb-3 --namespace default -- bash ` check db_client batch [23154] equal [23154] data Success test failover oom check cluster status before cluster-failover-oom check cluster status done cluster_status:Running `kubectl patch -p '{"metadata":{"finalizers":[]}}' --type=merge StressChaos test-chaos-mesh-oom-mongodb-eflsbm --namespace default ` Warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely. Error from server (NotFound): stresschaos.chaos-mesh.org "test-chaos-mesh-oom-mongodb-eflsbm" not found Error from server (NotFound): stresschaos.chaos-mesh.org "test-chaos-mesh-oom-mongodb-eflsbm" not found apiVersion: chaos-mesh.org/v1alpha1 kind: StressChaos metadata: name: test-chaos-mesh-oom-mongodb-eflsbm namespace: default spec: selector: namespaces: - default labelSelectors: apps.kubeblocks.io/pod-name: mongodb-eflsbm-mongodb-3 mode: all stressors: memory: workers: 1 size: "100GB" oomScoreAdj: -1000 duration: 2m `kubectl apply -f test-chaos-mesh-oom-mongodb-eflsbm.yaml` stresschaos.chaos-mesh.org/test-chaos-mesh-oom-mongodb-eflsbm created apply test-chaos-mesh-oom-mongodb-eflsbm.yaml Success `rm -rf test-chaos-mesh-oom-mongodb-eflsbm.yaml` check cluster status `kbcli cluster list mongodb-eflsbm --show-labels --namespace default ` NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS mongodb-eflsbm default mongodb WipeOut Running Feb 12,2026 12:11 UTC+0800 app.kubernetes.io/instance=mongodb-eflsbm,clusterdefinition.kubeblocks.io/name=mongodb check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances mongodb-eflsbm --namespace default ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME mongodb-eflsbm-mongodb-0 default mongodb-eflsbm mongodb Running primary cn-guangzhou-b 100m / 100m 512Mi / 512Mi data:20Gi 192.168.0.200/192.168.0.200 Feb 12,2026 12:11 UTC+0800 mongodb-eflsbm-mongodb-2 default mongodb-eflsbm mongodb Running secondary cn-guangzhou-b 100m / 100m 512Mi / 512Mi data:20Gi 192.168.0.159/192.168.0.159 Feb 12,2026 12:11 UTC+0800 mongodb-eflsbm-mongodb-3 default mongodb-eflsbm mongodb Running secondary cn-guangzhou-b 100m / 100m 512Mi / 512Mi data:20Gi 192.168.0.199/192.168.0.199 Feb 12,2026 12:14 UTC+0800 check pod status done check cluster role check cluster role done primary: mongodb-eflsbm-mongodb-0;secondary: mongodb-eflsbm-mongodb-2 mongodb-eflsbm-mongodb-3 `kubectl get secrets -l app.kubernetes.io/instance=mongodb-eflsbm` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.username}"` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.password}"` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.port}"` DB_USERNAME:root;DB_PASSWORD:403nfj8Y0jh2R14x;DB_PORT:27017;DB_DATABASE: No resources found in default namespace. check cluster connect `echo " echo \"\" | mongo --host mongodb-eflsbm-mongodb-mongodb.default.svc.cluster.local --port 27017 -u root -p 403nfj8Y0jh2R14x --authenticationDatabase admin admin " | kubectl exec -it mongodb-eflsbm-mongodb-0 --namespace default -- bash` check cluster connect done `kubectl patch -p '{"metadata":{"finalizers":[]}}' --type=merge StressChaos test-chaos-mesh-oom-mongodb-eflsbm --namespace default ` Warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely. stresschaos.chaos-mesh.org "test-chaos-mesh-oom-mongodb-eflsbm" force deleted Error from server (NotFound): stresschaos.chaos-mesh.org "test-chaos-mesh-oom-mongodb-eflsbm" not found check failover pod name failover pod name:mongodb-eflsbm-mongodb-0 failover oom Success `kubectl get secrets -l app.kubernetes.io/instance=mongodb-eflsbm` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.username}"` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.password}"` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.port}"` DB_USERNAME:root;DB_PASSWORD:403nfj8Y0jh2R14x;DB_PORT:27017;DB_DATABASE: No resources found in default namespace. `echo "echo \"db.col.find()\" | mongo --host mongodb-eflsbm-mongodb-mongodb.default.svc.cluster.local --port 27017 -u root -p 403nfj8Y0jh2R14x --authenticationDatabase admin admin " | kubectl exec -it mongodb-eflsbm-mongodb-0 --namespace default -- bash ` check data: Defaulted container "mongodb" out of: mongodb, mongodb-backup-agent, exporter, kbagent, init-syncer (init), init-kubectl (init), init-pbm-agent (init), init-kbagent (init), kbagent-worker (init) Unable to use a TTY - input is not a terminal or the right kind of file Percona Server for MongoDB shell version v4.4.29-28 connecting to: mongodb://mongodb-eflsbm-mongodb-mongodb.default.svc.cluster.local:27017/admin?authSource=admin&compressors=disabled&gssapiServiceName=mongodb Implicit session: session { "id" : UUID("774ae5ba-74fc-4bfe-b27c-524e25fcb733") } Percona Server for MongoDB server version: v4.4.29-28 { "_id" : ObjectId("698d539a50ef62d9286bd4cf"), "a" : "nelsi" } bye check cluster data consistent Success `kubectl get secrets -l app.kubernetes.io/instance=mongodb-eflsbm` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.username}"` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.password}"` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.port}"` DB_USERNAME:root;DB_PASSWORD:403nfj8Y0jh2R14x;DB_PORT:27017;DB_DATABASE: No resources found in default namespace. `echo "echo \"db.col.find().readPref('secondary')\" | mongo --host mongodb-eflsbm-mongodb-mongodb-ro.default.svc.cluster.local --port 27017 -u root -p 403nfj8Y0jh2R14x --authenticationDatabase admin admin " | kubectl exec -it mongodb-eflsbm-mongodb-2 --namespace default -- bash ` check readonly data: Defaulted container "mongodb" out of: mongodb, mongodb-backup-agent, exporter, kbagent, init-syncer (init), init-kubectl (init), init-pbm-agent (init), init-kbagent (init), kbagent-worker (init) Unable to use a TTY - input is not a terminal or the right kind of file Percona Server for MongoDB shell version v4.4.29-28 connecting to: mongodb://mongodb-eflsbm-mongodb-mongodb-ro.default.svc.cluster.local:27017/admin?authSource=admin&compressors=disabled&gssapiServiceName=mongodb Implicit session: session { "id" : UUID("6cfdac80-fa04-4513-a6ac-d08be433fd1c") } Percona Server for MongoDB server version: v4.4.29-28 { "_id" : ObjectId("698d539a50ef62d9286bd4cf"), "a" : "nelsi" } bye check cluster readonly data consistent Success `kubectl get secrets -l app.kubernetes.io/instance=mongodb-eflsbm` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.username}"` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.password}"` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.port}"` DB_USERNAME:root;DB_PASSWORD:403nfj8Y0jh2R14x;DB_PORT:27017;DB_DATABASE: No resources found in default namespace. check db_client batch data count `echo "echo \"db.executions_loop_table.estimatedDocumentCount();\" | mongo --host mongodb-eflsbm-mongodb-mongodb.default.svc.cluster.local --port 27017 -u root -p 403nfj8Y0jh2R14x --authenticationDatabase admin admin " | kubectl exec -it mongodb-eflsbm-mongodb-0 --namespace default -- bash ` check db_client batch [23154] equal [23154] data Success test failover networkduplicate check cluster status before cluster-failover-networkduplicate check cluster status done cluster_status:Running `kubectl patch -p '{"metadata":{"finalizers":[]}}' --type=merge NetworkChaos test-chaos-mesh-networkduplicate-mongodb-eflsbm --namespace default ` Warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely. Error from server (NotFound): networkchaos.chaos-mesh.org "test-chaos-mesh-networkduplicate-mongodb-eflsbm" not found Error from server (NotFound): networkchaos.chaos-mesh.org "test-chaos-mesh-networkduplicate-mongodb-eflsbm" not found apiVersion: chaos-mesh.org/v1alpha1 kind: NetworkChaos metadata: name: test-chaos-mesh-networkduplicate-mongodb-eflsbm namespace: default spec: selector: namespaces: - default labelSelectors: apps.kubeblocks.io/pod-name: mongodb-eflsbm-mongodb-0 mode: all action: duplicate duplicate: duplicate: '100' correlation: '100' direction: to duration: 2m `kubectl apply -f test-chaos-mesh-networkduplicate-mongodb-eflsbm.yaml` networkchaos.chaos-mesh.org/test-chaos-mesh-networkduplicate-mongodb-eflsbm created apply test-chaos-mesh-networkduplicate-mongodb-eflsbm.yaml Success `rm -rf test-chaos-mesh-networkduplicate-mongodb-eflsbm.yaml` networkduplicate chaos test waiting 120 seconds check cluster status `kbcli cluster list mongodb-eflsbm --show-labels --namespace default ` NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS mongodb-eflsbm default mongodb WipeOut Running Feb 12,2026 12:11 UTC+0800 app.kubernetes.io/instance=mongodb-eflsbm,clusterdefinition.kubeblocks.io/name=mongodb check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances mongodb-eflsbm --namespace default ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME mongodb-eflsbm-mongodb-0 default mongodb-eflsbm mongodb Running primary cn-guangzhou-b 100m / 100m 512Mi / 512Mi data:20Gi 192.168.0.200/192.168.0.200 Feb 12,2026 12:11 UTC+0800 mongodb-eflsbm-mongodb-2 default mongodb-eflsbm mongodb Running secondary cn-guangzhou-b 100m / 100m 512Mi / 512Mi data:20Gi 192.168.0.159/192.168.0.159 Feb 12,2026 12:11 UTC+0800 mongodb-eflsbm-mongodb-3 default mongodb-eflsbm mongodb Running secondary cn-guangzhou-b 100m / 100m 512Mi / 512Mi data:20Gi 192.168.0.199/192.168.0.199 Feb 12,2026 12:14 UTC+0800 check pod status done check cluster role check cluster role done primary: mongodb-eflsbm-mongodb-0;secondary: mongodb-eflsbm-mongodb-2 mongodb-eflsbm-mongodb-3 `kubectl get secrets -l app.kubernetes.io/instance=mongodb-eflsbm` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.username}"` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.password}"` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.port}"` DB_USERNAME:root;DB_PASSWORD:403nfj8Y0jh2R14x;DB_PORT:27017;DB_DATABASE: No resources found in default namespace. check cluster connect `echo " echo \"\" | mongo --host mongodb-eflsbm-mongodb-mongodb.default.svc.cluster.local --port 27017 -u root -p 403nfj8Y0jh2R14x --authenticationDatabase admin admin " | kubectl exec -it mongodb-eflsbm-mongodb-0 --namespace default -- bash` check cluster connect done `kubectl patch -p '{"metadata":{"finalizers":[]}}' --type=merge NetworkChaos test-chaos-mesh-networkduplicate-mongodb-eflsbm --namespace default ` Warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely. networkchaos.chaos-mesh.org "test-chaos-mesh-networkduplicate-mongodb-eflsbm" force deleted Error from server (NotFound): networkchaos.chaos-mesh.org "test-chaos-mesh-networkduplicate-mongodb-eflsbm" not found check failover pod name failover pod name:mongodb-eflsbm-mongodb-0 failover networkduplicate Success `kubectl get secrets -l app.kubernetes.io/instance=mongodb-eflsbm` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.username}"` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.password}"` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.port}"` DB_USERNAME:root;DB_PASSWORD:403nfj8Y0jh2R14x;DB_PORT:27017;DB_DATABASE: No resources found in default namespace. `echo "echo \"db.col.find()\" | mongo --host mongodb-eflsbm-mongodb-mongodb.default.svc.cluster.local --port 27017 -u root -p 403nfj8Y0jh2R14x --authenticationDatabase admin admin " | kubectl exec -it mongodb-eflsbm-mongodb-0 --namespace default -- bash ` check data: Defaulted container "mongodb" out of: mongodb, mongodb-backup-agent, exporter, kbagent, init-syncer (init), init-kubectl (init), init-pbm-agent (init), init-kbagent (init), kbagent-worker (init) Unable to use a TTY - input is not a terminal or the right kind of file Percona Server for MongoDB shell version v4.4.29-28 connecting to: mongodb://mongodb-eflsbm-mongodb-mongodb.default.svc.cluster.local:27017/admin?authSource=admin&compressors=disabled&gssapiServiceName=mongodb Implicit session: session { "id" : UUID("a9abd2ae-a41b-4841-8874-c517eeaed66c") } Percona Server for MongoDB server version: v4.4.29-28 { "_id" : ObjectId("698d539a50ef62d9286bd4cf"), "a" : "nelsi" } bye check cluster data consistent Success `kubectl get secrets -l app.kubernetes.io/instance=mongodb-eflsbm` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.username}"` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.password}"` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.port}"` DB_USERNAME:root;DB_PASSWORD:403nfj8Y0jh2R14x;DB_PORT:27017;DB_DATABASE: No resources found in default namespace. `echo "echo \"db.col.find().readPref('secondary')\" | mongo --host mongodb-eflsbm-mongodb-mongodb-ro.default.svc.cluster.local --port 27017 -u root -p 403nfj8Y0jh2R14x --authenticationDatabase admin admin " | kubectl exec -it mongodb-eflsbm-mongodb-2 --namespace default -- bash ` check readonly data: Defaulted container "mongodb" out of: mongodb, mongodb-backup-agent, exporter, kbagent, init-syncer (init), init-kubectl (init), init-pbm-agent (init), init-kbagent (init), kbagent-worker (init) Unable to use a TTY - input is not a terminal or the right kind of file Percona Server for MongoDB shell version v4.4.29-28 connecting to: mongodb://mongodb-eflsbm-mongodb-mongodb-ro.default.svc.cluster.local:27017/admin?authSource=admin&compressors=disabled&gssapiServiceName=mongodb Implicit session: session { "id" : UUID("bcc7e808-8362-4e72-b7b6-859d1304e4ac") } Percona Server for MongoDB server version: v4.4.29-28 { "_id" : ObjectId("698d539a50ef62d9286bd4cf"), "a" : "nelsi" } bye check cluster readonly data consistent Success `kubectl get secrets -l app.kubernetes.io/instance=mongodb-eflsbm` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.username}"` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.password}"` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.port}"` DB_USERNAME:root;DB_PASSWORD:403nfj8Y0jh2R14x;DB_PORT:27017;DB_DATABASE: No resources found in default namespace. check db_client batch data count `echo "echo \"db.executions_loop_table.estimatedDocumentCount();\" | mongo --host mongodb-eflsbm-mongodb-mongodb.default.svc.cluster.local --port 27017 -u root -p 403nfj8Y0jh2R14x --authenticationDatabase admin admin " | kubectl exec -it mongodb-eflsbm-mongodb-0 --namespace default -- bash ` check db_client batch [23154] equal [23154] data Success cluster hscale offline instances apiVersion: operations.kubeblocks.io/v1alpha1 kind: OpsRequest metadata: generateName: mongodb-eflsbm-hscaleoffinstance- labels: app.kubernetes.io/instance: mongodb-eflsbm app.kubernetes.io/managed-by: kubeblocks namespace: default spec: type: HorizontalScaling clusterName: mongodb-eflsbm force: true horizontalScaling: - componentName: mongodb scaleIn: onlineInstancesToOffline: - mongodb-eflsbm-mongodb-2 check cluster status before ops check cluster status done cluster_status:Running `kubectl create -f test_ops_cluster_mongodb-eflsbm.yaml` opsrequest.operations.kubeblocks.io/mongodb-eflsbm-hscaleoffinstance-wz89f created create test_ops_cluster_mongodb-eflsbm.yaml Success `rm -rf test_ops_cluster_mongodb-eflsbm.yaml` check ops status `kbcli cluster list-ops mongodb-eflsbm --status all --namespace default ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME mongodb-eflsbm-hscaleoffinstance-wz89f default HorizontalScaling mongodb-eflsbm mongodb Running 0/1 Feb 12,2026 12:28 UTC+0800 check cluster status `kbcli cluster list mongodb-eflsbm --show-labels --namespace default ` NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS mongodb-eflsbm default mongodb WipeOut Running Feb 12,2026 12:11 UTC+0800 app.kubernetes.io/instance=mongodb-eflsbm,clusterdefinition.kubeblocks.io/name=mongodb check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances mongodb-eflsbm --namespace default ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME mongodb-eflsbm-mongodb-0 default mongodb-eflsbm mongodb Running primary cn-guangzhou-b 100m / 100m 512Mi / 512Mi data:20Gi 192.168.0.200/192.168.0.200 Feb 12,2026 12:11 UTC+0800 mongodb-eflsbm-mongodb-3 default mongodb-eflsbm mongodb Running secondary cn-guangzhou-b 100m / 100m 512Mi / 512Mi data:20Gi 192.168.0.199/192.168.0.199 Feb 12,2026 12:14 UTC+0800 check pod status done check cluster role check cluster role done primary: mongodb-eflsbm-mongodb-0;secondary: mongodb-eflsbm-mongodb-3 `kubectl get secrets -l app.kubernetes.io/instance=mongodb-eflsbm` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.username}"` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.password}"` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.port}"` DB_USERNAME:root;DB_PASSWORD:403nfj8Y0jh2R14x;DB_PORT:27017;DB_DATABASE: No resources found in default namespace. check cluster connect `echo " echo \"\" | mongo --host mongodb-eflsbm-mongodb-mongodb.default.svc.cluster.local --port 27017 -u root -p 403nfj8Y0jh2R14x --authenticationDatabase admin admin " | kubectl exec -it mongodb-eflsbm-mongodb-0 --namespace default -- bash` check cluster connect done check ops status `kbcli cluster list-ops mongodb-eflsbm --status all --namespace default ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME mongodb-eflsbm-hscaleoffinstance-wz89f default HorizontalScaling mongodb-eflsbm mongodb Succeed 1/1 Feb 12,2026 12:28 UTC+0800 check ops status done ops_status:mongodb-eflsbm-hscaleoffinstance-wz89f default HorizontalScaling mongodb-eflsbm mongodb Succeed 1/1 Feb 12,2026 12:28 UTC+0800 `kubectl patch -p '{"metadata":{"finalizers":[]}}' --type=merge opsrequests.operations mongodb-eflsbm-hscaleoffinstance-wz89f --namespace default ` opsrequest.operations.kubeblocks.io/mongodb-eflsbm-hscaleoffinstance-wz89f patched `kbcli cluster delete-ops --name mongodb-eflsbm-hscaleoffinstance-wz89f --force --auto-approve --namespace default ` OpsRequest mongodb-eflsbm-hscaleoffinstance-wz89f deleted `kubectl get secrets -l app.kubernetes.io/instance=mongodb-eflsbm` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.username}"` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.password}"` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.port}"` DB_USERNAME:root;DB_PASSWORD:403nfj8Y0jh2R14x;DB_PORT:27017;DB_DATABASE: No resources found in default namespace. `echo "echo \"db.col.find()\" | mongo --host mongodb-eflsbm-mongodb-mongodb.default.svc.cluster.local --port 27017 -u root -p 403nfj8Y0jh2R14x --authenticationDatabase admin admin " | kubectl exec -it mongodb-eflsbm-mongodb-0 --namespace default -- bash ` check data: Defaulted container "mongodb" out of: mongodb, mongodb-backup-agent, exporter, kbagent, init-syncer (init), init-kubectl (init), init-pbm-agent (init), init-kbagent (init), kbagent-worker (init) Unable to use a TTY - input is not a terminal or the right kind of file Percona Server for MongoDB shell version v4.4.29-28 connecting to: mongodb://mongodb-eflsbm-mongodb-mongodb.default.svc.cluster.local:27017/admin?authSource=admin&compressors=disabled&gssapiServiceName=mongodb Implicit session: session { "id" : UUID("bc4307ab-1e94-4ac0-8956-3cfa75f8a4bc") } Percona Server for MongoDB server version: v4.4.29-28 { "_id" : ObjectId("698d539a50ef62d9286bd4cf"), "a" : "nelsi" } bye check cluster data consistent Success `kubectl get secrets -l app.kubernetes.io/instance=mongodb-eflsbm` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.username}"` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.password}"` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.port}"` DB_USERNAME:root;DB_PASSWORD:403nfj8Y0jh2R14x;DB_PORT:27017;DB_DATABASE: No resources found in default namespace. `echo "echo \"db.col.find().readPref('secondary')\" | mongo --host mongodb-eflsbm-mongodb-mongodb-ro.default.svc.cluster.local --port 27017 -u root -p 403nfj8Y0jh2R14x --authenticationDatabase admin admin " | kubectl exec -it mongodb-eflsbm-mongodb-3 --namespace default -- bash ` check readonly data: Defaulted container "mongodb" out of: mongodb, mongodb-backup-agent, exporter, kbagent, init-syncer (init), init-kubectl (init), init-pbm-agent (init), init-kbagent (init), kbagent-worker (init) Unable to use a TTY - input is not a terminal or the right kind of file Percona Server for MongoDB shell version v4.4.29-28 connecting to: mongodb://mongodb-eflsbm-mongodb-mongodb-ro.default.svc.cluster.local:27017/admin?authSource=admin&compressors=disabled&gssapiServiceName=mongodb Implicit session: session { "id" : UUID("94d3fa59-00b1-4d88-ae0a-a454d3c3851c") } Percona Server for MongoDB server version: v4.4.29-28 { "_id" : ObjectId("698d539a50ef62d9286bd4cf"), "a" : "nelsi" } bye check cluster readonly data consistent Success `kubectl get secrets -l app.kubernetes.io/instance=mongodb-eflsbm` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.username}"` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.password}"` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.port}"` DB_USERNAME:root;DB_PASSWORD:403nfj8Y0jh2R14x;DB_PORT:27017;DB_DATABASE: No resources found in default namespace. check db_client batch data count `echo "echo \"db.executions_loop_table.estimatedDocumentCount();\" | mongo --host mongodb-eflsbm-mongodb-mongodb.default.svc.cluster.local --port 27017 -u root -p 403nfj8Y0jh2R14x --authenticationDatabase admin admin " | kubectl exec -it mongodb-eflsbm-mongodb-0 --namespace default -- bash ` check db_client batch [23154] equal [23154] data Success cluster hscale online instances apiVersion: operations.kubeblocks.io/v1alpha1 kind: OpsRequest metadata: generateName: mongodb-eflsbm-hscaleoninstance- labels: app.kubernetes.io/instance: mongodb-eflsbm app.kubernetes.io/managed-by: kubeblocks namespace: default spec: type: HorizontalScaling clusterName: mongodb-eflsbm force: true horizontalScaling: - componentName: mongodb scaleOut: offlineInstancesToOnline: - mongodb-eflsbm-mongodb-2 check cluster status before ops check cluster status done cluster_status:Running `kubectl create -f test_ops_cluster_mongodb-eflsbm.yaml` opsrequest.operations.kubeblocks.io/mongodb-eflsbm-hscaleoninstance-mn7cq created create test_ops_cluster_mongodb-eflsbm.yaml Success `rm -rf test_ops_cluster_mongodb-eflsbm.yaml` check ops status `kbcli cluster list-ops mongodb-eflsbm --status all --namespace default ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME mongodb-eflsbm-hscaleoninstance-mn7cq default HorizontalScaling mongodb-eflsbm mongodb Running 0/1 Feb 12,2026 12:29 UTC+0800 check cluster status `kbcli cluster list mongodb-eflsbm --show-labels --namespace default ` NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS mongodb-eflsbm default mongodb WipeOut Updating Feb 12,2026 12:11 UTC+0800 app.kubernetes.io/instance=mongodb-eflsbm,clusterdefinition.kubeblocks.io/name=mongodb cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances mongodb-eflsbm --namespace default ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME mongodb-eflsbm-mongodb-0 default mongodb-eflsbm mongodb Running primary cn-guangzhou-b 100m / 100m 512Mi / 512Mi data:20Gi 192.168.0.200/192.168.0.200 Feb 12,2026 12:11 UTC+0800 mongodb-eflsbm-mongodb-2 default mongodb-eflsbm mongodb Running secondary cn-guangzhou-b 100m / 100m 512Mi / 512Mi data:20Gi 192.168.0.13/192.168.0.13 Feb 12,2026 12:29 UTC+0800 mongodb-eflsbm-mongodb-3 default mongodb-eflsbm mongodb Running secondary cn-guangzhou-b 100m / 100m 512Mi / 512Mi data:20Gi 192.168.0.199/192.168.0.199 Feb 12,2026 12:14 UTC+0800 check pod status done check cluster role check cluster role done primary: mongodb-eflsbm-mongodb-0;secondary: mongodb-eflsbm-mongodb-2 mongodb-eflsbm-mongodb-3 `kubectl get secrets -l app.kubernetes.io/instance=mongodb-eflsbm` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.username}"` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.password}"` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.port}"` DB_USERNAME:root;DB_PASSWORD:403nfj8Y0jh2R14x;DB_PORT:27017;DB_DATABASE: No resources found in default namespace. check cluster connect `echo " echo \"\" | mongo --host mongodb-eflsbm-mongodb-mongodb.default.svc.cluster.local --port 27017 -u root -p 403nfj8Y0jh2R14x --authenticationDatabase admin admin " | kubectl exec -it mongodb-eflsbm-mongodb-0 --namespace default -- bash` check cluster connect done check ops status `kbcli cluster list-ops mongodb-eflsbm --status all --namespace default ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME mongodb-eflsbm-hscaleoninstance-mn7cq default HorizontalScaling mongodb-eflsbm mongodb Succeed 1/1 Feb 12,2026 12:29 UTC+0800 check ops status done ops_status:mongodb-eflsbm-hscaleoninstance-mn7cq default HorizontalScaling mongodb-eflsbm mongodb Succeed 1/1 Feb 12,2026 12:29 UTC+0800 `kubectl patch -p '{"metadata":{"finalizers":[]}}' --type=merge opsrequests.operations mongodb-eflsbm-hscaleoninstance-mn7cq --namespace default ` opsrequest.operations.kubeblocks.io/mongodb-eflsbm-hscaleoninstance-mn7cq patched `kbcli cluster delete-ops --name mongodb-eflsbm-hscaleoninstance-mn7cq --force --auto-approve --namespace default ` OpsRequest mongodb-eflsbm-hscaleoninstance-mn7cq deleted `kubectl get secrets -l app.kubernetes.io/instance=mongodb-eflsbm` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.username}"` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.password}"` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.port}"` DB_USERNAME:root;DB_PASSWORD:403nfj8Y0jh2R14x;DB_PORT:27017;DB_DATABASE: No resources found in default namespace. `echo "echo \"db.col.find()\" | mongo --host mongodb-eflsbm-mongodb-mongodb.default.svc.cluster.local --port 27017 -u root -p 403nfj8Y0jh2R14x --authenticationDatabase admin admin " | kubectl exec -it mongodb-eflsbm-mongodb-0 --namespace default -- bash ` check data: Defaulted container "mongodb" out of: mongodb, mongodb-backup-agent, exporter, kbagent, init-syncer (init), init-kubectl (init), init-pbm-agent (init), init-kbagent (init), kbagent-worker (init) Unable to use a TTY - input is not a terminal or the right kind of file Percona Server for MongoDB shell version v4.4.29-28 connecting to: mongodb://mongodb-eflsbm-mongodb-mongodb.default.svc.cluster.local:27017/admin?authSource=admin&compressors=disabled&gssapiServiceName=mongodb Implicit session: session { "id" : UUID("5d8420cd-36d2-453c-9963-8c0302978b21") } Percona Server for MongoDB server version: v4.4.29-28 { "_id" : ObjectId("698d539a50ef62d9286bd4cf"), "a" : "nelsi" } bye check cluster data consistent Success `kubectl get secrets -l app.kubernetes.io/instance=mongodb-eflsbm` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.username}"` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.password}"` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.port}"` DB_USERNAME:root;DB_PASSWORD:403nfj8Y0jh2R14x;DB_PORT:27017;DB_DATABASE: No resources found in default namespace. `echo "echo \"db.col.find().readPref('secondary')\" | mongo --host mongodb-eflsbm-mongodb-mongodb-ro.default.svc.cluster.local --port 27017 -u root -p 403nfj8Y0jh2R14x --authenticationDatabase admin admin " | kubectl exec -it mongodb-eflsbm-mongodb-2 --namespace default -- bash ` check readonly data: Defaulted container "mongodb" out of: mongodb, mongodb-backup-agent, exporter, kbagent, init-syncer (init), init-kubectl (init), init-pbm-agent (init), init-kbagent (init), kbagent-worker (init) Unable to use a TTY - input is not a terminal or the right kind of file Percona Server for MongoDB shell version v4.4.29-28 connecting to: mongodb://mongodb-eflsbm-mongodb-mongodb-ro.default.svc.cluster.local:27017/admin?authSource=admin&compressors=disabled&gssapiServiceName=mongodb Implicit session: session { "id" : UUID("d40d86be-9fba-4f15-be1e-4b6496b1d0d3") } Percona Server for MongoDB server version: v4.4.29-28 { "_id" : ObjectId("698d539a50ef62d9286bd4cf"), "a" : "nelsi" } bye check cluster readonly data consistent Success `kubectl get secrets -l app.kubernetes.io/instance=mongodb-eflsbm` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.username}"` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.password}"` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.port}"` DB_USERNAME:root;DB_PASSWORD:403nfj8Y0jh2R14x;DB_PORT:27017;DB_DATABASE: No resources found in default namespace. check db_client batch data count `echo "echo \"db.executions_loop_table.estimatedDocumentCount();\" | mongo --host mongodb-eflsbm-mongodb-mongodb.default.svc.cluster.local --port 27017 -u root -p 403nfj8Y0jh2R14x --authenticationDatabase admin admin " | kubectl exec -it mongodb-eflsbm-mongodb-0 --namespace default -- bash ` check db_client batch [23154] equal [23154] data Success cluster stop check cluster status before ops check cluster status done cluster_status:Running `kbcli cluster stop mongodb-eflsbm --auto-approve --force=true --namespace default ` OpsRequest mongodb-eflsbm-stop-c8k98 created successfully, you can view the progress: kbcli cluster describe-ops mongodb-eflsbm-stop-c8k98 -n default check ops status `kbcli cluster list-ops mongodb-eflsbm --status all --namespace default ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME mongodb-eflsbm-stop-c8k98 default Stop mongodb-eflsbm mongodb Running 0/3 Feb 12,2026 12:30 UTC+0800 check cluster status `kbcli cluster list mongodb-eflsbm --show-labels --namespace default ` NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS mongodb-eflsbm default mongodb WipeOut Stopping Feb 12,2026 12:11 UTC+0800 app.kubernetes.io/instance=mongodb-eflsbm,clusterdefinition.kubeblocks.io/name=mongodb cluster_status:Stopping cluster_status:Stopping check cluster status done cluster_status:Stopped check pod status `kbcli cluster list-instances mongodb-eflsbm --namespace default ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME check pod status done check ops status `kbcli cluster list-ops mongodb-eflsbm --status all --namespace default ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME mongodb-eflsbm-stop-c8k98 default Stop mongodb-eflsbm mongodb Succeed 3/3 Feb 12,2026 12:30 UTC+0800 check ops status done ops_status:mongodb-eflsbm-stop-c8k98 default Stop mongodb-eflsbm mongodb Succeed 3/3 Feb 12,2026 12:30 UTC+0800 `kubectl patch -p '{"metadata":{"finalizers":[]}}' --type=merge opsrequests.operations mongodb-eflsbm-stop-c8k98 --namespace default ` opsrequest.operations.kubeblocks.io/mongodb-eflsbm-stop-c8k98 patched `kbcli cluster delete-ops --name mongodb-eflsbm-stop-c8k98 --force --auto-approve --namespace default ` OpsRequest mongodb-eflsbm-stop-c8k98 deleted cluster start check cluster status before ops check cluster status done cluster_status:Stopped `kbcli cluster start mongodb-eflsbm --force=true --namespace default ` OpsRequest mongodb-eflsbm-start-wlhnx created successfully, you can view the progress: kbcli cluster describe-ops mongodb-eflsbm-start-wlhnx -n default check ops status `kbcli cluster list-ops mongodb-eflsbm --status all --namespace default ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME mongodb-eflsbm-start-wlhnx default Start mongodb-eflsbm mongodb Running 0/3 Feb 12,2026 12:30 UTC+0800 check cluster status `kbcli cluster list mongodb-eflsbm --show-labels --namespace default ` NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS mongodb-eflsbm default mongodb WipeOut Updating Feb 12,2026 12:11 UTC+0800 app.kubernetes.io/instance=mongodb-eflsbm,clusterdefinition.kubeblocks.io/name=mongodb cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances mongodb-eflsbm --namespace default ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME mongodb-eflsbm-mongodb-0 default mongodb-eflsbm mongodb Running primary cn-guangzhou-b 100m / 100m 512Mi / 512Mi data:20Gi 192.168.0.13/192.168.0.13 Feb 12,2026 12:30 UTC+0800 mongodb-eflsbm-mongodb-2 default mongodb-eflsbm mongodb Running secondary cn-guangzhou-b 100m / 100m 512Mi / 512Mi data:20Gi 192.168.0.199/192.168.0.199 Feb 12,2026 12:30 UTC+0800 mongodb-eflsbm-mongodb-3 default mongodb-eflsbm mongodb Running secondary cn-guangzhou-b 100m / 100m 512Mi / 512Mi data:20Gi 192.168.0.159/192.168.0.159 Feb 12,2026 12:31 UTC+0800 check pod status done check cluster role check cluster role done primary: mongodb-eflsbm-mongodb-0;secondary: mongodb-eflsbm-mongodb-2 mongodb-eflsbm-mongodb-3 `kubectl get secrets -l app.kubernetes.io/instance=mongodb-eflsbm` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.username}"` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.password}"` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.port}"` DB_USERNAME:root;DB_PASSWORD:403nfj8Y0jh2R14x;DB_PORT:27017;DB_DATABASE: No resources found in default namespace. check cluster connect `echo " echo \"\" | mongo --host mongodb-eflsbm-mongodb-mongodb.default.svc.cluster.local --port 27017 -u root -p 403nfj8Y0jh2R14x --authenticationDatabase admin admin " | kubectl exec -it mongodb-eflsbm-mongodb-0 --namespace default -- bash` check cluster connect done check ops status `kbcli cluster list-ops mongodb-eflsbm --status all --namespace default ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME mongodb-eflsbm-start-wlhnx default Start mongodb-eflsbm mongodb Succeed 3/3 Feb 12,2026 12:30 UTC+0800 check ops status done ops_status:mongodb-eflsbm-start-wlhnx default Start mongodb-eflsbm mongodb Succeed 3/3 Feb 12,2026 12:30 UTC+0800 `kubectl patch -p '{"metadata":{"finalizers":[]}}' --type=merge opsrequests.operations mongodb-eflsbm-start-wlhnx --namespace default ` opsrequest.operations.kubeblocks.io/mongodb-eflsbm-start-wlhnx patched `kbcli cluster delete-ops --name mongodb-eflsbm-start-wlhnx --force --auto-approve --namespace default ` OpsRequest mongodb-eflsbm-start-wlhnx deleted `kubectl get secrets -l app.kubernetes.io/instance=mongodb-eflsbm` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.username}"` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.password}"` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.port}"` DB_USERNAME:root;DB_PASSWORD:403nfj8Y0jh2R14x;DB_PORT:27017;DB_DATABASE: No resources found in default namespace. `echo "echo \"db.col.find()\" | mongo --host mongodb-eflsbm-mongodb-mongodb.default.svc.cluster.local --port 27017 -u root -p 403nfj8Y0jh2R14x --authenticationDatabase admin admin " | kubectl exec -it mongodb-eflsbm-mongodb-0 --namespace default -- bash ` check data: Defaulted container "mongodb" out of: mongodb, mongodb-backup-agent, exporter, kbagent, init-syncer (init), init-kubectl (init), init-pbm-agent (init), init-kbagent (init), kbagent-worker (init) Unable to use a TTY - input is not a terminal or the right kind of file Percona Server for MongoDB shell version v4.4.29-28 connecting to: mongodb://mongodb-eflsbm-mongodb-mongodb.default.svc.cluster.local:27017/admin?authSource=admin&compressors=disabled&gssapiServiceName=mongodb Implicit session: session { "id" : UUID("5c019d6a-788e-40b0-bd05-f1e9b4f8286f") } Percona Server for MongoDB server version: v4.4.29-28 { "_id" : ObjectId("698d539a50ef62d9286bd4cf"), "a" : "nelsi" } bye check cluster data consistent Success `kubectl get secrets -l app.kubernetes.io/instance=mongodb-eflsbm` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.username}"` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.password}"` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.port}"` DB_USERNAME:root;DB_PASSWORD:403nfj8Y0jh2R14x;DB_PORT:27017;DB_DATABASE: No resources found in default namespace. `echo "echo \"db.col.find().readPref('secondary')\" | mongo --host mongodb-eflsbm-mongodb-mongodb-ro.default.svc.cluster.local --port 27017 -u root -p 403nfj8Y0jh2R14x --authenticationDatabase admin admin " | kubectl exec -it mongodb-eflsbm-mongodb-2 --namespace default -- bash ` check readonly data: Defaulted container "mongodb" out of: mongodb, mongodb-backup-agent, exporter, kbagent, init-syncer (init), init-kubectl (init), init-pbm-agent (init), init-kbagent (init), kbagent-worker (init) Unable to use a TTY - input is not a terminal or the right kind of file Percona Server for MongoDB shell version v4.4.29-28 connecting to: mongodb://mongodb-eflsbm-mongodb-mongodb-ro.default.svc.cluster.local:27017/admin?authSource=admin&compressors=disabled&gssapiServiceName=mongodb Implicit session: session { "id" : UUID("7f6eb939-60d5-4005-bc1c-cf4e3be86812") } Percona Server for MongoDB server version: v4.4.29-28 { "_id" : ObjectId("698d539a50ef62d9286bd4cf"), "a" : "nelsi" } bye check cluster readonly data consistent Success `kubectl get secrets -l app.kubernetes.io/instance=mongodb-eflsbm` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.username}"` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.password}"` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.port}"` DB_USERNAME:root;DB_PASSWORD:403nfj8Y0jh2R14x;DB_PORT:27017;DB_DATABASE: No resources found in default namespace. check db_client batch data count `echo "echo \"db.executions_loop_table.estimatedDocumentCount();\" | mongo --host mongodb-eflsbm-mongodb-mongodb.default.svc.cluster.local --port 27017 -u root -p 403nfj8Y0jh2R14x --authenticationDatabase admin admin " | kubectl exec -it mongodb-eflsbm-mongodb-0 --namespace default -- bash ` check db_client batch [23154] equal [23154] data Success test failover podfailure check cluster status before cluster-failover-podfailure check cluster status done cluster_status:Running `kubectl patch -p '{"metadata":{"finalizers":[]}}' --type=merge PodChaos test-chaos-mesh-podfailure-mongodb-eflsbm --namespace default ` Warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely. Error from server (NotFound): podchaos.chaos-mesh.org "test-chaos-mesh-podfailure-mongodb-eflsbm" not found apiVersion: chaos-mesh.org/v1alpha1 kind: PodChaos metadata: name: test-chaos-mesh-podfailure-mongodb-eflsbm namespace: default spec: selector: namespaces: - default labelSelectors: apps.kubeblocks.io/pod-name: mongodb-eflsbm-mongodb-0 mode: all action: pod-failure duration: 2m `kubectl apply -f test-chaos-mesh-podfailure-mongodb-eflsbm.yaml` Error from server (NotFound): podchaos.chaos-mesh.org "test-chaos-mesh-podfailure-mongodb-eflsbm" not found podchaos.chaos-mesh.org/test-chaos-mesh-podfailure-mongodb-eflsbm created apply test-chaos-mesh-podfailure-mongodb-eflsbm.yaml Success `rm -rf test-chaos-mesh-podfailure-mongodb-eflsbm.yaml` podfailure chaos test waiting 120 seconds check cluster status `kbcli cluster list mongodb-eflsbm --show-labels --namespace default ` NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS mongodb-eflsbm default mongodb WipeOut Failed Feb 12,2026 12:11 UTC+0800 app.kubernetes.io/instance=mongodb-eflsbm,clusterdefinition.kubeblocks.io/name=mongodb cluster_status:Failed cluster_status:Updating check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances mongodb-eflsbm --namespace default ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME mongodb-eflsbm-mongodb-0 default mongodb-eflsbm mongodb Running primary cn-guangzhou-b 100m / 100m 512Mi / 512Mi data:20Gi 192.168.0.13/192.168.0.13 Feb 12,2026 12:30 UTC+0800 mongodb-eflsbm-mongodb-2 default mongodb-eflsbm mongodb Running secondary cn-guangzhou-b 100m / 100m 512Mi / 512Mi data:20Gi 192.168.0.199/192.168.0.199 Feb 12,2026 12:30 UTC+0800 mongodb-eflsbm-mongodb-3 default mongodb-eflsbm mongodb Running primary cn-guangzhou-b 100m / 100m 512Mi / 512Mi data:20Gi 192.168.0.159/192.168.0.159 Feb 12,2026 12:31 UTC+0800 check pod status done check cluster role primary: mongodb-eflsbm-mongodb-0 mongodb-eflsbm-mongodb-3;secondary: mongodb-eflsbm-mongodb-2 check cluster role done primary: mongodb-eflsbm-mongodb-3;secondary: mongodb-eflsbm-mongodb-0 mongodb-eflsbm-mongodb-2 `kubectl get secrets -l app.kubernetes.io/instance=mongodb-eflsbm` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.username}"` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.password}"` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.port}"` DB_USERNAME:root;DB_PASSWORD:403nfj8Y0jh2R14x;DB_PORT:27017;DB_DATABASE: No resources found in default namespace. check cluster connect `echo " echo \"\" | mongo --host mongodb-eflsbm-mongodb-mongodb.default.svc.cluster.local --port 27017 -u root -p 403nfj8Y0jh2R14x --authenticationDatabase admin admin " | kubectl exec -it mongodb-eflsbm-mongodb-3 --namespace default -- bash` check cluster connect done `kubectl patch -p '{"metadata":{"finalizers":[]}}' --type=merge PodChaos test-chaos-mesh-podfailure-mongodb-eflsbm --namespace default ` Warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely. podchaos.chaos-mesh.org "test-chaos-mesh-podfailure-mongodb-eflsbm" force deleted Error from server (NotFound): podchaos.chaos-mesh.org "test-chaos-mesh-podfailure-mongodb-eflsbm" not found check failover pod name failover pod name:mongodb-eflsbm-mongodb-3 failover podfailure Success `kubectl get secrets -l app.kubernetes.io/instance=mongodb-eflsbm` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.username}"` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.password}"` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.port}"` DB_USERNAME:root;DB_PASSWORD:403nfj8Y0jh2R14x;DB_PORT:27017;DB_DATABASE: No resources found in default namespace. `echo "echo \"db.col.find()\" | mongo --host mongodb-eflsbm-mongodb-mongodb.default.svc.cluster.local --port 27017 -u root -p 403nfj8Y0jh2R14x --authenticationDatabase admin admin " | kubectl exec -it mongodb-eflsbm-mongodb-3 --namespace default -- bash ` check data: Defaulted container "mongodb" out of: mongodb, mongodb-backup-agent, exporter, kbagent, init-syncer (init), init-kubectl (init), init-pbm-agent (init), init-kbagent (init), kbagent-worker (init) Unable to use a TTY - input is not a terminal or the right kind of file Percona Server for MongoDB shell version v4.4.29-28 connecting to: mongodb://mongodb-eflsbm-mongodb-mongodb.default.svc.cluster.local:27017/admin?authSource=admin&compressors=disabled&gssapiServiceName=mongodb Implicit session: session { "id" : UUID("57f76234-badf-43fe-ac91-08f982302034") } Percona Server for MongoDB server version: v4.4.29-28 { "_id" : ObjectId("698d539a50ef62d9286bd4cf"), "a" : "nelsi" } bye check cluster data consistent Success `kubectl get secrets -l app.kubernetes.io/instance=mongodb-eflsbm` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.username}"` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.password}"` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.port}"` DB_USERNAME:root;DB_PASSWORD:403nfj8Y0jh2R14x;DB_PORT:27017;DB_DATABASE: No resources found in default namespace. `echo "echo \"db.col.find().readPref('secondary')\" | mongo --host mongodb-eflsbm-mongodb-mongodb-ro.default.svc.cluster.local --port 27017 -u root -p 403nfj8Y0jh2R14x --authenticationDatabase admin admin " | kubectl exec -it mongodb-eflsbm-mongodb-0 --namespace default -- bash ` check readonly data: Defaulted container "mongodb" out of: mongodb, mongodb-backup-agent, exporter, kbagent, init-syncer (init), init-kubectl (init), init-pbm-agent (init), init-kbagent (init), kbagent-worker (init) Unable to use a TTY - input is not a terminal or the right kind of file Percona Server for MongoDB shell version v4.4.29-28 connecting to: mongodb://mongodb-eflsbm-mongodb-mongodb-ro.default.svc.cluster.local:27017/admin?authSource=admin&compressors=disabled&gssapiServiceName=mongodb Implicit session: session { "id" : UUID("6eb87315-2f64-4976-ae2d-2296f264793b") } Percona Server for MongoDB server version: v4.4.29-28 { "_id" : ObjectId("698d539a50ef62d9286bd4cf"), "a" : "nelsi" } bye check cluster readonly data consistent Success `kubectl get secrets -l app.kubernetes.io/instance=mongodb-eflsbm` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.username}"` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.password}"` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.port}"` DB_USERNAME:root;DB_PASSWORD:403nfj8Y0jh2R14x;DB_PORT:27017;DB_DATABASE: No resources found in default namespace. check db_client batch data count `echo "echo \"db.executions_loop_table.estimatedDocumentCount();\" | mongo --host mongodb-eflsbm-mongodb-mongodb.default.svc.cluster.local --port 27017 -u root -p 403nfj8Y0jh2R14x --authenticationDatabase admin admin " | kubectl exec -it mongodb-eflsbm-mongodb-3 --namespace default -- bash ` check db_client batch [23154] equal [23154] data Success `kubectl get pvc -l app.kubernetes.io/instance=mongodb-eflsbm,apps.kubeblocks.io/component-name=mongodb,apps.kubeblocks.io/vct-name=data --namespace default ` cluster volume-expand check cluster status before ops check cluster status done cluster_status:Running No resources found in mongodb-eflsbm namespace. `kbcli cluster volume-expand mongodb-eflsbm --auto-approve --force=true --components mongodb --volume-claim-templates data --storage 25Gi --namespace default ` OpsRequest mongodb-eflsbm-volumeexpansion-9j2k7 created successfully, you can view the progress: kbcli cluster describe-ops mongodb-eflsbm-volumeexpansion-9j2k7 -n default check ops status `kbcli cluster list-ops mongodb-eflsbm --status all --namespace default ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME mongodb-eflsbm-volumeexpansion-9j2k7 default VolumeExpansion mongodb-eflsbm mongodb Running 0/3 Feb 12,2026 12:34 UTC+0800 check cluster status `kbcli cluster list mongodb-eflsbm --show-labels --namespace default ` NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS mongodb-eflsbm default mongodb WipeOut Updating Feb 12,2026 12:11 UTC+0800 app.kubernetes.io/instance=mongodb-eflsbm,clusterdefinition.kubeblocks.io/name=mongodb cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances mongodb-eflsbm --namespace default ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME mongodb-eflsbm-mongodb-0 default mongodb-eflsbm mongodb Running secondary cn-guangzhou-b 100m / 100m 512Mi / 512Mi data:25Gi 192.168.0.13/192.168.0.13 Feb 12,2026 12:30 UTC+0800 mongodb-eflsbm-mongodb-2 default mongodb-eflsbm mongodb Running secondary cn-guangzhou-b 100m / 100m 512Mi / 512Mi data:25Gi 192.168.0.199/192.168.0.199 Feb 12,2026 12:30 UTC+0800 mongodb-eflsbm-mongodb-3 default mongodb-eflsbm mongodb Running primary cn-guangzhou-b 100m / 100m 512Mi / 512Mi data:25Gi 192.168.0.159/192.168.0.159 Feb 12,2026 12:31 UTC+0800 check pod status done check cluster role check cluster role done primary: mongodb-eflsbm-mongodb-3;secondary: mongodb-eflsbm-mongodb-0 mongodb-eflsbm-mongodb-2 `kubectl get secrets -l app.kubernetes.io/instance=mongodb-eflsbm` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.username}"` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.password}"` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.port}"` DB_USERNAME:root;DB_PASSWORD:403nfj8Y0jh2R14x;DB_PORT:27017;DB_DATABASE: No resources found in default namespace. check cluster connect `echo " echo \"\" | mongo --host mongodb-eflsbm-mongodb-mongodb.default.svc.cluster.local --port 27017 -u root -p 403nfj8Y0jh2R14x --authenticationDatabase admin admin " | kubectl exec -it mongodb-eflsbm-mongodb-3 --namespace default -- bash` check cluster connect done No resources found in mongodb-eflsbm namespace. check ops status `kbcli cluster list-ops mongodb-eflsbm --status all --namespace default ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME mongodb-eflsbm-volumeexpansion-9j2k7 default VolumeExpansion mongodb-eflsbm mongodb Succeed 3/3 Feb 12,2026 12:34 UTC+0800 check ops status done ops_status:mongodb-eflsbm-volumeexpansion-9j2k7 default VolumeExpansion mongodb-eflsbm mongodb Succeed 3/3 Feb 12,2026 12:34 UTC+0800 `kubectl patch -p '{"metadata":{"finalizers":[]}}' --type=merge opsrequests.operations mongodb-eflsbm-volumeexpansion-9j2k7 --namespace default ` opsrequest.operations.kubeblocks.io/mongodb-eflsbm-volumeexpansion-9j2k7 patched `kbcli cluster delete-ops --name mongodb-eflsbm-volumeexpansion-9j2k7 --force --auto-approve --namespace default ` OpsRequest mongodb-eflsbm-volumeexpansion-9j2k7 deleted `kubectl get secrets -l app.kubernetes.io/instance=mongodb-eflsbm` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.username}"` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.password}"` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.port}"` DB_USERNAME:root;DB_PASSWORD:403nfj8Y0jh2R14x;DB_PORT:27017;DB_DATABASE: No resources found in default namespace. `echo "echo \"db.col.find()\" | mongo --host mongodb-eflsbm-mongodb-mongodb.default.svc.cluster.local --port 27017 -u root -p 403nfj8Y0jh2R14x --authenticationDatabase admin admin " | kubectl exec -it mongodb-eflsbm-mongodb-3 --namespace default -- bash ` check data: Defaulted container "mongodb" out of: mongodb, mongodb-backup-agent, exporter, kbagent, init-syncer (init), init-kubectl (init), init-pbm-agent (init), init-kbagent (init), kbagent-worker (init) Unable to use a TTY - input is not a terminal or the right kind of file Percona Server for MongoDB shell version v4.4.29-28 connecting to: mongodb://mongodb-eflsbm-mongodb-mongodb.default.svc.cluster.local:27017/admin?authSource=admin&compressors=disabled&gssapiServiceName=mongodb Implicit session: session { "id" : UUID("355eab83-38e3-4711-bdb2-b61c0ee813c0") } Percona Server for MongoDB server version: v4.4.29-28 { "_id" : ObjectId("698d539a50ef62d9286bd4cf"), "a" : "nelsi" } bye check cluster data consistent Success `kubectl get secrets -l app.kubernetes.io/instance=mongodb-eflsbm` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.username}"` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.password}"` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.port}"` DB_USERNAME:root;DB_PASSWORD:403nfj8Y0jh2R14x;DB_PORT:27017;DB_DATABASE: No resources found in default namespace. `echo "echo \"db.col.find().readPref('secondary')\" | mongo --host mongodb-eflsbm-mongodb-mongodb-ro.default.svc.cluster.local --port 27017 -u root -p 403nfj8Y0jh2R14x --authenticationDatabase admin admin " | kubectl exec -it mongodb-eflsbm-mongodb-0 --namespace default -- bash ` check readonly data: Defaulted container "mongodb" out of: mongodb, mongodb-backup-agent, exporter, kbagent, init-syncer (init), init-kubectl (init), init-pbm-agent (init), init-kbagent (init), kbagent-worker (init) Unable to use a TTY - input is not a terminal or the right kind of file Percona Server for MongoDB shell version v4.4.29-28 connecting to: mongodb://mongodb-eflsbm-mongodb-mongodb-ro.default.svc.cluster.local:27017/admin?authSource=admin&compressors=disabled&gssapiServiceName=mongodb Implicit session: session { "id" : UUID("fccb0f3b-affe-42ea-8286-7537eb7c2a7a") } Percona Server for MongoDB server version: v4.4.29-28 { "_id" : ObjectId("698d539a50ef62d9286bd4cf"), "a" : "nelsi" } bye check cluster readonly data consistent Success `kubectl get secrets -l app.kubernetes.io/instance=mongodb-eflsbm` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.username}"` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.password}"` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.port}"` DB_USERNAME:root;DB_PASSWORD:403nfj8Y0jh2R14x;DB_PORT:27017;DB_DATABASE: No resources found in default namespace. check db_client batch data count `echo "echo \"db.executions_loop_table.estimatedDocumentCount();\" | mongo --host mongodb-eflsbm-mongodb-mongodb.default.svc.cluster.local --port 27017 -u root -p 403nfj8Y0jh2R14x --authenticationDatabase admin admin " | kubectl exec -it mongodb-eflsbm-mongodb-3 --namespace default -- bash ` check db_client batch [23154] equal [23154] data Success test failover dnserror check cluster status before cluster-failover-dnserror check cluster status done cluster_status:Running `kubectl patch -p '{"metadata":{"finalizers":[]}}' --type=merge DNSChaos test-chaos-mesh-dnserror-mongodb-eflsbm --namespace default ` Warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely. Error from server (NotFound): dnschaos.chaos-mesh.org "test-chaos-mesh-dnserror-mongodb-eflsbm" not found Error from server (NotFound): dnschaos.chaos-mesh.org "test-chaos-mesh-dnserror-mongodb-eflsbm" not found apiVersion: chaos-mesh.org/v1alpha1 kind: DNSChaos metadata: name: test-chaos-mesh-dnserror-mongodb-eflsbm namespace: default spec: selector: namespaces: - default labelSelectors: apps.kubeblocks.io/pod-name: mongodb-eflsbm-mongodb-3 mode: all action: error duration: 2m `kubectl apply -f test-chaos-mesh-dnserror-mongodb-eflsbm.yaml` dnschaos.chaos-mesh.org/test-chaos-mesh-dnserror-mongodb-eflsbm created apply test-chaos-mesh-dnserror-mongodb-eflsbm.yaml Success `rm -rf test-chaos-mesh-dnserror-mongodb-eflsbm.yaml` dnserror chaos test waiting 120 seconds check cluster status `kbcli cluster list mongodb-eflsbm --show-labels --namespace default ` NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS mongodb-eflsbm default mongodb WipeOut Running Feb 12,2026 12:11 UTC+0800 app.kubernetes.io/instance=mongodb-eflsbm,clusterdefinition.kubeblocks.io/name=mongodb check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances mongodb-eflsbm --namespace default ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME mongodb-eflsbm-mongodb-0 default mongodb-eflsbm mongodb Running secondary cn-guangzhou-b 100m / 100m 512Mi / 512Mi data:25Gi 192.168.0.13/192.168.0.13 Feb 12,2026 12:30 UTC+0800 mongodb-eflsbm-mongodb-2 default mongodb-eflsbm mongodb Running secondary cn-guangzhou-b 100m / 100m 512Mi / 512Mi data:25Gi 192.168.0.199/192.168.0.199 Feb 12,2026 12:30 UTC+0800 mongodb-eflsbm-mongodb-3 default mongodb-eflsbm mongodb Running primary cn-guangzhou-b 100m / 100m 512Mi / 512Mi data:25Gi 192.168.0.159/192.168.0.159 Feb 12,2026 12:31 UTC+0800 check pod status done check cluster role check cluster role done primary: mongodb-eflsbm-mongodb-3;secondary: mongodb-eflsbm-mongodb-0 mongodb-eflsbm-mongodb-2 `kubectl get secrets -l app.kubernetes.io/instance=mongodb-eflsbm` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.username}"` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.password}"` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.port}"` DB_USERNAME:root;DB_PASSWORD:403nfj8Y0jh2R14x;DB_PORT:27017;DB_DATABASE: No resources found in default namespace. check cluster connect `echo " echo \"\" | mongo --host mongodb-eflsbm-mongodb-mongodb.default.svc.cluster.local --port 27017 -u root -p 403nfj8Y0jh2R14x --authenticationDatabase admin admin " | kubectl exec -it mongodb-eflsbm-mongodb-3 --namespace default -- bash` check cluster connect done `kubectl patch -p '{"metadata":{"finalizers":[]}}' --type=merge DNSChaos test-chaos-mesh-dnserror-mongodb-eflsbm --namespace default ` Warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely. dnschaos.chaos-mesh.org "test-chaos-mesh-dnserror-mongodb-eflsbm" force deleted Error from server (NotFound): dnschaos.chaos-mesh.org "test-chaos-mesh-dnserror-mongodb-eflsbm" not found check failover pod name failover pod name:mongodb-eflsbm-mongodb-3 failover dnserror Success `kubectl get secrets -l app.kubernetes.io/instance=mongodb-eflsbm` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.username}"` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.password}"` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.port}"` DB_USERNAME:root;DB_PASSWORD:403nfj8Y0jh2R14x;DB_PORT:27017;DB_DATABASE: No resources found in default namespace. `echo "echo \"db.col.find()\" | mongo --host mongodb-eflsbm-mongodb-mongodb.default.svc.cluster.local --port 27017 -u root -p 403nfj8Y0jh2R14x --authenticationDatabase admin admin " | kubectl exec -it mongodb-eflsbm-mongodb-3 --namespace default -- bash ` check data: Defaulted container "mongodb" out of: mongodb, mongodb-backup-agent, exporter, kbagent, init-syncer (init), init-kubectl (init), init-pbm-agent (init), init-kbagent (init), kbagent-worker (init) Unable to use a TTY - input is not a terminal or the right kind of file Percona Server for MongoDB shell version v4.4.29-28 connecting to: mongodb://mongodb-eflsbm-mongodb-mongodb.default.svc.cluster.local:27017/admin?authSource=admin&compressors=disabled&gssapiServiceName=mongodb Implicit session: session { "id" : UUID("84016600-cce6-4ba1-a338-8325ccfec4f2") } Percona Server for MongoDB server version: v4.4.29-28 { "_id" : ObjectId("698d539a50ef62d9286bd4cf"), "a" : "nelsi" } bye check cluster data consistent Success `kubectl get secrets -l app.kubernetes.io/instance=mongodb-eflsbm` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.username}"` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.password}"` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.port}"` DB_USERNAME:root;DB_PASSWORD:403nfj8Y0jh2R14x;DB_PORT:27017;DB_DATABASE: No resources found in default namespace. `echo "echo \"db.col.find().readPref('secondary')\" | mongo --host mongodb-eflsbm-mongodb-mongodb-ro.default.svc.cluster.local --port 27017 -u root -p 403nfj8Y0jh2R14x --authenticationDatabase admin admin " | kubectl exec -it mongodb-eflsbm-mongodb-0 --namespace default -- bash ` check readonly data: Defaulted container "mongodb" out of: mongodb, mongodb-backup-agent, exporter, kbagent, init-syncer (init), init-kubectl (init), init-pbm-agent (init), init-kbagent (init), kbagent-worker (init) Unable to use a TTY - input is not a terminal or the right kind of file Percona Server for MongoDB shell version v4.4.29-28 connecting to: mongodb://mongodb-eflsbm-mongodb-mongodb-ro.default.svc.cluster.local:27017/admin?authSource=admin&compressors=disabled&gssapiServiceName=mongodb Implicit session: session { "id" : UUID("2adf6fd1-4980-4f57-999e-3d0b350b2798") } Percona Server for MongoDB server version: v4.4.29-28 { "_id" : ObjectId("698d539a50ef62d9286bd4cf"), "a" : "nelsi" } bye check cluster readonly data consistent Success `kubectl get secrets -l app.kubernetes.io/instance=mongodb-eflsbm` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.username}"` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.password}"` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.port}"` DB_USERNAME:root;DB_PASSWORD:403nfj8Y0jh2R14x;DB_PORT:27017;DB_DATABASE: No resources found in default namespace. check db_client batch data count `echo "echo \"db.executions_loop_table.estimatedDocumentCount();\" | mongo --host mongodb-eflsbm-mongodb-mongodb.default.svc.cluster.local --port 27017 -u root -p 403nfj8Y0jh2R14x --authenticationDatabase admin admin " | kubectl exec -it mongodb-eflsbm-mongodb-3 --namespace default -- bash ` check db_client batch [23154] equal [23154] data Success cmpv upgrade service version:3,4.4.29|3,5.0.29|3,6.0.27|3,7.0.28|3,8.0.17 set latest cmpv service version latest service version:4.4.29 cmpv service version upgrade and downgrade check cluster status before ops check cluster status done cluster_status:Running `kbcli cluster vscale mongodb-eflsbm --auto-approve --force=true --components mongodb --cpu 200m --memory 0.6Gi --namespace default ` OpsRequest mongodb-eflsbm-verticalscaling-bkmb5 created successfully, you can view the progress: kbcli cluster describe-ops mongodb-eflsbm-verticalscaling-bkmb5 -n default check ops status `kbcli cluster list-ops mongodb-eflsbm --status all --namespace default ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME mongodb-eflsbm-verticalscaling-bkmb5 default VerticalScaling mongodb-eflsbm mongodb Running 0/3 Feb 12,2026 12:37 UTC+0800 check cluster status `kbcli cluster list mongodb-eflsbm --show-labels --namespace default ` NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS mongodb-eflsbm default mongodb WipeOut Updating Feb 12,2026 12:11 UTC+0800 app.kubernetes.io/instance=mongodb-eflsbm,clusterdefinition.kubeblocks.io/name=mongodb cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances mongodb-eflsbm --namespace default ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME mongodb-eflsbm-mongodb-0 default mongodb-eflsbm mongodb Running primary cn-guangzhou-b 200m / 200m 644245094400m / 644245094400m data:25Gi 192.168.0.13/192.168.0.13 Feb 12,2026 12:38 UTC+0800 mongodb-eflsbm-mongodb-2 default mongodb-eflsbm mongodb Running secondary cn-guangzhou-b 200m / 200m 644245094400m / 644245094400m data:25Gi 192.168.0.199/192.168.0.199 Feb 12,2026 12:38 UTC+0800 mongodb-eflsbm-mongodb-3 default mongodb-eflsbm mongodb Running secondary cn-guangzhou-b 200m / 200m 644245094400m / 644245094400m data:25Gi 192.168.0.159/192.168.0.159 Feb 12,2026 12:39 UTC+0800 check pod status done check cluster role check cluster role done primary: mongodb-eflsbm-mongodb-0;secondary: mongodb-eflsbm-mongodb-2 mongodb-eflsbm-mongodb-3 `kubectl get secrets -l app.kubernetes.io/instance=mongodb-eflsbm` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.username}"` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.password}"` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.port}"` DB_USERNAME:root;DB_PASSWORD:403nfj8Y0jh2R14x;DB_PORT:27017;DB_DATABASE: No resources found in default namespace. check cluster connect `echo " echo \"\" | mongo --host mongodb-eflsbm-mongodb-mongodb.default.svc.cluster.local --port 27017 -u root -p 403nfj8Y0jh2R14x --authenticationDatabase admin admin " | kubectl exec -it mongodb-eflsbm-mongodb-0 --namespace default -- bash` check cluster connect done check ops status `kbcli cluster list-ops mongodb-eflsbm --status all --namespace default ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME mongodb-eflsbm-verticalscaling-bkmb5 default VerticalScaling mongodb-eflsbm mongodb Succeed 3/3 Feb 12,2026 12:37 UTC+0800 check ops status done ops_status:mongodb-eflsbm-verticalscaling-bkmb5 default VerticalScaling mongodb-eflsbm mongodb Succeed 3/3 Feb 12,2026 12:37 UTC+0800 `kubectl patch -p '{"metadata":{"finalizers":[]}}' --type=merge opsrequests.operations mongodb-eflsbm-verticalscaling-bkmb5 --namespace default ` opsrequest.operations.kubeblocks.io/mongodb-eflsbm-verticalscaling-bkmb5 patched `kbcli cluster delete-ops --name mongodb-eflsbm-verticalscaling-bkmb5 --force --auto-approve --namespace default ` OpsRequest mongodb-eflsbm-verticalscaling-bkmb5 deleted `kubectl get secrets -l app.kubernetes.io/instance=mongodb-eflsbm` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.username}"` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.password}"` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.port}"` DB_USERNAME:root;DB_PASSWORD:403nfj8Y0jh2R14x;DB_PORT:27017;DB_DATABASE: No resources found in default namespace. `echo "echo \"db.col.find()\" | mongo --host mongodb-eflsbm-mongodb-mongodb.default.svc.cluster.local --port 27017 -u root -p 403nfj8Y0jh2R14x --authenticationDatabase admin admin " | kubectl exec -it mongodb-eflsbm-mongodb-0 --namespace default -- bash ` check data: Defaulted container "mongodb" out of: mongodb, mongodb-backup-agent, exporter, kbagent, init-syncer (init), init-kubectl (init), init-pbm-agent (init), init-kbagent (init), kbagent-worker (init) Unable to use a TTY - input is not a terminal or the right kind of file E0212 12:39:43.776296 43075 websocket.go:296] Unknown stream id 1, discarding message Percona Server for MongoDB shell version v4.4.29-28 connecting to: mongodb://mongodb-eflsbm-mongodb-mongodb.default.svc.cluster.local:27017/admin?authSource=admin&compressors=disabled&gssapiServiceName=mongodb Implicit session: session { "id" : UUID("8927eb45-ef20-4fd3-b9ec-3d196aa67733") } Percona Server for MongoDB server version: v4.4.29-28 { "_id" : ObjectId("698d539a50ef62d9286bd4cf"), "a" : "nelsi" } bye check cluster data consistent Success `kubectl get secrets -l app.kubernetes.io/instance=mongodb-eflsbm` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.username}"` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.password}"` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.port}"` DB_USERNAME:root;DB_PASSWORD:403nfj8Y0jh2R14x;DB_PORT:27017;DB_DATABASE: No resources found in default namespace. `echo "echo \"db.col.find().readPref('secondary')\" | mongo --host mongodb-eflsbm-mongodb-mongodb-ro.default.svc.cluster.local --port 27017 -u root -p 403nfj8Y0jh2R14x --authenticationDatabase admin admin " | kubectl exec -it mongodb-eflsbm-mongodb-2 --namespace default -- bash ` check readonly data: Defaulted container "mongodb" out of: mongodb, mongodb-backup-agent, exporter, kbagent, init-syncer (init), init-kubectl (init), init-pbm-agent (init), init-kbagent (init), kbagent-worker (init) Unable to use a TTY - input is not a terminal or the right kind of file Percona Server for MongoDB shell version v4.4.29-28 connecting to: mongodb://mongodb-eflsbm-mongodb-mongodb-ro.default.svc.cluster.local:27017/admin?authSource=admin&compressors=disabled&gssapiServiceName=mongodb Implicit session: session { "id" : UUID("788406d5-8106-48c0-814f-c912f8d910d5") } Percona Server for MongoDB server version: v4.4.29-28 { "_id" : ObjectId("698d539a50ef62d9286bd4cf"), "a" : "nelsi" } bye check cluster readonly data consistent Success `kubectl get secrets -l app.kubernetes.io/instance=mongodb-eflsbm` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.username}"` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.password}"` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.port}"` DB_USERNAME:root;DB_PASSWORD:403nfj8Y0jh2R14x;DB_PORT:27017;DB_DATABASE: No resources found in default namespace. check db_client batch data count `echo "echo \"db.executions_loop_table.estimatedDocumentCount();\" | mongo --host mongodb-eflsbm-mongodb-mongodb.default.svc.cluster.local --port 27017 -u root -p 403nfj8Y0jh2R14x --authenticationDatabase admin admin " | kubectl exec -it mongodb-eflsbm-mongodb-0 --namespace default -- bash ` check db_client batch [23154] equal [23154] data Success test failover kill1 check cluster status before cluster-failover-kill1 check cluster status done cluster_status:Running `kill 1` Defaulted container "mongodb" out of: mongodb, mongodb-backup-agent, exporter, kbagent, init-syncer (init), init-kubectl (init), init-pbm-agent (init), init-kbagent (init), kbagent-worker (init) Unable to use a TTY - input is not a terminal or the right kind of file exec return message: check cluster status `kbcli cluster list mongodb-eflsbm --show-labels --namespace default ` NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS mongodb-eflsbm default mongodb WipeOut Running Feb 12,2026 12:11 UTC+0800 app.kubernetes.io/instance=mongodb-eflsbm,clusterdefinition.kubeblocks.io/name=mongodb check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances mongodb-eflsbm --namespace default ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME mongodb-eflsbm-mongodb-0 default mongodb-eflsbm mongodb Running primary cn-guangzhou-b 200m / 200m 644245094400m / 644245094400m data:25Gi 192.168.0.13/192.168.0.13 Feb 12,2026 12:38 UTC+0800 mongodb-eflsbm-mongodb-2 default mongodb-eflsbm mongodb Running secondary cn-guangzhou-b 200m / 200m 644245094400m / 644245094400m data:25Gi 192.168.0.199/192.168.0.199 Feb 12,2026 12:38 UTC+0800 mongodb-eflsbm-mongodb-3 default mongodb-eflsbm mongodb Running secondary cn-guangzhou-b 200m / 200m 644245094400m / 644245094400m data:25Gi 192.168.0.159/192.168.0.159 Feb 12,2026 12:39 UTC+0800 check pod status done check cluster role check cluster role done primary: mongodb-eflsbm-mongodb-0;secondary: mongodb-eflsbm-mongodb-2 mongodb-eflsbm-mongodb-3 `kubectl get secrets -l app.kubernetes.io/instance=mongodb-eflsbm` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.username}"` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.password}"` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.port}"` DB_USERNAME:root;DB_PASSWORD:403nfj8Y0jh2R14x;DB_PORT:27017;DB_DATABASE: No resources found in default namespace. check cluster connect `echo " echo \"\" | mongo --host mongodb-eflsbm-mongodb-mongodb.default.svc.cluster.local --port 27017 -u root -p 403nfj8Y0jh2R14x --authenticationDatabase admin admin " | kubectl exec -it mongodb-eflsbm-mongodb-0 --namespace default -- bash` check cluster connect done check failover pod name failover pod name:mongodb-eflsbm-mongodb-0 checking failover... `kill 1` Defaulted container "mongodb" out of: mongodb, mongodb-backup-agent, exporter, kbagent, init-syncer (init), init-kubectl (init), init-pbm-agent (init), init-kbagent (init), kbagent-worker (init) Unable to use a TTY - input is not a terminal or the right kind of file exec return message: check cluster status `kbcli cluster list mongodb-eflsbm --show-labels --namespace default ` NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS mongodb-eflsbm default mongodb WipeOut Running Feb 12,2026 12:11 UTC+0800 app.kubernetes.io/instance=mongodb-eflsbm,clusterdefinition.kubeblocks.io/name=mongodb check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances mongodb-eflsbm --namespace default ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME mongodb-eflsbm-mongodb-0 default mongodb-eflsbm mongodb NotReady primary cn-guangzhou-b 200m / 200m 644245094400m / 644245094400m data:25Gi 192.168.0.13/192.168.0.13 Feb 12,2026 12:38 UTC+0800 mongodb-eflsbm-mongodb-2 default mongodb-eflsbm mongodb Running secondary cn-guangzhou-b 200m / 200m 644245094400m / 644245094400m data:25Gi 192.168.0.199/192.168.0.199 Feb 12,2026 12:38 UTC+0800 mongodb-eflsbm-mongodb-3 default mongodb-eflsbm mongodb Running primary cn-guangzhou-b 200m / 200m 644245094400m / 644245094400m data:25Gi 192.168.0.159/192.168.0.159 Feb 12,2026 12:39 UTC+0800 pod_status:NotReady check pod status done check cluster role primary: mongodb-eflsbm-mongodb-0 mongodb-eflsbm-mongodb-3;secondary: mongodb-eflsbm-mongodb-2 check cluster role done primary: mongodb-eflsbm-mongodb-3;secondary: mongodb-eflsbm-mongodb-0 mongodb-eflsbm-mongodb-2 `kubectl get secrets -l app.kubernetes.io/instance=mongodb-eflsbm` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.username}"` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.password}"` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.port}"` DB_USERNAME:root;DB_PASSWORD:403nfj8Y0jh2R14x;DB_PORT:27017;DB_DATABASE: No resources found in default namespace. check cluster connect `echo " echo \"\" | mongo --host mongodb-eflsbm-mongodb-mongodb.default.svc.cluster.local --port 27017 -u root -p 403nfj8Y0jh2R14x --authenticationDatabase admin admin " | kubectl exec -it mongodb-eflsbm-mongodb-3 --namespace default -- bash` check cluster connect done check failover pod name:mongodb-eflsbm-mongodb-3 failover kill1 Success `kubectl get secrets -l app.kubernetes.io/instance=mongodb-eflsbm` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.username}"` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.password}"` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.port}"` DB_USERNAME:root;DB_PASSWORD:403nfj8Y0jh2R14x;DB_PORT:27017;DB_DATABASE: No resources found in default namespace. `echo "echo \"db.col.find()\" | mongo --host mongodb-eflsbm-mongodb-mongodb.default.svc.cluster.local --port 27017 -u root -p 403nfj8Y0jh2R14x --authenticationDatabase admin admin " | kubectl exec -it mongodb-eflsbm-mongodb-3 --namespace default -- bash ` check data: Defaulted container "mongodb" out of: mongodb, mongodb-backup-agent, exporter, kbagent, init-syncer (init), init-kubectl (init), init-pbm-agent (init), init-kbagent (init), kbagent-worker (init) Unable to use a TTY - input is not a terminal or the right kind of file Percona Server for MongoDB shell version v4.4.29-28 connecting to: mongodb://mongodb-eflsbm-mongodb-mongodb.default.svc.cluster.local:27017/admin?authSource=admin&compressors=disabled&gssapiServiceName=mongodb Implicit session: session { "id" : UUID("256f8947-5837-46d9-a725-9090b8e1e940") } Percona Server for MongoDB server version: v4.4.29-28 { "_id" : ObjectId("698d539a50ef62d9286bd4cf"), "a" : "nelsi" } bye check cluster data consistent Success `kubectl get secrets -l app.kubernetes.io/instance=mongodb-eflsbm` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.username}"` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.password}"` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.port}"` DB_USERNAME:root;DB_PASSWORD:403nfj8Y0jh2R14x;DB_PORT:27017;DB_DATABASE: No resources found in default namespace. `echo "echo \"db.col.find().readPref('secondary')\" | mongo --host mongodb-eflsbm-mongodb-mongodb-ro.default.svc.cluster.local --port 27017 -u root -p 403nfj8Y0jh2R14x --authenticationDatabase admin admin " | kubectl exec -it mongodb-eflsbm-mongodb-0 --namespace default -- bash ` check readonly data: Defaulted container "mongodb" out of: mongodb, mongodb-backup-agent, exporter, kbagent, init-syncer (init), init-kubectl (init), init-pbm-agent (init), init-kbagent (init), kbagent-worker (init) Unable to use a TTY - input is not a terminal or the right kind of file Percona Server for MongoDB shell version v4.4.29-28 connecting to: mongodb://mongodb-eflsbm-mongodb-mongodb-ro.default.svc.cluster.local:27017/admin?authSource=admin&compressors=disabled&gssapiServiceName=mongodb Implicit session: session { "id" : UUID("e86dc3ac-0398-4c22-8074-a9586358ec41") } Percona Server for MongoDB server version: v4.4.29-28 { "_id" : ObjectId("698d539a50ef62d9286bd4cf"), "a" : "nelsi" } bye check cluster readonly data consistent Success `kubectl get secrets -l app.kubernetes.io/instance=mongodb-eflsbm` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.username}"` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.password}"` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.port}"` DB_USERNAME:root;DB_PASSWORD:403nfj8Y0jh2R14x;DB_PORT:27017;DB_DATABASE: No resources found in default namespace. check db_client batch data count `echo "echo \"db.executions_loop_table.estimatedDocumentCount();\" | mongo --host mongodb-eflsbm-mongodb-mongodb.default.svc.cluster.local --port 27017 -u root -p 403nfj8Y0jh2R14x --authenticationDatabase admin admin " | kubectl exec -it mongodb-eflsbm-mongodb-3 --namespace default -- bash ` check db_client batch [23154] equal [23154] data Success test failover podkill check cluster status before cluster-failover-podkill check cluster status done cluster_status:Running `kubectl patch -p '{"metadata":{"finalizers":[]}}' --type=merge PodChaos test-chaos-mesh-podkill-mongodb-eflsbm --namespace default ` Warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely. Error from server (NotFound): podchaos.chaos-mesh.org "test-chaos-mesh-podkill-mongodb-eflsbm" not found Error from server (NotFound): podchaos.chaos-mesh.org "test-chaos-mesh-podkill-mongodb-eflsbm" not found apiVersion: chaos-mesh.org/v1alpha1 kind: PodChaos metadata: name: test-chaos-mesh-podkill-mongodb-eflsbm namespace: default spec: selector: namespaces: - default labelSelectors: apps.kubeblocks.io/pod-name: mongodb-eflsbm-mongodb-3 mode: all action: pod-kill `kubectl apply -f test-chaos-mesh-podkill-mongodb-eflsbm.yaml` podchaos.chaos-mesh.org/test-chaos-mesh-podkill-mongodb-eflsbm created apply test-chaos-mesh-podkill-mongodb-eflsbm.yaml Success `rm -rf test-chaos-mesh-podkill-mongodb-eflsbm.yaml` check cluster status `kbcli cluster list mongodb-eflsbm --show-labels --namespace default ` NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS mongodb-eflsbm default mongodb WipeOut Updating Feb 12,2026 12:11 UTC+0800 app.kubernetes.io/instance=mongodb-eflsbm,clusterdefinition.kubeblocks.io/name=mongodb cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances mongodb-eflsbm --namespace default ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME mongodb-eflsbm-mongodb-0 default mongodb-eflsbm mongodb Running primary cn-guangzhou-b 200m / 200m 644245094400m / 644245094400m data:25Gi 192.168.0.13/192.168.0.13 Feb 12,2026 12:38 UTC+0800 mongodb-eflsbm-mongodb-2 default mongodb-eflsbm mongodb Running secondary cn-guangzhou-b 200m / 200m 644245094400m / 644245094400m data:25Gi 192.168.0.199/192.168.0.199 Feb 12,2026 12:38 UTC+0800 mongodb-eflsbm-mongodb-3 default mongodb-eflsbm mongodb Running secondary cn-guangzhou-b 200m / 200m 644245094400m / 644245094400m data:25Gi 192.168.0.159/192.168.0.159 Feb 12,2026 12:40 UTC+0800 check pod status done check cluster role check cluster role done primary: mongodb-eflsbm-mongodb-0;secondary: mongodb-eflsbm-mongodb-2 mongodb-eflsbm-mongodb-3 `kubectl get secrets -l app.kubernetes.io/instance=mongodb-eflsbm` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.username}"` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.password}"` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.port}"` DB_USERNAME:root;DB_PASSWORD:403nfj8Y0jh2R14x;DB_PORT:27017;DB_DATABASE: No resources found in default namespace. check cluster connect `echo " echo \"\" | mongo --host mongodb-eflsbm-mongodb-mongodb.default.svc.cluster.local --port 27017 -u root -p 403nfj8Y0jh2R14x --authenticationDatabase admin admin " | kubectl exec -it mongodb-eflsbm-mongodb-0 --namespace default -- bash` check cluster connect done `kubectl patch -p '{"metadata":{"finalizers":[]}}' --type=merge PodChaos test-chaos-mesh-podkill-mongodb-eflsbm --namespace default ` Warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely. podchaos.chaos-mesh.org "test-chaos-mesh-podkill-mongodb-eflsbm" force deleted podchaos.chaos-mesh.org/test-chaos-mesh-podkill-mongodb-eflsbm patched check failover pod name failover pod name:mongodb-eflsbm-mongodb-0 failover podkill Success `kubectl get secrets -l app.kubernetes.io/instance=mongodb-eflsbm` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.username}"` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.password}"` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.port}"` DB_USERNAME:root;DB_PASSWORD:403nfj8Y0jh2R14x;DB_PORT:27017;DB_DATABASE: No resources found in default namespace. `echo "echo \"db.col.find()\" | mongo --host mongodb-eflsbm-mongodb-mongodb.default.svc.cluster.local --port 27017 -u root -p 403nfj8Y0jh2R14x --authenticationDatabase admin admin " | kubectl exec -it mongodb-eflsbm-mongodb-0 --namespace default -- bash ` check data: Defaulted container "mongodb" out of: mongodb, mongodb-backup-agent, exporter, kbagent, init-syncer (init), init-kubectl (init), init-pbm-agent (init), init-kbagent (init), kbagent-worker (init) Unable to use a TTY - input is not a terminal or the right kind of file Percona Server for MongoDB shell version v4.4.29-28 connecting to: mongodb://mongodb-eflsbm-mongodb-mongodb.default.svc.cluster.local:27017/admin?authSource=admin&compressors=disabled&gssapiServiceName=mongodb Implicit session: session { "id" : UUID("79b14a81-54ae-4b0c-b00f-e796dfa3988a") } Percona Server for MongoDB server version: v4.4.29-28 { "_id" : ObjectId("698d539a50ef62d9286bd4cf"), "a" : "nelsi" } bye check cluster data consistent Success `kubectl get secrets -l app.kubernetes.io/instance=mongodb-eflsbm` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.username}"` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.password}"` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.port}"` DB_USERNAME:root;DB_PASSWORD:403nfj8Y0jh2R14x;DB_PORT:27017;DB_DATABASE: No resources found in default namespace. `echo "echo \"db.col.find().readPref('secondary')\" | mongo --host mongodb-eflsbm-mongodb-mongodb-ro.default.svc.cluster.local --port 27017 -u root -p 403nfj8Y0jh2R14x --authenticationDatabase admin admin " | kubectl exec -it mongodb-eflsbm-mongodb-2 --namespace default -- bash ` check readonly data: Defaulted container "mongodb" out of: mongodb, mongodb-backup-agent, exporter, kbagent, init-syncer (init), init-kubectl (init), init-pbm-agent (init), init-kbagent (init), kbagent-worker (init) Unable to use a TTY - input is not a terminal or the right kind of file Percona Server for MongoDB shell version v4.4.29-28 connecting to: mongodb://mongodb-eflsbm-mongodb-mongodb-ro.default.svc.cluster.local:27017/admin?authSource=admin&compressors=disabled&gssapiServiceName=mongodb Implicit session: session { "id" : UUID("c078603a-c28d-444c-85e0-d6f3ee2b5e4f") } Percona Server for MongoDB server version: v4.4.29-28 { "_id" : ObjectId("698d539a50ef62d9286bd4cf"), "a" : "nelsi" } bye check cluster readonly data consistent Success `kubectl get secrets -l app.kubernetes.io/instance=mongodb-eflsbm` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.username}"` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.password}"` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.port}"` DB_USERNAME:root;DB_PASSWORD:403nfj8Y0jh2R14x;DB_PORT:27017;DB_DATABASE: No resources found in default namespace. check db_client batch data count `echo "echo \"db.executions_loop_table.estimatedDocumentCount();\" | mongo --host mongodb-eflsbm-mongodb-mongodb.default.svc.cluster.local --port 27017 -u root -p 403nfj8Y0jh2R14x --authenticationDatabase admin admin " | kubectl exec -it mongodb-eflsbm-mongodb-0 --namespace default -- bash ` check db_client batch [23154] equal [23154] data Success test failover networkcorruptover check cluster status before cluster-failover-networkcorruptover check cluster status done cluster_status:Running `kubectl patch -p '{"metadata":{"finalizers":[]}}' --type=merge NetworkChaos test-chaos-mesh-networkcorruptover-mongodb-eflsbm --namespace default ` Warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely. Error from server (NotFound): networkchaos.chaos-mesh.org "test-chaos-mesh-networkcorruptover-mongodb-eflsbm" not found Error from server (NotFound): networkchaos.chaos-mesh.org "test-chaos-mesh-networkcorruptover-mongodb-eflsbm" not found apiVersion: chaos-mesh.org/v1alpha1 kind: NetworkChaos metadata: name: test-chaos-mesh-networkcorruptover-mongodb-eflsbm namespace: default spec: selector: namespaces: - default labelSelectors: apps.kubeblocks.io/pod-name: mongodb-eflsbm-mongodb-0 mode: all action: corrupt corrupt: corrupt: '100' correlation: '100' direction: to duration: 2m `kubectl apply -f test-chaos-mesh-networkcorruptover-mongodb-eflsbm.yaml` networkchaos.chaos-mesh.org/test-chaos-mesh-networkcorruptover-mongodb-eflsbm created apply test-chaos-mesh-networkcorruptover-mongodb-eflsbm.yaml Success `rm -rf test-chaos-mesh-networkcorruptover-mongodb-eflsbm.yaml` networkcorruptover chaos test waiting 120 seconds check cluster status `kbcli cluster list mongodb-eflsbm --show-labels --namespace default ` NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS mongodb-eflsbm default mongodb WipeOut Running Feb 12,2026 12:11 UTC+0800 app.kubernetes.io/instance=mongodb-eflsbm,clusterdefinition.kubeblocks.io/name=mongodb check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances mongodb-eflsbm --namespace default ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME mongodb-eflsbm-mongodb-0 default mongodb-eflsbm mongodb Running primary cn-guangzhou-b 200m / 200m 644245094400m / 644245094400m data:25Gi 192.168.0.13/192.168.0.13 Feb 12,2026 12:38 UTC+0800 mongodb-eflsbm-mongodb-2 default mongodb-eflsbm mongodb Running primary cn-guangzhou-b 200m / 200m 644245094400m / 644245094400m data:25Gi 192.168.0.199/192.168.0.199 Feb 12,2026 12:38 UTC+0800 mongodb-eflsbm-mongodb-3 default mongodb-eflsbm mongodb Running secondary cn-guangzhou-b 200m / 200m 644245094400m / 644245094400m data:25Gi 192.168.0.159/192.168.0.159 Feb 12,2026 12:40 UTC+0800 check pod status done check cluster role primary: mongodb-eflsbm-mongodb-0 mongodb-eflsbm-mongodb-2;secondary: mongodb-eflsbm-mongodb-3 primary: mongodb-eflsbm-mongodb-0 mongodb-eflsbm-mongodb-2;secondary: mongodb-eflsbm-mongodb-3 check cluster role done primary: mongodb-eflsbm-mongodb-2;secondary: mongodb-eflsbm-mongodb-0 mongodb-eflsbm-mongodb-3 `kubectl get secrets -l app.kubernetes.io/instance=mongodb-eflsbm` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.username}"` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.password}"` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.port}"` DB_USERNAME:root;DB_PASSWORD:403nfj8Y0jh2R14x;DB_PORT:27017;DB_DATABASE: No resources found in default namespace. check cluster connect `echo " echo \"\" | mongo --host mongodb-eflsbm-mongodb-mongodb.default.svc.cluster.local --port 27017 -u root -p 403nfj8Y0jh2R14x --authenticationDatabase admin admin " | kubectl exec -it mongodb-eflsbm-mongodb-2 --namespace default -- bash` check cluster connect done `kubectl patch -p '{"metadata":{"finalizers":[]}}' --type=merge NetworkChaos test-chaos-mesh-networkcorruptover-mongodb-eflsbm --namespace default ` Warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely. networkchaos.chaos-mesh.org "test-chaos-mesh-networkcorruptover-mongodb-eflsbm" force deleted Error from server (NotFound): networkchaos.chaos-mesh.org "test-chaos-mesh-networkcorruptover-mongodb-eflsbm" not found check failover pod name failover pod name:mongodb-eflsbm-mongodb-2 failover networkcorruptover Success `kubectl get secrets -l app.kubernetes.io/instance=mongodb-eflsbm` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.username}"` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.password}"` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.port}"` DB_USERNAME:root;DB_PASSWORD:403nfj8Y0jh2R14x;DB_PORT:27017;DB_DATABASE: No resources found in default namespace. `echo "echo \"db.col.find()\" | mongo --host mongodb-eflsbm-mongodb-mongodb.default.svc.cluster.local --port 27017 -u root -p 403nfj8Y0jh2R14x --authenticationDatabase admin admin " | kubectl exec -it mongodb-eflsbm-mongodb-2 --namespace default -- bash ` check data: Defaulted container "mongodb" out of: mongodb, mongodb-backup-agent, exporter, kbagent, init-syncer (init), init-kubectl (init), init-pbm-agent (init), init-kbagent (init), kbagent-worker (init) Unable to use a TTY - input is not a terminal or the right kind of file Percona Server for MongoDB shell version v4.4.29-28 connecting to: mongodb://mongodb-eflsbm-mongodb-mongodb.default.svc.cluster.local:27017/admin?authSource=admin&compressors=disabled&gssapiServiceName=mongodb Implicit session: session { "id" : UUID("201e9a88-d708-4914-b34f-737c8f6cb61f") } Percona Server for MongoDB server version: v4.4.29-28 { "_id" : ObjectId("698d539a50ef62d9286bd4cf"), "a" : "nelsi" } bye check cluster data consistent Success `kubectl get secrets -l app.kubernetes.io/instance=mongodb-eflsbm` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.username}"` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.password}"` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.port}"` DB_USERNAME:root;DB_PASSWORD:403nfj8Y0jh2R14x;DB_PORT:27017;DB_DATABASE: No resources found in default namespace. `echo "echo \"db.col.find().readPref('secondary')\" | mongo --host mongodb-eflsbm-mongodb-mongodb-ro.default.svc.cluster.local --port 27017 -u root -p 403nfj8Y0jh2R14x --authenticationDatabase admin admin " | kubectl exec -it mongodb-eflsbm-mongodb-0 --namespace default -- bash ` check readonly data: Defaulted container "mongodb" out of: mongodb, mongodb-backup-agent, exporter, kbagent, init-syncer (init), init-kubectl (init), init-pbm-agent (init), init-kbagent (init), kbagent-worker (init) Unable to use a TTY - input is not a terminal or the right kind of file Percona Server for MongoDB shell version v4.4.29-28 connecting to: mongodb://mongodb-eflsbm-mongodb-mongodb-ro.default.svc.cluster.local:27017/admin?authSource=admin&compressors=disabled&gssapiServiceName=mongodb Implicit session: session { "id" : UUID("41d55a64-6eb0-40de-903a-451349226e5b") } Percona Server for MongoDB server version: v4.4.29-28 { "_id" : ObjectId("698d539a50ef62d9286bd4cf"), "a" : "nelsi" } bye check cluster readonly data consistent Success `kubectl get secrets -l app.kubernetes.io/instance=mongodb-eflsbm` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.username}"` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.password}"` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.port}"` DB_USERNAME:root;DB_PASSWORD:403nfj8Y0jh2R14x;DB_PORT:27017;DB_DATABASE: No resources found in default namespace. check db_client batch data count `echo "echo \"db.executions_loop_table.estimatedDocumentCount();\" | mongo --host mongodb-eflsbm-mongodb-mongodb.default.svc.cluster.local --port 27017 -u root -p 403nfj8Y0jh2R14x --authenticationDatabase admin admin " | kubectl exec -it mongodb-eflsbm-mongodb-2 --namespace default -- bash ` check db_client batch [23154] equal [23154] data Success cluster restart check cluster status before ops check cluster status done cluster_status:Running `kbcli cluster restart mongodb-eflsbm --auto-approve --force=true --namespace default ` OpsRequest mongodb-eflsbm-restart-nbqn8 created successfully, you can view the progress: kbcli cluster describe-ops mongodb-eflsbm-restart-nbqn8 -n default check ops status `kbcli cluster list-ops mongodb-eflsbm --status all --namespace default ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME mongodb-eflsbm-restart-nbqn8 default Restart mongodb-eflsbm mongodb Running 0/3 Feb 12,2026 12:43 UTC+0800 check cluster status `kbcli cluster list mongodb-eflsbm --show-labels --namespace default ` NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS mongodb-eflsbm default mongodb WipeOut Updating Feb 12,2026 12:11 UTC+0800 app.kubernetes.io/instance=mongodb-eflsbm,clusterdefinition.kubeblocks.io/name=mongodb cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances mongodb-eflsbm --namespace default ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME mongodb-eflsbm-mongodb-0 default mongodb-eflsbm mongodb Running secondary cn-guangzhou-b 200m / 200m 644245094400m / 644245094400m data:25Gi 192.168.0.13/192.168.0.13 Feb 12,2026 12:44 UTC+0800 mongodb-eflsbm-mongodb-2 default mongodb-eflsbm mongodb Running secondary cn-guangzhou-b 200m / 200m 644245094400m / 644245094400m data:25Gi 192.168.0.199/192.168.0.199 Feb 12,2026 12:45 UTC+0800 mongodb-eflsbm-mongodb-3 default mongodb-eflsbm mongodb Running primary cn-guangzhou-b 200m / 200m 644245094400m / 644245094400m data:25Gi 192.168.0.200/192.168.0.200 Feb 12,2026 12:43 UTC+0800 check pod status done check cluster role check cluster role done primary: mongodb-eflsbm-mongodb-3;secondary: mongodb-eflsbm-mongodb-0 mongodb-eflsbm-mongodb-2 `kubectl get secrets -l app.kubernetes.io/instance=mongodb-eflsbm` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.username}"` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.password}"` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.port}"` DB_USERNAME:root;DB_PASSWORD:403nfj8Y0jh2R14x;DB_PORT:27017;DB_DATABASE: No resources found in default namespace. check cluster connect `echo " echo \"\" | mongo --host mongodb-eflsbm-mongodb-mongodb.default.svc.cluster.local --port 27017 -u root -p 403nfj8Y0jh2R14x --authenticationDatabase admin admin " | kubectl exec -it mongodb-eflsbm-mongodb-3 --namespace default -- bash` check cluster connect done check ops status `kbcli cluster list-ops mongodb-eflsbm --status all --namespace default ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME mongodb-eflsbm-restart-nbqn8 default Restart mongodb-eflsbm mongodb Succeed 3/3 Feb 12,2026 12:43 UTC+0800 check ops status done ops_status:mongodb-eflsbm-restart-nbqn8 default Restart mongodb-eflsbm mongodb Succeed 3/3 Feb 12,2026 12:43 UTC+0800 `kubectl patch -p '{"metadata":{"finalizers":[]}}' --type=merge opsrequests.operations mongodb-eflsbm-restart-nbqn8 --namespace default ` opsrequest.operations.kubeblocks.io/mongodb-eflsbm-restart-nbqn8 patched `kbcli cluster delete-ops --name mongodb-eflsbm-restart-nbqn8 --force --auto-approve --namespace default ` OpsRequest mongodb-eflsbm-restart-nbqn8 deleted `kubectl get secrets -l app.kubernetes.io/instance=mongodb-eflsbm` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.username}"` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.password}"` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.port}"` DB_USERNAME:root;DB_PASSWORD:403nfj8Y0jh2R14x;DB_PORT:27017;DB_DATABASE: No resources found in default namespace. `echo "echo \"db.col.find()\" | mongo --host mongodb-eflsbm-mongodb-mongodb.default.svc.cluster.local --port 27017 -u root -p 403nfj8Y0jh2R14x --authenticationDatabase admin admin " | kubectl exec -it mongodb-eflsbm-mongodb-3 --namespace default -- bash ` check data: Defaulted container "mongodb" out of: mongodb, mongodb-backup-agent, exporter, kbagent, init-syncer (init), init-kubectl (init), init-pbm-agent (init), init-kbagent (init), kbagent-worker (init) Unable to use a TTY - input is not a terminal or the right kind of file Percona Server for MongoDB shell version v4.4.29-28 connecting to: mongodb://mongodb-eflsbm-mongodb-mongodb.default.svc.cluster.local:27017/admin?authSource=admin&compressors=disabled&gssapiServiceName=mongodb Implicit session: session { "id" : UUID("ae87c35e-768b-4d77-a920-2115e5d52aff") } Percona Server for MongoDB server version: v4.4.29-28 { "_id" : ObjectId("698d539a50ef62d9286bd4cf"), "a" : "nelsi" } bye check cluster data consistent Success `kubectl get secrets -l app.kubernetes.io/instance=mongodb-eflsbm` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.username}"` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.password}"` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.port}"` DB_USERNAME:root;DB_PASSWORD:403nfj8Y0jh2R14x;DB_PORT:27017;DB_DATABASE: No resources found in default namespace. `echo "echo \"db.col.find().readPref('secondary')\" | mongo --host mongodb-eflsbm-mongodb-mongodb-ro.default.svc.cluster.local --port 27017 -u root -p 403nfj8Y0jh2R14x --authenticationDatabase admin admin " | kubectl exec -it mongodb-eflsbm-mongodb-0 --namespace default -- bash ` check readonly data: Defaulted container "mongodb" out of: mongodb, mongodb-backup-agent, exporter, kbagent, init-syncer (init), init-kubectl (init), init-pbm-agent (init), init-kbagent (init), kbagent-worker (init) Unable to use a TTY - input is not a terminal or the right kind of file Percona Server for MongoDB shell version v4.4.29-28 connecting to: mongodb://mongodb-eflsbm-mongodb-mongodb-ro.default.svc.cluster.local:27017/admin?authSource=admin&compressors=disabled&gssapiServiceName=mongodb Implicit session: session { "id" : UUID("7eb641a0-d9a9-49fa-9304-f37f66b0885f") } Percona Server for MongoDB server version: v4.4.29-28 { "_id" : ObjectId("698d539a50ef62d9286bd4cf"), "a" : "nelsi" } bye check cluster readonly data consistent Success `kubectl get secrets -l app.kubernetes.io/instance=mongodb-eflsbm` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.username}"` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.password}"` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.port}"` DB_USERNAME:root;DB_PASSWORD:403nfj8Y0jh2R14x;DB_PORT:27017;DB_DATABASE: No resources found in default namespace. check db_client batch data count `echo "echo \"db.executions_loop_table.estimatedDocumentCount();\" | mongo --host mongodb-eflsbm-mongodb-mongodb.default.svc.cluster.local --port 27017 -u root -p 403nfj8Y0jh2R14x --authenticationDatabase admin admin " | kubectl exec -it mongodb-eflsbm-mongodb-3 --namespace default -- bash ` check db_client batch [23154] equal [23154] data Success skip cluster Upgrade test failover networkbandwidthover check cluster status before cluster-failover-networkbandwidthover check cluster status done cluster_status:Running `kubectl patch -p '{"metadata":{"finalizers":[]}}' --type=merge NetworkChaos test-chaos-mesh-networkbandwidthover-mongodb-eflsbm --namespace default ` Warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely. Error from server (NotFound): networkchaos.chaos-mesh.org "test-chaos-mesh-networkbandwidthover-mongodb-eflsbm" not found Error from server (NotFound): networkchaos.chaos-mesh.org "test-chaos-mesh-networkbandwidthover-mongodb-eflsbm" not found apiVersion: chaos-mesh.org/v1alpha1 kind: NetworkChaos metadata: name: test-chaos-mesh-networkbandwidthover-mongodb-eflsbm namespace: default spec: selector: namespaces: - default labelSelectors: apps.kubeblocks.io/pod-name: mongodb-eflsbm-mongodb-3 action: bandwidth mode: all bandwidth: rate: '1bps' limit: 20971520 buffer: 10000 duration: 2m `kubectl apply -f test-chaos-mesh-networkbandwidthover-mongodb-eflsbm.yaml` networkchaos.chaos-mesh.org/test-chaos-mesh-networkbandwidthover-mongodb-eflsbm created apply test-chaos-mesh-networkbandwidthover-mongodb-eflsbm.yaml Success `rm -rf test-chaos-mesh-networkbandwidthover-mongodb-eflsbm.yaml` networkbandwidthover chaos test waiting 120 seconds check cluster status `kbcli cluster list mongodb-eflsbm --show-labels --namespace default ` NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS mongodb-eflsbm default mongodb WipeOut Running Feb 12,2026 12:11 UTC+0800 app.kubernetes.io/instance=mongodb-eflsbm,clusterdefinition.kubeblocks.io/name=mongodb check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances mongodb-eflsbm --namespace default ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME mongodb-eflsbm-mongodb-0 default mongodb-eflsbm mongodb Running secondary cn-guangzhou-b 200m / 200m 644245094400m / 644245094400m data:25Gi 192.168.0.13/192.168.0.13 Feb 12,2026 12:44 UTC+0800 mongodb-eflsbm-mongodb-2 default mongodb-eflsbm mongodb Running primary cn-guangzhou-b 200m / 200m 644245094400m / 644245094400m data:25Gi 192.168.0.199/192.168.0.199 Feb 12,2026 12:45 UTC+0800 mongodb-eflsbm-mongodb-3 default mongodb-eflsbm mongodb Running secondary cn-guangzhou-b 200m / 200m 644245094400m / 644245094400m data:25Gi 192.168.0.200/192.168.0.200 Feb 12,2026 12:43 UTC+0800 check pod status done check cluster role check cluster role done primary: mongodb-eflsbm-mongodb-2;secondary: mongodb-eflsbm-mongodb-0 mongodb-eflsbm-mongodb-3 `kubectl get secrets -l app.kubernetes.io/instance=mongodb-eflsbm` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.username}"` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.password}"` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.port}"` DB_USERNAME:root;DB_PASSWORD:403nfj8Y0jh2R14x;DB_PORT:27017;DB_DATABASE: No resources found in default namespace. check cluster connect `echo " echo \"\" | mongo --host mongodb-eflsbm-mongodb-mongodb.default.svc.cluster.local --port 27017 -u root -p 403nfj8Y0jh2R14x --authenticationDatabase admin admin " | kubectl exec -it mongodb-eflsbm-mongodb-2 --namespace default -- bash` check cluster connect done `kubectl patch -p '{"metadata":{"finalizers":[]}}' --type=merge NetworkChaos test-chaos-mesh-networkbandwidthover-mongodb-eflsbm --namespace default ` Warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely. networkchaos.chaos-mesh.org "test-chaos-mesh-networkbandwidthover-mongodb-eflsbm" force deleted Error from server (NotFound): networkchaos.chaos-mesh.org "test-chaos-mesh-networkbandwidthover-mongodb-eflsbm" not found check failover pod name failover pod name:mongodb-eflsbm-mongodb-2 failover networkbandwidthover Success `kubectl get secrets -l app.kubernetes.io/instance=mongodb-eflsbm` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.username}"` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.password}"` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.port}"` DB_USERNAME:root;DB_PASSWORD:403nfj8Y0jh2R14x;DB_PORT:27017;DB_DATABASE: No resources found in default namespace. `echo "echo \"db.col.find()\" | mongo --host mongodb-eflsbm-mongodb-mongodb.default.svc.cluster.local --port 27017 -u root -p 403nfj8Y0jh2R14x --authenticationDatabase admin admin " | kubectl exec -it mongodb-eflsbm-mongodb-2 --namespace default -- bash ` check data: Defaulted container "mongodb" out of: mongodb, mongodb-backup-agent, exporter, kbagent, init-syncer (init), init-kubectl (init), init-pbm-agent (init), init-kbagent (init), kbagent-worker (init) Unable to use a TTY - input is not a terminal or the right kind of file Percona Server for MongoDB shell version v4.4.29-28 connecting to: mongodb://mongodb-eflsbm-mongodb-mongodb.default.svc.cluster.local:27017/admin?authSource=admin&compressors=disabled&gssapiServiceName=mongodb Implicit session: session { "id" : UUID("1ccfa1bd-44b3-47d7-b817-827bcd4d7895") } Percona Server for MongoDB server version: v4.4.29-28 { "_id" : ObjectId("698d539a50ef62d9286bd4cf"), "a" : "nelsi" } bye check cluster data consistent Success `kubectl get secrets -l app.kubernetes.io/instance=mongodb-eflsbm` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.username}"` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.password}"` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.port}"` DB_USERNAME:root;DB_PASSWORD:403nfj8Y0jh2R14x;DB_PORT:27017;DB_DATABASE: No resources found in default namespace. `echo "echo \"db.col.find().readPref('secondary')\" | mongo --host mongodb-eflsbm-mongodb-mongodb-ro.default.svc.cluster.local --port 27017 -u root -p 403nfj8Y0jh2R14x --authenticationDatabase admin admin " | kubectl exec -it mongodb-eflsbm-mongodb-0 --namespace default -- bash ` check readonly data: Defaulted container "mongodb" out of: mongodb, mongodb-backup-agent, exporter, kbagent, init-syncer (init), init-kubectl (init), init-pbm-agent (init), init-kbagent (init), kbagent-worker (init) Unable to use a TTY - input is not a terminal or the right kind of file Percona Server for MongoDB shell version v4.4.29-28 connecting to: mongodb://mongodb-eflsbm-mongodb-mongodb-ro.default.svc.cluster.local:27017/admin?authSource=admin&compressors=disabled&gssapiServiceName=mongodb Implicit session: session { "id" : UUID("dc5f48de-c585-40a9-aeb0-71f396926252") } Percona Server for MongoDB server version: v4.4.29-28 { "_id" : ObjectId("698d539a50ef62d9286bd4cf"), "a" : "nelsi" } bye check cluster readonly data consistent Success `kubectl get secrets -l app.kubernetes.io/instance=mongodb-eflsbm` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.username}"` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.password}"` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.port}"` DB_USERNAME:root;DB_PASSWORD:403nfj8Y0jh2R14x;DB_PORT:27017;DB_DATABASE: No resources found in default namespace. check db_client batch data count `echo "echo \"db.executions_loop_table.estimatedDocumentCount();\" | mongo --host mongodb-eflsbm-mongodb-mongodb.default.svc.cluster.local --port 27017 -u root -p 403nfj8Y0jh2R14x --authenticationDatabase admin admin " | kubectl exec -it mongodb-eflsbm-mongodb-2 --namespace default -- bash ` check db_client batch [23154] equal [23154] data Success test failover fullcpu check cluster status before cluster-failover-fullcpu check cluster status done cluster_status:Running `kubectl patch -p '{"metadata":{"finalizers":[]}}' --type=merge StressChaos test-chaos-mesh-fullcpu-mongodb-eflsbm --namespace default ` Warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely. Error from server (NotFound): stresschaos.chaos-mesh.org "test-chaos-mesh-fullcpu-mongodb-eflsbm" not found Error from server (NotFound): stresschaos.chaos-mesh.org "test-chaos-mesh-fullcpu-mongodb-eflsbm" not found apiVersion: chaos-mesh.org/v1alpha1 kind: StressChaos metadata: name: test-chaos-mesh-fullcpu-mongodb-eflsbm namespace: default spec: selector: namespaces: - default labelSelectors: apps.kubeblocks.io/pod-name: mongodb-eflsbm-mongodb-2 mode: all stressors: cpu: workers: 100 load: 100 duration: 2m `kubectl apply -f test-chaos-mesh-fullcpu-mongodb-eflsbm.yaml` stresschaos.chaos-mesh.org/test-chaos-mesh-fullcpu-mongodb-eflsbm created apply test-chaos-mesh-fullcpu-mongodb-eflsbm.yaml Success `rm -rf test-chaos-mesh-fullcpu-mongodb-eflsbm.yaml` fullcpu chaos test waiting 120 seconds check cluster status `kbcli cluster list mongodb-eflsbm --show-labels --namespace default ` NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS mongodb-eflsbm default mongodb WipeOut Running Feb 12,2026 12:11 UTC+0800 app.kubernetes.io/instance=mongodb-eflsbm,clusterdefinition.kubeblocks.io/name=mongodb check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances mongodb-eflsbm --namespace default ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME mongodb-eflsbm-mongodb-0 default mongodb-eflsbm mongodb Running secondary cn-guangzhou-b 200m / 200m 644245094400m / 644245094400m data:25Gi 192.168.0.13/192.168.0.13 Feb 12,2026 12:44 UTC+0800 mongodb-eflsbm-mongodb-2 default mongodb-eflsbm mongodb Running primary cn-guangzhou-b 200m / 200m 644245094400m / 644245094400m data:25Gi 192.168.0.199/192.168.0.199 Feb 12,2026 12:45 UTC+0800 mongodb-eflsbm-mongodb-3 default mongodb-eflsbm mongodb Running secondary cn-guangzhou-b 200m / 200m 644245094400m / 644245094400m data:25Gi 192.168.0.200/192.168.0.200 Feb 12,2026 12:43 UTC+0800 check pod status done check cluster role check cluster role done primary: mongodb-eflsbm-mongodb-2;secondary: mongodb-eflsbm-mongodb-0 mongodb-eflsbm-mongodb-3 `kubectl get secrets -l app.kubernetes.io/instance=mongodb-eflsbm` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.username}"` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.password}"` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.port}"` DB_USERNAME:root;DB_PASSWORD:403nfj8Y0jh2R14x;DB_PORT:27017;DB_DATABASE: No resources found in default namespace. check cluster connect `echo " echo \"\" | mongo --host mongodb-eflsbm-mongodb-mongodb.default.svc.cluster.local --port 27017 -u root -p 403nfj8Y0jh2R14x --authenticationDatabase admin admin " | kubectl exec -it mongodb-eflsbm-mongodb-2 --namespace default -- bash` check cluster connect done `kubectl patch -p '{"metadata":{"finalizers":[]}}' --type=merge StressChaos test-chaos-mesh-fullcpu-mongodb-eflsbm --namespace default ` Warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely. stresschaos.chaos-mesh.org "test-chaos-mesh-fullcpu-mongodb-eflsbm" force deleted Error from server (NotFound): stresschaos.chaos-mesh.org "test-chaos-mesh-fullcpu-mongodb-eflsbm" not found check failover pod name failover pod name:mongodb-eflsbm-mongodb-2 failover fullcpu Success `kubectl get secrets -l app.kubernetes.io/instance=mongodb-eflsbm` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.username}"` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.password}"` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.port}"` DB_USERNAME:root;DB_PASSWORD:403nfj8Y0jh2R14x;DB_PORT:27017;DB_DATABASE: No resources found in default namespace. `echo "echo \"db.col.find()\" | mongo --host mongodb-eflsbm-mongodb-mongodb.default.svc.cluster.local --port 27017 -u root -p 403nfj8Y0jh2R14x --authenticationDatabase admin admin " | kubectl exec -it mongodb-eflsbm-mongodb-2 --namespace default -- bash ` check data: Defaulted container "mongodb" out of: mongodb, mongodb-backup-agent, exporter, kbagent, init-syncer (init), init-kubectl (init), init-pbm-agent (init), init-kbagent (init), kbagent-worker (init) Unable to use a TTY - input is not a terminal or the right kind of file Percona Server for MongoDB shell version v4.4.29-28 connecting to: mongodb://mongodb-eflsbm-mongodb-mongodb.default.svc.cluster.local:27017/admin?authSource=admin&compressors=disabled&gssapiServiceName=mongodb Implicit session: session { "id" : UUID("3c0e5711-a502-464f-b4a4-9ae41c02d3d5") } Percona Server for MongoDB server version: v4.4.29-28 { "_id" : ObjectId("698d539a50ef62d9286bd4cf"), "a" : "nelsi" } bye check cluster data consistent Success `kubectl get secrets -l app.kubernetes.io/instance=mongodb-eflsbm` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.username}"` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.password}"` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.port}"` DB_USERNAME:root;DB_PASSWORD:403nfj8Y0jh2R14x;DB_PORT:27017;DB_DATABASE: No resources found in default namespace. `echo "echo \"db.col.find().readPref('secondary')\" | mongo --host mongodb-eflsbm-mongodb-mongodb-ro.default.svc.cluster.local --port 27017 -u root -p 403nfj8Y0jh2R14x --authenticationDatabase admin admin " | kubectl exec -it mongodb-eflsbm-mongodb-0 --namespace default -- bash ` check readonly data: Defaulted container "mongodb" out of: mongodb, mongodb-backup-agent, exporter, kbagent, init-syncer (init), init-kubectl (init), init-pbm-agent (init), init-kbagent (init), kbagent-worker (init) Unable to use a TTY - input is not a terminal or the right kind of file Percona Server for MongoDB shell version v4.4.29-28 connecting to: mongodb://mongodb-eflsbm-mongodb-mongodb-ro.default.svc.cluster.local:27017/admin?authSource=admin&compressors=disabled&gssapiServiceName=mongodb Implicit session: session { "id" : UUID("dcbf4ed1-6e9c-479c-8e38-78b50e6dde13") } Percona Server for MongoDB server version: v4.4.29-28 { "_id" : ObjectId("698d539a50ef62d9286bd4cf"), "a" : "nelsi" } bye check cluster readonly data consistent Success `kubectl get secrets -l app.kubernetes.io/instance=mongodb-eflsbm` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.username}"` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.password}"` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.port}"` DB_USERNAME:root;DB_PASSWORD:403nfj8Y0jh2R14x;DB_PORT:27017;DB_DATABASE: No resources found in default namespace. check db_client batch data count `echo "echo \"db.executions_loop_table.estimatedDocumentCount();\" | mongo --host mongodb-eflsbm-mongodb-mongodb.default.svc.cluster.local --port 27017 -u root -p 403nfj8Y0jh2R14x --authenticationDatabase admin admin " | kubectl exec -it mongodb-eflsbm-mongodb-2 --namespace default -- bash ` check db_client batch [23154] equal [23154] data Success test failover timeoffset check cluster status before cluster-failover-timeoffset check cluster status done cluster_status:Running `kubectl patch -p '{"metadata":{"finalizers":[]}}' --type=merge TimeChaos test-chaos-mesh-timeoffset-mongodb-eflsbm --namespace default ` Warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely. Error from server (NotFound): timechaos.chaos-mesh.org "test-chaos-mesh-timeoffset-mongodb-eflsbm" not found Error from server (NotFound): timechaos.chaos-mesh.org "test-chaos-mesh-timeoffset-mongodb-eflsbm" not found apiVersion: chaos-mesh.org/v1alpha1 kind: TimeChaos metadata: name: test-chaos-mesh-timeoffset-mongodb-eflsbm namespace: default spec: selector: namespaces: - default labelSelectors: apps.kubeblocks.io/pod-name: mongodb-eflsbm-mongodb-2 mode: all timeOffset: '-10m' clockIds: - CLOCK_REALTIME duration: 2m `kubectl apply -f test-chaos-mesh-timeoffset-mongodb-eflsbm.yaml` timechaos.chaos-mesh.org/test-chaos-mesh-timeoffset-mongodb-eflsbm created apply test-chaos-mesh-timeoffset-mongodb-eflsbm.yaml Success `rm -rf test-chaos-mesh-timeoffset-mongodb-eflsbm.yaml` timeoffset chaos test waiting 120 seconds check cluster status `kbcli cluster list mongodb-eflsbm --show-labels --namespace default ` NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS mongodb-eflsbm default mongodb WipeOut Running Feb 12,2026 12:11 UTC+0800 app.kubernetes.io/instance=mongodb-eflsbm,clusterdefinition.kubeblocks.io/name=mongodb check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances mongodb-eflsbm --namespace default ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME mongodb-eflsbm-mongodb-0 default mongodb-eflsbm mongodb Running secondary cn-guangzhou-b 200m / 200m 644245094400m / 644245094400m data:25Gi 192.168.0.13/192.168.0.13 Feb 12,2026 12:44 UTC+0800 mongodb-eflsbm-mongodb-2 default mongodb-eflsbm mongodb Running primary cn-guangzhou-b 200m / 200m 644245094400m / 644245094400m data:25Gi 192.168.0.199/192.168.0.199 Feb 12,2026 12:45 UTC+0800 mongodb-eflsbm-mongodb-3 default mongodb-eflsbm mongodb Running secondary cn-guangzhou-b 200m / 200m 644245094400m / 644245094400m data:25Gi 192.168.0.200/192.168.0.200 Feb 12,2026 12:43 UTC+0800 check pod status done check cluster role check cluster role done primary: mongodb-eflsbm-mongodb-2;secondary: mongodb-eflsbm-mongodb-0 mongodb-eflsbm-mongodb-3 `kubectl get secrets -l app.kubernetes.io/instance=mongodb-eflsbm` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.username}"` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.password}"` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.port}"` DB_USERNAME:root;DB_PASSWORD:403nfj8Y0jh2R14x;DB_PORT:27017;DB_DATABASE: No resources found in default namespace. check cluster connect `echo " echo \"\" | mongo --host mongodb-eflsbm-mongodb-mongodb.default.svc.cluster.local --port 27017 -u root -p 403nfj8Y0jh2R14x --authenticationDatabase admin admin " | kubectl exec -it mongodb-eflsbm-mongodb-2 --namespace default -- bash` check cluster connect done `kubectl patch -p '{"metadata":{"finalizers":[]}}' --type=merge TimeChaos test-chaos-mesh-timeoffset-mongodb-eflsbm --namespace default ` Warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely. timechaos.chaos-mesh.org/test-chaos-mesh-timeoffset-mongodb-eflsbm patched check failover pod name timechaos.chaos-mesh.org "test-chaos-mesh-timeoffset-mongodb-eflsbm" force deleted failover pod name:mongodb-eflsbm-mongodb-2 failover timeoffset Success `kubectl get secrets -l app.kubernetes.io/instance=mongodb-eflsbm` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.username}"` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.password}"` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.port}"` DB_USERNAME:root;DB_PASSWORD:403nfj8Y0jh2R14x;DB_PORT:27017;DB_DATABASE: No resources found in default namespace. `echo "echo \"db.col.find()\" | mongo --host mongodb-eflsbm-mongodb-mongodb.default.svc.cluster.local --port 27017 -u root -p 403nfj8Y0jh2R14x --authenticationDatabase admin admin " | kubectl exec -it mongodb-eflsbm-mongodb-2 --namespace default -- bash ` check data: Defaulted container "mongodb" out of: mongodb, mongodb-backup-agent, exporter, kbagent, init-syncer (init), init-kubectl (init), init-pbm-agent (init), init-kbagent (init), kbagent-worker (init) Unable to use a TTY - input is not a terminal or the right kind of file Percona Server for MongoDB shell version v4.4.29-28 connecting to: mongodb://mongodb-eflsbm-mongodb-mongodb.default.svc.cluster.local:27017/admin?authSource=admin&compressors=disabled&gssapiServiceName=mongodb Implicit session: session { "id" : UUID("735e65a2-c469-42b9-bb00-a281e7331cea") } Percona Server for MongoDB server version: v4.4.29-28 { "_id" : ObjectId("698d539a50ef62d9286bd4cf"), "a" : "nelsi" } bye check cluster data consistent Success `kubectl get secrets -l app.kubernetes.io/instance=mongodb-eflsbm` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.username}"` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.password}"` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.port}"` DB_USERNAME:root;DB_PASSWORD:403nfj8Y0jh2R14x;DB_PORT:27017;DB_DATABASE: No resources found in default namespace. `echo "echo \"db.col.find().readPref('secondary')\" | mongo --host mongodb-eflsbm-mongodb-mongodb-ro.default.svc.cluster.local --port 27017 -u root -p 403nfj8Y0jh2R14x --authenticationDatabase admin admin " | kubectl exec -it mongodb-eflsbm-mongodb-0 --namespace default -- bash ` check readonly data: Defaulted container "mongodb" out of: mongodb, mongodb-backup-agent, exporter, kbagent, init-syncer (init), init-kubectl (init), init-pbm-agent (init), init-kbagent (init), kbagent-worker (init) Unable to use a TTY - input is not a terminal or the right kind of file Percona Server for MongoDB shell version v4.4.29-28 connecting to: mongodb://mongodb-eflsbm-mongodb-mongodb-ro.default.svc.cluster.local:27017/admin?authSource=admin&compressors=disabled&gssapiServiceName=mongodb Implicit session: session { "id" : UUID("9ba2f82d-34f5-482b-8ec6-bdac554cd644") } Percona Server for MongoDB server version: v4.4.29-28 { "_id" : ObjectId("698d539a50ef62d9286bd4cf"), "a" : "nelsi" } bye check cluster readonly data consistent Success `kubectl get secrets -l app.kubernetes.io/instance=mongodb-eflsbm` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.username}"` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.password}"` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.port}"` DB_USERNAME:root;DB_PASSWORD:403nfj8Y0jh2R14x;DB_PORT:27017;DB_DATABASE: No resources found in default namespace. check db_client batch data count `echo "echo \"db.executions_loop_table.estimatedDocumentCount();\" | mongo --host mongodb-eflsbm-mongodb-mongodb.default.svc.cluster.local --port 27017 -u root -p 403nfj8Y0jh2R14x --authenticationDatabase admin admin " | kubectl exec -it mongodb-eflsbm-mongodb-2 --namespace default -- bash ` check db_client batch [23154] equal [23154] data Success `kubectl get secrets -l app.kubernetes.io/instance=mongodb-eflsbm` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.username}"` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.password}"` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.port}"` DB_USERNAME:root;DB_PASSWORD:403nfj8Y0jh2R14x;DB_PORT:27017;DB_DATABASE: No resources found in default namespace. `mongo mongodb://root:403nfj8Y0jh2R14x@mongodb-eflsbm-mongodb-mongodb.default.svc.cluster.local` Defaulted container "mongodb" out of: mongodb, mongodb-backup-agent, exporter, kbagent, init-syncer (init), init-kubectl (init), init-pbm-agent (init), init-kbagent (init), kbagent-worker (init) Unable to use a TTY - input is not a terminal or the right kind of file exec return msg:Percona Server for MongoDB shell version v4.4.29-28 connecting to: mongodb://mongodb-eflsbm-mongodb-mongodb.default.svc.cluster.local:27017/?compressors=disabled&gssapiServiceName=mongodb Implicit session: session { "id" : UUID("e4c1d208-a74e-4afe-b91d-7a2c1211e9bc") } Percona Server for MongoDB server version: v4.4.29-28 bye connect headlessEndpoints Success cluster mongodb scale-out cluster mongodb scale-out replicas: 4 check cluster status before ops check cluster status done cluster_status:Running No resources found in mongodb-eflsbm namespace. `kbcli cluster scale-out mongodb-eflsbm --auto-approve --force=true --components mongodb --replicas 1 --namespace default ` OpsRequest mongodb-eflsbm-horizontalscaling-gwv8g created successfully, you can view the progress: kbcli cluster describe-ops mongodb-eflsbm-horizontalscaling-gwv8g -n default check ops status `kbcli cluster list-ops mongodb-eflsbm --status all --namespace default ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME mongodb-eflsbm-horizontalscaling-gwv8g default HorizontalScaling mongodb-eflsbm mongodb Running 0/1 Feb 12,2026 12:53 UTC+0800 check cluster status `kbcli cluster list mongodb-eflsbm --show-labels --namespace default ` NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS mongodb-eflsbm default mongodb WipeOut Updating Feb 12,2026 12:11 UTC+0800 app.kubernetes.io/instance=mongodb-eflsbm,clusterdefinition.kubeblocks.io/name=mongodb cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances mongodb-eflsbm --namespace default ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME mongodb-eflsbm-mongodb-0 default mongodb-eflsbm mongodb Running secondary cn-guangzhou-b 200m / 200m 644245094400m / 644245094400m data:25Gi 192.168.0.13/192.168.0.13 Feb 12,2026 12:44 UTC+0800 mongodb-eflsbm-mongodb-2 default mongodb-eflsbm mongodb Running primary cn-guangzhou-b 200m / 200m 644245094400m / 644245094400m data:25Gi 192.168.0.199/192.168.0.199 Feb 12,2026 12:45 UTC+0800 mongodb-eflsbm-mongodb-3 default mongodb-eflsbm mongodb Running secondary cn-guangzhou-b 200m / 200m 644245094400m / 644245094400m data:25Gi 192.168.0.200/192.168.0.200 Feb 12,2026 12:43 UTC+0800 mongodb-eflsbm-mongodb-4 default mongodb-eflsbm mongodb Running secondary cn-guangzhou-b 200m / 200m 644245094400m / 644245094400m data:25Gi 192.168.0.13/192.168.0.13 Feb 12,2026 12:53 UTC+0800 check pod status done check cluster role check cluster role done primary: mongodb-eflsbm-mongodb-2;secondary: mongodb-eflsbm-mongodb-0 mongodb-eflsbm-mongodb-3 mongodb-eflsbm-mongodb-4 `kubectl get secrets -l app.kubernetes.io/instance=mongodb-eflsbm` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.username}"` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.password}"` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.port}"` DB_USERNAME:root;DB_PASSWORD:403nfj8Y0jh2R14x;DB_PORT:27017;DB_DATABASE: No resources found in default namespace. check cluster connect `echo " echo \"\" | mongo --host mongodb-eflsbm-mongodb-mongodb.default.svc.cluster.local --port 27017 -u root -p 403nfj8Y0jh2R14x --authenticationDatabase admin admin " | kubectl exec -it mongodb-eflsbm-mongodb-2 --namespace default -- bash` check cluster connect done No resources found in mongodb-eflsbm namespace. check ops status `kbcli cluster list-ops mongodb-eflsbm --status all --namespace default ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME mongodb-eflsbm-horizontalscaling-gwv8g default HorizontalScaling mongodb-eflsbm mongodb Succeed 1/1 Feb 12,2026 12:53 UTC+0800 check ops status done ops_status:mongodb-eflsbm-horizontalscaling-gwv8g default HorizontalScaling mongodb-eflsbm mongodb Succeed 1/1 Feb 12,2026 12:53 UTC+0800 `kubectl patch -p '{"metadata":{"finalizers":[]}}' --type=merge opsrequests.operations mongodb-eflsbm-horizontalscaling-gwv8g --namespace default ` opsrequest.operations.kubeblocks.io/mongodb-eflsbm-horizontalscaling-gwv8g patched `kbcli cluster delete-ops --name mongodb-eflsbm-horizontalscaling-gwv8g --force --auto-approve --namespace default ` OpsRequest mongodb-eflsbm-horizontalscaling-gwv8g deleted `kubectl get secrets -l app.kubernetes.io/instance=mongodb-eflsbm` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.username}"` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.password}"` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.port}"` DB_USERNAME:root;DB_PASSWORD:403nfj8Y0jh2R14x;DB_PORT:27017;DB_DATABASE: No resources found in default namespace. `echo "echo \"db.col.find()\" | mongo --host mongodb-eflsbm-mongodb-mongodb.default.svc.cluster.local --port 27017 -u root -p 403nfj8Y0jh2R14x --authenticationDatabase admin admin " | kubectl exec -it mongodb-eflsbm-mongodb-2 --namespace default -- bash ` check data: Defaulted container "mongodb" out of: mongodb, mongodb-backup-agent, exporter, kbagent, init-syncer (init), init-kubectl (init), init-pbm-agent (init), init-kbagent (init), kbagent-worker (init) Unable to use a TTY - input is not a terminal or the right kind of file Percona Server for MongoDB shell version v4.4.29-28 connecting to: mongodb://mongodb-eflsbm-mongodb-mongodb.default.svc.cluster.local:27017/admin?authSource=admin&compressors=disabled&gssapiServiceName=mongodb Implicit session: session { "id" : UUID("87ee5950-3fac-4354-a400-28ce0590e053") } Percona Server for MongoDB server version: v4.4.29-28 { "_id" : ObjectId("698d539a50ef62d9286bd4cf"), "a" : "nelsi" } bye check cluster data consistent Success `kubectl get secrets -l app.kubernetes.io/instance=mongodb-eflsbm` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.username}"` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.password}"` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.port}"` DB_USERNAME:root;DB_PASSWORD:403nfj8Y0jh2R14x;DB_PORT:27017;DB_DATABASE: No resources found in default namespace. `echo "echo \"db.col.find().readPref('secondary')\" | mongo --host mongodb-eflsbm-mongodb-mongodb-ro.default.svc.cluster.local --port 27017 -u root -p 403nfj8Y0jh2R14x --authenticationDatabase admin admin " | kubectl exec -it mongodb-eflsbm-mongodb-0 --namespace default -- bash ` check readonly data: Defaulted container "mongodb" out of: mongodb, mongodb-backup-agent, exporter, kbagent, init-syncer (init), init-kubectl (init), init-pbm-agent (init), init-kbagent (init), kbagent-worker (init) Unable to use a TTY - input is not a terminal or the right kind of file Percona Server for MongoDB shell version v4.4.29-28 connecting to: mongodb://mongodb-eflsbm-mongodb-mongodb-ro.default.svc.cluster.local:27017/admin?authSource=admin&compressors=disabled&gssapiServiceName=mongodb Implicit session: session { "id" : UUID("af07a380-12b9-42f3-8502-527898fd26de") } Percona Server for MongoDB server version: v4.4.29-28 { "_id" : ObjectId("698d539a50ef62d9286bd4cf"), "a" : "nelsi" } bye check cluster readonly data consistent Success `kubectl get secrets -l app.kubernetes.io/instance=mongodb-eflsbm` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.username}"` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.password}"` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.port}"` DB_USERNAME:root;DB_PASSWORD:403nfj8Y0jh2R14x;DB_PORT:27017;DB_DATABASE: No resources found in default namespace. check db_client batch data count `echo "echo \"db.executions_loop_table.estimatedDocumentCount();\" | mongo --host mongodb-eflsbm-mongodb-mongodb.default.svc.cluster.local --port 27017 -u root -p 403nfj8Y0jh2R14x --authenticationDatabase admin admin " | kubectl exec -it mongodb-eflsbm-mongodb-2 --namespace default -- bash ` check db_client batch [23154] equal [23154] data Success cluster mongodb scale-in cluster mongodb scale-in replicas: 3 check cluster status before ops check cluster status done cluster_status:Running No resources found in mongodb-eflsbm namespace. `kbcli cluster scale-in mongodb-eflsbm --auto-approve --force=true --components mongodb --replicas 1 --namespace default ` OpsRequest mongodb-eflsbm-horizontalscaling-rflt8 created successfully, you can view the progress: kbcli cluster describe-ops mongodb-eflsbm-horizontalscaling-rflt8 -n default check ops status `kbcli cluster list-ops mongodb-eflsbm --status all --namespace default ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME mongodb-eflsbm-horizontalscaling-rflt8 default HorizontalScaling mongodb-eflsbm mongodb Running 0/1 Feb 12,2026 12:54 UTC+0800 check cluster status `kbcli cluster list mongodb-eflsbm --show-labels --namespace default ` NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS mongodb-eflsbm default mongodb WipeOut Running Feb 12,2026 12:11 UTC+0800 app.kubernetes.io/instance=mongodb-eflsbm,clusterdefinition.kubeblocks.io/name=mongodb check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances mongodb-eflsbm --namespace default ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME mongodb-eflsbm-mongodb-0 default mongodb-eflsbm mongodb Running secondary cn-guangzhou-b 200m / 200m 644245094400m / 644245094400m data:25Gi 192.168.0.13/192.168.0.13 Feb 12,2026 12:44 UTC+0800 mongodb-eflsbm-mongodb-2 default mongodb-eflsbm mongodb Running primary cn-guangzhou-b 200m / 200m 644245094400m / 644245094400m data:25Gi 192.168.0.199/192.168.0.199 Feb 12,2026 12:45 UTC+0800 mongodb-eflsbm-mongodb-3 default mongodb-eflsbm mongodb Running secondary cn-guangzhou-b 200m / 200m 644245094400m / 644245094400m data:25Gi 192.168.0.200/192.168.0.200 Feb 12,2026 12:43 UTC+0800 check pod status done check cluster role check cluster role done primary: mongodb-eflsbm-mongodb-2;secondary: mongodb-eflsbm-mongodb-0 mongodb-eflsbm-mongodb-3 `kubectl get secrets -l app.kubernetes.io/instance=mongodb-eflsbm` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.username}"` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.password}"` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.port}"` DB_USERNAME:root;DB_PASSWORD:403nfj8Y0jh2R14x;DB_PORT:27017;DB_DATABASE: No resources found in default namespace. check cluster connect `echo " echo \"\" | mongo --host mongodb-eflsbm-mongodb-mongodb.default.svc.cluster.local --port 27017 -u root -p 403nfj8Y0jh2R14x --authenticationDatabase admin admin " | kubectl exec -it mongodb-eflsbm-mongodb-2 --namespace default -- bash` check cluster connect done No resources found in mongodb-eflsbm namespace. check ops status `kbcli cluster list-ops mongodb-eflsbm --status all --namespace default ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME mongodb-eflsbm-horizontalscaling-rflt8 default HorizontalScaling mongodb-eflsbm mongodb Succeed 1/1 Feb 12,2026 12:54 UTC+0800 check ops status done ops_status:mongodb-eflsbm-horizontalscaling-rflt8 default HorizontalScaling mongodb-eflsbm mongodb Succeed 1/1 Feb 12,2026 12:54 UTC+0800 `kubectl patch -p '{"metadata":{"finalizers":[]}}' --type=merge opsrequests.operations mongodb-eflsbm-horizontalscaling-rflt8 --namespace default ` opsrequest.operations.kubeblocks.io/mongodb-eflsbm-horizontalscaling-rflt8 patched `kbcli cluster delete-ops --name mongodb-eflsbm-horizontalscaling-rflt8 --force --auto-approve --namespace default ` OpsRequest mongodb-eflsbm-horizontalscaling-rflt8 deleted `kubectl get secrets -l app.kubernetes.io/instance=mongodb-eflsbm` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.username}"` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.password}"` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.port}"` DB_USERNAME:root;DB_PASSWORD:403nfj8Y0jh2R14x;DB_PORT:27017;DB_DATABASE: No resources found in default namespace. `echo "echo \"db.col.find()\" | mongo --host mongodb-eflsbm-mongodb-mongodb.default.svc.cluster.local --port 27017 -u root -p 403nfj8Y0jh2R14x --authenticationDatabase admin admin " | kubectl exec -it mongodb-eflsbm-mongodb-2 --namespace default -- bash ` check data: Defaulted container "mongodb" out of: mongodb, mongodb-backup-agent, exporter, kbagent, init-syncer (init), init-kubectl (init), init-pbm-agent (init), init-kbagent (init), kbagent-worker (init) Unable to use a TTY - input is not a terminal or the right kind of file Percona Server for MongoDB shell version v4.4.29-28 connecting to: mongodb://mongodb-eflsbm-mongodb-mongodb.default.svc.cluster.local:27017/admin?authSource=admin&compressors=disabled&gssapiServiceName=mongodb Implicit session: session { "id" : UUID("7839dab1-6794-4434-bbe4-8ceb0404fafe") } Percona Server for MongoDB server version: v4.4.29-28 { "_id" : ObjectId("698d539a50ef62d9286bd4cf"), "a" : "nelsi" } bye check cluster data consistent Success `kubectl get secrets -l app.kubernetes.io/instance=mongodb-eflsbm` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.username}"` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.password}"` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.port}"` DB_USERNAME:root;DB_PASSWORD:403nfj8Y0jh2R14x;DB_PORT:27017;DB_DATABASE: No resources found in default namespace. `echo "echo \"db.col.find().readPref('secondary')\" | mongo --host mongodb-eflsbm-mongodb-mongodb-ro.default.svc.cluster.local --port 27017 -u root -p 403nfj8Y0jh2R14x --authenticationDatabase admin admin " | kubectl exec -it mongodb-eflsbm-mongodb-0 --namespace default -- bash ` check readonly data: Defaulted container "mongodb" out of: mongodb, mongodb-backup-agent, exporter, kbagent, init-syncer (init), init-kubectl (init), init-pbm-agent (init), init-kbagent (init), kbagent-worker (init) Unable to use a TTY - input is not a terminal or the right kind of file Percona Server for MongoDB shell version v4.4.29-28 connecting to: mongodb://mongodb-eflsbm-mongodb-mongodb-ro.default.svc.cluster.local:27017/admin?authSource=admin&compressors=disabled&gssapiServiceName=mongodb Implicit session: session { "id" : UUID("319b9a2a-5086-4a28-92cf-63a736b0dd82") } Percona Server for MongoDB server version: v4.4.29-28 { "_id" : ObjectId("698d539a50ef62d9286bd4cf"), "a" : "nelsi" } bye check cluster readonly data consistent Success `kubectl get secrets -l app.kubernetes.io/instance=mongodb-eflsbm` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.username}"` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.password}"` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.port}"` DB_USERNAME:root;DB_PASSWORD:403nfj8Y0jh2R14x;DB_PORT:27017;DB_DATABASE: No resources found in default namespace. check db_client batch data count `echo "echo \"db.executions_loop_table.estimatedDocumentCount();\" | mongo --host mongodb-eflsbm-mongodb-mongodb.default.svc.cluster.local --port 27017 -u root -p 403nfj8Y0jh2R14x --authenticationDatabase admin admin " | kubectl exec -it mongodb-eflsbm-mongodb-2 --namespace default -- bash ` check db_client batch [23154] equal [23154] data Success cluster update terminationPolicy WipeOut `kbcli cluster update mongodb-eflsbm --termination-policy=WipeOut --namespace default ` cluster.apps.kubeblocks.io/mongodb-eflsbm updated (no change) check cluster status `kbcli cluster list mongodb-eflsbm --show-labels --namespace default ` NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS mongodb-eflsbm default mongodb WipeOut Running Feb 12,2026 12:11 UTC+0800 app.kubernetes.io/instance=mongodb-eflsbm,clusterdefinition.kubeblocks.io/name=mongodb check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances mongodb-eflsbm --namespace default ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME mongodb-eflsbm-mongodb-0 default mongodb-eflsbm mongodb Running secondary cn-guangzhou-b 200m / 200m 644245094400m / 644245094400m data:25Gi 192.168.0.13/192.168.0.13 Feb 12,2026 12:44 UTC+0800 mongodb-eflsbm-mongodb-2 default mongodb-eflsbm mongodb Running primary cn-guangzhou-b 200m / 200m 644245094400m / 644245094400m data:25Gi 192.168.0.199/192.168.0.199 Feb 12,2026 12:45 UTC+0800 mongodb-eflsbm-mongodb-3 default mongodb-eflsbm mongodb Running secondary cn-guangzhou-b 200m / 200m 644245094400m / 644245094400m data:25Gi 192.168.0.200/192.168.0.200 Feb 12,2026 12:43 UTC+0800 check pod status done check cluster role check cluster role done primary: mongodb-eflsbm-mongodb-2;secondary: mongodb-eflsbm-mongodb-0 mongodb-eflsbm-mongodb-3 `kubectl get secrets -l app.kubernetes.io/instance=mongodb-eflsbm` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.username}"` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.password}"` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.port}"` DB_USERNAME:root;DB_PASSWORD:403nfj8Y0jh2R14x;DB_PORT:27017;DB_DATABASE: No resources found in default namespace. check cluster connect `echo " echo \"\" | mongo --host mongodb-eflsbm-mongodb-mongodb.default.svc.cluster.local --port 27017 -u root -p 403nfj8Y0jh2R14x --authenticationDatabase admin admin " | kubectl exec -it mongodb-eflsbm-mongodb-2 --namespace default -- bash` check cluster connect done cluster pbm-physical backup `kubectl get backuprepo backuprepo-kbcli-test -o jsonpath="{.spec.credential.name}"` `kubectl get backuprepo backuprepo-kbcli-test -o jsonpath="{.spec.credential.namespace}"` `kubectl get secrets kb-backuprepo-cg5kj -n kb-system -o jsonpath="{.data.accessKeyId}"` `kubectl get secrets kb-backuprepo-cg5kj -n kb-system -o jsonpath="{.data.secretAccessKey}"` KUBEBLOCKS NAMESPACE:kb-system get kubeblocks namespace done `kubectl get secrets -l app.kubernetes.io/instance=kbcli-test-minio --namespace kb-system -o jsonpath="{.items[0].data.root-user}"` `kubectl get secrets -l app.kubernetes.io/instance=kbcli-test-minio --namespace kb-system -o jsonpath="{.items[0].data.root-password}"` minio_user:kbclitest,minio_password:kbclitest,minio_endpoint:kbcli-test-minio.kb-system.svc.cluster.local:9000 list minio bucket kbcli-test `echo 'mc alias set minioserver http://kbcli-test-minio.kb-system.svc.cluster.local:9000 kbclitest kbclitest;mc ls minioserver' | kubectl exec -it kbcli-test-minio-79497b7755-qk8gw --namespace kb-system -- bash` Unable to use a TTY - input is not a terminal or the right kind of file list minio bucket done default backuprepo:backuprepo-kbcli-test exists `kbcli cluster backup mongodb-eflsbm --method pbm-physical --namespace default ` Backup backup-default-mongodb-eflsbm-20260212125515 created successfully, you can view the progress: kbcli cluster list-backups --names=backup-default-mongodb-eflsbm-20260212125515 -n default check backup status `kbcli cluster list-backups mongodb-eflsbm --namespace default ` NAME NAMESPACE SOURCE-CLUSTER METHOD STATUS TOTAL-SIZE DURATION DELETION-POLICY CREATE-TIME COMPLETION-TIME EXPIRATION backup-default-mongodb-eflsbm-20260212125515 default mongodb-eflsbm pbm-physical Running Delete Feb 12,2026 12:55 UTC+0800 backup_status:mongodb-eflsbm-pbm-physical-Running backup_status:mongodb-eflsbm-pbm-physical-Running backup_status:mongodb-eflsbm-pbm-physical-Running backup_status:mongodb-eflsbm-pbm-physical-Running backup_status:mongodb-eflsbm-pbm-physical-Running check backup status done backup_status:backup-default-mongodb-eflsbm-20260212125515 default mongodb-eflsbm pbm-physical Completed 1148791 26s Delete Feb 12,2026 12:55 UTC+0800 Feb 12,2026 12:55 UTC+0800 cluster restore backup Error from server (NotFound): opsrequests.operations.kubeblocks.io "mongodb-eflsbm-backup" not found `kbcli cluster describe-backup --names backup-default-mongodb-eflsbm-20260212125515 --namespace default ` Name: backup-default-mongodb-eflsbm-20260212125515 Cluster: mongodb-eflsbm Namespace: default Spec: Method: pbm-physical Policy Name: mongodb-eflsbm-mongodb-backup-policy Actions: dp-backup-0: ActionType: Job WorkloadName: dp-backup-0-backup-default-mongodb-eflsbm-20260212125515-b2da7a TargetPodName: mongodb-eflsbm-mongodb-0 Phase: Completed Start Time: Feb 12,2026 12:55 UTC+0800 Completion Time: Feb 12,2026 12:55 UTC+0800 Extras: =================== 1 =================== backupType: physical lastWriteTime: 2026-02-12T04:55:24Z backupName: 2026-02-12T04:55:22Z Status: Phase: Completed Total Size: 1148791 ActionSet Name: mongodb-rs-pbm-physical Repository: backuprepo-kbcli-test Duration: 26s Start Time: Feb 12,2026 12:55 UTC+0800 Completion Time: Feb 12,2026 12:55 UTC+0800 Path: /default/mongodb-eflsbm-156baf7f-b63b-4601-a105-9c09306a9deb/mongodb/backup-default-mongodb-eflsbm-20260212125515 Time Range Start: Feb 12,2026 12:55 UTC+0800 Time Range End: Feb 12,2026 12:55 UTC+0800 Warning Events: `kbcli cluster restore mongodb-eflsbm-backup --backup backup-default-mongodb-eflsbm-20260212125515 --namespace default ` Cluster mongodb-eflsbm-backup created check cluster status `kbcli cluster list mongodb-eflsbm-backup --show-labels --namespace default ` NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS mongodb-eflsbm-backup default mongodb WipeOut Creating Feb 12,2026 12:55 UTC+0800 clusterdefinition.kubeblocks.io/name=mongodb cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances mongodb-eflsbm-backup --namespace default ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME mongodb-eflsbm-backup-mongodb-0 default mongodb-eflsbm-backup mongodb Running primary cn-guangzhou-b 200m / 200m 644245094400m / 644245094400m data:25Gi 192.168.0.199/192.168.0.199 Feb 12,2026 12:57 UTC+0800 mongodb-eflsbm-backup-mongodb-1 default mongodb-eflsbm-backup mongodb Running secondary cn-guangzhou-b 200m / 200m 644245094400m / 644245094400m data:25Gi 192.168.0.199/192.168.0.199 Feb 12,2026 12:57 UTC+0800 mongodb-eflsbm-backup-mongodb-2 default mongodb-eflsbm-backup mongodb Running secondary cn-guangzhou-b 200m / 200m 644245094400m / 644245094400m data:25Gi 192.168.0.13/192.168.0.13 Feb 12,2026 12:58 UTC+0800 check pod status done check cluster role check cluster role done primary: mongodb-eflsbm-backup-mongodb-0;secondary: mongodb-eflsbm-backup-mongodb-1 mongodb-eflsbm-backup-mongodb-2 `kubectl get secrets -l app.kubernetes.io/instance=mongodb-eflsbm-backup` `kubectl get secrets mongodb-eflsbm-backup-mongodb-account-root -o jsonpath="{.data.username}"` `kubectl get secrets mongodb-eflsbm-backup-mongodb-account-root -o jsonpath="{.data.password}"` `kubectl get secrets mongodb-eflsbm-backup-mongodb-account-root -o jsonpath="{.data.port}"` DB_USERNAME:root;DB_PASSWORD:403nfj8Y0jh2R14x;DB_PORT:27017;DB_DATABASE: No resources found in default namespace. check cluster connect `echo " echo \"\" | mongo --host mongodb-eflsbm-backup-mongodb-mongodb.default.svc.cluster.local --port 27017 -u root -p 403nfj8Y0jh2R14x --authenticationDatabase admin admin " | kubectl exec -it mongodb-eflsbm-backup-mongodb-0 --namespace default -- bash` check cluster connect done check backup restore post ready check backup restore post ready exists post_ready_pod_status:restore-post-ready-53174748-backup-default-mongodb-eflsbm-h288w 2/2 Running 0 11s post_ready_pod_status:restore-post-ready-53174748-backup-default-mongodb-eflsbm-h288w 2/2 Running 0 19s post_ready_pod_status:restore-post-ready-53174748-backup-default-mongodb-eflsbm-h288w 2/2 Running 0 29s post_ready_pod_status:restore-post-ready-53174748-backup-default-mongodb-eflsbm-h288w 2/2 Running 0 39s post_ready_pod_status:restore-post-ready-53174748-backup-default-mongodb-eflsbm-h288w 2/2 Running 0 50s post_ready_pod_status:restore-post-ready-53174748-backup-default-mongodb-eflsbm-h288w 2/2 Running 0 60s post_ready_pod_status:restore-post-ready-53174748-backup-default-mongodb-eflsbm-h288w 2/2 Running 0 70s post_ready_pod_status:restore-post-ready-53174748-backup-default-mongodb-eflsbm-h288w 2/2 Running 0 81s post_ready_pod_status:restore-post-ready-53174748-backup-default-mongodb-eflsbm-h288w 2/2 Running 0 91s post_ready_pod_status:restore-post-ready-53174748-backup-default-mongodb-eflsbm-h288w 2/2 Running 0 101s post_ready_pod_status:restore-post-ready-53174748-backup-default-mongodb-eflsbm-h288w 2/2 Running 0 111s post_ready_pod_status:restore-post-ready-53174748-backup-default-mongodb-eflsbm-h288w 1/2 NotReady 0 2m2s check backup restore post ready done `kbcli cluster describe-backup --names backup-default-mongodb-eflsbm-20260212125515 --namespace default ` Name: backup-default-mongodb-eflsbm-20260212125515 Cluster: mongodb-eflsbm Namespace: default Spec: Method: pbm-physical Policy Name: mongodb-eflsbm-mongodb-backup-policy Actions: dp-backup-0: ActionType: Job WorkloadName: dp-backup-0-backup-default-mongodb-eflsbm-20260212125515-b2da7a TargetPodName: mongodb-eflsbm-mongodb-0 Phase: Completed Start Time: Feb 12,2026 12:55 UTC+0800 Completion Time: Feb 12,2026 12:55 UTC+0800 Extras: =================== 1 =================== lastWriteTime: 2026-02-12T04:55:24Z backupName: 2026-02-12T04:55:22Z backupType: physical Status: Phase: Completed Total Size: 1148791 ActionSet Name: mongodb-rs-pbm-physical Repository: backuprepo-kbcli-test Duration: 26s Start Time: Feb 12,2026 12:55 UTC+0800 Completion Time: Feb 12,2026 12:55 UTC+0800 Path: /default/mongodb-eflsbm-156baf7f-b63b-4601-a105-9c09306a9deb/mongodb/backup-default-mongodb-eflsbm-20260212125515 Time Range Start: Feb 12,2026 12:55 UTC+0800 Time Range End: Feb 12,2026 12:55 UTC+0800 Warning Events: cluster connect `kubectl get secrets -l app.kubernetes.io/instance=mongodb-eflsbm-backup` `kubectl get secrets mongodb-eflsbm-backup-mongodb-account-root -o jsonpath="{.data.username}"` `kubectl get secrets mongodb-eflsbm-backup-mongodb-account-root -o jsonpath="{.data.password}"` `kubectl get secrets mongodb-eflsbm-backup-mongodb-account-root -o jsonpath="{.data.port}"` DB_USERNAME:root;DB_PASSWORD:403nfj8Y0jh2R14x;DB_PORT:27017;DB_DATABASE: No resources found in default namespace. `echo " echo \"rs.status()\" | mongo --host mongodb-eflsbm-backup-mongodb-mongodb.default.svc.cluster.local --port 27017 -u root -p 403nfj8Y0jh2R14x --authenticationDatabase admin admin " | kubectl exec -it mongodb-eflsbm-backup-mongodb-1 --namespace default -- bash ` Defaulted container "mongodb" out of: mongodb, mongodb-backup-agent, exporter, kbagent, init-syncer (init), init-kubectl (init), init-pbm-agent (init), init-kbagent (init), kbagent-worker (init) Unable to use a TTY - input is not a terminal or the right kind of file Percona Server for MongoDB shell version v4.4.29-28 connecting to: mongodb://mongodb-eflsbm-backup-mongodb-mongodb.default.svc.cluster.local:27017/admin?authSource=admin&compressors=disabled&gssapiServiceName=mongodb Implicit session: session { "id" : UUID("65a10322-a937-48ef-b063-fd4c24ffab1c") } Percona Server for MongoDB server version: v4.4.29-28 { "set" : "mongodb-eflsbm-backup-mongodb", "date" : ISODate("2026-02-12T05:01:15.039Z"), "myState" : 1, "term" : NumberLong(13), "syncSourceHost" : "", "syncSourceId" : -1, "heartbeatIntervalMillis" : NumberLong(2000), "majorityVoteCount" : 2, "writeMajorityCount" : 2, "votingMembersCount" : 3, "writableVotingMembersCount" : 3, "optimes" : { "lastCommittedOpTime" : { "ts" : Timestamp(1770872474, 6), "t" : NumberLong(13) }, "lastCommittedWallTime" : ISODate("2026-02-12T05:01:14.047Z"), "readConcernMajorityOpTime" : { "ts" : Timestamp(1770872474, 6), "t" : NumberLong(13) }, "readConcernMajorityWallTime" : ISODate("2026-02-12T05:01:14.047Z"), "appliedOpTime" : { "ts" : Timestamp(1770872474, 6), "t" : NumberLong(13) }, "durableOpTime" : { "ts" : Timestamp(1770872474, 6), "t" : NumberLong(13) }, "lastAppliedWallTime" : ISODate("2026-02-12T05:01:14.047Z"), "lastDurableWallTime" : ISODate("2026-02-12T05:01:14.047Z") }, "lastStableRecoveryTimestamp" : Timestamp(1770872468, 2), "electionCandidateMetrics" : { "lastElectionReason" : "electionTimeout", "lastElectionDate" : ISODate("2026-02-12T05:01:08.203Z"), "electionTerm" : NumberLong(13), "lastCommittedOpTimeAtElection" : { "ts" : Timestamp(0, 0), "t" : NumberLong(-1) }, "lastSeenOpTimeAtElection" : { "ts" : Timestamp(1770872124, 3), "t" : NumberLong(12) }, "numVotesNeeded" : 2, "priorityAtElection" : 1, "electionTimeoutMillis" : NumberLong(10000), "numCatchUpOps" : NumberLong(0), "newTermStartDate" : ISODate("2026-02-12T05:01:08.207Z"), "wMajorityWriteAvailabilityDate" : ISODate("2026-02-12T05:01:09.033Z") }, "members" : [ { "_id" : 0, "name" : "mongodb-eflsbm-backup-mongodb-0.mongodb-eflsbm-backup-mongodb-headless.default.svc:27017", "health" : 1, "state" : 2, "stateStr" : "SECONDARY", "uptime" : 16, "optime" : { "ts" : Timestamp(1770872474, 6), "t" : NumberLong(13) }, "optimeDurable" : { "ts" : Timestamp(1770872474, 6), "t" : NumberLong(13) }, "optimeDate" : ISODate("2026-02-12T05:01:14Z"), "optimeDurableDate" : ISODate("2026-02-12T05:01:14Z"), "lastAppliedWallTime" : ISODate("2026-02-12T05:01:14.047Z"), "lastDurableWallTime" : ISODate("2026-02-12T05:01:14.047Z"), "lastHeartbeat" : ISODate("2026-02-12T05:01:14.206Z"), "lastHeartbeatRecv" : ISODate("2026-02-12T05:01:13.206Z"), "pingMs" : NumberLong(0), "lastHeartbeatMessage" : "", "syncSourceHost" : "mongodb-eflsbm-backup-mongodb-1.mongodb-eflsbm-backup-mongodb-headless.default.svc:27017", "syncSourceId" : 1, "infoMessage" : "", "configVersion" : 1, "configTerm" : -1 }, { "_id" : 1, "name" : "mongodb-eflsbm-backup-mongodb-1.mongodb-eflsbm-backup-mongodb-headless.default.svc:27017", "health" : 1, "state" : 1, "stateStr" : "PRIMARY", "uptime" : 23, "optime" : { "ts" : Timestamp(1770872474, 6), "t" : NumberLong(13) }, "optimeDate" : ISODate("2026-02-12T05:01:14Z"), "lastAppliedWallTime" : ISODate("2026-02-12T05:01:14.047Z"), "lastDurableWallTime" : ISODate("2026-02-12T05:01:14.047Z"), "syncSourceHost" : "", "syncSourceId" : -1, "infoMessage" : "", "electionTime" : Timestamp(1770872468, 1), "electionDate" : ISODate("2026-02-12T05:01:08Z"), "configVersion" : 1, "configTerm" : -1, "self" : true, "lastHeartbeatMessage" : "" }, { "_id" : 2, "name" : "mongodb-eflsbm-backup-mongodb-2.mongodb-eflsbm-backup-mongodb-headless.default.svc:27017", "health" : 1, "state" : 2, "stateStr" : "SECONDARY", "uptime" : 17, "optime" : { "ts" : Timestamp(1770872474, 6), "t" : NumberLong(13) }, "optimeDurable" : { "ts" : Timestamp(1770872474, 6), "t" : NumberLong(13) }, "optimeDate" : ISODate("2026-02-12T05:01:14Z"), "optimeDurableDate" : ISODate("2026-02-12T05:01:14Z"), "lastAppliedWallTime" : ISODate("2026-02-12T05:01:14.047Z"), "lastDurableWallTime" : ISODate("2026-02-12T05:01:14.047Z"), "lastHeartbeat" : ISODate("2026-02-12T05:01:14.207Z"), "lastHeartbeatRecv" : ISODate("2026-02-12T05:01:13.207Z"), "pingMs" : NumberLong(0), "lastHeartbeatMessage" : "", "syncSourceHost" : "mongodb-eflsbm-backup-mongodb-1.mongodb-eflsbm-backup-mongodb-headless.default.svc:27017", "syncSourceId" : 1, "infoMessage" : "", "configVersion" : 1, "configTerm" : -1 } ], "ok" : 1, "$clusterTime" : { "clusterTime" : Timestamp(1770872474, 6), "signature" : { "hash" : BinData(0,"AAAAAAAAAAAAAAAAAAAAAAAAAAA="), "keyId" : NumberLong(0) } }, "operationTime" : Timestamp(1770872474, 6) } bye connect cluster Success delete cluster mongodb-eflsbm-backup `kbcli cluster delete mongodb-eflsbm-backup --auto-approve --namespace default ` pod_info:mongodb-eflsbm-backup-mongodb-0 4/4 Running 0 3m41s mongodb-eflsbm-backup-mongodb-1 4/4 Running 0 3m28s mongodb-eflsbm-backup-mongodb-2 4/4 Running 0 3m Cluster mongodb-eflsbm-backup deleted No resources found in default namespace. delete cluster pod done No resources found in default namespace. check cluster resource non-exist OK: pvc No resources found in default namespace. delete cluster done No resources found in default namespace. No resources found in default namespace. check resource cm non exists No resources found in default namespace. check resource cm non exists No resources found in default namespace. cluster delete backup `kubectl patch -p '{"metadata":{"finalizers":[]}}' --type=merge backups backup-default-mongodb-eflsbm-20260212125515 --namespace default ` backup.dataprotection.kubeblocks.io/backup-default-mongodb-eflsbm-20260212125515 patched `kbcli cluster delete-backup mongodb-eflsbm --name backup-default-mongodb-eflsbm-20260212125515 --force --auto-approve --namespace default ` Backup backup-default-mongodb-eflsbm-20260212125515 deleted No opsrequests found in default namespace. cluster datafile backup `kubectl get backuprepo backuprepo-kbcli-test -o jsonpath="{.spec.credential.name}"` `kubectl get backuprepo backuprepo-kbcli-test -o jsonpath="{.spec.credential.namespace}"` `kubectl get secrets kb-backuprepo-cg5kj -n kb-system -o jsonpath="{.data.accessKeyId}"` `kubectl get secrets kb-backuprepo-cg5kj -n kb-system -o jsonpath="{.data.secretAccessKey}"` KUBEBLOCKS NAMESPACE:kb-system get kubeblocks namespace done `kubectl get secrets -l app.kubernetes.io/instance=kbcli-test-minio --namespace kb-system -o jsonpath="{.items[0].data.root-user}"` `kubectl get secrets -l app.kubernetes.io/instance=kbcli-test-minio --namespace kb-system -o jsonpath="{.items[0].data.root-password}"` minio_user:kbclitest,minio_password:kbclitest,minio_endpoint:kbcli-test-minio.kb-system.svc.cluster.local:9000 list minio bucket kbcli-test `echo 'mc alias set minioserver http://kbcli-test-minio.kb-system.svc.cluster.local:9000 kbclitest kbclitest;mc ls minioserver' | kubectl exec -it kbcli-test-minio-79497b7755-qk8gw --namespace kb-system -- bash` Unable to use a TTY - input is not a terminal or the right kind of file list minio bucket done default backuprepo:backuprepo-kbcli-test exists `kbcli cluster backup mongodb-eflsbm --method datafile --namespace default ` Backup backup-default-mongodb-eflsbm-20260212130140 created successfully, you can view the progress: kbcli cluster list-backups --names=backup-default-mongodb-eflsbm-20260212130140 -n default check backup status `kbcli cluster list-backups mongodb-eflsbm --namespace default ` NAME NAMESPACE SOURCE-CLUSTER METHOD STATUS TOTAL-SIZE DURATION DELETION-POLICY CREATE-TIME COMPLETION-TIME EXPIRATION backup-default-mongodb-eflsbm-20260212130140 default mongodb-eflsbm datafile Running Delete Feb 12,2026 13:01 UTC+0800 backup_status:mongodb-eflsbm-datafile-Running backup_status:mongodb-eflsbm-datafile-Running backup_status:mongodb-eflsbm-datafile-Running backup_status:mongodb-eflsbm-datafile-Running backup_status:mongodb-eflsbm-datafile-Running backup_status:mongodb-eflsbm-datafile-Running backup_status:mongodb-eflsbm-datafile-Running backup_status:mongodb-eflsbm-datafile-Running backup_status:mongodb-eflsbm-datafile-Running backup_status:mongodb-eflsbm-datafile-Running backup_status:mongodb-eflsbm-datafile-Running check backup status done backup_status:backup-default-mongodb-eflsbm-20260212130140 default mongodb-eflsbm datafile Completed 2658578 59s Delete Feb 12,2026 13:01 UTC+0800 Feb 12,2026 13:02 UTC+0800 cluster restore backup Error from server (NotFound): opsrequests.operations.kubeblocks.io "mongodb-eflsbm-backup" not found `kbcli cluster describe-backup --names backup-default-mongodb-eflsbm-20260212130140 --namespace default ` Name: backup-default-mongodb-eflsbm-20260212130140 Cluster: mongodb-eflsbm Namespace: default Spec: Method: datafile Policy Name: mongodb-eflsbm-mongodb-backup-policy Actions: dp-backup-0: ActionType: Job WorkloadName: dp-backup-0-backup-default-mongodb-eflsbm-20260212130140-a50369 TargetPodName: mongodb-eflsbm-mongodb-0 Phase: Completed Start Time: Feb 12,2026 13:01 UTC+0800 Completion Time: Feb 12,2026 13:02 UTC+0800 Status: Phase: Completed Total Size: 2658578 ActionSet Name: mongodb-physical-br Repository: backuprepo-kbcli-test Duration: 59s Start Time: Feb 12,2026 13:01 UTC+0800 Completion Time: Feb 12,2026 13:02 UTC+0800 Path: /default/mongodb-eflsbm-156baf7f-b63b-4601-a105-9c09306a9deb/mongodb/backup-default-mongodb-eflsbm-20260212130140 Time Range Start: Feb 12,2026 13:02 UTC+0800 Time Range End: Feb 12,2026 13:02 UTC+0800 Warning Events: `kbcli cluster restore mongodb-eflsbm-backup --backup backup-default-mongodb-eflsbm-20260212130140 --namespace default ` Cluster mongodb-eflsbm-backup created check cluster status `kbcli cluster list mongodb-eflsbm-backup --show-labels --namespace default ` NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS mongodb-eflsbm-backup default mongodb WipeOut Creating Feb 12,2026 13:02 UTC+0800 clusterdefinition.kubeblocks.io/name=mongodb cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances mongodb-eflsbm-backup --namespace default ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME mongodb-eflsbm-backup-mongodb-0 default mongodb-eflsbm-backup mongodb Running primary cn-guangzhou-b 200m / 200m 644245094400m / 644245094400m data:25Gi 192.168.0.199/192.168.0.199 Feb 12,2026 13:05 UTC+0800 mongodb-eflsbm-backup-mongodb-1 default mongodb-eflsbm-backup mongodb Running secondary cn-guangzhou-b 200m / 200m 644245094400m / 644245094400m data:25Gi 192.168.0.13/192.168.0.13 Feb 12,2026 13:05 UTC+0800 mongodb-eflsbm-backup-mongodb-2 default mongodb-eflsbm-backup mongodb Running secondary cn-guangzhou-b 200m / 200m 644245094400m / 644245094400m data:25Gi 192.168.0.159/192.168.0.159 Feb 12,2026 13:05 UTC+0800 check pod status done check cluster role check cluster role done primary: mongodb-eflsbm-backup-mongodb-0;secondary: mongodb-eflsbm-backup-mongodb-1 mongodb-eflsbm-backup-mongodb-2 `kubectl get secrets -l app.kubernetes.io/instance=mongodb-eflsbm-backup` `kubectl get secrets mongodb-eflsbm-backup-mongodb-account-root -o jsonpath="{.data.username}"` `kubectl get secrets mongodb-eflsbm-backup-mongodb-account-root -o jsonpath="{.data.password}"` `kubectl get secrets mongodb-eflsbm-backup-mongodb-account-root -o jsonpath="{.data.port}"` DB_USERNAME:root;DB_PASSWORD:403nfj8Y0jh2R14x;DB_PORT:27017;DB_DATABASE: No resources found in default namespace. check cluster connect `echo " echo \"\" | mongo --host mongodb-eflsbm-backup-mongodb-mongodb.default.svc.cluster.local --port 27017 -u root -p 403nfj8Y0jh2R14x --authenticationDatabase admin admin " | kubectl exec -it mongodb-eflsbm-backup-mongodb-0 --namespace default -- bash` check cluster connect done `kbcli cluster describe-backup --names backup-default-mongodb-eflsbm-20260212130140 --namespace default ` Name: backup-default-mongodb-eflsbm-20260212130140 Cluster: mongodb-eflsbm Namespace: default Spec: Method: datafile Policy Name: mongodb-eflsbm-mongodb-backup-policy Actions: dp-backup-0: ActionType: Job WorkloadName: dp-backup-0-backup-default-mongodb-eflsbm-20260212130140-a50369 TargetPodName: mongodb-eflsbm-mongodb-0 Phase: Completed Start Time: Feb 12,2026 13:01 UTC+0800 Completion Time: Feb 12,2026 13:02 UTC+0800 Status: Phase: Completed Total Size: 2658578 ActionSet Name: mongodb-physical-br Repository: backuprepo-kbcli-test Duration: 59s Start Time: Feb 12,2026 13:01 UTC+0800 Completion Time: Feb 12,2026 13:02 UTC+0800 Path: /default/mongodb-eflsbm-156baf7f-b63b-4601-a105-9c09306a9deb/mongodb/backup-default-mongodb-eflsbm-20260212130140 Time Range Start: Feb 12,2026 13:02 UTC+0800 Time Range End: Feb 12,2026 13:02 UTC+0800 Warning Events: cluster connect `kubectl get secrets -l app.kubernetes.io/instance=mongodb-eflsbm-backup` `kubectl get secrets mongodb-eflsbm-backup-mongodb-account-root -o jsonpath="{.data.username}"` `kubectl get secrets mongodb-eflsbm-backup-mongodb-account-root -o jsonpath="{.data.password}"` `kubectl get secrets mongodb-eflsbm-backup-mongodb-account-root -o jsonpath="{.data.port}"` DB_USERNAME:root;DB_PASSWORD:403nfj8Y0jh2R14x;DB_PORT:27017;DB_DATABASE: No resources found in default namespace. `echo " echo \"rs.status()\" | mongo --host mongodb-eflsbm-backup-mongodb-mongodb.default.svc.cluster.local --port 27017 -u root -p 403nfj8Y0jh2R14x --authenticationDatabase admin admin " | kubectl exec -it mongodb-eflsbm-backup-mongodb-0 --namespace default -- bash ` Defaulted container "mongodb" out of: mongodb, mongodb-backup-agent, exporter, kbagent, init-syncer (init), init-kubectl (init), init-pbm-agent (init), init-kbagent (init), kbagent-worker (init) Unable to use a TTY - input is not a terminal or the right kind of file Percona Server for MongoDB shell version v4.4.29-28 connecting to: mongodb://mongodb-eflsbm-backup-mongodb-mongodb.default.svc.cluster.local:27017/admin?authSource=admin&compressors=disabled&gssapiServiceName=mongodb Implicit session: session { "id" : UUID("541d6713-aade-4fba-8e4e-f295b8ce8885") } Percona Server for MongoDB server version: v4.4.29-28 { "set" : "mongodb-eflsbm-backup-mongodb", "date" : ISODate("2026-02-12T05:06:54.842Z"), "myState" : 1, "term" : NumberLong(1), "syncSourceHost" : "", "syncSourceId" : -1, "heartbeatIntervalMillis" : NumberLong(2000), "majorityVoteCount" : 2, "writeMajorityCount" : 2, "votingMembersCount" : 3, "writableVotingMembersCount" : 3, "optimes" : { "lastCommittedOpTime" : { "ts" : Timestamp(1770872811, 3), "t" : NumberLong(1) }, "lastCommittedWallTime" : ISODate("2026-02-12T05:06:51.166Z"), "readConcernMajorityOpTime" : { "ts" : Timestamp(1770872811, 3), "t" : NumberLong(1) }, "readConcernMajorityWallTime" : ISODate("2026-02-12T05:06:51.166Z"), "appliedOpTime" : { "ts" : Timestamp(1770872811, 3), "t" : NumberLong(1) }, "durableOpTime" : { "ts" : Timestamp(1770872811, 3), "t" : NumberLong(1) }, "lastAppliedWallTime" : ISODate("2026-02-12T05:06:51.166Z"), "lastDurableWallTime" : ISODate("2026-02-12T05:06:51.166Z") }, "lastStableRecoveryTimestamp" : Timestamp(1770872804, 10), "electionCandidateMetrics" : { "lastElectionReason" : "electionTimeout", "lastElectionDate" : ISODate("2026-02-12T05:05:44.842Z"), "electionTerm" : NumberLong(1), "lastCommittedOpTimeAtElection" : { "ts" : Timestamp(0, 0), "t" : NumberLong(-1) }, "lastSeenOpTimeAtElection" : { "ts" : Timestamp(1770872744, 1), "t" : NumberLong(-1) }, "numVotesNeeded" : 1, "priorityAtElection" : 2, "electionTimeoutMillis" : NumberLong(10000), "newTermStartDate" : ISODate("2026-02-12T05:05:44.846Z"), "wMajorityWriteAvailabilityDate" : ISODate("2026-02-12T05:05:44.945Z") }, "members" : [ { "_id" : 0, "name" : "mongodb-eflsbm-backup-mongodb-0.mongodb-eflsbm-backup-mongodb-headless.default.svc:27017", "health" : 1, "state" : 1, "stateStr" : "PRIMARY", "uptime" : 75, "optime" : { "ts" : Timestamp(1770872811, 3), "t" : NumberLong(1) }, "optimeDate" : ISODate("2026-02-12T05:06:51Z"), "lastAppliedWallTime" : ISODate("2026-02-12T05:06:51.166Z"), "lastDurableWallTime" : ISODate("2026-02-12T05:06:51.166Z"), "syncSourceHost" : "", "syncSourceId" : -1, "infoMessage" : "Could not find member to sync from", "electionTime" : Timestamp(1770872744, 2), "electionDate" : ISODate("2026-02-12T05:05:44Z"), "configVersion" : 3, "configTerm" : 1, "self" : true, "lastHeartbeatMessage" : "" }, { "_id" : 1, "name" : "mongodb-eflsbm-backup-mongodb-1.mongodb-eflsbm-backup-mongodb-headless.default.svc:27017", "health" : 1, "state" : 2, "stateStr" : "SECONDARY", "uptime" : 28, "optime" : { "ts" : Timestamp(1770872811, 3), "t" : NumberLong(1) }, "optimeDurable" : { "ts" : Timestamp(1770872811, 3), "t" : NumberLong(1) }, "optimeDate" : ISODate("2026-02-12T05:06:51Z"), "optimeDurableDate" : ISODate("2026-02-12T05:06:51Z"), "lastAppliedWallTime" : ISODate("2026-02-12T05:06:51.166Z"), "lastDurableWallTime" : ISODate("2026-02-12T05:06:51.166Z"), "lastHeartbeat" : ISODate("2026-02-12T05:06:53.850Z"), "lastHeartbeatRecv" : ISODate("2026-02-12T05:06:54.353Z"), "pingMs" : NumberLong(0), "lastHeartbeatMessage" : "", "syncSourceHost" : "mongodb-eflsbm-backup-mongodb-0.mongodb-eflsbm-backup-mongodb-headless.default.svc:27017", "syncSourceId" : 0, "infoMessage" : "", "configVersion" : 3, "configTerm" : 1 }, { "_id" : 2, "name" : "mongodb-eflsbm-backup-mongodb-2.mongodb-eflsbm-backup-mongodb-headless.default.svc:27017", "health" : 1, "state" : 2, "stateStr" : "SECONDARY", "uptime" : 12, "optime" : { "ts" : Timestamp(1770872811, 3), "t" : NumberLong(1) }, "optimeDurable" : { "ts" : Timestamp(1770872811, 3), "t" : NumberLong(1) }, "optimeDate" : ISODate("2026-02-12T05:06:51Z"), "optimeDurableDate" : ISODate("2026-02-12T05:06:51Z"), "lastAppliedWallTime" : ISODate("2026-02-12T05:06:51.166Z"), "lastDurableWallTime" : ISODate("2026-02-12T05:06:51.166Z"), "lastHeartbeat" : ISODate("2026-02-12T05:06:53.924Z"), "lastHeartbeatRecv" : ISODate("2026-02-12T05:06:53.942Z"), "pingMs" : NumberLong(0), "lastHeartbeatMessage" : "", "syncSourceHost" : "mongodb-eflsbm-backup-mongodb-1.mongodb-eflsbm-backup-mongodb-headless.default.svc:27017", "syncSourceId" : 1, "infoMessage" : "", "configVersion" : 3, "configTerm" : 1 } ], "ok" : 1, "$clusterTime" : { "clusterTime" : Timestamp(1770872811, 3), "signature" : { "hash" : BinData(0,"AAAAAAAAAAAAAAAAAAAAAAAAAAA="), "keyId" : NumberLong(0) } }, "operationTime" : Timestamp(1770872811, 3) } bye connect cluster Success delete cluster mongodb-eflsbm-backup `kbcli cluster delete mongodb-eflsbm-backup --auto-approve --namespace default ` Cluster mongodb-eflsbm-backup deleted pod_info:mongodb-eflsbm-backup-mongodb-0 4/4 Running 0 93s mongodb-eflsbm-backup-mongodb-1 4/4 Running 0 79s mongodb-eflsbm-backup-mongodb-2 4/4 Running 0 64s No resources found in default namespace. delete cluster pod done No resources found in default namespace. check cluster resource non-exist OK: pvc No resources found in default namespace. delete cluster done No resources found in default namespace. No resources found in default namespace. check resource cm non exists No resources found in default namespace. check resource cm non exists No resources found in default namespace. cluster rebuild instances apiVersion: operations.kubeblocks.io/v1alpha1 kind: OpsRequest metadata: generateName: mongodb-eflsbm-rebuildinstance- namespace: default spec: type: RebuildInstance clusterName: mongodb-eflsbm force: true rebuildFrom: - componentName: mongodb instances: - name: mongodb-eflsbm-mongodb-0 inPlace: true check cluster status before ops check cluster status done cluster_status:Running `kubectl create -f test_ops_cluster_mongodb-eflsbm.yaml` opsrequest.operations.kubeblocks.io/mongodb-eflsbm-rebuildinstance-8c4hv created create test_ops_cluster_mongodb-eflsbm.yaml Success `rm -rf test_ops_cluster_mongodb-eflsbm.yaml` check ops status `kbcli cluster list-ops mongodb-eflsbm --status all --namespace default ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME mongodb-eflsbm-rebuildinstance-8c4hv default RebuildInstance mongodb-eflsbm mongodb Running 0/1 Feb 12,2026 13:07 UTC+0800 ops_status:mongodb-eflsbm-rebuildinstance-8c4hv default RebuildInstance mongodb-eflsbm mongodb Running 0/1 Feb 12,2026 13:07 UTC+0800 ops_status:mongodb-eflsbm-rebuildinstance-8c4hv default RebuildInstance mongodb-eflsbm mongodb Running 0/1 Feb 12,2026 13:07 UTC+0800 ops_status:mongodb-eflsbm-rebuildinstance-8c4hv default RebuildInstance mongodb-eflsbm mongodb Running 0/1 Feb 12,2026 13:07 UTC+0800 ops_status:mongodb-eflsbm-rebuildinstance-8c4hv default RebuildInstance mongodb-eflsbm mongodb Running 0/1 Feb 12,2026 13:07 UTC+0800 ops_status:mongodb-eflsbm-rebuildinstance-8c4hv default RebuildInstance mongodb-eflsbm mongodb Running 0/1 Feb 12,2026 13:07 UTC+0800 ops_status:mongodb-eflsbm-rebuildinstance-8c4hv default RebuildInstance mongodb-eflsbm mongodb Running 0/1 Feb 12,2026 13:07 UTC+0800 ops_status:mongodb-eflsbm-rebuildinstance-8c4hv default RebuildInstance mongodb-eflsbm mongodb Running 0/1 Feb 12,2026 13:07 UTC+0800 ops_status:mongodb-eflsbm-rebuildinstance-8c4hv default RebuildInstance mongodb-eflsbm mongodb Running 0/1 Feb 12,2026 13:07 UTC+0800 ops_status:mongodb-eflsbm-rebuildinstance-8c4hv default RebuildInstance mongodb-eflsbm mongodb Running 0/1 Feb 12,2026 13:07 UTC+0800 ops_status:mongodb-eflsbm-rebuildinstance-8c4hv default RebuildInstance mongodb-eflsbm mongodb Running 0/1 Feb 12,2026 13:07 UTC+0800 ops_status:mongodb-eflsbm-rebuildinstance-8c4hv default RebuildInstance mongodb-eflsbm mongodb Running 0/1 Feb 12,2026 13:07 UTC+0800 ops_status:mongodb-eflsbm-rebuildinstance-8c4hv default RebuildInstance mongodb-eflsbm mongodb Running 0/1 Feb 12,2026 13:07 UTC+0800 check ops status done ops_status:mongodb-eflsbm-rebuildinstance-8c4hv default RebuildInstance mongodb-eflsbm mongodb Succeed 1/1 Feb 12,2026 13:07 UTC+0800 `kubectl patch -p '{"metadata":{"finalizers":[]}}' --type=merge opsrequests.operations mongodb-eflsbm-rebuildinstance-8c4hv --namespace default ` opsrequest.operations.kubeblocks.io/mongodb-eflsbm-rebuildinstance-8c4hv patched `kbcli cluster delete-ops --name mongodb-eflsbm-rebuildinstance-8c4hv --force --auto-approve --namespace default ` OpsRequest mongodb-eflsbm-rebuildinstance-8c4hv deleted check cluster status `kbcli cluster list mongodb-eflsbm --show-labels --namespace default ` NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS mongodb-eflsbm default mongodb WipeOut Running Feb 12,2026 12:11 UTC+0800 app.kubernetes.io/instance=mongodb-eflsbm,clusterdefinition.kubeblocks.io/name=mongodb check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances mongodb-eflsbm --namespace default ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME mongodb-eflsbm-mongodb-0 default mongodb-eflsbm mongodb Running secondary cn-guangzhou-b 200m / 200m 644245094400m / 644245094400m data:25Gi 192.168.0.199/192.168.0.199 Feb 12,2026 13:07 UTC+0800 mongodb-eflsbm-mongodb-2 default mongodb-eflsbm mongodb Running primary cn-guangzhou-b 200m / 200m 644245094400m / 644245094400m data:25Gi 192.168.0.199/192.168.0.199 Feb 12,2026 12:45 UTC+0800 mongodb-eflsbm-mongodb-3 default mongodb-eflsbm mongodb Running secondary cn-guangzhou-b 200m / 200m 644245094400m / 644245094400m data:25Gi 192.168.0.200/192.168.0.200 Feb 12,2026 12:43 UTC+0800 check pod status done check cluster role check cluster role done primary: mongodb-eflsbm-mongodb-2;secondary: mongodb-eflsbm-mongodb-0 mongodb-eflsbm-mongodb-3 `kubectl get secrets -l app.kubernetes.io/instance=mongodb-eflsbm` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.username}"` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.password}"` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.port}"` DB_USERNAME:root;DB_PASSWORD:403nfj8Y0jh2R14x;DB_PORT:27017;DB_DATABASE: No resources found in default namespace. check cluster connect `echo " echo \"\" | mongo --host mongodb-eflsbm-mongodb-mongodb.default.svc.cluster.local --port 27017 -u root -p 403nfj8Y0jh2R14x --authenticationDatabase admin admin " | kubectl exec -it mongodb-eflsbm-mongodb-2 --namespace default -- bash` check cluster connect done `kubectl get secrets -l app.kubernetes.io/instance=mongodb-eflsbm` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.username}"` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.password}"` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.port}"` DB_USERNAME:root;DB_PASSWORD:403nfj8Y0jh2R14x;DB_PORT:27017;DB_DATABASE: No resources found in default namespace. `echo "echo \"db.col.find()\" | mongo --host mongodb-eflsbm-mongodb-mongodb.default.svc.cluster.local --port 27017 -u root -p 403nfj8Y0jh2R14x --authenticationDatabase admin admin " | kubectl exec -it mongodb-eflsbm-mongodb-2 --namespace default -- bash ` check data: Defaulted container "mongodb" out of: mongodb, mongodb-backup-agent, exporter, kbagent, init-syncer (init), init-kubectl (init), init-pbm-agent (init), init-kbagent (init), kbagent-worker (init) Unable to use a TTY - input is not a terminal or the right kind of file Percona Server for MongoDB shell version v4.4.29-28 connecting to: mongodb://mongodb-eflsbm-mongodb-mongodb.default.svc.cluster.local:27017/admin?authSource=admin&compressors=disabled&gssapiServiceName=mongodb Implicit session: session { "id" : UUID("36bb227e-4069-4a68-92c5-06104c8583ad") } Percona Server for MongoDB server version: v4.4.29-28 { "_id" : ObjectId("698d539a50ef62d9286bd4cf"), "a" : "nelsi" } bye check cluster data consistent Success `kubectl get secrets -l app.kubernetes.io/instance=mongodb-eflsbm` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.username}"` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.password}"` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.port}"` DB_USERNAME:root;DB_PASSWORD:403nfj8Y0jh2R14x;DB_PORT:27017;DB_DATABASE: No resources found in default namespace. `echo "echo \"db.col.find().readPref('secondary')\" | mongo --host mongodb-eflsbm-mongodb-mongodb-ro.default.svc.cluster.local --port 27017 -u root -p 403nfj8Y0jh2R14x --authenticationDatabase admin admin " | kubectl exec -it mongodb-eflsbm-mongodb-0 --namespace default -- bash ` check readonly data: Defaulted container "mongodb" out of: mongodb, mongodb-backup-agent, exporter, kbagent, init-syncer (init), init-kubectl (init), init-pbm-agent (init), init-kbagent (init), kbagent-worker (init) Unable to use a TTY - input is not a terminal or the right kind of file Percona Server for MongoDB shell version v4.4.29-28 connecting to: mongodb://mongodb-eflsbm-mongodb-mongodb-ro.default.svc.cluster.local:27017/admin?authSource=admin&compressors=disabled&gssapiServiceName=mongodb Implicit session: session { "id" : UUID("cb57f1a9-c3b8-42d3-9385-3b1ad9f81305") } Percona Server for MongoDB server version: v4.4.29-28 { "_id" : ObjectId("698d539a50ef62d9286bd4cf"), "a" : "nelsi" } bye check cluster readonly data consistent Success `kubectl get secrets -l app.kubernetes.io/instance=mongodb-eflsbm` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.username}"` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.password}"` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.port}"` DB_USERNAME:root;DB_PASSWORD:403nfj8Y0jh2R14x;DB_PORT:27017;DB_DATABASE: No resources found in default namespace. check db_client batch data count `echo "echo \"db.executions_loop_table.estimatedDocumentCount();\" | mongo --host mongodb-eflsbm-mongodb-mongodb.default.svc.cluster.local --port 27017 -u root -p 403nfj8Y0jh2R14x --authenticationDatabase admin admin " | kubectl exec -it mongodb-eflsbm-mongodb-2 --namespace default -- bash ` check db_client batch [23154] equal [23154] data Success cluster delete backup `kubectl patch -p '{"metadata":{"finalizers":[]}}' --type=merge backups backup-default-mongodb-eflsbm-20260212130140 --namespace default ` backup.dataprotection.kubeblocks.io/backup-default-mongodb-eflsbm-20260212130140 patched `kbcli cluster delete-backup mongodb-eflsbm --name backup-default-mongodb-eflsbm-20260212130140 --force --auto-approve --namespace default ` Backup backup-default-mongodb-eflsbm-20260212130140 deleted No opsrequests found in default namespace. check cluster storage class cluster volume-snapshot backup `kbcli cluster backup mongodb-eflsbm --method volume-snapshot --namespace default ` Backup backup-default-mongodb-eflsbm-20260212130844 created successfully, you can view the progress: kbcli cluster list-backups --names=backup-default-mongodb-eflsbm-20260212130844 -n default check backup status `kbcli cluster list-backups mongodb-eflsbm --namespace default ` NAME NAMESPACE SOURCE-CLUSTER METHOD STATUS TOTAL-SIZE DURATION DELETION-POLICY CREATE-TIME COMPLETION-TIME EXPIRATION backup-default-mongodb-eflsbm-20260212130844 default mongodb-eflsbm volume-snapshot Running Delete Feb 12,2026 13:08 UTC+0800 backup_status:mongodb-eflsbm-volume-snapshot-Running backup_status:mongodb-eflsbm-volume-snapshot-Running backup_status:mongodb-eflsbm-volume-snapshot-Running backup_status:mongodb-eflsbm-volume-snapshot-Running backup_status:mongodb-eflsbm-volume-snapshot-Running backup_status:mongodb-eflsbm-volume-snapshot-Running backup_status:mongodb-eflsbm-volume-snapshot-Running backup_status:mongodb-eflsbm-volume-snapshot-Running backup_status:mongodb-eflsbm-volume-snapshot-Running backup_status:mongodb-eflsbm-volume-snapshot-Running backup_status:mongodb-eflsbm-volume-snapshot-Running backup_status:mongodb-eflsbm-volume-snapshot-Running backup_status:mongodb-eflsbm-volume-snapshot-Running backup_status:mongodb-eflsbm-volume-snapshot-Running backup_status:mongodb-eflsbm-volume-snapshot-Running backup_status:mongodb-eflsbm-volume-snapshot-Running backup_status:mongodb-eflsbm-volume-snapshot-Running check backup status done backup_status:backup-default-mongodb-eflsbm-20260212130844 default mongodb-eflsbm volume-snapshot Completed 25Gi 92s Delete Feb 12,2026 13:08 UTC+0800 Feb 12,2026 13:10 UTC+0800 cluster restore backup Error from server (NotFound): opsrequests.operations.kubeblocks.io "mongodb-eflsbm-backup" not found `kbcli cluster describe-backup --names backup-default-mongodb-eflsbm-20260212130844 --namespace default ` Name: backup-default-mongodb-eflsbm-20260212130844 Cluster: mongodb-eflsbm Namespace: default Spec: Method: volume-snapshot Policy Name: mongodb-eflsbm-mongodb-backup-policy Actions: createVolumeSnapshot-0: panic: runtime error: invalid memory address or nil pointer dereference [signal SIGSEGV: segmentation violation code=0x2 addr=0x20 pc=0x1052739b8] goroutine 1 [running]: github.com/apecloud/kbcli/pkg/cmd/dataprotection.PrintBackupObjDescribe(0x140011fc6c0, 0x14000ca2008) /home/runner/work/kbcli/kbcli/pkg/cmd/dataprotection/backup.go:480 +0x3a8 github.com/apecloud/kbcli/pkg/cmd/dataprotection.DescribeBackups(0x140011fc6c0, {0x14001754ab0?, 0x140015efb98?, 0x105279668?}) /home/runner/work/kbcli/kbcli/pkg/cmd/dataprotection/backup.go:458 +0xe0 github.com/apecloud/kbcli/pkg/cmd/cluster.describeBackups(0x0?, {0x14000b75b80?, 0x0?, 0xbfa960618740a6b2?}) /home/runner/work/kbcli/kbcli/pkg/cmd/cluster/dataprotection.go:204 +0x6c github.com/apecloud/kbcli/pkg/cmd/cluster.NewDescribeBackupCmd.func1(0x140012baf08?, {0x14000b75b80, 0x0, 0x4}) /home/runner/work/kbcli/kbcli/pkg/cmd/cluster/dataprotection.go:195 +0xe0 github.com/spf13/cobra.(*Command).execute(0x140012baf08, {0x14000b75b40, 0x4, 0x4}) /home/runner/go/pkg/mod/github.com/spf13/cobra@v1.9.1/command.go:1019 +0x82c github.com/spf13/cobra.(*Command).ExecuteC(0x1400071b508) /home/runner/go/pkg/mod/github.com/spf13/cobra@v1.9.1/command.go:1148 +0x384 github.com/spf13/cobra.(*Command).Execute(...) /home/runner/go/pkg/mod/github.com/spf13/cobra@v1.9.1/command.go:1071 k8s.io/component-base/cli.run(0x1400071b508) /home/runner/go/pkg/mod/k8s.io/component-base@v0.29.14/cli/run.go:146 +0x250 k8s.io/component-base/cli.RunNoErrOutput(...) /home/runner/go/pkg/mod/k8s.io/component-base@v0.29.14/cli/run.go:84 main.main() /home/runner/work/kbcli/kbcli/cmd/cli/main.go:31 +0x20 `kbcli cluster restore mongodb-eflsbm-backup --backup backup-default-mongodb-eflsbm-20260212130844 --namespace default ` Cluster mongodb-eflsbm-backup created check cluster status `kbcli cluster list mongodb-eflsbm-backup --show-labels --namespace default ` NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS mongodb-eflsbm-backup default mongodb WipeOut Creating Feb 12,2026 13:10 UTC+0800 clusterdefinition.kubeblocks.io/name=mongodb cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances mongodb-eflsbm-backup --namespace default ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME mongodb-eflsbm-backup-mongodb-0 default mongodb-eflsbm-backup mongodb Running primary cn-guangzhou-b 200m / 200m 644245094400m / 644245094400m data:25Gi 192.168.0.199/192.168.0.199 Feb 12,2026 13:10 UTC+0800 mongodb-eflsbm-backup-mongodb-1 default mongodb-eflsbm-backup mongodb Running secondary cn-guangzhou-b 200m / 200m 644245094400m / 644245094400m data:25Gi 192.168.0.13/192.168.0.13 Feb 12,2026 13:10 UTC+0800 mongodb-eflsbm-backup-mongodb-2 default mongodb-eflsbm-backup mongodb Running secondary cn-guangzhou-b 200m / 200m 644245094400m / 644245094400m data:25Gi 192.168.0.200/192.168.0.200 Feb 12,2026 13:11 UTC+0800 check pod status done check cluster role check cluster role done primary: mongodb-eflsbm-backup-mongodb-0;secondary: mongodb-eflsbm-backup-mongodb-1 mongodb-eflsbm-backup-mongodb-2 `kubectl get secrets -l app.kubernetes.io/instance=mongodb-eflsbm-backup` `kubectl get secrets mongodb-eflsbm-backup-mongodb-account-root -o jsonpath="{.data.username}"` `kubectl get secrets mongodb-eflsbm-backup-mongodb-account-root -o jsonpath="{.data.password}"` `kubectl get secrets mongodb-eflsbm-backup-mongodb-account-root -o jsonpath="{.data.port}"` DB_USERNAME:root;DB_PASSWORD:403nfj8Y0jh2R14x;DB_PORT:27017;DB_DATABASE: No resources found in default namespace. check cluster connect `echo " echo \"\" | mongo --host mongodb-eflsbm-backup-mongodb-mongodb.default.svc.cluster.local --port 27017 -u root -p 403nfj8Y0jh2R14x --authenticationDatabase admin admin " | kubectl exec -it mongodb-eflsbm-backup-mongodb-0 --namespace default -- bash` check cluster connect done `kbcli cluster describe-backup --names backup-default-mongodb-eflsbm-20260212130844 --namespace default ` Name: backup-default-mongodb-eflsbm-20260212130844 Cluster: mongodb-eflsbm Namespace: default Spec: Method: volume-snapshot Policy Name: mongodb-eflsbm-mongodb-backup-policy Actions: createVolumeSnapshot-0: panic: runtime error: invalid memory address or nil pointer dereference [signal SIGSEGV: segmentation violation code=0x2 addr=0x20 pc=0x1074439b8] goroutine 1 [running]: github.com/apecloud/kbcli/pkg/cmd/dataprotection.PrintBackupObjDescribe(0x14000b68240, 0x14000868588) /home/runner/work/kbcli/kbcli/pkg/cmd/dataprotection/backup.go:480 +0x3a8 github.com/apecloud/kbcli/pkg/cmd/dataprotection.DescribeBackups(0x14000b68240, {0x14001115140?, 0x1400143fb98?, 0x107449668?}) /home/runner/work/kbcli/kbcli/pkg/cmd/dataprotection/backup.go:458 +0xe0 github.com/apecloud/kbcli/pkg/cmd/cluster.describeBackups(0x0?, {0x14000bed740?, 0x0?, 0x58e53e36f49c4c27?}) /home/runner/work/kbcli/kbcli/pkg/cmd/cluster/dataprotection.go:204 +0x6c github.com/apecloud/kbcli/pkg/cmd/cluster.NewDescribeBackupCmd.func1(0x14001134008?, {0x14000bed740, 0x0, 0x4}) /home/runner/work/kbcli/kbcli/pkg/cmd/cluster/dataprotection.go:195 +0xe0 github.com/spf13/cobra.(*Command).execute(0x14001134008, {0x14000bed700, 0x4, 0x4}) /home/runner/go/pkg/mod/github.com/spf13/cobra@v1.9.1/command.go:1019 +0x82c github.com/spf13/cobra.(*Command).ExecuteC(0x14000ec0908) /home/runner/go/pkg/mod/github.com/spf13/cobra@v1.9.1/command.go:1148 +0x384 github.com/spf13/cobra.(*Command).Execute(...) /home/runner/go/pkg/mod/github.com/spf13/cobra@v1.9.1/command.go:1071 k8s.io/component-base/cli.run(0x14000ec0908) /home/runner/go/pkg/mod/k8s.io/component-base@v0.29.14/cli/run.go:146 +0x250 k8s.io/component-base/cli.RunNoErrOutput(...) /home/runner/go/pkg/mod/k8s.io/component-base@v0.29.14/cli/run.go:84 main.main() /home/runner/work/kbcli/kbcli/cmd/cli/main.go:31 +0x20 cluster connect `kubectl get secrets -l app.kubernetes.io/instance=mongodb-eflsbm-backup` `kubectl get secrets mongodb-eflsbm-backup-mongodb-account-root -o jsonpath="{.data.username}"` `kubectl get secrets mongodb-eflsbm-backup-mongodb-account-root -o jsonpath="{.data.password}"` `kubectl get secrets mongodb-eflsbm-backup-mongodb-account-root -o jsonpath="{.data.port}"` DB_USERNAME:root;DB_PASSWORD:403nfj8Y0jh2R14x;DB_PORT:27017;DB_DATABASE: No resources found in default namespace. `echo " echo \"rs.status()\" | mongo --host mongodb-eflsbm-backup-mongodb-mongodb.default.svc.cluster.local --port 27017 -u root -p 403nfj8Y0jh2R14x --authenticationDatabase admin admin " | kubectl exec -it mongodb-eflsbm-backup-mongodb-0 --namespace default -- bash ` Defaulted container "mongodb" out of: mongodb, mongodb-backup-agent, exporter, kbagent, init-syncer (init), init-kubectl (init), init-pbm-agent (init), init-kbagent (init), kbagent-worker (init) Unable to use a TTY - input is not a terminal or the right kind of file Percona Server for MongoDB shell version v4.4.29-28 connecting to: mongodb://mongodb-eflsbm-backup-mongodb-mongodb.default.svc.cluster.local:27017/admin?authSource=admin&compressors=disabled&gssapiServiceName=mongodb Implicit session: session { "id" : UUID("4ae9d0f2-e5f4-4068-b3fe-89d91f17388e") } Percona Server for MongoDB server version: v4.4.29-28 { "set" : "mongodb-eflsbm-backup-mongodb", "date" : ISODate("2026-02-12T05:12:09.934Z"), "myState" : 1, "term" : NumberLong(1), "syncSourceHost" : "", "syncSourceId" : -1, "heartbeatIntervalMillis" : NumberLong(2000), "majorityVoteCount" : 2, "writeMajorityCount" : 2, "votingMembersCount" : 3, "writableVotingMembersCount" : 3, "optimes" : { "lastCommittedOpTime" : { "ts" : Timestamp(1770873128, 3), "t" : NumberLong(1) }, "lastCommittedWallTime" : ISODate("2026-02-12T05:12:08.956Z"), "readConcernMajorityOpTime" : { "ts" : Timestamp(1770873128, 3), "t" : NumberLong(1) }, "readConcernMajorityWallTime" : ISODate("2026-02-12T05:12:08.956Z"), "appliedOpTime" : { "ts" : Timestamp(1770873128, 3), "t" : NumberLong(1) }, "durableOpTime" : { "ts" : Timestamp(1770873128, 3), "t" : NumberLong(1) }, "lastAppliedWallTime" : ISODate("2026-02-12T05:12:08.956Z"), "lastDurableWallTime" : ISODate("2026-02-12T05:12:08.956Z") }, "lastStableRecoveryTimestamp" : Timestamp(1770873118, 1), "electionCandidateMetrics" : { "lastElectionReason" : "electionTimeout", "lastElectionDate" : ISODate("2026-02-12T05:11:00.429Z"), "electionTerm" : NumberLong(1), "lastCommittedOpTimeAtElection" : { "ts" : Timestamp(0, 0), "t" : NumberLong(-1) }, "lastSeenOpTimeAtElection" : { "ts" : Timestamp(1770873060, 1), "t" : NumberLong(-1) }, "numVotesNeeded" : 1, "priorityAtElection" : 2, "electionTimeoutMillis" : NumberLong(10000), "newTermStartDate" : ISODate("2026-02-12T05:11:00.435Z"), "wMajorityWriteAvailabilityDate" : ISODate("2026-02-12T05:11:00.533Z") }, "members" : [ { "_id" : 0, "name" : "mongodb-eflsbm-backup-mongodb-0.mongodb-eflsbm-backup-mongodb-headless.default.svc:27017", "health" : 1, "state" : 1, "stateStr" : "PRIMARY", "uptime" : 74, "optime" : { "ts" : Timestamp(1770873128, 3), "t" : NumberLong(1) }, "optimeDate" : ISODate("2026-02-12T05:12:08Z"), "lastAppliedWallTime" : ISODate("2026-02-12T05:12:08.956Z"), "lastDurableWallTime" : ISODate("2026-02-12T05:12:08.956Z"), "syncSourceHost" : "", "syncSourceId" : -1, "infoMessage" : "Could not find member to sync from", "electionTime" : Timestamp(1770873060, 2), "electionDate" : ISODate("2026-02-12T05:11:00Z"), "configVersion" : 3, "configTerm" : 1, "self" : true, "lastHeartbeatMessage" : "" }, { "_id" : 1, "name" : "mongodb-eflsbm-backup-mongodb-1.mongodb-eflsbm-backup-mongodb-headless.default.svc:27017", "health" : 1, "state" : 2, "stateStr" : "SECONDARY", "uptime" : 26, "optime" : { "ts" : Timestamp(1770873128, 3), "t" : NumberLong(1) }, "optimeDurable" : { "ts" : Timestamp(1770873128, 3), "t" : NumberLong(1) }, "optimeDate" : ISODate("2026-02-12T05:12:08Z"), "optimeDurableDate" : ISODate("2026-02-12T05:12:08Z"), "lastAppliedWallTime" : ISODate("2026-02-12T05:12:08.956Z"), "lastDurableWallTime" : ISODate("2026-02-12T05:12:08.956Z"), "lastHeartbeat" : ISODate("2026-02-12T05:12:09.732Z"), "lastHeartbeatRecv" : ISODate("2026-02-12T05:12:08.234Z"), "pingMs" : NumberLong(0), "lastHeartbeatMessage" : "", "syncSourceHost" : "mongodb-eflsbm-backup-mongodb-0.mongodb-eflsbm-backup-mongodb-headless.default.svc:27017", "syncSourceId" : 0, "infoMessage" : "", "configVersion" : 3, "configTerm" : 1 }, { "_id" : 2, "name" : "mongodb-eflsbm-backup-mongodb-2.mongodb-eflsbm-backup-mongodb-headless.default.svc:27017", "health" : 1, "state" : 2, "stateStr" : "SECONDARY", "uptime" : 12, "optime" : { "ts" : Timestamp(1770873128, 3), "t" : NumberLong(1) }, "optimeDurable" : { "ts" : Timestamp(1770873128, 3), "t" : NumberLong(1) }, "optimeDate" : ISODate("2026-02-12T05:12:08Z"), "optimeDurableDate" : ISODate("2026-02-12T05:12:08Z"), "lastAppliedWallTime" : ISODate("2026-02-12T05:12:08.956Z"), "lastDurableWallTime" : ISODate("2026-02-12T05:12:08.956Z"), "lastHeartbeat" : ISODate("2026-02-12T05:12:09.825Z"), "lastHeartbeatRecv" : ISODate("2026-02-12T05:12:08.502Z"), "pingMs" : NumberLong(0), "lastHeartbeatMessage" : "", "syncSourceHost" : "mongodb-eflsbm-backup-mongodb-1.mongodb-eflsbm-backup-mongodb-headless.default.svc:27017", "syncSourceId" : 1, "infoMessage" : "", "configVersion" : 3, "configTerm" : 1 } ], "ok" : 1, "$clusterTime" : { "clusterTime" : Timestamp(1770873128, 3), "signature" : { "hash" : BinData(0,"AAAAAAAAAAAAAAAAAAAAAAAAAAA="), "keyId" : NumberLong(0) } }, "operationTime" : Timestamp(1770873128, 3) } bye connect cluster Success delete cluster mongodb-eflsbm-backup `kbcli cluster delete mongodb-eflsbm-backup --auto-approve --namespace default ` pod_info:mongodb-eflsbm-backup-mongodb-0 4/4 Running 0 94s mongodb-eflsbm-backup-mongodb-1 4/4 Running 0 77s mongodb-eflsbm-backup-mongodb-2 4/4 Running 0 62s Cluster mongodb-eflsbm-backup deleted No resources found in default namespace. delete cluster pod done No resources found in default namespace. check cluster resource non-exist OK: pvc No resources found in default namespace. delete cluster done No resources found in default namespace. No resources found in default namespace. check resource cm non exists No resources found in default namespace. check resource cm non exists No resources found in default namespace. cluster delete backup `kubectl patch -p '{"metadata":{"finalizers":[]}}' --type=merge backups backup-default-mongodb-eflsbm-20260212130844 --namespace default ` backup.dataprotection.kubeblocks.io/backup-default-mongodb-eflsbm-20260212130844 patched `kbcli cluster delete-backup mongodb-eflsbm --name backup-default-mongodb-eflsbm-20260212130844 --force --auto-approve --namespace default ` Backup backup-default-mongodb-eflsbm-20260212130844 deleted No opsrequests found in default namespace. `kubectl get secrets -l app.kubernetes.io/instance=mongodb-eflsbm` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.username}"` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.password}"` `kubectl get secrets mongodb-eflsbm-mongodb-account-root -o jsonpath="{.data.port}"` DB_USERNAME:root;DB_PASSWORD:403nfj8Y0jh2R14x;DB_PORT:27017;DB_DATABASE: No resources found in default namespace. `db.msg.drop();db.createCollection('msg');db.msg.insertOne({msg: 'kbcli-test-data-eflsbm0',time: new Date()});db.msg.insertOne({msg: 'kbcli-test-data-eflsbm1',time: new Date()});db.msg.insertOne({msg: 'kbcli-test-data-eflsbm2',time: new Date()});db.msg.insertOne({msg: 'kbcli-test-data-eflsbm3',time: new Date()});db.msg.insertOne({msg: 'kbcli-test-data-eflsbm4',time: new Date()});db.msg.insertOne({msg: 'kbcli-test-data-eflsbm5',time: new Date()});db.msg.insertOne({msg: 'kbcli-test-data-eflsbm6',time: new Date()});db.msg.insertOne({msg: 'kbcli-test-data-eflsbm7',time: new Date()});db.msg.insertOne({msg: 'kbcli-test-data-eflsbm8',time: new Date()});db.msg.insertOne({msg: 'kbcli-test-data-eflsbm9',time: new Date()});db.msg.insertOne({msg: 'kbcli-test-data-eflsbm10',time: new Date()});db.msg.insertOne({msg: 'kbcli-test-data-eflsbm11',time: new Date()});db.msg.insertOne({msg: 'kbcli-test-data-eflsbm12',time: new Date()});db.msg.insertOne({msg: 'kbcli-test-data-eflsbm13',time: new Date()});db.msg.insertOne({msg: 'kbcli-test-data-eflsbm14',time: new Date()});db.msg.insertOne({msg: 'kbcli-test-data-eflsbm15',time: new Date()});` Defaulted container "mongodb" out of: mongodb, mongodb-backup-agent, exporter, kbagent, init-syncer (init), init-kubectl (init), init-pbm-agent (init), init-kbagent (init), kbagent-worker (init) Unable to use a TTY - input is not a terminal or the right kind of file bash: line 1: mongosh: command not found command terminated with exit code 127 Defaulted container "mongodb" out of: mongodb, mongodb-backup-agent, exporter, kbagent, init-syncer (init), init-kubectl (init), init-pbm-agent (init), init-kbagent (init), kbagent-worker (init) Unable to use a TTY - input is not a terminal or the right kind of file Percona Server for MongoDB shell version v4.4.29-28 connecting to: mongodb://mongodb-eflsbm-mongodb-mongodb.default.svc.cluster.local:27017/admin?authSource=admin&compressors=disabled&gssapiServiceName=mongodb Implicit session: session { "id" : UUID("8a84efe0-56c8-42e2-9f1f-b1971fd68161") } Percona Server for MongoDB server version: v4.4.29-28 { "acknowledged" : true, "insertedId" : ObjectId("698d6142d3ddb435c5d9889b") } bye cluster dump backup `kubectl get backuprepo backuprepo-kbcli-test -o jsonpath="{.spec.credential.name}"` `kubectl get backuprepo backuprepo-kbcli-test -o jsonpath="{.spec.credential.namespace}"` `kubectl get secrets kb-backuprepo-cg5kj -n kb-system -o jsonpath="{.data.accessKeyId}"` `kubectl get secrets kb-backuprepo-cg5kj -n kb-system -o jsonpath="{.data.secretAccessKey}"` KUBEBLOCKS NAMESPACE:kb-system get kubeblocks namespace done `kubectl get secrets -l app.kubernetes.io/instance=kbcli-test-minio --namespace kb-system -o jsonpath="{.items[0].data.root-user}"` `kubectl get secrets -l app.kubernetes.io/instance=kbcli-test-minio --namespace kb-system -o jsonpath="{.items[0].data.root-password}"` minio_user:kbclitest,minio_password:kbclitest,minio_endpoint:kbcli-test-minio.kb-system.svc.cluster.local:9000 list minio bucket kbcli-test `echo 'mc alias set minioserver http://kbcli-test-minio.kb-system.svc.cluster.local:9000 kbclitest kbclitest;mc ls minioserver' | kubectl exec -it kbcli-test-minio-79497b7755-qk8gw --namespace kb-system -- bash` Unable to use a TTY - input is not a terminal or the right kind of file list minio bucket done default backuprepo:backuprepo-kbcli-test exists `kbcli cluster backup mongodb-eflsbm --method dump --namespace default ` Backup backup-default-mongodb-eflsbm-20260212131237 created successfully, you can view the progress: kbcli cluster list-backups --names=backup-default-mongodb-eflsbm-20260212131237 -n default check backup status `kbcli cluster list-backups mongodb-eflsbm --namespace default ` NAME NAMESPACE SOURCE-CLUSTER METHOD STATUS TOTAL-SIZE DURATION DELETION-POLICY CREATE-TIME COMPLETION-TIME EXPIRATION backup-default-mongodb-eflsbm-20260212131237 default mongodb-eflsbm dump Running Delete Feb 12,2026 13:12 UTC+0800 backup_status:mongodb-eflsbm-dump-Running backup_status:mongodb-eflsbm-dump-Running check backup status done backup_status:backup-default-mongodb-eflsbm-20260212131237 default mongodb-eflsbm dump Completed 102169 10s Delete Feb 12,2026 13:12 UTC+0800 Feb 12,2026 13:12 UTC+0800 cluster restore backup Error from server (NotFound): opsrequests.operations.kubeblocks.io "mongodb-eflsbm-backup" not found `kbcli cluster describe-backup --names backup-default-mongodb-eflsbm-20260212131237 --namespace default ` Name: backup-default-mongodb-eflsbm-20260212131237 Cluster: mongodb-eflsbm Namespace: default Spec: Method: dump Policy Name: mongodb-eflsbm-mongodb-backup-policy Actions: dp-backup-0: ActionType: Job WorkloadName: dp-backup-0-backup-default-mongodb-eflsbm-20260212131237-96ed36 TargetPodName: mongodb-eflsbm-mongodb-0 Phase: Completed Start Time: Feb 12,2026 13:12 UTC+0800 Completion Time: Feb 12,2026 13:12 UTC+0800 Status: Phase: Completed Total Size: 102169 ActionSet Name: mongodb-dump-br Repository: backuprepo-kbcli-test Duration: 10s Start Time: Feb 12,2026 13:12 UTC+0800 Completion Time: Feb 12,2026 13:12 UTC+0800 Path: /default/mongodb-eflsbm-156baf7f-b63b-4601-a105-9c09306a9deb/mongodb/backup-default-mongodb-eflsbm-20260212131237 Time Range Start: Feb 12,2026 13:12 UTC+0800 Time Range End: Feb 12,2026 13:12 UTC+0800 Warning Events: `kbcli cluster restore mongodb-eflsbm-backup --backup backup-default-mongodb-eflsbm-20260212131237 --namespace default ` Cluster mongodb-eflsbm-backup created check cluster status `kbcli cluster list mongodb-eflsbm-backup --show-labels --namespace default ` NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS mongodb-eflsbm-backup default mongodb WipeOut Creating Feb 12,2026 13:12 UTC+0800 clusterdefinition.kubeblocks.io/name=mongodb cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances mongodb-eflsbm-backup --namespace default ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME mongodb-eflsbm-backup-mongodb-0 default mongodb-eflsbm-backup mongodb Running primary cn-guangzhou-b 200m / 200m 644245094400m / 644245094400m data:25Gi 192.168.0.199/192.168.0.199 Feb 12,2026 13:12 UTC+0800 mongodb-eflsbm-backup-mongodb-1 default mongodb-eflsbm-backup mongodb Running secondary cn-guangzhou-b 200m / 200m 644245094400m / 644245094400m data:25Gi 192.168.0.200/192.168.0.200 Feb 12,2026 13:13 UTC+0800 mongodb-eflsbm-backup-mongodb-2 default mongodb-eflsbm-backup mongodb Running secondary cn-guangzhou-b 200m / 200m 644245094400m / 644245094400m data:25Gi 192.168.0.13/192.168.0.13 Feb 12,2026 13:13 UTC+0800 check pod status done check cluster role check cluster role done primary: mongodb-eflsbm-backup-mongodb-0;secondary: mongodb-eflsbm-backup-mongodb-1 mongodb-eflsbm-backup-mongodb-2 `kubectl get secrets -l app.kubernetes.io/instance=mongodb-eflsbm-backup` `kubectl get secrets mongodb-eflsbm-backup-mongodb-account-root -o jsonpath="{.data.username}"` `kubectl get secrets mongodb-eflsbm-backup-mongodb-account-root -o jsonpath="{.data.password}"` `kubectl get secrets mongodb-eflsbm-backup-mongodb-account-root -o jsonpath="{.data.port}"` DB_USERNAME:root;DB_PASSWORD:403nfj8Y0jh2R14x;DB_PORT:27017;DB_DATABASE: No resources found in default namespace. check cluster connect `echo " echo \"\" | mongo --host mongodb-eflsbm-backup-mongodb-mongodb.default.svc.cluster.local --port 27017 -u root -p 403nfj8Y0jh2R14x --authenticationDatabase admin admin " | kubectl exec -it mongodb-eflsbm-backup-mongodb-0 --namespace default -- bash` check cluster connect done check backup restore post ready check backup restore post ready exists post_ready_pod_status:restore-post-ready-50be585e-backup-default-mongodb-eflsbm-jbsx2 1/2 NotReady 0 6s check backup restore post ready done `kbcli cluster describe-backup --names backup-default-mongodb-eflsbm-20260212131237 --namespace default ` Name: backup-default-mongodb-eflsbm-20260212131237 Cluster: mongodb-eflsbm Namespace: default Spec: Method: dump Policy Name: mongodb-eflsbm-mongodb-backup-policy Actions: dp-backup-0: ActionType: Job WorkloadName: dp-backup-0-backup-default-mongodb-eflsbm-20260212131237-96ed36 TargetPodName: mongodb-eflsbm-mongodb-0 Phase: Completed Start Time: Feb 12,2026 13:12 UTC+0800 Completion Time: Feb 12,2026 13:12 UTC+0800 Status: Phase: Completed Total Size: 102169 ActionSet Name: mongodb-dump-br Repository: backuprepo-kbcli-test Duration: 10s Start Time: Feb 12,2026 13:12 UTC+0800 Completion Time: Feb 12,2026 13:12 UTC+0800 Path: /default/mongodb-eflsbm-156baf7f-b63b-4601-a105-9c09306a9deb/mongodb/backup-default-mongodb-eflsbm-20260212131237 Time Range Start: Feb 12,2026 13:12 UTC+0800 Time Range End: Feb 12,2026 13:12 UTC+0800 Warning Events: `kubectl get secrets -l app.kubernetes.io/instance=mongodb-eflsbm-backup` `kubectl get secrets mongodb-eflsbm-backup-mongodb-account-root -o jsonpath="{.data.username}"` `kubectl get secrets mongodb-eflsbm-backup-mongodb-account-root -o jsonpath="{.data.password}"` `kubectl get secrets mongodb-eflsbm-backup-mongodb-account-root -o jsonpath="{.data.port}"` DB_USERNAME:root;DB_PASSWORD:403nfj8Y0jh2R14x;DB_PORT:27017;DB_DATABASE: No resources found in default namespace. `db.msg.find();` Defaulted container "mongodb" out of: mongodb, mongodb-backup-agent, exporter, kbagent, init-syncer (init), init-kubectl (init), init-pbm-agent (init), init-kbagent (init), kbagent-worker (init) Unable to use a TTY - input is not a terminal or the right kind of file bash: line 1: mongosh: command not found command terminated with exit code 127 Defaulted container "mongodb" out of: mongodb, mongodb-backup-agent, exporter, kbagent, init-syncer (init), init-kubectl (init), init-pbm-agent (init), init-kbagent (init), kbagent-worker (init) Unable to use a TTY - input is not a terminal or the right kind of file Percona Server for MongoDB shell version v4.4.29-28 connecting to: mongodb://mongodb-eflsbm-backup-mongodb-mongodb.default.svc.cluster.local:27017/admin?authSource=admin&compressors=disabled&gssapiServiceName=mongodb Implicit session: session { "id" : UUID("08691923-1ee0-4583-8f5d-f52c8e1bd3ba") } Percona Server for MongoDB server version: v4.4.29-28 { "_id" : ObjectId("698d6142d3ddb435c5d9888c"), "msg" : "kbcli-test-data-eflsbm0", "time" : ISODate("2026-02-12T05:12:34.725Z") } { "_id" : ObjectId("698d6142d3ddb435c5d9888d"), "msg" : "kbcli-test-data-eflsbm1", "time" : ISODate("2026-02-12T05:12:34.726Z") } { "_id" : ObjectId("698d6142d3ddb435c5d9888e"), "msg" : "kbcli-test-data-eflsbm2", "time" : ISODate("2026-02-12T05:12:34.726Z") } { "_id" : ObjectId("698d6142d3ddb435c5d9888f"), "msg" : "kbcli-test-data-eflsbm3", "time" : ISODate("2026-02-12T05:12:34.727Z") } { "_id" : ObjectId("698d6142d3ddb435c5d98890"), "msg" : "kbcli-test-data-eflsbm4", "time" : ISODate("2026-02-12T05:12:34.728Z") } { "_id" : ObjectId("698d6142d3ddb435c5d98891"), "msg" : "kbcli-test-data-eflsbm5", "time" : ISODate("2026-02-12T05:12:34.728Z") } { "_id" : ObjectId("698d6142d3ddb435c5d98892"), "msg" : "kbcli-test-data-eflsbm6", "time" : ISODate("2026-02-12T05:12:34.729Z") } { "_id" : ObjectId("698d6142d3ddb435c5d98893"), "msg" : "kbcli-test-data-eflsbm7", "time" : ISODate("2026-02-12T05:12:34.729Z") } { "_id" : ObjectId("698d6142d3ddb435c5d98894"), "msg" : "kbcli-test-data-eflsbm8", "time" : ISODate("2026-02-12T05:12:34.729Z") } { "_id" : ObjectId("698d6142d3ddb435c5d98895"), "msg" : "kbcli-test-data-eflsbm9", "time" : ISODate("2026-02-12T05:12:34.729Z") } { "_id" : ObjectId("698d6142d3ddb435c5d98896"), "msg" : "kbcli-test-data-eflsbm10", "time" : ISODate("2026-02-12T05:12:34.730Z") } { "_id" : ObjectId("698d6142d3ddb435c5d98897"), "msg" : "kbcli-test-data-eflsbm11", "time" : ISODate("2026-02-12T05:12:34.730Z") } { "_id" : ObjectId("698d6142d3ddb435c5d98898"), "msg" : "kbcli-test-data-eflsbm12", "time" : ISODate("2026-02-12T05:12:34.730Z") } { "_id" : ObjectId("698d6142d3ddb435c5d9889b"), "msg" : "kbcli-test-data-eflsbm15", "time" : ISODate("2026-02-12T05:12:34.731Z") } { "_id" : ObjectId("698d6142d3ddb435c5d9889a"), "msg" : "kbcli-test-data-eflsbm14", "time" : ISODate("2026-02-12T05:12:34.731Z") } { "_id" : ObjectId("698d6142d3ddb435c5d98899"), "msg" : "kbcli-test-data-eflsbm13", "time" : ISODate("2026-02-12T05:12:34.730Z") } bye dump backup check data Success cluster connect `kubectl get secrets -l app.kubernetes.io/instance=mongodb-eflsbm-backup` `kubectl get secrets mongodb-eflsbm-backup-mongodb-account-root -o jsonpath="{.data.username}"` `kubectl get secrets mongodb-eflsbm-backup-mongodb-account-root -o jsonpath="{.data.password}"` `kubectl get secrets mongodb-eflsbm-backup-mongodb-account-root -o jsonpath="{.data.port}"` DB_USERNAME:root;DB_PASSWORD:403nfj8Y0jh2R14x;DB_PORT:27017;DB_DATABASE: No resources found in default namespace. `echo " echo \"rs.status()\" | mongo --host mongodb-eflsbm-backup-mongodb-mongodb.default.svc.cluster.local --port 27017 -u root -p 403nfj8Y0jh2R14x --authenticationDatabase admin admin " | kubectl exec -it mongodb-eflsbm-backup-mongodb-0 --namespace default -- bash ` Defaulted container "mongodb" out of: mongodb, mongodb-backup-agent, exporter, kbagent, init-syncer (init), init-kubectl (init), init-pbm-agent (init), init-kbagent (init), kbagent-worker (init) Unable to use a TTY - input is not a terminal or the right kind of file Percona Server for MongoDB shell version v4.4.29-28 connecting to: mongodb://mongodb-eflsbm-backup-mongodb-mongodb.default.svc.cluster.local:27017/admin?authSource=admin&compressors=disabled&gssapiServiceName=mongodb Implicit session: session { "id" : UUID("fdd0267c-1098-4d48-aa93-0ec643339b83") } Percona Server for MongoDB server version: v4.4.29-28 { "set" : "mongodb-eflsbm-backup-mongodb", "date" : ISODate("2026-02-12T05:14:34.326Z"), "myState" : 1, "term" : NumberLong(1), "syncSourceHost" : "", "syncSourceId" : -1, "heartbeatIntervalMillis" : NumberLong(2000), "majorityVoteCount" : 2, "writeMajorityCount" : 2, "votingMembersCount" : 3, "writableVotingMembersCount" : 3, "optimes" : { "lastCommittedOpTime" : { "ts" : Timestamp(1770873274, 1), "t" : NumberLong(1) }, "lastCommittedWallTime" : ISODate("2026-02-12T05:14:34.224Z"), "readConcernMajorityOpTime" : { "ts" : Timestamp(1770873274, 1), "t" : NumberLong(1) }, "readConcernMajorityWallTime" : ISODate("2026-02-12T05:14:34.224Z"), "appliedOpTime" : { "ts" : Timestamp(1770873274, 1), "t" : NumberLong(1) }, "durableOpTime" : { "ts" : Timestamp(1770873274, 1), "t" : NumberLong(1) }, "lastAppliedWallTime" : ISODate("2026-02-12T05:14:34.224Z"), "lastDurableWallTime" : ISODate("2026-02-12T05:14:34.224Z") }, "lastStableRecoveryTimestamp" : Timestamp(1770873254, 2), "electionCandidateMetrics" : { "lastElectionReason" : "electionTimeout", "lastElectionDate" : ISODate("2026-02-12T05:13:15.718Z"), "electionTerm" : NumberLong(1), "lastCommittedOpTimeAtElection" : { "ts" : Timestamp(0, 0), "t" : NumberLong(-1) }, "lastSeenOpTimeAtElection" : { "ts" : Timestamp(1770873195, 1), "t" : NumberLong(-1) }, "numVotesNeeded" : 1, "priorityAtElection" : 2, "electionTimeoutMillis" : NumberLong(10000), "newTermStartDate" : ISODate("2026-02-12T05:13:15.735Z"), "wMajorityWriteAvailabilityDate" : ISODate("2026-02-12T05:13:15.748Z") }, "members" : [ { "_id" : 0, "name" : "mongodb-eflsbm-backup-mongodb-0.mongodb-eflsbm-backup-mongodb-headless.default.svc:27017", "health" : 1, "state" : 1, "stateStr" : "PRIMARY", "uptime" : 83, "optime" : { "ts" : Timestamp(1770873274, 1), "t" : NumberLong(1) }, "optimeDate" : ISODate("2026-02-12T05:14:34Z"), "lastAppliedWallTime" : ISODate("2026-02-12T05:14:34.224Z"), "lastDurableWallTime" : ISODate("2026-02-12T05:14:34.224Z"), "syncSourceHost" : "", "syncSourceId" : -1, "infoMessage" : "", "electionTime" : Timestamp(1770873195, 2), "electionDate" : ISODate("2026-02-12T05:13:15Z"), "configVersion" : 3, "configTerm" : 1, "self" : true, "lastHeartbeatMessage" : "" }, { "_id" : 1, "name" : "mongodb-eflsbm-backup-mongodb-1.mongodb-eflsbm-backup-mongodb-headless.default.svc:27017", "health" : 1, "state" : 2, "stateStr" : "SECONDARY", "uptime" : 60, "optime" : { "ts" : Timestamp(1770873272, 1), "t" : NumberLong(1) }, "optimeDurable" : { "ts" : Timestamp(1770873272, 1), "t" : NumberLong(1) }, "optimeDate" : ISODate("2026-02-12T05:14:32Z"), "optimeDurableDate" : ISODate("2026-02-12T05:14:32Z"), "lastAppliedWallTime" : ISODate("2026-02-12T05:14:34.224Z"), "lastDurableWallTime" : ISODate("2026-02-12T05:14:34.224Z"), "lastHeartbeat" : ISODate("2026-02-12T05:14:34.025Z"), "lastHeartbeatRecv" : ISODate("2026-02-12T05:14:33.998Z"), "pingMs" : NumberLong(0), "lastHeartbeatMessage" : "", "syncSourceHost" : "mongodb-eflsbm-backup-mongodb-0.mongodb-eflsbm-backup-mongodb-headless.default.svc:27017", "syncSourceId" : 0, "infoMessage" : "", "configVersion" : 3, "configTerm" : 1 }, { "_id" : 2, "name" : "mongodb-eflsbm-backup-mongodb-2.mongodb-eflsbm-backup-mongodb-headless.default.svc:27017", "health" : 1, "state" : 2, "stateStr" : "SECONDARY", "uptime" : 22, "optime" : { "ts" : Timestamp(1770873272, 1), "t" : NumberLong(1) }, "optimeDurable" : { "ts" : Timestamp(1770873272, 1), "t" : NumberLong(1) }, "optimeDate" : ISODate("2026-02-12T05:14:32Z"), "optimeDurableDate" : ISODate("2026-02-12T05:14:32Z"), "lastAppliedWallTime" : ISODate("2026-02-12T05:14:34.224Z"), "lastDurableWallTime" : ISODate("2026-02-12T05:14:34.224Z"), "lastHeartbeat" : ISODate("2026-02-12T05:14:33.940Z"), "lastHeartbeatRecv" : ISODate("2026-02-12T05:14:32.935Z"), "pingMs" : NumberLong(0), "lastHeartbeatMessage" : "", "syncSourceHost" : "mongodb-eflsbm-backup-mongodb-1.mongodb-eflsbm-backup-mongodb-headless.default.svc:27017", "syncSourceId" : 1, "infoMessage" : "", "configVersion" : 3, "configTerm" : 1 } ], "ok" : 1, "$clusterTime" : { "clusterTime" : Timestamp(1770873274, 1), "signature" : { "hash" : BinData(0,"AAAAAAAAAAAAAAAAAAAAAAAAAAA="), "keyId" : NumberLong(0) } }, "operationTime" : Timestamp(1770873274, 1) } bye connect cluster Success delete cluster mongodb-eflsbm-backup `kbcli cluster delete mongodb-eflsbm-backup --auto-approve --namespace default ` pod_info:mongodb-eflsbm-backup-mongodb-0 4/4 Running 0 100s mongodb-eflsbm-backup-mongodb-1 4/4 Running 0 78s mongodb-eflsbm-backup-mongodb-2 4/4 Running 0 60s Cluster mongodb-eflsbm-backup deleted No resources found in default namespace. delete cluster pod done No resources found in default namespace. check cluster resource non-exist OK: pvc No resources found in default namespace. delete cluster done No resources found in default namespace. No resources found in default namespace. check resource cm non exists No resources found in default namespace. check resource cm non exists No resources found in default namespace. cluster delete backup `kubectl patch -p '{"metadata":{"finalizers":[]}}' --type=merge backups backup-default-mongodb-eflsbm-20260212131237 --namespace default ` backup.dataprotection.kubeblocks.io/backup-default-mongodb-eflsbm-20260212131237 patched `kbcli cluster delete-backup mongodb-eflsbm --name backup-default-mongodb-eflsbm-20260212131237 --force --auto-approve --namespace default ` Backup backup-default-mongodb-eflsbm-20260212131237 deleted No opsrequests found in default namespace. `kubectl get backupschedule -l app.kubernetes.io/instance=mongodb-eflsbm ` `kubectl get backupschedule mongodb-eflsbm-mongodb-backup-schedule -ojsonpath='{.spec.schedules[*].backupMethod}' ` backupschedule.dataprotection.kubeblocks.io/mongodb-eflsbm-mongodb-backup-schedule patched backupschedule.dataprotection.kubeblocks.io/mongodb-eflsbm-mongodb-backup-schedule patched (no change) backupschedule.dataprotection.kubeblocks.io/mongodb-eflsbm-mongodb-backup-schedule patched backupschedule.dataprotection.kubeblocks.io/mongodb-eflsbm-mongodb-backup-schedule patched (no change) backupschedule.dataprotection.kubeblocks.io/mongodb-eflsbm-mongodb-backup-schedule patched backupschedule.dataprotection.kubeblocks.io/mongodb-eflsbm-mongodb-backup-schedule patched (no change) backupschedule.dataprotection.kubeblocks.io/mongodb-eflsbm-mongodb-backup-schedule patched backupschedule.dataprotection.kubeblocks.io/mongodb-eflsbm-mongodb-backup-schedule patched (no change) backupschedule.dataprotection.kubeblocks.io/mongodb-eflsbm-mongodb-backup-schedule patched backupschedule.dataprotection.kubeblocks.io/mongodb-eflsbm-mongodb-backup-schedule patched check backup status `kbcli cluster list-backups mongodb-eflsbm --namespace default ` NAME NAMESPACE SOURCE-CLUSTER METHOD STATUS TOTAL-SIZE DURATION DELETION-POLICY CREATE-TIME COMPLETION-TIME EXPIRATION mongodb-eflsbm-pbm-physical-20260212051501 default mongodb-eflsbm pbm-physical Running Delete Feb 12,2026 13:15 UTC+0800 Feb 19,2026 13:15 UTC+0800 `kubectl get backupschedule -l app.kubernetes.io/instance=mongodb-eflsbm ` `kubectl get backupschedule mongodb-eflsbm-mongodb-backup-schedule -ojsonpath='{.spec.schedules[*].backupMethod}' ` backupschedule.dataprotection.kubeblocks.io/mongodb-eflsbm-mongodb-backup-schedule patched (no change) backupschedule.dataprotection.kubeblocks.io/mongodb-eflsbm-mongodb-backup-schedule patched (no change) backupschedule.dataprotection.kubeblocks.io/mongodb-eflsbm-mongodb-backup-schedule patched (no change) backupschedule.dataprotection.kubeblocks.io/mongodb-eflsbm-mongodb-backup-schedule patched (no change) backupschedule.dataprotection.kubeblocks.io/mongodb-eflsbm-mongodb-backup-schedule patched (no change) backupschedule.dataprotection.kubeblocks.io/mongodb-eflsbm-mongodb-backup-schedule patched (no change) backupschedule.dataprotection.kubeblocks.io/mongodb-eflsbm-mongodb-backup-schedule patched (no change) backupschedule.dataprotection.kubeblocks.io/mongodb-eflsbm-mongodb-backup-schedule patched (no change) backupschedule.dataprotection.kubeblocks.io/mongodb-eflsbm-mongodb-backup-schedule patched backupschedule.dataprotection.kubeblocks.io/mongodb-eflsbm-mongodb-backup-schedule patched backupschedule.dataprotection.kubeblocks.io/mongodb-eflsbm-mongodb-backup-schedule patched backupschedule.dataprotection.kubeblocks.io/mongodb-eflsbm-mongodb-backup-schedule patched (no change) backup_status:mongodb-eflsbm-pbm-physical-Running backup_status:mongodb-eflsbm-pbm-physical-Running backup_status:mongodb-eflsbm-pbm-physical-Running backup_status:mongodb-eflsbm-pbm-physical-Running check backup status done backup_status:mongodb-eflsbm-pbm-physical-20260212051501 default mongodb-eflsbm pbm-physical Completed 1023715 20s Delete Feb 12,2026 13:15 UTC+0800 Feb 12,2026 13:15 UTC+0800 Feb 19,2026 13:15 UTC+0800 `kubectl get backupschedule -l app.kubernetes.io/instance=mongodb-eflsbm ` `kubectl get backupschedule mongodb-eflsbm-mongodb-backup-schedule -ojsonpath='{.spec.schedules[*].backupMethod}' ` backupschedule.dataprotection.kubeblocks.io/mongodb-eflsbm-mongodb-backup-schedule patched (no change) backupschedule.dataprotection.kubeblocks.io/mongodb-eflsbm-mongodb-backup-schedule patched (no change) backupschedule.dataprotection.kubeblocks.io/mongodb-eflsbm-mongodb-backup-schedule patched (no change) backupschedule.dataprotection.kubeblocks.io/mongodb-eflsbm-mongodb-backup-schedule patched (no change) backupschedule.dataprotection.kubeblocks.io/mongodb-eflsbm-mongodb-backup-schedule patched (no change) backupschedule.dataprotection.kubeblocks.io/mongodb-eflsbm-mongodb-backup-schedule patched (no change) backupschedule.dataprotection.kubeblocks.io/mongodb-eflsbm-mongodb-backup-schedule patched (no change) backupschedule.dataprotection.kubeblocks.io/mongodb-eflsbm-mongodb-backup-schedule patched (no change) backupschedule.dataprotection.kubeblocks.io/mongodb-eflsbm-mongodb-backup-schedule patched (no change) backupschedule.dataprotection.kubeblocks.io/mongodb-eflsbm-mongodb-backup-schedule patched (no change) backupschedule.dataprotection.kubeblocks.io/mongodb-eflsbm-mongodb-backup-schedule patched (no change) backupschedule.dataprotection.kubeblocks.io/mongodb-eflsbm-mongodb-backup-schedule patched (no change) cluster restore backup Error from server (NotFound): opsrequests.operations.kubeblocks.io "mongodb-eflsbm-backup" not found `kbcli cluster describe-backup --names mongodb-eflsbm-pbm-physical-20260212051501 --namespace default ` Name: mongodb-eflsbm-pbm-physical-20260212051501 Cluster: mongodb-eflsbm Namespace: default Spec: Method: pbm-physical Policy Name: mongodb-eflsbm-mongodb-backup-policy Actions: dp-backup-0: ActionType: Job WorkloadName: dp-backup-0-mongodb-eflsbm-pbm-physical-20260212051501-9c52930a TargetPodName: mongodb-eflsbm-mongodb-0 Phase: Completed Start Time: Feb 12,2026 13:15 UTC+0800 Completion Time: Feb 12,2026 13:15 UTC+0800 Extras: =================== 1 =================== backupName: 2026-02-12T05:15:03Z backupType: physical lastWriteTime: 2026-02-12T05:15:05Z Status: Phase: Completed Total Size: 1023715 ActionSet Name: mongodb-rs-pbm-physical Repository: backuprepo-kbcli-test Duration: 20s Expiration Time: Feb 19,2026 13:15 UTC+0800 Start Time: Feb 12,2026 13:15 UTC+0800 Completion Time: Feb 12,2026 13:15 UTC+0800 Path: /default/mongodb-eflsbm-156baf7f-b63b-4601-a105-9c09306a9deb/mongodb/mongodb-eflsbm-pbm-physical-20260212051501 Time Range Start: Feb 12,2026 13:15 UTC+0800 Time Range End: Feb 12,2026 13:15 UTC+0800 Warning Events: `kbcli cluster restore mongodb-eflsbm-backup --backup mongodb-eflsbm-pbm-physical-20260212051501 --namespace default ` Cluster mongodb-eflsbm-backup created check cluster status `kbcli cluster list mongodb-eflsbm-backup --show-labels --namespace default ` NAME NAMESPACE CLUSTER-DEFINITION TERMINATION-POLICY STATUS CREATED-TIME LABELS mongodb-eflsbm-backup default mongodb WipeOut Creating Feb 12,2026 13:15 UTC+0800 clusterdefinition.kubeblocks.io/name=mongodb cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances mongodb-eflsbm-backup --namespace default ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME mongodb-eflsbm-backup-mongodb-0 default mongodb-eflsbm-backup mongodb Running primary cn-guangzhou-b 200m / 200m 644245094400m / 644245094400m data:25Gi 192.168.0.199/192.168.0.199 Feb 12,2026 13:15 UTC+0800 mongodb-eflsbm-backup-mongodb-1 default mongodb-eflsbm-backup mongodb Running secondary cn-guangzhou-b 200m / 200m 644245094400m / 644245094400m data:25Gi 192.168.0.13/192.168.0.13 Feb 12,2026 13:16 UTC+0800 mongodb-eflsbm-backup-mongodb-2 default mongodb-eflsbm-backup mongodb Running secondary cn-guangzhou-b 200m / 200m 644245094400m / 644245094400m data:25Gi 192.168.0.200/192.168.0.200 Feb 12,2026 13:16 UTC+0800 check pod status done check cluster role check cluster role done primary: mongodb-eflsbm-backup-mongodb-0;secondary: mongodb-eflsbm-backup-mongodb-1 mongodb-eflsbm-backup-mongodb-2 `kubectl get secrets -l app.kubernetes.io/instance=mongodb-eflsbm-backup` `kubectl get secrets mongodb-eflsbm-backup-mongodb-account-root -o jsonpath="{.data.username}"` `kubectl get secrets mongodb-eflsbm-backup-mongodb-account-root -o jsonpath="{.data.password}"` `kubectl get secrets mongodb-eflsbm-backup-mongodb-account-root -o jsonpath="{.data.port}"` DB_USERNAME:root;DB_PASSWORD:403nfj8Y0jh2R14x;DB_PORT:27017;DB_DATABASE: No resources found in default namespace. check cluster connect `echo " echo \"\" | mongo --host mongodb-eflsbm-backup-mongodb-mongodb.default.svc.cluster.local --port 27017 -u root -p 403nfj8Y0jh2R14x --authenticationDatabase admin admin " | kubectl exec -it mongodb-eflsbm-backup-mongodb-0 --namespace default -- bash` check cluster connect done check backup restore post ready check backup restore post ready exists post_ready_pod_status:restore-post-ready-b8010444-mongodb-eflsbm-pbm-physical-2-xsgj5 2/2 Running 0 7s post_ready_pod_status:restore-post-ready-b8010444-mongodb-eflsbm-pbm-physical-2-xsgj5 2/2 Running 0 15s post_ready_pod_status:restore-post-ready-b8010444-mongodb-eflsbm-pbm-physical-2-xsgj5 2/2 Running 0 26s post_ready_pod_status:restore-post-ready-b8010444-mongodb-eflsbm-pbm-physical-2-xsgj5 2/2 Running 0 36s post_ready_pod_status:restore-post-ready-b8010444-mongodb-eflsbm-pbm-physical-2-xsgj5 2/2 Running 0 46s post_ready_pod_status:restore-post-ready-b8010444-mongodb-eflsbm-pbm-physical-2-xsgj5 2/2 Running 0 56s post_ready_pod_status:restore-post-ready-b8010444-mongodb-eflsbm-pbm-physical-2-xsgj5 2/2 Running 0 67s post_ready_pod_status:restore-post-ready-b8010444-mongodb-eflsbm-pbm-physical-2-xsgj5 2/2 Running 0 77s post_ready_pod_status:restore-post-ready-b8010444-mongodb-eflsbm-pbm-physical-2-xsgj5 2/2 Running 0 87s post_ready_pod_status:restore-post-ready-b8010444-mongodb-eflsbm-pbm-physical-2-xsgj5 1/2 NotReady 0 98s post_ready_pod_status:restore-post-ready-b8010444-mongodb-eflsbm-pbm-physical-2-xsgj5 1/2 NotReady 0 108s check backup restore post ready done `kbcli cluster describe-backup --names mongodb-eflsbm-pbm-physical-20260212051501 --namespace default ` Name: mongodb-eflsbm-pbm-physical-20260212051501 Cluster: mongodb-eflsbm Namespace: default Spec: Method: pbm-physical Policy Name: mongodb-eflsbm-mongodb-backup-policy Actions: dp-backup-0: ActionType: Job WorkloadName: dp-backup-0-mongodb-eflsbm-pbm-physical-20260212051501-9c52930a TargetPodName: mongodb-eflsbm-mongodb-0 Phase: Completed Start Time: Feb 12,2026 13:15 UTC+0800 Completion Time: Feb 12,2026 13:15 UTC+0800 Extras: =================== 1 =================== backupName: 2026-02-12T05:15:03Z backupType: physical lastWriteTime: 2026-02-12T05:15:05Z Status: Phase: Completed Total Size: 1023715 ActionSet Name: mongodb-rs-pbm-physical Repository: backuprepo-kbcli-test Duration: 20s Expiration Time: Feb 19,2026 13:15 UTC+0800 Start Time: Feb 12,2026 13:15 UTC+0800 Completion Time: Feb 12,2026 13:15 UTC+0800 Path: /default/mongodb-eflsbm-156baf7f-b63b-4601-a105-9c09306a9deb/mongodb/mongodb-eflsbm-pbm-physical-20260212051501 Time Range Start: Feb 12,2026 13:15 UTC+0800 Time Range End: Feb 12,2026 13:15 UTC+0800 Warning Events: cluster connect `kubectl get secrets -l app.kubernetes.io/instance=mongodb-eflsbm-backup` `kubectl get secrets mongodb-eflsbm-backup-mongodb-account-root -o jsonpath="{.data.username}"` `kubectl get secrets mongodb-eflsbm-backup-mongodb-account-root -o jsonpath="{.data.password}"` `kubectl get secrets mongodb-eflsbm-backup-mongodb-account-root -o jsonpath="{.data.port}"` DB_USERNAME:root;DB_PASSWORD:403nfj8Y0jh2R14x;DB_PORT:27017;DB_DATABASE: No resources found in default namespace. `echo " echo \"rs.status()\" | mongo --host mongodb-eflsbm-backup-mongodb-mongodb.default.svc.cluster.local --port 27017 -u root -p 403nfj8Y0jh2R14x --authenticationDatabase admin admin " | kubectl exec -it mongodb-eflsbm-backup-mongodb-1 --namespace default -- bash ` Defaulted container "mongodb" out of: mongodb, mongodb-backup-agent, exporter, kbagent, init-syncer (init), init-kubectl (init), init-pbm-agent (init), init-kbagent (init), kbagent-worker (init) Unable to use a TTY - input is not a terminal or the right kind of file Percona Server for MongoDB shell version v4.4.29-28 connecting to: mongodb://mongodb-eflsbm-backup-mongodb-mongodb.default.svc.cluster.local:27017/admin?authSource=admin&compressors=disabled&gssapiServiceName=mongodb Implicit session: session { "id" : UUID("051dd315-af67-4132-b57a-446ac8d5cbfb") } Percona Server for MongoDB server version: v4.4.29-28 { "set" : "mongodb-eflsbm-backup-mongodb", "date" : ISODate("2026-02-12T05:19:00.527Z"), "myState" : 1, "term" : NumberLong(13), "syncSourceHost" : "", "syncSourceId" : -1, "heartbeatIntervalMillis" : NumberLong(2000), "majorityVoteCount" : 2, "writeMajorityCount" : 2, "votingMembersCount" : 3, "writableVotingMembersCount" : 3, "optimes" : { "lastCommittedOpTime" : { "ts" : Timestamp(1770873535, 6), "t" : NumberLong(13) }, "lastCommittedWallTime" : ISODate("2026-02-12T05:18:55.959Z"), "readConcernMajorityOpTime" : { "ts" : Timestamp(1770873535, 6), "t" : NumberLong(13) }, "readConcernMajorityWallTime" : ISODate("2026-02-12T05:18:55.959Z"), "appliedOpTime" : { "ts" : Timestamp(1770873535, 6), "t" : NumberLong(13) }, "durableOpTime" : { "ts" : Timestamp(1770873535, 6), "t" : NumberLong(13) }, "lastAppliedWallTime" : ISODate("2026-02-12T05:18:55.959Z"), "lastDurableWallTime" : ISODate("2026-02-12T05:18:55.959Z") }, "lastStableRecoveryTimestamp" : Timestamp(1770873530, 2), "electionCandidateMetrics" : { "lastElectionReason" : "electionTimeout", "lastElectionDate" : ISODate("2026-02-12T05:18:50.303Z"), "electionTerm" : NumberLong(13), "lastCommittedOpTimeAtElection" : { "ts" : Timestamp(0, 0), "t" : NumberLong(-1) }, "lastSeenOpTimeAtElection" : { "ts" : Timestamp(1770873305, 1), "t" : NumberLong(12) }, "numVotesNeeded" : 2, "priorityAtElection" : 1, "electionTimeoutMillis" : NumberLong(10000), "numCatchUpOps" : NumberLong(0), "newTermStartDate" : ISODate("2026-02-12T05:18:50.306Z"), "wMajorityWriteAvailabilityDate" : ISODate("2026-02-12T05:18:50.945Z") }, "members" : [ { "_id" : 0, "name" : "mongodb-eflsbm-backup-mongodb-0.mongodb-eflsbm-backup-mongodb-headless.default.svc:27017", "health" : 1, "state" : 2, "stateStr" : "SECONDARY", "uptime" : 19, "optime" : { "ts" : Timestamp(1770873535, 6), "t" : NumberLong(13) }, "optimeDurable" : { "ts" : Timestamp(1770873535, 6), "t" : NumberLong(13) }, "optimeDate" : ISODate("2026-02-12T05:18:55Z"), "optimeDurableDate" : ISODate("2026-02-12T05:18:55Z"), "lastAppliedWallTime" : ISODate("2026-02-12T05:18:55.959Z"), "lastDurableWallTime" : ISODate("2026-02-12T05:18:55.959Z"), "lastHeartbeat" : ISODate("2026-02-12T05:19:00.305Z"), "lastHeartbeatRecv" : ISODate("2026-02-12T05:18:59.306Z"), "pingMs" : NumberLong(0), "lastHeartbeatMessage" : "", "syncSourceHost" : "mongodb-eflsbm-backup-mongodb-1.mongodb-eflsbm-backup-mongodb-headless.default.svc:27017", "syncSourceId" : 2, "infoMessage" : "", "configVersion" : 1, "configTerm" : -1 }, { "_id" : 1, "name" : "mongodb-eflsbm-backup-mongodb-2.mongodb-eflsbm-backup-mongodb-headless.default.svc:27017", "health" : 1, "state" : 2, "stateStr" : "SECONDARY", "uptime" : 20, "optime" : { "ts" : Timestamp(1770873535, 6), "t" : NumberLong(13) }, "optimeDurable" : { "ts" : Timestamp(1770873535, 6), "t" : NumberLong(13) }, "optimeDate" : ISODate("2026-02-12T05:18:55Z"), "optimeDurableDate" : ISODate("2026-02-12T05:18:55Z"), "lastAppliedWallTime" : ISODate("2026-02-12T05:18:55.959Z"), "lastDurableWallTime" : ISODate("2026-02-12T05:18:55.959Z"), "lastHeartbeat" : ISODate("2026-02-12T05:19:00.306Z"), "lastHeartbeatRecv" : ISODate("2026-02-12T05:18:59.306Z"), "pingMs" : NumberLong(0), "lastHeartbeatMessage" : "", "syncSourceHost" : "mongodb-eflsbm-backup-mongodb-1.mongodb-eflsbm-backup-mongodb-headless.default.svc:27017", "syncSourceId" : 2, "infoMessage" : "", "configVersion" : 1, "configTerm" : -1 }, { "_id" : 2, "name" : "mongodb-eflsbm-backup-mongodb-1.mongodb-eflsbm-backup-mongodb-headless.default.svc:27017", "health" : 1, "state" : 1, "stateStr" : "PRIMARY", "uptime" : 26, "optime" : { "ts" : Timestamp(1770873535, 6), "t" : NumberLong(13) }, "optimeDate" : ISODate("2026-02-12T05:18:55Z"), "lastAppliedWallTime" : ISODate("2026-02-12T05:18:55.959Z"), "lastDurableWallTime" : ISODate("2026-02-12T05:18:55.959Z"), "syncSourceHost" : "", "syncSourceId" : -1, "infoMessage" : "", "electionTime" : Timestamp(1770873530, 1), "electionDate" : ISODate("2026-02-12T05:18:50Z"), "configVersion" : 1, "configTerm" : -1, "self" : true, "lastHeartbeatMessage" : "" } ], "ok" : 1, "$clusterTime" : { "clusterTime" : Timestamp(1770873535, 6), "signature" : { "hash" : BinData(0,"AAAAAAAAAAAAAAAAAAAAAAAAAAA="), "keyId" : NumberLong(0) } }, "operationTime" : Timestamp(1770873535, 6) } bye connect cluster Success delete cluster mongodb-eflsbm-backup `kbcli cluster delete mongodb-eflsbm-backup --auto-approve --namespace default ` pod_info:mongodb-eflsbm-backup-mongodb-0 4/4 Running 0 3m8s mongodb-eflsbm-backup-mongodb-1 4/4 Running 0 2m50s mongodb-eflsbm-backup-mongodb-2 4/4 Running 0 2m36s Cluster mongodb-eflsbm-backup deleted No resources found in default namespace. delete cluster pod done No resources found in default namespace. check cluster resource non-exist OK: pvc No resources found in default namespace. delete cluster done No resources found in default namespace. No resources found in default namespace. check resource cm non exists No resources found in default namespace. check resource cm non exists No resources found in default namespace. cluster delete backup `kubectl patch -p '{"metadata":{"finalizers":[]}}' --type=merge backups mongodb-eflsbm-pbm-physical-20260212051501 --namespace default ` backup.dataprotection.kubeblocks.io/mongodb-eflsbm-pbm-physical-20260212051501 patched `kbcli cluster delete-backup mongodb-eflsbm --name mongodb-eflsbm-pbm-physical-20260212051501 --force --auto-approve --namespace default ` Backup mongodb-eflsbm-pbm-physical-20260212051501 deleted No opsrequests found in default namespace. cluster list-logs `kbcli cluster list-logs mongodb-eflsbm --namespace default ` No log files found. cluster logs `kbcli cluster logs mongodb-eflsbm --tail 30 --namespace default ` Defaulted container "mongodb" out of: mongodb, mongodb-backup-agent, exporter, kbagent, init-syncer (init), init-kubectl (init), init-pbm-agent (init), init-kbagent (init), kbagent-worker (init) 2026-02-12T05:04:47Z INFO HA This member is Cluster's leader 2026-02-12T05:04:47Z DEBUG HA Refresh leader ttl 2026-02-12T05:05:47Z INFO HA This member is Cluster's leader 2026-02-12T05:05:47Z DEBUG HA Refresh leader ttl 2026-02-12T05:06:47Z INFO HA This member is Cluster's leader 2026-02-12T05:06:47Z DEBUG HA Refresh leader ttl 2026-02-12T05:07:47Z INFO HA This member is Cluster's leader 2026-02-12T05:07:47Z DEBUG HA Refresh leader ttl 2026-02-12T05:08:47Z INFO HA This member is Cluster's leader 2026-02-12T05:08:47Z DEBUG HA Refresh leader ttl 2026-02-12T05:09:47Z INFO HA This member is Cluster's leader 2026-02-12T05:09:47Z DEBUG HA Refresh leader ttl 2026-02-12T05:10:47Z INFO HA This member is Cluster's leader 2026-02-12T05:10:47Z DEBUG HA Refresh leader ttl 2026-02-12T05:11:47Z INFO HA This member is Cluster's leader 2026-02-12T05:11:47Z DEBUG HA Refresh leader ttl 2026-02-12T05:12:47Z INFO HA This member is Cluster's leader 2026-02-12T05:12:47Z DEBUG HA Refresh leader ttl 2026-02-12T05:13:47Z INFO HA This member is Cluster's leader 2026-02-12T05:13:47Z DEBUG HA Refresh leader ttl 2026-02-12T05:14:47Z INFO HA This member is Cluster's leader 2026-02-12T05:14:47Z DEBUG HA Refresh leader ttl 2026-02-12T05:15:47Z INFO HA This member is Cluster's leader 2026-02-12T05:15:47Z DEBUG HA Refresh leader ttl 2026-02-12T05:16:47Z INFO HA This member is Cluster's leader 2026-02-12T05:16:47Z DEBUG HA Refresh leader ttl 2026-02-12T05:17:47Z INFO HA This member is Cluster's leader 2026-02-12T05:17:47Z DEBUG HA Refresh leader ttl 2026-02-12T05:18:47Z INFO HA This member is Cluster's leader 2026-02-12T05:18:47Z DEBUG HA Refresh leader ttl cluster logs specify instance and container `kbcli cluster logs mongodb-eflsbm --tail 30 --instance mongodb-eflsbm-mongodb-2 -c exporter --namespace default ` time="2026-02-12T04:45:43Z" level=error msg="Cannot connect to MongoDB: cannot connect to MongoDB: server selection error: server selection timeout, current topology: { Type: Single, Servers: [{ Addr: 127.0.0.1:27017, Type: Unknown, Last error: dial tcp 127.0.0.1:27017: connect: connection refused }, ] }" cluster logs running `kbcli cluster logs mongodb-eflsbm --tail 30 --file-type=running --namespace default ` ==> /data/mongodb/logs/mongodb.log <== {"t":{"$date":"2026-02-12T05:19:25.223+00:00"},"s":"I", "c":"-", "id":20883, "ctx":"conn31576","msg":"Interrupted operation as its client disconnected","attr":{"opId":274030}} {"t":{"$date":"2026-02-12T05:19:25.223+00:00"},"s":"I", "c":"NETWORK", "id":22944, "ctx":"conn31577","msg":"Connection ended","attr":{"remote":"192.168.0.238:40210","connectionId":31577,"connectionCount":38}} {"t":{"$date":"2026-02-12T05:19:25.223+00:00"},"s":"I", "c":"NETWORK", "id":22944, "ctx":"conn31578","msg":"Connection ended","attr":{"remote":"192.168.0.238:40212","connectionId":31578,"connectionCount":37}} {"t":{"$date":"2026-02-12T05:19:25.223+00:00"},"s":"I", "c":"NETWORK", "id":22944, "ctx":"conn31576","msg":"Connection ended","attr":{"remote":"192.168.0.238:40198","connectionId":31576,"connectionCount":36}} {"t":{"$date":"2026-02-12T05:19:25.224+00:00"},"s":"I", "c":"NETWORK", "id":22943, "ctx":"listener","msg":"Connection accepted","attr":{"remote":"192.168.0.238:40216","connectionId":31579,"connectionCount":37}} {"t":{"$date":"2026-02-12T05:19:25.224+00:00"},"s":"I", "c":"NETWORK", "id":22943, "ctx":"listener","msg":"Connection accepted","attr":{"remote":"192.168.0.238:40218","connectionId":31580,"connectionCount":38}} {"t":{"$date":"2026-02-12T05:19:25.224+00:00"},"s":"I", "c":"NETWORK", "id":51800, "ctx":"conn31579","msg":"client metadata","attr":{"remote":"192.168.0.238:40216","client":"conn31579","doc":{"driver":{"name":"mongo-go-driver","version":"v1.11.6"},"os":{"type":"linux","architecture":"amd64"},"platform":"go1.24.10"}}} {"t":{"$date":"2026-02-12T05:19:25.224+00:00"},"s":"I", "c":"NETWORK", "id":51800, "ctx":"conn31580","msg":"client metadata","attr":{"remote":"192.168.0.238:40218","client":"conn31580","doc":{"driver":{"name":"mongo-go-driver","version":"v1.11.6"},"os":{"type":"linux","architecture":"amd64"},"platform":"go1.24.10"}}} {"t":{"$date":"2026-02-12T05:19:25.225+00:00"},"s":"I", "c":"NETWORK", "id":22943, "ctx":"listener","msg":"Connection accepted","attr":{"remote":"192.168.0.238:40230","connectionId":31581,"connectionCount":39}} {"t":{"$date":"2026-02-12T05:19:25.225+00:00"},"s":"I", "c":"NETWORK", "id":51800, "ctx":"conn31581","msg":"client metadata","attr":{"remote":"192.168.0.238:40230","client":"conn31581","doc":{"driver":{"name":"mongo-go-driver","version":"v1.11.6"},"os":{"type":"linux","architecture":"amd64"},"platform":"go1.24.10"}}} {"t":{"$date":"2026-02-12T05:19:25.228+00:00"},"s":"I", "c":"ACCESS", "id":20250, "ctx":"conn31581","msg":"Authentication succeeded","attr":{"mechanism":"SCRAM-SHA-256","speculative":true,"principalName":"root","authenticationDatabase":"admin","remote":"192.168.0.238:40230","extraInfo":{}}} {"t":{"$date":"2026-02-12T05:19:25.228+00:00"},"s":"I", "c":"-", "id":20883, "ctx":"conn31579","msg":"Interrupted operation as its client disconnected","attr":{"opId":274037}} {"t":{"$date":"2026-02-12T05:19:25.228+00:00"},"s":"I", "c":"NETWORK", "id":22944, "ctx":"conn31581","msg":"Connection ended","attr":{"remote":"192.168.0.238:40230","connectionId":31581,"connectionCount":38}} {"t":{"$date":"2026-02-12T05:19:25.228+00:00"},"s":"I", "c":"NETWORK", "id":22944, "ctx":"conn31580","msg":"Connection ended","attr":{"remote":"192.168.0.238:40218","connectionId":31580,"connectionCount":37}} {"t":{"$date":"2026-02-12T05:19:25.228+00:00"},"s":"I", "c":"NETWORK", "id":22944, "ctx":"conn31579","msg":"Connection ended","attr":{"remote":"192.168.0.238:40216","connectionId":31579,"connectionCount":36}} {"t":{"$date":"2026-02-12T05:19:25.593+00:00"},"s":"I", "c":"NETWORK", "id":22943, "ctx":"listener","msg":"Connection accepted","attr":{"remote":"192.168.0.76:47534","connectionId":31582,"connectionCount":37}} {"t":{"$date":"2026-02-12T05:19:25.593+00:00"},"s":"I", "c":"NETWORK", "id":22943, "ctx":"listener","msg":"Connection accepted","attr":{"remote":"192.168.0.76:47542","connectionId":31583,"connectionCount":38}} {"t":{"$date":"2026-02-12T05:19:25.593+00:00"},"s":"I", "c":"NETWORK", "id":51800, "ctx":"conn31582","msg":"client metadata","attr":{"remote":"192.168.0.76:47534","client":"conn31582","doc":{"driver":{"name":"mongo-go-driver","version":"v1.11.6"},"os":{"type":"linux","architecture":"amd64"},"platform":"go1.24.10"}}} {"t":{"$date":"2026-02-12T05:19:25.593+00:00"},"s":"I", "c":"NETWORK", "id":51800, "ctx":"conn31583","msg":"client metadata","attr":{"remote":"192.168.0.76:47542","client":"conn31583","doc":{"driver":{"name":"mongo-go-driver","version":"v1.11.6"},"os":{"type":"linux","architecture":"amd64"},"platform":"go1.24.10"}}} {"t":{"$date":"2026-02-12T05:19:25.595+00:00"},"s":"I", "c":"NETWORK", "id":22943, "ctx":"listener","msg":"Connection accepted","attr":{"remote":"192.168.0.76:47552","connectionId":31584,"connectionCount":39}} {"t":{"$date":"2026-02-12T05:19:25.595+00:00"},"s":"I", "c":"NETWORK", "id":51800, "ctx":"conn31584","msg":"client metadata","attr":{"remote":"192.168.0.76:47552","client":"conn31584","doc":{"driver":{"name":"mongo-go-driver","version":"v1.11.6"},"os":{"type":"linux","architecture":"amd64"},"platform":"go1.24.10"}}} {"t":{"$date":"2026-02-12T05:19:25.599+00:00"},"s":"I", "c":"ACCESS", "id":20250, "ctx":"conn31584","msg":"Authentication succeeded","attr":{"mechanism":"SCRAM-SHA-256","speculative":true,"principalName":"root","authenticationDatabase":"admin","remote":"192.168.0.76:47552","extraInfo":{}}} {"t":{"$date":"2026-02-12T05:19:25.600+00:00"},"s":"I", "c":"-", "id":20883, "ctx":"conn31582","msg":"Interrupted operation as its client disconnected","attr":{"opId":274052}} {"t":{"$date":"2026-02-12T05:19:25.600+00:00"},"s":"I", "c":"NETWORK", "id":22944, "ctx":"conn31583","msg":"Connection ended","attr":{"remote":"192.168.0.76:47542","connectionId":31583,"connectionCount":38}} {"t":{"$date":"2026-02-12T05:19:25.600+00:00"},"s":"I", "c":"NETWORK", "id":22944, "ctx":"conn31584","msg":"Connection ended","attr":{"remote":"192.168.0.76:47552","connectionId":31584,"connectionCount":37}} {"t":{"$date":"2026-02-12T05:19:25.600+00:00"},"s":"I", "c":"NETWORK", "id":22944, "ctx":"conn31582","msg":"Connection ended","attr":{"remote":"192.168.0.76:47534","connectionId":31582,"connectionCount":36}} {"t":{"$date":"2026-02-12T05:19:25.601+00:00"},"s":"I", "c":"NETWORK", "id":22943, "ctx":"listener","msg":"Connection accepted","attr":{"remote":"192.168.0.76:47554","connectionId":31585,"connectionCount":37}} {"t":{"$date":"2026-02-12T05:19:25.601+00:00"},"s":"I", "c":"NETWORK", "id":22943, "ctx":"listener","msg":"Connection accepted","attr":{"remote":"192.168.0.76:47562","connectionId":31586,"connectionCount":38}} {"t":{"$date":"2026-02-12T05:19:25.601+00:00"},"s":"I", "c":"NETWORK", "id":51800, "ctx":"conn31585","msg":"client metadata","attr":{"remote":"192.168.0.76:47554","client":"conn31585","doc":{"driver":{"name":"mongo-go-driver","version":"v1.11.6"},"os":{"type":"linux","architecture":"amd64"},"platform":"go1.24.10"}}} {"t":{"$date":"2026-02-12T05:19:25.601+00:00"},"s":"I", "c":"NETWORK", "id":51800, "ctx":"conn31586","msg":"client metadata","attr":{"remote":"192.168.0.76:47562","client":"conn31586","doc":{"driver":{"name":"mongo-go-driver","version":"v1.11.6"},"os":{"type":"linux","architecture":"amd64"},"platform":"go1.24.10"}}} ==> /data/mongodb/logs/mongodb.log.2026-02-12T04-31-26 <== {"t":{"$date":"2026-02-12T04:30:14.151+00:00"},"s":"I", "c":"INDEX", "id":4784915, "ctx":"SignalHandler","msg":"Shutting down the IndexBuildsCoordinator"} {"t":{"$date":"2026-02-12T04:30:14.151+00:00"},"s":"I", "c":"REPL", "id":4784916, "ctx":"SignalHandler","msg":"Reacquiring the ReplicationStateTransitionLock for shutdown"} {"t":{"$date":"2026-02-12T04:30:14.151+00:00"},"s":"I", "c":"REPL", "id":4784917, "ctx":"SignalHandler","msg":"Attempting to mark clean shutdown"} {"t":{"$date":"2026-02-12T04:30:14.151+00:00"},"s":"I", "c":"NETWORK", "id":4784918, "ctx":"SignalHandler","msg":"Shutting down the ReplicaSetMonitor"} {"t":{"$date":"2026-02-12T04:30:14.151+00:00"},"s":"I", "c":"REPL", "id":4784920, "ctx":"SignalHandler","msg":"Shutting down the LogicalTimeValidator"} {"t":{"$date":"2026-02-12T04:30:14.151+00:00"},"s":"I", "c":"SHARDING", "id":4784921, "ctx":"SignalHandler","msg":"Shutting down the MigrationUtilExecutor"} {"t":{"$date":"2026-02-12T04:30:14.151+00:00"},"s":"I", "c":"STORAGE", "id":4784927, "ctx":"SignalHandler","msg":"Shutting down the HealthLog"} {"t":{"$date":"2026-02-12T04:30:14.151+00:00"},"s":"I", "c":"STORAGE", "id":4784929, "ctx":"SignalHandler","msg":"Acquiring the global lock for shutdown"} {"t":{"$date":"2026-02-12T04:30:14.151+00:00"},"s":"I", "c":"NETWORK", "id":22944, "ctx":"conn86","msg":"Connection ended","attr":{"remote":"127.0.0.1:56470","connectionId":86,"connectionCount":9}} {"t":{"$date":"2026-02-12T04:30:14.151+00:00"},"s":"I", "c":"STORAGE", "id":4784930, "ctx":"SignalHandler","msg":"Shutting down the storage engine"} {"t":{"$date":"2026-02-12T04:30:14.151+00:00"},"s":"I", "c":"STORAGE", "id":22320, "ctx":"SignalHandler","msg":"Shutting down journal flusher thread"} {"t":{"$date":"2026-02-12T04:30:14.151+00:00"},"s":"I", "c":"NETWORK", "id":22944, "ctx":"conn49","msg":"Connection ended","attr":{"remote":"192.168.0.238:39356","connectionId":49,"connectionCount":8}} {"t":{"$date":"2026-02-12T04:30:14.151+00:00"},"s":"I", "c":"STORAGE", "id":22321, "ctx":"SignalHandler","msg":"Finished shutting down journal flusher thread"} {"t":{"$date":"2026-02-12T04:30:14.151+00:00"},"s":"I", "c":"STORAGE", "id":20282, "ctx":"SignalHandler","msg":"Deregistering all the collections"} {"t":{"$date":"2026-02-12T04:30:14.151+00:00"},"s":"I", "c":"STORAGE", "id":22372, "ctx":"OplogVisibilityThread","msg":"Oplog visibility thread shutting down."} {"t":{"$date":"2026-02-12T04:30:14.151+00:00"},"s":"I", "c":"STORAGE", "id":22261, "ctx":"SignalHandler","msg":"Timestamp monitor shutting down"} {"t":{"$date":"2026-02-12T04:30:14.151+00:00"},"s":"I", "c":"STORAGE", "id":22317, "ctx":"SignalHandler","msg":"WiredTigerKVEngine shutting down"} {"t":{"$date":"2026-02-12T04:30:14.151+00:00"},"s":"I", "c":"STORAGE", "id":22318, "ctx":"SignalHandler","msg":"Shutting down session sweeper thread"} {"t":{"$date":"2026-02-12T04:30:14.151+00:00"},"s":"I", "c":"STORAGE", "id":22319, "ctx":"SignalHandler","msg":"Finished shutting down session sweeper thread"} {"t":{"$date":"2026-02-12T04:30:14.151+00:00"},"s":"I", "c":"STORAGE", "id":22322, "ctx":"SignalHandler","msg":"Shutting down checkpoint thread"} {"t":{"$date":"2026-02-12T04:30:14.151+00:00"},"s":"I", "c":"STORAGE", "id":22323, "ctx":"SignalHandler","msg":"Finished shutting down checkpoint thread"} {"t":{"$date":"2026-02-12T04:30:14.152+00:00"},"s":"I", "c":"STORAGE", "id":4795902, "ctx":"SignalHandler","msg":"Closing WiredTiger","attr":{"closeConfig":"leak_memory=true,"}} {"t":{"$date":"2026-02-12T04:30:14.155+00:00"},"s":"I", "c":"STORAGE", "id":22430, "ctx":"SignalHandler","msg":"WiredTiger message","attr":{"message":"[1770870614:155315][19:0x7fdd3ab6b700], close_ckpt: [WT_VERB_CHECKPOINT_PROGRESS] saving checkpoint snapshot min: 1293, snapshot max: 1293 snapshot count: 0, oldest timestamp: (1770870608, 3) , meta checkpoint timestamp: (1770870613, 3) base write gen: 1"}} {"t":{"$date":"2026-02-12T04:30:14.168+00:00"},"s":"I", "c":"STORAGE", "id":4795901, "ctx":"SignalHandler","msg":"WiredTiger closed","attr":{"durationMillis":16}} {"t":{"$date":"2026-02-12T04:30:14.168+00:00"},"s":"I", "c":"STORAGE", "id":22279, "ctx":"SignalHandler","msg":"shutdown: removing fs lock..."} {"t":{"$date":"2026-02-12T04:30:14.168+00:00"},"s":"I", "c":"-", "id":4784931, "ctx":"SignalHandler","msg":"Dropping the scope cache for shutdown"} {"t":{"$date":"2026-02-12T04:30:14.168+00:00"},"s":"I", "c":"FTDC", "id":4784926, "ctx":"SignalHandler","msg":"Shutting down full-time data capture"} {"t":{"$date":"2026-02-12T04:30:14.168+00:00"},"s":"I", "c":"FTDC", "id":20626, "ctx":"SignalHandler","msg":"Shutting down full-time diagnostic data capture"} {"t":{"$date":"2026-02-12T04:30:14.226+00:00"},"s":"I", "c":"CONTROL", "id":20565, "ctx":"SignalHandler","msg":"Now exiting"} {"t":{"$date":"2026-02-12T04:30:14.226+00:00"},"s":"I", "c":"CONTROL", "id":23138, "ctx":"SignalHandler","msg":"Shutting down","attr":{"exitCode":0}} ==> /data/mongodb/logs/mongodb.log.2026-02-12T04-38-29 <== {"t":{"$date":"2026-02-12T04:37:59.240+00:00"},"s":"I", "c":"NETWORK", "id":22944, "ctx":"conn1322","msg":"Connection ended","attr":{"remote":"192.168.0.94:58544","connectionId":1322,"connectionCount":15}} {"t":{"$date":"2026-02-12T04:37:59.240+00:00"},"s":"I", "c":"NETWORK", "id":22944, "ctx":"conn14","msg":"Connection ended","attr":{"remote":"127.0.0.1:56528","connectionId":14,"connectionCount":14}} {"t":{"$date":"2026-02-12T04:37:59.240+00:00"},"s":"I", "c":"NETWORK", "id":22944, "ctx":"conn2880","msg":"Connection ended","attr":{"remote":"192.168.0.78:52688","connectionId":2880,"connectionCount":13}} {"t":{"$date":"2026-02-12T04:37:59.240+00:00"},"s":"I", "c":"NETWORK", "id":22944, "ctx":"conn12","msg":"Connection ended","attr":{"remote":"192.168.0.62:47866","connectionId":12,"connectionCount":12}} {"t":{"$date":"2026-02-12T04:37:59.240+00:00"},"s":"I", "c":"NETWORK", "id":22944, "ctx":"conn2884","msg":"Connection ended","attr":{"remote":"192.168.0.78:52700","connectionId":2884,"connectionCount":11}} {"t":{"$date":"2026-02-12T04:37:59.240+00:00"},"s":"I", "c":"REPL", "id":4784920, "ctx":"SignalHandler","msg":"Shutting down the LogicalTimeValidator"} {"t":{"$date":"2026-02-12T04:37:59.240+00:00"},"s":"I", "c":"SHARDING", "id":4784921, "ctx":"SignalHandler","msg":"Shutting down the MigrationUtilExecutor"} {"t":{"$date":"2026-02-12T04:37:59.240+00:00"},"s":"I", "c":"STORAGE", "id":4784927, "ctx":"SignalHandler","msg":"Shutting down the HealthLog"} {"t":{"$date":"2026-02-12T04:37:59.240+00:00"},"s":"I", "c":"STORAGE", "id":4784929, "ctx":"SignalHandler","msg":"Acquiring the global lock for shutdown"} {"t":{"$date":"2026-02-12T04:37:59.240+00:00"},"s":"I", "c":"STORAGE", "id":4784930, "ctx":"SignalHandler","msg":"Shutting down the storage engine"} {"t":{"$date":"2026-02-12T04:37:59.240+00:00"},"s":"I", "c":"STORAGE", "id":22320, "ctx":"SignalHandler","msg":"Shutting down journal flusher thread"} {"t":{"$date":"2026-02-12T04:37:59.240+00:00"},"s":"I", "c":"STORAGE", "id":22321, "ctx":"SignalHandler","msg":"Finished shutting down journal flusher thread"} {"t":{"$date":"2026-02-12T04:37:59.240+00:00"},"s":"I", "c":"STORAGE", "id":20282, "ctx":"SignalHandler","msg":"Deregistering all the collections"} {"t":{"$date":"2026-02-12T04:37:59.240+00:00"},"s":"I", "c":"STORAGE", "id":22372, "ctx":"OplogVisibilityThread","msg":"Oplog visibility thread shutting down."} {"t":{"$date":"2026-02-12T04:37:59.240+00:00"},"s":"W", "c":"QUERY", "id":20478, "ctx":"conn1339","msg":"getMore command executor error","attr":{"state":"FAILURE","error":{"code":11600,"codeName":"InterruptedAtShutdown","errmsg":"interrupted at shutdown"},"stats":{"stage":"COLLSCAN","nReturned":379,"executionTimeMillisEstimate":6,"works":6231,"advanced":379,"needTime":2926,"needYield":0,"saveState":2926,"restoreState":2925,"isEOF":0,"direction":"forward","minTs":{"$timestamp":{"t":1770870735,"i":6}},"docsExamined":379}}} {"t":{"$date":"2026-02-12T04:37:59.240+00:00"},"s":"I", "c":"STORAGE", "id":22261, "ctx":"SignalHandler","msg":"Timestamp monitor shutting down"} {"t":{"$date":"2026-02-12T04:37:59.241+00:00"},"s":"I", "c":"STORAGE", "id":22317, "ctx":"SignalHandler","msg":"WiredTigerKVEngine shutting down"} {"t":{"$date":"2026-02-12T04:37:59.241+00:00"},"s":"I", "c":"STORAGE", "id":22318, "ctx":"SignalHandler","msg":"Shutting down session sweeper thread"} {"t":{"$date":"2026-02-12T04:37:59.241+00:00"},"s":"I", "c":"STORAGE", "id":22319, "ctx":"SignalHandler","msg":"Finished shutting down session sweeper thread"} {"t":{"$date":"2026-02-12T04:37:59.241+00:00"},"s":"I", "c":"STORAGE", "id":22322, "ctx":"SignalHandler","msg":"Shutting down checkpoint thread"} {"t":{"$date":"2026-02-12T04:37:59.241+00:00"},"s":"I", "c":"STORAGE", "id":22323, "ctx":"SignalHandler","msg":"Finished shutting down checkpoint thread"} {"t":{"$date":"2026-02-12T04:37:59.241+00:00"},"s":"I", "c":"STORAGE", "id":4795902, "ctx":"SignalHandler","msg":"Closing WiredTiger","attr":{"closeConfig":"leak_memory=true,"}} {"t":{"$date":"2026-02-12T04:37:59.244+00:00"},"s":"I", "c":"STORAGE", "id":22430, "ctx":"SignalHandler","msg":"WiredTiger message","attr":{"message":"[1770871079:244152][19:0x7fcc407d3700], close_ckpt: [WT_VERB_CHECKPOINT_PROGRESS] saving checkpoint snapshot min: 3002, snapshot max: 3002 snapshot count: 0, oldest timestamp: (1770871071, 2) , meta checkpoint timestamp: (1770871076, 2) base write gen: 28"}} {"t":{"$date":"2026-02-12T04:37:59.330+00:00"},"s":"I", "c":"STORAGE", "id":4795901, "ctx":"SignalHandler","msg":"WiredTiger closed","attr":{"durationMillis":89}} {"t":{"$date":"2026-02-12T04:37:59.330+00:00"},"s":"I", "c":"STORAGE", "id":22279, "ctx":"SignalHandler","msg":"shutdown: removing fs lock..."} {"t":{"$date":"2026-02-12T04:37:59.330+00:00"},"s":"I", "c":"-", "id":4784931, "ctx":"SignalHandler","msg":"Dropping the scope cache for shutdown"} {"t":{"$date":"2026-02-12T04:37:59.330+00:00"},"s":"I", "c":"FTDC", "id":4784926, "ctx":"SignalHandler","msg":"Shutting down full-time data capture"} {"t":{"$date":"2026-02-12T04:37:59.330+00:00"},"s":"I", "c":"FTDC", "id":20626, "ctx":"SignalHandler","msg":"Shutting down full-time diagnostic data capture"} {"t":{"$date":"2026-02-12T04:37:59.332+00:00"},"s":"I", "c":"CONTROL", "id":20565, "ctx":"SignalHandler","msg":"Now exiting"} {"t":{"$date":"2026-02-12T04:37:59.332+00:00"},"s":"I", "c":"CONTROL", "id":23138, "ctx":"SignalHandler","msg":"Shutting down","attr":{"exitCode":0}} ==> /data/mongodb/logs/mongodb.log.2026-02-12T04-45-43 <== {"t":{"$date":"2026-02-12T04:45:23.135+00:00"},"s":"I", "c":"REPL", "id":4784917, "ctx":"SignalHandler","msg":"Attempting to mark clean shutdown"} {"t":{"$date":"2026-02-12T04:45:23.136+00:00"},"s":"I", "c":"NETWORK", "id":22944, "ctx":"conn17","msg":"Connection ended","attr":{"remote":"127.0.0.1:59568","connectionId":17,"connectionCount":19}} {"t":{"$date":"2026-02-12T04:45:23.136+00:00"},"s":"I", "c":"NETWORK", "id":4784918, "ctx":"SignalHandler","msg":"Shutting down the ReplicaSetMonitor"} {"t":{"$date":"2026-02-12T04:45:23.136+00:00"},"s":"I", "c":"REPL", "id":4784920, "ctx":"SignalHandler","msg":"Shutting down the LogicalTimeValidator"} {"t":{"$date":"2026-02-12T04:45:23.136+00:00"},"s":"I", "c":"SHARDING", "id":4784921, "ctx":"SignalHandler","msg":"Shutting down the MigrationUtilExecutor"} {"t":{"$date":"2026-02-12T04:45:23.136+00:00"},"s":"I", "c":"STORAGE", "id":4784927, "ctx":"SignalHandler","msg":"Shutting down the HealthLog"} {"t":{"$date":"2026-02-12T04:45:23.136+00:00"},"s":"I", "c":"STORAGE", "id":4784929, "ctx":"SignalHandler","msg":"Acquiring the global lock for shutdown"} {"t":{"$date":"2026-02-12T04:45:23.136+00:00"},"s":"I", "c":"STORAGE", "id":4784930, "ctx":"SignalHandler","msg":"Shutting down the storage engine"} {"t":{"$date":"2026-02-12T04:45:23.136+00:00"},"s":"I", "c":"NETWORK", "id":22944, "ctx":"conn3519","msg":"Connection ended","attr":{"remote":"192.168.0.238:42432","connectionId":3519,"connectionCount":18}} {"t":{"$date":"2026-02-12T04:45:23.136+00:00"},"s":"I", "c":"STORAGE", "id":22320, "ctx":"SignalHandler","msg":"Shutting down journal flusher thread"} {"t":{"$date":"2026-02-12T04:45:23.136+00:00"},"s":"I", "c":"STORAGE", "id":22321, "ctx":"SignalHandler","msg":"Finished shutting down journal flusher thread"} {"t":{"$date":"2026-02-12T04:45:23.136+00:00"},"s":"I", "c":"NETWORK", "id":22944, "ctx":"conn4078","msg":"Connection ended","attr":{"remote":"192.168.0.112:34652","connectionId":4078,"connectionCount":17}} {"t":{"$date":"2026-02-12T04:45:23.136+00:00"},"s":"I", "c":"STORAGE", "id":20282, "ctx":"SignalHandler","msg":"Deregistering all the collections"} {"t":{"$date":"2026-02-12T04:45:23.136+00:00"},"s":"I", "c":"STORAGE", "id":22372, "ctx":"OplogVisibilityThread","msg":"Oplog visibility thread shutting down."} {"t":{"$date":"2026-02-12T04:45:23.136+00:00"},"s":"W", "c":"QUERY", "id":20478, "ctx":"conn4100","msg":"getMore command executor error","attr":{"state":"FAILURE","error":{"code":11600,"codeName":"InterruptedAtShutdown","errmsg":"interrupted at shutdown"},"stats":{"stage":"COLLSCAN","nReturned":65,"executionTimeMillisEstimate":0,"works":281,"advanced":65,"needTime":108,"needYield":0,"saveState":108,"restoreState":107,"isEOF":0,"direction":"forward","minTs":{"$timestamp":{"t":1770871457,"i":2}},"docsExamined":65}}} {"t":{"$date":"2026-02-12T04:45:23.136+00:00"},"s":"I", "c":"STORAGE", "id":22261, "ctx":"SignalHandler","msg":"Timestamp monitor shutting down"} {"t":{"$date":"2026-02-12T04:45:23.136+00:00"},"s":"I", "c":"STORAGE", "id":22317, "ctx":"SignalHandler","msg":"WiredTigerKVEngine shutting down"} {"t":{"$date":"2026-02-12T04:45:23.136+00:00"},"s":"I", "c":"STORAGE", "id":22318, "ctx":"SignalHandler","msg":"Shutting down session sweeper thread"} {"t":{"$date":"2026-02-12T04:45:23.136+00:00"},"s":"I", "c":"STORAGE", "id":22319, "ctx":"SignalHandler","msg":"Finished shutting down session sweeper thread"} {"t":{"$date":"2026-02-12T04:45:23.136+00:00"},"s":"I", "c":"STORAGE", "id":22322, "ctx":"SignalHandler","msg":"Shutting down checkpoint thread"} {"t":{"$date":"2026-02-12T04:45:23.136+00:00"},"s":"I", "c":"STORAGE", "id":22323, "ctx":"SignalHandler","msg":"Finished shutting down checkpoint thread"} {"t":{"$date":"2026-02-12T04:45:23.137+00:00"},"s":"I", "c":"STORAGE", "id":4795902, "ctx":"SignalHandler","msg":"Closing WiredTiger","attr":{"closeConfig":"leak_memory=true,"}} {"t":{"$date":"2026-02-12T04:45:23.139+00:00"},"s":"I", "c":"STORAGE", "id":22430, "ctx":"SignalHandler","msg":"WiredTiger message","attr":{"message":"[1770871523:139892][20:0x7fd1dd13c700], close_ckpt: [WT_VERB_CHECKPOINT_PROGRESS] saving checkpoint snapshot min: 1530, snapshot max: 1530 snapshot count: 0, oldest timestamp: (1770871517, 2) , meta checkpoint timestamp: (1770871522, 2) base write gen: 83"}} {"t":{"$date":"2026-02-12T04:45:23.153+00:00"},"s":"I", "c":"STORAGE", "id":4795901, "ctx":"SignalHandler","msg":"WiredTiger closed","attr":{"durationMillis":16}} {"t":{"$date":"2026-02-12T04:45:23.153+00:00"},"s":"I", "c":"STORAGE", "id":22279, "ctx":"SignalHandler","msg":"shutdown: removing fs lock..."} {"t":{"$date":"2026-02-12T04:45:23.153+00:00"},"s":"I", "c":"-", "id":4784931, "ctx":"SignalHandler","msg":"Dropping the scope cache for shutdown"} {"t":{"$date":"2026-02-12T04:45:23.153+00:00"},"s":"I", "c":"FTDC", "id":4784926, "ctx":"SignalHandler","msg":"Shutting down full-time data capture"} {"t":{"$date":"2026-02-12T04:45:23.153+00:00"},"s":"I", "c":"FTDC", "id":20626, "ctx":"SignalHandler","msg":"Shutting down full-time diagnostic data capture"} {"t":{"$date":"2026-02-12T04:45:23.155+00:00"},"s":"I", "c":"CONTROL", "id":20565, "ctx":"SignalHandler","msg":"Now exiting"} {"t":{"$date":"2026-02-12T04:45:23.155+00:00"},"s":"I", "c":"CONTROL", "id":23138, "ctx":"SignalHandler","msg":"Shutting down","attr":{"exitCode":0}} delete cluster mongodb-eflsbm `kbcli cluster delete mongodb-eflsbm --auto-approve --namespace default ` pod_info:mongodb-eflsbm-mongodb-0 4/4 Running 0 11m mongodb-eflsbm-mongodb-2 4/4 Running 0 34m mongodb-eflsbm-mongodb-3 4/4 Running 0 35m Cluster mongodb-eflsbm deleted pod_info:mongodb-eflsbm-mongodb-0 4/4 Terminating 0 12m mongodb-eflsbm-mongodb-2 4/4 Terminating 0 34m No resources found in default namespace. delete cluster pod done No resources found in default namespace. check cluster resource non-exist OK: pvc No resources found in default namespace. delete cluster done No resources found in default namespace. No resources found in default namespace. check resource cm non exists No resources found in default namespace. check resource cm non exists No resources found in default namespace. Mongodb Test Suite All Done! Test Engine: mongodb Test Type: 6 --------------------------------------Mongodb (Topology = replicaset Replicas 3) Test Result-------------------------------------- [PASSED]|[Create]|[Topology=replicaset;ComponentDefinition=mongodb-1.0.2;ComponentVersion=mongodb;ServiceVersion=4.4.29;]|[Description=Create a cluster with the specified topology replicaset with the specified component definition mongodb-1.0.2 and component version mongodb and service version 4.4.29] [PASSED]|[Connect]|[ComponentName=mongodb]|[Description=Connect to the cluster] [PASSED]|[AddData]|[Values=nelsi]|[Description=Add data to the cluster] [PASSED]|[CheckAddDataReadonly]|[Values=nelsi;Role=Readonly]|[Description=Add data to the cluster readonly] [PASSED]|[RebuildInstance]|[ComponentName=mongodb]|[Description=Rebuild the cluster instance specify component mongodb] [PASSED]|[SwitchOver]|[ComponentName=mongodb]|[Description=SwitchOver the cluster specify component mongodb] [PASSED]|[Update]|[Monitor=true]|[Description=Update the cluster Monitor enable] [PASSED]|[NoFailover]|[HA=Network Delay;Durations=2m;ComponentName=mongodb]|[Description=Simulates network delay fault thereby testing the application's resilience to potential slowness/unavailability of some replicas due to delay network.] [PASSED]|[Failover]|[HA=Network Loss;Durations=2m;ComponentName=mongodb]|[Description=Simulates network loss fault thereby testing the application's resilience to potential slowness/unavailability of some replicas due to loss network.] [PASSED]|[NoFailover]|[HA=DNS Random;Durations=2m;ComponentName=mongodb]|[Description=Simulates conditions where pods experience random IP addresses being returned by the DNS service for a period of time either due to expected/undesired processes thereby testing the application's resilience to potential slowness/unavailability of some replicas due to the DNS service returning random IP addresses.] [PASSED]|[NoFailover]|[HA=Network Partition;Durations=2m;ComponentName=mongodb]|[Description=Simulates network partition fault thereby testing the application's resilience to potential slowness/unavailability of some replicas due to partition network.] [PASSED]|[Failover]|[HA=OOM;Durations=2m;ComponentName=mongodb]|[Description=Simulates conditions where pods experience OOM either due to expected/undesired processes thereby testing the application's resilience to potential slowness/unavailability of some replicas due to high Memory load.] [PASSED]|[NoFailover]|[HA=Network Duplicate;Durations=2m;ComponentName=mongodb]|[Description=Simulates network duplicate fault thereby testing the application's resilience to potential slowness/unavailability of some replicas due to duplicate network.] [PASSED]|[HscaleOfflineInstances]|[ComponentName=mongodb]|[Description=Hscale the cluster instances offline specify component mongodb] [PASSED]|[HscaleOnlineInstances]|[ComponentName=mongodb]|[Description=Hscale the cluster instances online specify component mongodb] [PASSED]|[Stop]|[-]|[Description=Stop the cluster] [PASSED]|[Start]|[-]|[Description=Start the cluster] [PASSED]|[Failover]|[HA=Pod Failure;Durations=2m;ComponentName=mongodb]|[Description=Simulates conditions where pods experience failure for a period of time either due to expected/undesired processes thereby testing the application's resilience to potential slowness/unavailability of some replicas due to failure.] [PASSED]|[VolumeExpansion]|[ComponentName=mongodb]|[Description=VolumeExpansion the cluster specify component mongodb] [PASSED]|[NoFailover]|[HA=DNS Error;Durations=2m;ComponentName=mongodb]|[Description=Simulates conditions where pods experience DNS service errors for a period of time either due to expected/undesired processes thereby testing the application's resilience to potential slowness/unavailability of some replicas due to DNS service errors.] [PASSED]|[VerticalScaling]|[ComponentName=mongodb]|[Description=VerticalScaling the cluster specify component mongodb] [PASSED]|[Failover]|[HA=Kill 1;ComponentName=mongodb]|[Description=Simulates conditions where process 1 killed either due to expected/undesired processes thereby testing the application's resilience to unavailability of some replicas due to abnormal termination signals.] [PASSED]|[Failover]|[HA=Pod Kill;ComponentName=mongodb]|[Description=Simulates conditions where pods experience kill for a period of time either due to expected/undesired processes thereby testing the application's resilience to potential slowness/unavailability of some replicas due to kill.] [PASSED]|[Failover]|[HA=Network Corrupt;Durations=2m;ComponentName=mongodb]|[Description=Simulates network corrupt fault thereby testing the application's resilience to potential slowness/unavailability of some replicas due to corrupt network.] [PASSED]|[Restart]|[-]|[Description=Restart the cluster] [PASSED]|[Failover]|[HA=Network Bandwidth;Durations=2m;ComponentName=mongodb]|[Description=Simulates network bandwidth fault thereby testing the application's resilience to potential slowness/unavailability of some replicas due to bandwidth network.] [PASSED]|[NoFailover]|[HA=Full CPU;Durations=2m;ComponentName=mongodb]|[Description=Simulates conditions where pods experience CPU full either due to expected/undesired processes thereby testing the application's resilience to potential slowness/unavailability of some replicas due to high CPU load.] [PASSED]|[NoFailover]|[HA=Time Offset;Durations=2m;ComponentName=mongodb]|[Description=Simulates a time offset scenario thereby testing the application's resilience to potential slowness/unavailability of some replicas due to time offset.] [PASSED]|[Connect]|[Endpoints=true]|[Description=Connect to the cluster] [PASSED]|[HorizontalScaling Out]|[ComponentName=mongodb]|[Description=HorizontalScaling Out the cluster specify component mongodb] [PASSED]|[HorizontalScaling In]|[ComponentName=mongodb]|[Description=HorizontalScaling In the cluster specify component mongodb] [PASSED]|[Update]|[TerminationPolicy=WipeOut]|[Description=Update the cluster TerminationPolicy WipeOut] [PASSED]|[Backup]|[BackupMethod=pbm-physical]|[Description=The cluster pbm-physical Backup] [PASSED]|[Restore]|[BackupMethod=pbm-physical]|[Description=The cluster pbm-physical Restore] [PASSED]|[Connect]|[ComponentName=mongodb]|[Description=Connect to the cluster] [PASSED]|[Delete Restore Cluster]|[BackupMethod=pbm-physical]|[Description=Delete the pbm-physical restore cluster] [PASSED]|[Backup]|[BackupMethod=datafile]|[Description=The cluster datafile Backup] [PASSED]|[Restore]|[BackupMethod=datafile]|[Description=The cluster datafile Restore] [PASSED]|[Connect]|[ComponentName=mongodb]|[Description=Connect to the cluster] [PASSED]|[Delete Restore Cluster]|[BackupMethod=datafile]|[Description=Delete the datafile restore cluster] [PASSED]|[RebuildInstance]|[ComponentName=mongodb]|[Description=Rebuild the cluster instance specify component mongodb] [PASSED]|[Backup]|[BackupMethod=volume-snapshot]|[Description=The cluster volume-snapshot Backup] [PASSED]|[Restore]|[BackupMethod=volume-snapshot]|[Description=The cluster volume-snapshot Restore] [PASSED]|[Connect]|[ComponentName=mongodb]|[Description=Connect to the cluster] [PASSED]|[Delete Restore Cluster]|[BackupMethod=volume-snapshot]|[Description=Delete the volume-snapshot restore cluster] [PASSED]|[Backup]|[BackupMethod=dump]|[Description=The cluster dump Backup] [PASSED]|[Restore]|[BackupMethod=dump]|[Description=The cluster dump Restore] [PASSED]|[Check Data]|[BackupMethod=dump]|[Description=Check the cluster data restore via dump] [PASSED]|[Connect]|[ComponentName=mongodb]|[Description=Connect to the cluster] [PASSED]|[Delete Restore Cluster]|[BackupMethod=dump]|[Description=Delete the dump restore cluster] [PASSED]|[Backup]|[Schedule=true;BackupMethod=pbm-physical]|[Description=The cluster Schedule pbm-physical Backup] [PASSED]|[Restore]|[Schedule=true;BackupMethod=pbm-physical]|[Description=The cluster Schedule pbm-physical Restore] [PASSED]|[Connect]|[ComponentName=mongodb]|[Description=Connect to the cluster] [PASSED]|[Delete Restore Cluster]|[Schedule=true;BackupMethod=pbm-physical]|[Description=Delete the Schedule pbm-physical restore cluster] [PASSED]|[Delete]|[-]|[Description=Delete the cluster] [END]