source commons files source engines files source kubeblocks files `kubectl get namespace | grep ns-jcjpx ` `kubectl create namespace ns-jcjpx` namespace/ns-jcjpx created create namespace ns-jcjpx done download kbcli `gh release list --repo apecloud/kbcli --limit 100 | (grep "0.9" || true)` `curl -fsSL https://kubeblocks.io/installer/install_cli.sh | bash -s v0.9.4-beta.1` Your system is linux_amd64 Installing kbcli ... Downloading ... % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 32.1M 100 32.1M 0 0 53.7M 0 --:--:-- --:--:-- --:--:-- 53.7M kbcli installed successfully. Kubernetes: v1.32.5-eks-5d4a308 KubeBlocks: 0.9.4 kbcli: 0.9.4-beta.1 WARNING: version difference between kbcli (0.9.4-beta.1) and kubeblocks (0.9.4) Make sure your docker service is running and begin your journey with kbcli: kbcli playground init For more information on how to get started, please visit: https://kubeblocks.io download kbcli v0.9.4-beta.1 done Kubernetes: v1.32.5-eks-5d4a308 KubeBlocks: 0.9.4 kbcli: 0.9.4-beta.1 WARNING: version difference between kbcli (0.9.4-beta.1) and kubeblocks (0.9.4) Kubernetes Env: v1.32.5-eks-5d4a308 POD_RESOURCES: No resources found found default storage class: gp3 kubeblocks version is:0.9.4 skip upgrade kubeblocks Error: no repositories to show helm repo add chaos-mesh https://charts.chaos-mesh.org "chaos-mesh" has been added to your repositories add helm chart repo chaos-mesh success chaos mesh already installed check cluster definition set component name:redis set component version set component version:redis set service versions:7.0.6,7.2.4,7.2.7 set service versions sorted:7.0.6,7.2.4,7.2.7 set redis component definition set redis component definition redis-7 set replicas first:2,7.0.6|2,7.2.4|2,7.2.7 set replicas third:2,7.0.6 set replicas fourth:2,7.0.6 set minimum cmpv service version set minimum cmpv service version replicas:2,7.0.6 REPORT_COUNT:1 CLUSTER_TOPOLOGY:replication topology replication found in cluster definition redis LIMIT_CPU:0.1 LIMIT_MEMORY:0.5 storage size: 1 No resources found in ns-jcjpx namespace. termination_policy:Delete create 2 replica Delete redis cluster check cluster version check cluster definition check component definition set component definition by component version check cmpd by labels set component definition1: redis-7 by component version:redis apiVersion: apps.kubeblocks.io/v1alpha1 kind: Cluster metadata: name: redis-ljzvzz namespace: ns-jcjpx spec: terminationPolicy: Delete componentSpecs: - name: redis componentDef: redis-7 replicas: 2 resources: requests: cpu: 100m memory: 0.5Gi limits: cpu: 100m memory: 0.5Gi switchPolicy: type: Noop volumeClaimTemplates: - name: data spec: storageClassName: accessModes: - ReadWriteOnce resources: requests: storage: 1Gi - name: redis-sentinel componentDef: redis-sentinel-7 replicas: 3 resources: requests: cpu: 100m memory: 0.5Gi limits: cpu: 100m memory: 0.5Gi volumeClaimTemplates: - name: data spec: storageClassName: accessModes: - ReadWriteOnce resources: requests: storage: 1Gi - name: redis-twemproxy componentDef: redis-twemproxy-0.5 replicas: 3 resources: requests: cpu: 100m memory: 0.5Gi limits: cpu: 100m memory: 0.5Gi volumeClaimTemplates: - name: data spec: storageClassName: accessModes: - ReadWriteOnce resources: requests: storage: 1Gi `kubectl apply -f test_create_redis-ljzvzz.yaml` cluster.apps.kubeblocks.io/redis-ljzvzz created apply test_create_redis-ljzvzz.yaml Success `rm -rf test_create_redis-ljzvzz.yaml` check cluster status `kbcli cluster list redis-ljzvzz --show-labels --namespace ns-jcjpx ` NAME NAMESPACE CLUSTER-DEFINITION VERSION TERMINATION-POLICY STATUS CREATED-TIME LABELS redis-ljzvzz ns-jcjpx Delete Jun 19,2025 18:16 UTC+0800 cluster_status: cluster_status:Creating cluster_status:Updating check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances redis-ljzvzz --namespace ns-jcjpx ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME redis-ljzvzz-redis-0 ns-jcjpx redis-ljzvzz redis Running primary us-west-2a 100m / 100m 512Mi / 512Mi data:1Gi ip-172-31-8-116.us-west-2.compute.internal/172.31.8.116 Jun 19,2025 18:16 UTC+0800 redis-ljzvzz-redis-1 ns-jcjpx redis-ljzvzz redis Running secondary us-west-2a 100m / 100m 512Mi / 512Mi data:1Gi ip-172-31-12-104.us-west-2.compute.internal/172.31.12.104 Jun 19,2025 18:16 UTC+0800 redis-ljzvzz-redis-sentinel-0 ns-jcjpx redis-ljzvzz redis-sentinel Running us-west-2a 100m / 100m 512Mi / 512Mi data:1Gi ip-172-31-6-232.us-west-2.compute.internal/172.31.6.232 Jun 19,2025 18:16 UTC+0800 redis-ljzvzz-redis-sentinel-1 ns-jcjpx redis-ljzvzz redis-sentinel Running us-west-2a 100m / 100m 512Mi / 512Mi data:1Gi ip-172-31-1-34.us-west-2.compute.internal/172.31.1.34 Jun 19,2025 18:16 UTC+0800 redis-ljzvzz-redis-sentinel-2 ns-jcjpx redis-ljzvzz redis-sentinel Running us-west-2a 100m / 100m 512Mi / 512Mi data:1Gi ip-172-31-1-97.us-west-2.compute.internal/172.31.1.97 Jun 19,2025 18:16 UTC+0800 redis-ljzvzz-redis-twemproxy-0 ns-jcjpx redis-ljzvzz redis-twemproxy Running us-west-2a 100m / 100m 512Mi / 512Mi data:1Gi ip-172-31-10-206.us-west-2.compute.internal/172.31.10.206 Jun 19,2025 18:16 UTC+0800 redis-ljzvzz-redis-twemproxy-1 ns-jcjpx redis-ljzvzz redis-twemproxy Running us-west-2a 100m / 100m 512Mi / 512Mi data:1Gi ip-172-31-8-95.us-west-2.compute.internal/172.31.8.95 Jun 19,2025 18:16 UTC+0800 redis-ljzvzz-redis-twemproxy-2 ns-jcjpx redis-ljzvzz redis-twemproxy Running us-west-2a 100m / 100m 512Mi / 512Mi data:1Gi ip-172-31-2-66.us-west-2.compute.internal/172.31.2.66 Jun 19,2025 18:17 UTC+0800 check pod status done check cluster role check cluster role done primary: redis-ljzvzz-redis-0;secondary: redis-ljzvzz-redis-1 `kubectl get secrets -l app.kubernetes.io/instance=redis-ljzvzz` set secret: redis-ljzvzz-redis-account-default `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.username***"` `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.password***"` `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.port***"` DB_USERNAME_PROXY:;DB_PASSWORD_PROXY:;DB_PORT_PROXY:26379 DB_USERNAME:default;DB_PASSWORD:gu97Tl5m13;DB_PORT:6379;DB_DATABASE:db0 check cluster connect `echo 'echo "" | redis-cli -h redis-ljzvzz-redis-redis.ns-jcjpx.svc.cluster.local -p 6379 -a gu97Tl5m13' | kubectl exec -it redis-ljzvzz-redis-0 --namespace ns-jcjpx -- bash` check cluster connect done `kubectl get secrets -l app.kubernetes.io/instance=redis-ljzvzz` set secret: redis-ljzvzz-redis-account-default `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.username***"` `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.password***"` `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.port***"` DB_USERNAME_PROXY:;DB_PASSWORD_PROXY:;DB_PORT_PROXY:26379 DB_USERNAME:default;DB_PASSWORD:gu97Tl5m13;DB_PORT:6379;DB_DATABASE:db0 check pod redis-ljzvzz-redis-0 container_name redis exist password gu97Tl5m13 check pod redis-ljzvzz-redis-0 container_name metrics exist password gu97Tl5m13 check pod redis-ljzvzz-redis-0 container_name lorry exist password gu97Tl5m13 No container logs contain secret password. describe cluster `kbcli cluster describe redis-ljzvzz --namespace ns-jcjpx ` Name: redis-ljzvzz Created Time: Jun 19,2025 18:16 UTC+0800 NAMESPACE CLUSTER-DEFINITION VERSION STATUS TERMINATION-POLICY ns-jcjpx Running Delete Endpoints: COMPONENT MODE INTERNAL EXTERNAL redis ReadWrite redis-ljzvzz-redis-redis.ns-jcjpx.svc.cluster.local:6379 redis-sentinel ReadWrite redis-ljzvzz-redis-sentinel-redis-sentinel.ns-jcjpx.svc.cluster.local:26379 redis-twemproxy ReadWrite redis-ljzvzz-redis-twemproxy-twemproxy.ns-jcjpx.svc.cluster.local:22121 Topology: COMPONENT INSTANCE ROLE STATUS AZ NODE CREATED-TIME redis redis-ljzvzz-redis-0 primary Running us-west-2a ip-172-31-8-116.us-west-2.compute.internal/172.31.8.116 Jun 19,2025 18:16 UTC+0800 redis redis-ljzvzz-redis-1 secondary Running us-west-2a ip-172-31-12-104.us-west-2.compute.internal/172.31.12.104 Jun 19,2025 18:16 UTC+0800 redis-sentinel redis-ljzvzz-redis-sentinel-0 Running us-west-2a ip-172-31-6-232.us-west-2.compute.internal/172.31.6.232 Jun 19,2025 18:16 UTC+0800 redis-sentinel redis-ljzvzz-redis-sentinel-1 Running us-west-2a ip-172-31-1-34.us-west-2.compute.internal/172.31.1.34 Jun 19,2025 18:16 UTC+0800 redis-sentinel redis-ljzvzz-redis-sentinel-2 Running us-west-2a ip-172-31-1-97.us-west-2.compute.internal/172.31.1.97 Jun 19,2025 18:16 UTC+0800 redis-twemproxy redis-ljzvzz-redis-twemproxy-0 Running us-west-2a ip-172-31-10-206.us-west-2.compute.internal/172.31.10.206 Jun 19,2025 18:16 UTC+0800 redis-twemproxy redis-ljzvzz-redis-twemproxy-1 Running us-west-2a ip-172-31-8-95.us-west-2.compute.internal/172.31.8.95 Jun 19,2025 18:16 UTC+0800 redis-twemproxy redis-ljzvzz-redis-twemproxy-2 Running us-west-2a ip-172-31-2-66.us-west-2.compute.internal/172.31.2.66 Jun 19,2025 18:17 UTC+0800 Resources Allocation: COMPONENT DEDICATED CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE-SIZE STORAGE-CLASS redis false 100m / 100m 512Mi / 512Mi data:1Gi kb-default-sc redis-sentinel false 100m / 100m 512Mi / 512Mi data:1Gi kb-default-sc redis-twemproxy false 100m / 100m 512Mi / 512Mi data:1Gi kb-default-sc Images: COMPONENT TYPE IMAGE redis docker.io/apecloud/redis-stack-server:7.2.0-v14 redis-sentinel docker.io/apecloud/redis-stack-server:7.2.0-v14 redis-twemproxy docker.io/apecloud/twemproxy:0.5.0 Data Protection: BACKUP-REPO AUTO-BACKUP BACKUP-SCHEDULE BACKUP-METHOD BACKUP-RETENTION RECOVERABLE-TIME Show cluster events: kbcli cluster list-events -n ns-jcjpx redis-ljzvzz `kbcli cluster label redis-ljzvzz app.kubernetes.io/instance- --namespace ns-jcjpx ` label "app.kubernetes.io/instance" not found. `kbcli cluster label redis-ljzvzz app.kubernetes.io/instance=redis-ljzvzz --namespace ns-jcjpx ` `kbcli cluster label redis-ljzvzz --list --namespace ns-jcjpx ` NAME NAMESPACE LABELS redis-ljzvzz ns-jcjpx app.kubernetes.io/instance=redis-ljzvzz label cluster app.kubernetes.io/instance=redis-ljzvzz Success `kbcli cluster label case.name=kbcli.test1 -l app.kubernetes.io/instance=redis-ljzvzz --namespace ns-jcjpx ` `kbcli cluster label redis-ljzvzz --list --namespace ns-jcjpx ` NAME NAMESPACE LABELS redis-ljzvzz ns-jcjpx app.kubernetes.io/instance=redis-ljzvzz case.name=kbcli.test1 label cluster case.name=kbcli.test1 Success `kbcli cluster label redis-ljzvzz case.name=kbcli.test2 --overwrite --namespace ns-jcjpx ` `kbcli cluster label redis-ljzvzz --list --namespace ns-jcjpx ` NAME NAMESPACE LABELS redis-ljzvzz ns-jcjpx app.kubernetes.io/instance=redis-ljzvzz case.name=kbcli.test2 label cluster case.name=kbcli.test2 Success `kbcli cluster label redis-ljzvzz case.name- --namespace ns-jcjpx ` `kbcli cluster label redis-ljzvzz --list --namespace ns-jcjpx ` NAME NAMESPACE LABELS redis-ljzvzz ns-jcjpx app.kubernetes.io/instance=redis-ljzvzz delete cluster label case.name Success cluster connect `kubectl get secrets -l app.kubernetes.io/instance=redis-ljzvzz` set secret: redis-ljzvzz-redis-account-default `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.username***"` `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.password***"` `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.port***"` DB_USERNAME_PROXY:;DB_PASSWORD_PROXY:;DB_PORT_PROXY:26379 DB_USERNAME:default;DB_PASSWORD:gu97Tl5m13;DB_PORT:6379;DB_DATABASE:db0 Defaulted container "redis" out of: redis, metrics, lorry, init-lorry (init) Unable to use a TTY - input is not a terminal or the right kind of file Warning: Using a password with '-a' or '-u' option on the command line interface may not be safe. # Server redis_version:7.2.7 redis_git_sha1:00000000 redis_git_dirty:0 redis_build_id:acdbb1d3e39a157b redis_mode:standalone os:Linux 5.10.237-230.949.amzn2.x86_64 x86_64 arch_bits:64 monotonic_clock:POSIX clock_gettime multiplexing_api:epoll atomicvar_api:c11-builtin gcc_version:11.4.0 process_id:1 process_supervised:no run_id:361ab47ad7b3dacfacb78325875ff3ed875c66ec tcp_port:6379 server_time_usec:1750328299837904 uptime_in_seconds:81 uptime_in_days:0 hz:10 configured_hz:10 lru_clock:5497835 executable:/redis-server config_file:/etc/redis/redis.conf io_threads_active:0 listener0:name=tcp,bind=*,bind=-::*,port=6379 `echo 'echo "CONFIG GET maxclients" | redis-cli -h redis-ljzvzz-redis-redis.ns-jcjpx.svc.cluster.local -p 6379 -a gu97Tl5m13' | kubectl exec -it redis-ljzvzz-redis-0 --namespace ns-jcjpx -- bash ` Defaulted container "redis" out of: redis, metrics, lorry, init-lorry (init) Unable to use a TTY - input is not a terminal or the right kind of file Warning: Using a password with '-a' or '-u' option on the command line interface may not be safe. maxclients 10000 connect cluster Success set max_connections to 10000 insert batch data by db client Error from server (NotFound): pods "test-db-client-executionloop-redis-ljzvzz" not found DB_CLIENT_BATCH_DATA_COUNT: `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge pods test-db-client-executionloop-redis-ljzvzz --namespace ns-jcjpx ` Error from server (NotFound): pods "test-db-client-executionloop-redis-ljzvzz" not found Warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely. Error from server (NotFound): pods "test-db-client-executionloop-redis-ljzvzz" not found `kubectl get secrets -l app.kubernetes.io/instance=redis-ljzvzz` set secret: redis-ljzvzz-redis-account-default `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.username***"` `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.password***"` `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.port***"` DB_USERNAME_PROXY:;DB_PASSWORD_PROXY:;DB_PORT_PROXY:26379 DB_USERNAME:default;DB_PASSWORD:gu97Tl5m13;DB_PORT:6379;DB_DATABASE:db0 apiVersion: v1 kind: Pod metadata: name: test-db-client-executionloop-redis-ljzvzz namespace: ns-jcjpx spec: containers: - name: test-dbclient imagePullPolicy: IfNotPresent image: docker.io/apecloud/dbclient:test args: - "--host" - "redis-ljzvzz-redis-redis.ns-jcjpx.svc.cluster.local" - "--user" - "default" - "--password" - "gu97Tl5m13" - "--port" - "6379" - "--dbtype" - "redis" - "--test" - "executionloop" - "--duration" - "60" - "--interval" - "1" restartPolicy: Never `kubectl apply -f test-db-client-executionloop-redis-ljzvzz.yaml` pod/test-db-client-executionloop-redis-ljzvzz created apply test-db-client-executionloop-redis-ljzvzz.yaml Success `rm -rf test-db-client-executionloop-redis-ljzvzz.yaml` check pod status pod_status:NAME READY STATUS RESTARTS AGE test-db-client-executionloop-redis-ljzvzz 0/1 ContainerCreating 0 6s pod_status:NAME READY STATUS RESTARTS AGE test-db-client-executionloop-redis-ljzvzz 1/1 Running 0 11s pod_status:NAME READY STATUS RESTARTS AGE test-db-client-executionloop-redis-ljzvzz 1/1 Running 0 16s pod_status:NAME READY STATUS RESTARTS AGE test-db-client-executionloop-redis-ljzvzz 1/1 Running 0 22s pod_status:NAME READY STATUS RESTARTS AGE test-db-client-executionloop-redis-ljzvzz 1/1 Running 0 28s pod_status:NAME READY STATUS RESTARTS AGE test-db-client-executionloop-redis-ljzvzz 1/1 Running 0 34s pod_status:NAME READY STATUS RESTARTS AGE test-db-client-executionloop-redis-ljzvzz 1/1 Running 0 39s pod_status:NAME READY STATUS RESTARTS AGE test-db-client-executionloop-redis-ljzvzz 1/1 Running 0 45s pod_status:NAME READY STATUS RESTARTS AGE test-db-client-executionloop-redis-ljzvzz 1/1 Running 0 51s pod_status:NAME READY STATUS RESTARTS AGE test-db-client-executionloop-redis-ljzvzz 1/1 Running 0 57s pod_status:NAME READY STATUS RESTARTS AGE test-db-client-executionloop-redis-ljzvzz 1/1 Running 0 63s pod_status:NAME READY STATUS RESTARTS AGE test-db-client-executionloop-redis-ljzvzz 1/1 Running 0 68s check pod test-db-client-executionloop-redis-ljzvzz status done pod_status:NAME READY STATUS RESTARTS AGE test-db-client-executionloop-redis-ljzvzz 0/1 Completed 0 74s check cluster status `kbcli cluster list redis-ljzvzz --show-labels --namespace ns-jcjpx ` NAME NAMESPACE CLUSTER-DEFINITION VERSION TERMINATION-POLICY STATUS CREATED-TIME LABELS redis-ljzvzz ns-jcjpx Delete Running Jun 19,2025 18:16 UTC+0800 app.kubernetes.io/instance=redis-ljzvzz check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances redis-ljzvzz --namespace ns-jcjpx ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME redis-ljzvzz-redis-0 ns-jcjpx redis-ljzvzz redis Running primary us-west-2a 100m / 100m 512Mi / 512Mi data:1Gi ip-172-31-8-116.us-west-2.compute.internal/172.31.8.116 Jun 19,2025 18:16 UTC+0800 redis-ljzvzz-redis-1 ns-jcjpx redis-ljzvzz redis Running secondary us-west-2a 100m / 100m 512Mi / 512Mi data:1Gi ip-172-31-12-104.us-west-2.compute.internal/172.31.12.104 Jun 19,2025 18:16 UTC+0800 redis-ljzvzz-redis-sentinel-0 ns-jcjpx redis-ljzvzz redis-sentinel Running us-west-2a 100m / 100m 512Mi / 512Mi data:1Gi ip-172-31-6-232.us-west-2.compute.internal/172.31.6.232 Jun 19,2025 18:16 UTC+0800 redis-ljzvzz-redis-sentinel-1 ns-jcjpx redis-ljzvzz redis-sentinel Running us-west-2a 100m / 100m 512Mi / 512Mi data:1Gi ip-172-31-1-34.us-west-2.compute.internal/172.31.1.34 Jun 19,2025 18:16 UTC+0800 redis-ljzvzz-redis-sentinel-2 ns-jcjpx redis-ljzvzz redis-sentinel Running us-west-2a 100m / 100m 512Mi / 512Mi data:1Gi ip-172-31-1-97.us-west-2.compute.internal/172.31.1.97 Jun 19,2025 18:16 UTC+0800 redis-ljzvzz-redis-twemproxy-0 ns-jcjpx redis-ljzvzz redis-twemproxy Running us-west-2a 100m / 100m 512Mi / 512Mi data:1Gi ip-172-31-10-206.us-west-2.compute.internal/172.31.10.206 Jun 19,2025 18:16 UTC+0800 redis-ljzvzz-redis-twemproxy-1 ns-jcjpx redis-ljzvzz redis-twemproxy Running us-west-2a 100m / 100m 512Mi / 512Mi data:1Gi ip-172-31-8-95.us-west-2.compute.internal/172.31.8.95 Jun 19,2025 18:16 UTC+0800 redis-ljzvzz-redis-twemproxy-2 ns-jcjpx redis-ljzvzz redis-twemproxy Running us-west-2a 100m / 100m 512Mi / 512Mi data:1Gi ip-172-31-2-66.us-west-2.compute.internal/172.31.2.66 Jun 19,2025 18:17 UTC+0800 check pod status done check cluster role check cluster role done primary: redis-ljzvzz-redis-0;secondary: redis-ljzvzz-redis-1 `kubectl get secrets -l app.kubernetes.io/instance=redis-ljzvzz` set secret: redis-ljzvzz-redis-account-default `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.username***"` `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.password***"` `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.port***"` DB_USERNAME_PROXY:;DB_PASSWORD_PROXY:;DB_PORT_PROXY:26379 DB_USERNAME:default;DB_PASSWORD:gu97Tl5m13;DB_PORT:6379;DB_DATABASE:db0 check cluster connect `echo 'echo "" | redis-cli -h redis-ljzvzz-redis-redis.ns-jcjpx.svc.cluster.local -p 6379 -a gu97Tl5m13' | kubectl exec -it redis-ljzvzz-redis-0 --namespace ns-jcjpx -- bash` check cluster connect done --host redis-ljzvzz-redis-redis.ns-jcjpx.svc.cluster.local --user default --password gu97Tl5m13 --port 6379 --dbtype redis --test executionloop --duration 60 --interval 1 SLF4J(I): Connected with provider of type [ch.qos.logback.classic.spi.LogbackServiceProvider] Execution loop start: Execution loop start:set executions_loop_key executions_loop_test_1 [ 1s ] executions total: 407 successful: 407 failed: 0 disconnect: 0 [2025-06-19 10:18:43.639] Connection error occurred! [ 2s ] executions total: 801 successful: 800 failed: 1 disconnect: 1 [2025-06-19 10:18:43.639] Connection error occurred! [2025-06-19 10:18:44.644] Connection successfully recovered! The connection was restored in 1005 milliseconds. [ 3s ] executions total: 802 successful: 801 failed: 1 disconnect: 1 [ 4s ] executions total: 1202 successful: 1201 failed: 1 disconnect: 1 [2025-06-19 10:18:49.593] Connection error occurred! [ 5s ] executions total: 1602 successful: 1600 failed: 2 disconnect: 2 [2025-06-19 10:18:49.593] Connection error occurred! [2025-06-19 10:18:50.597] Connection successfully recovered! The connection was restored in 1004 milliseconds. [ 6s ] executions total: 1603 successful: 1601 failed: 2 disconnect: 2 [ 7s ] executions total: 2029 successful: 2027 failed: 2 disconnect: 2 [2025-06-19 10:18:55.459] Connection error occurred! [ 8s ] executions total: 2403 successful: 2400 failed: 3 disconnect: 3 [2025-06-19 10:18:55.459] Connection error occurred! [2025-06-19 10:18:56.463] Connection successfully recovered! The connection was restored in 1004 milliseconds. [ 9s ] executions total: 2404 successful: 2401 failed: 3 disconnect: 3 [ 10s ] executions total: 2853 successful: 2850 failed: 3 disconnect: 3 [2025-06-19 10:19:01.286] Connection error occurred! [ 11s ] executions total: 3204 successful: 3200 failed: 4 disconnect: 4 [2025-06-19 10:19:01.286] Connection error occurred! [2025-06-19 10:19:02.291] Connection successfully recovered! The connection was restored in 1005 milliseconds. [ 12s ] executions total: 3205 successful: 3201 failed: 4 disconnect: 4 [ 13s ] executions total: 3641 successful: 3637 failed: 4 disconnect: 4 [ 14s ] executions total: 3973 successful: 3969 failed: 4 disconnect: 4 [2025-06-19 10:19:07.373] Connection error occurred! [ 15s ] executions total: 4005 successful: 4000 failed: 5 disconnect: 5 [2025-06-19 10:19:07.373] Connection error occurred! [2025-06-19 10:19:08.378] Connection successfully recovered! The connection was restored in 1005 milliseconds. [ 16s ] executions total: 4006 successful: 4001 failed: 5 disconnect: 5 [ 17s ] executions total: 4367 successful: 4362 failed: 5 disconnect: 5 [ 18s ] executions total: 4766 successful: 4761 failed: 5 disconnect: 5 [2025-06-19 10:19:13.528] Connection error occurred! [ 19s ] executions total: 4806 successful: 4800 failed: 6 disconnect: 6 [2025-06-19 10:19:13.528] Connection error occurred! [2025-06-19 10:19:14.533] Connection successfully recovered! The connection was restored in 1005 milliseconds. [ 20s ] executions total: 4807 successful: 4801 failed: 6 disconnect: 6 [ 21s ] executions total: 5256 successful: 5250 failed: 6 disconnect: 6 [2025-06-19 10:19:19.356] Connection error occurred! [ 22s ] executions total: 5607 successful: 5600 failed: 7 disconnect: 7 [2025-06-19 10:19:19.356] Connection error occurred! [2025-06-19 10:19:20.362] Connection successfully recovered! The connection was restored in 1006 milliseconds. [ 23s ] executions total: 5608 successful: 5601 failed: 7 disconnect: 7 [ 24s ] executions total: 6045 successful: 6038 failed: 7 disconnect: 7 [ 25s ] executions total: 6398 successful: 6391 failed: 7 disconnect: 7 [2025-06-19 10:19:25.375] Connection error occurred! [ 26s ] executions total: 6408 successful: 6400 failed: 8 disconnect: 8 [2025-06-19 10:19:25.375] Connection error occurred! [2025-06-19 10:19:26.380] Connection successfully recovered! The connection was restored in 1005 milliseconds. [ 27s ] executions total: 6409 successful: 6401 failed: 8 disconnect: 8 [ 28s ] executions total: 6826 successful: 6818 failed: 8 disconnect: 8 [2025-06-19 10:19:31.367] Connection error occurred! [ 29s ] executions total: 7209 successful: 7200 failed: 9 disconnect: 9 [2025-06-19 10:19:31.367] Connection error occurred! [2025-06-19 10:19:32.372] Connection successfully recovered! The connection was restored in 1005 milliseconds. [ 30s ] executions total: 7210 successful: 7201 failed: 9 disconnect: 9 [ 31s ] executions total: 7632 successful: 7623 failed: 9 disconnect: 9 [ 32s ] executions total: 7966 successful: 7957 failed: 9 disconnect: 9 [2025-06-19 10:19:37.475] Connection error occurred! [ 33s ] executions total: 8010 successful: 8000 failed: 10 disconnect: 10 [2025-06-19 10:19:37.475] Connection error occurred! [2025-06-19 10:19:38.481] Connection successfully recovered! The connection was restored in 1006 milliseconds. [ 34s ] executions total: 8011 successful: 8001 failed: 10 disconnect: 10 [ 60s ] executions total: 8091 successful: 8081 failed: 10 disconnect: 10 Test Result: Total Executions: 8091 Successful Executions: 8081 Failed Executions: 10 Disconnection Counts: 10 Connection Information: Database Type: redis Host: redis-ljzvzz-redis-redis.ns-jcjpx.svc.cluster.local Port: 6379 Database: Table: User: default Org: Access Mode: mysql Test Type: executionloop Query: Duration: 60 seconds Interval: 1 seconds Key: DB_CLIENT_BATCH_DATA_COUNT: 8081 `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge pods test-db-client-executionloop-redis-ljzvzz --namespace ns-jcjpx ` pod/test-db-client-executionloop-redis-ljzvzz patched (no change) Warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely. pod "test-db-client-executionloop-redis-ljzvzz" force deleted `kubectl get secrets -l app.kubernetes.io/instance=redis-ljzvzz` set secret: redis-ljzvzz-redis-account-default `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.username***"` `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.password***"` `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.port***"` DB_USERNAME_PROXY:;DB_PASSWORD_PROXY:;DB_PORT_PROXY:26379 DB_USERNAME:default;DB_PASSWORD:gu97Tl5m13;DB_PORT:6379;DB_DATABASE:db0 `echo 'echo "set mykey \"bxtif\"" | redis-cli -h redis-ljzvzz-redis-redis.ns-jcjpx.svc.cluster.local -p 6379 -a gu97Tl5m13' | kubectl exec -it redis-ljzvzz-redis-0 --namespace ns-jcjpx -- bash` Defaulted container "redis" out of: redis, metrics, lorry, init-lorry (init) Unable to use a TTY - input is not a terminal or the right kind of file Warning: Using a password with '-a' or '-u' option on the command line interface may not be safe. OK add consistent data bxtif Success `kubectl get secrets -l app.kubernetes.io/instance=redis-ljzvzz` set secret: redis-ljzvzz-redis-account-default `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.username***"` `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.password***"` `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.port***"` DB_USERNAME_PROXY:;DB_PASSWORD_PROXY:;DB_PORT_PROXY:26379 DB_USERNAME:default;DB_PASSWORD:gu97Tl5m13;DB_PORT:6379;DB_DATABASE:db0 `echo 'echo "set mykey \"bxtif\"" | redis-cli -h 127.0.0.1 -p 6379 -a gu97Tl5m13' | kubectl exec -it redis-ljzvzz-redis-1 --namespace ns-jcjpx -- bash` Defaulted container "redis" out of: redis, metrics, lorry, init-lorry (init) Unable to use a TTY - input is not a terminal or the right kind of file READONLY You can't write against a read only replica. Warning: Using a password with '-a' or '-u' option on the command line interface may not be safe. check add consistent data readonly Success cluster expose check cluster status before ops check cluster status done cluster_status:Running `kbcli cluster expose redis-ljzvzz --auto-approve --force=true --type vpc --enable true --components redis --namespace ns-jcjpx ` OpsRequest redis-ljzvzz-expose-4b267 created successfully, you can view the progress: kbcli cluster describe-ops redis-ljzvzz-expose-4b267 -n ns-jcjpx check ops status `kbcli cluster list-ops redis-ljzvzz --status all --namespace ns-jcjpx ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME redis-ljzvzz-expose-4b267 ns-jcjpx Expose redis-ljzvzz redis Running 0/1 Jun 19,2025 18:20 UTC+0800 check cluster status `kbcli cluster list redis-ljzvzz --show-labels --namespace ns-jcjpx ` NAME NAMESPACE CLUSTER-DEFINITION VERSION TERMINATION-POLICY STATUS CREATED-TIME LABELS redis-ljzvzz ns-jcjpx Delete Running Jun 19,2025 18:16 UTC+0800 app.kubernetes.io/instance=redis-ljzvzz check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances redis-ljzvzz --namespace ns-jcjpx ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME redis-ljzvzz-redis-0 ns-jcjpx redis-ljzvzz redis Running primary us-west-2a 100m / 100m 512Mi / 512Mi data:1Gi ip-172-31-8-116.us-west-2.compute.internal/172.31.8.116 Jun 19,2025 18:16 UTC+0800 redis-ljzvzz-redis-1 ns-jcjpx redis-ljzvzz redis Running secondary us-west-2a 100m / 100m 512Mi / 512Mi data:1Gi ip-172-31-12-104.us-west-2.compute.internal/172.31.12.104 Jun 19,2025 18:16 UTC+0800 redis-ljzvzz-redis-sentinel-0 ns-jcjpx redis-ljzvzz redis-sentinel Running us-west-2a 100m / 100m 512Mi / 512Mi data:1Gi ip-172-31-6-232.us-west-2.compute.internal/172.31.6.232 Jun 19,2025 18:16 UTC+0800 redis-ljzvzz-redis-sentinel-1 ns-jcjpx redis-ljzvzz redis-sentinel Running us-west-2a 100m / 100m 512Mi / 512Mi data:1Gi ip-172-31-1-34.us-west-2.compute.internal/172.31.1.34 Jun 19,2025 18:16 UTC+0800 redis-ljzvzz-redis-sentinel-2 ns-jcjpx redis-ljzvzz redis-sentinel Running us-west-2a 100m / 100m 512Mi / 512Mi data:1Gi ip-172-31-1-97.us-west-2.compute.internal/172.31.1.97 Jun 19,2025 18:16 UTC+0800 redis-ljzvzz-redis-twemproxy-0 ns-jcjpx redis-ljzvzz redis-twemproxy Running us-west-2a 100m / 100m 512Mi / 512Mi data:1Gi ip-172-31-10-206.us-west-2.compute.internal/172.31.10.206 Jun 19,2025 18:16 UTC+0800 redis-ljzvzz-redis-twemproxy-1 ns-jcjpx redis-ljzvzz redis-twemproxy Running us-west-2a 100m / 100m 512Mi / 512Mi data:1Gi ip-172-31-8-95.us-west-2.compute.internal/172.31.8.95 Jun 19,2025 18:16 UTC+0800 redis-ljzvzz-redis-twemproxy-2 ns-jcjpx redis-ljzvzz redis-twemproxy Running us-west-2a 100m / 100m 512Mi / 512Mi data:1Gi ip-172-31-2-66.us-west-2.compute.internal/172.31.2.66 Jun 19,2025 18:17 UTC+0800 check pod status done check cluster role check cluster role done primary: redis-ljzvzz-redis-0;secondary: redis-ljzvzz-redis-1 `kubectl get secrets -l app.kubernetes.io/instance=redis-ljzvzz` set secret: redis-ljzvzz-redis-account-default `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.username***"` `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.password***"` `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.port***"` DB_USERNAME_PROXY:;DB_PASSWORD_PROXY:;DB_PORT_PROXY:26379 DB_USERNAME:default;DB_PASSWORD:gu97Tl5m13;DB_PORT:6379;DB_DATABASE:db0 check cluster connect `echo 'echo "" | redis-cli -h redis-ljzvzz-redis-redis.ns-jcjpx.svc.cluster.local -p 6379 -a gu97Tl5m13' | kubectl exec -it redis-ljzvzz-redis-0 --namespace ns-jcjpx -- bash` check cluster connect done check ops status `kbcli cluster list-ops redis-ljzvzz --status all --namespace ns-jcjpx ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME redis-ljzvzz-expose-4b267 ns-jcjpx Expose redis-ljzvzz redis Succeed 1/1 Jun 19,2025 18:20 UTC+0800 check ops status done ops_status:redis-ljzvzz-expose-4b267 ns-jcjpx Expose redis-ljzvzz redis Succeed 1/1 Jun 19,2025 18:20 UTC+0800 `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge opsrequests redis-ljzvzz-expose-4b267 --namespace ns-jcjpx ` opsrequest.apps.kubeblocks.io/redis-ljzvzz-expose-4b267 patched `kbcli cluster delete-ops --name redis-ljzvzz-expose-4b267 --force --auto-approve --namespace ns-jcjpx ` OpsRequest redis-ljzvzz-expose-4b267 deleted `echo 'get mykey' | kbcli cluster connect redis-ljzvzz --namespace ns-jcjpx ` check data: Connect to instance redis-ljzvzz-redis-0: out of redis-ljzvzz-redis-0(primary), redis-ljzvzz-redis-1(secondary) Unable to use a TTY - input is not a terminal or the right kind of file bxtif Warning: Using a password with '-a' or '-u' option on the command line interface may not be safe. check cluster data consistent Success `kubectl get secrets -l app.kubernetes.io/instance=redis-ljzvzz` set secret: redis-ljzvzz-redis-account-default `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.username***"` `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.password***"` `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.port***"` DB_USERNAME_PROXY:;DB_PASSWORD_PROXY:;DB_PORT_PROXY:26379 DB_USERNAME:default;DB_PASSWORD:gu97Tl5m13;DB_PORT:6379;DB_DATABASE:db0 `echo "echo \"get mykey\" | redis-cli -h 127.0.0.1 -p 6379 -a gu97Tl5m13 " | kubectl exec -it redis-ljzvzz-redis-1 --namespace ns-jcjpx -- bash ` check readonly data: Defaulted container "redis" out of: redis, metrics, lorry, init-lorry (init) Unable to use a TTY - input is not a terminal or the right kind of file Warning: Using a password with '-a' or '-u' option on the command line interface may not be safe. bxtif check cluster readonly data consistent Success check db_client batch data count `echo 'get executions_loop_key' | kbcli cluster connect redis-ljzvzz --namespace ns-jcjpx ` check db_client batch data Success `kubectl get secrets -l app.kubernetes.io/instance=redis-ljzvzz` set secret: redis-ljzvzz-redis-account-default `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.username***"` `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.password***"` `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.port***"` DB_USERNAME_PROXY:;DB_PASSWORD_PROXY:;DB_PORT_PROXY:26379 DB_USERNAME:default;DB_PASSWORD:gu97Tl5m13;DB_PORT:6379;DB_DATABASE:db0 check readonly db_client batch data count `echo "echo \"get executions_loop_key\" | redis-cli -h 127.0.0.1 -p 6379 -a gu97Tl5m13 " | kubectl exec -it redis-ljzvzz-redis-1 --namespace ns-jcjpx -- bash ` check readonly db_client batch data Success test failover fullcpuover check node drain check node drain success `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge StressChaos test-chaos-mesh-fullcpuover-redis-ljzvzz --namespace ns-jcjpx ` Warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely. Error from server (NotFound): stresschaos.chaos-mesh.org "test-chaos-mesh-fullcpuover-redis-ljzvzz" not found Error from server (NotFound): stresschaos.chaos-mesh.org "test-chaos-mesh-fullcpuover-redis-ljzvzz" not found apiVersion: chaos-mesh.org/v1alpha1 kind: StressChaos metadata: name: test-chaos-mesh-fullcpuover-redis-ljzvzz namespace: ns-jcjpx spec: selector: namespaces: - ns-jcjpx labelSelectors: apps.kubeblocks.io/pod-name: redis-ljzvzz-redis-0 mode: all stressors: cpu: workers: 100 load: 100 duration: 2m `kubectl apply -f test-chaos-mesh-fullcpuover-redis-ljzvzz.yaml` stresschaos.chaos-mesh.org/test-chaos-mesh-fullcpuover-redis-ljzvzz created apply test-chaos-mesh-fullcpuover-redis-ljzvzz.yaml Success `rm -rf test-chaos-mesh-fullcpuover-redis-ljzvzz.yaml` fullcpuover chaos test waiting 120 seconds check cluster status `kbcli cluster list redis-ljzvzz --show-labels --namespace ns-jcjpx ` NAME NAMESPACE CLUSTER-DEFINITION VERSION TERMINATION-POLICY STATUS CREATED-TIME LABELS redis-ljzvzz ns-jcjpx Delete Running Jun 19,2025 18:16 UTC+0800 app.kubernetes.io/instance=redis-ljzvzz check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances redis-ljzvzz --namespace ns-jcjpx ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME redis-ljzvzz-redis-0 ns-jcjpx redis-ljzvzz redis Running secondary us-west-2a 100m / 100m 512Mi / 512Mi data:1Gi ip-172-31-8-116.us-west-2.compute.internal/172.31.8.116 Jun 19,2025 18:16 UTC+0800 redis-ljzvzz-redis-1 ns-jcjpx redis-ljzvzz redis Running primary us-west-2a 100m / 100m 512Mi / 512Mi data:1Gi ip-172-31-12-104.us-west-2.compute.internal/172.31.12.104 Jun 19,2025 18:16 UTC+0800 redis-ljzvzz-redis-sentinel-0 ns-jcjpx redis-ljzvzz redis-sentinel Running us-west-2a 100m / 100m 512Mi / 512Mi data:1Gi ip-172-31-6-232.us-west-2.compute.internal/172.31.6.232 Jun 19,2025 18:16 UTC+0800 redis-ljzvzz-redis-sentinel-1 ns-jcjpx redis-ljzvzz redis-sentinel Running us-west-2a 100m / 100m 512Mi / 512Mi data:1Gi ip-172-31-1-34.us-west-2.compute.internal/172.31.1.34 Jun 19,2025 18:16 UTC+0800 redis-ljzvzz-redis-sentinel-2 ns-jcjpx redis-ljzvzz redis-sentinel Running us-west-2a 100m / 100m 512Mi / 512Mi data:1Gi ip-172-31-1-97.us-west-2.compute.internal/172.31.1.97 Jun 19,2025 18:16 UTC+0800 redis-ljzvzz-redis-twemproxy-0 ns-jcjpx redis-ljzvzz redis-twemproxy Running us-west-2a 100m / 100m 512Mi / 512Mi data:1Gi ip-172-31-10-206.us-west-2.compute.internal/172.31.10.206 Jun 19,2025 18:16 UTC+0800 redis-ljzvzz-redis-twemproxy-1 ns-jcjpx redis-ljzvzz redis-twemproxy Running us-west-2a 100m / 100m 512Mi / 512Mi data:1Gi ip-172-31-8-95.us-west-2.compute.internal/172.31.8.95 Jun 19,2025 18:16 UTC+0800 redis-ljzvzz-redis-twemproxy-2 ns-jcjpx redis-ljzvzz redis-twemproxy Running us-west-2a 100m / 100m 512Mi / 512Mi data:1Gi ip-172-31-2-66.us-west-2.compute.internal/172.31.2.66 Jun 19,2025 18:17 UTC+0800 check pod status done check cluster role check cluster role done primary: redis-ljzvzz-redis-1;secondary: redis-ljzvzz-redis-0 `kubectl get secrets -l app.kubernetes.io/instance=redis-ljzvzz` set secret: redis-ljzvzz-redis-account-default `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.username***"` `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.password***"` `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.port***"` DB_USERNAME_PROXY:;DB_PASSWORD_PROXY:;DB_PORT_PROXY:26379 DB_USERNAME:default;DB_PASSWORD:gu97Tl5m13;DB_PORT:6379;DB_DATABASE:db0 check cluster connect `echo 'echo "" | redis-cli -h redis-ljzvzz-redis-redis.ns-jcjpx.svc.cluster.local -p 6379 -a gu97Tl5m13' | kubectl exec -it redis-ljzvzz-redis-1 --namespace ns-jcjpx -- bash` check cluster connect done `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge StressChaos test-chaos-mesh-fullcpuover-redis-ljzvzz --namespace ns-jcjpx ` Warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely. stresschaos.chaos-mesh.org "test-chaos-mesh-fullcpuover-redis-ljzvzz" force deleted stresschaos.chaos-mesh.org/test-chaos-mesh-fullcpuover-redis-ljzvzz patched check failover pod name failover pod name:redis-ljzvzz-redis-1 failover fullcpuover Success `echo 'get mykey' | kbcli cluster connect redis-ljzvzz --namespace ns-jcjpx ` check data: Connect to instance redis-ljzvzz-redis-1: out of redis-ljzvzz-redis-1(primary), redis-ljzvzz-redis-0(secondary) Unable to use a TTY - input is not a terminal or the right kind of file Warning: Using a password with '-a' or '-u' option on the command line interface may not be safe. bxtif check cluster data consistent Success `kubectl get secrets -l app.kubernetes.io/instance=redis-ljzvzz` set secret: redis-ljzvzz-redis-account-default `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.username***"` `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.password***"` `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.port***"` DB_USERNAME_PROXY:;DB_PASSWORD_PROXY:;DB_PORT_PROXY:26379 DB_USERNAME:default;DB_PASSWORD:gu97Tl5m13;DB_PORT:6379;DB_DATABASE:db0 `echo "echo \"get mykey\" | redis-cli -h 127.0.0.1 -p 6379 -a gu97Tl5m13 " | kubectl exec -it redis-ljzvzz-redis-0 --namespace ns-jcjpx -- bash ` check readonly data: Defaulted container "redis" out of: redis, metrics, lorry, init-lorry (init) Unable to use a TTY - input is not a terminal or the right kind of file Warning: Using a password with '-a' or '-u' option on the command line interface may not be safe. bxtif check cluster readonly data consistent Success check db_client batch data count `echo 'get executions_loop_key' | kbcli cluster connect redis-ljzvzz --namespace ns-jcjpx ` check db_client batch data Success `kubectl get secrets -l app.kubernetes.io/instance=redis-ljzvzz` set secret: redis-ljzvzz-redis-account-default `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.username***"` `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.password***"` `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.port***"` DB_USERNAME_PROXY:;DB_PASSWORD_PROXY:;DB_PORT_PROXY:26379 DB_USERNAME:default;DB_PASSWORD:gu97Tl5m13;DB_PORT:6379;DB_DATABASE:db0 check readonly db_client batch data count `echo "echo \"get executions_loop_key\" | redis-cli -h 127.0.0.1 -p 6379 -a gu97Tl5m13 " | kubectl exec -it redis-ljzvzz-redis-0 --namespace ns-jcjpx -- bash ` check readonly db_client batch data Success test failover networkbandwidthover check node drain check node drain success `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge NetworkChaos test-chaos-mesh-networkbandwidthover-redis-ljzvzz --namespace ns-jcjpx ` Warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely. Error from server (NotFound): networkchaos.chaos-mesh.org "test-chaos-mesh-networkbandwidthover-redis-ljzvzz" not found Error from server (NotFound): networkchaos.chaos-mesh.org "test-chaos-mesh-networkbandwidthover-redis-ljzvzz" not found apiVersion: chaos-mesh.org/v1alpha1 kind: NetworkChaos metadata: name: test-chaos-mesh-networkbandwidthover-redis-ljzvzz namespace: ns-jcjpx spec: selector: namespaces: - ns-jcjpx labelSelectors: apps.kubeblocks.io/pod-name: redis-ljzvzz-redis-1 action: bandwidth mode: all bandwidth: rate: '1bps' limit: 20971520 buffer: 10000 duration: 2m `kubectl apply -f test-chaos-mesh-networkbandwidthover-redis-ljzvzz.yaml` networkchaos.chaos-mesh.org/test-chaos-mesh-networkbandwidthover-redis-ljzvzz created apply test-chaos-mesh-networkbandwidthover-redis-ljzvzz.yaml Success `rm -rf test-chaos-mesh-networkbandwidthover-redis-ljzvzz.yaml` networkbandwidthover chaos test waiting 120 seconds check cluster status `kbcli cluster list redis-ljzvzz --show-labels --namespace ns-jcjpx ` NAME NAMESPACE CLUSTER-DEFINITION VERSION TERMINATION-POLICY STATUS CREATED-TIME LABELS redis-ljzvzz ns-jcjpx Delete Updating Jun 19,2025 18:16 UTC+0800 app.kubernetes.io/instance=redis-ljzvzz cluster_status:Updating check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances redis-ljzvzz --namespace ns-jcjpx ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME redis-ljzvzz-redis-0 ns-jcjpx redis-ljzvzz redis Running primary us-west-2a 100m / 100m 512Mi / 512Mi data:1Gi ip-172-31-8-116.us-west-2.compute.internal/172.31.8.116 Jun 19,2025 18:16 UTC+0800 redis-ljzvzz-redis-1 ns-jcjpx redis-ljzvzz redis Running secondary us-west-2a 100m / 100m 512Mi / 512Mi data:1Gi ip-172-31-12-104.us-west-2.compute.internal/172.31.12.104 Jun 19,2025 18:16 UTC+0800 redis-ljzvzz-redis-sentinel-0 ns-jcjpx redis-ljzvzz redis-sentinel Running us-west-2a 100m / 100m 512Mi / 512Mi data:1Gi ip-172-31-6-232.us-west-2.compute.internal/172.31.6.232 Jun 19,2025 18:16 UTC+0800 redis-ljzvzz-redis-sentinel-1 ns-jcjpx redis-ljzvzz redis-sentinel Running us-west-2a 100m / 100m 512Mi / 512Mi data:1Gi ip-172-31-1-34.us-west-2.compute.internal/172.31.1.34 Jun 19,2025 18:16 UTC+0800 redis-ljzvzz-redis-sentinel-2 ns-jcjpx redis-ljzvzz redis-sentinel Running us-west-2a 100m / 100m 512Mi / 512Mi data:1Gi ip-172-31-1-97.us-west-2.compute.internal/172.31.1.97 Jun 19,2025 18:16 UTC+0800 redis-ljzvzz-redis-twemproxy-0 ns-jcjpx redis-ljzvzz redis-twemproxy Running us-west-2a 100m / 100m 512Mi / 512Mi data:1Gi ip-172-31-10-206.us-west-2.compute.internal/172.31.10.206 Jun 19,2025 18:16 UTC+0800 redis-ljzvzz-redis-twemproxy-1 ns-jcjpx redis-ljzvzz redis-twemproxy Running us-west-2a 100m / 100m 512Mi / 512Mi data:1Gi ip-172-31-8-95.us-west-2.compute.internal/172.31.8.95 Jun 19,2025 18:16 UTC+0800 redis-ljzvzz-redis-twemproxy-2 ns-jcjpx redis-ljzvzz redis-twemproxy Running us-west-2a 100m / 100m 512Mi / 512Mi data:1Gi ip-172-31-2-66.us-west-2.compute.internal/172.31.2.66 Jun 19,2025 18:17 UTC+0800 check pod status done check cluster role check cluster role done primary: redis-ljzvzz-redis-0;secondary: redis-ljzvzz-redis-1 `kubectl get secrets -l app.kubernetes.io/instance=redis-ljzvzz` set secret: redis-ljzvzz-redis-account-default `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.username***"` `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.password***"` `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.port***"` DB_USERNAME_PROXY:;DB_PASSWORD_PROXY:;DB_PORT_PROXY:26379 DB_USERNAME:default;DB_PASSWORD:gu97Tl5m13;DB_PORT:6379;DB_DATABASE:db0 check cluster connect `echo 'echo "" | redis-cli -h redis-ljzvzz-redis-redis.ns-jcjpx.svc.cluster.local -p 6379 -a gu97Tl5m13' | kubectl exec -it redis-ljzvzz-redis-0 --namespace ns-jcjpx -- bash` check cluster connect done `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge NetworkChaos test-chaos-mesh-networkbandwidthover-redis-ljzvzz --namespace ns-jcjpx ` Warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely. networkchaos.chaos-mesh.org "test-chaos-mesh-networkbandwidthover-redis-ljzvzz" force deleted Error from server (NotFound): networkchaos.chaos-mesh.org "test-chaos-mesh-networkbandwidthover-redis-ljzvzz" not found check failover pod name failover pod name:redis-ljzvzz-redis-0 failover networkbandwidthover Success `echo 'get mykey' | kbcli cluster connect redis-ljzvzz --namespace ns-jcjpx ` check data: Connect to instance redis-ljzvzz-redis-0: out of redis-ljzvzz-redis-0(primary), redis-ljzvzz-redis-1(secondary) Unable to use a TTY - input is not a terminal or the right kind of file Warning: Using a password with '-a' or '-u' option on the command line interface may not be safe. bxtif check cluster data consistent Success `kubectl get secrets -l app.kubernetes.io/instance=redis-ljzvzz` set secret: redis-ljzvzz-redis-account-default `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.username***"` `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.password***"` `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.port***"` DB_USERNAME_PROXY:;DB_PASSWORD_PROXY:;DB_PORT_PROXY:26379 DB_USERNAME:default;DB_PASSWORD:gu97Tl5m13;DB_PORT:6379;DB_DATABASE:db0 `echo "echo \"get mykey\" | redis-cli -h 127.0.0.1 -p 6379 -a gu97Tl5m13 " | kubectl exec -it redis-ljzvzz-redis-1 --namespace ns-jcjpx -- bash ` check readonly data: Defaulted container "redis" out of: redis, metrics, lorry, init-lorry (init) Unable to use a TTY - input is not a terminal or the right kind of file Warning: Using a password with '-a' or '-u' option on the command line interface may not be safe. bxtif check cluster readonly data consistent Success check db_client batch data count `echo 'get executions_loop_key' | kbcli cluster connect redis-ljzvzz --namespace ns-jcjpx ` check db_client batch data Success `kubectl get secrets -l app.kubernetes.io/instance=redis-ljzvzz` set secret: redis-ljzvzz-redis-account-default `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.username***"` `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.password***"` `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.port***"` DB_USERNAME_PROXY:;DB_PASSWORD_PROXY:;DB_PORT_PROXY:26379 DB_USERNAME:default;DB_PASSWORD:gu97Tl5m13;DB_PORT:6379;DB_DATABASE:db0 check readonly db_client batch data count `echo "echo \"get executions_loop_key\" | redis-cli -h 127.0.0.1 -p 6379 -a gu97Tl5m13 " | kubectl exec -it redis-ljzvzz-redis-1 --namespace ns-jcjpx -- bash ` check readonly db_client batch data Success `kubectl get pvc -l app.kubernetes.io/instance=redis-ljzvzz,apps.kubeblocks.io/component-name=redis,apps.kubeblocks.io/vct-name=data --namespace ns-jcjpx ` cluster volume-expand check cluster status before ops check cluster status done cluster_status:Running No resources found in redis-ljzvzz namespace. `kbcli cluster volume-expand redis-ljzvzz --auto-approve --force=true --components redis --volume-claim-templates data --storage 2Gi --namespace ns-jcjpx ` OpsRequest redis-ljzvzz-volumeexpansion-4rghn created successfully, you can view the progress: kbcli cluster describe-ops redis-ljzvzz-volumeexpansion-4rghn -n ns-jcjpx check ops status `kbcli cluster list-ops redis-ljzvzz --status all --namespace ns-jcjpx ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME redis-ljzvzz-volumeexpansion-4rghn ns-jcjpx VolumeExpansion redis-ljzvzz redis Running 0/2 Jun 19,2025 18:26 UTC+0800 check cluster status `kbcli cluster list redis-ljzvzz --show-labels --namespace ns-jcjpx ` NAME NAMESPACE CLUSTER-DEFINITION VERSION TERMINATION-POLICY STATUS CREATED-TIME LABELS redis-ljzvzz ns-jcjpx Delete Updating Jun 19,2025 18:16 UTC+0800 app.kubernetes.io/instance=redis-ljzvzz cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances redis-ljzvzz --namespace ns-jcjpx ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME redis-ljzvzz-redis-0 ns-jcjpx redis-ljzvzz redis Running primary us-west-2a 100m / 100m 512Mi / 512Mi data:2Gi ip-172-31-8-116.us-west-2.compute.internal/172.31.8.116 Jun 19,2025 18:16 UTC+0800 redis-ljzvzz-redis-1 ns-jcjpx redis-ljzvzz redis Running secondary us-west-2a 100m / 100m 512Mi / 512Mi data:2Gi ip-172-31-12-104.us-west-2.compute.internal/172.31.12.104 Jun 19,2025 18:16 UTC+0800 redis-ljzvzz-redis-sentinel-0 ns-jcjpx redis-ljzvzz redis-sentinel Running us-west-2a 100m / 100m 512Mi / 512Mi data:1Gi ip-172-31-6-232.us-west-2.compute.internal/172.31.6.232 Jun 19,2025 18:16 UTC+0800 redis-ljzvzz-redis-sentinel-1 ns-jcjpx redis-ljzvzz redis-sentinel Running us-west-2a 100m / 100m 512Mi / 512Mi data:1Gi ip-172-31-1-34.us-west-2.compute.internal/172.31.1.34 Jun 19,2025 18:16 UTC+0800 redis-ljzvzz-redis-sentinel-2 ns-jcjpx redis-ljzvzz redis-sentinel Running us-west-2a 100m / 100m 512Mi / 512Mi data:1Gi ip-172-31-1-97.us-west-2.compute.internal/172.31.1.97 Jun 19,2025 18:16 UTC+0800 redis-ljzvzz-redis-twemproxy-0 ns-jcjpx redis-ljzvzz redis-twemproxy Running us-west-2a 100m / 100m 512Mi / 512Mi data:1Gi ip-172-31-10-206.us-west-2.compute.internal/172.31.10.206 Jun 19,2025 18:16 UTC+0800 redis-ljzvzz-redis-twemproxy-1 ns-jcjpx redis-ljzvzz redis-twemproxy Running us-west-2a 100m / 100m 512Mi / 512Mi data:1Gi ip-172-31-8-95.us-west-2.compute.internal/172.31.8.95 Jun 19,2025 18:16 UTC+0800 redis-ljzvzz-redis-twemproxy-2 ns-jcjpx redis-ljzvzz redis-twemproxy Running us-west-2a 100m / 100m 512Mi / 512Mi data:1Gi ip-172-31-2-66.us-west-2.compute.internal/172.31.2.66 Jun 19,2025 18:17 UTC+0800 check pod status done check cluster role check cluster role done primary: redis-ljzvzz-redis-0;secondary: redis-ljzvzz-redis-1 `kubectl get secrets -l app.kubernetes.io/instance=redis-ljzvzz` set secret: redis-ljzvzz-redis-account-default `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.username***"` `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.password***"` `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.port***"` DB_USERNAME_PROXY:;DB_PASSWORD_PROXY:;DB_PORT_PROXY:26379 DB_USERNAME:default;DB_PASSWORD:gu97Tl5m13;DB_PORT:6379;DB_DATABASE:db0 check cluster connect `echo 'echo "" | redis-cli -h redis-ljzvzz-redis-redis.ns-jcjpx.svc.cluster.local -p 6379 -a gu97Tl5m13' | kubectl exec -it redis-ljzvzz-redis-0 --namespace ns-jcjpx -- bash` check cluster connect done No resources found in redis-ljzvzz namespace. check ops status `kbcli cluster list-ops redis-ljzvzz --status all --namespace ns-jcjpx ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME redis-ljzvzz-volumeexpansion-4rghn ns-jcjpx VolumeExpansion redis-ljzvzz redis Succeed 2/2 Jun 19,2025 18:26 UTC+0800 check ops status done ops_status:redis-ljzvzz-volumeexpansion-4rghn ns-jcjpx VolumeExpansion redis-ljzvzz redis Succeed 2/2 Jun 19,2025 18:26 UTC+0800 `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge opsrequests redis-ljzvzz-volumeexpansion-4rghn --namespace ns-jcjpx ` opsrequest.apps.kubeblocks.io/redis-ljzvzz-volumeexpansion-4rghn patched `kbcli cluster delete-ops --name redis-ljzvzz-volumeexpansion-4rghn --force --auto-approve --namespace ns-jcjpx ` OpsRequest redis-ljzvzz-volumeexpansion-4rghn deleted `echo 'get mykey' | kbcli cluster connect redis-ljzvzz --namespace ns-jcjpx ` check data: Connect to instance redis-ljzvzz-redis-0: out of redis-ljzvzz-redis-0(primary), redis-ljzvzz-redis-1(secondary) Unable to use a TTY - input is not a terminal or the right kind of file Warning: Using a password with '-a' or '-u' option on the command line interface may not be safe. bxtif check cluster data consistent Success `kubectl get secrets -l app.kubernetes.io/instance=redis-ljzvzz` set secret: redis-ljzvzz-redis-account-default `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.username***"` `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.password***"` `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.port***"` DB_USERNAME_PROXY:;DB_PASSWORD_PROXY:;DB_PORT_PROXY:26379 DB_USERNAME:default;DB_PASSWORD:gu97Tl5m13;DB_PORT:6379;DB_DATABASE:db0 `echo "echo \"get mykey\" | redis-cli -h 127.0.0.1 -p 6379 -a gu97Tl5m13 " | kubectl exec -it redis-ljzvzz-redis-1 --namespace ns-jcjpx -- bash ` check readonly data: Defaulted container "redis" out of: redis, metrics, lorry, init-lorry (init) Unable to use a TTY - input is not a terminal or the right kind of file Warning: Using a password with '-a' or '-u' option on the command line interface may not be safe. bxtif check cluster readonly data consistent Success check db_client batch data count `echo 'get executions_loop_key' | kbcli cluster connect redis-ljzvzz --namespace ns-jcjpx ` check db_client batch data Success `kubectl get secrets -l app.kubernetes.io/instance=redis-ljzvzz` set secret: redis-ljzvzz-redis-account-default `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.username***"` `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.password***"` `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.port***"` DB_USERNAME_PROXY:;DB_PASSWORD_PROXY:;DB_PORT_PROXY:26379 DB_USERNAME:default;DB_PASSWORD:gu97Tl5m13;DB_PORT:6379;DB_DATABASE:db0 check readonly db_client batch data count `echo "echo \"get executions_loop_key\" | redis-cli -h 127.0.0.1 -p 6379 -a gu97Tl5m13 " | kubectl exec -it redis-ljzvzz-redis-1 --namespace ns-jcjpx -- bash ` check readonly db_client batch data Success test failover networkcorruptover check node drain check node drain success `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge NetworkChaos test-chaos-mesh-networkcorruptover-redis-ljzvzz --namespace ns-jcjpx ` Warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely. Error from server (NotFound): networkchaos.chaos-mesh.org "test-chaos-mesh-networkcorruptover-redis-ljzvzz" not found Error from server (NotFound): networkchaos.chaos-mesh.org "test-chaos-mesh-networkcorruptover-redis-ljzvzz" not found apiVersion: chaos-mesh.org/v1alpha1 kind: NetworkChaos metadata: name: test-chaos-mesh-networkcorruptover-redis-ljzvzz namespace: ns-jcjpx spec: selector: namespaces: - ns-jcjpx labelSelectors: apps.kubeblocks.io/pod-name: redis-ljzvzz-redis-0 mode: all action: corrupt corrupt: corrupt: '100' correlation: '100' direction: to duration: 2m `kubectl apply -f test-chaos-mesh-networkcorruptover-redis-ljzvzz.yaml` networkchaos.chaos-mesh.org/test-chaos-mesh-networkcorruptover-redis-ljzvzz created apply test-chaos-mesh-networkcorruptover-redis-ljzvzz.yaml Success `rm -rf test-chaos-mesh-networkcorruptover-redis-ljzvzz.yaml` networkcorruptover chaos test waiting 120 seconds check cluster status `kbcli cluster list redis-ljzvzz --show-labels --namespace ns-jcjpx ` NAME NAMESPACE CLUSTER-DEFINITION VERSION TERMINATION-POLICY STATUS CREATED-TIME LABELS redis-ljzvzz ns-jcjpx Delete Updating Jun 19,2025 18:16 UTC+0800 app.kubernetes.io/instance=redis-ljzvzz cluster_status:Updating cluster_status:Updating check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances redis-ljzvzz --namespace ns-jcjpx ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME redis-ljzvzz-redis-0 ns-jcjpx redis-ljzvzz redis Running secondary us-west-2a 100m / 100m 512Mi / 512Mi data:2Gi ip-172-31-8-116.us-west-2.compute.internal/172.31.8.116 Jun 19,2025 18:16 UTC+0800 redis-ljzvzz-redis-1 ns-jcjpx redis-ljzvzz redis Running primary us-west-2a 100m / 100m 512Mi / 512Mi data:2Gi ip-172-31-12-104.us-west-2.compute.internal/172.31.12.104 Jun 19,2025 18:16 UTC+0800 redis-ljzvzz-redis-sentinel-0 ns-jcjpx redis-ljzvzz redis-sentinel Running us-west-2a 100m / 100m 512Mi / 512Mi data:1Gi ip-172-31-6-232.us-west-2.compute.internal/172.31.6.232 Jun 19,2025 18:16 UTC+0800 redis-ljzvzz-redis-sentinel-1 ns-jcjpx redis-ljzvzz redis-sentinel Running us-west-2a 100m / 100m 512Mi / 512Mi data:1Gi ip-172-31-1-34.us-west-2.compute.internal/172.31.1.34 Jun 19,2025 18:16 UTC+0800 redis-ljzvzz-redis-sentinel-2 ns-jcjpx redis-ljzvzz redis-sentinel Running us-west-2a 100m / 100m 512Mi / 512Mi data:1Gi ip-172-31-1-97.us-west-2.compute.internal/172.31.1.97 Jun 19,2025 18:16 UTC+0800 redis-ljzvzz-redis-twemproxy-0 ns-jcjpx redis-ljzvzz redis-twemproxy Running us-west-2a 100m / 100m 512Mi / 512Mi data:1Gi ip-172-31-10-206.us-west-2.compute.internal/172.31.10.206 Jun 19,2025 18:16 UTC+0800 redis-ljzvzz-redis-twemproxy-1 ns-jcjpx redis-ljzvzz redis-twemproxy Running us-west-2a 100m / 100m 512Mi / 512Mi data:1Gi ip-172-31-8-95.us-west-2.compute.internal/172.31.8.95 Jun 19,2025 18:16 UTC+0800 redis-ljzvzz-redis-twemproxy-2 ns-jcjpx redis-ljzvzz redis-twemproxy Running us-west-2a 100m / 100m 512Mi / 512Mi data:1Gi ip-172-31-2-66.us-west-2.compute.internal/172.31.2.66 Jun 19,2025 18:17 UTC+0800 check pod status done check cluster role check cluster role done primary: redis-ljzvzz-redis-1;secondary: redis-ljzvzz-redis-0 `kubectl get secrets -l app.kubernetes.io/instance=redis-ljzvzz` set secret: redis-ljzvzz-redis-account-default `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.username***"` `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.password***"` `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.port***"` DB_USERNAME_PROXY:;DB_PASSWORD_PROXY:;DB_PORT_PROXY:26379 DB_USERNAME:default;DB_PASSWORD:gu97Tl5m13;DB_PORT:6379;DB_DATABASE:db0 check cluster connect `echo 'echo "" | redis-cli -h redis-ljzvzz-redis-redis.ns-jcjpx.svc.cluster.local -p 6379 -a gu97Tl5m13' | kubectl exec -it redis-ljzvzz-redis-1 --namespace ns-jcjpx -- bash` check cluster connect done `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge NetworkChaos test-chaos-mesh-networkcorruptover-redis-ljzvzz --namespace ns-jcjpx ` Warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely. networkchaos.chaos-mesh.org "test-chaos-mesh-networkcorruptover-redis-ljzvzz" force deleted Error from server (NotFound): networkchaos.chaos-mesh.org "test-chaos-mesh-networkcorruptover-redis-ljzvzz" not found check failover pod name failover pod name:redis-ljzvzz-redis-1 failover networkcorruptover Success `echo 'get mykey' | kbcli cluster connect redis-ljzvzz --namespace ns-jcjpx ` check data: Connect to instance redis-ljzvzz-redis-1: out of redis-ljzvzz-redis-1(primary), redis-ljzvzz-redis-0(secondary) Unable to use a TTY - input is not a terminal or the right kind of file Warning: Using a password with '-a' or '-u' option on the command line interface may not be safe. bxtif check cluster data consistent Success `kubectl get secrets -l app.kubernetes.io/instance=redis-ljzvzz` set secret: redis-ljzvzz-redis-account-default `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.username***"` `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.password***"` `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.port***"` DB_USERNAME_PROXY:;DB_PASSWORD_PROXY:;DB_PORT_PROXY:26379 DB_USERNAME:default;DB_PASSWORD:gu97Tl5m13;DB_PORT:6379;DB_DATABASE:db0 `echo "echo \"get mykey\" | redis-cli -h 127.0.0.1 -p 6379 -a gu97Tl5m13 " | kubectl exec -it redis-ljzvzz-redis-0 --namespace ns-jcjpx -- bash ` check readonly data: Defaulted container "redis" out of: redis, metrics, lorry, init-lorry (init) Unable to use a TTY - input is not a terminal or the right kind of file Warning: Using a password with '-a' or '-u' option on the command line interface may not be safe. bxtif check cluster readonly data consistent Success check db_client batch data count `echo 'get executions_loop_key' | kbcli cluster connect redis-ljzvzz --namespace ns-jcjpx ` check db_client batch data Success `kubectl get secrets -l app.kubernetes.io/instance=redis-ljzvzz` set secret: redis-ljzvzz-redis-account-default `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.username***"` `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.password***"` `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.port***"` DB_USERNAME_PROXY:;DB_PASSWORD_PROXY:;DB_PORT_PROXY:26379 DB_USERNAME:default;DB_PASSWORD:gu97Tl5m13;DB_PORT:6379;DB_DATABASE:db0 check readonly db_client batch data count `echo "echo \"get executions_loop_key\" | redis-cli -h 127.0.0.1 -p 6379 -a gu97Tl5m13 " | kubectl exec -it redis-ljzvzz-redis-0 --namespace ns-jcjpx -- bash ` check readonly db_client batch data Success get redis-sentinel replicas test failover delete pod:redis-ljzvzz-redis-1 `kubectl delete pod redis-ljzvzz-redis-1 --namespace ns-jcjpx ` pod "redis-ljzvzz-redis-1" deleted check cluster status `kbcli cluster list redis-ljzvzz --show-labels --namespace ns-jcjpx ` NAME NAMESPACE CLUSTER-DEFINITION VERSION TERMINATION-POLICY STATUS CREATED-TIME LABELS redis-ljzvzz ns-jcjpx Delete Updating Jun 19,2025 18:16 UTC+0800 app.kubernetes.io/instance=redis-ljzvzz cluster_status:Updating cluster_status:Updating cluster_status:Updating check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances redis-ljzvzz --namespace ns-jcjpx ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME redis-ljzvzz-redis-0 ns-jcjpx redis-ljzvzz redis Running primary us-west-2a 100m / 100m 512Mi / 512Mi data:2Gi ip-172-31-8-116.us-west-2.compute.internal/172.31.8.116 Jun 19,2025 18:16 UTC+0800 redis-ljzvzz-redis-1 ns-jcjpx redis-ljzvzz redis Running secondary us-west-2a 100m / 100m 512Mi / 512Mi data:2Gi ip-172-31-12-104.us-west-2.compute.internal/172.31.12.104 Jun 19,2025 18:30 UTC+0800 redis-ljzvzz-redis-sentinel-0 ns-jcjpx redis-ljzvzz redis-sentinel Running us-west-2a 100m / 100m 512Mi / 512Mi data:1Gi ip-172-31-6-232.us-west-2.compute.internal/172.31.6.232 Jun 19,2025 18:16 UTC+0800 redis-ljzvzz-redis-sentinel-1 ns-jcjpx redis-ljzvzz redis-sentinel Running us-west-2a 100m / 100m 512Mi / 512Mi data:1Gi ip-172-31-1-34.us-west-2.compute.internal/172.31.1.34 Jun 19,2025 18:16 UTC+0800 redis-ljzvzz-redis-sentinel-2 ns-jcjpx redis-ljzvzz redis-sentinel Running us-west-2a 100m / 100m 512Mi / 512Mi data:1Gi ip-172-31-1-97.us-west-2.compute.internal/172.31.1.97 Jun 19,2025 18:16 UTC+0800 redis-ljzvzz-redis-twemproxy-0 ns-jcjpx redis-ljzvzz redis-twemproxy Running us-west-2a 100m / 100m 512Mi / 512Mi data:1Gi ip-172-31-10-206.us-west-2.compute.internal/172.31.10.206 Jun 19,2025 18:16 UTC+0800 redis-ljzvzz-redis-twemproxy-1 ns-jcjpx redis-ljzvzz redis-twemproxy Running us-west-2a 100m / 100m 512Mi / 512Mi data:1Gi ip-172-31-8-95.us-west-2.compute.internal/172.31.8.95 Jun 19,2025 18:16 UTC+0800 redis-ljzvzz-redis-twemproxy-2 ns-jcjpx redis-ljzvzz redis-twemproxy Running us-west-2a 100m / 100m 512Mi / 512Mi data:1Gi ip-172-31-2-66.us-west-2.compute.internal/172.31.2.66 Jun 19,2025 18:17 UTC+0800 check pod status done check cluster role check cluster role done primary: redis-ljzvzz-redis-0;secondary: redis-ljzvzz-redis-1 `kubectl get secrets -l app.kubernetes.io/instance=redis-ljzvzz` set secret: redis-ljzvzz-redis-account-default `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.username***"` `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.password***"` `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.port***"` DB_USERNAME_PROXY:;DB_PASSWORD_PROXY:;DB_PORT_PROXY:26379 DB_USERNAME:default;DB_PASSWORD:gu97Tl5m13;DB_PORT:6379;DB_DATABASE:db0 check cluster connect `echo 'echo "" | redis-cli -h redis-ljzvzz-redis-redis.ns-jcjpx.svc.cluster.local -p 6379 -a gu97Tl5m13' | kubectl exec -it redis-ljzvzz-redis-0 --namespace ns-jcjpx -- bash` check cluster connect done check failover pod name failover pod name:redis-ljzvzz-redis-0 failover Success `echo 'get mykey' | kbcli cluster connect redis-ljzvzz --namespace ns-jcjpx ` check data: Connect to instance redis-ljzvzz-redis-0: out of redis-ljzvzz-redis-0(primary), redis-ljzvzz-redis-1(secondary) Unable to use a TTY - input is not a terminal or the right kind of file Warning: Using a password with '-a' or '-u' option on the command line interface may not be safe. bxtif check cluster data consistent Success `kubectl get secrets -l app.kubernetes.io/instance=redis-ljzvzz` set secret: redis-ljzvzz-redis-account-default `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.username***"` `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.password***"` `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.port***"` DB_USERNAME_PROXY:;DB_PASSWORD_PROXY:;DB_PORT_PROXY:26379 DB_USERNAME:default;DB_PASSWORD:gu97Tl5m13;DB_PORT:6379;DB_DATABASE:db0 `echo "echo \"get mykey\" | redis-cli -h 127.0.0.1 -p 6379 -a gu97Tl5m13 " | kubectl exec -it redis-ljzvzz-redis-1 --namespace ns-jcjpx -- bash ` check readonly data: Defaulted container "redis" out of: redis, metrics, lorry, init-lorry (init) Unable to use a TTY - input is not a terminal or the right kind of file bxtif Warning: Using a password with '-a' or '-u' option on the command line interface may not be safe. check cluster readonly data consistent Success check db_client batch data count `echo 'get executions_loop_key' | kbcli cluster connect redis-ljzvzz --namespace ns-jcjpx ` check db_client batch data Success `kubectl get secrets -l app.kubernetes.io/instance=redis-ljzvzz` set secret: redis-ljzvzz-redis-account-default `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.username***"` `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.password***"` `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.port***"` DB_USERNAME_PROXY:;DB_PASSWORD_PROXY:;DB_PORT_PROXY:26379 DB_USERNAME:default;DB_PASSWORD:gu97Tl5m13;DB_PORT:6379;DB_DATABASE:db0 check readonly db_client batch data count `echo "echo \"get executions_loop_key\" | redis-cli -h 127.0.0.1 -p 6379 -a gu97Tl5m13 " | kubectl exec -it redis-ljzvzz-redis-1 --namespace ns-jcjpx -- bash ` check readonly db_client batch data Success `kubectl get secrets -l app.kubernetes.io/instance=redis-ljzvzz` set secret: redis-ljzvzz-redis-account-default `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.username***"` `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.password***"` `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.port***"` DB_USERNAME_PROXY:;DB_PASSWORD_PROXY:;DB_PORT_PROXY:26379 DB_USERNAME:default;DB_PASSWORD:gu97Tl5m13;DB_PORT:6379;DB_DATABASE:db0 apiVersion: v1 kind: Pod metadata: name: benchtest-redis-ljzvzz namespace: ns-jcjpx spec: containers: - name: test-benchmark imagePullPolicy: IfNotPresent image: docker.io/apecloud/redis-benchmark:latest args: - "-h" - "redis-ljzvzz-redis-redis.ns-jcjpx.svc.cluster.local" - "-p" - "6379" - "-a" - "gu97Tl5m13" - "-n" - "5000" - "-c" - "10" - "-q" restartPolicy: Never `kubectl apply -f benchtest-redis-ljzvzz.yaml` pod/benchtest-redis-ljzvzz created apply benchtest-redis-ljzvzz.yaml Success `rm -rf benchtest-redis-ljzvzz.yaml` check pod status pod_status:NAME READY STATUS RESTARTS AGE benchtest-redis-ljzvzz 0/1 ContainerCreating 0 0s pod_status:NAME READY STATUS RESTARTS AGE benchtest-redis-ljzvzz 0/1 ContainerCreating 0 5s pod_status:NAME READY STATUS RESTARTS AGE benchtest-redis-ljzvzz 1/1 Running 0 11s pod_status:NAME READY STATUS RESTARTS AGE benchtest-redis-ljzvzz 1/1 Running 0 17s pod_status:NAME READY STATUS RESTARTS AGE benchtest-redis-ljzvzz 1/1 Running 0 22s pod_status:NAME READY STATUS RESTARTS AGE benchtest-redis-ljzvzz 1/1 Running 0 28s pod_status:NAME READY STATUS RESTARTS AGE benchtest-redis-ljzvzz 1/1 Running 0 34s pod_status:NAME READY STATUS RESTARTS AGE benchtest-redis-ljzvzz 1/1 Running 0 40s pod_status:NAME READY STATUS RESTARTS AGE benchtest-redis-ljzvzz 1/1 Running 0 46s pod_status:NAME READY STATUS RESTARTS AGE benchtest-redis-ljzvzz 1/1 Running 0 51s pod_status:NAME READY STATUS RESTARTS AGE benchtest-redis-ljzvzz 1/1 Running 0 57s pod_status:NAME READY STATUS RESTARTS AGE benchtest-redis-ljzvzz 1/1 Running 0 63s pod_status:NAME READY STATUS RESTARTS AGE benchtest-redis-ljzvzz 1/1 Running 0 69s pod_status:NAME READY STATUS RESTARTS AGE benchtest-redis-ljzvzz 1/1 Running 0 74s pod_status:NAME READY STATUS RESTARTS AGE benchtest-redis-ljzvzz 1/1 Running 0 80s pod_status:NAME READY STATUS RESTARTS AGE benchtest-redis-ljzvzz 1/1 Running 0 86s pod_status:NAME READY STATUS RESTARTS AGE benchtest-redis-ljzvzz 1/1 Running 0 92s pod_status:NAME READY STATUS RESTARTS AGE benchtest-redis-ljzvzz 1/1 Running 0 98s pod_status:NAME READY STATUS RESTARTS AGE benchtest-redis-ljzvzz 1/1 Running 0 103s pod_status:NAME READY STATUS RESTARTS AGE benchtest-redis-ljzvzz 1/1 Running 0 109s pod_status:NAME READY STATUS RESTARTS AGE benchtest-redis-ljzvzz 1/1 Running 0 115s pod_status:NAME READY STATUS RESTARTS AGE benchtest-redis-ljzvzz 1/1 Running 0 2m1s pod_status:NAME READY STATUS RESTARTS AGE benchtest-redis-ljzvzz 1/1 Running 0 2m6s pod_status:NAME READY STATUS RESTARTS AGE benchtest-redis-ljzvzz 1/1 Running 0 2m12s pod_status:NAME READY STATUS RESTARTS AGE benchtest-redis-ljzvzz 1/1 Running 0 2m18s pod_status:NAME READY STATUS RESTARTS AGE benchtest-redis-ljzvzz 1/1 Running 0 2m24s pod_status:NAME READY STATUS RESTARTS AGE benchtest-redis-ljzvzz 1/1 Running 0 2m29s pod_status:NAME READY STATUS RESTARTS AGE benchtest-redis-ljzvzz 1/1 Running 0 2m35s pod_status:NAME READY STATUS RESTARTS AGE benchtest-redis-ljzvzz 1/1 Running 0 2m41s pod_status:NAME READY STATUS RESTARTS AGE benchtest-redis-ljzvzz 1/1 Running 0 2m47s pod_status:NAME READY STATUS RESTARTS AGE benchtest-redis-ljzvzz 1/1 Running 0 2m53s pod_status:NAME READY STATUS RESTARTS AGE benchtest-redis-ljzvzz 1/1 Running 0 2m58s pod_status:NAME READY STATUS RESTARTS AGE benchtest-redis-ljzvzz 1/1 Running 0 3m4s pod_status:NAME READY STATUS RESTARTS AGE benchtest-redis-ljzvzz 1/1 Running 0 3m10s pod_status:NAME READY STATUS RESTARTS AGE benchtest-redis-ljzvzz 1/1 Running 0 3m16s pod_status:NAME READY STATUS RESTARTS AGE benchtest-redis-ljzvzz 1/1 Running 0 3m22s pod_status:NAME READY STATUS RESTARTS AGE benchtest-redis-ljzvzz 1/1 Running 0 3m27s pod_status:NAME READY STATUS RESTARTS AGE benchtest-redis-ljzvzz 1/1 Running 0 3m33s pod_status:NAME READY STATUS RESTARTS AGE benchtest-redis-ljzvzz 1/1 Running 0 3m39s pod_status:NAME READY STATUS RESTARTS AGE benchtest-redis-ljzvzz 1/1 Running 0 3m45s pod_status:NAME READY STATUS RESTARTS AGE benchtest-redis-ljzvzz 1/1 Running 0 3m51s pod_status:NAME READY STATUS RESTARTS AGE benchtest-redis-ljzvzz 1/1 Running 0 3m56s pod_status:NAME READY STATUS RESTARTS AGE benchtest-redis-ljzvzz 1/1 Running 0 4m2s pod_status:NAME READY STATUS RESTARTS AGE benchtest-redis-ljzvzz 1/1 Running 0 4m8s pod_status:NAME READY STATUS RESTARTS AGE benchtest-redis-ljzvzz 1/1 Running 0 4m14s pod_status:NAME READY STATUS RESTARTS AGE benchtest-redis-ljzvzz 1/1 Running 0 4m20s pod_status:NAME READY STATUS RESTARTS AGE benchtest-redis-ljzvzz 1/1 Running 0 4m25s pod_status:NAME READY STATUS RESTARTS AGE benchtest-redis-ljzvzz 1/1 Running 0 4m31s pod_status:NAME READY STATUS RESTARTS AGE benchtest-redis-ljzvzz 1/1 Running 0 4m37s pod_status:NAME READY STATUS RESTARTS AGE benchtest-redis-ljzvzz 1/1 Running 0 4m43s pod_status:NAME READY STATUS RESTARTS AGE benchtest-redis-ljzvzz 1/1 Running 0 4m48s pod_status:NAME READY STATUS RESTARTS AGE benchtest-redis-ljzvzz 1/1 Running 0 4m54s pod_status:NAME READY STATUS RESTARTS AGE benchtest-redis-ljzvzz 1/1 Running 0 5m pod_status:NAME READY STATUS RESTARTS AGE benchtest-redis-ljzvzz 1/1 Running 0 5m6s pod_status:NAME READY STATUS RESTARTS AGE benchtest-redis-ljzvzz 1/1 Running 0 5m12s pod_status:NAME READY STATUS RESTARTS AGE benchtest-redis-ljzvzz 1/1 Running 0 5m17s pod_status:NAME READY STATUS RESTARTS AGE benchtest-redis-ljzvzz 1/1 Running 0 5m23s pod_status:NAME READY STATUS RESTARTS AGE benchtest-redis-ljzvzz 1/1 Running 0 5m29s pod_status:NAME READY STATUS RESTARTS AGE benchtest-redis-ljzvzz 1/1 Running 0 5m35s pod_status:NAME READY STATUS RESTARTS AGE benchtest-redis-ljzvzz 1/1 Running 0 5m41s pod_status:NAME READY STATUS RESTARTS AGE benchtest-redis-ljzvzz 1/1 Running 0 5m46s check pod benchtest-redis-ljzvzz status timeout --------------------------------------get pod benchtest-redis-ljzvzz yaml-------------------------------------- `kubectl get pod benchtest-redis-ljzvzz -o yaml --namespace ns-jcjpx ` apiVersion: v1 kind: Pod metadata: annotations: kubectl.kubernetes.io/last-applied-configuration: | ***"apiVersion":"v1","kind":"Pod","metadata":***"annotations":***,"name":"benchtest-redis-ljzvzz","namespace":"ns-jcjpx"***,"spec":***"containers":[***"args":["-h","redis-ljzvzz-redis-redis.ns-jcjpx.svc.cluster.local","-p","6379","-a","gu97Tl5m13","-n","5000","-c","10","-q"],"image":"docker.io/apecloud/redis-benchmark:latest","imagePullPolicy":"IfNotPresent","name":"test-benchmark"***],"restartPolicy":"Never"*** creationTimestamp: "2025-06-19T10:31:58Z" name: benchtest-redis-ljzvzz namespace: ns-jcjpx resourceVersion: "37027" uid: 31c88f71-0f11-417a-baf6-f831c14b1480 spec: containers: - args: - -h - redis-ljzvzz-redis-redis.ns-jcjpx.svc.cluster.local - -p - "6379" - -a - gu97Tl5m13 - -n - "5000" - -c - "10" - -q image: docker.io/apecloud/redis-benchmark:latest imagePullPolicy: IfNotPresent name: test-benchmark resources: *** terminationMessagePath: /dev/termination-log terminationMessagePolicy: File volumeMounts: - mountPath: /var/run/secrets/kubernetes.io/serviceaccount name: kube-api-access-sqlv2 readOnly: true dnsPolicy: ClusterFirst enableServiceLinks: true nodeName: ip-172-31-6-5.us-west-2.compute.internal preemptionPolicy: PreemptLowerPriority priority: 0 restartPolicy: Never schedulerName: default-scheduler securityContext: *** serviceAccount: default serviceAccountName: default terminationGracePeriodSeconds: 30 tolerations: - effect: NoExecute key: node.kubernetes.io/not-ready operator: Exists tolerationSeconds: 300 - effect: NoExecute key: node.kubernetes.io/unreachable operator: Exists tolerationSeconds: 300 volumes: - name: kube-api-access-sqlv2 projected: defaultMode: 420 sources: - serviceAccountToken: expirationSeconds: 3607 path: token - configMap: items: - key: ca.crt path: ca.crt name: kube-root-ca.crt - downwardAPI: items: - fieldRef: apiVersion: v1 fieldPath: metadata.namespace path: namespace status: conditions: - lastProbeTime: null lastTransitionTime: "2025-06-19T10:32:04Z" status: "True" type: PodReadyToStartContainers - lastProbeTime: null lastTransitionTime: "2025-06-19T10:31:58Z" status: "True" type: Initialized - lastProbeTime: null lastTransitionTime: "2025-06-19T10:32:04Z" status: "True" type: Ready - lastProbeTime: null lastTransitionTime: "2025-06-19T10:32:04Z" status: "True" type: ContainersReady - lastProbeTime: null lastTransitionTime: "2025-06-19T10:31:58Z" status: "True" type: PodScheduled containerStatuses: - containerID: containerd://3d94f4d07d9c07f553a4db3b6a0c0b7541f9459beaff935ed6da86843b042517 image: docker.io/apecloud/redis-benchmark:latest imageID: docker.io/apecloud/redis-benchmark@sha256:a4ae7eaa01ff4ef5ac13d8b72992f1e7b18924fb613f21fddab63dc5a6682c56 lastState: *** name: test-benchmark ready: true restartCount: 0 started: true state: running: startedAt: "2025-06-19T10:32:03Z" volumeMounts: - mountPath: /var/run/secrets/kubernetes.io/serviceaccount name: kube-api-access-sqlv2 readOnly: true recursiveReadOnly: Disabled hostIP: 172.31.6.5 hostIPs: - ip: 172.31.6.5 phase: Running podIP: 172.31.11.23 podIPs: - ip: 172.31.11.23 qosClass: BestEffort startTime: "2025-06-19T10:31:58Z" ------------------------------------------------------------------------------------------------------------------ --------------------------------------describe pod benchtest-redis-ljzvzz-------------------------------------- `kubectl describe pod benchtest-redis-ljzvzz --namespace ns-jcjpx ` Name: benchtest-redis-ljzvzz Namespace: ns-jcjpx Priority: 0 Service Account: default Node: ip-172-31-6-5.us-west-2.compute.internal/172.31.6.5 Start Time: Thu, 19 Jun 2025 18:31:58 +0800 Labels: Annotations: Status: Running IP: 172.31.11.23 IPs: IP: 172.31.11.23 Containers: test-benchmark: Container ID: containerd://3d94f4d07d9c07f553a4db3b6a0c0b7541f9459beaff935ed6da86843b042517 Image: docker.io/apecloud/redis-benchmark:latest Image ID: docker.io/apecloud/redis-benchmark@sha256:a4ae7eaa01ff4ef5ac13d8b72992f1e7b18924fb613f21fddab63dc5a6682c56 Port: Host Port: Args: -h redis-ljzvzz-redis-redis.ns-jcjpx.svc.cluster.local -p 6379 -a gu97Tl5m13 -n 5000 -c 10 -q State: Running Started: Thu, 19 Jun 2025 18:32:03 +0800 Ready: True Restart Count: 0 Environment: Mounts: /var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-sqlv2 (ro) Conditions: Type Status PodReadyToStartContainers True Initialized True Ready True ContainersReady True PodScheduled True Volumes: kube-api-access-sqlv2: Type: Projected (a volume that contains injected data from multiple sources) TokenExpirationSeconds: 3607 ConfigMapName: kube-root-ca.crt ConfigMapOptional: DownwardAPI: true QoS Class: BestEffort Node-Selectors: Tolerations: node.kubernetes.io/not-ready:NoExecute op=Exists for 300s node.kubernetes.io/unreachable:NoExecute op=Exists for 300s Events: Type Reason Age From Message ---- ------ ---- ---- ------- Normal Scheduled 5m49s default-scheduler Successfully assigned ns-jcjpx/benchtest-redis-ljzvzz to ip-172-31-6-5.us-west-2.compute.internal Normal Pulling 5m49s kubelet Pulling image "docker.io/apecloud/redis-benchmark:latest" Normal Pulled 5m44s kubelet Successfully pulled image "docker.io/apecloud/redis-benchmark:latest" in 4.522s (4.522s including waiting). Image size: 51408869 bytes. Normal Created 5m44s kubelet Created container: test-benchmark Normal Started 5m44s kubelet Started container test-benchmark ------------------------------------------------------------------------------------------------------------------ --------------------------------------pod benchtest-redis-ljzvzz-------------------------------------- `kubectl logs benchtest-redis-ljzvzz --namespace ns-jcjpx --tail 500` PING_INLINE: rps=0.0 (overall: -nan) avg_msec=-nan (overall: -nan) PING_INLINE: rps=543.7 (overall: 543.7) avg_msec=8.458 (overall: 8.458) PING_INLINE: rps=31.9 (overall: 288.3) avg_msec=223.904 (overall: 20.345) PING_INLINE: rps=0.0 (overall: 192.3) avg_msec=-nan (overall: 20.345) PING_INLINE: rps=31.9 (overall: 152.2) avg_msec=624.896 (overall: 51.955) PING_INLINE: rps=8.0 (overall: 123.4) avg_msec=800.000 (overall: 61.608) PING_INLINE: rps=223.1 (overall: 140.0) avg_msec=96.569 (overall: 70.886) PING_INLINE: rps=39.8 (overall: 125.7) avg_msec=118.406 (overall: 73.037) PING_INLINE: rps=442.2 (overall: 165.3) avg_msec=34.294 (overall: 60.084) PING_INLINE: rps=1043.8 (overall: 262.8) avg_msec=7.708 (overall: 36.982) PING_INLINE: rps=729.1 (overall: 309.4) avg_msec=16.144 (overall: 32.074) PING_INLINE: rps=884.5 (overall: 361.7) avg_msec=8.865 (overall: 26.917) PING_INLINE: rps=414.3 (overall: 366.1) avg_msec=28.883 (overall: 27.102) PING_INLINE: rps=573.7 (overall: 382.0) avg_msec=13.943 (overall: 25.582) PING_INLINE: rps=2055.8 (overall: 501.6) avg_msec=5.756 (overall: 19.780) PING_INLINE: rps=484.1 (overall: 500.4) avg_msec=15.862 (overall: 19.526) PING_INLINE: rps=1079.7 (overall: 536.6) avg_msec=11.099 (overall: 18.467) PING_INLINE: rps=0.0 (overall: 505.2) avg_msec=-nan (overall: 18.467) PING_INLINE: rps=19.9 (overall: 478.2) avg_msec=496.102 (overall: 19.572) PING_INLINE: rps=19.9 (overall: 454.1) avg_msec=595.917 (overall: 20.902) PING_INLINE: rps=362.5 (overall: 449.5) avg_msec=42.888 (overall: 21.789) PING_INLINE: rps=239.0 (overall: 439.5) avg_msec=43.522 (overall: 22.352) PING_INLINE: rps=39.8 (overall: 421.3) avg_msec=97.299 (overall: 22.674) PING_INLINE: rps=71.7 (overall: 406.1) avg_msec=211.644 (overall: 24.124) PING_INLINE: rps=127.5 (overall: 394.5) avg_msec=99.573 (overall: 25.140) PING_INLINE: rps=39.8 (overall: 380.3) avg_msec=99.782 (overall: 25.453) PING_INLINE: rps=111.6 (overall: 370.0) avg_msec=114.362 (overall: 26.483) PING_INLINE: rps=8.0 (overall: 356.6) avg_msec=199.552 (overall: 26.627) PING_INLINE: rps=235.1 (overall: 352.3) avg_msec=91.677 (overall: 28.177) PING_INLINE: rps=39.8 (overall: 341.5) avg_msec=117.978 (overall: 28.538) PING_INLINE: rps=31.9 (overall: 331.2) avg_msec=324.736 (overall: 29.488) PING_INLINE: rps=71.7 (overall: 322.8) avg_msec=166.891 (overall: 30.473) PING_INLINE: rps=8.0 (overall: 313.0) avg_msec=196.864 (overall: 30.605) PING_INLINE: rps=39.7 (overall: 304.6) avg_msec=409.882 (overall: 32.108) PING_INLINE: rps=0.0 (overall: 295.7) avg_msec=-nan (overall: 32.108) PING_INLINE: rps=39.8 (overall: 288.4) avg_msec=489.882 (overall: 33.914) PING_INLINE: rps=31.9 (overall: 281.3) avg_msec=324.896 (overall: 34.830) PING_INLINE: rps=0.0 (overall: 273.6) avg_msec=-nan (overall: 34.830) PING_INLINE: rps=39.7 (overall: 267.4) avg_msec=450.048 (overall: 36.457) PING_INLINE: rps=8.0 (overall: 260.7) avg_msec=403.840 (overall: 36.745) PING_INLINE: rps=80.0 (overall: 256.2) avg_msec=296.179 (overall: 38.760) PING_INLINE: rps=0.0 (overall: 250.0) avg_msec=-nan (overall: 38.760) PING_INLINE: rps=39.8 (overall: 245.0) avg_msec=316.493 (overall: 39.835) PING_INLINE: rps=31.9 (overall: 240.0) avg_msec=499.968 (overall: 41.255) PING_INLINE: rps=8.0 (overall: 234.8) avg_msec=499.968 (overall: 41.609) PING_INLINE: rps=27.9 (overall: 230.2) avg_msec=471.351 (overall: 42.766) PING_INLINE: rps=51.8 (overall: 226.3) avg_msec=269.314 (overall: 43.892) PING_INLINE: rps=4.0 (overall: 221.6) avg_msec=304.768 (overall: 43.992) PING_INLINE: rps=116.0 (overall: 219.4) avg_msec=162.040 (overall: 45.287) PING_INLINE: rps=0.0 (overall: 214.9) avg_msec=-nan (overall: 45.287) PING_INLINE: rps=39.8 (overall: 211.4) avg_msec=418.944 (overall: 46.695) PING_INLINE: rps=0.0 (overall: 207.3) avg_msec=-nan (overall: 46.695) PING_INLINE: rps=27.9 (overall: 203.8) avg_msec=599.881 (overall: 48.150) PING_INLINE: rps=12.0 (overall: 200.2) avg_msec=633.088 (overall: 48.809) PING_INLINE: rps=39.8 (overall: 197.2) avg_msec=391.040 (overall: 50.089) PING_INLINE: rps=0.0 (overall: 193.7) avg_msec=-nan (overall: 50.089) PING_INLINE: rps=31.9 (overall: 190.8) avg_msec=598.272 (overall: 51.724) PING_INLINE: rps=8.0 (overall: 187.6) avg_msec=600.320 (overall: 52.133) PING_INLINE: rps=0.0 (overall: 184.3) avg_msec=-nan (overall: 52.133) PING_INLINE: rps=79.4 (overall: 182.6) avg_msec=390.029 (overall: 54.632) PING_INLINE: rps=0.0 (overall: 179.5) avg_msec=-nan (overall: 54.632) PING_INLINE: rps=39.8 (overall: 177.2) avg_msec=320.563 (overall: 55.612) PING_INLINE: rps=23.9 (overall: 174.8) avg_msec=298.368 (overall: 56.147) PING_INLINE: rps=8.0 (overall: 172.1) avg_msec=498.304 (overall: 56.472) PING_INLINE: rps=31.9 (overall: 169.9) avg_msec=551.584 (overall: 57.923) PING_INLINE: rps=39.8 (overall: 167.9) avg_msec=408.602 (overall: 59.203) PING_INLINE: rps=0.0 (overall: 165.4) avg_msec=-nan (overall: 59.203) PING_INLINE: rps=0.0 (overall: 162.9) avg_msec=-nan (overall: 59.203) PING_INLINE: rps=39.8 (overall: 161.1) avg_msec=651.213 (overall: 61.355) PING_INLINE: rps=63.7 (overall: 159.7) avg_msec=186.962 (overall: 62.082) PING_INLINE: rps=4.0 (overall: 157.5) avg_msec=299.648 (overall: 62.168) PING_INLINE: rps=27.9 (overall: 155.6) avg_msec=527.707 (overall: 63.343) PING_INLINE: rps=8.0 (overall: 153.6) avg_msec=699.392 (overall: 63.801) PING_INLINE: rps=39.8 (overall: 152.0) avg_msec=431.091 (overall: 65.119) PING_INLINE: rps=111.6 (overall: 151.5) avg_msec=110.265 (overall: 65.568) PING_INLINE: rps=8.0 (overall: 149.6) avg_msec=300.032 (overall: 65.735) PING_INLINE: rps=0.0 (overall: 147.6) avg_msec=-nan (overall: 65.735) PING_INLINE: rps=23.9 (overall: 146.0) avg_msec=799.829 (overall: 67.296) PING_INLINE: rps=15.9 (overall: 144.3) avg_msec=799.488 (overall: 68.332) PING_INLINE: rps=31.9 (overall: 142.9) avg_msec=475.456 (overall: 69.481) PING_INLINE: rps=7.9 (overall: 141.2) avg_msec=599.808 (overall: 69.855) PING_INLINE: rps=23.9 (overall: 139.8) avg_msec=499.840 (overall: 70.763) PING_INLINE: rps=8.0 (overall: 138.2) avg_msec=598.272 (overall: 71.134) PING_INLINE: rps=0.0 (overall: 136.5) avg_msec=-nan (overall: 71.134) PING_INLINE: rps=8.0 (overall: 135.0) avg_msec=899.840 (overall: 71.716) PING_INLINE: rps=23.9 (overall: 133.7) avg_msec=1000.107 (overall: 73.670) PING_INLINE: rps=15.9 (overall: 132.3) avg_msec=750.144 (overall: 74.617) PING_INLINE: rps=55.8 (overall: 131.4) avg_msec=286.400 (overall: 75.650) PING_INLINE: rps=47.8 (overall: 130.5) avg_msec=198.928 (overall: 76.163) PING_INLINE: rps=79.7 (overall: 129.9) avg_msec=149.901 (overall: 76.672) PING_INLINE: rps=8.0 (overall: 128.5) avg_msec=199.552 (overall: 76.756) PING_INLINE: rps=0.0 (overall: 127.1) avg_msec=-nan (overall: 76.756) PING_INLINE: rps=111.6 (overall: 127.0) avg_msec=243.322 (overall: 78.347) PING_INLINE: rps=39.8 (overall: 126.0) avg_msec=98.298 (overall: 78.415) PING_INLINE: rps=39.8 (overall: 125.1) avg_msec=301.568 (overall: 79.171) PING_INLINE: rps=79.7 (overall: 124.6) avg_msec=199.932 (overall: 79.983) PING_INLINE: rps=0.0 (overall: 123.3) avg_msec=-nan (overall: 79.983) PING_INLINE: rps=79.7 (overall: 122.9) avg_msec=199.855 (overall: 80.785) PING_INLINE: rps=222.2 (overall: 123.9) avg_msec=71.429 (overall: 80.613) PING_INLINE: rps=27.9 (overall: 122.9) avg_msec=126.149 (overall: 80.717) PING_INLINE: rps=191.2 (overall: 123.6) avg_msec=75.103 (overall: 80.630) PING_INLINE: rps=8.0 (overall: 122.5) avg_msec=196.928 (overall: 80.705) PING_INLINE: rps=31.9 (overall: 121.6) avg_msec=460.656 (overall: 81.682) PING_INLINE: rps=0.0 (overall: 120.4) avg_msec=-nan (overall: 81.682) PING_INLINE: rps=39.8 (overall: 119.6) avg_msec=460.365 (overall: 82.894) PING_INLINE: rps=23.9 (overall: 118.7) avg_msec=399.360 (overall: 83.501) PING_INLINE: rps=8.0 (overall: 117.7) avg_msec=499.200 (overall: 83.767) PING_INLINE: rps=0.0 (overall: 116.6) avg_msec=-nan (overall: 83.767) PING_INLINE: rps=39.8 (overall: 115.9) avg_msec=640.538 (overall: 85.539) PING_INLINE: rps=0.0 (overall: 114.8) avg_msec=-nan (overall: 85.539) PING_INLINE: rps=39.8 (overall: 114.1) avg_msec=549.338 (overall: 87.011) PING_INLINE: rps=23.9 (overall: 113.3) avg_msec=366.507 (overall: 87.542) PING_INLINE: rps=39.8 (overall: 112.6) avg_msec=330.138 (overall: 88.308) PING_INLINE: rps=190.5 (overall: 113.3) avg_msec=62.626 (overall: 87.925) PING_INLINE: rps=79.7 (overall: 113.0) avg_msec=149.066 (overall: 88.303) PING_INLINE: rps=40.0 (overall: 112.4) avg_msec=199.462 (overall: 88.645) PING_INLINE: rps=161.4 (overall: 112.8) avg_msec=48.828 (overall: 88.149) PING_INLINE: rps=39.8 (overall: 112.2) avg_msec=218.957 (overall: 88.545) PING_INLINE: rps=0.0 (overall: 111.3) avg_msec=-nan (overall: 88.545) PING_INLINE: rps=40.0 (overall: 110.7) avg_msec=502.067 (overall: 89.796) PING_INLINE: rps=31.7 (overall: 110.0) avg_msec=222.064 (overall: 90.115) PING_INLINE: rps=123.5 (overall: 110.1) avg_msec=129.549 (overall: 90.481) PING_INLINE: rps=39.8 (overall: 109.5) avg_msec=118.093 (overall: 90.563) PING_INLINE: rps=0.0 (overall: 108.6) avg_msec=-nan (overall: 90.563) PING_INLINE: rps=39.8 (overall: 108.1) avg_msec=500.275 (overall: 91.781) PING_INLINE: rps=0.0 (overall: 107.2) avg_msec=-nan (overall: 91.781) PING_INLINE: rps=39.8 (overall: 106.7) avg_msec=520.090 (overall: 93.050) PING_INLINE: rps=0.0 (overall: 105.9) avg_msec=-nan (overall: 93.050) PING_INLINE: rps=79.7 (overall: 105.7) avg_msec=304.565 (overall: 94.296) PING_INLINE: rps=79.7 (overall: 105.5) avg_msec=125.563 (overall: 94.479) PING_INLINE: rps=163.3 (overall: 105.9) avg_msec=55.586 (overall: 94.018) PING_INLINE: rps=119.5 (overall: 106.0) avg_msec=90.650 (overall: 93.989) PING_INLINE: rps=39.8 (overall: 105.5) avg_msec=149.514 (overall: 94.147) PING_INLINE: rps=27.7 (overall: 104.9) avg_msec=341.010 (overall: 94.641) PING_INLINE: rps=8.0 (overall: 104.2) avg_msec=696.832 (overall: 94.984) PING_INLINE: rps=64.0 (overall: 103.9) avg_msec=294.348 (overall: 95.890) PING_INLINE: rps=39.8 (overall: 103.4) avg_msec=298.598 (overall: 96.464) PING_INLINE: rps=39.7 (overall: 103.0) avg_msec=120.173 (overall: 96.531) PING_INLINE: rps=31.9 (overall: 102.4) avg_msec=199.824 (overall: 96.764) PING_INLINE: rps=83.7 (overall: 102.3) avg_msec=200.735 (overall: 97.376) PING_INLINE: rps=377.0 (overall: 104.3) avg_msec=31.506 (overall: 95.668) PING_INLINE: rps=749.0 (overall: 108.8) avg_msec=15.826 (overall: 91.773) PING_INLINE: rps=191.2 (overall: 109.4) avg_msec=37.129 (overall: 91.100) PING_INLINE: rps=127.5 (overall: 109.5) avg_msec=69.564 (overall: 90.925) PING_INLINE: rps=183.3 (overall: 110.1) avg_msec=65.159 (overall: 90.627) PING_INLINE: rps=792.8 (overall: 114.8) avg_msec=14.841 (overall: 87.017) PING_INLINE: rps=649.4 (overall: 118.4) avg_msec=12.530 (overall: 84.221) PING_INLINE: rps=698.4 (overall: 122.4) avg_msec=16.924 (overall: 81.598) PING_INLINE: rps=72.0 (overall: 122.0) avg_msec=53.487 (overall: 81.487) PING_INLINE: rps=422.3 (overall: 124.1) avg_msec=37.571 (overall: 80.484) PING_INLINE: rps=402.4 (overall: 125.9) avg_msec=19.431 (overall: 79.183) PING_INLINE: rps=170.6 (overall: 126.2) avg_msec=23.768 (overall: 78.685) PING_INLINE: rps=0.0 (overall: 125.4) avg_msec=-nan (overall: 78.685) PING_INLINE: rps=40.0 (overall: 124.8) avg_msec=637.645 (overall: 79.851) PING_INLINE: rps=19.9 (overall: 124.1) avg_msec=299.494 (overall: 80.080) PING_INLINE: rps=4.0 (overall: 123.4) avg_msec=399.232 (overall: 80.146) PING_INLINE: rps=39.8 (overall: 122.8) avg_msec=468.685 (overall: 80.954) PING_INLINE: rps=195.2 (overall: 123.3) avg_msec=81.603 (overall: 80.961) PING_INLINE: rps=378.5 (overall: 124.9) avg_msec=21.205 (overall: 79.815) PING_INLINE: 125.32 requests per second, p50=0.583 msec PING_MBULK: rps=0.0 (overall: 0.0) avg_msec=-nan (overall: -nan) PING_MBULK: rps=91.3 (overall: 90.6) avg_msec=62.503 (overall: 62.503) PING_MBULK: rps=159.4 (overall: 124.8) avg_msec=59.804 (overall: 60.789) PING_MBULK: rps=23.9 (overall: 91.3) avg_msec=298.411 (overall: 81.452) PING_MBULK: rps=127.5 (overall: 100.3) avg_msec=125.168 (overall: 95.303) PING_MBULK: rps=322.7 (overall: 144.7) avg_msec=24.910 (overall: 63.974) PING_MBULK: rps=187.3 (overall: 151.8) avg_msec=41.668 (overall: 59.396) PING_MBULK: rps=147.4 (overall: 151.1) avg_msec=81.059 (overall: 62.409) PING_MBULK: rps=353.2 (overall: 176.4) avg_msec=33.613 (overall: 55.190) PING_MBULK: rps=1180.0 (overall: 287.4) avg_msec=6.824 (overall: 33.239) PING_MBULK: rps=1298.8 (overall: 388.4) avg_msec=9.020 (overall: 25.150) PING_MBULK: rps=513.9 (overall: 399.8) avg_msec=17.632 (overall: 24.272) PING_MBULK: rps=661.4 (overall: 421.6) avg_msec=11.269 (overall: 22.574) PING_MBULK: rps=0.0 (overall: 389.2) avg_msec=-nan (overall: 22.574) PING_MBULK: rps=0.0 (overall: 361.4) avg_msec=-nan (overall: 22.574) PING_MBULK: rps=71.7 (overall: 342.1) avg_msec=422.396 (overall: 28.157) PING_MBULK: rps=7.9 (overall: 321.1) avg_msec=296.320 (overall: 28.573) PING_MBULK: rps=79.7 (overall: 307.0) avg_msec=230.022 (overall: 31.646) PING_MBULK: rps=79.7 (overall: 294.3) avg_msec=149.740 (overall: 33.420) PING_MBULK: rps=31.7 (overall: 280.5) avg_msec=211.192 (overall: 34.482) PING_MBULK: rps=8.0 (overall: 266.9) avg_msec=398.592 (overall: 35.025) PING_MBULK: rps=0.0 (overall: 254.2) avg_msec=-nan (overall: 35.025) PING_MBULK: rps=32.0 (overall: 244.1) avg_msec=687.680 (overall: 38.896) PING_MBULK: rps=67.5 (overall: 236.4) avg_msec=295.266 (overall: 42.086) PING_MBULK: rps=259.0 (overall: 237.4) avg_msec=30.801 (overall: 41.574) PING_MBULK: rps=924.3 (overall: 264.8) avg_msec=12.680 (overall: 37.543) PING_MBULK: rps=39.8 (overall: 256.2) avg_msec=116.774 (overall: 38.017) PING_MBULK: rps=460.0 (overall: 263.7) avg_msec=33.167 (overall: 37.705) PING_MBULK: rps=525.9 (overall: 273.0) avg_msec=15.069 (overall: 36.148) PING_MBULK: rps=2091.6 (overall: 335.7) avg_msec=5.747 (overall: 29.620) PING_MBULK: rps=1127.5 (overall: 362.1) avg_msec=6.947 (overall: 27.268) PING_MBULK: rps=952.0 (overall: 381.0) avg_msec=11.077 (overall: 25.969) PING_MBULK: rps=31.9 (overall: 370.1) avg_msec=197.808 (overall: 26.431) PING_MBULK: rps=39.8 (overall: 360.1) avg_msec=280.083 (overall: 27.281) PING_MBULK: rps=0.0 (overall: 349.6) avg_msec=-nan (overall: 27.281) PING_MBULK: rps=314.7 (overall: 348.6) avg_msec=62.387 (overall: 28.187) PING_MBULK: rps=167.3 (overall: 343.5) avg_msec=70.942 (overall: 28.765) PING_MBULK: rps=67.7 (overall: 336.1) avg_msec=178.140 (overall: 29.579) PING_MBULK: rps=7.9 (overall: 327.4) avg_msec=194.944 (overall: 29.684) PING_MBULK: rps=750.0 (overall: 338.2) avg_msec=24.163 (overall: 29.369) PING_MBULK: rps=398.4 (overall: 339.7) avg_msec=20.023 (overall: 29.096) PING_MBULK: rps=150.8 (overall: 335.1) avg_msec=78.226 (overall: 29.637) PING_MBULK: rps=460.0 (overall: 338.1) avg_msec=17.564 (overall: 29.247) PING_MBULK: rps=454.5 (overall: 340.8) avg_msec=26.569 (overall: 29.164) PING_MBULK: rps=318.7 (overall: 340.3) avg_msec=23.886 (overall: 29.051) PING_MBULK: rps=992.0 (overall: 354.8) avg_msec=11.891 (overall: 27.986) PING_MBULK: rps=187.3 (overall: 351.1) avg_msec=42.357 (overall: 28.152) PING_MBULK: rps=494.0 (overall: 354.2) avg_msec=24.432 (overall: 28.042) PING_MBULK: rps=210.3 (overall: 351.2) avg_msec=36.880 (overall: 28.152) PING_MBULK: rps=502.0 (overall: 354.2) avg_msec=23.795 (overall: 28.027) PING_MBULK: rps=884.9 (overall: 364.9) avg_msec=9.010 (overall: 27.101) PING_MBULK: rps=308.0 (overall: 363.8) avg_msec=25.310 (overall: 27.072) PING_MBULK: rps=51.8 (overall: 357.8) avg_msec=230.644 (overall: 27.638) PING_MBULK: rps=39.8 (overall: 351.8) avg_msec=130.262 (overall: 27.857) PING_MBULK: rps=79.7 (overall: 346.8) avg_msec=185.683 (overall: 28.528) PING_MBULK: rps=290.8 (overall: 345.7) avg_msec=40.877 (overall: 28.717) PING_MBULK: rps=0.0 (overall: 339.6) avg_msec=-nan (overall: 28.717) PING_MBULK: rps=187.3 (overall: 336.9) avg_msec=106.302 (overall: 29.473) PING_MBULK: rps=472.2 (overall: 339.2) avg_msec=25.398 (overall: 29.375) PING_MBULK: 343.01 requests per second, p50=0.471 msec SET: rps=310.8 (overall: 388.1) avg_msec=18.991 (overall: 18.991) SET: rps=39.8 (overall: 194.7) avg_msec=116.192 (overall: 30.037) SET: rps=183.3 (overall: 190.6) avg_msec=82.588 (overall: 48.077) SET: rps=39.8 (overall: 150.9) avg_msec=129.907 (overall: 53.760) SET: rps=0.0 (overall: 119.5) avg_msec=-nan (overall: 53.760) SET: rps=35.9 (overall: 105.1) avg_msec=532.750 (overall: 81.935) SET: rps=12.0 (overall: 91.4) avg_msec=402.304 (overall: 88.096) SET: rps=79.4 (overall: 89.9) avg_msec=215.035 (overall: 102.521) SET: rps=607.1 (overall: 148.9) avg_msec=22.588 (overall: 65.349) SET: rps=119.5 (overall: 145.9) avg_msec=64.265 (overall: 65.258) SET: rps=454.2 (overall: 174.4) avg_msec=26.253 (overall: 55.857) SET: rps=705.2 (overall: 219.4) avg_msec=17.124 (overall: 45.310) SET: rps=649.4 (overall: 253.0) avg_msec=12.039 (overall: 38.639) SET: rps=39.7 (overall: 237.4) avg_msec=99.590 (overall: 39.380) SET: rps=27.9 (overall: 223.3) avg_msec=397.952 (overall: 42.404) SET: rps=12.0 (overall: 209.9) avg_msec=599.125 (overall: 44.409) SET: rps=67.7 (overall: 201.5) avg_msec=241.365 (overall: 48.348) SET: rps=51.8 (overall: 193.1) avg_msec=146.213 (overall: 49.822) SET: rps=84.3 (overall: 187.1) avg_msec=154.729 (overall: 52.430) SET: rps=828.7 (overall: 219.4) avg_msec=14.364 (overall: 45.186) SET: rps=195.2 (overall: 218.2) avg_msec=40.507 (overall: 44.985) SET: rps=597.6 (overall: 235.6) avg_msec=19.882 (overall: 42.071) SET: rps=0.0 (overall: 225.3) avg_msec=-nan (overall: 42.071) SET: rps=274.9 (overall: 227.4) avg_msec=73.238 (overall: 43.651) SET: rps=183.3 (overall: 225.6) avg_msec=33.611 (overall: 43.323) SET: rps=646.8 (overall: 241.9) avg_msec=19.720 (overall: 40.872) SET: rps=768.0 (overall: 261.5) avg_msec=11.489 (overall: 37.671) SET: rps=111.6 (overall: 256.1) avg_msec=105.316 (overall: 38.729) SET: rps=940.5 (overall: 279.9) avg_msec=9.441 (overall: 35.304) SET: rps=438.2 (overall: 285.2) avg_msec=23.291 (overall: 34.686) SET: rps=633.5 (overall: 296.5) avg_msec=13.801 (overall: 33.240) SET: rps=1609.6 (overall: 337.7) avg_msec=7.418 (overall: 29.376) SET: rps=349.2 (overall: 338.1) avg_msec=24.570 (overall: 29.224) SET: rps=0.0 (overall: 328.1) avg_msec=-nan (overall: 29.224) SET: rps=39.8 (overall: 319.8) avg_msec=474.163 (overall: 30.814) SET: rps=0.0 (overall: 310.9) avg_msec=-nan (overall: 30.814) SET: rps=11.9 (overall: 302.8) avg_msec=572.971 (overall: 31.395) SET: rps=60.0 (overall: 296.4) avg_msec=396.388 (overall: 33.339) SET: rps=71.7 (overall: 290.6) avg_msec=174.926 (overall: 34.239) SET: rps=7.9 (overall: 283.5) avg_msec=232.256 (overall: 34.378) SET: rps=39.8 (overall: 277.5) avg_msec=318.323 (overall: 35.376) SET: rps=23.9 (overall: 271.4) avg_msec=335.616 (overall: 36.008) SET: rps=338.6 (overall: 273.0) avg_msec=53.657 (overall: 36.518) SET: rps=772.9 (overall: 284.4) avg_msec=9.998 (overall: 34.875) SET: rps=654.8 (overall: 292.7) avg_msec=18.189 (overall: 34.040) SET: rps=460.0 (overall: 296.3) avg_msec=17.141 (overall: 33.470) SET: rps=199.2 (overall: 294.3) avg_msec=59.606 (overall: 33.848) SET: rps=298.8 (overall: 294.3) avg_msec=26.353 (overall: 33.689) SET: rps=1298.8 (overall: 314.9) avg_msec=9.178 (overall: 31.620) SET: rps=726.2 (overall: 323.2) avg_msec=10.831 (overall: 30.679) SET: rps=127.5 (overall: 319.3) avg_msec=92.514 (overall: 31.165) SET: rps=513.9 (overall: 323.1) avg_msec=15.685 (overall: 30.690) SET: rps=418.3 (overall: 324.9) avg_msec=28.308 (overall: 30.632) SET: rps=39.8 (overall: 319.6) avg_msec=99.315 (overall: 30.791) SET: rps=79.7 (overall: 315.2) avg_msec=149.504 (overall: 31.338) SET: rps=39.8 (overall: 310.3) avg_msec=301.005 (overall: 31.957) SET: rps=369.0 (overall: 311.3) avg_msec=32.539 (overall: 31.970) SET: rps=290.8 (overall: 311.0) avg_msec=26.866 (overall: 31.887) SET: rps=87.6 (overall: 307.2) avg_msec=99.511 (overall: 32.215) SET: rps=48.0 (overall: 302.9) avg_msec=232.864 (overall: 32.744) SET: rps=175.3 (overall: 300.8) avg_msec=54.513 (overall: 32.952) SET: rps=207.2 (overall: 299.3) avg_msec=50.664 (overall: 33.151) SET: rps=239.0 (overall: 298.3) avg_msec=42.906 (overall: 33.275) SET: rps=342.6 (overall: 299.0) avg_msec=27.921 (overall: 33.179) SET: rps=561.8 (overall: 303.1) avg_msec=21.051 (overall: 32.832) SET: 305.81 requests per second, p50=0.551 msec GET: rps=322.7 (overall: 515.9) avg_msec=9.156 (overall: 9.156) GET: rps=813.5 (overall: 699.3) avg_msec=14.438 (overall: 12.942) GET: rps=446.2 (overall: 603.0) avg_msec=17.813 (overall: 14.313) GET: rps=1231.1 (overall: 776.1) avg_msec=9.871 (overall: 12.371) GET: rps=63.7 (overall: 622.2) avg_msec=108.136 (overall: 14.491) GET: rps=900.4 (overall: 671.6) avg_msec=14.325 (overall: 14.451) GET: rps=1015.9 (overall: 723.6) avg_msec=7.649 (overall: 13.010) GET: rps=1012.0 (overall: 761.2) avg_msec=7.744 (overall: 12.096) GET: rps=39.7 (overall: 677.3) avg_msec=198.861 (overall: 13.369) GET: rps=39.8 (overall: 611.1) avg_msec=330.701 (overall: 15.517) GET: rps=0.0 (overall: 553.6) avg_msec=-nan (overall: 15.517) GET: rps=79.7 (overall: 512.8) avg_msec=284.576 (overall: 19.112) GET: rps=31.7 (overall: 474.6) avg_msec=99.848 (overall: 19.541) GET: rps=40.0 (overall: 442.9) avg_msec=320.666 (overall: 21.529) GET: rps=67.7 (overall: 417.2) avg_msec=216.981 (overall: 23.698) GET: rps=51.8 (overall: 393.8) avg_msec=177.273 (overall: 24.990) GET: rps=95.6 (overall: 375.9) avg_msec=83.030 (overall: 25.878) GET: rps=15.9 (overall: 355.4) avg_msec=298.944 (overall: 26.572) GET: rps=19.9 (overall: 337.4) avg_msec=480.410 (overall: 28.010) GET: rps=19.9 (overall: 321.2) avg_msec=579.686 (overall: 29.753) GET: rps=629.5 (overall: 336.2) avg_msec=28.573 (overall: 29.646) GET: rps=1259.0 (overall: 378.8) avg_msec=6.321 (overall: 26.062) GET: rps=1195.2 (overall: 414.9) avg_msec=10.074 (overall: 24.027) GET: rps=270.9 (overall: 408.8) avg_msec=28.140 (overall: 24.143) GET: rps=494.0 (overall: 412.3) avg_msec=24.841 (overall: 24.177) GET: rps=920.3 (overall: 432.1) avg_msec=8.220 (overall: 22.851) GET: rps=1000.0 (overall: 453.4) avg_msec=11.948 (overall: 21.948) GET: rps=266.9 (overall: 446.7) avg_msec=28.903 (overall: 22.098) GET: rps=0.0 (overall: 431.1) avg_msec=-nan (overall: 22.098) GET: rps=39.8 (overall: 417.9) avg_msec=480.026 (overall: 23.572) GET: rps=79.7 (overall: 406.8) avg_msec=160.084 (overall: 24.445) GET: rps=39.8 (overall: 395.2) avg_msec=99.360 (overall: 24.683) GET: rps=39.8 (overall: 384.3) avg_msec=399.744 (overall: 25.875) GET: rps=79.7 (overall: 375.3) avg_msec=100.051 (overall: 26.343) GET: rps=454.2 (overall: 377.5) avg_msec=26.379 (overall: 26.344) GET: rps=174.6 (overall: 371.8) avg_msec=45.137 (overall: 26.593) GET: rps=354.6 (overall: 371.4) avg_msec=33.633 (overall: 26.776) GET: rps=597.6 (overall: 377.4) avg_msec=13.400 (overall: 26.214) GET: rps=1868.5 (overall: 416.0) avg_msec=6.412 (overall: 23.911) GET: rps=521.9 (overall: 418.6) avg_msec=14.804 (overall: 23.625) GET: rps=506.0 (overall: 420.8) avg_msec=23.547 (overall: 23.623) GET: rps=55.8 (overall: 412.0) avg_msec=140.891 (overall: 24.004) GET: rps=750.0 (overall: 420.0) avg_msec=16.064 (overall: 23.670) GET: rps=63.7 (overall: 411.8) avg_msec=109.572 (overall: 23.975) GET: rps=71.1 (overall: 404.1) avg_msec=154.756 (overall: 24.495) GET: rps=187.3 (overall: 399.4) avg_msec=51.453 (overall: 24.771) GET: rps=593.6 (overall: 403.5) avg_msec=20.147 (overall: 24.626) GET: rps=39.8 (overall: 395.9) avg_msec=98.451 (overall: 24.782) GET: rps=79.7 (overall: 389.4) avg_msec=99.350 (overall: 25.095) GET: rps=39.5 (overall: 382.3) avg_msec=350.285 (overall: 25.778) GET: rps=0.0 (overall: 374.8) avg_msec=-nan (overall: 25.778) GET: rps=39.7 (overall: 368.3) avg_msec=469.018 (overall: 26.706) GET: rps=95.6 (overall: 363.1) avg_msec=129.073 (overall: 27.218) GET: rps=40.0 (overall: 357.1) avg_msec=269.958 (overall: 27.723) GET: rps=71.7 (overall: 351.9) avg_msec=155.385 (overall: 28.199) GET: rps=7.9 (overall: 345.7) avg_msec=299.648 (overall: 28.311) GET: rps=19.9 (overall: 339.9) avg_msec=499.482 (overall: 28.798) GET: rps=39.8 (overall: 334.7) avg_msec=359.994 (overall: 29.482) GET: rps=71.7 (overall: 330.2) avg_msec=183.413 (overall: 30.052) GET: rps=31.9 (overall: 325.2) avg_msec=275.680 (overall: 30.456) GET: rps=7.9 (overall: 320.0) avg_msec=399.488 (overall: 30.607) GET: rps=27.9 (overall: 315.2) avg_msec=527.177 (overall: 31.319) GET: rps=12.0 (overall: 310.4) avg_msec=599.893 (overall: 31.669) GET: rps=0.0 (overall: 305.5) avg_msec=-nan (overall: 31.669) GET: rps=0.0 (overall: 300.8) avg_msec=-nan (overall: 31.669) GET: rps=39.8 (overall: 296.8) avg_msec=869.939 (overall: 33.382) GET: rps=0.0 (overall: 292.4) avg_msec=-nan (overall: 33.382) GET: rps=68.0 (overall: 289.1) avg_msec=335.671 (overall: 34.429) GET: rps=11.9 (overall: 285.0) avg_msec=198.421 (overall: 34.529) GET: rps=31.9 (overall: 281.4) avg_msec=425.536 (overall: 35.165) GET: rps=8.0 (overall: 277.5) avg_msec=597.248 (overall: 35.394) GET: rps=39.8 (overall: 274.2) avg_msec=459.034 (overall: 36.253) GET: rps=0.0 (overall: 270.4) avg_msec=-nan (overall: 36.253) GET: rps=139.4 (overall: 268.7) avg_msec=157.529 (overall: 37.107) GET: rps=91.6 (overall: 266.3) avg_msec=86.491 (overall: 37.335) GET: 264.96 requests per second, p50=0.455 msec INCR: rps=91.6 (overall: 237.1) avg_msec=34.380 (overall: 34.380) INCR: rps=171.3 (overall: 189.7) avg_msec=41.432 (overall: 38.974) INCR: rps=103.6 (overall: 153.6) avg_msec=124.176 (overall: 63.053) INCR: rps=8.0 (overall: 110.6) avg_msec=97.184 (overall: 63.779) INCR: rps=31.9 (overall: 92.6) avg_msec=495.872 (overall: 97.669) INCR: rps=39.8 (overall: 82.8) avg_msec=220.115 (overall: 108.602) INCR: rps=490.0 (overall: 146.6) avg_msec=29.450 (overall: 67.173) INCR: rps=135.5 (overall: 145.1) avg_msec=58.413 (overall: 66.066) INCR: rps=39.8 (overall: 132.5) avg_msec=98.253 (overall: 67.220) INCR: rps=31.9 (overall: 121.8) avg_msec=400.832 (overall: 76.519) INCR: rps=23.9 (overall: 112.4) avg_msec=365.739 (overall: 82.441) INCR: rps=31.9 (overall: 105.3) avg_msec=324.504 (overall: 88.875) INCR: rps=8.0 (overall: 97.5) avg_msec=399.872 (overall: 90.928) INCR: rps=0.0 (overall: 90.2) avg_msec=-nan (overall: 90.928) INCR: rps=31.7 (overall: 86.1) avg_msec=827.136 (overall: 109.866) INCR: rps=8.0 (overall: 81.0) avg_msec=900.096 (overall: 114.915) INCR: rps=59.8 (overall: 79.7) avg_msec=193.324 (overall: 118.501) INCR: rps=27.8 (overall: 76.7) avg_msec=297.783 (overall: 122.247) INCR: rps=8.0 (overall: 73.0) avg_msec=497.536 (overall: 124.474) INCR: rps=23.9 (overall: 70.5) avg_msec=634.709 (overall: 133.400) INCR: rps=199.2 (overall: 76.8) avg_msec=99.943 (overall: 129.143) INCR: rps=4.0 (overall: 73.4) avg_msec=99.296 (overall: 129.067) INCR: rps=362.5 (overall: 86.3) avg_msec=53.855 (overall: 114.955) INCR: rps=517.9 (overall: 104.7) avg_msec=15.415 (overall: 93.914) INCR: rps=143.4 (overall: 106.3) avg_msec=82.533 (overall: 93.285) INCR: rps=39.8 (overall: 103.7) avg_msec=200.115 (overall: 94.901) INCR: rps=79.7 (overall: 102.8) avg_msec=100.326 (overall: 95.060) INCR: rps=39.8 (overall: 100.5) avg_msec=229.165 (overall: 97.001) INCR: rps=316.0 (overall: 108.1) avg_msec=47.161 (overall: 91.888) INCR: rps=357.1 (overall: 116.6) avg_msec=22.047 (overall: 84.579) INCR: rps=72.0 (overall: 115.1) avg_msec=155.673 (overall: 86.036) INCR: rps=150.8 (overall: 116.2) avg_msec=83.493 (overall: 85.931) INCR: rps=39.8 (overall: 113.9) avg_msec=200.064 (overall: 87.163) INCR: rps=23.9 (overall: 111.2) avg_msec=300.629 (overall: 88.537) INCR: rps=8.0 (overall: 108.2) avg_msec=450.432 (overall: 89.312) INCR: rps=27.8 (overall: 105.9) avg_msec=499.566 (overall: 92.364) INCR: rps=12.0 (overall: 103.3) avg_msec=798.293 (overall: 94.608) INCR: rps=0.0 (overall: 100.6) avg_msec=-nan (overall: 94.608) INCR: rps=0.0 (overall: 98.0) avg_msec=-nan (overall: 94.608) INCR: rps=107.6 (overall: 98.2) avg_msec=336.956 (overall: 101.347) INCR: rps=11.9 (overall: 96.1) avg_msec=199.232 (overall: 101.648) INCR: rps=486.1 (overall: 105.5) avg_msec=38.907 (overall: 94.664) INCR: rps=324.0 (overall: 110.6) avg_msec=24.364 (overall: 89.826) INCR: rps=442.2 (overall: 118.3) avg_msec=26.991 (overall: 84.411) INCR: rps=39.8 (overall: 116.5) avg_msec=96.166 (overall: 84.502) INCR: rps=666.7 (overall: 128.7) avg_msec=23.958 (overall: 77.563) INCR: rps=31.9 (overall: 126.6) avg_msec=171.328 (overall: 78.072) INCR: rps=67.7 (overall: 125.3) avg_msec=182.372 (overall: 79.262) INCR: rps=19.9 (overall: 123.2) avg_msec=259.507 (overall: 79.864) INCR: rps=338.6 (overall: 127.5) avg_msec=49.430 (overall: 78.228) INCR: rps=139.4 (overall: 127.8) avg_msec=56.616 (overall: 77.760) INCR: rps=203.2 (overall: 129.2) avg_msec=55.125 (overall: 77.067) INCR: rps=7.8 (overall: 126.9) avg_msec=198.016 (overall: 77.212) INCR: rps=39.8 (overall: 125.2) avg_msec=428.672 (overall: 79.305) INCR: rps=0.0 (overall: 122.9) avg_msec=-nan (overall: 79.305) INCR: rps=135.5 (overall: 123.2) avg_msec=162.016 (overall: 80.947) INCR: rps=39.7 (overall: 121.7) avg_msec=99.258 (overall: 81.053) INCR: rps=39.8 (overall: 120.3) avg_msec=239.744 (overall: 81.969) INCR: rps=0.0 (overall: 118.2) avg_msec=-nan (overall: 81.969) INCR: rps=39.8 (overall: 116.9) avg_msec=460.672 (overall: 84.142) INCR: rps=39.8 (overall: 115.6) avg_msec=299.366 (overall: 85.369) INCR: rps=31.7 (overall: 114.2) avg_msec=274.688 (overall: 86.230) INCR: rps=31.9 (overall: 112.9) avg_msec=349.824 (overall: 87.422) INCR: rps=31.9 (overall: 111.6) avg_msec=274.624 (overall: 88.264) INCR: rps=0.0 (overall: 109.9) avg_msec=-nan (overall: 88.264) INCR: rps=23.9 (overall: 108.6) avg_msec=566.592 (overall: 89.874) INCR: rps=0.0 (overall: 107.0) avg_msec=-nan (overall: 89.874) INCR: rps=0.0 (overall: 105.4) avg_msec=-nan (overall: 89.874) INCR: rps=35.7 (overall: 104.4) avg_msec=979.314 (overall: 94.341) INCR: rps=63.7 (overall: 103.8) avg_msec=286.875 (overall: 96.045) INCR: rps=27.9 (overall: 102.7) avg_msec=99.259 (overall: 96.057) INCR: rps=55.8 (overall: 102.0) avg_msec=235.086 (overall: 97.121) INCR: rps=8.0 (overall: 100.7) avg_msec=299.648 (overall: 97.343) INCR: rps=250.0 (overall: 102.8) avg_msec=86.082 (overall: 96.968) INCR: rps=163.3 (overall: 103.6) avg_msec=53.387 (overall: 96.045) INCR: rps=115.5 (overall: 103.8) avg_msec=96.054 (overall: 96.045) INCR: rps=79.7 (overall: 103.4) avg_msec=100.296 (overall: 96.088) INCR: rps=39.8 (overall: 102.6) avg_msec=218.342 (overall: 96.701) INCR: rps=40.0 (overall: 101.8) avg_msec=280.205 (overall: 97.616) INCR: rps=39.7 (overall: 101.0) avg_msec=219.725 (overall: 98.223) INCR: rps=0.0 (overall: 99.8) avg_msec=-nan (overall: 98.223) INCR: rps=31.9 (overall: 99.0) avg_msec=499.776 (overall: 99.812) INCR: rps=7.9 (overall: 97.8) avg_msec=599.808 (overall: 100.306) INCR: rps=23.9 (overall: 97.0) avg_msec=600.917 (overall: 101.785) INCR: rps=8.0 (overall: 95.9) avg_msec=899.584 (overall: 102.570) INCR: rps=0.0 (overall: 94.8) avg_msec=-nan (overall: 102.570) INCR: rps=31.7 (overall: 94.1) avg_msec=724.384 (overall: 105.009) INCR: rps=87.6 (overall: 94.0) avg_msec=200.178 (overall: 106.024) INCR: rps=63.7 (overall: 93.6) avg_msec=162.997 (overall: 106.463) INCR: rps=119.5 (overall: 93.9) avg_msec=79.935 (overall: 106.085) INCR: rps=613.5 (overall: 99.7) avg_msec=19.481 (overall: 100.189) INCR: rps=251.0 (overall: 101.3) avg_msec=18.866 (overall: 97.986) INCR: rps=83.7 (overall: 101.1) avg_msec=109.051 (overall: 98.085) INCR: rps=19.9 (overall: 100.3) avg_msec=377.728 (overall: 98.680) INCR: rps=127.0 (overall: 100.6) avg_msec=81.472 (overall: 98.448) INCR: rps=39.8 (overall: 99.9) avg_msec=348.390 (overall: 99.493) INCR: rps=12.0 (overall: 99.0) avg_msec=400.000 (overall: 99.869) INCR: rps=8.0 (overall: 98.1) avg_msec=550.080 (overall: 100.245) INCR: rps=398.4 (overall: 101.1) avg_msec=62.140 (overall: 98.719) INCR: rps=468.3 (overall: 104.8) avg_msec=16.789 (overall: 95.024) INCR: rps=736.0 (overall: 111.1) avg_msec=16.325 (overall: 89.852) INCR: rps=413.4 (overall: 114.1) avg_msec=18.777 (overall: 87.283) INCR: rps=59.8 (overall: 113.6) avg_msec=145.967 (overall: 87.585) INCR: rps=23.9 (overall: 112.7) avg_msec=299.733 (overall: 88.020) INCR: rps=31.9 (overall: 111.9) avg_msec=349.920 (overall: 88.734) INCR: rps=39.7 (overall: 111.2) avg_msec=300.800 (overall: 89.454) INCR: rps=47.8 (overall: 110.6) avg_msec=182.715 (overall: 89.833) INCR: rps=167.3 (overall: 111.2) avg_msec=47.970 (overall: 89.246) INCR: rps=79.7 (overall: 110.9) avg_msec=163.922 (overall: 89.741) INCR: rps=39.8 (overall: 110.2) avg_msec=269.792 (overall: 90.336) INCR: rps=458.2 (overall: 113.4) avg_msec=26.076 (overall: 87.984) INCR: rps=346.6 (overall: 115.5) avg_msec=23.269 (overall: 86.241) INCR: rps=87.6 (overall: 115.2) avg_msec=53.045 (overall: 86.017) INCR: rps=39.8 (overall: 114.6) avg_msec=379.520 (overall: 86.916) INCR: rps=282.9 (overall: 116.0) avg_msec=42.254 (overall: 85.965) INCR: rps=207.2 (overall: 116.8) avg_msec=28.858 (overall: 85.088) INCR: rps=71.7 (overall: 116.4) avg_msec=138.071 (overall: 85.368) INCR: rps=139.4 (overall: 116.6) avg_msec=86.982 (overall: 85.384) INCR: rps=513.9 (overall: 120.0) avg_msec=22.765 (overall: 83.120) INCR: rps=80.0 (overall: 119.7) avg_msec=98.186 (overall: 83.204) INCR: rps=0.0 (overall: 118.7) avg_msec=-nan (overall: 83.204) INCR: rps=119.5 (overall: 118.7) avg_msec=173.229 (overall: 83.951) INCR: rps=0.0 (overall: 117.7) avg_msec=-nan (overall: 83.951) INCR: rps=23.9 (overall: 116.9) avg_msec=599.808 (overall: 84.805) INCR: rps=8.0 (overall: 116.1) avg_msec=799.488 (overall: 85.199) INCR: rps=31.9 (overall: 115.4) avg_msec=625.312 (overall: 86.388) INCR: rps=8.0 (overall: 114.5) avg_msec=400.000 (overall: 86.561) INCR: rps=0.0 (overall: 113.6) avg_msec=-nan (overall: 86.561) INCR: rps=39.8 (overall: 113.1) avg_msec=629.453 (overall: 88.050) INCR: rps=147.4 (overall: 113.3) avg_msec=94.984 (overall: 88.120) INCR: rps=131.5 (overall: 113.5) avg_msec=60.409 (overall: 87.874) INCR: rps=318.7 (overall: 115.0) avg_msec=37.294 (overall: 86.808) INCR: rps=280.0 (overall: 116.3) avg_msec=28.657 (overall: 85.755) INCR: rps=111.6 (overall: 116.2) avg_msec=92.075 (overall: 85.800) INCR: rps=87.6 (overall: 116.0) avg_msec=109.256 (overall: 85.932) INCR: rps=517.9 (overall: 119.0) avg_msec=23.144 (overall: 83.914) INCR: rps=386.5 (overall: 121.0) avg_msec=20.329 (overall: 82.425) INCR: rps=286.9 (overall: 122.2) avg_msec=34.573 (overall: 81.607) INCR: rps=59.8 (overall: 121.7) avg_msec=166.607 (overall: 81.909) INCR: rps=239.0 (overall: 122.6) avg_msec=33.254 (overall: 81.228) INCR: rps=99.6 (overall: 122.4) avg_msec=120.232 (overall: 81.454) INCR: rps=394.4 (overall: 124.3) avg_msec=30.252 (overall: 80.305) INCR: rps=31.9 (overall: 123.7) avg_msec=161.324 (overall: 80.452) INCR: rps=8.0 (overall: 122.9) avg_msec=398.720 (overall: 80.596) INCR: rps=79.7 (overall: 122.6) avg_msec=245.149 (overall: 81.337) INCR: rps=142.9 (overall: 122.7) avg_msec=77.971 (overall: 81.310) INCR: rps=178.6 (overall: 123.1) avg_msec=48.937 (overall: 80.988) INCR: rps=227.1 (overall: 123.8) avg_msec=38.241 (overall: 80.456) INCR: rps=444.4 (overall: 126.0) avg_msec=25.212 (overall: 79.137) INCR: rps=584.3 (overall: 129.1) avg_msec=19.961 (overall: 77.316) INCR: 132.69 requests per second, p50=0.695 msec LPUSH: rps=0.0 (overall: 0.0) avg_msec=-nan (overall: -nan) LPUSH: rps=689.2 (overall: 559.9) avg_msec=15.772 (overall: 15.772) LPUSH: rps=0.0 (overall: 308.9) avg_msec=-nan (overall: 15.772) LPUSH: rps=51.8 (overall: 229.3) avg_msec=275.638 (overall: 33.935) LPUSH: rps=255.0 (overall: 235.4) avg_msec=53.445 (overall: 38.929) LPUSH: rps=276.0 (overall: 243.1) avg_msec=43.047 (overall: 39.820) LPUSH: rps=370.5 (overall: 263.6) avg_msec=21.760 (overall: 35.743) LPUSH: rps=257.9 (overall: 262.8) avg_msec=37.979 (overall: 36.048) LPUSH: rps=382.5 (overall: 277.3) avg_msec=26.118 (overall: 34.384) LPUSH: rps=235.1 (overall: 272.8) avg_msec=36.821 (overall: 34.612) LPUSH: rps=155.4 (overall: 261.3) avg_msec=72.154 (overall: 36.794) LPUSH: rps=79.7 (overall: 245.1) avg_msec=109.059 (overall: 38.886) LPUSH: rps=0.0 (overall: 225.2) avg_msec=-nan (overall: 38.886) LPUSH: rps=23.9 (overall: 209.9) avg_msec=600.064 (overall: 43.716) LPUSH: rps=107.1 (overall: 202.7) avg_msec=133.674 (overall: 47.071) LPUSH: rps=79.7 (overall: 194.6) avg_msec=179.379 (overall: 50.628) LPUSH: rps=72.0 (overall: 187.1) avg_msec=111.036 (overall: 52.055) LPUSH: rps=349.2 (overall: 196.5) avg_msec=34.458 (overall: 50.233) LPUSH: rps=270.9 (overall: 200.6) avg_msec=43.707 (overall: 49.750) LPUSH: rps=270.9 (overall: 204.3) avg_msec=29.246 (overall: 48.336) LPUSH: rps=39.8 (overall: 196.1) avg_msec=98.125 (overall: 48.835) LPUSH: rps=27.8 (overall: 188.2) avg_msec=328.210 (overall: 50.785) LPUSH: rps=12.0 (overall: 180.3) avg_msec=499.584 (overall: 52.124) LPUSH: rps=51.8 (overall: 174.7) avg_msec=346.139 (overall: 55.874) LPUSH: rps=111.6 (overall: 172.1) avg_msec=75.422 (overall: 56.397) LPUSH: rps=23.9 (overall: 166.2) avg_msec=382.549 (overall: 58.256) LPUSH: rps=39.8 (overall: 161.4) avg_msec=228.986 (overall: 59.862) LPUSH: rps=39.8 (overall: 157.0) avg_msec=300.774 (overall: 62.107) LPUSH: rps=39.8 (overall: 152.8) avg_msec=218.906 (overall: 63.555) LPUSH: rps=15.9 (overall: 148.1) avg_msec=399.808 (overall: 64.792) LPUSH: rps=39.8 (overall: 144.6) avg_msec=410.957 (overall: 67.948) LPUSH: rps=99.6 (overall: 143.1) avg_msec=111.673 (overall: 68.922) LPUSH: rps=12.0 (overall: 139.0) avg_msec=299.051 (overall: 69.536) LPUSH: rps=0.0 (overall: 134.9) avg_msec=-nan (overall: 69.536) LPUSH: rps=27.9 (overall: 131.7) avg_msec=644.645 (overall: 73.092) LPUSH: rps=0.0 (overall: 128.0) avg_msec=-nan (overall: 73.092) LPUSH: rps=79.7 (overall: 126.7) avg_msec=339.332 (overall: 77.714) LPUSH: rps=39.8 (overall: 124.3) avg_msec=309.773 (overall: 79.711) LPUSH: rps=39.7 (overall: 122.1) avg_msec=100.851 (overall: 79.892) LPUSH: rps=400.0 (overall: 129.2) avg_msec=40.164 (overall: 76.768) LPUSH: rps=682.5 (overall: 143.0) avg_msec=17.340 (overall: 69.690) LPUSH: rps=155.4 (overall: 143.3) avg_msec=45.340 (overall: 69.049) LPUSH: rps=79.4 (overall: 141.8) avg_msec=160.224 (overall: 70.263) LPUSH: rps=199.2 (overall: 143.1) avg_msec=39.924 (overall: 69.286) LPUSH: rps=1027.9 (overall: 163.1) avg_msec=11.836 (overall: 61.101) LPUSH: rps=290.8 (overall: 165.9) avg_msec=26.582 (overall: 59.764) LPUSH: rps=15.9 (overall: 162.7) avg_msec=99.376 (overall: 59.848) LPUSH: rps=31.7 (overall: 159.9) avg_msec=422.880 (overall: 61.380) LPUSH: rps=0.0 (overall: 156.6) avg_msec=-nan (overall: 61.380) LPUSH: rps=44.0 (overall: 154.3) avg_msec=563.235 (overall: 64.274) LPUSH: rps=39.8 (overall: 152.0) avg_msec=300.109 (overall: 65.505) LPUSH: rps=111.1 (overall: 151.2) avg_msec=64.248 (overall: 65.486) LPUSH: rps=127.5 (overall: 150.8) avg_msec=38.059 (overall: 65.043) LPUSH: rps=31.9 (overall: 148.5) avg_msec=397.088 (overall: 66.381) LPUSH: rps=8.0 (overall: 145.9) avg_msec=597.248 (overall: 66.915) LPUSH: rps=0.0 (overall: 143.3) avg_msec=-nan (overall: 66.915) LPUSH: rps=39.8 (overall: 141.5) avg_msec=580.224 (overall: 69.486) LPUSH: rps=71.7 (overall: 140.2) avg_msec=213.070 (overall: 70.768) LPUSH: rps=79.4 (overall: 139.2) avg_msec=103.467 (overall: 71.090) LPUSH: rps=12.0 (overall: 137.0) avg_msec=398.720 (overall: 71.572) LPUSH: rps=28.0 (overall: 135.2) avg_msec=484.809 (overall: 72.986) LPUSH: rps=282.9 (overall: 137.6) avg_msec=52.379 (overall: 72.295) LPUSH: rps=386.5 (overall: 141.6) avg_msec=26.990 (overall: 70.309) LPUSH: rps=412.0 (overall: 145.9) avg_msec=28.809 (overall: 68.463) LPUSH: rps=436.5 (overall: 150.4) avg_msec=18.030 (overall: 66.177) LPUSH: rps=79.7 (overall: 149.4) avg_msec=99.465 (overall: 66.449) LPUSH: rps=266.9 (overall: 151.1) avg_msec=44.515 (overall: 65.864) LPUSH: rps=525.9 (overall: 156.7) avg_msec=22.716 (overall: 63.711) LPUSH: rps=83.7 (overall: 155.6) avg_msec=80.009 (overall: 63.839) LPUSH: rps=12.0 (overall: 153.6) avg_msec=197.867 (overall: 63.990) LPUSH: rps=0.0 (overall: 151.4) avg_msec=-nan (overall: 63.990) LPUSH: rps=39.8 (overall: 149.8) avg_msec=610.829 (overall: 66.031) LPUSH: rps=0.0 (overall: 147.7) avg_msec=-nan (overall: 66.031) LPUSH: rps=0.0 (overall: 145.7) avg_msec=-nan (overall: 66.031) LPUSH: rps=0.0 (overall: 143.8) avg_msec=-nan (overall: 66.031) LPUSH: rps=31.9 (overall: 142.3) avg_msec=1099.392 (overall: 69.108) LPUSH: rps=27.9 (overall: 140.8) avg_msec=328.046 (overall: 69.780) LPUSH: rps=51.8 (overall: 139.6) avg_msec=422.956 (overall: 71.476) LPUSH: rps=0.0 (overall: 137.8) avg_msec=-nan (overall: 71.476) LPUSH: rps=39.8 (overall: 136.6) avg_msec=420.352 (overall: 72.761) LPUSH: rps=71.7 (overall: 135.8) avg_msec=155.189 (overall: 73.303) LPUSH: rps=80.0 (overall: 135.1) avg_msec=99.840 (overall: 73.496) LPUSH: rps=39.7 (overall: 133.9) avg_msec=301.082 (overall: 74.319) LPUSH: rps=364.0 (overall: 136.7) avg_msec=32.983 (overall: 73.002) LPUSH: rps=27.9 (overall: 135.4) avg_msec=98.382 (overall: 73.064) LPUSH: rps=51.6 (overall: 134.4) avg_msec=222.366 (overall: 73.739) LPUSH: rps=68.0 (overall: 133.7) avg_msec=200.201 (overall: 74.482) LPUSH: rps=410.4 (overall: 136.8) avg_msec=29.053 (overall: 72.920) LPUSH: rps=642.9 (overall: 142.6) avg_msec=12.498 (overall: 69.820) LPUSH: rps=388.0 (overall: 145.3) avg_msec=28.409 (overall: 68.586) LPUSH: rps=39.7 (overall: 144.1) avg_msec=139.994 (overall: 68.805) LPUSH: rps=0.0 (overall: 142.6) avg_msec=-nan (overall: 68.805) LPUSH: rps=79.7 (overall: 141.9) avg_msec=289.832 (overall: 70.151) LPUSH: rps=75.4 (overall: 141.2) avg_msec=152.325 (overall: 70.623) LPUSH: rps=71.7 (overall: 140.4) avg_msec=105.520 (overall: 70.812) LPUSH: rps=87.6 (overall: 139.9) avg_msec=122.373 (overall: 71.152) LPUSH: rps=0.0 (overall: 138.4) avg_msec=-nan (overall: 71.152) LPUSH: rps=27.9 (overall: 137.3) avg_msec=471.278 (overall: 71.987) LPUSH: rps=59.8 (overall: 136.5) avg_msec=282.408 (overall: 72.925) LPUSH: rps=184.0 (overall: 137.0) avg_msec=60.132 (overall: 72.753) LPUSH: rps=7.9 (overall: 135.7) avg_msec=199.936 (overall: 72.827) LPUSH: rps=31.9 (overall: 134.7) avg_msec=374.272 (overall: 73.532) LPUSH: rps=47.8 (overall: 133.8) avg_msec=317.456 (overall: 74.384) LPUSH: rps=446.2 (overall: 136.8) avg_msec=26.743 (overall: 72.879) LPUSH: rps=430.3 (overall: 139.7) avg_msec=18.564 (overall: 71.274) LPUSH: rps=203.2 (overall: 140.3) avg_msec=58.334 (overall: 71.096) LPUSH: rps=203.2 (overall: 140.8) avg_msec=38.990 (overall: 70.660) LPUSH: rps=628.0 (overall: 145.4) avg_msec=19.280 (overall: 68.599) LPUSH: rps=341.3 (overall: 147.2) avg_msec=22.830 (overall: 67.614) LPUSH: rps=396.0 (overall: 149.5) avg_msec=20.946 (overall: 66.487) LPUSH: rps=71.7 (overall: 148.8) avg_msec=148.837 (overall: 66.847) LPUSH: rps=39.8 (overall: 147.8) avg_msec=279.782 (overall: 67.363) LPUSH: rps=4.0 (overall: 146.5) avg_msec=301.952 (overall: 67.420) LPUSH: rps=4.0 (overall: 145.2) avg_msec=700.160 (overall: 67.573) LPUSH: rps=71.7 (overall: 144.6) avg_msec=355.362 (overall: 68.823) LPUSH: rps=127.5 (overall: 144.4) avg_msec=72.252 (overall: 68.849) LPUSH: rps=27.9 (overall: 143.4) avg_msec=355.931 (overall: 69.329) LPUSH: rps=12.0 (overall: 142.3) avg_msec=597.760 (overall: 69.708) LPUSH: rps=138.9 (overall: 142.3) avg_msec=125.692 (overall: 70.172) LPUSH: rps=366.5 (overall: 144.2) avg_msec=22.007 (overall: 69.145) LPUSH: rps=633.5 (overall: 148.2) avg_msec=18.632 (overall: 67.350) LPUSH: rps=470.1 (overall: 150.9) avg_msec=16.747 (overall: 66.049) LPUSH: rps=87.6 (overall: 150.4) avg_msec=136.763 (overall: 66.386) LPUSH: rps=402.4 (overall: 152.4) avg_msec=19.941 (overall: 65.392) LPUSH: rps=1016.0 (overall: 159.3) avg_msec=11.808 (overall: 62.652) LPUSH: 159.88 requests per second, p50=0.655 msec RPUSH: rps=31.7 (overall: 57.6) avg_msec=75.656 (overall: 75.656) RPUSH: rps=207.2 (overall: 153.8) avg_msec=60.709 (overall: 62.702) RPUSH: rps=31.9 (overall: 106.1) avg_msec=198.160 (overall: 78.638) RPUSH: rps=8.0 (overall: 78.5) avg_msec=298.112 (overall: 84.909) RPUSH: rps=0.0 (overall: 61.2) avg_msec=-nan (overall: 84.909) RPUSH: rps=67.7 (overall: 62.4) avg_msec=353.188 (overall: 137.331) RPUSH: rps=0.0 (overall: 52.9) avg_msec=-nan (overall: 137.331) RPUSH: rps=178.6 (overall: 69.6) avg_msec=120.285 (overall: 131.520) RPUSH: rps=0.0 (overall: 61.5) avg_msec=-nan (overall: 131.520) RPUSH: rps=35.9 (overall: 58.8) avg_msec=478.037 (overall: 153.638) RPUSH: rps=31.9 (overall: 56.2) avg_msec=384.880 (overall: 166.054) RPUSH: rps=0.0 (overall: 51.4) avg_msec=-nan (overall: 166.054) RPUSH: rps=123.5 (overall: 57.1) avg_msec=161.488 (overall: 165.268) RPUSH: rps=39.8 (overall: 55.8) avg_msec=218.765 (overall: 168.083) RPUSH: rps=0.0 (overall: 52.0) avg_msec=-nan (overall: 168.083) RPUSH: rps=63.7 (overall: 52.8) avg_msec=400.924 (overall: 186.168) RPUSH: rps=15.9 (overall: 50.6) avg_msec=249.600 (overall: 187.376) RPUSH: rps=262.9 (overall: 62.7) avg_msec=66.554 (overall: 158.484) RPUSH: rps=111.6 (overall: 65.3) avg_msec=49.828 (overall: 148.476) RPUSH: rps=211.2 (overall: 72.8) avg_msec=68.027 (overall: 136.533) RPUSH: rps=159.4 (overall: 77.0) avg_msec=49.735 (overall: 127.787) RPUSH: rps=338.6 (overall: 89.1) avg_msec=35.410 (overall: 111.497) RPUSH: rps=346.6 (overall: 100.5) avg_msec=22.781 (overall: 97.932) RPUSH: rps=410.4 (overall: 113.7) avg_msec=23.214 (overall: 86.480) RPUSH: rps=111.6 (overall: 113.6) avg_msec=92.700 (overall: 86.729) RPUSH: rps=151.4 (overall: 115.1) avg_msec=52.579 (overall: 84.970) RPUSH: rps=0.0 (overall: 110.8) avg_msec=-nan (overall: 84.970) RPUSH: rps=39.8 (overall: 108.2) avg_msec=548.480 (overall: 91.167) RPUSH: rps=0.0 (overall: 104.4) avg_msec=-nan (overall: 91.167) RPUSH: rps=107.6 (overall: 104.5) avg_msec=174.445 (overall: 94.068) RPUSH: rps=31.9 (overall: 102.1) avg_msec=223.360 (overall: 95.389) RPUSH: rps=8.0 (overall: 99.1) avg_msec=400.000 (overall: 96.165) RPUSH: rps=23.9 (overall: 96.8) avg_msec=533.163 (overall: 99.480) RPUSH: rps=235.1 (overall: 101.0) avg_msec=85.277 (overall: 98.494) RPUSH: rps=553.8 (overall: 114.1) avg_msec=14.214 (overall: 86.649) RPUSH: rps=107.6 (overall: 113.9) avg_msec=40.436 (overall: 85.421) RPUSH: rps=0.0 (overall: 110.8) avg_msec=-nan (overall: 85.421) RPUSH: rps=47.8 (overall: 109.1) avg_msec=508.533 (overall: 90.360) RPUSH: rps=167.3 (overall: 110.6) avg_msec=73.821 (overall: 89.711) RPUSH: rps=304.0 (overall: 115.5) avg_msec=35.304 (overall: 86.103) RPUSH: rps=382.5 (overall: 122.1) avg_msec=20.560 (overall: 81.037) RPUSH: rps=39.8 (overall: 120.1) avg_msec=229.651 (overall: 82.224) RPUSH: rps=0.0 (overall: 117.3) avg_msec=-nan (overall: 82.224) RPUSH: rps=27.9 (overall: 115.2) avg_msec=600.320 (overall: 85.104) RPUSH: rps=11.9 (overall: 112.9) avg_msec=700.160 (overall: 86.566) RPUSH: rps=0.0 (overall: 110.4) avg_msec=-nan (overall: 86.566) RPUSH: rps=549.8 (overall: 119.8) avg_msec=53.694 (overall: 83.326) RPUSH: rps=191.2 (overall: 121.3) avg_msec=37.091 (overall: 81.793) RPUSH: rps=8.0 (overall: 119.0) avg_msec=197.760 (overall: 81.953) RPUSH: rps=219.1 (overall: 121.0) avg_msec=87.876 (overall: 82.170) RPUSH: rps=23.8 (overall: 119.1) avg_msec=196.709 (overall: 82.625) RPUSH: rps=48.0 (overall: 117.7) avg_msec=265.120 (overall: 84.062) RPUSH: rps=67.5 (overall: 116.8) avg_msec=182.921 (overall: 85.154) RPUSH: rps=20.0 (overall: 115.0) avg_msec=199.437 (overall: 85.524) RPUSH: rps=31.9 (overall: 113.4) avg_msec=260.904 (overall: 86.427) RPUSH: rps=8.0 (overall: 111.5) avg_msec=499.584 (overall: 86.958) RPUSH: rps=0.0 (overall: 109.6) avg_msec=-nan (overall: 86.958) RPUSH: rps=39.8 (overall: 108.4) avg_msec=760.346 (overall: 91.261) RPUSH: rps=23.9 (overall: 106.9) avg_msec=316.160 (overall: 92.120) RPUSH: rps=8.0 (overall: 105.3) avg_msec=599.296 (overall: 92.765) RPUSH: rps=39.8 (overall: 104.2) avg_msec=500.467 (overall: 95.341) RPUSH: rps=0.0 (overall: 102.5) avg_msec=-nan (overall: 95.341) RPUSH: rps=143.4 (overall: 103.1) avg_msec=147.140 (overall: 96.492) RPUSH: rps=496.0 (overall: 109.3) avg_msec=19.535 (overall: 90.976) RPUSH: rps=270.9 (overall: 111.8) avg_msec=40.285 (overall: 89.074) RPUSH: rps=47.6 (overall: 110.9) avg_msec=183.211 (overall: 89.693) RPUSH: rps=440.0 (overall: 115.8) avg_msec=27.206 (overall: 86.139) RPUSH: rps=207.2 (overall: 117.1) avg_msec=38.158 (overall: 84.883) RPUSH: rps=354.6 (overall: 120.6) avg_msec=33.719 (overall: 82.689) RPUSH: rps=111.6 (overall: 120.5) avg_msec=70.862 (overall: 82.531) RPUSH: rps=199.2 (overall: 121.6) avg_msec=60.009 (overall: 82.008) RPUSH: rps=276.0 (overall: 123.7) avg_msec=28.697 (overall: 80.353) RPUSH: rps=306.8 (overall: 126.3) avg_msec=39.321 (overall: 78.978) RPUSH: rps=171.3 (overall: 126.9) avg_msec=32.345 (overall: 78.122) RPUSH: rps=179.3 (overall: 127.6) avg_msec=79.719 (overall: 78.152) RPUSH: rps=334.7 (overall: 130.3) avg_msec=23.771 (overall: 76.304) RPUSH: rps=23.9 (overall: 128.9) avg_msec=131.317 (overall: 76.437) RPUSH: rps=0.0 (overall: 127.3) avg_msec=-nan (overall: 76.437) RPUSH: rps=0.0 (overall: 125.6) avg_msec=-nan (overall: 76.437) RPUSH: rps=23.9 (overall: 124.4) avg_msec=932.864 (overall: 78.506) RPUSH: rps=119.5 (overall: 124.3) avg_msec=220.425 (overall: 80.200) RPUSH: rps=67.5 (overall: 123.6) avg_msec=117.211 (overall: 80.449) RPUSH: rps=150.8 (overall: 123.9) avg_msec=78.483 (overall: 80.420) RPUSH: rps=239.0 (overall: 125.3) avg_msec=33.245 (overall: 79.343) RPUSH: rps=0.0 (overall: 123.8) avg_msec=-nan (overall: 79.343) RPUSH: rps=63.5 (overall: 123.1) avg_msec=300.076 (overall: 80.679) RPUSH: rps=266.9 (overall: 124.8) avg_msec=33.165 (overall: 79.505) RPUSH: rps=31.9 (overall: 123.7) avg_msec=296.544 (overall: 80.143) RPUSH: rps=8.0 (overall: 122.4) avg_msec=496.000 (overall: 80.449) RPUSH: rps=140.0 (overall: 122.6) avg_msec=160.253 (overall: 81.462) RPUSH: rps=458.2 (overall: 126.3) avg_msec=17.447 (overall: 78.898) RPUSH: rps=354.6 (overall: 128.8) avg_msec=33.336 (overall: 77.528) RPUSH: rps=183.3 (overall: 129.4) avg_msec=43.348 (overall: 77.005) RPUSH: rps=290.8 (overall: 131.1) avg_msec=41.407 (overall: 76.161) RPUSH: rps=816.7 (overall: 138.4) avg_msec=9.994 (overall: 72.031) RPUSH: rps=223.1 (overall: 139.3) avg_msec=33.317 (overall: 71.382) RPUSH: rps=131.5 (overall: 139.2) avg_msec=75.679 (overall: 71.424) RPUSH: rps=99.2 (overall: 138.8) avg_msec=111.546 (overall: 71.719) RPUSH: rps=39.8 (overall: 137.8) avg_msec=171.568 (overall: 72.012) RPUSH: rps=0.0 (overall: 136.4) avg_msec=-nan (overall: 72.012) RPUSH: rps=39.8 (overall: 135.4) avg_msec=518.144 (overall: 73.317) RPUSH: rps=39.8 (overall: 134.5) avg_msec=309.581 (overall: 74.006) RPUSH: rps=27.9 (overall: 133.4) avg_msec=303.744 (overall: 74.474) RPUSH: rps=39.8 (overall: 132.5) avg_msec=358.042 (overall: 75.298) RPUSH: rps=79.4 (overall: 132.0) avg_msec=100.755 (overall: 75.444) RPUSH: rps=348.0 (overall: 134.1) avg_msec=34.212 (overall: 74.435) RPUSH: rps=337.3 (overall: 136.0) avg_msec=23.542 (overall: 73.245) RPUSH: rps=103.6 (overall: 135.7) avg_msec=68.589 (overall: 73.212) RPUSH: rps=8.0 (overall: 134.5) avg_msec=298.368 (overall: 73.335) RPUSH: rps=362.5 (overall: 136.6) avg_msec=61.648 (overall: 73.052) RPUSH: rps=282.9 (overall: 137.9) avg_msec=28.073 (overall: 72.217) RPUSH: rps=266.9 (overall: 139.1) avg_msec=20.867 (overall: 71.334) RPUSH: rps=27.9 (overall: 138.1) avg_msec=368.731 (overall: 71.867) RPUSH: rps=12.0 (overall: 137.0) avg_msec=532.224 (overall: 72.221) RPUSH: rps=0.0 (overall: 135.8) avg_msec=-nan (overall: 72.221) RPUSH: rps=204.0 (overall: 136.4) avg_msec=121.601 (overall: 72.858) RPUSH: rps=8.0 (overall: 135.3) avg_msec=297.856 (overall: 72.972) RPUSH: rps=31.9 (overall: 134.4) avg_msec=524.608 (overall: 73.883) RPUSH: rps=39.8 (overall: 133.6) avg_msec=241.843 (overall: 74.305) RPUSH: rps=0.0 (overall: 132.5) avg_msec=-nan (overall: 74.305) RPUSH: rps=39.8 (overall: 131.7) avg_msec=498.662 (overall: 75.370) RPUSH: rps=27.9 (overall: 130.8) avg_msec=399.781 (overall: 75.939) RPUSH: rps=247.0 (overall: 131.8) avg_msec=51.834 (overall: 75.571) RPUSH: rps=196.0 (overall: 132.3) avg_msec=40.258 (overall: 75.149) RPUSH: rps=230.2 (overall: 133.1) avg_msec=52.045 (overall: 74.827) RPUSH: rps=376.0 (overall: 135.0) avg_msec=31.554 (overall: 73.871) RPUSH: rps=39.8 (overall: 134.3) avg_msec=100.371 (overall: 73.933) RPUSH: rps=191.2 (overall: 134.7) avg_msec=83.083 (overall: 74.035) RPUSH: rps=39.8 (overall: 134.0) avg_msec=200.998 (overall: 74.329) RPUSH: rps=67.7 (overall: 133.5) avg_msec=140.239 (overall: 74.587) RPUSH: rps=12.0 (overall: 132.5) avg_msec=299.648 (overall: 74.742) RPUSH: rps=79.7 (overall: 132.1) avg_msec=184.931 (overall: 75.247) RPUSH: rps=0.0 (overall: 131.1) avg_msec=-nan (overall: 75.247) RPUSH: rps=848.6 (overall: 136.5) avg_msec=28.157 (overall: 73.055) RPUSH: rps=71.7 (overall: 136.0) avg_msec=55.029 (overall: 72.985) RPUSH: rps=39.8 (overall: 135.3) avg_msec=228.998 (overall: 73.324) RPUSH: rps=27.9 (overall: 134.5) avg_msec=400.256 (overall: 73.820) RPUSH: rps=12.0 (overall: 133.6) avg_msec=599.979 (overall: 74.162) RPUSH: rps=131.5 (overall: 133.6) avg_msec=130.425 (overall: 74.562) RPUSH: rps=12.0 (overall: 132.8) avg_msec=101.728 (overall: 74.579) RPUSH: rps=39.7 (overall: 132.1) avg_msec=448.653 (overall: 75.382) RPUSH: rps=27.9 (overall: 131.4) avg_msec=342.766 (overall: 75.783) RPUSH: rps=75.7 (overall: 131.0) avg_msec=189.968 (overall: 76.246) RPUSH: rps=39.8 (overall: 130.3) avg_msec=189.584 (overall: 76.487) RPUSH: rps=63.7 (overall: 129.9) avg_msec=181.004 (overall: 76.842) RPUSH: rps=8.0 (overall: 129.0) avg_msec=199.872 (overall: 76.894) RPUSH: rps=111.6 (overall: 128.9) avg_msec=131.869 (overall: 77.219) RPUSH: rps=39.8 (overall: 128.3) avg_msec=229.907 (overall: 77.540) RPUSH: rps=23.9 (overall: 127.6) avg_msec=400.427 (overall: 77.947) RPUSH: rps=31.9 (overall: 127.0) avg_msec=312.376 (overall: 78.341) RPUSH: rps=8.0 (overall: 126.2) avg_msec=449.472 (overall: 78.497) RPUSH: rps=31.9 (overall: 125.6) avg_msec=424.992 (overall: 79.077) RPUSH: rps=87.6 (overall: 125.3) avg_msec=209.457 (overall: 79.675) RPUSH: rps=353.2 (overall: 126.8) avg_msec=22.621 (overall: 78.636) RPUSH: rps=39.8 (overall: 126.2) avg_msec=117.274 (overall: 78.715) RPUSH: rps=23.9 (overall: 125.6) avg_msec=400.213 (overall: 79.108) RPUSH: rps=0.0 (overall: 124.8) avg_msec=-nan (overall: 79.108) RPUSH: rps=8.0 (overall: 124.0) avg_msec=899.840 (overall: 79.443) RPUSH: rps=31.9 (overall: 123.5) avg_msec=749.024 (overall: 80.533) RPUSH: rps=8.0 (overall: 122.7) avg_msec=999.168 (overall: 80.907) RPUSH: rps=0.0 (overall: 122.0) avg_msec=-nan (overall: 80.907) RPUSH: rps=0.0 (overall: 121.2) avg_msec=-nan (overall: 80.907) RPUSH: rps=51.8 (overall: 120.8) avg_msec=661.428 (overall: 82.438) RPUSH: rps=0.0 (overall: 120.0) avg_msec=-nan (overall: 82.438) RPUSH: rps=51.6 (overall: 119.6) avg_msec=339.195 (overall: 83.114) RPUSH: rps=8.0 (overall: 119.0) avg_msec=599.872 (overall: 83.323) RPUSH: 119.68 requests per second, p50=0.735 msec LPOP: rps=0.0 (overall: 0.0) avg_msec=-nan (overall: -nan) LPOP: rps=39.8 (overall: 39.5) avg_msec=72.550 (overall: 72.550) LPOP: rps=231.1 (overall: 134.9) avg_msec=69.234 (overall: 69.722) LPOP: rps=276.7 (overall: 182.3) avg_msec=28.503 (overall: 48.814) LPOP: rps=114.6 (overall: 165.3) avg_msec=78.406 (overall: 53.953) LPOP: rps=0.0 (overall: 132.4) avg_msec=-nan (overall: 53.953) LPOP: rps=39.7 (overall: 117.0) avg_msec=509.376 (overall: 79.683) LPOP: rps=0.0 (overall: 100.3) avg_msec=-nan (overall: 79.683) LPOP: rps=12.0 (overall: 89.4) avg_msec=601.856 (overall: 88.386) LPOP: rps=39.8 (overall: 83.9) avg_msec=503.114 (overall: 110.213) LPOP: rps=126.5 (overall: 88.2) avg_msec=118.452 (overall: 111.401) LPOP: rps=119.5 (overall: 91.0) avg_msec=65.708 (overall: 105.961) LPOP: rps=79.7 (overall: 90.1) avg_msec=109.750 (overall: 106.240) LPOP: rps=0.0 (overall: 83.2) avg_msec=-nan (overall: 106.240) LPOP: rps=39.7 (overall: 80.1) avg_msec=510.630 (overall: 120.580) LPOP: rps=68.0 (overall: 79.3) avg_msec=217.212 (overall: 126.074) LPOP: rps=146.8 (overall: 83.5) avg_msec=53.891 (overall: 118.125) LPOP: rps=240.0 (overall: 92.7) avg_msec=49.912 (overall: 107.790) LPOP: rps=390.4 (overall: 109.2) avg_msec=20.416 (overall: 90.457) LPOP: rps=302.8 (overall: 119.3) avg_msec=39.441 (overall: 83.655) LPOP: rps=581.7 (overall: 142.4) avg_msec=13.929 (overall: 69.437) LPOP: rps=517.9 (overall: 160.3) avg_msec=22.798 (overall: 62.270) LPOP: rps=482.1 (overall: 174.9) avg_msec=16.547 (overall: 56.549) LPOP: rps=436.5 (overall: 186.3) avg_msec=25.821 (overall: 53.410) LPOP: rps=4.0 (overall: 178.7) avg_msec=196.032 (overall: 53.543) LPOP: rps=322.7 (overall: 184.5) avg_msec=60.614 (overall: 54.037) LPOP: rps=79.7 (overall: 180.4) avg_msec=69.238 (overall: 54.295) LPOP: rps=171.3 (overall: 180.1) avg_msec=83.851 (overall: 55.335) LPOP: rps=545.8 (overall: 193.1) avg_msec=15.456 (overall: 51.315) LPOP: rps=27.9 (overall: 187.5) avg_msec=142.898 (overall: 51.784) LPOP: rps=0.0 (overall: 181.2) avg_msec=-nan (overall: 51.784) LPOP: rps=63.7 (overall: 177.4) avg_msec=378.780 (overall: 55.570) LPOP: rps=0.0 (overall: 171.9) avg_msec=-nan (overall: 55.570) LPOP: rps=27.8 (overall: 167.5) avg_msec=513.792 (overall: 57.879) LPOP: rps=39.8 (overall: 163.8) avg_msec=390.240 (overall: 60.255) LPOP: rps=135.5 (overall: 163.0) avg_msec=96.776 (overall: 61.121) LPOP: rps=234.1 (overall: 165.0) avg_msec=34.387 (overall: 60.064) LPOP: rps=40.0 (overall: 161.6) avg_msec=296.474 (overall: 61.638) LPOP: rps=115.5 (overall: 160.4) avg_msec=69.079 (overall: 61.779) LPOP: rps=31.9 (overall: 157.1) avg_msec=126.072 (overall: 62.113) LPOP: rps=0.0 (overall: 153.2) avg_msec=-nan (overall: 62.113) LPOP: rps=39.7 (overall: 150.4) avg_msec=538.752 (overall: 65.190) LPOP: rps=163.3 (overall: 150.7) avg_msec=88.140 (overall: 65.782) LPOP: rps=191.2 (overall: 151.7) avg_msec=62.940 (overall: 65.699) LPOP: rps=39.8 (overall: 149.1) avg_msec=115.187 (overall: 65.999) LPOP: rps=262.9 (overall: 151.6) avg_msec=57.512 (overall: 65.672) LPOP: rps=219.1 (overall: 153.1) avg_msec=36.459 (overall: 64.764) LPOP: rps=448.4 (overall: 159.4) avg_msec=26.483 (overall: 62.465) LPOP: rps=757.0 (overall: 171.9) avg_msec=10.541 (overall: 57.704) LPOP: rps=95.6 (overall: 170.3) avg_msec=98.736 (overall: 58.174) LPOP: rps=23.9 (overall: 167.4) avg_msec=201.131 (overall: 58.582) LPOP: rps=139.4 (overall: 166.8) avg_msec=125.891 (overall: 59.684) LPOP: rps=39.7 (overall: 164.4) avg_msec=198.298 (overall: 60.330) LPOP: rps=200.0 (overall: 165.0) avg_msec=60.115 (overall: 60.325) LPOP: rps=39.7 (overall: 162.7) avg_msec=139.341 (overall: 60.683) LPOP: rps=1155.4 (overall: 180.7) avg_msec=12.545 (overall: 55.092) LPOP: rps=195.2 (overall: 181.0) avg_msec=39.720 (overall: 54.796) LPOP: rps=314.7 (overall: 183.3) avg_msec=37.763 (overall: 54.284) LPOP: rps=171.3 (overall: 183.1) avg_msec=46.735 (overall: 54.162) LPOP: rps=278.9 (overall: 184.8) avg_msec=33.783 (overall: 53.641) LPOP: rps=0.0 (overall: 181.7) avg_msec=-nan (overall: 53.641) LPOP: rps=31.9 (overall: 179.2) avg_msec=449.760 (overall: 54.795) LPOP: rps=366.5 (overall: 182.3) avg_msec=43.594 (overall: 54.432) LPOP: rps=701.2 (overall: 190.5) avg_msec=17.020 (overall: 52.247) LPOP: rps=27.9 (overall: 188.0) avg_msec=97.221 (overall: 52.352) LPOP: rps=59.8 (overall: 186.0) avg_msec=222.114 (overall: 53.190) LPOP: rps=159.4 (overall: 185.6) avg_msec=99.236 (overall: 53.789) LPOP: rps=494.0 (overall: 190.2) avg_msec=16.198 (overall: 52.332) LPOP: rps=59.8 (overall: 188.3) avg_msec=197.779 (overall: 53.011) LPOP: rps=277.8 (overall: 189.6) avg_msec=28.948 (overall: 52.498) LPOP: rps=39.8 (overall: 187.4) avg_msec=196.832 (overall: 52.936) LPOP: rps=0.0 (overall: 184.8) avg_msec=-nan (overall: 52.936) LPOP: rps=99.6 (overall: 183.6) avg_msec=219.821 (overall: 54.193) LPOP: rps=19.9 (overall: 181.4) avg_msec=239.731 (overall: 54.472) LPOP: rps=159.4 (overall: 181.1) avg_msec=107.860 (overall: 55.107) LPOP: rps=31.9 (overall: 179.1) avg_msec=197.872 (overall: 55.445) LPOP: rps=47.8 (overall: 177.4) avg_msec=283.136 (overall: 56.252) LPOP: rps=39.8 (overall: 175.6) avg_msec=99.667 (overall: 56.380) LPOP: rps=190.5 (overall: 175.8) avg_msec=83.227 (overall: 56.755) LPOP: rps=474.1 (overall: 179.5) avg_msec=16.900 (overall: 55.423) LPOP: rps=39.8 (overall: 177.8) avg_msec=208.122 (overall: 55.851) LPOP: rps=8.0 (overall: 175.7) avg_msec=448.384 (overall: 56.070) LPOP: rps=211.2 (overall: 176.1) avg_msec=94.338 (overall: 56.629) LPOP: rps=362.5 (overall: 178.4) avg_msec=22.005 (overall: 55.782) LPOP: rps=231.1 (overall: 179.0) avg_msec=25.797 (overall: 55.321) LPOP: rps=31.7 (overall: 177.3) avg_msec=261.048 (overall: 55.756) LPOP: rps=852.0 (overall: 185.1) avg_msec=20.722 (overall: 53.889) LPOP: rps=761.0 (overall: 191.7) avg_msec=10.347 (overall: 51.904) LPOP: rps=386.5 (overall: 193.9) avg_msec=28.673 (overall: 51.378) LPOP: rps=7.9 (overall: 191.8) avg_msec=297.728 (overall: 51.493) LPOP: rps=71.7 (overall: 190.5) avg_msec=255.797 (overall: 52.347) LPOP: rps=131.5 (overall: 189.8) avg_msec=48.822 (overall: 52.320) LPOP: rps=39.8 (overall: 188.2) avg_msec=138.464 (overall: 52.518) LPOP: rps=31.6 (overall: 186.5) avg_msec=299.136 (overall: 52.971) LPOP: rps=23.9 (overall: 184.8) avg_msec=467.157 (overall: 53.541) LPOP: rps=31.9 (overall: 183.2) avg_msec=374.948 (overall: 54.129) LPOP: rps=79.7 (overall: 182.1) avg_msec=189.590 (overall: 54.746) LPOP: rps=0.0 (overall: 180.2) avg_msec=-nan (overall: 54.746) LPOP: rps=338.6 (overall: 181.8) avg_msec=59.141 (overall: 54.830) LPOP: rps=159.4 (overall: 181.6) avg_msec=49.353 (overall: 54.781) LPOP: rps=39.7 (overall: 180.2) avg_msec=228.589 (overall: 55.165) LPOP: rps=0.0 (overall: 178.4) avg_msec=-nan (overall: 55.165) LPOP: rps=79.1 (overall: 177.4) avg_msec=284.997 (overall: 56.177) LPOP: rps=39.8 (overall: 176.1) avg_msec=120.314 (overall: 56.318) LPOP: rps=203.2 (overall: 176.3) avg_msec=74.555 (overall: 56.519) LPOP: rps=92.0 (overall: 175.5) avg_msec=87.055 (overall: 56.671) LPOP: rps=753.0 (overall: 181.0) avg_msec=15.848 (overall: 55.070) LPOP: rps=573.7 (overall: 184.7) avg_msec=13.919 (overall: 53.876) LPOP: 186.05 requests per second, p50=0.623 msec RPOP: rps=63.5 (overall: 70.5) avg_msec=98.512 (overall: 98.512) RPOP: rps=7.9 (overall: 37.6) avg_msec=298.624 (overall: 120.747) RPOP: rps=0.0 (overall: 24.7) avg_msec=-nan (overall: 120.747) RPOP: rps=0.0 (overall: 18.3) avg_msec=-nan (overall: 120.747) RPOP: rps=0.0 (overall: 14.6) avg_msec=-nan (overall: 120.747) RPOP: rps=31.9 (overall: 17.5) avg_msec=1098.368 (overall: 421.553) RPOP: rps=91.6 (overall: 28.3) avg_msec=252.309 (overall: 342.112) RPOP: rps=211.2 (overall: 51.4) avg_msec=56.636 (overall: 193.777) RPOP: rps=39.8 (overall: 50.1) avg_msec=100.122 (overall: 185.415) RPOP: rps=936.0 (overall: 139.2) avg_msec=17.268 (overall: 71.697) RPOP: rps=824.7 (overall: 202.0) avg_msec=9.365 (overall: 48.365) RPOP: rps=1008.0 (overall: 269.7) avg_msec=11.880 (overall: 36.912) RPOP: rps=151.4 (overall: 260.6) avg_msec=46.201 (overall: 37.330) RPOP: rps=936.3 (overall: 309.2) avg_msec=13.684 (overall: 32.180) RPOP: rps=498.0 (overall: 321.8) avg_msec=15.637 (overall: 30.463) RPOP: rps=31.9 (overall: 303.6) avg_msec=196.120 (overall: 31.556) RPOP: rps=8.0 (overall: 286.1) avg_msec=395.904 (overall: 32.156) RPOP: rps=63.7 (overall: 273.7) avg_msec=287.648 (overall: 35.480) RPOP: rps=226.2 (overall: 271.2) avg_msec=53.004 (overall: 36.256) RPOP: rps=617.5 (overall: 288.6) avg_msec=19.459 (overall: 34.451) RPOP: rps=39.8 (overall: 276.7) avg_msec=95.091 (overall: 34.868) RPOP: rps=39.8 (overall: 265.9) avg_msec=218.944 (overall: 36.127) RPOP: rps=0.0 (overall: 254.3) avg_msec=-nan (overall: 36.127) RPOP: rps=0.0 (overall: 243.7) avg_msec=-nan (overall: 36.127) RPOP: rps=39.7 (overall: 235.4) avg_msec=820.890 (overall: 41.459) RPOP: rps=15.9 (overall: 227.0) avg_msec=399.168 (overall: 42.428) RPOP: rps=0.0 (overall: 218.6) avg_msec=-nan (overall: 42.428) RPOP: rps=95.2 (overall: 214.1) avg_msec=292.075 (overall: 46.422) RPOP: rps=216.0 (overall: 214.2) avg_msec=37.066 (overall: 46.097) RPOP: rps=247.0 (overall: 215.3) avg_msec=48.444 (overall: 46.187) RPOP: rps=259.0 (overall: 216.7) avg_msec=30.508 (overall: 45.581) RPOP: rps=217.4 (overall: 216.7) avg_msec=43.364 (overall: 45.511) RPOP: rps=159.4 (overall: 215.0) avg_msec=66.914 (overall: 45.993) RPOP: rps=561.8 (overall: 225.2) avg_msec=20.511 (overall: 44.119) RPOP: rps=430.3 (overall: 231.1) avg_msec=18.344 (overall: 42.744) RPOP: rps=434.3 (overall: 236.7) avg_msec=27.412 (overall: 41.961) RPOP: rps=301.6 (overall: 238.5) avg_msec=26.148 (overall: 41.417) RPOP: rps=19.9 (overall: 232.7) avg_msec=139.398 (overall: 41.638) RPOP: rps=23.9 (overall: 227.4) avg_msec=465.664 (overall: 42.784) RPOP: rps=47.8 (overall: 222.9) avg_msec=374.955 (overall: 44.569) RPOP: rps=107.1 (overall: 220.0) avg_msec=37.370 (overall: 44.483) RPOP: rps=39.8 (overall: 215.7) avg_msec=259.424 (overall: 45.430) RPOP: rps=0.0 (overall: 210.7) avg_msec=-nan (overall: 45.430) RPOP: rps=19.9 (overall: 206.4) avg_msec=699.546 (overall: 46.867) RPOP: rps=23.8 (overall: 202.3) avg_msec=548.800 (overall: 48.188) RPOP: rps=15.9 (overall: 198.2) avg_msec=699.008 (overall: 49.327) RPOP: rps=175.3 (overall: 197.7) avg_msec=102.226 (overall: 50.326) RPOP: rps=71.7 (overall: 195.1) avg_msec=126.768 (overall: 50.913) RPOP: rps=39.8 (overall: 191.9) avg_msec=299.776 (overall: 51.968) RPOP: rps=19.9 (overall: 188.5) avg_msec=200.512 (overall: 52.283) RPOP: rps=708.0 (overall: 198.6) avg_msec=22.583 (overall: 50.212) RPOP: rps=79.7 (overall: 196.3) avg_msec=49.763 (overall: 50.209) RPOP: rps=39.8 (overall: 193.4) avg_msec=218.995 (overall: 50.866) RPOP: rps=119.5 (overall: 192.0) avg_msec=127.091 (overall: 51.746) RPOP: rps=39.8 (overall: 189.2) avg_msec=218.074 (overall: 52.383) RPOP: rps=111.6 (overall: 187.9) avg_msec=92.906 (overall: 52.814) RPOP: rps=59.8 (overall: 185.6) avg_msec=167.644 (overall: 53.463) RPOP: rps=27.9 (overall: 182.9) avg_msec=196.891 (overall: 53.841) RPOP: rps=378.5 (overall: 186.2) avg_msec=45.325 (overall: 53.547) RPOP: rps=192.0 (overall: 186.3) avg_msec=37.540 (overall: 53.273) RPOP: rps=146.8 (overall: 185.7) avg_msec=59.554 (overall: 53.354) RPOP: rps=0.0 (overall: 182.7) avg_msec=-nan (overall: 53.354) RPOP: rps=63.5 (overall: 180.8) avg_msec=349.216 (overall: 55.013) RPOP: rps=0.0 (overall: 177.9) avg_msec=-nan (overall: 55.013) RPOP: rps=8.0 (overall: 175.3) avg_msec=599.808 (overall: 55.394) RPOP: rps=0.0 (overall: 172.7) avg_msec=-nan (overall: 55.394) RPOP: rps=64.0 (overall: 171.1) avg_msec=524.352 (overall: 58.006) RPOP: rps=55.8 (overall: 169.4) avg_msec=200.187 (overall: 58.695) RPOP: rps=318.7 (overall: 171.5) avg_msec=37.401 (overall: 58.121) RPOP: rps=131.5 (overall: 170.9) avg_msec=36.299 (overall: 57.881) RPOP: rps=135.5 (overall: 170.4) avg_msec=111.532 (overall: 58.482) RPOP: rps=414.3 (overall: 173.8) avg_msec=14.615 (overall: 57.028) RPOP: rps=71.7 (overall: 172.4) avg_msec=126.078 (overall: 57.422) RPOP: rps=8.0 (overall: 170.2) avg_msec=299.520 (overall: 57.575) RPOP: rps=55.6 (overall: 168.7) avg_msec=342.807 (overall: 58.834) RPOP: rps=8.0 (overall: 166.6) avg_msec=399.360 (overall: 59.049) RPOP: rps=39.8 (overall: 164.9) avg_msec=499.917 (overall: 60.434) RPOP: rps=301.6 (overall: 166.7) avg_msec=26.308 (overall: 59.638) RPOP: rps=440.5 (overall: 170.2) avg_msec=27.117 (overall: 58.567) RPOP: rps=171.3 (overall: 170.2) avg_msec=46.003 (overall: 58.409) RPOP: rps=103.6 (overall: 169.3) avg_msec=77.562 (overall: 58.554) RPOP: rps=0.0 (overall: 167.3) avg_msec=-nan (overall: 58.554) RPOP: rps=39.8 (overall: 165.7) avg_msec=498.381 (overall: 59.828) RPOP: rps=79.4 (overall: 164.7) avg_msec=150.157 (overall: 60.349) RPOP: rps=0.0 (overall: 162.8) avg_msec=-nan (overall: 60.349) RPOP: rps=27.9 (overall: 161.2) avg_msec=400.183 (overall: 61.033) RPOP: rps=31.9 (overall: 159.7) avg_msec=511.600 (overall: 62.068) RPOP: rps=8.0 (overall: 158.0) avg_msec=497.792 (overall: 62.317) RPOP: rps=39.8 (overall: 156.7) avg_msec=429.632 (overall: 63.368) RPOP: rps=23.9 (overall: 155.2) avg_msec=299.691 (overall: 63.773) RPOP: rps=8.0 (overall: 153.6) avg_msec=399.616 (overall: 63.964) RPOP: rps=31.9 (overall: 152.2) avg_msec=450.176 (overall: 64.844) RPOP: rps=63.7 (overall: 151.3) avg_msec=224.936 (overall: 65.570) RPOP: rps=39.8 (overall: 150.1) avg_msec=401.203 (overall: 66.518) RPOP: rps=432.5 (overall: 153.1) avg_msec=18.041 (overall: 65.070) RPOP: rps=172.0 (overall: 153.3) avg_msec=70.283 (overall: 65.130) RPOP: rps=71.7 (overall: 152.4) avg_msec=53.856 (overall: 65.076) RPOP: rps=39.8 (overall: 151.3) avg_msec=199.936 (overall: 65.438) RPOP: rps=398.4 (overall: 153.8) avg_msec=40.270 (overall: 64.779) RPOP: rps=75.4 (overall: 153.0) avg_msec=150.846 (overall: 65.205) RPOP: rps=0.0 (overall: 151.5) avg_msec=-nan (overall: 65.205) RPOP: rps=23.9 (overall: 150.2) avg_msec=300.331 (overall: 65.572) RPOP: rps=8.0 (overall: 148.9) avg_msec=649.984 (overall: 65.876) RPOP: rps=31.9 (overall: 147.7) avg_msec=599.856 (overall: 66.985) RPOP: rps=31.9 (overall: 146.6) avg_msec=375.136 (overall: 67.623) RPOP: rps=191.2 (overall: 147.0) avg_msec=87.368 (overall: 67.865) RPOP: rps=119.0 (overall: 146.8) avg_msec=66.527 (overall: 67.855) RPOP: rps=91.6 (overall: 146.3) avg_msec=100.335 (overall: 68.044) RPOP: rps=27.9 (overall: 145.2) avg_msec=226.807 (overall: 68.324) RPOP: rps=239.0 (overall: 146.0) avg_msec=52.167 (overall: 68.083) RPOP: rps=80.0 (overall: 145.4) avg_msec=149.721 (overall: 68.486) RPOP: rps=39.7 (overall: 144.5) avg_msec=216.666 (overall: 68.851) RPOP: rps=0.0 (overall: 143.2) avg_msec=-nan (overall: 68.851) RPOP: rps=358.6 (overall: 145.1) avg_msec=64.478 (overall: 68.756) RPOP: rps=365.1 (overall: 147.0) avg_msec=21.764 (overall: 67.737) RPOP: rps=99.6 (overall: 146.6) avg_msec=119.631 (overall: 68.041) RPOP: rps=24.0 (overall: 145.6) avg_msec=99.787 (overall: 68.086) RPOP: rps=167.3 (overall: 145.8) avg_msec=104.999 (overall: 68.445) RPOP: rps=59.8 (overall: 145.0) avg_msec=98.507 (overall: 68.549) RPOP: rps=75.4 (overall: 144.5) avg_msec=89.446 (overall: 68.640) RPOP: rps=39.8 (overall: 143.6) avg_msec=320.269 (overall: 69.218) RPOP: rps=0.0 (overall: 142.4) avg_msec=-nan (overall: 69.218) RPOP: rps=35.9 (overall: 141.6) avg_msec=499.300 (overall: 70.104) RPOP: rps=4.0 (overall: 140.4) avg_msec=700.160 (overall: 70.248) RPOP: rps=0.0 (overall: 139.3) avg_msec=-nan (overall: 70.248) RPOP: rps=39.7 (overall: 138.5) avg_msec=670.861 (overall: 71.620) RPOP: rps=19.9 (overall: 137.6) avg_msec=398.925 (overall: 71.993) RPOP: rps=8.0 (overall: 136.6) avg_msec=499.584 (overall: 72.188) RPOP: rps=31.9 (overall: 135.8) avg_msec=537.520 (overall: 73.035) RPOP: rps=63.7 (overall: 135.2) avg_msec=212.939 (overall: 73.543) RPOP: rps=87.6 (overall: 134.8) avg_msec=136.666 (overall: 73.856) RPOP: rps=79.7 (overall: 134.4) avg_msec=59.245 (overall: 73.790) RPOP: rps=19.9 (overall: 133.6) avg_msec=359.450 (overall: 74.111) RPOP: rps=215.1 (overall: 134.2) avg_msec=93.134 (overall: 74.339) RPOP: rps=31.9 (overall: 133.4) avg_msec=96.360 (overall: 74.378) RPOP: rps=47.8 (overall: 132.8) avg_msec=349.344 (overall: 75.106) RPOP: rps=0.0 (overall: 131.8) avg_msec=-nan (overall: 75.106) RPOP: rps=79.7 (overall: 131.4) avg_msec=199.878 (overall: 75.654) RPOP: rps=298.8 (overall: 132.6) avg_msec=40.310 (overall: 75.081) RPOP: rps=79.7 (overall: 132.3) avg_msec=148.317 (overall: 75.396) RPOP: rps=0.0 (overall: 131.3) avg_msec=-nan (overall: 75.396) RPOP: rps=31.9 (overall: 130.6) avg_msec=499.616 (overall: 76.126) RPOP: rps=8.0 (overall: 129.8) avg_msec=699.648 (overall: 76.393) RPOP: rps=0.0 (overall: 128.9) avg_msec=-nan (overall: 76.393) RPOP: rps=39.8 (overall: 128.3) avg_msec=680.013 (overall: 77.687) RPOP: rps=43.8 (overall: 127.7) avg_msec=254.789 (overall: 78.104) RPOP: rps=140.0 (overall: 127.8) avg_msec=79.890 (overall: 78.117) RPOP: rps=59.5 (overall: 127.3) avg_msec=147.364 (overall: 78.337) RPOP: rps=308.0 (overall: 128.5) avg_msec=38.771 (overall: 77.702) RPOP: rps=31.9 (overall: 127.9) avg_msec=199.648 (overall: 77.905) RPOP: rps=75.7 (overall: 127.5) avg_msec=137.488 (overall: 78.140) RPOP: rps=191.2 (overall: 127.9) avg_msec=58.613 (overall: 77.947) RPOP: rps=48.0 (overall: 127.4) avg_msec=138.840 (overall: 78.097) RPOP: rps=11.9 (overall: 126.7) avg_msec=299.904 (overall: 78.233) RPOP: rps=392.0 (overall: 128.4) avg_msec=55.105 (overall: 77.779) RPOP: 128.28 requests per second, p50=0.687 msec SADD: rps=111.6 (overall: 201.4) avg_msec=27.863 (overall: 27.863) SADD: rps=31.7 (overall: 92.1) avg_msec=221.360 (overall: 70.862) SADD: rps=8.0 (overall: 59.2) avg_msec=396.416 (overall: 87.996) SADD: rps=115.5 (overall: 75.0) avg_msec=137.987 (overall: 109.634) SADD: rps=19.9 (overall: 62.9) avg_msec=359.040 (overall: 126.954) SADD: rps=19.9 (overall: 55.2) avg_msec=422.477 (overall: 146.144) SADD: rps=79.4 (overall: 58.9) avg_msec=199.108 (overall: 157.064) SADD: rps=79.7 (overall: 61.6) avg_msec=75.108 (overall: 143.055) SADD: rps=0.0 (overall: 54.5) avg_msec=-nan (overall: 143.055) SADD: rps=0.0 (overall: 48.8) avg_msec=-nan (overall: 143.055) SADD: rps=0.0 (overall: 44.2) avg_msec=-nan (overall: 143.055) SADD: rps=35.9 (overall: 43.4) avg_msec=1020.388 (overall: 205.721) SADD: rps=79.7 (overall: 46.3) avg_msec=190.731 (overall: 203.668) SADD: rps=39.8 (overall: 45.8) avg_msec=398.157 (overall: 216.135) SADD: rps=79.4 (overall: 48.2) avg_msec=51.592 (overall: 197.437) SADD: rps=27.9 (overall: 46.9) avg_msec=325.650 (overall: 202.341) SADD: rps=12.0 (overall: 44.7) avg_msec=496.341 (overall: 207.083) SADD: rps=39.8 (overall: 44.5) avg_msec=519.744 (overall: 223.035) SADD: rps=39.8 (overall: 44.2) avg_msec=129.795 (overall: 218.509) SADD: rps=79.7 (overall: 46.0) avg_msec=185.021 (overall: 215.545) SADD: rps=139.4 (overall: 50.6) avg_msec=56.970 (overall: 194.281) SADD: rps=179.3 (overall: 56.5) avg_msec=66.882 (overall: 175.546) SADD: rps=134.9 (overall: 60.0) avg_msec=58.501 (overall: 163.841) SADD: rps=159.4 (overall: 64.2) avg_msec=74.913 (overall: 154.480) SADD: rps=107.6 (overall: 66.0) avg_msec=62.897 (overall: 148.405) SADD: rps=99.6 (overall: 67.3) avg_msec=131.881 (overall: 147.449) SADD: rps=282.9 (overall: 75.4) avg_msec=28.253 (overall: 130.624) SADD: rps=350.6 (overall: 85.4) avg_msec=34.016 (overall: 116.239) SADD: rps=127.5 (overall: 86.9) avg_msec=62.190 (overall: 113.463) SADD: rps=358.6 (overall: 96.1) avg_msec=33.391 (overall: 103.355) SADD: rps=223.1 (overall: 100.2) avg_msec=35.451 (overall: 98.411) SADD: rps=1075.7 (overall: 131.1) avg_msec=10.996 (overall: 75.694) SADD: rps=347.8 (overall: 137.8) avg_msec=33.885 (overall: 72.430) SADD: rps=374.5 (overall: 144.9) avg_msec=21.386 (overall: 68.500) SADD: rps=661.4 (overall: 159.8) avg_msec=16.722 (overall: 62.303) SADD: rps=8.0 (overall: 155.6) avg_msec=196.992 (overall: 62.497) SADD: rps=19.9 (overall: 151.9) avg_msec=501.171 (overall: 64.071) SADD: rps=8.0 (overall: 148.0) avg_msec=497.536 (overall: 64.692) SADD: rps=35.9 (overall: 145.1) avg_msec=577.650 (overall: 67.977) SADD: rps=4.0 (overall: 141.5) avg_msec=598.272 (overall: 68.355) SADD: rps=0.0 (overall: 138.1) avg_msec=-nan (overall: 68.355) SADD: rps=32.0 (overall: 135.5) avg_msec=737.152 (overall: 72.138) SADD: rps=8.0 (overall: 132.5) avg_msec=898.816 (overall: 73.306) SADD: rps=39.8 (overall: 130.4) avg_msec=399.795 (overall: 75.596) SADD: rps=356.0 (overall: 135.4) avg_msec=43.008 (overall: 73.681) SADD: rps=278.9 (overall: 138.6) avg_msec=28.026 (overall: 71.665) SADD: rps=537.8 (overall: 147.2) avg_msec=22.399 (overall: 67.798) SADD: rps=617.5 (overall: 157.0) avg_msec=12.798 (overall: 63.251) SADD: rps=458.2 (overall: 163.2) avg_msec=25.967 (overall: 61.097) SADD: rps=155.4 (overall: 163.1) avg_msec=50.856 (overall: 60.900) SADD: rps=510.0 (overall: 169.9) avg_msec=23.665 (overall: 58.690) SADD: rps=456.3 (overall: 175.5) avg_msec=17.029 (overall: 56.582) SADD: rps=259.0 (overall: 177.1) avg_msec=45.906 (overall: 56.285) SADD: rps=79.7 (overall: 175.3) avg_msec=74.835 (overall: 56.442) SADD: rps=450.2 (overall: 180.3) avg_msec=30.988 (overall: 55.278) SADD: rps=39.8 (overall: 177.8) avg_msec=98.246 (overall: 55.451) SADD: rps=0.0 (overall: 174.7) avg_msec=-nan (overall: 55.451) SADD: rps=31.9 (overall: 172.2) avg_msec=524.800 (overall: 56.960) SADD: rps=31.9 (overall: 169.8) avg_msec=474.528 (overall: 58.298) SADD: rps=79.7 (overall: 168.3) avg_msec=150.246 (overall: 59.029) SADD: rps=800.8 (overall: 178.7) avg_msec=15.067 (overall: 55.777) SADD: rps=1027.9 (overall: 192.5) avg_msec=7.792 (overall: 51.616) SADD: rps=390.4 (overall: 195.7) avg_msec=21.618 (overall: 50.659) SADD: rps=0.0 (overall: 192.6) avg_msec=-nan (overall: 50.659) SADD: rps=39.7 (overall: 190.2) avg_msec=399.232 (overall: 51.790) SADD: rps=79.7 (overall: 188.5) avg_msec=190.547 (overall: 52.684) SADD: rps=105.5 (overall: 187.3) avg_msec=36.972 (overall: 52.548) SADD: rps=39.8 (overall: 185.1) avg_msec=338.381 (overall: 53.459) SADD: rps=79.7 (overall: 183.6) avg_msec=145.064 (overall: 54.039) SADD: rps=199.2 (overall: 183.8) avg_msec=54.245 (overall: 54.042) SADD: rps=390.4 (overall: 186.7) avg_msec=30.462 (overall: 53.343) SADD: rps=244.0 (overall: 187.5) avg_msec=33.137 (overall: 52.977) SADD: rps=55.8 (overall: 185.7) avg_msec=211.493 (overall: 53.633) SADD: rps=650.8 (overall: 192.0) avg_msec=12.402 (overall: 51.727) SADD: rps=286.9 (overall: 193.3) avg_msec=40.951 (overall: 51.513) SADD: rps=39.8 (overall: 191.3) avg_msec=120.090 (overall: 51.702) SADD: rps=0.0 (overall: 188.8) avg_msec=-nan (overall: 51.702) SADD: rps=0.0 (overall: 186.4) avg_msec=-nan (overall: 51.702) SADD: rps=39.8 (overall: 184.5) avg_msec=829.798 (overall: 53.840) SADD: rps=0.0 (overall: 182.2) avg_msec=-nan (overall: 53.840) SADD: rps=107.6 (overall: 181.3) avg_msec=203.882 (overall: 54.945) SADD: rps=345.2 (overall: 183.3) avg_msec=27.531 (overall: 54.309) SADD: rps=0.0 (overall: 181.1) avg_msec=-nan (overall: 54.309) SADD: rps=39.8 (overall: 179.4) avg_msec=488.051 (overall: 55.462) SADD: rps=39.8 (overall: 177.7) avg_msec=270.189 (overall: 56.031) SADD: rps=848.6 (overall: 185.6) avg_msec=14.289 (overall: 53.800) SADD: rps=848.6 (overall: 193.2) avg_msec=8.945 (overall: 51.525) SADD: rps=849.2 (overall: 200.7) avg_msec=13.883 (overall: 49.700) SADD: rps=199.2 (overall: 200.7) avg_msec=40.455 (overall: 49.596) SADD: rps=648.0 (overall: 205.7) avg_msec=18.552 (overall: 48.509) SADD: rps=515.9 (overall: 209.1) avg_msec=15.280 (overall: 47.600) SADD: rps=745.0 (overall: 215.0) avg_msec=15.779 (overall: 46.396) SADD: rps=119.5 (overall: 213.9) avg_msec=66.855 (overall: 46.520) SADD: 214.80 requests per second, p50=0.559 msec HSET: rps=332.0 (overall: 434.6) avg_msec=21.511 (overall: 21.511) HSET: rps=259.0 (overall: 334.8) avg_msec=30.681 (overall: 25.539) HSET: rps=71.4 (overall: 239.2) avg_msec=109.493 (overall: 34.642) HSET: rps=0.0 (overall: 175.7) avg_msec=-nan (overall: 34.642) HSET: rps=23.9 (overall: 143.8) avg_msec=549.803 (overall: 52.613) HSET: rps=8.0 (overall: 120.2) avg_msec=747.776 (overall: 60.603) HSET: rps=31.9 (overall: 107.2) avg_msec=549.888 (overall: 82.110) HSET: rps=40.0 (overall: 98.6) avg_msec=379.878 (overall: 97.619) HSET: rps=67.7 (overall: 95.0) avg_msec=141.026 (overall: 101.150) HSET: rps=0.0 (overall: 85.3) avg_msec=-nan (overall: 101.150) HSET: rps=139.4 (overall: 90.3) avg_msec=160.157 (overall: 109.614) HSET: rps=119.0 (overall: 92.8) avg_msec=66.705 (overall: 104.916) HSET: rps=147.4 (overall: 97.1) avg_msec=61.988 (overall: 99.809) HSET: rps=139.4 (overall: 100.1) avg_msec=76.999 (overall: 97.501) HSET: rps=960.2 (overall: 158.4) avg_msec=12.399 (overall: 62.562) HSET: rps=1000.0 (overall: 211.8) avg_msec=8.182 (overall: 46.274) HSET: rps=340.0 (overall: 219.4) avg_msec=34.679 (overall: 45.206) HSET: rps=151.4 (overall: 215.6) avg_msec=46.553 (overall: 45.259) HSET: rps=47.8 (overall: 206.6) avg_msec=266.059 (overall: 47.982) HSET: rps=0.0 (overall: 196.2) avg_msec=-nan (overall: 47.982) HSET: rps=103.6 (overall: 191.7) avg_msec=192.168 (overall: 51.735) HSET: rps=187.3 (overall: 191.5) avg_msec=38.046 (overall: 51.120) HSET: rps=47.8 (overall: 185.2) avg_msec=267.552 (overall: 53.575) HSET: rps=39.7 (overall: 179.0) avg_msec=97.862 (overall: 53.989) HSET: rps=27.8 (overall: 172.9) avg_msec=356.882 (overall: 55.962) HSET: rps=71.7 (overall: 169.0) avg_msec=183.669 (overall: 58.065) HSET: rps=79.4 (overall: 165.6) avg_msec=119.402 (overall: 59.167) HSET: rps=215.1 (overall: 167.4) avg_msec=52.255 (overall: 58.847) HSET: rps=282.9 (overall: 171.4) avg_msec=32.076 (overall: 57.312) HSET: rps=27.9 (overall: 166.6) avg_msec=270.409 (overall: 58.510) HSET: rps=47.8 (overall: 162.7) avg_msec=316.917 (overall: 60.977) HSET: rps=111.6 (overall: 161.1) avg_msec=63.945 (overall: 61.042) HSET: rps=87.6 (overall: 158.9) avg_msec=145.964 (overall: 62.471) HSET: rps=79.7 (overall: 156.5) avg_msec=50.775 (overall: 62.295) HSET: rps=239.0 (overall: 158.9) avg_msec=66.291 (overall: 62.468) HSET: rps=964.0 (overall: 181.3) avg_msec=12.346 (overall: 55.048) HSET: rps=350.6 (overall: 185.9) avg_msec=22.550 (overall: 53.381) HSET: rps=940.5 (overall: 206.0) avg_msec=12.656 (overall: 48.439) HSET: rps=219.1 (overall: 206.3) avg_msec=36.277 (overall: 48.106) HSET: rps=63.7 (overall: 202.7) avg_msec=185.144 (overall: 49.189) HSET: rps=0.0 (overall: 197.8) avg_msec=-nan (overall: 49.189) HSET: rps=308.0 (overall: 200.4) avg_msec=65.330 (overall: 49.781) HSET: rps=39.7 (overall: 196.6) avg_msec=116.666 (overall: 50.098) HSET: rps=0.0 (overall: 192.1) avg_msec=-nan (overall: 50.098) HSET: rps=0.0 (overall: 187.9) avg_msec=-nan (overall: 50.098) HSET: rps=354.6 (overall: 191.5) avg_msec=99.307 (overall: 52.089) HSET: rps=294.8 (overall: 193.7) avg_msec=26.404 (overall: 51.253) HSET: rps=282.9 (overall: 195.6) avg_msec=42.134 (overall: 50.977) HSET: rps=79.7 (overall: 193.2) avg_msec=99.304 (overall: 51.385) HSET: rps=482.1 (overall: 199.0) avg_msec=24.831 (overall: 50.093) HSET: rps=436.5 (overall: 203.7) avg_msec=18.283 (overall: 48.745) HSET: rps=414.3 (overall: 207.8) avg_msec=26.676 (overall: 47.895) HSET: rps=195.2 (overall: 207.5) avg_msec=24.794 (overall: 47.483) HSET: rps=1248.0 (overall: 226.8) avg_msec=12.847 (overall: 43.953) HSET: rps=349.2 (overall: 229.1) avg_msec=22.232 (overall: 43.346) HSET: rps=730.2 (overall: 238.1) avg_msec=11.822 (overall: 41.605) HSET: rps=71.7 (overall: 235.1) avg_msec=154.812 (overall: 42.214) HSET: rps=571.4 (overall: 241.1) avg_msec=20.408 (overall: 41.291) HSET: rps=39.8 (overall: 237.7) avg_msec=126.544 (overall: 41.534) HSET: rps=215.1 (overall: 237.3) avg_msec=53.667 (overall: 41.718) HSET: rps=0.0 (overall: 233.4) avg_msec=-nan (overall: 41.718) HSET: rps=31.9 (overall: 230.2) avg_msec=400.352 (overall: 42.521) HSET: rps=19.9 (overall: 226.8) avg_msec=460.544 (overall: 43.106) HSET: rps=19.9 (overall: 223.6) avg_msec=598.886 (overall: 43.882) HSET: rps=8.0 (overall: 220.3) avg_msec=449.536 (overall: 44.108) HSET: rps=87.6 (overall: 218.2) avg_msec=290.675 (overall: 45.613) HSET: rps=39.8 (overall: 215.6) avg_msec=100.128 (overall: 45.764) HSET: rps=39.7 (overall: 213.0) avg_msec=219.558 (overall: 46.243) HSET: rps=0.0 (overall: 209.9) avg_msec=-nan (overall: 46.243) HSET: rps=31.9 (overall: 207.3) avg_msec=649.728 (overall: 47.572) HSET: rps=0.0 (overall: 204.4) avg_msec=-nan (overall: 47.572) HSET: rps=23.8 (overall: 201.9) avg_msec=734.080 (overall: 48.704) HSET: rps=0.0 (overall: 199.1) avg_msec=-nan (overall: 48.704) HSET: rps=63.7 (overall: 197.3) avg_msec=325.208 (overall: 49.915) HSET: rps=71.7 (overall: 195.6) avg_msec=277.230 (overall: 51.029) HSET: rps=227.1 (overall: 196.0) avg_msec=14.124 (overall: 50.465) HSET: rps=8.0 (overall: 193.6) avg_msec=294.528 (overall: 50.595) HSET: rps=490.0 (overall: 197.4) avg_msec=45.689 (overall: 50.439) HSET: rps=940.0 (overall: 206.8) avg_msec=12.655 (overall: 48.268) HSET: rps=694.4 (overall: 212.9) avg_msec=11.493 (overall: 46.759) HSET: rps=800.8 (overall: 220.2) avg_msec=14.872 (overall: 45.324) HSET: rps=107.6 (overall: 218.8) avg_msec=73.015 (overall: 45.490) HSET: rps=103.6 (overall: 217.4) avg_msec=76.622 (overall: 45.669) HSET: rps=8.0 (overall: 214.9) avg_msec=200.704 (overall: 45.738) HSET: rps=0.0 (overall: 212.4) avg_msec=-nan (overall: 45.738) HSET: rps=19.9 (overall: 210.1) avg_msec=799.386 (overall: 46.570) HSET: rps=31.9 (overall: 208.1) avg_msec=637.680 (overall: 47.613) HSET: rps=140.0 (overall: 207.3) avg_msec=99.951 (overall: 48.014) HSET: rps=39.8 (overall: 205.4) avg_msec=219.405 (overall: 48.389) HSET: rps=362.2 (overall: 207.2) avg_msec=30.527 (overall: 48.037) HSET: rps=749.0 (overall: 213.2) avg_msec=16.003 (overall: 46.797) HSET: rps=31.9 (overall: 211.2) avg_msec=172.136 (overall: 47.003) HSET: rps=8.0 (overall: 209.0) avg_msec=396.032 (overall: 47.147) HSET: rps=183.3 (overall: 208.7) avg_msec=104.706 (overall: 47.686) HSET: rps=111.6 (overall: 207.7) avg_msec=106.460 (overall: 48.018) HSET: 208.52 requests per second, p50=0.599 msec SPOP: rps=0.0 (overall: 0.0) avg_msec=-nan (overall: -nan) SPOP: rps=1386.5 (overall: 1175.7) avg_msec=7.803 (overall: 7.803) SPOP: rps=761.9 (overall: 985.4) avg_msec=10.623 (overall: 8.805) SPOP: rps=1302.8 (overall: 1085.1) avg_msec=9.088 (overall: 8.912) SPOP: rps=192.0 (overall: 872.3) avg_msec=40.469 (overall: 10.567) SPOP: rps=1075.4 (overall: 911.6) avg_msec=10.904 (overall: 10.644) SPOP: rps=27.9 (overall: 768.7) avg_msec=100.777 (overall: 11.173) SPOP: rps=0.0 (overall: 661.7) avg_msec=-nan (overall: 11.173) SPOP: rps=12.0 (overall: 582.3) avg_msec=699.136 (overall: 12.899) SPOP: rps=31.7 (overall: 522.1) avg_msec=747.816 (overall: 17.782) SPOP: rps=31.7 (overall: 473.8) avg_msec=299.296 (overall: 19.640) SPOP: rps=0.0 (overall: 431.6) avg_msec=-nan (overall: 19.640) SPOP: rps=0.0 (overall: 396.2) avg_msec=-nan (overall: 19.640) SPOP: rps=95.2 (overall: 373.3) avg_msec=358.539 (overall: 26.221) SPOP: rps=8.0 (overall: 347.6) avg_msec=199.296 (overall: 26.500) SPOP: rps=87.6 (overall: 330.4) avg_msec=186.213 (overall: 29.289) SPOP: rps=0.0 (overall: 310.1) avg_msec=-nan (overall: 29.289) SPOP: rps=39.7 (overall: 294.3) avg_msec=489.677 (overall: 32.914) SPOP: rps=0.0 (overall: 278.2) avg_msec=-nan (overall: 32.914) SPOP: rps=123.0 (overall: 270.1) avg_msec=187.482 (overall: 36.597) SPOP: rps=227.1 (overall: 268.0) avg_msec=35.090 (overall: 36.534) SPOP: rps=1147.4 (overall: 309.5) avg_msec=10.450 (overall: 31.970) SPOP: rps=294.8 (overall: 308.8) avg_msec=26.588 (overall: 31.738) SPOP: rps=79.7 (overall: 298.9) avg_msec=108.733 (overall: 32.623) SPOP: rps=31.9 (overall: 287.9) avg_msec=224.176 (overall: 33.500) SPOP: rps=31.9 (overall: 277.7) avg_msec=400.064 (overall: 35.170) SPOP: rps=207.2 (overall: 275.0) avg_msec=73.126 (overall: 36.262) SPOP: rps=39.8 (overall: 266.4) avg_msec=99.347 (overall: 36.609) SPOP: rps=31.7 (overall: 258.0) avg_msec=399.712 (overall: 38.199) SPOP: rps=71.7 (overall: 251.6) avg_msec=155.764 (overall: 39.347) SPOP: rps=55.8 (overall: 245.2) avg_msec=214.414 (overall: 40.666) SPOP: rps=79.7 (overall: 239.8) avg_msec=75.229 (overall: 41.034) SPOP: rps=669.3 (overall: 253.2) avg_msec=21.020 (overall: 39.391) SPOP: rps=1446.2 (overall: 289.1) avg_msec=5.387 (overall: 34.267) SPOP: rps=1697.2 (overall: 330.3) avg_msec=6.932 (overall: 30.160) SPOP: rps=980.1 (overall: 348.8) avg_msec=7.830 (overall: 28.377) SPOP: rps=192.0 (overall: 344.5) avg_msec=61.670 (overall: 28.887) SPOP: rps=107.6 (overall: 338.1) avg_msec=74.091 (overall: 29.274) SPOP: rps=589.6 (overall: 344.7) avg_msec=20.433 (overall: 28.878) SPOP: rps=776.9 (overall: 355.7) avg_msec=10.024 (overall: 27.827) SPOP: rps=199.2 (overall: 351.8) avg_msec=52.147 (overall: 28.170) SPOP: rps=8.0 (overall: 343.5) avg_msec=295.680 (overall: 28.321) SPOP: rps=83.7 (overall: 337.3) avg_msec=228.531 (overall: 29.498) SPOP: rps=27.9 (overall: 330.1) avg_msec=100.027 (overall: 29.636) SPOP: rps=31.9 (overall: 323.4) avg_msec=262.000 (overall: 30.154) SPOP: rps=318.7 (overall: 323.3) avg_msec=52.579 (overall: 30.643) SPOP: rps=39.8 (overall: 317.1) avg_msec=98.387 (overall: 30.827) SPOP: rps=79.7 (overall: 312.1) avg_msec=199.571 (overall: 31.740) SPOP: rps=39.8 (overall: 306.5) avg_msec=200.141 (overall: 32.194) SPOP: rps=0.0 (overall: 300.2) avg_msec=-nan (overall: 32.194) SPOP: rps=0.0 (overall: 294.3) avg_msec=-nan (overall: 32.194) SPOP: rps=0.0 (overall: 288.5) avg_msec=-nan (overall: 32.194) SPOP: rps=39.7 (overall: 283.7) avg_msec=919.603 (overall: 34.582) SPOP: rps=39.8 (overall: 279.2) avg_msec=280.486 (overall: 35.242) SPOP: rps=79.7 (overall: 275.5) avg_msec=151.280 (overall: 35.861) SPOP: rps=0.0 (overall: 270.5) avg_msec=-nan (overall: 35.861) SPOP: rps=39.7 (overall: 266.4) avg_msec=517.171 (overall: 37.142) SPOP: rps=0.0 (overall: 261.7) avg_msec=-nan (overall: 37.142) SPOP: rps=31.7 (overall: 257.8) avg_msec=448.928 (overall: 38.017) SPOP: rps=12.0 (overall: 253.6) avg_msec=500.053 (overall: 38.385) SPOP: rps=12.0 (overall: 249.6) avg_msec=599.893 (overall: 38.832) SPOP: rps=0.0 (overall: 245.5) avg_msec=-nan (overall: 38.832) SPOP: rps=111.1 (overall: 243.4) avg_msec=304.234 (overall: 40.788) SPOP: rps=71.4 (overall: 240.6) avg_msec=132.701 (overall: 41.221) SPOP: rps=148.0 (overall: 239.2) avg_msec=80.722 (overall: 41.600) SPOP: rps=75.7 (overall: 236.7) avg_msec=99.832 (overall: 41.886) SPOP: rps=175.3 (overall: 235.8) avg_msec=65.843 (overall: 42.155) SPOP: rps=8.0 (overall: 232.4) avg_msec=199.424 (overall: 42.236) SPOP: rps=0.0 (overall: 229.0) avg_msec=-nan (overall: 42.236) SPOP: rps=111.6 (overall: 227.3) avg_msec=235.604 (overall: 43.607) SPOP: rps=426.3 (overall: 230.1) avg_msec=29.824 (overall: 43.243) SPOP: rps=79.7 (overall: 228.0) avg_msec=100.170 (overall: 43.523) SPOP: rps=613.5 (overall: 233.3) avg_msec=15.768 (overall: 42.512) SPOP: rps=83.3 (overall: 231.3) avg_msec=164.774 (overall: 43.116) SPOP: rps=216.0 (overall: 231.1) avg_msec=34.894 (overall: 43.013) SPOP: rps=147.4 (overall: 229.9) avg_msec=67.772 (overall: 43.224) SPOP: rps=462.2 (overall: 233.0) avg_msec=23.567 (overall: 42.712) SPOP: rps=1753.0 (overall: 252.7) avg_msec=6.603 (overall: 39.467) SPOP: 256.77 requests per second, p50=0.519 msec ------------------------------------------------------------------------------------------------------------------ `kubectl delete pod benchtest-redis-ljzvzz --force --namespace ns-jcjpx ` Warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely. pod "benchtest-redis-ljzvzz" force deleted `kubectl get secrets -l app.kubernetes.io/instance=redis-ljzvzz` set secret: redis-ljzvzz-redis-account-default `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.username***"` `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.password***"` `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.port***"` DB_USERNAME_PROXY:;DB_PASSWORD_PROXY:;DB_PORT_PROXY:26379 DB_USERNAME:default;DB_PASSWORD:gu97Tl5m13;DB_PORT:6379;DB_DATABASE:db0 apiVersion: v1 kind: Pod metadata: name: benchtest-redis-ljzvzz namespace: ns-jcjpx spec: containers: - name: test-benchmark imagePullPolicy: IfNotPresent image: docker.io/apecloud/redis-benchmark:latest args: - "-h" - "redis-ljzvzz-redis-twemproxy-twemproxy.ns-jcjpx.svc.cluster.local" - "-p" - "22121" - "-a" - "gu97Tl5m13" - "-n" - "5000" - "-c" - "10" - "-t" - "PING_MBULK,SET,GET,INCR,LPUSH,RPUSH,LPOP,RPOP,SADD,HSET,SPOP,ZADD,ZPOPMIN,LRANGE_100,LRANGE_300,LRANGE_500,LRANGE_600,MSET" - "-q" restartPolicy: Never `kubectl apply -f benchtest-redis-ljzvzz.yaml` pod/benchtest-redis-ljzvzz created apply benchtest-redis-ljzvzz.yaml Success `rm -rf benchtest-redis-ljzvzz.yaml` check pod status pod_status:NAME READY STATUS RESTARTS AGE benchtest-redis-ljzvzz 0/1 ContainerCreating 0 1s pod_status:NAME READY STATUS RESTARTS AGE benchtest-redis-ljzvzz 0/1 ContainerCreating 0 6s pod_status:NAME READY STATUS RESTARTS AGE benchtest-redis-ljzvzz 1/1 Running 0 11s pod_status:NAME READY STATUS RESTARTS AGE benchtest-redis-ljzvzz 1/1 Running 0 17s pod_status:NAME READY STATUS RESTARTS AGE benchtest-redis-ljzvzz 1/1 Running 0 23s pod_status:NAME READY STATUS RESTARTS AGE benchtest-redis-ljzvzz 1/1 Running 0 29s pod_status:NAME READY STATUS RESTARTS AGE benchtest-redis-ljzvzz 1/1 Running 0 35s pod_status:NAME READY STATUS RESTARTS AGE benchtest-redis-ljzvzz 1/1 Running 0 40s pod_status:NAME READY STATUS RESTARTS AGE benchtest-redis-ljzvzz 1/1 Running 0 46s pod_status:NAME READY STATUS RESTARTS AGE benchtest-redis-ljzvzz 1/1 Running 0 52s check pod benchtest-redis-ljzvzz status done pod_status:NAME READY STATUS RESTARTS AGE benchtest-redis-ljzvzz 0/1 Completed 0 58s `kubectl logs benchtest-redis-ljzvzz --tail 30 --namespace ns-jcjpx ` WARNING: Could not fetch server CONFIG PING_MBULK: rps=0.0 (overall: -nan) avg_msec=-nan (overall: -nan) PING_MBULK: rps=7214.3 (overall: 7214.3) avg_msec=1.065 (overall: 1.065) PING_MBULK: rps=6172.0 (overall: 6695.2) avg_msec=1.817 (overall: 1.410) PING_MBULK: rps=6316.0 (overall: 6569.1) avg_msec=1.278 (overall: 1.368) PING_MBULK: 6281.41 requests per second, p50=0.303 msec SET: rps=2071.7 (overall: 2841.5) avg_msec=3.408 (overall: 3.408) SET: rps=2333.3 (overall: 2547.1) avg_msec=3.670 (overall: 3.547) SET: rps=2560.0 (overall: 2551.8) avg_msec=4.393 (overall: 3.856) SET: rps=2345.2 (overall: 2496.3) avg_msec=3.657 (overall: 3.806) SET: rps=2296.0 (overall: 2454.1) avg_msec=4.835 (overall: 4.009) SET: rps=2725.1 (overall: 2501.4) avg_msec=3.141 (overall: 3.844) SET: rps=2617.5 (overall: 2518.7) avg_msec=4.247 (overall: 3.906) SET: rps=2648.0 (overall: 2535.3) avg_msec=3.149 (overall: 3.804) SET: 2523.98 requests per second, p50=0.823 msec GET: rps=2820.7 (overall: 3933.3) avg_msec=2.459 (overall: 2.459) GET: rps=2565.7 (overall: 3136.9) avg_msec=3.442 (overall: 2.928) GET: rps=2104.0 (overall: 2757.7) avg_msec=5.144 (overall: 3.548) GET: rps=2577.7 (overall: 2709.2) avg_msec=3.176 (overall: 3.453) GET: rps=2940.2 (overall: 2758.2) avg_msec=3.767 (overall: 3.524) GET: rps=2083.7 (overall: 2640.2) avg_msec=3.656 (overall: 3.542) GET: rps=3432.0 (overall: 2757.7) avg_msec=3.509 (overall: 3.536) GET: 2807.41 requests per second, p50=0.759 msec INCR: rps=1206.3 (overall: 2393.7) avg_msec=2.255 (overall: 2.255) INCR: rps=2158.7 (overall: 2237.5) avg_msec=5.545 (overall: 4.366) INCR: rps=1581.7 (overall: 1976.2) avg_msec=4.667 (overall: 4.462) INCR: rps=2816.7 (overall: 2215.7) avg_msec=4.359 (overall: 4.425) INCR: rps=2375.5 (overall: 2251.3) avg_msec=3.318 (overall: 4.164) INCR: rps=2430.3 (overall: 2283.8) avg_msec=4.582 (overall: 4.245) INCR: rps=1832.7 (overall: 2214.5) avg_msec=4.675 (overall: 4.299) INCR: rps=2055.8 (overall: 2193.4) avg_msec=5.680 (overall: 4.471) INCR: rps=1545.8 (overall: 2117.4) avg_msec=4.994 (overall: 4.516) INCR: 2193.94 requests per second, p50=0.799 msec LPUSH: rps=1187.3 (overall: 3547.6) avg_msec=2.305 (overall: 2.305) LPUSH: rps=1992.1 (overall: 2381.0) avg_msec=4.026 (overall: 3.385) LPUSH: rps=418.3 (overall: 1541.7) avg_msec=26.808 (overall: 6.103) LPUSH: rps=1749.0 (overall: 1603.8) avg_msec=4.828 (overall: 5.686) LPUSH: rps=2864.5 (overall: 1894.4) avg_msec=4.157 (overall: 5.153) LPUSH: rps=1305.6 (overall: 1783.7) avg_msec=6.280 (overall: 5.308) LPUSH: rps=1342.6 (overall: 1714.2) avg_msec=8.041 (overall: 5.646) LPUSH: rps=1613.5 (overall: 1700.5) avg_msec=5.299 (overall: 5.601) LPUSH: rps=2649.4 (overall: 1814.2) avg_msec=4.388 (overall: 5.389) LPUSH: rps=1697.2 (overall: 1801.7) avg_msec=4.604 (overall: 5.310) LPUSH: rps=2223.1 (overall: 1842.4) avg_msec=5.334 (overall: 5.312) LPUSH: 1871.26 requests per second, p50=0.783 msec RPUSH: rps=1000.0 (overall: 1695.9) avg_msec=2.876 (overall: 2.876) RPUSH: rps=2936.3 (overall: 2476.2) avg_msec=4.032 (overall: 3.738) RPUSH: rps=1525.9 (overall: 2109.2) avg_msec=5.216 (overall: 4.151) RPUSH: rps=2310.8 (overall: 2165.4) avg_msec=5.088 (overall: 4.429) RPUSH: rps=1848.6 (overall: 2096.4) avg_msec=4.252 (overall: 4.395) RPUSH: rps=2438.2 (overall: 2157.5) avg_msec=4.692 (overall: 4.455) RPUSH: rps=1908.4 (overall: 2119.7) avg_msec=4.115 (overall: 4.409) RPUSH: rps=2908.4 (overall: 2223.6) avg_msec=4.083 (overall: 4.353) RPUSH: rps=207.2 (overall: 1988.9) avg_msec=53.737 (overall: 4.951) RPUSH: rps=2354.6 (overall: 2027.0) avg_msec=3.592 (overall: 4.787) RPUSH: 2029.22 requests per second, p50=0.735 msec LPOP: rps=1486.1 (overall: 2247.0) avg_msec=4.332 (overall: 4.332) LPOP: rps=3147.4 (overall: 2789.0) avg_msec=2.665 (overall: 3.199) LPOP: rps=2350.6 (overall: 2624.3) avg_msec=4.804 (overall: 3.739) LPOP: rps=2745.0 (overall: 2657.2) avg_msec=3.038 (overall: 3.541) LPOP: rps=2352.0 (overall: 2592.0) avg_msec=4.843 (overall: 3.794) LPOP: rps=1000.0 (overall: 2310.6) avg_msec=7.947 (overall: 4.112) LPOP: rps=1852.0 (overall: 2241.9) avg_msec=6.412 (overall: 4.396) LPOP: rps=2537.8 (overall: 2280.6) avg_msec=3.394 (overall: 4.251) LPOP: rps=2075.7 (overall: 2256.9) avg_msec=5.328 (overall: 4.365) LPOP: 2291.48 requests per second, p50=0.711 msec RPOP: rps=2083.7 (overall: 2432.6) avg_msec=3.366 (overall: 3.366) RPOP: rps=2274.9 (overall: 2347.6) avg_msec=4.883 (overall: 4.158) RPOP: rps=2142.3 (overall: 2275.4) avg_msec=3.740 (overall: 4.020) RPOP: rps=2613.5 (overall: 2362.9) avg_msec=4.429 (overall: 4.137) RPOP: rps=2346.6 (overall: 2359.5) avg_msec=3.493 (overall: 4.005) RPOP: rps=2019.9 (overall: 2301.6) avg_msec=5.486 (overall: 4.227) RPOP: rps=1868.5 (overall: 2238.5) avg_msec=4.442 (overall: 4.253) RPOP: rps=1629.5 (overall: 2161.1) avg_msec=4.876 (overall: 4.313) RPOP: rps=159.4 (overall: 1935.3) avg_msec=70.619 (overall: 4.929) RPOP: rps=2176.0 (overall: 1959.6) avg_msec=5.785 (overall: 5.025) RPOP: 1947.04 requests per second, p50=0.743 msec SADD: rps=1912.4 (overall: 3555.6) avg_msec=1.798 (overall: 1.798) SADD: rps=3466.1 (overall: 3497.4) avg_msec=3.340 (overall: 2.792) SADD: rps=2597.6 (overall: 3142.9) avg_msec=3.043 (overall: 2.873) SADD: rps=3484.0 (overall: 3239.0) avg_msec=3.336 (overall: 3.014) SADD: rps=1231.1 (overall: 2796.1) avg_msec=6.368 (overall: 3.340) SADD: rps=3192.0 (overall: 2867.4) avg_msec=3.703 (overall: 3.413) SADD: rps=960.2 (overall: 2575.4) avg_msec=7.605 (overall: 3.652) SADD: rps=79.4 (overall: 2242.7) avg_msec=146.288 (overall: 4.325) SADD: rps=2138.3 (overall: 2230.4) avg_msec=4.217 (overall: 4.312) SADD: 2291.48 requests per second, p50=0.735 msec HSET: rps=1932.3 (overall: 2607.5) avg_msec=3.472 (overall: 3.472) HSET: rps=1912.0 (overall: 2208.7) avg_msec=4.316 (overall: 3.891) HSET: rps=2490.0 (overall: 2311.5) avg_msec=4.672 (overall: 4.198) HSET: rps=1804.0 (overall: 2176.1) avg_msec=4.591 (overall: 4.285) HSET: rps=2669.3 (overall: 2280.3) avg_msec=4.341 (overall: 4.299) HSET: rps=1796.8 (overall: 2196.0) avg_msec=4.490 (overall: 4.326) HSET: rps=2533.9 (overall: 2246.2) avg_msec=4.455 (overall: 4.348) HSET: rps=1880.5 (overall: 2198.9) avg_msec=3.978 (overall: 4.307) HSET: rps=2685.3 (overall: 2254.6) avg_msec=4.603 (overall: 4.347) HSET: 2214.35 requests per second, p50=0.839 msec SPOP: rps=2023.9 (overall: 3116.6) avg_msec=1.828 (overall: 1.828) SPOP: rps=2932.0 (overall: 3004.8) avg_msec=4.070 (overall: 3.152) SPOP: rps=2912.4 (overall: 2969.9) avg_msec=3.135 (overall: 3.146) SPOP: rps=4286.9 (overall: 3331.1) avg_msec=2.345 (overall: 2.863) SPOP: rps=2689.2 (overall: 3193.0) avg_msec=2.912 (overall: 2.872) SPOP: rps=3932.3 (overall: 3323.9) avg_msec=3.033 (overall: 2.906) SPOP: 3333.33 requests per second, p50=0.687 msec ZADD: rps=1147.4 (overall: 2028.2) avg_msec=3.224 (overall: 3.224) ZADD: rps=3629.5 (overall: 3050.9) avg_msec=2.970 (overall: 3.031) ZADD: rps=521.9 (overall: 2065.2) avg_msec=13.561 (overall: 4.068) ZADD: rps=3043.8 (overall: 2339.7) avg_msec=4.097 (overall: 4.079) ZADD: rps=2261.9 (overall: 2322.6) avg_msec=3.735 (overall: 4.005) ZADD: rps=133.9 (overall: 1925.8) avg_msec=75.356 (overall: 4.904) ZADD: rps=2450.2 (overall: 2005.4) avg_msec=4.844 (overall: 4.893) ZADD: rps=2601.6 (overall: 2084.1) avg_msec=3.078 (overall: 4.594) ZADD: rps=2728.0 (overall: 2158.8) avg_msec=4.318 (overall: 4.554) ZADD: 2217.29 requests per second, p50=0.799 msec ZPOPMIN: rps=2107.1 (overall: 4317.1) avg_msec=1.690 (overall: 1.690) ZPOPMIN: rps=2640.0 (overall: 3193.0) avg_msec=4.143 (overall: 3.050) ZPOPMIN: rps=3605.6 (overall: 3359.0) avg_msec=2.318 (overall: 2.734) ZPOPMIN: rps=2648.0 (overall: 3155.6) avg_msec=4.276 (overall: 3.104) ZPOPMIN: rps=2412.7 (overall: 2989.3) avg_msec=3.727 (overall: 3.217) ZPOPMIN: rps=2872.0 (overall: 2968.0) avg_msec=3.752 (overall: 3.311) ZPOPMIN: rps=3277.8 (overall: 3016.0) avg_msec=2.621 (overall: 3.195) ZPOPMIN: 2992.22 requests per second, p50=0.751 msec LPUSH (needed to benchmark LRANGE): rps=1824.0 (overall: 2505.5) avg_msec=3.912 (overall: 3.912) LPUSH (needed to benchmark LRANGE): rps=1948.4 (overall: 2182.0) avg_msec=4.331 (overall: 4.130) LPUSH (needed to benchmark LRANGE): rps=2076.0 (overall: 2143.3) avg_msec=5.424 (overall: 4.588) LPUSH (needed to benchmark LRANGE): rps=2162.7 (overall: 2148.5) avg_msec=3.723 (overall: 4.353) LPUSH (needed to benchmark LRANGE): rps=2576.0 (overall: 2238.6) avg_msec=4.488 (overall: 4.386) LPUSH (needed to benchmark LRANGE): rps=996.0 (overall: 2021.6) avg_msec=7.361 (overall: 4.642) LPUSH (needed to benchmark LRANGE): rps=80.0 (overall: 1733.8) avg_msec=150.710 (overall: 5.641) LPUSH (needed to benchmark LRANGE): rps=527.8 (overall: 1577.1) avg_msec=15.422 (overall: 6.066) LPUSH (needed to benchmark LRANGE): rps=1259.0 (overall: 1540.6) avg_msec=9.376 (overall: 6.376) LPUSH (needed to benchmark LRANGE): rps=1757.0 (overall: 1562.9) avg_msec=4.717 (overall: 6.184) LPUSH (needed to benchmark LRANGE): rps=2700.0 (overall: 1668.5) avg_msec=4.388 (overall: 5.914) LPUSH (needed to benchmark LRANGE): rps=1709.2 (overall: 1672.0) avg_msec=4.601 (overall: 5.800) LPUSH (needed to benchmark LRANGE): 1678.42 requests per second, p50=0.847 msec LRANGE_100 (first 100 elements): rps=2386.5 (overall: 3220.4) avg_msec=2.927 (overall: 2.927) LRANGE_100 (first 100 elements): rps=2123.5 (overall: 2590.4) avg_msec=3.737 (overall: 3.308) LRANGE_100 (first 100 elements): rps=2749.0 (overall: 2648.3) avg_msec=4.067 (overall: 3.596) LRANGE_100 (first 100 elements): rps=1892.4 (overall: 2446.2) avg_msec=4.178 (overall: 3.716) LRANGE_100 (first 100 elements): rps=1872.0 (overall: 2325.5) avg_msec=6.234 (overall: 4.142) LRANGE_100 (first 100 elements): rps=1697.2 (overall: 2216.0) avg_msec=4.632 (overall: 4.208) LRANGE_100 (first 100 elements): rps=2853.2 (overall: 2310.9) avg_msec=3.920 (overall: 4.155) LRANGE_100 (first 100 elements): rps=2015.9 (overall: 2272.8) avg_msec=3.934 (overall: 4.130) LRANGE_100 (first 100 elements): 2300.97 requests per second, p50=0.783 msec LRANGE_300 (first 300 elements): rps=0.0 (overall: -nan) avg_msec=-nan (overall: -nan) LRANGE_300 (first 300 elements): rps=1710.3 (overall: 1710.3) avg_msec=4.187 (overall: 4.187) LRANGE_300 (first 300 elements): rps=183.3 (overall: 948.3) avg_msec=61.575 (overall: 9.721) LRANGE_300 (first 300 elements): rps=1438.2 (overall: 1111.4) avg_msec=5.739 (overall: 8.006) LRANGE_300 (first 300 elements): rps=1900.4 (overall: 1308.5) avg_msec=5.971 (overall: 7.268) LRANGE_300 (first 300 elements): rps=1278.9 (overall: 1302.5) avg_msec=5.902 (overall: 7.000) LRANGE_300 (first 300 elements): rps=605.6 (overall: 1186.5) avg_msec=18.257 (overall: 7.957) LRANGE_300 (first 300 elements): rps=1305.6 (overall: 1203.5) avg_msec=6.107 (overall: 7.669) LRANGE_300 (first 300 elements): rps=1844.6 (overall: 1283.6) avg_msec=6.269 (overall: 7.418) LRANGE_300 (first 300 elements): rps=1402.4 (overall: 1296.8) avg_msec=5.294 (overall: 7.163) LRANGE_300 (first 300 elements): rps=1434.3 (overall: 1310.5) avg_msec=7.579 (overall: 7.209) LRANGE_300 (first 300 elements): rps=1207.2 (overall: 1301.1) avg_msec=6.921 (overall: 7.184) LRANGE_300 (first 300 elements): rps=1390.4 (overall: 1308.6) avg_msec=7.816 (overall: 7.240) LRANGE_300 (first 300 elements): rps=741.0 (overall: 1264.9) avg_msec=8.359 (overall: 7.291) LRANGE_300 (first 300 elements): rps=1091.6 (overall: 1252.6) avg_msec=12.857 (overall: 7.637) LRANGE_300 (first 300 elements): rps=1087.6 (overall: 1241.6) avg_msec=6.430 (overall: 7.566) LRANGE_300 (first 300 elements): 1285.68 requests per second, p50=1.047 msec LRANGE_500 (first 500 elements): rps=484.1 (overall: 1140.2) avg_msec=6.338 (overall: 6.338) LRANGE_500 (first 500 elements): rps=1071.7 (overall: 1092.2) avg_msec=7.267 (overall: 6.977) LRANGE_500 (first 500 elements): rps=1398.4 (overall: 1218.4) avg_msec=7.656 (overall: 7.298) LRANGE_500 (first 500 elements): rps=1071.7 (overall: 1175.6) avg_msec=9.878 (overall: 7.985) LRANGE_500 (first 500 elements): rps=1436.5 (overall: 1234.7) avg_msec=5.550 (overall: 7.343) LRANGE_500 (first 500 elements): rps=1012.0 (overall: 1193.8) avg_msec=10.873 (overall: 7.892) LRANGE_500 (first 500 elements): rps=1537.8 (overall: 1247.4) avg_msec=5.142 (overall: 7.364) LRANGE_500 (first 500 elements): rps=1107.6 (overall: 1228.5) avg_msec=9.827 (overall: 7.663) LRANGE_500 (first 500 elements): rps=1470.1 (overall: 1257.2) avg_msec=5.423 (overall: 7.352) LRANGE_500 (first 500 elements): rps=1095.6 (overall: 1240.1) avg_msec=9.592 (overall: 7.562) LRANGE_500 (first 500 elements): rps=476.2 (overall: 1166.5) avg_msec=17.390 (overall: 7.949) LRANGE_500 (first 500 elements): rps=772.0 (overall: 1132.1) avg_msec=14.706 (overall: 8.350) LRANGE_500 (first 500 elements): rps=1388.9 (overall: 1152.9) avg_msec=5.667 (overall: 8.089) LRANGE_500 (first 500 elements): rps=39.8 (overall: 1070.0) avg_msec=73.050 (overall: 8.269) LRANGE_500 (first 500 elements): rps=39.8 (overall: 998.6) avg_msec=298.394 (overall: 9.071) LRANGE_500 (first 500 elements): rps=661.4 (overall: 976.8) avg_msec=24.285 (overall: 9.739) LRANGE_500 (first 500 elements): rps=1326.7 (overall: 998.1) avg_msec=5.897 (overall: 9.428) LRANGE_500 (first 500 elements): rps=1462.2 (overall: 1024.7) avg_msec=7.508 (overall: 9.271) LRANGE_500 (first 500 elements): rps=1183.3 (overall: 1033.3) avg_msec=6.469 (overall: 9.097) LRANGE_500 (first 500 elements): 1025.64 requests per second, p50=1.311 msec LRANGE_600 (first 600 elements): rps=0.0 (overall: -nan) avg_msec=-nan (overall: -nan) LRANGE_600 (first 600 elements): rps=932.5 (overall: 932.5) avg_msec=7.017 (overall: 7.017) LRANGE_600 (first 600 elements): rps=852.6 (overall: 892.6) avg_msec=13.206 (overall: 9.966) LRANGE_600 (first 600 elements): rps=1000.0 (overall: 928.4) avg_msec=7.930 (overall: 9.236) LRANGE_600 (first 600 elements): rps=1330.7 (overall: 1028.9) avg_msec=8.316 (overall: 8.939) LRANGE_600 (first 600 elements): rps=956.2 (overall: 1014.3) avg_msec=7.946 (overall: 8.752) LRANGE_600 (first 600 elements): rps=1286.9 (overall: 1059.7) avg_msec=8.922 (overall: 8.786) LRANGE_600 (first 600 elements): rps=873.0 (overall: 1033.0) avg_msec=8.645 (overall: 8.769) LRANGE_600 (first 600 elements): rps=968.0 (overall: 1024.9) avg_msec=10.910 (overall: 9.021) LRANGE_600 (first 600 elements): rps=964.3 (overall: 1018.1) avg_msec=10.500 (overall: 9.177) LRANGE_600 (first 600 elements): rps=872.5 (overall: 1003.6) avg_msec=8.607 (overall: 9.127) LRANGE_600 (first 600 elements): rps=127.5 (overall: 924.0) avg_msec=72.362 (overall: 9.920) LRANGE_600 (first 600 elements): rps=143.4 (overall: 859.0) avg_msec=84.733 (overall: 10.960) LRANGE_600 (first 600 elements): rps=1035.9 (overall: 872.6) avg_msec=10.639 (overall: 10.931) LRANGE_600 (first 600 elements): rps=1274.9 (overall: 901.3) avg_msec=6.178 (overall: 10.451) LRANGE_600 (first 600 elements): rps=1004.0 (overall: 908.2) avg_msec=10.117 (overall: 10.426) LRANGE_600 (first 600 elements): rps=1235.1 (overall: 928.6) avg_msec=6.356 (overall: 10.088) LRANGE_600 (first 600 elements): rps=1167.3 (overall: 942.6) avg_msec=9.481 (overall: 10.044) LRANGE_600 (first 600 elements): rps=1091.3 (overall: 950.9) avg_msec=7.157 (overall: 9.859) LRANGE_600 (first 600 elements): rps=896.4 (overall: 948.1) avg_msec=12.366 (overall: 9.984) LRANGE_600 (first 600 elements): rps=968.1 (overall: 949.1) avg_msec=8.324 (overall: 9.899) LRANGE_600 (first 600 elements): 948.95 requests per second, p50=1.383 msec MSET (10 keys): rps=0.0 (overall: -nan) avg_msec=-nan (overall: -nan) MSET (10 keys): rps=1646.8 (overall: 1646.8) avg_msec=4.285 (overall: 4.285) MSET (10 keys): rps=2276.0 (overall: 1960.2) avg_msec=5.080 (overall: 4.745) MSET (10 keys): rps=1326.7 (overall: 1749.0) avg_msec=5.874 (overall: 5.030) MSET (10 keys): rps=1547.6 (overall: 1698.5) avg_msec=7.833 (overall: 5.671) MSET (10 keys): rps=1444.0 (overall: 1647.8) avg_msec=5.321 (overall: 5.610) MSET (10 keys): rps=1027.9 (overall: 1544.5) avg_msec=11.132 (overall: 6.222) MSET (10 keys): rps=1242.1 (overall: 1501.1) avg_msec=6.830 (overall: 6.294) MSET (10 keys): rps=1744.0 (overall: 1531.4) avg_msec=6.819 (overall: 6.369) MSET (10 keys): rps=872.5 (overall: 1458.2) avg_msec=12.769 (overall: 6.794) MSET (10 keys): rps=1191.2 (overall: 1431.5) avg_msec=7.214 (overall: 6.829) MSET (10 keys): rps=1274.9 (overall: 1417.2) avg_msec=8.884 (overall: 6.997) MSET (10 keys): rps=1662.7 (overall: 1437.8) avg_msec=5.295 (overall: 6.833) MSET (10 keys): rps=1354.6 (overall: 1431.4) avg_msec=7.932 (overall: 6.913) MSET (10 keys): 1445.92 requests per second, p50=0.959 msec `kubectl delete pod benchtest-redis-ljzvzz --force --namespace ns-jcjpx ` Warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely. pod "benchtest-redis-ljzvzz" force deleted No resources found in ns-jcjpx namespace. `kubectl get secrets -l app.kubernetes.io/instance=redis-ljzvzz` set secret: redis-ljzvzz-redis-account-default `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.username***"` `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.password***"` `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.port***"` DB_USERNAME_PROXY:;DB_PASSWORD_PROXY:;DB_PORT_PROXY:26379 DB_USERNAME:default;DB_PASSWORD:gu97Tl5m13;DB_PORT:6379;DB_DATABASE:db0 apiVersion: v1 kind: Pod metadata: name: benchtest-redis-ljzvzz namespace: ns-jcjpx spec: containers: - name: test-benchmark imagePullPolicy: IfNotPresent image: docker.io/apecloud/redis-benchmark:latest args: - "-h" - "a39bed76e068f4572874650759b09068-224882140473a74c.elb.us-west-2.amazonaws.com" - "-p" - "6379" - "-a" - "gu97Tl5m13" - "-n" - "5000" - "-c" - "10" - "-q" restartPolicy: Never `kubectl apply -f benchtest-redis-ljzvzz.yaml` pod/benchtest-redis-ljzvzz created apply benchtest-redis-ljzvzz.yaml Success `rm -rf benchtest-redis-ljzvzz.yaml` check pod status pod_status:NAME READY STATUS RESTARTS AGE benchtest-redis-ljzvzz 0/1 ContainerCreating 0 1s pod_status:NAME READY STATUS RESTARTS AGE benchtest-redis-ljzvzz 0/1 ContainerCreating 0 6s pod_status:NAME READY STATUS RESTARTS AGE benchtest-redis-ljzvzz 1/1 Running 0 12s pod_status:NAME READY STATUS RESTARTS AGE benchtest-redis-ljzvzz 1/1 Running 0 18s pod_status:NAME READY STATUS RESTARTS AGE benchtest-redis-ljzvzz 1/1 Running 0 23s pod_status:NAME READY STATUS RESTARTS AGE benchtest-redis-ljzvzz 1/1 Running 0 29s pod_status:NAME READY STATUS RESTARTS AGE benchtest-redis-ljzvzz 1/1 Running 0 35s pod_status:NAME READY STATUS RESTARTS AGE benchtest-redis-ljzvzz 1/1 Running 0 41s pod_status:NAME READY STATUS RESTARTS AGE benchtest-redis-ljzvzz 1/1 Running 0 47s pod_status:NAME READY STATUS RESTARTS AGE benchtest-redis-ljzvzz 1/1 Running 0 52s pod_status:NAME READY STATUS RESTARTS AGE benchtest-redis-ljzvzz 1/1 Running 0 58s pod_status:NAME READY STATUS RESTARTS AGE benchtest-redis-ljzvzz 1/1 Running 0 64s pod_status:NAME READY STATUS RESTARTS AGE benchtest-redis-ljzvzz 1/1 Running 0 70s pod_status:NAME READY STATUS RESTARTS AGE benchtest-redis-ljzvzz 1/1 Running 0 76s pod_status:NAME READY STATUS RESTARTS AGE benchtest-redis-ljzvzz 1/1 Running 0 81s pod_status:NAME READY STATUS RESTARTS AGE benchtest-redis-ljzvzz 1/1 Running 0 87s pod_status:NAME READY STATUS RESTARTS AGE benchtest-redis-ljzvzz 1/1 Running 0 93s pod_status:NAME READY STATUS RESTARTS AGE benchtest-redis-ljzvzz 1/1 Running 0 99s pod_status:NAME READY STATUS RESTARTS AGE benchtest-redis-ljzvzz 1/1 Running 0 105s pod_status:NAME READY STATUS RESTARTS AGE benchtest-redis-ljzvzz 1/1 Running 0 111s pod_status:NAME READY STATUS RESTARTS AGE benchtest-redis-ljzvzz 1/1 Running 0 116s pod_status:NAME READY STATUS RESTARTS AGE benchtest-redis-ljzvzz 1/1 Running 0 2m2s pod_status:NAME READY STATUS RESTARTS AGE benchtest-redis-ljzvzz 1/1 Running 0 2m8s pod_status:NAME READY STATUS RESTARTS AGE benchtest-redis-ljzvzz 1/1 Running 0 2m14s pod_status:NAME READY STATUS RESTARTS AGE benchtest-redis-ljzvzz 1/1 Running 0 2m20s pod_status:NAME READY STATUS RESTARTS AGE benchtest-redis-ljzvzz 1/1 Running 0 2m25s pod_status:NAME READY STATUS RESTARTS AGE benchtest-redis-ljzvzz 1/1 Running 0 2m31s pod_status:NAME READY STATUS RESTARTS AGE benchtest-redis-ljzvzz 1/1 Running 0 2m37s pod_status:NAME READY STATUS RESTARTS AGE benchtest-redis-ljzvzz 1/1 Running 0 2m43s pod_status:NAME READY STATUS RESTARTS AGE benchtest-redis-ljzvzz 1/1 Running 0 2m48s pod_status:NAME READY STATUS RESTARTS AGE benchtest-redis-ljzvzz 1/1 Running 0 2m54s pod_status:NAME READY STATUS RESTARTS AGE benchtest-redis-ljzvzz 1/1 Running 0 3m pod_status:NAME READY STATUS RESTARTS AGE benchtest-redis-ljzvzz 1/1 Running 0 3m6s pod_status:NAME READY STATUS RESTARTS AGE benchtest-redis-ljzvzz 1/1 Running 0 3m12s pod_status:NAME READY STATUS RESTARTS AGE benchtest-redis-ljzvzz 1/1 Running 0 3m17s pod_status:NAME READY STATUS RESTARTS AGE benchtest-redis-ljzvzz 1/1 Running 0 3m23s pod_status:NAME READY STATUS RESTARTS AGE benchtest-redis-ljzvzz 1/1 Running 0 3m29s pod_status:NAME READY STATUS RESTARTS AGE benchtest-redis-ljzvzz 1/1 Running 0 3m35s pod_status:NAME READY STATUS RESTARTS AGE benchtest-redis-ljzvzz 1/1 Running 0 3m40s pod_status:NAME READY STATUS RESTARTS AGE benchtest-redis-ljzvzz 1/1 Running 0 3m46s pod_status:NAME READY STATUS RESTARTS AGE benchtest-redis-ljzvzz 1/1 Running 0 3m52s pod_status:NAME READY STATUS RESTARTS AGE benchtest-redis-ljzvzz 1/1 Running 0 3m58s pod_status:NAME READY STATUS RESTARTS AGE benchtest-redis-ljzvzz 1/1 Running 0 4m4s pod_status:NAME READY STATUS RESTARTS AGE benchtest-redis-ljzvzz 1/1 Running 0 4m9s pod_status:NAME READY STATUS RESTARTS AGE benchtest-redis-ljzvzz 1/1 Running 0 4m15s pod_status:NAME READY STATUS RESTARTS AGE benchtest-redis-ljzvzz 1/1 Running 0 4m21s pod_status:NAME READY STATUS RESTARTS AGE benchtest-redis-ljzvzz 1/1 Running 0 4m27s pod_status:NAME READY STATUS RESTARTS AGE benchtest-redis-ljzvzz 1/1 Running 0 4m33s pod_status:NAME READY STATUS RESTARTS AGE benchtest-redis-ljzvzz 1/1 Running 0 4m38s pod_status:NAME READY STATUS RESTARTS AGE benchtest-redis-ljzvzz 1/1 Running 0 4m44s pod_status:NAME READY STATUS RESTARTS AGE benchtest-redis-ljzvzz 1/1 Running 0 4m50s pod_status:NAME READY STATUS RESTARTS AGE benchtest-redis-ljzvzz 1/1 Running 0 4m56s pod_status:NAME READY STATUS RESTARTS AGE benchtest-redis-ljzvzz 1/1 Running 0 5m2s pod_status:NAME READY STATUS RESTARTS AGE benchtest-redis-ljzvzz 1/1 Running 0 5m8s pod_status:NAME READY STATUS RESTARTS AGE benchtest-redis-ljzvzz 1/1 Running 0 5m13s pod_status:NAME READY STATUS RESTARTS AGE benchtest-redis-ljzvzz 1/1 Running 0 5m19s pod_status:NAME READY STATUS RESTARTS AGE benchtest-redis-ljzvzz 1/1 Running 0 5m25s pod_status:NAME READY STATUS RESTARTS AGE benchtest-redis-ljzvzz 1/1 Running 0 5m31s pod_status:NAME READY STATUS RESTARTS AGE benchtest-redis-ljzvzz 1/1 Running 0 5m36s pod_status:NAME READY STATUS RESTARTS AGE benchtest-redis-ljzvzz 1/1 Running 0 5m42s pod_status:NAME READY STATUS RESTARTS AGE benchtest-redis-ljzvzz 1/1 Running 0 5m48s check pod benchtest-redis-ljzvzz status timeout --------------------------------------get pod benchtest-redis-ljzvzz yaml-------------------------------------- `kubectl get pod benchtest-redis-ljzvzz -o yaml --namespace ns-jcjpx ` apiVersion: v1 kind: Pod metadata: annotations: kubectl.kubernetes.io/last-applied-configuration: | ***"apiVersion":"v1","kind":"Pod","metadata":***"annotations":***,"name":"benchtest-redis-ljzvzz","namespace":"ns-jcjpx"***,"spec":***"containers":[***"args":["-h","a39bed76e068f4572874650759b09068-224882140473a74c.elb.us-west-2.amazonaws.com","-p","6379","-a","gu97Tl5m13","-n","5000","-c","10","-q"],"image":"docker.io/apecloud/redis-benchmark:latest","imagePullPolicy":"IfNotPresent","name":"test-benchmark"***],"restartPolicy":"Never"*** creationTimestamp: "2025-06-19T10:40:59Z" name: benchtest-redis-ljzvzz namespace: ns-jcjpx resourceVersion: "46957" uid: 17cc2228-6a5c-47f6-9119-8be29bd44d0e spec: containers: - args: - -h - a39bed76e068f4572874650759b09068-224882140473a74c.elb.us-west-2.amazonaws.com - -p - "6379" - -a - gu97Tl5m13 - -n - "5000" - -c - "10" - -q image: docker.io/apecloud/redis-benchmark:latest imagePullPolicy: IfNotPresent name: test-benchmark resources: *** terminationMessagePath: /dev/termination-log terminationMessagePolicy: File volumeMounts: - mountPath: /var/run/secrets/kubernetes.io/serviceaccount name: kube-api-access-jhdfs readOnly: true dnsPolicy: ClusterFirst enableServiceLinks: true nodeName: ip-172-31-3-13.us-west-2.compute.internal preemptionPolicy: PreemptLowerPriority priority: 0 restartPolicy: Never schedulerName: default-scheduler securityContext: *** serviceAccount: default serviceAccountName: default terminationGracePeriodSeconds: 30 tolerations: - effect: NoExecute key: node.kubernetes.io/not-ready operator: Exists tolerationSeconds: 300 - effect: NoExecute key: node.kubernetes.io/unreachable operator: Exists tolerationSeconds: 300 volumes: - name: kube-api-access-jhdfs projected: defaultMode: 420 sources: - serviceAccountToken: expirationSeconds: 3607 path: token - configMap: items: - key: ca.crt path: ca.crt name: kube-root-ca.crt - downwardAPI: items: - fieldRef: apiVersion: v1 fieldPath: metadata.namespace path: namespace status: conditions: - lastProbeTime: null lastTransitionTime: "2025-06-19T10:41:05Z" status: "True" type: PodReadyToStartContainers - lastProbeTime: null lastTransitionTime: "2025-06-19T10:40:59Z" status: "True" type: Initialized - lastProbeTime: null lastTransitionTime: "2025-06-19T10:41:05Z" status: "True" type: Ready - lastProbeTime: null lastTransitionTime: "2025-06-19T10:41:05Z" status: "True" type: ContainersReady - lastProbeTime: null lastTransitionTime: "2025-06-19T10:40:59Z" status: "True" type: PodScheduled containerStatuses: - containerID: containerd://70f927c4d17d16df7278b585564054331ce3518a8c8e2b6a6089a5a4573619c5 image: docker.io/apecloud/redis-benchmark:latest imageID: docker.io/apecloud/redis-benchmark@sha256:a4ae7eaa01ff4ef5ac13d8b72992f1e7b18924fb613f21fddab63dc5a6682c56 lastState: *** name: test-benchmark ready: true restartCount: 0 started: true state: running: startedAt: "2025-06-19T10:41:04Z" volumeMounts: - mountPath: /var/run/secrets/kubernetes.io/serviceaccount name: kube-api-access-jhdfs readOnly: true recursiveReadOnly: Disabled hostIP: 172.31.3.13 hostIPs: - ip: 172.31.3.13 phase: Running podIP: 172.31.6.173 podIPs: - ip: 172.31.6.173 qosClass: BestEffort startTime: "2025-06-19T10:40:59Z" ------------------------------------------------------------------------------------------------------------------ --------------------------------------describe pod benchtest-redis-ljzvzz-------------------------------------- `kubectl describe pod benchtest-redis-ljzvzz --namespace ns-jcjpx ` Name: benchtest-redis-ljzvzz Namespace: ns-jcjpx Priority: 0 Service Account: default Node: ip-172-31-3-13.us-west-2.compute.internal/172.31.3.13 Start Time: Thu, 19 Jun 2025 18:40:59 +0800 Labels: Annotations: Status: Running IP: 172.31.6.173 IPs: IP: 172.31.6.173 Containers: test-benchmark: Container ID: containerd://70f927c4d17d16df7278b585564054331ce3518a8c8e2b6a6089a5a4573619c5 Image: docker.io/apecloud/redis-benchmark:latest Image ID: docker.io/apecloud/redis-benchmark@sha256:a4ae7eaa01ff4ef5ac13d8b72992f1e7b18924fb613f21fddab63dc5a6682c56 Port: Host Port: Args: -h a39bed76e068f4572874650759b09068-224882140473a74c.elb.us-west-2.amazonaws.com -p 6379 -a gu97Tl5m13 -n 5000 -c 10 -q State: Running Started: Thu, 19 Jun 2025 18:41:04 +0800 Ready: True Restart Count: 0 Environment: Mounts: /var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-jhdfs (ro) Conditions: Type Status PodReadyToStartContainers True Initialized True Ready True ContainersReady True PodScheduled True Volumes: kube-api-access-jhdfs: Type: Projected (a volume that contains injected data from multiple sources) TokenExpirationSeconds: 3607 ConfigMapName: kube-root-ca.crt ConfigMapOptional: DownwardAPI: true QoS Class: BestEffort Node-Selectors: Tolerations: node.kubernetes.io/not-ready:NoExecute op=Exists for 300s node.kubernetes.io/unreachable:NoExecute op=Exists for 300s Events: Type Reason Age From Message ---- ------ ---- ---- ------- Normal Scheduled 5m51s default-scheduler Successfully assigned ns-jcjpx/benchtest-redis-ljzvzz to ip-172-31-3-13.us-west-2.compute.internal Normal Pulling 5m50s kubelet Pulling image "docker.io/apecloud/redis-benchmark:latest" Normal Pulled 5m46s kubelet Successfully pulled image "docker.io/apecloud/redis-benchmark:latest" in 4.221s (4.221s including waiting). Image size: 51408869 bytes. Normal Created 5m46s kubelet Created container: test-benchmark Normal Started 5m46s kubelet Started container test-benchmark ------------------------------------------------------------------------------------------------------------------ --------------------------------------pod benchtest-redis-ljzvzz-------------------------------------- `kubectl logs benchtest-redis-ljzvzz --namespace ns-jcjpx --tail 500` PING_INLINE: rps=0.0 (overall: -nan) avg_msec=-nan (overall: -nan) PING_INLINE: rps=1788.8 (overall: 1788.8) avg_msec=5.527 (overall: 5.527) PING_INLINE: rps=1251.0 (overall: 1519.9) avg_msec=6.432 (overall: 5.899) PING_INLINE: rps=673.3 (overall: 1237.7) avg_msec=17.454 (overall: 7.994) PING_INLINE: rps=498.0 (overall: 1052.8) avg_msec=16.014 (overall: 8.943) PING_INLINE: rps=388.9 (overall: 919.6) avg_msec=30.236 (overall: 10.749) PING_INLINE: rps=264.0 (overall: 810.8) avg_msec=30.267 (overall: 11.804) PING_INLINE: rps=321.4 (overall: 740.6) avg_msec=28.024 (overall: 12.814) PING_INLINE: rps=180.0 (overall: 670.8) avg_msec=60.129 (overall: 14.394) PING_INLINE: rps=595.2 (overall: 662.4) avg_msec=20.261 (overall: 14.982) PING_INLINE: rps=39.8 (overall: 600.2) avg_msec=96.602 (overall: 15.524) PING_INLINE: rps=112.0 (overall: 556.0) avg_msec=141.946 (overall: 17.830) PING_INLINE: rps=27.8 (overall: 511.8) avg_msec=200.073 (overall: 18.657) PING_INLINE: rps=52.0 (overall: 476.6) avg_msec=276.682 (overall: 20.814) PING_INLINE: rps=27.9 (overall: 444.5) avg_msec=199.707 (overall: 21.616) PING_INLINE: rps=12.0 (overall: 415.7) avg_msec=299.648 (overall: 22.149) PING_INLINE: rps=39.7 (overall: 392.1) avg_msec=370.278 (overall: 24.359) PING_INLINE: rps=39.8 (overall: 371.4) avg_msec=239.578 (overall: 25.717) PING_INLINE: rps=0.0 (overall: 350.8) avg_msec=-nan (overall: 25.717) PING_INLINE: rps=39.7 (overall: 334.4) avg_msec=599.782 (overall: 29.316) PING_INLINE: rps=39.8 (overall: 319.7) avg_msec=160.109 (overall: 30.131) PING_INLINE: rps=39.7 (overall: 306.3) avg_msec=319.590 (overall: 31.923) PING_INLINE: rps=0.0 (overall: 292.4) avg_msec=-nan (overall: 31.923) PING_INLINE: rps=151.4 (overall: 286.3) avg_msec=153.554 (overall: 34.720) PING_INLINE: rps=39.8 (overall: 276.0) avg_msec=96.512 (overall: 35.091) PING_INLINE: rps=440.0 (overall: 282.5) avg_msec=36.336 (overall: 35.168) PING_INLINE: rps=167.3 (overall: 278.1) avg_msec=47.292 (overall: 35.449) PING_INLINE: rps=111.6 (overall: 271.9) avg_msec=71.277 (overall: 35.993) PING_INLINE: rps=215.1 (overall: 269.9) avg_msec=55.849 (overall: 36.558) PING_INLINE: rps=1247.0 (overall: 303.6) avg_msec=9.503 (overall: 32.727) PING_INLINE: rps=39.7 (overall: 294.8) avg_msec=97.152 (overall: 33.017) PING_INLINE: rps=812.0 (overall: 311.4) avg_msec=20.094 (overall: 31.934) PING_INLINE: rps=581.7 (overall: 319.8) avg_msec=13.337 (overall: 30.877) PING_INLINE: rps=1015.9 (overall: 340.9) avg_msec=11.629 (overall: 29.139) PING_INLINE: rps=936.5 (overall: 358.5) avg_msec=8.503 (overall: 27.548) PING_INLINE: rps=370.5 (overall: 358.9) avg_msec=31.768 (overall: 27.672) PING_INLINE: rps=27.8 (overall: 349.6) avg_msec=97.605 (overall: 27.827) PING_INLINE: rps=55.8 (overall: 341.7) avg_msec=270.967 (overall: 28.899) PING_INLINE: rps=15.9 (overall: 333.1) avg_msec=250.048 (overall: 29.178) PING_INLINE: rps=27.9 (overall: 325.3) avg_msec=456.759 (overall: 30.118) PING_INLINE: rps=12.0 (overall: 317.5) avg_msec=533.120 (overall: 30.591) PING_INLINE: rps=27.9 (overall: 310.4) avg_msec=428.343 (overall: 31.462) PING_INLINE: rps=0.0 (overall: 303.0) avg_msec=-nan (overall: 31.462) PING_INLINE: rps=0.0 (overall: 296.0) avg_msec=-nan (overall: 31.462) PING_INLINE: rps=79.7 (overall: 291.1) avg_msec=435.642 (overall: 33.977) PING_INLINE: rps=202.4 (overall: 289.1) avg_msec=58.952 (overall: 34.367) PING_INLINE: rps=232.0 (overall: 287.9) avg_msec=47.792 (overall: 34.601) PING_INLINE: rps=1075.7 (overall: 304.6) avg_msec=8.297 (overall: 32.625) PING_INLINE: rps=452.0 (overall: 307.7) avg_msec=26.078 (overall: 32.425) PING_INLINE: rps=789.7 (overall: 317.6) avg_msec=10.369 (overall: 31.302) PING_INLINE: rps=516.0 (overall: 321.5) avg_msec=22.586 (overall: 31.023) PING_INLINE: rps=265.9 (overall: 320.4) avg_msec=29.847 (overall: 31.004) PING_INLINE: rps=119.5 (overall: 316.6) avg_msec=99.359 (overall: 31.500) PING_INLINE: rps=494.0 (overall: 319.9) avg_msec=16.333 (overall: 31.058) PING_INLINE: rps=79.4 (overall: 315.4) avg_msec=99.478 (overall: 31.378) PING_INLINE: rps=0.0 (overall: 309.7) avg_msec=-nan (overall: 31.378) PING_INLINE: rps=0.0 (overall: 304.2) avg_msec=-nan (overall: 31.378) PING_INLINE: rps=31.9 (overall: 299.4) avg_msec=696.320 (overall: 32.620) PING_INLINE: rps=8.0 (overall: 294.4) avg_msec=896.256 (overall: 33.023) PING_INLINE: rps=31.9 (overall: 289.9) avg_msec=599.808 (overall: 34.079) PING_INLINE: rps=8.0 (overall: 285.2) avg_msec=600.320 (overall: 34.342) PING_INLINE: rps=39.8 (overall: 281.2) avg_msec=390.067 (overall: 35.169) PING_INLINE: rps=39.8 (overall: 277.3) avg_msec=369.792 (overall: 35.944) PING_INLINE: rps=170.6 (overall: 275.6) avg_msec=46.782 (overall: 36.051) PING_INLINE: rps=482.1 (overall: 278.8) avg_msec=24.766 (overall: 35.746) PING_INLINE: rps=533.9 (overall: 282.8) avg_msec=15.054 (overall: 35.145) PING_INLINE: rps=565.7 (overall: 287.1) avg_msec=20.799 (overall: 34.717) PING_INLINE: rps=163.3 (overall: 285.2) avg_msec=48.861 (overall: 34.838) PING_INLINE: rps=418.3 (overall: 287.2) avg_msec=28.308 (overall: 34.698) PING_INLINE: rps=171.3 (overall: 285.5) avg_msec=46.858 (overall: 34.803) PING_INLINE: 286.58 requests per second, p50=0.591 msec PING_MBULK: rps=615.1 (overall: 1504.9) avg_msec=5.192 (overall: 5.192) PING_MBULK: rps=1111.6 (overall: 1226.0) avg_msec=7.256 (overall: 6.519) PING_MBULK: rps=816.7 (overall: 1056.2) avg_msec=14.014 (overall: 8.923) PING_MBULK: rps=39.8 (overall: 758.2) avg_msec=96.723 (overall: 10.276) PING_MBULK: rps=31.9 (overall: 593.5) avg_msec=224.912 (overall: 12.890) PING_MBULK: rps=39.8 (overall: 491.2) avg_msec=344.192 (overall: 17.857) PING_MBULK: rps=0.0 (overall: 414.3) avg_msec=-nan (overall: 17.857) PING_MBULK: rps=0.0 (overall: 358.2) avg_msec=-nan (overall: 17.857) PING_MBULK: rps=0.0 (overall: 315.7) avg_msec=-nan (overall: 17.857) PING_MBULK: rps=0.0 (overall: 282.3) avg_msec=-nan (overall: 17.857) PING_MBULK: rps=0.0 (overall: 255.2) avg_msec=-nan (overall: 17.857) PING_MBULK: rps=0.0 (overall: 232.8) avg_msec=-nan (overall: 17.857) PING_MBULK: rps=0.0 (overall: 214.1) avg_msec=-nan (overall: 17.857) PING_MBULK: rps=0.0 (overall: 198.2) avg_msec=-nan (overall: 17.857) PING_MBULK: rps=0.0 (overall: 184.4) avg_msec=-nan (overall: 17.857) PING_MBULK: rps=39.8 (overall: 175.0) avg_msec=2574.131 (overall: 55.616) PING_MBULK: rps=0.0 (overall: 164.4) avg_msec=-nan (overall: 55.616) PING_MBULK: rps=0.0 (overall: 154.9) avg_msec=-nan (overall: 55.616) PING_MBULK: rps=0.0 (overall: 146.5) avg_msec=-nan (overall: 55.616) PING_MBULK: rps=0.0 (overall: 139.0) avg_msec=-nan (overall: 55.616) PING_MBULK: rps=91.6 (overall: 136.7) avg_msec=535.345 (overall: 71.378) PING_MBULK: rps=67.5 (overall: 133.4) avg_msec=157.549 (overall: 73.421) PING_MBULK: rps=1444.0 (overall: 191.7) avg_msec=8.455 (overall: 51.665) PING_MBULK: rps=39.7 (overall: 185.2) avg_msec=113.069 (overall: 52.230) PING_MBULK: rps=171.3 (overall: 184.6) avg_msec=88.247 (overall: 53.599) PING_MBULK: rps=40.0 (overall: 178.9) avg_msec=98.605 (overall: 53.993) PING_MBULK: rps=0.0 (overall: 172.1) avg_msec=-nan (overall: 53.993) PING_MBULK: rps=27.9 (overall: 166.9) avg_msec=700.087 (overall: 57.933) PING_MBULK: rps=12.0 (overall: 161.4) avg_msec=800.000 (overall: 59.867) PING_MBULK: rps=79.7 (overall: 158.7) avg_msec=200.114 (overall: 62.263) PING_MBULK: rps=119.5 (overall: 157.4) avg_msec=90.026 (overall: 62.956) PING_MBULK: rps=159.4 (overall: 157.4) avg_msec=75.021 (overall: 63.345) PING_MBULK: rps=47.8 (overall: 154.0) avg_msec=165.344 (overall: 64.322) PING_MBULK: rps=282.9 (overall: 157.9) avg_msec=42.506 (overall: 63.152) PING_MBULK: rps=139.4 (overall: 157.4) avg_msec=45.574 (overall: 62.699) PING_MBULK: rps=227.1 (overall: 159.3) avg_msec=59.556 (overall: 62.573) PING_MBULK: rps=119.5 (overall: 158.2) avg_msec=66.102 (overall: 62.646) PING_MBULK: rps=135.5 (overall: 157.6) avg_msec=88.203 (overall: 63.233) PING_MBULK: rps=362.5 (overall: 163.0) avg_msec=22.089 (overall: 60.850) PING_MBULK: rps=79.7 (overall: 160.9) avg_msec=148.669 (overall: 61.954) PING_MBULK: rps=1043.8 (overall: 182.7) avg_msec=8.016 (overall: 54.327) PING_MBULK: rps=1535.7 (overall: 215.5) avg_msec=7.552 (overall: 46.246) PING_MBULK: rps=757.9 (overall: 228.3) avg_msec=9.911 (overall: 43.391) PING_MBULK: rps=332.0 (overall: 230.7) avg_msec=35.774 (overall: 43.140) PING_MBULK: rps=190.5 (overall: 229.8) avg_msec=29.158 (overall: 42.878) PING_MBULK: rps=23.9 (overall: 225.3) avg_msec=379.861 (overall: 43.665) PING_MBULK: rps=8.0 (overall: 220.6) avg_msec=547.904 (overall: 44.058) PING_MBULK: rps=15.9 (overall: 216.3) avg_msec=578.720 (overall: 44.888) PING_MBULK: rps=12.0 (overall: 212.1) avg_msec=766.379 (overall: 45.728) PING_MBULK: rps=27.7 (overall: 208.3) avg_msec=541.934 (overall: 47.073) PING_MBULK: rps=12.0 (overall: 204.4) avg_msec=631.851 (overall: 47.751) PING_MBULK: rps=27.9 (overall: 201.0) avg_msec=356.133 (overall: 48.583) PING_MBULK: rps=0.0 (overall: 197.1) avg_msec=-nan (overall: 48.583) PING_MBULK: rps=80.0 (overall: 195.0) avg_msec=320.573 (overall: 50.664) PING_MBULK: rps=39.8 (overall: 192.1) avg_msec=228.550 (overall: 51.342) PING_MBULK: rps=15.9 (overall: 188.9) avg_msec=399.872 (overall: 51.872) PING_MBULK: rps=12.0 (overall: 185.8) avg_msec=499.840 (overall: 52.383) PING_MBULK: rps=27.9 (overall: 183.0) avg_msec=528.640 (overall: 53.647) PING_MBULK: rps=12.0 (overall: 180.1) avg_msec=599.808 (overall: 54.267) PING_MBULK: rps=143.4 (overall: 179.5) avg_msec=141.651 (overall: 55.442) PING_MBULK: rps=31.9 (overall: 177.1) avg_msec=199.360 (overall: 55.871) PING_MBULK: rps=358.6 (overall: 180.0) avg_msec=38.128 (overall: 55.296) PING_MBULK: rps=446.2 (overall: 184.3) avg_msec=17.705 (overall: 53.837) PING_MBULK: rps=1039.7 (overall: 197.8) avg_msec=11.448 (overall: 50.311) PING_MBULK: rps=615.1 (overall: 204.3) avg_msec=12.673 (overall: 48.545) PING_MBULK: rps=597.6 (overall: 210.3) avg_msec=19.871 (overall: 47.300) PING_MBULK: rps=39.8 (overall: 207.8) avg_msec=129.539 (overall: 47.537) PING_MBULK: rps=39.8 (overall: 205.3) avg_msec=278.874 (overall: 48.203) PING_MBULK: rps=0.0 (overall: 202.3) avg_msec=-nan (overall: 48.203) PING_MBULK: rps=0.0 (overall: 199.4) avg_msec=-nan (overall: 48.203) PING_MBULK: rps=39.8 (overall: 197.1) avg_msec=720.026 (overall: 50.131) PING_MBULK: rps=19.9 (overall: 194.6) avg_msec=399.693 (overall: 50.632) PING_MBULK: rps=83.7 (overall: 193.1) avg_msec=219.195 (overall: 51.641) PING_MBULK: rps=808.8 (overall: 201.5) avg_msec=10.493 (overall: 49.391) PING_MBULK: rps=79.7 (overall: 199.8) avg_msec=147.692 (overall: 49.918) PING_MBULK: rps=51.8 (overall: 197.9) avg_msec=124.948 (overall: 50.178) PING_MBULK: rps=259.0 (overall: 198.7) avg_msec=41.478 (overall: 50.030) PING_MBULK: rps=0.0 (overall: 196.1) avg_msec=-nan (overall: 50.030) PING_MBULK: rps=39.8 (overall: 194.1) avg_msec=387.072 (overall: 50.912) PING_MBULK: rps=361.1 (overall: 196.2) avg_msec=42.013 (overall: 50.705) PING_MBULK: rps=454.2 (overall: 199.4) avg_msec=26.126 (overall: 50.009) PING_MBULK: rps=127.5 (overall: 198.6) avg_msec=62.170 (overall: 50.105) PING_MBULK: rps=414.3 (overall: 201.2) avg_msec=25.852 (overall: 49.499) PING_MBULK: rps=51.8 (overall: 199.4) avg_msec=176.268 (overall: 49.893) PING_MBULK: rps=924.3 (overall: 208.0) avg_msec=11.647 (overall: 47.880) PING_MBULK: rps=39.8 (overall: 206.0) avg_msec=168.822 (overall: 48.154) PING_MBULK: rps=207.2 (overall: 206.0) avg_msec=69.012 (overall: 48.396) PING_MBULK: rps=39.7 (overall: 204.1) avg_msec=119.949 (overall: 48.556) PING_MBULK: rps=144.0 (overall: 203.4) avg_msec=77.879 (overall: 48.790) PING_MBULK: rps=146.2 (overall: 202.8) avg_msec=81.212 (overall: 49.054) PING_MBULK: rps=243.0 (overall: 203.2) avg_msec=48.773 (overall: 49.050) PING_MBULK: rps=27.9 (overall: 201.3) avg_msec=100.503 (overall: 49.128) PING_MBULK: rps=653.4 (overall: 206.2) avg_msec=26.305 (overall: 48.345) PING_MBULK: rps=539.7 (overall: 209.8) avg_msec=14.504 (overall: 47.410) PING_MBULK: rps=79.7 (overall: 208.4) avg_msec=84.122 (overall: 47.559) PING_MBULK: rps=79.7 (overall: 207.1) avg_msec=164.963 (overall: 48.032) PING_MBULK: rps=119.5 (overall: 206.1) avg_msec=99.806 (overall: 48.343) PING_MBULK: rps=27.9 (overall: 204.3) avg_msec=198.994 (overall: 48.554) PING_MBULK: 204.27 requests per second, p50=0.583 msec SET: rps=39.8 (overall: 55.6) avg_msec=149.658 (overall: 149.658) SET: rps=27.9 (overall: 39.4) avg_msec=129.513 (overall: 141.363) SET: rps=119.0 (overall: 68.8) avg_msec=136.490 (overall: 138.253) SET: rps=470.1 (overall: 176.7) avg_msec=17.251 (overall: 51.718) SET: rps=525.9 (overall: 250.6) avg_msec=10.337 (overall: 33.326) SET: rps=282.9 (overall: 256.3) avg_msec=52.351 (overall: 36.997) SET: rps=330.7 (overall: 267.3) avg_msec=24.363 (overall: 34.672) SET: rps=0.0 (overall: 232.7) avg_msec=-nan (overall: 34.672) SET: rps=0.0 (overall: 206.1) avg_msec=-nan (overall: 34.672) SET: rps=31.9 (overall: 188.2) avg_msec=724.864 (overall: 46.701) SET: rps=67.7 (overall: 177.0) avg_msec=276.553 (overall: 54.910) SET: rps=39.8 (overall: 165.2) avg_msec=149.802 (overall: 56.863) SET: rps=103.6 (overall: 160.4) avg_msec=115.559 (overall: 59.844) SET: rps=107.6 (overall: 156.5) avg_msec=103.719 (overall: 62.041) SET: rps=179.3 (overall: 158.1) avg_msec=67.957 (overall: 62.497) SET: rps=271.7 (overall: 165.4) avg_msec=27.258 (overall: 58.774) SET: rps=408.7 (overall: 180.0) avg_msec=22.249 (overall: 53.797) SET: rps=338.6 (overall: 188.9) avg_msec=40.995 (overall: 52.503) SET: rps=277.3 (overall: 193.8) avg_msec=28.946 (overall: 50.670) SET: rps=528.7 (overall: 211.4) avg_msec=22.137 (overall: 46.920) SET: rps=504.0 (overall: 225.5) avg_msec=14.623 (overall: 43.435) SET: rps=861.0 (overall: 255.5) avg_msec=13.265 (overall: 38.629) SET: rps=375.5 (overall: 261.0) avg_msec=17.248 (overall: 37.230) SET: rps=338.6 (overall: 264.2) avg_msec=30.457 (overall: 36.867) SET: rps=31.5 (overall: 254.8) avg_msec=173.120 (overall: 37.552) SET: rps=39.5 (overall: 246.4) avg_msec=200.499 (overall: 38.570) SET: rps=39.4 (overall: 238.6) avg_msec=429.133 (overall: 40.994) SET: rps=39.8 (overall: 231.5) avg_msec=270.714 (overall: 42.411) SET: rps=39.7 (overall: 224.8) avg_msec=141.152 (overall: 43.016) SET: rps=0.0 (overall: 217.3) avg_msec=-nan (overall: 43.016) SET: rps=31.9 (overall: 211.3) avg_msec=622.784 (overall: 45.846) SET: rps=0.0 (overall: 204.7) avg_msec=-nan (overall: 45.846) SET: rps=211.2 (overall: 204.9) avg_msec=124.963 (overall: 48.325) SET: rps=289.7 (overall: 207.4) avg_msec=27.134 (overall: 47.448) SET: rps=482.1 (overall: 215.3) avg_msec=24.076 (overall: 45.949) SET: rps=561.8 (overall: 224.9) avg_msec=14.170 (overall: 43.738) SET: rps=669.3 (overall: 237.0) avg_msec=12.969 (overall: 41.383) SET: rps=127.5 (overall: 234.1) avg_msec=87.246 (overall: 42.042) SET: rps=333.3 (overall: 236.6) avg_msec=35.658 (overall: 41.810) SET: rps=422.3 (overall: 241.3) avg_msec=18.709 (overall: 40.797) SET: rps=513.9 (overall: 248.0) avg_msec=23.062 (overall: 39.898) SET: rps=39.8 (overall: 243.0) avg_msec=199.949 (overall: 40.525) SET: rps=39.5 (overall: 238.2) avg_msec=249.530 (overall: 41.339) SET: rps=59.8 (overall: 234.1) avg_msec=167.243 (overall: 42.071) SET: rps=390.4 (overall: 237.6) avg_msec=30.387 (overall: 41.643) SET: rps=159.4 (overall: 235.9) avg_msec=50.252 (overall: 41.770) SET: rps=199.2 (overall: 235.1) avg_msec=33.928 (overall: 41.628) SET: rps=27.9 (overall: 230.8) avg_msec=326.711 (overall: 42.347) SET: rps=79.7 (overall: 227.7) avg_msec=159.808 (overall: 43.188) SET: rps=107.6 (overall: 225.3) avg_msec=104.010 (overall: 43.769) SET: rps=71.7 (overall: 222.3) avg_msec=144.075 (overall: 44.405) SET: rps=8.0 (overall: 218.2) avg_msec=299.648 (overall: 44.584) SET: rps=119.5 (overall: 216.3) avg_msec=132.934 (overall: 45.507) SET: rps=287.4 (overall: 217.6) avg_msec=38.810 (overall: 45.341) SET: rps=591.3 (overall: 224.5) avg_msec=20.039 (overall: 44.123) SET: rps=577.7 (overall: 230.8) avg_msec=13.534 (overall: 42.754) SET: rps=246.0 (overall: 231.1) avg_msec=47.919 (overall: 42.851) SET: rps=176.0 (overall: 230.1) avg_msec=45.154 (overall: 42.881) SET: rps=123.0 (overall: 228.3) avg_msec=96.695 (overall: 43.375) SET: rps=633.5 (overall: 235.0) avg_msec=12.745 (overall: 41.998) SET: rps=95.6 (overall: 232.8) avg_msec=123.551 (overall: 42.548) SET: rps=486.1 (overall: 236.8) avg_msec=16.443 (overall: 41.683) SET: rps=142.9 (overall: 235.3) avg_msec=71.350 (overall: 41.970) SET: rps=15.9 (overall: 231.9) avg_msec=199.680 (overall: 42.139) SET: rps=27.9 (overall: 228.8) avg_msec=442.862 (overall: 42.892) SET: rps=12.0 (overall: 225.5) avg_msec=799.488 (overall: 43.500) SET: rps=27.8 (overall: 222.5) avg_msec=471.826 (overall: 44.302) SET: rps=119.5 (overall: 221.0) avg_msec=103.126 (overall: 44.770) SET: rps=79.7 (overall: 219.0) avg_msec=105.475 (overall: 45.090) SET: rps=167.3 (overall: 218.2) avg_msec=85.730 (overall: 45.536) SET: rps=310.8 (overall: 219.5) avg_msec=25.527 (overall: 45.137) SET: rps=80.0 (overall: 217.6) avg_msec=148.995 (overall: 45.665) SET: rps=261.9 (overall: 218.2) avg_msec=30.765 (overall: 45.419) SET: rps=720.0 (overall: 225.0) avg_msec=16.441 (overall: 44.170) SET: rps=286.9 (overall: 225.8) avg_msec=27.878 (overall: 43.894) SET: rps=306.8 (overall: 226.9) avg_msec=26.022 (overall: 43.575) SET: rps=171.3 (overall: 226.1) avg_msec=69.625 (overall: 43.832) SET: rps=649.4 (overall: 231.6) avg_msec=18.357 (overall: 42.915) SET: rps=8.0 (overall: 228.7) avg_msec=96.192 (overall: 42.939) SET: rps=31.9 (overall: 226.3) avg_msec=345.792 (overall: 43.472) SET: rps=79.7 (overall: 224.5) avg_msec=200.195 (overall: 44.160) SET: rps=466.1 (overall: 227.4) avg_msec=25.641 (overall: 43.697) SET: rps=199.2 (overall: 227.1) avg_msec=39.805 (overall: 43.655) SET: 237.48 requests per second, p50=0.735 msec GET: rps=0.0 (overall: -nan) avg_msec=-nan (overall: -nan) GET: rps=1211.2 (overall: 1211.2) avg_msec=5.575 (overall: 5.575) GET: rps=452.0 (overall: 832.3) avg_msec=26.189 (overall: 11.161) GET: rps=0.0 (overall: 553.8) avg_msec=-nan (overall: 11.161) GET: rps=0.0 (overall: 414.5) avg_msec=-nan (overall: 11.161) GET: rps=0.0 (overall: 331.7) avg_msec=-nan (overall: 11.161) GET: rps=79.7 (overall: 289.8) avg_msec=498.925 (overall: 33.484) GET: rps=167.3 (overall: 272.3) avg_msec=48.239 (overall: 34.778) GET: rps=63.5 (overall: 246.1) avg_msec=187.424 (overall: 39.712) GET: rps=40.0 (overall: 223.4) avg_msec=127.280 (overall: 41.446) GET: rps=79.4 (overall: 208.9) avg_msec=185.616 (overall: 46.938) GET: rps=0.0 (overall: 189.9) avg_msec=-nan (overall: 46.938) GET: rps=39.8 (overall: 177.4) avg_msec=427.981 (overall: 54.060) GET: rps=0.0 (overall: 163.8) avg_msec=-nan (overall: 54.060) GET: rps=51.8 (overall: 155.8) avg_msec=437.969 (overall: 63.168) GET: rps=99.2 (overall: 152.0) avg_msec=100.338 (overall: 64.789) GET: rps=341.3 (overall: 163.9) avg_msec=29.468 (overall: 60.180) GET: rps=492.0 (overall: 183.1) avg_msec=23.809 (overall: 54.459) GET: rps=293.7 (overall: 189.3) avg_msec=26.797 (overall: 52.068) GET: rps=119.5 (overall: 185.6) avg_msec=99.326 (overall: 53.668) GET: rps=394.4 (overall: 196.0) avg_msec=20.312 (overall: 50.315) GET: rps=1689.2 (overall: 267.1) avg_msec=7.012 (overall: 37.284) GET: rps=322.7 (overall: 269.6) avg_msec=24.119 (overall: 36.569) GET: rps=79.7 (overall: 261.3) avg_msec=109.984 (overall: 37.541) GET: rps=0.0 (overall: 250.5) avg_msec=-nan (overall: 37.541) GET: rps=31.9 (overall: 241.7) avg_msec=450.176 (overall: 39.716) GET: rps=0.0 (overall: 232.5) avg_msec=-nan (overall: 39.716) GET: rps=119.0 (overall: 228.3) avg_msec=239.910 (overall: 43.596) GET: rps=39.8 (overall: 221.5) avg_msec=99.373 (overall: 43.954) GET: rps=39.8 (overall: 215.3) avg_msec=229.472 (overall: 45.137) GET: rps=183.3 (overall: 214.2) avg_msec=80.848 (overall: 46.154) GET: rps=199.2 (overall: 213.7) avg_msec=59.643 (overall: 46.560) GET: rps=350.6 (overall: 218.0) avg_msec=22.730 (overall: 45.363) GET: rps=79.7 (overall: 213.8) avg_msec=148.832 (overall: 46.531) GET: rps=223.1 (overall: 214.1) avg_msec=36.027 (overall: 46.209) GET: rps=194.4 (overall: 213.5) avg_msec=60.891 (overall: 46.592) GET: rps=39.8 (overall: 208.7) avg_msec=139.110 (overall: 47.082) GET: rps=8.0 (overall: 203.3) avg_msec=298.240 (overall: 47.348) GET: rps=31.9 (overall: 198.8) avg_msec=474.768 (overall: 49.151) GET: rps=179.3 (overall: 198.3) avg_msec=71.188 (overall: 49.662) GET: rps=239.0 (overall: 199.3) avg_msec=50.069 (overall: 49.674) GET: rps=119.5 (overall: 197.3) avg_msec=99.501 (overall: 50.409) GET: rps=159.4 (overall: 196.4) avg_msec=42.388 (overall: 50.255) GET: rps=11.9 (overall: 192.1) avg_msec=198.592 (overall: 50.469) GET: rps=0.0 (overall: 187.8) avg_msec=-nan (overall: 50.469) GET: rps=27.9 (overall: 184.2) avg_msec=656.859 (overall: 52.508) GET: rps=12.0 (overall: 180.5) avg_msec=900.864 (overall: 53.728) GET: rps=27.9 (overall: 177.2) avg_msec=528.585 (overall: 55.317) GET: rps=103.2 (overall: 175.7) avg_msec=143.008 (overall: 56.394) GET: rps=729.1 (overall: 187.0) avg_msec=16.601 (overall: 53.229) GET: rps=262.9 (overall: 188.5) avg_msec=29.073 (overall: 52.556) GET: rps=71.4 (overall: 186.2) avg_msec=143.321 (overall: 53.241) GET: rps=103.6 (overall: 184.6) avg_msec=92.519 (overall: 53.664) GET: rps=438.2 (overall: 189.4) avg_msec=25.363 (overall: 52.429) GET: rps=143.4 (overall: 188.5) avg_msec=61.207 (overall: 52.553) GET: rps=608.0 (overall: 196.1) avg_msec=19.847 (overall: 50.718) GET: rps=191.2 (overall: 196.0) avg_msec=40.895 (overall: 50.547) GET: rps=1298.8 (overall: 215.4) avg_msec=9.359 (overall: 46.191) GET: rps=442.2 (overall: 219.3) avg_msec=26.000 (overall: 45.490) GET: rps=163.3 (overall: 218.3) avg_msec=37.648 (overall: 45.390) GET: rps=115.5 (overall: 216.6) avg_msec=119.292 (overall: 46.047) GET: rps=705.2 (overall: 224.6) avg_msec=11.296 (overall: 44.259) GET: rps=141.7 (overall: 223.3) avg_msec=57.395 (overall: 44.395) GET: rps=105.3 (overall: 221.2) avg_msec=97.141 (overall: 44.847) GET: rps=0.0 (overall: 217.7) avg_msec=-nan (overall: 44.847) GET: rps=0.0 (overall: 214.4) avg_msec=-nan (overall: 44.847) GET: rps=39.8 (overall: 211.7) avg_msec=697.651 (overall: 46.703) GET: rps=0.0 (overall: 208.6) avg_msec=-nan (overall: 46.703) GET: rps=0.0 (overall: 205.4) avg_msec=-nan (overall: 46.703) GET: rps=0.0 (overall: 202.4) avg_msec=-nan (overall: 46.703) GET: rps=22.8 (overall: 199.8) avg_msec=1098.752 (overall: 48.495) GET: rps=151.4 (overall: 199.1) avg_msec=194.795 (overall: 50.056) GET: rps=278.9 (overall: 200.2) avg_msec=28.555 (overall: 49.641) GET: rps=67.7 (overall: 198.4) avg_msec=140.431 (overall: 50.064) GET: rps=47.6 (overall: 196.3) avg_msec=216.741 (overall: 50.611) GET: rps=394.4 (overall: 199.0) avg_msec=30.027 (overall: 50.069) GET: rps=281.7 (overall: 200.1) avg_msec=28.350 (overall: 49.666) GET: rps=215.1 (overall: 200.3) avg_msec=55.464 (overall: 49.747) GET: rps=812.7 (overall: 208.1) avg_msec=10.065 (overall: 47.766) GET: rps=138.6 (overall: 207.2) avg_msec=81.164 (overall: 48.066) GET: rps=355.6 (overall: 209.1) avg_msec=20.992 (overall: 47.450) GET: rps=75.7 (overall: 207.5) avg_msec=136.141 (overall: 47.848) GET: rps=432.5 (overall: 210.2) avg_msec=27.724 (overall: 47.343) GET: rps=63.7 (overall: 208.5) avg_msec=109.988 (overall: 47.573) GET: rps=39.8 (overall: 206.5) avg_msec=142.086 (overall: 47.789) GET: rps=0.0 (overall: 204.1) avg_msec=-nan (overall: 47.789) GET: rps=31.9 (overall: 202.1) avg_msec=521.632 (overall: 48.654) GET: rps=39.8 (overall: 200.2) avg_msec=361.011 (overall: 49.365) GET: rps=39.7 (overall: 198.4) avg_msec=328.781 (overall: 50.000) GET: rps=51.8 (overall: 196.8) avg_msec=208.102 (overall: 50.465) GET: rps=67.7 (overall: 195.3) avg_msec=175.942 (overall: 50.946) GET: rps=39.8 (overall: 193.6) avg_msec=101.165 (overall: 51.059) GET: rps=0.0 (overall: 191.5) avg_msec=-nan (overall: 51.059) GET: rps=75.7 (overall: 190.3) avg_msec=310.078 (overall: 52.162) GET: rps=163.3 (overall: 190.0) avg_msec=75.777 (overall: 52.377) GET: rps=167.3 (overall: 189.8) avg_msec=47.554 (overall: 52.333) GET: rps=864.5 (overall: 196.8) avg_msec=13.826 (overall: 50.578) GET: rps=637.5 (overall: 201.3) avg_msec=12.433 (overall: 49.338) GET: rps=119.5 (overall: 200.5) avg_msec=39.384 (overall: 49.278) GET: rps=39.8 (overall: 198.8) avg_msec=276.685 (overall: 49.736) GET: 199.45 requests per second, p50=0.663 msec INCR: rps=79.7 (overall: 181.8) avg_msec=36.165 (overall: 36.165) INCR: rps=269.8 (overall: 243.1) avg_msec=30.286 (overall: 31.622) INCR: rps=120.0 (overall: 192.8) avg_msec=97.144 (overall: 48.280) INCR: rps=462.2 (overall: 271.1) avg_msec=17.418 (overall: 32.981) INCR: rps=462.2 (overall: 314.2) avg_msec=25.549 (overall: 30.518) INCR: rps=290.8 (overall: 309.9) avg_msec=27.589 (overall: 30.012) INCR: rps=318.7 (overall: 311.3) avg_msec=37.406 (overall: 31.188) INCR: rps=302.8 (overall: 310.1) avg_msec=26.526 (overall: 30.576) INCR: rps=418.3 (overall: 322.9) avg_msec=19.737 (overall: 28.912) INCR: rps=155.4 (overall: 305.2) avg_msec=74.445 (overall: 31.368) INCR: rps=112.0 (overall: 286.8) avg_msec=91.847 (overall: 33.623) INCR: rps=7.9 (overall: 262.3) avg_msec=296.448 (overall: 34.321) INCR: rps=0.0 (overall: 241.2) avg_msec=-nan (overall: 34.321) INCR: rps=23.9 (overall: 225.0) avg_msec=799.915 (overall: 40.374) INCR: rps=0.0 (overall: 209.4) avg_msec=-nan (overall: 40.374) INCR: rps=8.0 (overall: 196.4) avg_msec=1099.264 (overall: 43.156) INCR: rps=0.0 (overall: 184.4) avg_msec=-nan (overall: 43.156) INCR: rps=0.0 (overall: 173.9) avg_msec=-nan (overall: 43.156) INCR: rps=0.0 (overall: 164.4) avg_msec=-nan (overall: 43.156) INCR: rps=31.9 (overall: 157.6) avg_msec=1600.128 (overall: 59.354) INCR: rps=7.9 (overall: 150.3) avg_msec=1600.000 (overall: 63.350) INCR: rps=0.0 (overall: 143.3) avg_msec=-nan (overall: 63.350) INCR: rps=63.5 (overall: 139.7) avg_msec=425.437 (overall: 70.712) INCR: rps=203.2 (overall: 142.4) avg_msec=59.226 (overall: 70.013) INCR: rps=32.0 (overall: 137.9) avg_msec=96.880 (overall: 70.267) INCR: rps=7.9 (overall: 132.8) avg_msec=296.320 (overall: 70.800) INCR: rps=63.7 (overall: 130.2) avg_msec=337.656 (overall: 75.742) INCR: rps=270.9 (overall: 135.3) avg_msec=47.008 (overall: 73.645) INCR: rps=159.4 (overall: 136.2) avg_msec=30.721 (overall: 71.879) INCR: rps=343.2 (overall: 143.7) avg_msec=40.512 (overall: 69.140) INCR: rps=102.8 (overall: 142.4) avg_msec=76.657 (overall: 69.319) INCR: rps=80.0 (overall: 140.4) avg_msec=150.288 (overall: 70.776) INCR: rps=0.0 (overall: 136.1) avg_msec=-nan (overall: 70.776) INCR: rps=39.8 (overall: 133.2) avg_msec=417.894 (overall: 73.873) INCR: rps=31.9 (overall: 130.3) avg_msec=300.832 (overall: 75.481) INCR: rps=71.7 (overall: 128.6) avg_msec=188.388 (overall: 77.253) INCR: rps=23.9 (overall: 125.7) avg_msec=199.723 (overall: 77.890) INCR: rps=7.8 (overall: 122.5) avg_msec=399.488 (overall: 78.447) INCR: rps=0.0 (overall: 119.4) avg_msec=-nan (overall: 78.447) INCR: rps=141.2 (overall: 119.9) avg_msec=222.812 (overall: 82.811) INCR: rps=166.0 (overall: 121.1) avg_msec=71.881 (overall: 82.439) INCR: rps=183.3 (overall: 122.6) avg_msec=42.744 (overall: 81.011) INCR: rps=39.8 (overall: 120.6) avg_msec=298.163 (overall: 82.696) INCR: rps=71.4 (overall: 119.5) avg_msec=99.577 (overall: 82.928) INCR: rps=8.0 (overall: 117.0) avg_msec=198.464 (overall: 83.105) INCR: rps=79.7 (overall: 116.2) avg_msec=240.820 (overall: 85.478) INCR: rps=167.3 (overall: 117.3) avg_msec=47.001 (overall: 84.299) INCR: rps=179.3 (overall: 118.6) avg_msec=66.943 (overall: 83.748) INCR: rps=641.4 (overall: 129.3) avg_msec=18.316 (overall: 77.068) INCR: rps=39.7 (overall: 127.5) avg_msec=199.987 (overall: 77.842) INCR: rps=71.7 (overall: 126.4) avg_msec=111.168 (overall: 78.216) INCR: rps=8.0 (overall: 124.1) avg_msec=299.008 (overall: 78.491) INCR: rps=0.0 (overall: 121.8) avg_msec=-nan (overall: 78.491) INCR: rps=63.7 (overall: 120.7) avg_msec=401.057 (overall: 81.671) INCR: rps=95.6 (overall: 120.2) avg_msec=136.684 (overall: 82.472) INCR: rps=4.0 (overall: 118.1) avg_msec=296.064 (overall: 82.602) INCR: rps=119.5 (overall: 118.1) avg_msec=137.007 (overall: 83.575) INCR: rps=0.0 (overall: 116.1) avg_msec=-nan (overall: 83.575) INCR: rps=39.2 (overall: 114.8) avg_msec=448.563 (overall: 85.737) INCR: rps=31.9 (overall: 113.4) avg_msec=324.704 (overall: 86.864) INCR: rps=107.6 (overall: 113.3) avg_msec=156.777 (overall: 87.960) INCR: rps=80.0 (overall: 112.7) avg_msec=98.790 (overall: 88.084) INCR: rps=39.7 (overall: 111.6) avg_msec=218.560 (overall: 88.828) INCR: rps=0.0 (overall: 109.8) avg_msec=-nan (overall: 88.828) INCR: rps=0.0 (overall: 108.1) avg_msec=-nan (overall: 88.828) INCR: rps=171.3 (overall: 109.1) avg_msec=182.532 (overall: 91.072) INCR: rps=107.1 (overall: 109.1) avg_msec=87.109 (overall: 91.013) INCR: rps=39.8 (overall: 108.0) avg_msec=159.482 (overall: 91.386) INCR: rps=39.7 (overall: 107.0) avg_msec=269.562 (overall: 92.353) INCR: rps=95.6 (overall: 106.9) avg_msec=154.405 (overall: 93.151) INCR: rps=95.6 (overall: 106.7) avg_msec=87.046 (overall: 93.073) INCR: rps=8.0 (overall: 105.3) avg_msec=299.776 (overall: 93.292) INCR: rps=31.9 (overall: 104.3) avg_msec=414.160 (overall: 94.642) INCR: rps=0.0 (overall: 102.9) avg_msec=-nan (overall: 94.642) INCR: rps=183.3 (overall: 104.0) avg_msec=143.540 (overall: 95.797) INCR: rps=147.4 (overall: 104.5) avg_msec=53.314 (overall: 95.005) INCR: rps=107.6 (overall: 104.6) avg_msec=111.956 (overall: 95.233) INCR: rps=182.5 (overall: 105.6) avg_msec=64.634 (overall: 94.548) INCR: rps=8.0 (overall: 104.4) avg_msec=100.160 (overall: 94.554) INCR: rps=274.9 (overall: 106.5) avg_msec=61.001 (overall: 93.466) INCR: rps=135.5 (overall: 106.9) avg_msec=76.117 (overall: 93.193) INCR: rps=330.7 (overall: 109.6) avg_msec=28.807 (overall: 90.813) INCR: rps=8.0 (overall: 108.4) avg_msec=197.888 (overall: 90.908) INCR: rps=374.5 (overall: 111.6) avg_msec=55.415 (overall: 89.483) INCR: rps=226.2 (overall: 112.9) avg_msec=34.678 (overall: 88.180) INCR: rps=330.7 (overall: 115.5) avg_msec=36.062 (overall: 86.437) INCR: rps=123.0 (overall: 115.5) avg_msec=38.971 (overall: 85.851) INCR: rps=23.9 (overall: 114.5) avg_msec=395.989 (overall: 86.590) INCR: rps=15.9 (overall: 113.4) avg_msec=497.920 (overall: 87.242) INCR: rps=143.4 (overall: 113.7) avg_msec=122.538 (overall: 87.739) INCR: rps=23.9 (overall: 112.7) avg_msec=198.891 (overall: 87.999) INCR: rps=147.4 (overall: 113.1) avg_msec=80.790 (overall: 87.896) INCR: rps=0.0 (overall: 111.9) avg_msec=-nan (overall: 87.896) INCR: rps=107.6 (overall: 111.8) avg_msec=148.543 (overall: 88.520) INCR: rps=12.0 (overall: 110.8) avg_msec=398.635 (overall: 88.873) INCR: rps=80.0 (overall: 110.5) avg_msec=244.864 (overall: 90.050) INCR: rps=214.3 (overall: 111.5) avg_msec=49.881 (overall: 89.248) INCR: rps=31.9 (overall: 110.7) avg_msec=300.384 (overall: 89.871) INCR: rps=318.7 (overall: 112.8) avg_msec=32.562 (overall: 88.229) INCR: rps=358.6 (overall: 115.3) avg_msec=33.054 (overall: 86.507) INCR: rps=480.2 (overall: 118.9) avg_msec=16.467 (overall: 83.686) INCR: rps=402.4 (overall: 121.7) avg_msec=29.841 (overall: 81.934) INCR: rps=325.4 (overall: 123.7) avg_msec=24.464 (overall: 80.455) INCR: rps=532.0 (overall: 127.6) avg_msec=22.434 (overall: 78.131) INCR: rps=253.0 (overall: 128.9) avg_msec=30.588 (overall: 77.232) INCR: rps=470.1 (overall: 132.1) avg_msec=18.576 (overall: 75.256) INCR: rps=239.0 (overall: 133.1) avg_msec=46.888 (overall: 74.778) INCR: rps=398.4 (overall: 135.6) avg_msec=29.953 (overall: 73.554) INCR: rps=326.7 (overall: 137.3) avg_msec=24.336 (overall: 72.476) INCR: rps=191.2 (overall: 137.8) avg_msec=47.703 (overall: 72.162) INCR: rps=0.0 (overall: 136.6) avg_msec=-nan (overall: 72.162) INCR: rps=0.0 (overall: 135.3) avg_msec=-nan (overall: 72.162) INCR: rps=31.9 (overall: 134.4) avg_msec=672.128 (overall: 73.425) INCR: rps=39.7 (overall: 133.6) avg_msec=490.394 (overall: 74.520) INCR: rps=120.0 (overall: 133.5) avg_msec=113.035 (overall: 74.821) INCR: rps=71.7 (overall: 132.9) avg_msec=100.100 (overall: 74.938) INCR: rps=39.8 (overall: 132.1) avg_msec=140.182 (overall: 75.107) INCR: rps=27.9 (overall: 131.2) avg_msec=398.391 (overall: 75.691) INCR: rps=31.9 (overall: 130.4) avg_msec=374.656 (overall: 76.307) INCR: rps=47.6 (overall: 129.7) avg_msec=250.368 (overall: 76.843) INCR: rps=99.6 (overall: 129.5) avg_msec=83.983 (overall: 76.889) INCR: rps=15.9 (overall: 128.5) avg_msec=298.880 (overall: 77.115) INCR: rps=239.0 (overall: 129.4) avg_msec=78.303 (overall: 77.133) INCR: rps=203.2 (overall: 130.0) avg_msec=39.187 (overall: 76.653) INCR: rps=95.6 (overall: 129.8) avg_msec=100.339 (overall: 76.793) INCR: rps=103.6 (overall: 129.5) avg_msec=99.213 (overall: 76.936) INCR: rps=848.6 (overall: 135.2) avg_msec=14.208 (overall: 73.828) INCR: rps=310.8 (overall: 136.6) avg_msec=25.266 (overall: 72.962) INCR: rps=203.2 (overall: 137.1) avg_msec=23.759 (overall: 72.395) INCR: rps=31.9 (overall: 136.3) avg_msec=320.896 (overall: 72.843) INCR: rps=99.6 (overall: 136.0) avg_msec=167.967 (overall: 73.377) INCR: rps=39.8 (overall: 135.3) avg_msec=100.781 (overall: 73.438) INCR: rps=39.8 (overall: 134.6) avg_msec=249.491 (overall: 73.831) INCR: rps=0.0 (overall: 133.6) avg_msec=-nan (overall: 73.831) INCR: rps=31.9 (overall: 132.8) avg_msec=512.352 (overall: 74.613) INCR: rps=39.8 (overall: 132.1) avg_msec=341.133 (overall: 75.205) INCR: rps=39.8 (overall: 131.5) avg_msec=298.214 (overall: 75.700) INCR: rps=39.8 (overall: 130.8) avg_msec=300.339 (overall: 76.197) INCR: rps=39.8 (overall: 130.1) avg_msec=199.987 (overall: 76.470) INCR: rps=39.8 (overall: 129.5) avg_msec=202.944 (overall: 76.749) INCR: rps=39.8 (overall: 128.8) avg_msec=196.198 (overall: 77.012) INCR: rps=39.7 (overall: 128.2) avg_msec=300.570 (overall: 77.502) INCR: rps=31.9 (overall: 127.5) avg_msec=325.024 (overall: 77.936) INCR: rps=39.8 (overall: 126.9) avg_msec=339.533 (overall: 78.508) INCR: rps=404.0 (overall: 128.8) avg_msec=29.699 (overall: 77.453) INCR: rps=450.2 (overall: 131.0) avg_msec=17.912 (overall: 76.049) INCR: rps=151.4 (overall: 131.2) avg_msec=25.850 (overall: 75.654) INCR: rps=0.0 (overall: 130.3) avg_msec=-nan (overall: 75.654) INCR: rps=79.7 (overall: 130.0) avg_msec=283.372 (overall: 76.511) INCR: rps=40.0 (overall: 129.4) avg_msec=329.510 (overall: 77.031) INCR: rps=198.4 (overall: 129.8) avg_msec=45.999 (overall: 76.715) INCR: rps=0.0 (overall: 129.0) avg_msec=-nan (overall: 76.715) INCR: rps=158.1 (overall: 129.2) avg_msec=137.567 (overall: 77.207) INCR: rps=103.6 (overall: 129.0) avg_msec=84.569 (overall: 77.246) INCR: 129.63 requests per second, p50=1.039 msec LPUSH: rps=39.8 (overall: 47.6) avg_msec=88.256 (overall: 88.256) LPUSH: rps=31.9 (overall: 39.0) avg_msec=197.936 (overall: 137.003) LPUSH: rps=8.0 (overall: 28.1) avg_msec=300.160 (overall: 153.318) LPUSH: rps=0.0 (overall: 20.8) avg_msec=-nan (overall: 153.318) LPUSH: rps=27.9 (overall: 22.3) avg_msec=713.911 (overall: 298.657) LPUSH: rps=39.8 (overall: 25.3) avg_msec=500.934 (overall: 353.327) LPUSH: rps=39.8 (overall: 27.4) avg_msec=200.589 (overall: 320.829) LPUSH: rps=0.0 (overall: 23.9) avg_msec=-nan (overall: 320.829) LPUSH: rps=348.0 (overall: 60.5) avg_msec=75.863 (overall: 161.784) LPUSH: rps=337.3 (overall: 88.7) avg_msec=23.077 (overall: 107.948) LPUSH: rps=565.7 (overall: 132.8) avg_msec=21.272 (overall: 73.854) LPUSH: rps=580.0 (overall: 170.4) avg_msec=20.477 (overall: 58.558) LPUSH: rps=758.9 (overall: 216.6) avg_msec=10.469 (overall: 45.330) LPUSH: rps=677.3 (overall: 249.9) avg_msec=17.279 (overall: 39.836) LPUSH: rps=390.4 (overall: 259.4) avg_msec=20.615 (overall: 37.886) LPUSH: rps=119.5 (overall: 250.6) avg_msec=98.893 (overall: 39.724) LPUSH: rps=0.0 (overall: 235.7) avg_msec=-nan (overall: 39.724) LPUSH: rps=31.9 (overall: 224.3) avg_msec=499.872 (overall: 43.390) LPUSH: rps=39.7 (overall: 214.4) avg_msec=280.973 (overall: 45.733) LPUSH: rps=32.0 (overall: 205.3) avg_msec=224.272 (overall: 47.131) LPUSH: rps=0.0 (overall: 195.4) avg_msec=-nan (overall: 47.131) LPUSH: rps=23.9 (overall: 187.6) avg_msec=599.125 (overall: 50.353) LPUSH: rps=15.9 (overall: 180.0) avg_msec=749.568 (overall: 53.063) LPUSH: rps=183.3 (overall: 180.2) avg_msec=87.331 (overall: 54.525) LPUSH: rps=79.7 (overall: 176.1) avg_msec=138.989 (overall: 56.064) LPUSH: rps=0.0 (overall: 169.3) avg_msec=-nan (overall: 56.064) LPUSH: rps=31.9 (overall: 164.2) avg_msec=399.552 (overall: 58.548) LPUSH: rps=167.3 (overall: 164.3) avg_msec=100.222 (overall: 60.073) LPUSH: rps=257.9 (overall: 167.6) avg_msec=40.190 (overall: 59.007) LPUSH: rps=19.9 (overall: 162.6) avg_msec=96.928 (overall: 59.163) LPUSH: rps=39.8 (overall: 158.6) avg_msec=418.381 (overall: 62.088) LPUSH: rps=19.8 (overall: 154.3) avg_msec=360.218 (overall: 63.297) LPUSH: rps=39.8 (overall: 150.8) avg_msec=299.194 (overall: 65.195) LPUSH: rps=1027.9 (overall: 176.7) avg_msec=13.865 (overall: 56.372) LPUSH: rps=334.7 (overall: 181.2) avg_msec=22.956 (overall: 54.601) LPUSH: rps=167.3 (overall: 180.8) avg_msec=51.605 (overall: 54.524) LPUSH: rps=19.9 (overall: 176.5) avg_msec=300.672 (overall: 55.278) LPUSH: rps=59.8 (overall: 173.4) avg_msec=286.263 (overall: 57.382) LPUSH: rps=0.0 (overall: 168.9) avg_msec=-nan (overall: 57.382) LPUSH: rps=39.8 (overall: 165.7) avg_msec=319.616 (overall: 58.964) LPUSH: rps=31.9 (overall: 162.4) avg_msec=349.920 (overall: 60.362) LPUSH: rps=23.9 (overall: 159.1) avg_msec=400.149 (overall: 61.582) LPUSH: rps=15.9 (overall: 155.8) avg_msec=499.936 (overall: 62.629) LPUSH: rps=39.8 (overall: 153.1) avg_msec=459.520 (overall: 64.985) LPUSH: rps=195.2 (overall: 154.1) avg_msec=41.407 (overall: 64.318) LPUSH: rps=394.4 (overall: 159.3) avg_msec=28.842 (overall: 62.402) LPUSH: rps=4.0 (overall: 156.0) avg_msec=195.264 (overall: 62.475) LPUSH: rps=35.9 (overall: 153.5) avg_msec=421.988 (overall: 64.230) LPUSH: rps=15.9 (overall: 150.7) avg_msec=375.008 (overall: 64.903) LPUSH: rps=15.9 (overall: 147.9) avg_msec=449.856 (overall: 65.735) LPUSH: rps=0.0 (overall: 145.0) avg_msec=-nan (overall: 65.735) LPUSH: rps=760.0 (overall: 156.8) avg_msec=41.226 (overall: 63.454) LPUSH: rps=290.8 (overall: 159.4) avg_msec=26.931 (overall: 62.192) LPUSH: rps=404.8 (overall: 164.0) avg_msec=29.428 (overall: 60.684) LPUSH: rps=79.7 (overall: 162.4) avg_msec=98.413 (overall: 61.022) LPUSH: rps=282.9 (overall: 164.6) avg_msec=42.114 (overall: 60.440) LPUSH: rps=111.6 (overall: 163.6) avg_msec=99.847 (overall: 60.912) LPUSH: rps=32.0 (overall: 161.4) avg_msec=202.336 (overall: 61.395) LPUSH: rps=8.0 (overall: 158.8) avg_msec=499.328 (overall: 61.769) LPUSH: rps=0.0 (overall: 156.1) avg_msec=-nan (overall: 61.769) LPUSH: rps=104.0 (overall: 155.3) avg_msec=291.690 (overall: 64.290) LPUSH: rps=23.9 (overall: 153.1) avg_msec=199.637 (overall: 64.632) LPUSH: rps=195.2 (overall: 153.8) avg_msec=77.614 (overall: 64.894) LPUSH: rps=448.0 (overall: 158.4) avg_msec=17.948 (overall: 62.822) LPUSH: rps=565.7 (overall: 164.7) avg_msec=20.875 (overall: 60.600) LPUSH: rps=150.8 (overall: 164.5) avg_msec=52.569 (overall: 60.487) LPUSH: rps=394.4 (overall: 167.9) avg_msec=30.372 (overall: 59.429) LPUSH: rps=338.6 (overall: 170.4) avg_msec=23.390 (overall: 58.373) LPUSH: rps=215.1 (overall: 171.1) avg_msec=54.873 (overall: 58.309) LPUSH: rps=757.0 (overall: 179.5) avg_msec=10.647 (overall: 55.431) LPUSH: rps=297.6 (overall: 181.1) avg_msec=39.382 (overall: 55.057) LPUSH: rps=131.5 (overall: 180.4) avg_msec=60.863 (overall: 55.116) LPUSH: rps=412.0 (overall: 183.6) avg_msec=28.887 (overall: 54.311) LPUSH: rps=95.6 (overall: 182.4) avg_msec=49.799 (overall: 54.279) LPUSH: rps=247.0 (overall: 183.3) avg_msec=61.302 (overall: 54.406) LPUSH: rps=100.0 (overall: 182.2) avg_msec=55.679 (overall: 54.415) LPUSH: rps=7.9 (overall: 179.9) avg_msec=198.912 (overall: 54.498) LPUSH: rps=23.9 (overall: 177.9) avg_msec=549.397 (overall: 55.352) LPUSH: rps=8.0 (overall: 175.8) avg_msec=651.264 (overall: 55.695) LPUSH: rps=0.0 (overall: 173.6) avg_msec=-nan (overall: 55.695) LPUSH: rps=39.8 (overall: 171.9) avg_msec=731.827 (overall: 57.634) LPUSH: rps=0.0 (overall: 169.8) avg_msec=-nan (overall: 57.634) LPUSH: rps=68.7 (overall: 168.5) avg_msec=271.430 (overall: 58.731) LPUSH: rps=31.7 (overall: 166.9) avg_msec=348.512 (overall: 59.391) LPUSH: rps=135.5 (overall: 166.5) avg_msec=77.291 (overall: 59.563) LPUSH: rps=119.5 (overall: 166.0) avg_msec=79.196 (overall: 59.727) LPUSH: rps=39.8 (overall: 164.5) avg_msec=288.627 (overall: 60.365) LPUSH: rps=357.1 (overall: 166.7) avg_msec=30.144 (overall: 59.626) LPUSH: rps=660.0 (overall: 172.2) avg_msec=18.150 (overall: 57.845) LPUSH: rps=178.6 (overall: 172.3) avg_msec=43.947 (overall: 57.684) LPUSH: rps=308.0 (overall: 173.8) avg_msec=38.966 (overall: 57.320) LPUSH: rps=198.4 (overall: 174.1) avg_msec=39.594 (overall: 57.100) LPUSH: rps=576.0 (overall: 178.4) avg_msec=21.014 (overall: 55.850) LPUSH: rps=227.1 (overall: 178.9) avg_msec=34.162 (overall: 55.557) LPUSH: rps=591.3 (overall: 183.3) avg_msec=20.081 (overall: 54.346) LPUSH: rps=39.5 (overall: 181.8) avg_msec=229.280 (overall: 54.746) LPUSH: rps=112.0 (overall: 181.0) avg_msec=89.299 (overall: 54.966) LPUSH: rps=7.9 (overall: 179.3) avg_msec=296.576 (overall: 55.075) LPUSH: rps=23.9 (overall: 177.7) avg_msec=499.883 (overall: 55.680) LPUSH: rps=39.7 (overall: 176.3) avg_msec=379.878 (overall: 56.414) LPUSH: rps=39.8 (overall: 175.0) avg_msec=280.064 (overall: 56.918) LPUSH: rps=75.7 (overall: 174.0) avg_msec=157.927 (overall: 57.350) LPUSH: rps=171.3 (overall: 174.0) avg_msec=46.987 (overall: 57.251) LPUSH: rps=976.1 (overall: 181.7) avg_msec=12.179 (overall: 54.920) LPUSH: rps=324.0 (overall: 183.0) avg_msec=24.204 (overall: 54.404) LPUSH: rps=191.2 (overall: 183.1) avg_msec=62.430 (overall: 54.483) LPUSH: 186.80 requests per second, p50=0.711 msec RPUSH: rps=404.8 (overall: 2615.4) avg_msec=0.939 (overall: 0.939) RPUSH: rps=79.7 (overall: 420.7) avg_msec=131.070 (overall: 22.272) RPUSH: rps=432.5 (overall: 426.2) avg_msec=18.498 (overall: 20.491) RPUSH: rps=486.1 (overall: 445.1) avg_msec=24.438 (overall: 21.855) RPUSH: rps=292.0 (overall: 408.4) avg_msec=27.165 (overall: 22.765) RPUSH: rps=282.9 (overall: 384.1) avg_msec=28.216 (overall: 23.544) RPUSH: rps=27.8 (overall: 326.0) avg_msec=225.326 (overall: 26.347) RPUSH: rps=123.5 (overall: 297.7) avg_msec=122.553 (overall: 31.921) RPUSH: rps=59.8 (overall: 268.6) avg_msec=173.404 (overall: 35.780) RPUSH: rps=79.7 (overall: 247.9) avg_msec=109.363 (overall: 38.362) RPUSH: rps=0.0 (overall: 223.5) avg_msec=-nan (overall: 38.362) RPUSH: rps=0.0 (overall: 203.6) avg_msec=-nan (overall: 38.362) RPUSH: rps=0.0 (overall: 186.8) avg_msec=-nan (overall: 38.362) RPUSH: rps=24.0 (overall: 174.5) avg_msec=1049.216 (overall: 48.891) RPUSH: rps=47.6 (overall: 165.5) avg_msec=541.941 (overall: 58.954) RPUSH: rps=39.8 (overall: 157.2) avg_msec=130.291 (overall: 60.147) RPUSH: rps=71.7 (overall: 151.9) avg_msec=193.993 (overall: 64.058) RPUSH: rps=308.3 (overall: 161.1) avg_msec=41.686 (overall: 61.543) RPUSH: rps=334.7 (overall: 170.7) avg_msec=22.562 (overall: 57.334) RPUSH: rps=131.5 (overall: 168.6) avg_msec=90.482 (overall: 58.683) RPUSH: rps=223.1 (overall: 171.3) avg_msec=35.768 (overall: 57.203) RPUSH: rps=131.5 (overall: 169.4) avg_msec=90.856 (overall: 58.437) RPUSH: rps=39.7 (overall: 163.6) avg_msec=97.568 (overall: 58.867) RPUSH: rps=39.5 (overall: 158.2) avg_msec=239.770 (overall: 60.833) RPUSH: rps=0.0 (overall: 151.6) avg_msec=-nan (overall: 60.833) RPUSH: rps=378.5 (overall: 160.6) avg_msec=59.181 (overall: 60.679) RPUSH: rps=39.8 (overall: 156.0) avg_msec=216.742 (overall: 62.201) RPUSH: rps=78.7 (overall: 153.1) avg_msec=154.782 (overall: 63.973) RPUSH: rps=139.4 (overall: 152.7) avg_msec=105.720 (overall: 65.326) RPUSH: rps=39.7 (overall: 148.8) avg_msec=99.597 (overall: 65.641) RPUSH: rps=0.0 (overall: 143.9) avg_msec=-nan (overall: 65.641) RPUSH: rps=39.8 (overall: 140.5) avg_msec=550.106 (overall: 70.045) RPUSH: rps=12.0 (overall: 136.5) avg_msec=401.024 (overall: 70.945) RPUSH: rps=63.5 (overall: 134.3) avg_msec=243.694 (overall: 73.415) RPUSH: rps=159.4 (overall: 135.1) avg_msec=65.103 (overall: 73.128) RPUSH: rps=79.7 (overall: 133.5) avg_msec=139.897 (overall: 74.261) RPUSH: rps=294.8 (overall: 137.9) avg_msec=40.616 (overall: 72.274) RPUSH: rps=79.7 (overall: 136.4) avg_msec=98.189 (overall: 72.681) RPUSH: rps=187.3 (overall: 137.7) avg_msec=59.439 (overall: 72.209) RPUSH: rps=47.6 (overall: 135.4) avg_msec=183.083 (overall: 73.208) RPUSH: rps=737.1 (overall: 150.4) avg_msec=16.167 (overall: 66.252) RPUSH: rps=442.2 (overall: 157.4) avg_msec=18.156 (overall: 62.973) RPUSH: rps=151.4 (overall: 157.3) avg_msec=77.701 (overall: 63.309) RPUSH: rps=39.8 (overall: 154.6) avg_msec=99.622 (overall: 63.525) RPUSH: rps=373.0 (overall: 159.5) avg_msec=42.587 (overall: 62.413) RPUSH: rps=256.0 (overall: 161.7) avg_msec=31.447 (overall: 61.333) RPUSH: rps=151.4 (overall: 161.4) avg_msec=73.316 (overall: 61.576) RPUSH: rps=39.8 (overall: 158.9) avg_msec=117.638 (overall: 61.874) RPUSH: rps=31.7 (overall: 156.2) avg_msec=399.744 (overall: 63.304) RPUSH: rps=8.0 (overall: 153.2) avg_msec=500.480 (overall: 63.766) RPUSH: rps=31.9 (overall: 150.8) avg_msec=425.024 (overall: 65.287) RPUSH: rps=0.0 (overall: 147.9) avg_msec=-nan (overall: 65.287) RPUSH: rps=27.8 (overall: 145.6) avg_msec=515.877 (overall: 66.941) RPUSH: rps=12.0 (overall: 143.0) avg_msec=899.413 (overall: 68.249) RPUSH: rps=39.8 (overall: 141.1) avg_msec=439.270 (overall: 70.181) RPUSH: rps=15.9 (overall: 138.9) avg_msec=299.072 (overall: 70.657) RPUSH: rps=47.8 (overall: 137.2) avg_msec=366.880 (overall: 72.493) RPUSH: rps=79.7 (overall: 136.2) avg_msec=105.768 (overall: 72.833) RPUSH: rps=466.1 (overall: 141.9) avg_msec=25.530 (overall: 70.164) RPUSH: rps=370.1 (overall: 145.8) avg_msec=20.974 (overall: 68.030) RPUSH: rps=794.5 (overall: 156.7) avg_msec=14.848 (overall: 63.516) RPUSH: rps=350.2 (overall: 159.9) avg_msec=22.170 (overall: 62.002) RPUSH: rps=369.0 (overall: 163.3) avg_msec=32.041 (overall: 60.910) RPUSH: rps=334.7 (overall: 166.0) avg_msec=35.464 (overall: 60.098) RPUSH: rps=713.1 (overall: 174.5) avg_msec=11.404 (overall: 57.001) RPUSH: rps=832.7 (overall: 184.6) avg_msec=13.880 (overall: 54.020) RPUSH: rps=513.9 (overall: 189.6) avg_msec=15.482 (overall: 52.442) RPUSH: rps=936.0 (overall: 200.6) avg_msec=12.766 (overall: 49.701) RPUSH: rps=853.2 (overall: 210.2) avg_msec=9.190 (overall: 47.282) RPUSH: rps=83.7 (overall: 208.4) avg_msec=102.664 (overall: 47.603) RPUSH: rps=0.0 (overall: 205.4) avg_msec=-nan (overall: 47.603) RPUSH: rps=0.0 (overall: 202.6) avg_msec=-nan (overall: 47.603) RPUSH: rps=31.9 (overall: 200.2) avg_msec=701.184 (overall: 49.043) RPUSH: rps=8.0 (overall: 197.6) avg_msec=800.000 (overall: 49.457) RPUSH: rps=255.0 (overall: 198.3) avg_msec=72.092 (overall: 49.849) RPUSH: rps=39.7 (overall: 196.2) avg_msec=216.781 (overall: 50.299) RPUSH: rps=71.7 (overall: 194.6) avg_msec=211.460 (overall: 51.078) RPUSH: rps=171.3 (overall: 194.3) avg_msec=69.810 (overall: 51.292) RPUSH: rps=187.3 (overall: 194.2) avg_msec=42.194 (overall: 51.180) RPUSH: rps=228.0 (overall: 194.6) avg_msec=52.884 (overall: 51.205) RPUSH: rps=470.1 (overall: 198.1) avg_msec=17.095 (overall: 50.196) RPUSH: rps=321.4 (overall: 199.6) avg_msec=36.507 (overall: 49.924) RPUSH: rps=513.9 (overall: 203.4) avg_msec=15.410 (overall: 48.863) RPUSH: rps=155.4 (overall: 202.8) avg_msec=66.778 (overall: 49.028) RPUSH: rps=55.8 (overall: 201.1) avg_msec=169.952 (overall: 49.426) RPUSH: rps=517.9 (overall: 204.8) avg_msec=23.317 (overall: 48.652) RPUSH: rps=661.4 (overall: 210.1) avg_msec=12.173 (overall: 47.320) RPUSH: rps=334.7 (overall: 211.5) avg_msec=34.922 (overall: 47.095) RPUSH: rps=71.7 (overall: 209.9) avg_msec=109.550 (overall: 47.337) RPUSH: rps=79.4 (overall: 208.5) avg_msec=99.930 (overall: 47.562) RPUSH: rps=0.0 (overall: 206.2) avg_msec=-nan (overall: 47.562) RPUSH: rps=32.0 (overall: 204.3) avg_msec=599.552 (overall: 48.506) RPUSH: rps=8.0 (overall: 202.1) avg_msec=799.488 (overall: 48.827) RPUSH: rps=8.0 (overall: 200.0) avg_msec=501.376 (overall: 49.021) RPUSH: rps=108.0 (overall: 199.1) avg_msec=196.277 (overall: 49.865) RPUSH: rps=31.9 (overall: 197.3) avg_msec=262.600 (overall: 50.226) RPUSH: rps=47.6 (overall: 195.8) avg_msec=266.416 (overall: 50.774) RPUSH: rps=72.0 (overall: 194.5) avg_msec=72.700 (overall: 50.857) RPUSH: rps=119.0 (overall: 193.7) avg_msec=123.004 (overall: 51.310) RPUSH: 201.01 requests per second, p50=0.735 msec LPOP: rps=103.6 (overall: 6500.0) avg_msec=0.620 (overall: 0.620) LPOP: rps=71.4 (overall: 171.9) avg_msec=80.359 (overall: 33.240) LPOP: rps=24.0 (overall: 98.8) avg_msec=332.757 (overall: 69.182) LPOP: rps=8.0 (overall: 68.7) avg_msec=399.616 (overall: 81.891) LPOP: rps=31.9 (overall: 59.5) avg_msec=449.664 (overall: 130.928) LPOP: rps=15.9 (overall: 50.8) avg_msec=450.240 (overall: 150.885) LPOP: rps=565.7 (overall: 136.4) avg_msec=35.485 (overall: 71.337) LPOP: rps=912.7 (overall: 247.4) avg_msec=8.488 (overall: 38.183) LPOP: rps=294.8 (overall: 253.4) avg_msec=40.319 (overall: 38.493) LPOP: rps=338.6 (overall: 262.8) avg_msec=23.361 (overall: 36.331) LPOP: rps=39.7 (overall: 240.5) avg_msec=299.366 (overall: 40.679) LPOP: rps=0.0 (overall: 218.7) avg_msec=-nan (overall: 40.679) LPOP: rps=0.0 (overall: 200.5) avg_msec=-nan (overall: 40.679) LPOP: rps=0.0 (overall: 185.2) avg_msec=-nan (overall: 40.679) LPOP: rps=0.0 (overall: 172.0) avg_msec=-nan (overall: 40.679) LPOP: rps=87.6 (overall: 166.4) avg_msec=591.070 (overall: 59.991) LPOP: rps=31.9 (overall: 158.0) avg_msec=112.058 (overall: 60.647) LPOP: rps=107.6 (overall: 155.0) avg_msec=151.730 (overall: 64.362) LPOP: rps=51.8 (overall: 149.3) avg_msec=153.167 (overall: 66.072) LPOP: rps=430.3 (overall: 164.0) avg_msec=28.001 (overall: 60.821) LPOP: rps=318.7 (overall: 171.8) avg_msec=14.959 (overall: 56.569) LPOP: rps=31.9 (overall: 165.1) avg_msec=345.720 (overall: 59.225) LPOP: rps=39.8 (overall: 159.4) avg_msec=260.032 (overall: 61.504) LPOP: rps=175.3 (overall: 160.1) avg_msec=54.562 (overall: 61.174) LPOP: rps=223.1 (overall: 162.7) avg_msec=53.763 (overall: 60.751) LPOP: rps=788.8 (overall: 187.8) avg_msec=15.079 (overall: 53.081) LPOP: rps=653.4 (overall: 205.7) avg_msec=12.153 (overall: 48.083) LPOP: rps=768.9 (overall: 226.5) avg_msec=15.590 (overall: 44.000) LPOP: rps=318.7 (overall: 229.8) avg_msec=24.228 (overall: 43.022) LPOP: rps=330.7 (overall: 233.3) avg_msec=23.776 (overall: 42.081) LPOP: rps=0.0 (overall: 225.5) avg_msec=-nan (overall: 42.081) LPOP: rps=0.0 (overall: 218.2) avg_msec=-nan (overall: 42.081) LPOP: rps=39.8 (overall: 212.6) avg_msec=720.384 (overall: 46.050) LPOP: rps=47.8 (overall: 207.6) avg_msec=316.011 (overall: 47.933) LPOP: rps=39.7 (overall: 202.7) avg_msec=100.218 (overall: 48.235) LPOP: rps=0.0 (overall: 196.9) avg_msec=-nan (overall: 48.235) LPOP: rps=71.4 (overall: 193.4) avg_msec=278.164 (overall: 50.601) LPOP: rps=119.5 (overall: 191.4) avg_msec=126.241 (overall: 51.877) LPOP: rps=8.0 (overall: 186.6) avg_msec=198.336 (overall: 52.041) LPOP: rps=31.9 (overall: 182.6) avg_msec=349.696 (overall: 53.372) LPOP: rps=151.4 (overall: 181.8) avg_msec=105.690 (overall: 54.460) LPOP: rps=504.0 (overall: 189.7) avg_msec=23.635 (overall: 52.457) LPOP: rps=517.9 (overall: 197.5) avg_msec=15.288 (overall: 50.138) LPOP: rps=214.3 (overall: 197.9) avg_msec=36.361 (overall: 49.790) LPOP: rps=39.7 (overall: 194.3) avg_msec=198.950 (overall: 50.485) LPOP: rps=39.8 (overall: 190.9) avg_msec=319.462 (overall: 51.731) LPOP: rps=79.7 (overall: 188.5) avg_msec=140.424 (overall: 52.546) LPOP: rps=195.2 (overall: 188.6) avg_msec=40.518 (overall: 52.281) LPOP: rps=406.4 (overall: 193.1) avg_msec=29.750 (overall: 51.294) LPOP: rps=231.1 (overall: 193.9) avg_msec=28.685 (overall: 50.745) LPOP: rps=10.5 (overall: 189.7) avg_msec=396.843 (overall: 51.179) LPOP: rps=11.9 (overall: 186.2) avg_msec=598.955 (overall: 51.866) LPOP: rps=15.9 (overall: 183.0) avg_msec=749.056 (overall: 53.029) LPOP: rps=31.7 (overall: 180.1) avg_msec=488.240 (overall: 54.477) LPOP: rps=31.9 (overall: 177.4) avg_msec=399.824 (overall: 55.622) LPOP: rps=0.0 (overall: 174.2) avg_msec=-nan (overall: 55.622) LPOP: rps=32.0 (overall: 171.7) avg_msec=452.256 (overall: 56.933) LPOP: rps=7.9 (overall: 168.8) avg_msec=599.808 (overall: 57.381) LPOP: rps=80.0 (overall: 167.3) avg_msec=318.866 (overall: 59.521) LPOP: rps=119.5 (overall: 166.5) avg_msec=67.401 (overall: 59.617) LPOP: rps=111.1 (overall: 165.5) avg_msec=99.513 (overall: 60.064) LPOP: rps=132.0 (overall: 165.0) avg_msec=66.572 (overall: 60.148) LPOP: rps=494.0 (overall: 170.3) avg_msec=24.107 (overall: 58.467) LPOP: rps=980.1 (overall: 183.1) avg_msec=8.251 (overall: 54.213) LPOP: rps=1087.6 (overall: 197.2) avg_msec=10.818 (overall: 50.484) LPOP: rps=729.1 (overall: 205.3) avg_msec=10.918 (overall: 48.329) LPOP: rps=669.3 (overall: 212.4) avg_msec=17.608 (overall: 46.866) LPOP: rps=330.7 (overall: 214.1) avg_msec=23.803 (overall: 46.336) LPOP: rps=494.0 (overall: 218.2) avg_msec=24.122 (overall: 45.599) LPOP: rps=39.8 (overall: 215.6) avg_msec=98.502 (overall: 45.740) LPOP: rps=27.9 (overall: 213.0) avg_msec=399.488 (overall: 46.400) LPOP: rps=12.0 (overall: 210.1) avg_msec=499.243 (overall: 46.762) LPOP: rps=31.9 (overall: 207.7) avg_msec=362.560 (overall: 47.433) LPOP: rps=8.0 (overall: 204.9) avg_msec=599.808 (overall: 47.727) LPOP: rps=178.6 (overall: 204.6) avg_msec=124.875 (overall: 48.638) LPOP: rps=848.6 (overall: 213.2) avg_msec=14.205 (overall: 46.815) LPOP: rps=251.0 (overall: 213.6) avg_msec=30.726 (overall: 46.567) LPOP: rps=629.5 (overall: 219.0) avg_msec=19.002 (overall: 45.540) LPOP: rps=79.7 (overall: 217.3) avg_msec=61.393 (overall: 45.615) LPOP: rps=390.4 (overall: 219.4) avg_msec=38.362 (overall: 45.452) LPOP: rps=549.8 (overall: 223.6) avg_msec=14.233 (overall: 44.494) LPOP: rps=525.9 (overall: 227.3) avg_msec=22.816 (overall: 43.877) LPOP: rps=868.5 (overall: 235.1) avg_msec=9.200 (overall: 42.318) LPOP: 239.61 requests per second, p50=0.671 msec RPOP: rps=0.0 (overall: -nan) avg_msec=-nan (overall: -nan) RPOP: rps=948.2 (overall: 948.2) avg_msec=6.871 (overall: 6.871) RPOP: rps=753.0 (overall: 850.6) avg_msec=15.589 (overall: 10.730) RPOP: rps=466.1 (overall: 722.4) avg_msec=17.021 (overall: 12.083) RPOP: rps=745.0 (overall: 728.1) avg_msec=15.992 (overall: 13.083) RPOP: rps=349.2 (overall: 652.1) avg_msec=22.511 (overall: 14.096) RPOP: rps=39.8 (overall: 550.1) avg_msec=97.600 (overall: 15.103) RPOP: rps=27.9 (overall: 475.5) avg_msec=300.050 (overall: 17.489) RPOP: rps=11.9 (overall: 417.4) avg_msec=501.461 (overall: 19.219) RPOP: rps=32.0 (overall: 374.8) avg_msec=624.560 (overall: 24.937) RPOP: rps=8.0 (overall: 338.1) avg_msec=800.000 (overall: 26.763) RPOP: rps=0.0 (overall: 307.4) avg_msec=-nan (overall: 26.763) RPOP: rps=107.6 (overall: 290.7) avg_msec=251.715 (overall: 33.696) RPOP: rps=143.4 (overall: 279.4) avg_msec=83.593 (overall: 35.666) RPOP: rps=39.8 (overall: 262.3) avg_msec=118.912 (overall: 36.569) RPOP: rps=31.9 (overall: 246.9) avg_msec=224.448 (overall: 38.185) RPOP: rps=71.7 (overall: 236.0) avg_msec=222.740 (overall: 41.689) RPOP: rps=190.5 (overall: 233.3) avg_msec=62.499 (overall: 42.692) RPOP: rps=203.2 (overall: 231.6) avg_msec=35.019 (overall: 42.318) RPOP: rps=211.2 (overall: 230.6) avg_msec=60.670 (overall: 43.202) RPOP: rps=259.0 (overall: 232.0) avg_msec=30.660 (overall: 42.503) RPOP: rps=928.3 (overall: 265.1) avg_msec=12.970 (overall: 37.581) RPOP: rps=0.0 (overall: 253.1) avg_msec=-nan (overall: 37.581) RPOP: rps=39.7 (overall: 243.8) avg_msec=342.912 (overall: 39.749) RPOP: rps=0.0 (overall: 233.6) avg_msec=-nan (overall: 39.749) RPOP: rps=39.8 (overall: 225.9) avg_msec=510.566 (overall: 43.069) RPOP: rps=7.9 (overall: 217.5) avg_msec=400.512 (overall: 43.573) RPOP: rps=199.2 (overall: 216.8) avg_msec=98.166 (overall: 45.430) RPOP: rps=0.0 (overall: 209.1) avg_msec=-nan (overall: 45.430) RPOP: rps=7.9 (overall: 202.1) avg_msec=496.896 (overall: 46.043) RPOP: rps=31.9 (overall: 196.4) avg_msec=663.552 (overall: 49.381) RPOP: rps=8.0 (overall: 190.4) avg_msec=900.096 (overall: 50.529) RPOP: rps=15.9 (overall: 184.9) avg_msec=498.752 (overall: 51.736) RPOP: rps=55.8 (overall: 181.0) avg_msec=377.243 (overall: 54.774) RPOP: rps=23.9 (overall: 176.4) avg_msec=249.973 (overall: 55.551) RPOP: rps=15.9 (overall: 171.8) avg_msec=349.824 (overall: 56.331) RPOP: rps=23.9 (overall: 167.7) avg_msec=466.773 (overall: 57.955) RPOP: rps=8.0 (overall: 163.4) avg_msec=699.392 (overall: 58.800) RPOP: rps=0.0 (overall: 159.1) avg_msec=-nan (overall: 58.800) RPOP: rps=31.7 (overall: 155.8) avg_msec=738.368 (overall: 62.363) RPOP: rps=0.0 (overall: 151.9) avg_msec=-nan (overall: 62.363) RPOP: rps=0.0 (overall: 148.2) avg_msec=-nan (overall: 62.363) RPOP: rps=23.8 (overall: 145.3) avg_msec=851.499 (overall: 65.454) RPOP: rps=79.7 (overall: 143.7) avg_msec=360.077 (overall: 69.250) RPOP: rps=0.0 (overall: 140.5) avg_msec=-nan (overall: 69.250) RPOP: rps=119.5 (overall: 140.0) avg_msec=145.955 (overall: 70.705) RPOP: rps=470.1 (overall: 147.2) avg_msec=22.687 (overall: 67.372) RPOP: rps=322.7 (overall: 150.9) avg_msec=35.638 (overall: 65.929) RPOP: rps=252.0 (overall: 153.0) avg_msec=31.881 (overall: 64.766) RPOP: rps=79.7 (overall: 151.5) avg_msec=99.248 (overall: 65.136) RPOP: rps=39.8 (overall: 149.3) avg_msec=219.290 (overall: 65.958) RPOP: rps=27.8 (overall: 146.9) avg_msec=371.584 (overall: 67.095) RPOP: rps=0.0 (overall: 144.1) avg_msec=-nan (overall: 67.095) RPOP: rps=178.6 (overall: 144.7) avg_msec=138.131 (overall: 68.755) RPOP: rps=438.2 (overall: 150.1) avg_msec=27.115 (overall: 66.505) RPOP: rps=709.2 (overall: 160.3) avg_msec=11.468 (overall: 62.081) RPOP: rps=1035.9 (overall: 175.9) avg_msec=11.285 (overall: 56.742) RPOP: rps=800.8 (overall: 186.9) avg_msec=9.817 (overall: 53.216) RPOP: rps=27.8 (overall: 184.1) avg_msec=98.007 (overall: 53.333) RPOP: rps=48.0 (overall: 181.8) avg_msec=357.677 (overall: 54.689) RPOP: rps=31.7 (overall: 179.3) avg_msec=137.340 (overall: 54.934) RPOP: rps=8.0 (overall: 176.5) avg_msec=399.744 (overall: 55.189) RPOP: rps=59.5 (overall: 174.6) avg_msec=393.254 (overall: 57.054) RPOP: rps=36.0 (overall: 172.4) avg_msec=222.108 (overall: 57.598) RPOP: rps=0.0 (overall: 169.7) avg_msec=-nan (overall: 57.598) RPOP: rps=15.9 (overall: 167.4) avg_msec=525.600 (overall: 58.283) RPOP: rps=880.5 (overall: 178.2) avg_msec=27.895 (overall: 56.009) RPOP: rps=521.9 (overall: 183.3) avg_msec=14.871 (overall: 54.262) RPOP: rps=860.6 (overall: 193.3) avg_msec=13.859 (overall: 51.617) RPOP: rps=549.8 (overall: 198.4) avg_msec=14.088 (overall: 50.111) RPOP: rps=772.9 (overall: 206.6) avg_msec=15.476 (overall: 48.261) RPOP: rps=352.9 (overall: 208.7) avg_msec=22.328 (overall: 47.634) RPOP: rps=1199.2 (overall: 222.5) avg_msec=9.715 (overall: 44.797) RPOP: rps=1290.8 (overall: 237.1) avg_msec=6.214 (overall: 41.921) RPOP: rps=406.4 (overall: 239.4) avg_msec=28.611 (overall: 41.616) RPOP: rps=276.0 (overall: 239.9) avg_msec=28.832 (overall: 41.421) RPOP: rps=227.1 (overall: 239.7) avg_msec=44.018 (overall: 41.453) RPOP: rps=87.6 (overall: 237.7) avg_msec=103.049 (overall: 41.748) RPOP: rps=8.0 (overall: 234.8) avg_msec=199.168 (overall: 41.816) RPOP: rps=31.9 (overall: 232.2) avg_msec=475.328 (overall: 42.569) RPOP: rps=8.0 (overall: 229.4) avg_msec=699.648 (overall: 42.854) RPOP: rps=39.8 (overall: 227.1) avg_msec=464.896 (overall: 43.768) RPOP: rps=183.3 (overall: 226.5) avg_msec=62.868 (overall: 43.956) RPOP: rps=115.5 (overall: 225.2) avg_msec=42.003 (overall: 43.944) RPOP: rps=23.9 (overall: 222.8) avg_msec=294.443 (overall: 44.264) RPOP: rps=8.0 (overall: 220.3) avg_msec=596.736 (overall: 44.499) RPOP: rps=0.0 (overall: 217.7) avg_msec=-nan (overall: 44.499) RPOP: rps=111.1 (overall: 216.5) avg_msec=257.728 (overall: 45.761) RPOP: rps=231.1 (overall: 216.7) avg_msec=62.002 (overall: 45.958) RPOP: rps=87.6 (overall: 215.2) avg_msec=90.603 (overall: 46.162) RPOP: rps=174.6 (overall: 214.8) avg_msec=51.956 (overall: 46.215) RPOP: rps=0.0 (overall: 212.4) avg_msec=-nan (overall: 46.215) RPOP: rps=27.8 (overall: 210.4) avg_msec=482.560 (overall: 46.843) RPOP: rps=12.0 (overall: 208.3) avg_msec=793.685 (overall: 47.304) RPOP: rps=27.9 (overall: 206.3) avg_msec=500.297 (overall: 47.954) RPOP: rps=23.9 (overall: 204.4) avg_msec=366.165 (overall: 48.346) RPOP: rps=7.8 (overall: 202.3) avg_msec=699.648 (overall: 48.613) RPOP: rps=31.9 (overall: 200.6) avg_msec=574.864 (overall: 49.474) RPOP: rps=0.0 (overall: 198.5) avg_msec=-nan (overall: 49.474) RPOP: rps=84.0 (overall: 197.4) avg_msec=228.702 (overall: 50.241) RPOP: rps=15.9 (overall: 195.6) avg_msec=299.072 (overall: 50.444) RPOP: rps=0.0 (overall: 193.6) avg_msec=-nan (overall: 50.444) RPOP: rps=67.7 (overall: 192.4) avg_msec=364.927 (overall: 51.529) RPOP: rps=71.7 (overall: 191.2) avg_msec=149.850 (overall: 51.886) RPOP: rps=11.9 (overall: 189.5) avg_msec=299.563 (overall: 52.036) RPOP: 189.68 requests per second, p50=0.655 msec SADD: rps=0.0 (overall: 0.0) avg_msec=-nan (overall: -nan) SADD: rps=1015.9 (overall: 1011.9) avg_msec=7.070 (overall: 7.070) SADD: rps=1470.1 (overall: 1240.6) avg_msec=7.893 (overall: 7.556) SADD: rps=829.4 (overall: 1103.3) avg_msec=9.255 (overall: 7.983) SADD: rps=641.4 (overall: 988.1) avg_msec=18.482 (overall: 9.683) SADD: rps=920.6 (overall: 974.6) avg_msec=8.546 (overall: 9.468) SADD: rps=581.7 (overall: 909.2) avg_msec=20.293 (overall: 10.620) SADD: rps=884.5 (overall: 905.7) avg_msec=9.083 (overall: 10.406) SADD: rps=464.3 (overall: 850.4) avg_msec=25.092 (overall: 11.410) SADD: rps=414.3 (overall: 802.0) avg_msec=18.981 (overall: 11.844) SADD: rps=39.7 (overall: 725.6) avg_msec=108.323 (overall: 12.373) SADD: rps=35.9 (overall: 663.1) avg_msec=322.404 (overall: 13.894) SADD: rps=31.9 (overall: 610.5) avg_msec=374.352 (overall: 15.459) SADD: rps=39.8 (overall: 566.7) avg_msec=300.045 (overall: 16.996) SADD: rps=67.7 (overall: 531.1) avg_msec=117.560 (overall: 17.911) SADD: rps=0.0 (overall: 495.8) avg_msec=-nan (overall: 17.911) SADD: rps=0.0 (overall: 464.9) avg_msec=-nan (overall: 17.911) SADD: rps=39.8 (overall: 439.9) avg_msec=739.942 (overall: 21.753) SADD: rps=0.0 (overall: 415.5) avg_msec=-nan (overall: 21.753) SADD: rps=31.9 (overall: 395.3) avg_msec=524.800 (overall: 23.886) SADD: rps=0.0 (overall: 375.7) avg_msec=-nan (overall: 23.886) SADD: rps=39.7 (overall: 359.6) avg_msec=559.949 (overall: 26.712) SADD: rps=119.5 (overall: 348.7) avg_msec=126.948 (overall: 28.273) SADD: rps=251.0 (overall: 344.5) avg_msec=47.558 (overall: 28.883) SADD: rps=996.0 (overall: 371.6) avg_msec=8.187 (overall: 26.573) SADD: rps=1194.4 (overall: 404.6) avg_msec=9.736 (overall: 24.579) SADD: rps=394.5 (overall: 404.2) avg_msec=19.303 (overall: 24.377) SADD: rps=215.1 (overall: 397.2) avg_msec=55.709 (overall: 25.005) SADD: rps=896.4 (overall: 415.0) avg_msec=8.693 (overall: 23.748) SADD: rps=1442.2 (overall: 450.4) avg_msec=8.183 (overall: 22.032) SADD: rps=940.2 (overall: 466.7) avg_msec=8.479 (overall: 21.123) SADD: rps=1605.6 (overall: 503.4) avg_msec=7.365 (overall: 19.709) SADD: rps=39.8 (overall: 488.9) avg_msec=93.824 (overall: 19.898) SADD: rps=0.0 (overall: 474.1) avg_msec=-nan (overall: 19.898) SADD: rps=27.9 (overall: 461.0) avg_msec=599.662 (overall: 20.928) SADD: rps=12.0 (overall: 448.2) avg_msec=799.659 (overall: 21.521) SADD: rps=39.7 (overall: 436.8) avg_msec=340.102 (overall: 22.327) SADD: rps=71.7 (overall: 427.0) avg_msec=200.036 (overall: 23.132) SADD: rps=7.9 (overall: 415.9) avg_msec=399.744 (overall: 23.322) SADD: rps=24.0 (overall: 405.9) avg_msec=499.541 (overall: 24.040) SADD: rps=158.7 (overall: 399.7) avg_msec=90.285 (overall: 24.700) SADD: rps=280.0 (overall: 396.8) avg_msec=43.126 (overall: 25.015) SADD: rps=191.2 (overall: 391.9) avg_msec=40.230 (overall: 25.192) SADD: rps=71.7 (overall: 384.5) avg_msec=126.780 (overall: 25.632) SADD: rps=15.9 (overall: 376.1) avg_msec=249.632 (overall: 25.848) SADD: rps=79.4 (overall: 369.5) avg_msec=234.710 (overall: 26.847) SADD: rps=91.6 (overall: 363.5) avg_msec=87.009 (overall: 27.177) SADD: rps=135.5 (overall: 358.6) avg_msec=88.449 (overall: 27.669) SADD: rps=334.7 (overall: 358.1) avg_msec=23.961 (overall: 27.597) SADD: rps=227.1 (overall: 355.5) avg_msec=48.478 (overall: 27.869) SADD: rps=31.9 (overall: 349.0) avg_msec=199.024 (overall: 28.181) SADD: rps=8.0 (overall: 342.3) avg_msec=298.880 (overall: 28.304) SADD: rps=0.0 (overall: 335.7) avg_msec=-nan (overall: 28.304) SADD: rps=24.0 (overall: 329.9) avg_msec=833.451 (overall: 29.404) SADD: rps=7.9 (overall: 323.9) avg_msec=999.680 (overall: 29.846) SADD: rps=0.0 (overall: 318.0) avg_msec=-nan (overall: 29.846) SADD: rps=0.0 (overall: 312.3) avg_msec=-nan (overall: 29.846) SADD: rps=31.9 (overall: 307.4) avg_msec=1075.904 (overall: 31.747) SADD: rps=4.0 (overall: 302.2) avg_msec=899.840 (overall: 31.944) SADD: rps=4.0 (overall: 297.1) avg_msec=1299.968 (overall: 32.232) SADD: rps=27.9 (overall: 292.7) avg_msec=870.437 (overall: 33.562) SADD: rps=8.0 (overall: 288.0) avg_msec=998.656 (overall: 34.000) SADD: rps=0.0 (overall: 283.4) avg_msec=-nan (overall: 34.000) SADD: rps=31.9 (overall: 279.4) avg_msec=662.592 (overall: 35.137) SADD: rps=31.9 (overall: 275.5) avg_msec=499.840 (overall: 35.976) SADD: rps=8.0 (overall: 271.4) avg_msec=499.584 (overall: 36.186) SADD: rps=39.8 (overall: 267.9) avg_msec=399.872 (overall: 37.005) SADD: rps=0.0 (overall: 263.9) avg_msec=-nan (overall: 37.005) SADD: rps=39.8 (overall: 260.6) avg_msec=529.882 (overall: 38.112) SADD: rps=39.8 (overall: 257.4) avg_msec=250.323 (overall: 38.588) SADD: rps=348.0 (overall: 258.7) avg_msec=34.556 (overall: 38.511) SADD: rps=896.8 (overall: 267.7) avg_msec=8.958 (overall: 37.112) SADD: rps=71.7 (overall: 265.0) avg_msec=140.633 (overall: 37.500) SADD: rps=8.0 (overall: 261.5) avg_msec=403.584 (overall: 37.653) SADD: rps=31.9 (overall: 258.4) avg_msec=400.128 (overall: 38.257) SADD: rps=27.8 (overall: 255.3) avg_msec=328.430 (overall: 38.679) SADD: rps=39.8 (overall: 252.4) avg_msec=348.992 (overall: 39.323) SADD: rps=545.8 (overall: 256.3) avg_msec=19.133 (overall: 38.765) SADD: 256.79 requests per second, p50=0.551 msec HSET: rps=214.3 (overall: 606.7) avg_msec=13.003 (overall: 13.003) HSET: rps=1063.7 (overall: 944.1) avg_msec=7.472 (overall: 8.402) HSET: rps=1227.1 (overall: 1064.3) avg_msec=9.741 (overall: 9.058) HSET: rps=581.7 (overall: 920.4) avg_msec=13.358 (overall: 9.868) HSET: rps=103.6 (overall: 732.8) avg_msec=114.085 (overall: 13.251) HSET: rps=454.2 (overall: 680.8) avg_msec=17.821 (overall: 13.820) HSET: rps=1418.3 (overall: 796.9) avg_msec=8.383 (overall: 12.297) HSET: rps=585.7 (overall: 768.1) avg_msec=13.485 (overall: 12.420) HSET: rps=710.3 (overall: 761.2) avg_msec=17.057 (overall: 12.940) HSET: rps=498.0 (overall: 733.1) avg_msec=15.019 (overall: 13.091) HSET: rps=635.3 (overall: 723.5) avg_msec=18.412 (overall: 13.549) HSET: rps=325.4 (overall: 688.4) avg_msec=23.984 (overall: 13.984) HSET: rps=800.8 (overall: 697.5) avg_msec=15.163 (overall: 14.093) HSET: rps=408.0 (overall: 675.9) avg_msec=18.924 (overall: 14.310) HSET: rps=131.5 (overall: 638.0) avg_msec=60.169 (overall: 14.968) HSET: rps=71.7 (overall: 601.2) avg_msec=155.735 (overall: 16.060) HSET: rps=39.8 (overall: 566.9) avg_msec=278.272 (overall: 17.185) HSET: rps=0.0 (overall: 534.3) avg_msec=-nan (overall: 17.185) HSET: rps=4.0 (overall: 505.4) avg_msec=704.256 (overall: 17.480) HSET: rps=4.0 (overall: 479.5) avg_msec=899.840 (overall: 17.858) HSET: rps=0.0 (overall: 456.0) avg_msec=-nan (overall: 17.858) HSET: rps=36.0 (overall: 436.4) avg_msec=1099.804 (overall: 22.018) HSET: rps=7.9 (overall: 417.2) avg_msec=551.872 (overall: 22.470) HSET: rps=386.5 (overall: 415.9) avg_msec=49.524 (overall: 23.546) HSET: rps=79.4 (overall: 402.0) avg_msec=147.654 (overall: 24.555) HSET: rps=191.2 (overall: 393.7) avg_msec=48.337 (overall: 25.010) HSET: rps=47.4 (overall: 380.5) avg_msec=222.917 (overall: 25.952) HSET: rps=438.2 (overall: 382.6) avg_msec=27.342 (overall: 26.010) HSET: rps=219.1 (overall: 376.8) avg_msec=36.057 (overall: 26.216) HSET: rps=502.0 (overall: 381.1) avg_msec=23.770 (overall: 26.107) HSET: rps=825.4 (overall: 395.8) avg_msec=9.821 (overall: 24.985) HSET: rps=960.2 (overall: 413.8) avg_msec=12.199 (overall: 24.039) HSET: rps=641.4 (overall: 420.8) avg_msec=12.498 (overall: 23.496) HSET: rps=187.3 (overall: 413.8) avg_msec=44.380 (overall: 23.779) HSET: rps=0.0 (overall: 401.8) avg_msec=-nan (overall: 23.779) HSET: rps=72.0 (overall: 392.5) avg_msec=311.253 (overall: 25.264) HSET: rps=0.0 (overall: 381.7) avg_msec=-nan (overall: 25.264) HSET: rps=0.0 (overall: 371.5) avg_msec=-nan (overall: 25.264) HSET: rps=8.0 (overall: 362.0) avg_msec=696.576 (overall: 25.649) HSET: rps=111.6 (overall: 355.7) avg_msec=271.473 (overall: 27.606) HSET: rps=8.0 (overall: 347.0) avg_msec=299.648 (overall: 27.761) HSET: rps=39.8 (overall: 339.6) avg_msec=459.494 (overall: 28.985) HSET: rps=896.4 (overall: 352.8) avg_msec=13.578 (overall: 28.061) HSET: rps=593.6 (overall: 358.3) avg_msec=19.705 (overall: 27.742) HSET: rps=27.9 (overall: 350.9) avg_msec=140.471 (overall: 27.944) HSET: rps=378.5 (overall: 351.5) avg_msec=42.032 (overall: 28.278) HSET: rps=289.7 (overall: 350.1) avg_msec=27.594 (overall: 28.266) HSET: rps=593.6 (overall: 355.3) avg_msec=20.171 (overall: 27.980) HSET: rps=776.5 (overall: 364.1) avg_msec=10.249 (overall: 27.187) HSET: rps=1078.9 (overall: 379.4) avg_msec=9.985 (overall: 26.139) HSET: rps=665.3 (overall: 385.1) avg_msec=11.497 (overall: 25.637) HSET: rps=266.9 (overall: 382.8) avg_msec=23.555 (overall: 25.609) HSET: rps=32.0 (overall: 376.1) avg_msec=472.384 (overall: 26.331) HSET: 376.85 requests per second, p50=0.615 msec SPOP: rps=31.9 (overall: 62.5) avg_msec=78.088 (overall: 78.088) SPOP: rps=8.0 (overall: 26.4) avg_msec=176.256 (overall: 97.722) SPOP: rps=0.0 (overall: 15.9) avg_msec=-nan (overall: 97.722) SPOP: rps=79.4 (overall: 34.1) avg_msec=389.386 (overall: 292.164) SPOP: rps=71.7 (overall: 42.4) avg_msec=99.701 (overall: 219.991) SPOP: rps=0.0 (overall: 34.7) avg_msec=-nan (overall: 219.991) SPOP: rps=47.8 (overall: 36.7) avg_msec=433.200 (overall: 262.633) SPOP: rps=39.8 (overall: 37.1) avg_msec=199.910 (overall: 253.672) SPOP: rps=111.6 (overall: 45.9) avg_msec=107.096 (overall: 211.793) SPOP: rps=1187.3 (overall: 165.9) avg_msec=10.199 (overall: 60.088) SPOP: rps=1092.0 (overall: 253.7) avg_msec=7.033 (overall: 38.438) SPOP: rps=382.5 (overall: 264.9) avg_msec=31.192 (overall: 37.529) SPOP: rps=1226.2 (overall: 342.0) avg_msec=6.621 (overall: 28.636) SPOP: rps=1513.9 (overall: 428.8) avg_msec=7.673 (overall: 23.158) SPOP: rps=637.5 (overall: 443.2) avg_msec=12.365 (overall: 22.088) SPOP: rps=1227.1 (overall: 493.7) avg_msec=9.709 (overall: 20.104) SPOP: rps=797.6 (overall: 512.2) avg_msec=10.025 (overall: 19.150) SPOP: rps=2131.5 (overall: 604.6) avg_msec=5.522 (overall: 16.407) SPOP: rps=1075.7 (overall: 630.1) avg_msec=7.261 (overall: 15.563) SPOP: rps=936.5 (overall: 645.8) avg_msec=8.280 (overall: 15.020) SPOP: rps=39.8 (overall: 616.3) avg_msec=296.141 (overall: 15.906) SPOP: rps=31.9 (overall: 589.2) avg_msec=125.904 (overall: 16.182) SPOP: rps=8.0 (overall: 563.3) avg_msec=399.744 (overall: 16.423) SPOP: rps=27.9 (overall: 540.6) avg_msec=669.952 (overall: 17.857) SPOP: rps=4.0 (overall: 518.6) avg_msec=899.328 (overall: 18.133) SPOP: rps=23.9 (overall: 499.2) avg_msec=566.720 (overall: 19.162) SPOP: rps=12.0 (overall: 480.8) avg_msec=734.123 (overall: 19.832) SPOP: rps=80.0 (overall: 466.3) avg_msec=250.189 (overall: 21.263) SPOP: rps=226.2 (overall: 457.9) avg_msec=35.321 (overall: 21.507) SPOP: rps=1059.8 (overall: 478.3) avg_msec=11.206 (overall: 20.734) SPOP: rps=575.4 (overall: 481.5) avg_msec=13.695 (overall: 20.457) SPOP: rps=976.1 (overall: 497.2) avg_msec=8.071 (overall: 19.686) SPOP: rps=27.8 (overall: 482.7) avg_msec=295.662 (overall: 20.176) SPOP: rps=32.0 (overall: 469.3) avg_msec=337.152 (overall: 20.818) SPOP: rps=7.9 (overall: 455.9) avg_msec=399.744 (overall: 21.010) SPOP: rps=79.7 (overall: 445.3) avg_msec=255.098 (overall: 22.189) SPOP: rps=354.6 (overall: 442.8) avg_msec=26.013 (overall: 22.273) SPOP: rps=1972.1 (overall: 483.5) avg_msec=6.004 (overall: 20.505) SPOP: rps=956.2 (overall: 495.8) avg_msec=8.418 (overall: 19.900) SPOP: 506.18 requests per second, p50=0.487 msec ZADD: rps=80.0 (overall: 1428.6) avg_msec=1.036 (overall: 1.036) ZADD: rps=79.7 (overall: 150.9) avg_msec=83.834 (overall: 42.435) ZADD: rps=87.6 (overall: 120.2) avg_msec=81.639 (overall: 56.346) ZADD: rps=0.0 (overall: 80.8) avg_msec=-nan (overall: 56.346) ZADD: rps=8.0 (overall: 62.9) avg_msec=498.688 (overall: 70.169) ZADD: rps=0.0 (overall: 50.4) avg_msec=-nan (overall: 70.169) ZADD: rps=71.7 (overall: 53.9) avg_msec=511.051 (overall: 166.948) ZADD: rps=23.9 (overall: 49.7) avg_msec=399.872 (overall: 182.829) ZADD: rps=15.8 (overall: 45.5) avg_msec=499.712 (overall: 196.607) ZADD: rps=72.0 (overall: 48.4) avg_msec=188.910 (overall: 195.347) ZADD: rps=7.9 (overall: 44.3) avg_msec=299.520 (overall: 197.208) ZADD: rps=0.0 (overall: 40.3) avg_msec=-nan (overall: 197.208) ZADD: rps=0.0 (overall: 37.0) avg_msec=-nan (overall: 197.208) ZADD: rps=39.7 (overall: 37.2) avg_msec=879.872 (overall: 253.164) ZADD: rps=0.0 (overall: 34.6) avg_msec=-nan (overall: 253.164) ZADD: rps=0.0 (overall: 32.3) avg_msec=-nan (overall: 253.164) ZADD: rps=0.0 (overall: 30.3) avg_msec=-nan (overall: 253.164) ZADD: rps=31.7 (overall: 30.3) avg_msec=1049.856 (overall: 302.191) ZADD: rps=0.0 (overall: 28.7) avg_msec=-nan (overall: 302.191) ZADD: rps=24.0 (overall: 28.4) avg_msec=999.936 (overall: 332.974) ZADD: rps=0.0 (overall: 27.0) avg_msec=-nan (overall: 332.974) ZADD: rps=79.7 (overall: 29.5) avg_msec=369.683 (overall: 337.680) ZADD: rps=39.7 (overall: 30.0) avg_msec=100.109 (overall: 323.369) ZADD: rps=422.3 (overall: 47.0) avg_msec=38.105 (overall: 212.200) ZADD: rps=39.7 (overall: 46.7) avg_msec=95.392 (overall: 208.058) ZADD: rps=0.0 (overall: 44.8) avg_msec=-nan (overall: 208.058) ZADD: rps=0.0 (overall: 43.1) avg_msec=-nan (overall: 208.058) ZADD: rps=39.7 (overall: 43.0) avg_msec=899.840 (overall: 231.749) ZADD: rps=32.0 (overall: 42.6) avg_msec=99.624 (overall: 228.225) ZADD: rps=31.9 (overall: 42.2) avg_msec=374.624 (overall: 232.028) ZADD: rps=15.9 (overall: 41.3) avg_msec=400.000 (overall: 234.181) ZADD: rps=466.1 (overall: 55.0) avg_msec=39.518 (overall: 181.091) ZADD: rps=876.5 (overall: 80.6) avg_msec=9.086 (overall: 122.785) ZADD: rps=1768.9 (overall: 131.7) avg_msec=6.754 (overall: 75.651) ZADD: rps=1354.6 (overall: 167.6) avg_msec=5.862 (overall: 59.092) ZADD: rps=1944.2 (overall: 218.2) avg_msec=6.055 (overall: 45.619) ZADD: rps=836.7 (overall: 235.4) avg_msec=9.882 (overall: 42.097) ZADD: rps=753.0 (overall: 249.4) avg_msec=15.138 (overall: 39.901) ZADD: rps=593.6 (overall: 258.4) avg_msec=13.043 (overall: 38.280) ZADD: rps=1434.3 (overall: 288.5) avg_msec=8.357 (overall: 34.472) ZADD: rps=589.6 (overall: 296.0) avg_msec=13.312 (overall: 33.420) ZADD: rps=151.4 (overall: 292.5) avg_msec=40.815 (overall: 33.514) ZADD: rps=0.0 (overall: 285.5) avg_msec=-nan (overall: 33.514) ZADD: rps=0.0 (overall: 278.9) avg_msec=-nan (overall: 33.514) ZADD: rps=39.7 (overall: 273.5) avg_msec=838.707 (overall: 36.175) ZADD: rps=693.2 (overall: 282.8) avg_msec=17.361 (overall: 35.152) ZADD: rps=334.7 (overall: 283.9) avg_msec=23.857 (overall: 34.863) ZADD: rps=1214.3 (overall: 303.8) avg_msec=9.737 (overall: 32.721) ZADD: rps=520.0 (overall: 308.2) avg_msec=15.044 (overall: 32.103) ZADD: rps=2071.7 (overall: 344.2) avg_msec=5.924 (overall: 28.891) ZADD: rps=1377.0 (overall: 364.9) avg_msec=5.608 (overall: 27.130) ZADD: rps=450.2 (overall: 366.6) avg_msec=17.195 (overall: 26.891) ZADD: rps=27.9 (overall: 360.1) avg_msec=320.786 (overall: 27.328) ZADD: rps=12.0 (overall: 353.5) avg_msec=392.576 (overall: 27.561) ZADD: rps=23.9 (overall: 347.4) avg_msec=550.037 (overall: 28.225) ZADD: rps=103.2 (overall: 343.0) avg_msec=161.988 (overall: 28.959) ZADD: rps=119.5 (overall: 339.0) avg_msec=99.419 (overall: 29.402) ZADD: rps=378.5 (overall: 339.7) avg_msec=21.458 (overall: 29.247) ZADD: 347.56 requests per second, p50=0.535 msec ZPOPMIN: rps=67.2 (overall: 118.1) avg_msec=21.377 (overall: 21.377) ZPOPMIN: rps=39.8 (overall: 68.4) avg_msec=199.718 (overall: 87.429) ZPOPMIN: rps=79.7 (overall: 72.8) avg_msec=200.012 (overall: 135.337) ZPOPMIN: rps=39.8 (overall: 63.5) avg_msec=99.366 (overall: 129.026) ZPOPMIN: rps=195.2 (overall: 92.3) avg_msec=67.596 (overall: 100.629) ZPOPMIN: rps=8.0 (overall: 77.2) avg_msec=198.080 (overall: 102.434) ZPOPMIN: rps=63.7 (overall: 75.2) avg_msec=330.448 (overall: 131.855) ZPOPMIN: rps=39.8 (overall: 70.5) avg_msec=99.834 (overall: 129.465) ZPOPMIN: rps=0.0 (overall: 62.3) avg_msec=-nan (overall: 129.465) ZPOPMIN: rps=39.8 (overall: 59.9) avg_msec=519.731 (overall: 156.567) ZPOPMIN: rps=31.9 (overall: 57.3) avg_msec=375.104 (overall: 168.069) ZPOPMIN: rps=90.9 (overall: 60.2) avg_msec=121.641 (overall: 161.967) ZPOPMIN: rps=960.0 (overall: 131.5) avg_msec=12.607 (overall: 75.590) ZPOPMIN: rps=306.8 (overall: 144.4) avg_msec=25.557 (overall: 67.760) ZPOPMIN: rps=1780.9 (overall: 256.6) avg_msec=6.762 (overall: 38.723) ZPOPMIN: rps=374.5 (overall: 264.2) avg_msec=20.471 (overall: 37.062) ZPOPMIN: rps=250.0 (overall: 263.3) avg_msec=33.443 (overall: 36.848) ZPOPMIN: rps=0.0 (overall: 248.4) avg_msec=-nan (overall: 36.848) ZPOPMIN: rps=219.1 (overall: 246.8) avg_msec=105.756 (overall: 40.135) ZPOPMIN: rps=478.1 (overall: 258.6) avg_msec=16.596 (overall: 37.916) ZPOPMIN: rps=1498.0 (overall: 318.7) avg_msec=7.978 (overall: 31.089) ZPOPMIN: rps=1552.0 (overall: 375.6) avg_msec=5.298 (overall: 26.177) ZPOPMIN: rps=1031.9 (overall: 404.6) avg_msec=11.085 (overall: 24.474) ZPOPMIN: rps=0.0 (overall: 387.4) avg_msec=-nan (overall: 24.474) ZPOPMIN: rps=39.8 (overall: 373.3) avg_msec=339.072 (overall: 25.839) ZPOPMIN: rps=0.0 (overall: 358.7) avg_msec=-nan (overall: 25.839) ZPOPMIN: rps=27.9 (overall: 346.3) avg_msec=543.159 (overall: 27.404) ZPOPMIN: rps=35.9 (overall: 335.1) avg_msec=466.347 (overall: 29.106) ZPOPMIN: rps=4.0 (overall: 323.5) avg_msec=399.232 (overall: 29.265) ZPOPMIN: rps=39.8 (overall: 313.9) avg_msec=420.813 (overall: 30.943) ZPOPMIN: rps=151.4 (overall: 308.6) avg_msec=105.473 (overall: 32.138) ZPOPMIN: rps=422.3 (overall: 312.2) avg_msec=18.744 (overall: 31.565) ZPOPMIN: rps=422.3 (overall: 315.6) avg_msec=28.329 (overall: 31.432) ZPOPMIN: rps=1212.0 (overall: 342.1) avg_msec=6.481 (overall: 28.812) ZPOPMIN: rps=1138.9 (overall: 365.3) avg_msec=10.260 (overall: 27.134) ZPOPMIN: rps=676.0 (overall: 374.0) avg_msec=17.642 (overall: 26.654) ZPOPMIN: rps=673.3 (overall: 382.1) avg_msec=11.862 (overall: 25.942) ZPOPMIN: rps=199.2 (overall: 377.3) avg_msec=43.430 (overall: 26.188) ZPOPMIN: rps=0.0 (overall: 367.5) avg_msec=-nan (overall: 26.188) ZPOPMIN: rps=39.7 (overall: 359.2) avg_msec=519.552 (overall: 27.569) ZPOPMIN: rps=179.3 (overall: 354.8) avg_msec=58.265 (overall: 27.951) ZPOPMIN: rps=780.9 (overall: 365.0) avg_msec=15.278 (overall: 27.300) ZPOPMIN: rps=184.0 (overall: 360.8) avg_msec=42.663 (overall: 27.483) ZPOPMIN: rps=31.9 (overall: 353.3) avg_msec=150.264 (overall: 27.737) ZPOPMIN: rps=0.0 (overall: 345.3) avg_msec=-nan (overall: 27.737) ZPOPMIN: rps=0.0 (overall: 337.8) avg_msec=-nan (overall: 27.737) ZPOPMIN: rps=0.0 (overall: 330.5) avg_msec=-nan (overall: 27.737) ZPOPMIN: rps=0.0 (overall: 323.6) avg_msec=-nan (overall: 27.737) ZPOPMIN: rps=39.8 (overall: 317.8) avg_msec=1290.342 (overall: 30.994) ZPOPMIN: rps=31.9 (overall: 312.0) avg_msec=286.520 (overall: 31.521) ZPOPMIN: rps=47.8 (overall: 306.8) avg_msec=300.187 (overall: 32.348) ZPOPMIN: rps=80.0 (overall: 302.4) avg_msec=149.658 (overall: 32.947) ZPOPMIN: rps=71.4 (overall: 298.0) avg_msec=68.042 (overall: 33.108) ZPOPMIN: rps=31.9 (overall: 293.0) avg_msec=346.144 (overall: 33.743) ZPOPMIN: rps=67.7 (overall: 288.9) avg_msec=176.819 (overall: 34.358) ZPOPMIN: rps=12.0 (overall: 283.9) avg_msec=99.531 (overall: 34.407) ZPOPMIN: rps=0.0 (overall: 278.9) avg_msec=-nan (overall: 34.407) ZPOPMIN: rps=159.4 (overall: 276.8) avg_msec=192.576 (overall: 35.988) ZPOPMIN: rps=314.7 (overall: 277.5) avg_msec=25.401 (overall: 35.783) ZPOPMIN: rps=1015.9 (overall: 289.9) avg_msec=11.756 (overall: 34.370) ZPOPMIN: rps=553.8 (overall: 294.2) avg_msec=14.056 (overall: 33.739) ZPOPMIN: rps=430.3 (overall: 296.4) avg_msec=27.721 (overall: 33.597) ZPOPMIN: rps=230.2 (overall: 295.4) avg_msec=34.297 (overall: 33.606) ZPOPMIN: rps=0.0 (overall: 290.7) avg_msec=-nan (overall: 33.606) ZPOPMIN: rps=39.8 (overall: 286.9) avg_msec=498.509 (overall: 34.605) ZPOPMIN: rps=63.7 (overall: 283.4) avg_msec=149.880 (overall: 35.001) ZPOPMIN: rps=8.0 (overall: 279.3) avg_msec=299.520 (overall: 35.114) ZPOPMIN: rps=163.3 (overall: 277.6) avg_msec=107.437 (overall: 35.744) ZPOPMIN: rps=51.6 (overall: 274.3) avg_msec=199.578 (overall: 36.194) ZPOPMIN: rps=115.5 (overall: 272.0) avg_msec=103.210 (overall: 36.603) ZPOPMIN: rps=278.9 (overall: 272.1) avg_msec=28.664 (overall: 36.488) ZPOPMIN: 280.27 requests per second, p50=0.543 msec LPUSH (needed to benchmark LRANGE): rps=115.5 (overall: 281.6) avg_msec=23.942 (overall: 23.942) LPUSH (needed to benchmark LRANGE): rps=621.5 (overall: 522.6) avg_msec=12.923 (overall: 14.650) LPUSH (needed to benchmark LRANGE): rps=765.9 (overall: 623.8) avg_msec=15.547 (overall: 15.108) LPUSH (needed to benchmark LRANGE): rps=199.2 (overall: 499.4) avg_msec=27.017 (overall: 16.499) LPUSH (needed to benchmark LRANGE): rps=135.5 (overall: 417.0) avg_msec=105.381 (overall: 23.040) LPUSH (needed to benchmark LRANGE): rps=138.9 (overall: 365.4) avg_msec=57.274 (overall: 25.451) LPUSH (needed to benchmark LRANGE): rps=616.0 (overall: 404.3) avg_msec=19.601 (overall: 24.067) LPUSH (needed to benchmark LRANGE): rps=309.5 (overall: 391.5) avg_msec=25.250 (overall: 24.194) LPUSH (needed to benchmark LRANGE): rps=140.0 (overall: 361.7) avg_msec=85.294 (overall: 26.993) LPUSH (needed to benchmark LRANGE): rps=246.0 (overall: 349.4) avg_msec=32.131 (overall: 27.379) LPUSH (needed to benchmark LRANGE): rps=418.3 (overall: 356.0) avg_msec=28.554 (overall: 27.511) LPUSH (needed to benchmark LRANGE): rps=298.8 (overall: 351.0) avg_msec=26.298 (overall: 27.421) LPUSH (needed to benchmark LRANGE): rps=0.0 (overall: 322.7) avg_msec=-nan (overall: 27.421) LPUSH (needed to benchmark LRANGE): rps=31.9 (overall: 301.1) avg_msec=524.608 (overall: 31.343) LPUSH (needed to benchmark LRANGE): rps=0.0 (overall: 280.3) avg_msec=-nan (overall: 31.343) LPUSH (needed to benchmark LRANGE): rps=31.9 (overall: 264.2) avg_msec=574.352 (overall: 35.594) LPUSH (needed to benchmark LRANGE): rps=51.8 (overall: 251.2) avg_msec=323.576 (overall: 39.211) LPUSH (needed to benchmark LRANGE): rps=496.0 (overall: 265.3) avg_msec=23.958 (overall: 37.567) LPUSH (needed to benchmark LRANGE): rps=940.2 (overall: 302.0) avg_msec=8.479 (overall: 32.650) LPUSH (needed to benchmark LRANGE): rps=1155.4 (overall: 345.9) avg_msec=10.219 (overall: 28.792) LPUSH (needed to benchmark LRANGE): rps=529.9 (overall: 354.9) avg_msec=15.156 (overall: 27.795) LPUSH (needed to benchmark LRANGE): rps=418.3 (overall: 357.9) avg_msec=27.851 (overall: 27.798) LPUSH (needed to benchmark LRANGE): rps=523.8 (overall: 365.3) avg_msec=15.430 (overall: 27.004) LPUSH (needed to benchmark LRANGE): rps=500.0 (overall: 371.0) avg_msec=23.722 (overall: 26.816) LPUSH (needed to benchmark LRANGE): rps=836.7 (overall: 390.1) avg_msec=9.678 (overall: 25.311) LPUSH (needed to benchmark LRANGE): rps=609.6 (overall: 398.7) avg_msec=19.277 (overall: 24.948) LPUSH (needed to benchmark LRANGE): rps=274.9 (overall: 394.1) avg_msec=28.649 (overall: 25.045) LPUSH (needed to benchmark LRANGE): rps=282.9 (overall: 390.0) avg_msec=42.410 (overall: 25.505) LPUSH (needed to benchmark LRANGE): rps=330.7 (overall: 387.9) avg_msec=24.196 (overall: 25.466) LPUSH (needed to benchmark LRANGE): rps=422.3 (overall: 389.1) avg_msec=28.142 (overall: 25.564) LPUSH (needed to benchmark LRANGE): rps=374.5 (overall: 388.6) avg_msec=21.225 (overall: 25.427) LPUSH (needed to benchmark LRANGE): rps=234.1 (overall: 383.7) avg_msec=37.016 (overall: 25.653) LPUSH (needed to benchmark LRANGE): rps=40.0 (overall: 373.1) avg_msec=279.040 (overall: 26.487) LPUSH (needed to benchmark LRANGE): rps=39.8 (overall: 363.1) avg_msec=120.922 (overall: 26.797) LPUSH (needed to benchmark LRANGE): rps=31.9 (overall: 353.5) avg_msec=373.600 (overall: 27.706) LPUSH (needed to benchmark LRANGE): rps=8.0 (overall: 343.8) avg_msec=699.136 (overall: 28.145) LPUSH (needed to benchmark LRANGE): rps=63.7 (overall: 336.1) avg_msec=275.368 (overall: 29.433) LPUSH (needed to benchmark LRANGE): rps=71.7 (overall: 329.0) avg_msec=144.018 (overall: 30.100) LPUSH (needed to benchmark LRANGE): rps=8.0 (overall: 320.6) avg_msec=299.520 (overall: 30.275) LPUSH (needed to benchmark LRANGE): rps=144.0 (overall: 316.2) avg_msec=133.777 (overall: 31.466) LPUSH (needed to benchmark LRANGE): rps=345.2 (overall: 316.9) avg_msec=23.227 (overall: 31.243) LPUSH (needed to benchmark LRANGE): rps=438.2 (overall: 319.8) avg_msec=25.061 (overall: 31.038) LPUSH (needed to benchmark LRANGE): rps=8.0 (overall: 312.5) avg_msec=196.416 (overall: 31.138) LPUSH (needed to benchmark LRANGE): rps=71.7 (overall: 306.9) avg_msec=222.423 (overall: 32.167) LPUSH (needed to benchmark LRANGE): rps=8.0 (overall: 300.2) avg_msec=199.680 (overall: 32.267) LPUSH (needed to benchmark LRANGE): rps=23.9 (overall: 294.1) avg_msec=566.400 (overall: 33.223) LPUSH (needed to benchmark LRANGE): rps=8.0 (overall: 288.0) avg_msec=798.464 (overall: 33.679) LPUSH (needed to benchmark LRANGE): rps=79.7 (overall: 283.6) avg_msec=229.827 (overall: 34.842) LPUSH (needed to benchmark LRANGE): rps=23.9 (overall: 278.2) avg_msec=299.605 (overall: 35.311) LPUSH (needed to benchmark LRANGE): rps=15.9 (overall: 272.9) avg_msec=349.760 (overall: 35.683) LPUSH (needed to benchmark LRANGE): rps=19.9 (overall: 267.9) avg_msec=460.160 (overall: 36.309) LPUSH (needed to benchmark LRANGE): rps=19.9 (overall: 263.1) avg_msec=639.949 (overall: 37.198) LPUSH (needed to benchmark LRANGE): rps=0.0 (overall: 258.0) avg_msec=-nan (overall: 37.198) LPUSH (needed to benchmark LRANGE): rps=16.0 (overall: 253.5) avg_msec=750.976 (overall: 38.038) LPUSH (needed to benchmark LRANGE): rps=15.9 (overall: 249.1) avg_msec=875.776 (overall: 39.023) LPUSH (needed to benchmark LRANGE): rps=0.0 (overall: 244.7) avg_msec=-nan (overall: 39.023) LPUSH (needed to benchmark LRANGE): rps=0.0 (overall: 240.3) avg_msec=-nan (overall: 39.023) LPUSH (needed to benchmark LRANGE): rps=0.0 (overall: 236.1) avg_msec=-nan (overall: 39.023) LPUSH (needed to benchmark LRANGE): rps=27.9 (overall: 232.6) avg_msec=1271.113 (overall: 41.552) LPUSH (needed to benchmark LRANGE): rps=67.7 (overall: 229.8) avg_msec=393.930 (overall: 43.300) LPUSH (needed to benchmark LRANGE): rps=83.7 (overall: 227.4) avg_msec=95.801 (overall: 43.620) LPUSH (needed to benchmark LRANGE): rps=0.0 (overall: 223.7) avg_msec=-nan (overall: 43.620) LPUSH (needed to benchmark LRANGE): rps=0.0 (overall: 220.1) avg_msec=-nan (overall: 43.620) LPUSH (needed to benchmark LRANGE): rps=79.7 (overall: 217.9) avg_msec=364.123 (overall: 45.468) LPUSH (needed to benchmark LRANGE): rps=67.7 (overall: 215.6) avg_msec=217.592 (overall: 46.308) LPUSH (needed to benchmark LRANGE): rps=286.9 (overall: 216.7) avg_msec=28.088 (overall: 45.939) LPUSH (needed to benchmark LRANGE): rps=551.6 (overall: 221.7) avg_msec=21.236 (overall: 45.010) LPUSH (needed to benchmark LRANGE): rps=565.7 (overall: 226.8) avg_msec=13.806 (overall: 43.855) LPUSH (needed to benchmark LRANGE): rps=717.1 (overall: 234.0) avg_msec=16.776 (overall: 42.642) LPUSH (needed to benchmark LRANGE): rps=39.8 (overall: 231.2) avg_msec=96.083 (overall: 42.775) LPUSH (needed to benchmark LRANGE): rps=357.1 (overall: 233.0) avg_msec=44.762 (overall: 42.818) LPUSH (needed to benchmark LRANGE): rps=64.0 (overall: 230.6) avg_msec=111.600 (overall: 43.085) LPUSH (needed to benchmark LRANGE): rps=47.8 (overall: 228.1) avg_msec=265.067 (overall: 43.727) LPUSH (needed to benchmark LRANGE): rps=31.7 (overall: 225.4) avg_msec=100.648 (overall: 43.837) LPUSH (needed to benchmark LRANGE): rps=40.0 (overall: 222.9) avg_msec=340.070 (overall: 44.548) LPUSH (needed to benchmark LRANGE): rps=8.0 (overall: 220.1) avg_msec=596.224 (overall: 44.813) LPUSH (needed to benchmark LRANGE): rps=71.7 (overall: 218.1) avg_msec=255.834 (overall: 45.721) LPUSH (needed to benchmark LRANGE): rps=71.4 (overall: 216.2) avg_msec=99.612 (overall: 45.952) LPUSH (needed to benchmark LRANGE): rps=31.9 (overall: 213.9) avg_msec=274.912 (overall: 46.387) LPUSH (needed to benchmark LRANGE): rps=87.6 (overall: 212.3) avg_msec=100.224 (overall: 46.667) LPUSH (needed to benchmark LRANGE): rps=0.0 (overall: 209.7) avg_msec=-nan (overall: 46.667) LPUSH (needed to benchmark LRANGE): rps=39.8 (overall: 207.6) avg_msec=529.805 (overall: 47.806) LPUSH (needed to benchmark LRANGE): rps=123.0 (overall: 206.6) avg_msec=93.382 (overall: 48.136) LPUSH (needed to benchmark LRANGE): rps=272.0 (overall: 207.3) avg_msec=38.569 (overall: 47.986) LPUSH (needed to benchmark LRANGE): rps=1155.4 (overall: 218.6) avg_msec=10.433 (overall: 45.635) LPUSH (needed to benchmark LRANGE): rps=384.9 (overall: 220.5) avg_msec=20.236 (overall: 45.114) LPUSH (needed to benchmark LRANGE): rps=15.9 (overall: 218.2) avg_msec=146.176 (overall: 45.199) LPUSH (needed to benchmark LRANGE): rps=8.0 (overall: 215.8) avg_msec=496.000 (overall: 45.390) LPUSH (needed to benchmark LRANGE): rps=641.4 (overall: 220.6) avg_msec=39.896 (overall: 45.209) LPUSH (needed to benchmark LRANGE): 223.54 requests per second, p50=0.663 msec LRANGE_100 (first 100 elements): rps=0.0 (overall: 0.0) avg_msec=-nan (overall: -nan) LRANGE_100 (first 100 elements): rps=1605.6 (overall: 1361.5) avg_msec=6.785 (overall: 6.785) LRANGE_100 (first 100 elements): rps=0.0 (overall: 736.7) avg_msec=-nan (overall: 6.785) LRANGE_100 (first 100 elements): rps=39.8 (overall: 517.5) avg_msec=310.784 (overall: 14.146) LRANGE_100 (first 100 elements): rps=0.0 (overall: 393.7) avg_msec=-nan (overall: 14.146) LRANGE_100 (first 100 elements): rps=0.0 (overall: 317.9) avg_msec=-nan (overall: 14.146) LRANGE_100 (first 100 elements): rps=31.9 (overall: 271.6) avg_msec=902.016 (overall: 31.017) LRANGE_100 (first 100 elements): rps=31.7 (overall: 238.1) avg_msec=448.384 (overall: 38.800) LRANGE_100 (first 100 elements): rps=8.0 (overall: 209.9) avg_msec=497.280 (overall: 40.928) LRANGE_100 (first 100 elements): rps=0.0 (overall: 187.1) avg_msec=-nan (overall: 40.928) LRANGE_100 (first 100 elements): rps=39.8 (overall: 172.6) avg_msec=629.837 (overall: 54.282) LRANGE_100 (first 100 elements): rps=40.0 (overall: 160.8) avg_msec=371.021 (overall: 61.305) LRANGE_100 (first 100 elements): rps=31.9 (overall: 150.2) avg_msec=198.656 (overall: 63.699) LRANGE_100 (first 100 elements): rps=8.0 (overall: 139.4) avg_msec=298.368 (overall: 64.717) LRANGE_100 (first 100 elements): rps=27.9 (overall: 131.5) avg_msec=371.401 (overall: 69.304) LRANGE_100 (first 100 elements): rps=79.7 (overall: 128.1) avg_msec=260.195 (overall: 77.128) LRANGE_100 (first 100 elements): rps=19.9 (overall: 121.4) avg_msec=199.334 (overall: 78.367) LRANGE_100 (first 100 elements): rps=19.8 (overall: 115.5) avg_msec=359.347 (overall: 81.188) LRANGE_100 (first 100 elements): rps=0.0 (overall: 109.2) avg_msec=-nan (overall: 81.188) LRANGE_100 (first 100 elements): rps=0.0 (overall: 103.4) avg_msec=-nan (overall: 81.188) LRANGE_100 (first 100 elements): rps=19.8 (overall: 99.3) avg_msec=880.179 (overall: 89.130) LRANGE_100 (first 100 elements): rps=8.0 (overall: 95.0) avg_msec=1049.472 (overall: 92.934) LRANGE_100 (first 100 elements): rps=23.9 (overall: 91.8) avg_msec=833.024 (overall: 101.624) LRANGE_100 (first 100 elements): rps=8.0 (overall: 88.2) avg_msec=1149.312 (overall: 105.708) LRANGE_100 (first 100 elements): rps=71.7 (overall: 87.5) avg_msec=333.703 (overall: 113.437) LRANGE_100 (first 100 elements): rps=203.2 (overall: 92.1) avg_msec=46.885 (overall: 107.605) LRANGE_100 (first 100 elements): rps=231.1 (overall: 97.4) avg_msec=51.879 (overall: 102.555) LRANGE_100 (first 100 elements): rps=541.8 (overall: 113.7) avg_msec=15.123 (overall: 87.232) LRANGE_100 (first 100 elements): rps=727.3 (overall: 135.7) avg_msec=15.853 (overall: 73.551) LRANGE_100 (first 100 elements): rps=609.6 (overall: 151.9) avg_msec=13.396 (overall: 65.282) LRANGE_100 (first 100 elements): rps=1277.8 (overall: 189.3) avg_msec=8.913 (overall: 52.633) LRANGE_100 (first 100 elements): rps=215.1 (overall: 190.2) avg_msec=36.214 (overall: 52.038) LRANGE_100 (first 100 elements): rps=1119.0 (overall: 219.1) avg_msec=10.577 (overall: 45.436) LRANGE_100 (first 100 elements): rps=348.0 (overall: 223.0) avg_msec=22.720 (overall: 44.372) LRANGE_100 (first 100 elements): rps=1884.5 (overall: 271.6) avg_msec=6.435 (overall: 36.674) LRANGE_100 (first 100 elements): rps=896.4 (overall: 289.3) avg_msec=8.811 (overall: 34.221) LRANGE_100 (first 100 elements): rps=39.8 (overall: 282.4) avg_msec=88.915 (overall: 34.434) LRANGE_100 (first 100 elements): rps=0.0 (overall: 274.9) avg_msec=-nan (overall: 34.434) LRANGE_100 (first 100 elements): rps=39.8 (overall: 268.7) avg_msec=699.187 (overall: 37.015) LRANGE_100 (first 100 elements): rps=79.4 (overall: 263.8) avg_msec=99.670 (overall: 37.498) LRANGE_100 (first 100 elements): rps=212.0 (overall: 262.6) avg_msec=56.844 (overall: 37.885) LRANGE_100 (first 100 elements): rps=406.4 (overall: 266.1) avg_msec=19.642 (overall: 37.208) LRANGE_100 (first 100 elements): rps=1071.7 (overall: 285.1) avg_msec=11.057 (overall: 34.879) LRANGE_100 (first 100 elements): rps=633.5 (overall: 293.2) avg_msec=12.497 (overall: 33.760) LRANGE_100 (first 100 elements): rps=492.1 (overall: 297.7) avg_msec=23.761 (overall: 33.384) LRANGE_100 (first 100 elements): rps=506.0 (overall: 302.3) avg_msec=15.815 (overall: 32.734) LRANGE_100 (first 100 elements): rps=848.6 (overall: 314.2) avg_msec=13.815 (overall: 31.627) LRANGE_100 (first 100 elements): rps=533.9 (overall: 318.8) avg_msec=15.011 (overall: 31.038) LRANGE_100 (first 100 elements): rps=581.7 (overall: 324.3) avg_msec=19.863 (overall: 30.622) LRANGE_100 (first 100 elements): rps=873.0 (overall: 335.5) avg_msec=8.900 (overall: 29.469) LRANGE_100 (first 100 elements): rps=1265.9 (overall: 354.1) avg_msec=9.460 (overall: 28.038) LRANGE_100 (first 100 elements): rps=792.8 (overall: 362.6) avg_msec=9.372 (overall: 27.241) LRANGE_100 (first 100 elements): rps=151.4 (overall: 358.6) avg_msec=56.172 (overall: 27.475) LRANGE_100 (first 100 elements): rps=15.9 (overall: 352.2) avg_msec=299.648 (overall: 27.707) LRANGE_100 (first 100 elements): rps=83.3 (overall: 347.2) avg_msec=204.680 (overall: 28.493) LRANGE_100 (first 100 elements): rps=270.9 (overall: 345.8) avg_msec=33.987 (overall: 28.571) LRANGE_100 (first 100 elements): rps=40.0 (overall: 340.4) avg_msec=157.632 (overall: 28.840) LRANGE_100 (first 100 elements): rps=0.0 (overall: 334.4) avg_msec=-nan (overall: 28.840) LRANGE_100 (first 100 elements): rps=0.0 (overall: 328.7) avg_msec=-nan (overall: 28.840) LRANGE_100 (first 100 elements): rps=0.0 (overall: 323.1) avg_msec=-nan (overall: 28.840) LRANGE_100 (first 100 elements): rps=0.0 (overall: 317.8) avg_msec=-nan (overall: 28.840) LRANGE_100 (first 100 elements): rps=0.0 (overall: 312.6) avg_msec=-nan (overall: 28.840) LRANGE_100 (first 100 elements): rps=60.0 (overall: 308.5) avg_msec=1093.353 (overall: 32.155) LRANGE_100 (first 100 elements): rps=0.0 (overall: 303.7) avg_msec=-nan (overall: 32.155) LRANGE_100 (first 100 elements): rps=31.6 (overall: 299.4) avg_msec=500.480 (overall: 32.931) LRANGE_100 (first 100 elements): rps=39.7 (overall: 295.4) avg_msec=199.520 (overall: 33.276) LRANGE_100 (first 100 elements): rps=80.0 (overall: 292.2) avg_msec=200.045 (overall: 33.963) LRANGE_100 (first 100 elements): rps=71.4 (overall: 288.9) avg_msec=155.072 (overall: 34.410) LRANGE_100 (first 100 elements): rps=330.7 (overall: 289.5) avg_msec=28.162 (overall: 34.306) LRANGE_100 (first 100 elements): 291.19 requests per second, p50=0.679 msec ------------------------------------------------------------------------------------------------------------------ `kubectl delete pod benchtest-redis-ljzvzz --force --namespace ns-jcjpx ` Warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely. pod "benchtest-redis-ljzvzz" force deleted cluster restart check cluster status before ops check cluster status done cluster_status:Running `kbcli cluster restart redis-ljzvzz --auto-approve --force=true --namespace ns-jcjpx ` OpsRequest redis-ljzvzz-restart-mgk59 created successfully, you can view the progress: kbcli cluster describe-ops redis-ljzvzz-restart-mgk59 -n ns-jcjpx check ops status `kbcli cluster list-ops redis-ljzvzz --status all --namespace ns-jcjpx ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME redis-ljzvzz-restart-mgk59 ns-jcjpx Restart redis-ljzvzz redis,redis-sentinel,redis-twemproxy Running 0/8 Jun 19,2025 18:46 UTC+0800 check cluster status `kbcli cluster list redis-ljzvzz --show-labels --namespace ns-jcjpx ` NAME NAMESPACE CLUSTER-DEFINITION VERSION TERMINATION-POLICY STATUS CREATED-TIME LABELS redis-ljzvzz ns-jcjpx Delete Updating Jun 19,2025 18:16 UTC+0800 app.kubernetes.io/instance=redis-ljzvzz cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances redis-ljzvzz --namespace ns-jcjpx ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME redis-ljzvzz-redis-0 ns-jcjpx redis-ljzvzz redis Running secondary us-west-2a 100m / 100m 512Mi / 512Mi data:2Gi ip-172-31-8-116.us-west-2.compute.internal/172.31.8.116 Jun 19,2025 18:47 UTC+0800 redis-ljzvzz-redis-1 ns-jcjpx redis-ljzvzz redis Running primary us-west-2a 100m / 100m 512Mi / 512Mi data:2Gi ip-172-31-6-232.us-west-2.compute.internal/172.31.6.232 Jun 19,2025 18:46 UTC+0800 redis-ljzvzz-redis-sentinel-0 ns-jcjpx redis-ljzvzz redis-sentinel Running us-west-2a 100m / 100m 512Mi / 512Mi data:1Gi ip-172-31-6-232.us-west-2.compute.internal/172.31.6.232 Jun 19,2025 18:47 UTC+0800 redis-ljzvzz-redis-sentinel-1 ns-jcjpx redis-ljzvzz redis-sentinel Running us-west-2a 100m / 100m 512Mi / 512Mi data:1Gi ip-172-31-1-34.us-west-2.compute.internal/172.31.1.34 Jun 19,2025 18:47 UTC+0800 redis-ljzvzz-redis-sentinel-2 ns-jcjpx redis-ljzvzz redis-sentinel Running us-west-2a 100m / 100m 512Mi / 512Mi data:1Gi ip-172-31-12-104.us-west-2.compute.internal/172.31.12.104 Jun 19,2025 18:46 UTC+0800 redis-ljzvzz-redis-twemproxy-0 ns-jcjpx redis-ljzvzz redis-twemproxy Running us-west-2a 100m / 100m 512Mi / 512Mi data:1Gi ip-172-31-15-106.us-west-2.compute.internal/172.31.15.106 Jun 19,2025 18:49 UTC+0800 redis-ljzvzz-redis-twemproxy-1 ns-jcjpx redis-ljzvzz redis-twemproxy Running us-west-2a 100m / 100m 512Mi / 512Mi data:1Gi ip-172-31-6-232.us-west-2.compute.internal/172.31.6.232 Jun 19,2025 18:48 UTC+0800 redis-ljzvzz-redis-twemproxy-2 ns-jcjpx redis-ljzvzz redis-twemproxy Running us-west-2a 100m / 100m 512Mi / 512Mi data:1Gi ip-172-31-2-181.us-west-2.compute.internal/172.31.2.181 Jun 19,2025 18:47 UTC+0800 check pod status done check cluster role check cluster role done primary: redis-ljzvzz-redis-1;secondary: redis-ljzvzz-redis-0 `kubectl get secrets -l app.kubernetes.io/instance=redis-ljzvzz` set secret: redis-ljzvzz-redis-account-default `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.username***"` `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.password***"` `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.port***"` DB_USERNAME_PROXY:;DB_PASSWORD_PROXY:;DB_PORT_PROXY:26379 DB_USERNAME:default;DB_PASSWORD:gu97Tl5m13;DB_PORT:6379;DB_DATABASE:db0 check cluster connect `echo 'echo "" | redis-cli -h redis-ljzvzz-redis-redis.ns-jcjpx.svc.cluster.local -p 6379 -a gu97Tl5m13' | kubectl exec -it redis-ljzvzz-redis-1 --namespace ns-jcjpx -- bash` check cluster connect done check ops status `kbcli cluster list-ops redis-ljzvzz --status all --namespace ns-jcjpx ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME redis-ljzvzz-restart-mgk59 ns-jcjpx Restart redis-ljzvzz redis,redis-sentinel,redis-twemproxy Succeed 8/8 Jun 19,2025 18:46 UTC+0800 check ops status done ops_status:redis-ljzvzz-restart-mgk59 ns-jcjpx Restart redis-ljzvzz redis,redis-sentinel,redis-twemproxy Succeed 8/8 Jun 19,2025 18:46 UTC+0800 `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge opsrequests redis-ljzvzz-restart-mgk59 --namespace ns-jcjpx ` opsrequest.apps.kubeblocks.io/redis-ljzvzz-restart-mgk59 patched `kbcli cluster delete-ops --name redis-ljzvzz-restart-mgk59 --force --auto-approve --namespace ns-jcjpx ` OpsRequest redis-ljzvzz-restart-mgk59 deleted `echo 'get mykey' | kbcli cluster connect redis-ljzvzz --namespace ns-jcjpx ` check data: Connect to instance redis-ljzvzz-redis-1: out of redis-ljzvzz-redis-1(primary), redis-ljzvzz-redis-0(secondary) Unable to use a TTY - input is not a terminal or the right kind of file Warning: Using a password with '-a' or '-u' option on the command line interface may not be safe. bxtif check cluster data consistent Success `kubectl get secrets -l app.kubernetes.io/instance=redis-ljzvzz` set secret: redis-ljzvzz-redis-account-default `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.username***"` `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.password***"` `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.port***"` DB_USERNAME_PROXY:;DB_PASSWORD_PROXY:;DB_PORT_PROXY:26379 DB_USERNAME:default;DB_PASSWORD:gu97Tl5m13;DB_PORT:6379;DB_DATABASE:db0 `echo "echo \"get mykey\" | redis-cli -h 127.0.0.1 -p 6379 -a gu97Tl5m13 " | kubectl exec -it redis-ljzvzz-redis-0 --namespace ns-jcjpx -- bash ` check readonly data: Defaulted container "redis" out of: redis, metrics, lorry, init-lorry (init) Unable to use a TTY - input is not a terminal or the right kind of file Warning: Using a password with '-a' or '-u' option on the command line interface may not be safe. bxtif check cluster readonly data consistent Success check db_client batch data count `echo 'get executions_loop_key' | kbcli cluster connect redis-ljzvzz --namespace ns-jcjpx ` check db_client batch data Success `kubectl get secrets -l app.kubernetes.io/instance=redis-ljzvzz` set secret: redis-ljzvzz-redis-account-default `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.username***"` `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.password***"` `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.port***"` DB_USERNAME_PROXY:;DB_PASSWORD_PROXY:;DB_PORT_PROXY:26379 DB_USERNAME:default;DB_PASSWORD:gu97Tl5m13;DB_PORT:6379;DB_DATABASE:db0 check readonly db_client batch data count `echo "echo \"get executions_loop_key\" | redis-cli -h 127.0.0.1 -p 6379 -a gu97Tl5m13 " | kubectl exec -it redis-ljzvzz-redis-0 --namespace ns-jcjpx -- bash ` check readonly db_client batch data Success test failover drainnode check node drain check node drain success kubectl get pod redis-ljzvzz-redis-1 --namespace ns-jcjpx -o jsonpath='***.spec.nodeName***' get node name:ip-172-31-6-232.us-west-2.compute.internal success check if multiple pods are on the same node kubectl get pod redis-ljzvzz-redis-0 --namespace ns-jcjpx -o jsonpath='***.spec.nodeName***' get node name:ip-172-31-8-116.us-west-2.compute.internal success kubectl get pod redis-ljzvzz-redis-sentinel-0 --namespace ns-jcjpx -o jsonpath='***.spec.nodeName***' get node name:ip-172-31-6-232.us-west-2.compute.internal success Multiple pods on the same node test failover networklossover check node drain check node drain success `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge NetworkChaos test-chaos-mesh-networklossover-redis-ljzvzz --namespace ns-jcjpx ` Warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely. Error from server (NotFound): networkchaos.chaos-mesh.org "test-chaos-mesh-networklossover-redis-ljzvzz" not found Error from server (NotFound): networkchaos.chaos-mesh.org "test-chaos-mesh-networklossover-redis-ljzvzz" not found apiVersion: chaos-mesh.org/v1alpha1 kind: NetworkChaos metadata: name: test-chaos-mesh-networklossover-redis-ljzvzz namespace: ns-jcjpx spec: selector: namespaces: - ns-jcjpx labelSelectors: apps.kubeblocks.io/pod-name: redis-ljzvzz-redis-1 mode: all action: loss loss: loss: '100' correlation: '100' direction: to duration: 2m `kubectl apply -f test-chaos-mesh-networklossover-redis-ljzvzz.yaml` networkchaos.chaos-mesh.org/test-chaos-mesh-networklossover-redis-ljzvzz created apply test-chaos-mesh-networklossover-redis-ljzvzz.yaml Success `rm -rf test-chaos-mesh-networklossover-redis-ljzvzz.yaml` networklossover chaos test waiting 120 seconds check cluster status `kbcli cluster list redis-ljzvzz --show-labels --namespace ns-jcjpx ` NAME NAMESPACE CLUSTER-DEFINITION VERSION TERMINATION-POLICY STATUS CREATED-TIME LABELS redis-ljzvzz ns-jcjpx Delete Running Jun 19,2025 18:16 UTC+0800 app.kubernetes.io/instance=redis-ljzvzz check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances redis-ljzvzz --namespace ns-jcjpx ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME redis-ljzvzz-redis-0 ns-jcjpx redis-ljzvzz redis Running primary us-west-2a 100m / 100m 512Mi / 512Mi data:2Gi ip-172-31-8-116.us-west-2.compute.internal/172.31.8.116 Jun 19,2025 18:47 UTC+0800 redis-ljzvzz-redis-1 ns-jcjpx redis-ljzvzz redis Running secondary us-west-2a 100m / 100m 512Mi / 512Mi data:2Gi ip-172-31-6-232.us-west-2.compute.internal/172.31.6.232 Jun 19,2025 18:46 UTC+0800 redis-ljzvzz-redis-sentinel-0 ns-jcjpx redis-ljzvzz redis-sentinel Running us-west-2a 100m / 100m 512Mi / 512Mi data:1Gi ip-172-31-6-232.us-west-2.compute.internal/172.31.6.232 Jun 19,2025 18:47 UTC+0800 redis-ljzvzz-redis-sentinel-1 ns-jcjpx redis-ljzvzz redis-sentinel Running us-west-2a 100m / 100m 512Mi / 512Mi data:1Gi ip-172-31-1-34.us-west-2.compute.internal/172.31.1.34 Jun 19,2025 18:47 UTC+0800 redis-ljzvzz-redis-sentinel-2 ns-jcjpx redis-ljzvzz redis-sentinel Running us-west-2a 100m / 100m 512Mi / 512Mi data:1Gi ip-172-31-12-104.us-west-2.compute.internal/172.31.12.104 Jun 19,2025 18:46 UTC+0800 redis-ljzvzz-redis-twemproxy-0 ns-jcjpx redis-ljzvzz redis-twemproxy Running us-west-2a 100m / 100m 512Mi / 512Mi data:1Gi ip-172-31-15-106.us-west-2.compute.internal/172.31.15.106 Jun 19,2025 18:49 UTC+0800 redis-ljzvzz-redis-twemproxy-1 ns-jcjpx redis-ljzvzz redis-twemproxy Running us-west-2a 100m / 100m 512Mi / 512Mi data:1Gi ip-172-31-6-232.us-west-2.compute.internal/172.31.6.232 Jun 19,2025 18:48 UTC+0800 redis-ljzvzz-redis-twemproxy-2 ns-jcjpx redis-ljzvzz redis-twemproxy Running us-west-2a 100m / 100m 512Mi / 512Mi data:1Gi ip-172-31-2-181.us-west-2.compute.internal/172.31.2.181 Jun 19,2025 18:47 UTC+0800 check pod status done check cluster role check cluster role done primary: redis-ljzvzz-redis-0;secondary: redis-ljzvzz-redis-1 `kubectl get secrets -l app.kubernetes.io/instance=redis-ljzvzz` set secret: redis-ljzvzz-redis-account-default `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.username***"` `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.password***"` `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.port***"` DB_USERNAME_PROXY:;DB_PASSWORD_PROXY:;DB_PORT_PROXY:26379 DB_USERNAME:default;DB_PASSWORD:gu97Tl5m13;DB_PORT:6379;DB_DATABASE:db0 check cluster connect `echo 'echo "" | redis-cli -h redis-ljzvzz-redis-redis.ns-jcjpx.svc.cluster.local -p 6379 -a gu97Tl5m13' | kubectl exec -it redis-ljzvzz-redis-0 --namespace ns-jcjpx -- bash` check cluster connect done `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge NetworkChaos test-chaos-mesh-networklossover-redis-ljzvzz --namespace ns-jcjpx ` networkchaos.chaos-mesh.org/test-chaos-mesh-networklossover-redis-ljzvzz patched check failover pod name Warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely. networkchaos.chaos-mesh.org "test-chaos-mesh-networklossover-redis-ljzvzz" force deleted failover pod name:redis-ljzvzz-redis-0 failover networklossover Success `echo 'get mykey' | kbcli cluster connect redis-ljzvzz --namespace ns-jcjpx ` check data: Connect to instance redis-ljzvzz-redis-0: out of redis-ljzvzz-redis-0(primary), redis-ljzvzz-redis-1(secondary) Unable to use a TTY - input is not a terminal or the right kind of file Warning: Using a password with '-a' or '-u' option on the command line interface may not be safe. bxtif check cluster data consistent Success `kubectl get secrets -l app.kubernetes.io/instance=redis-ljzvzz` set secret: redis-ljzvzz-redis-account-default `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.username***"` `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.password***"` `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.port***"` DB_USERNAME_PROXY:;DB_PASSWORD_PROXY:;DB_PORT_PROXY:26379 DB_USERNAME:default;DB_PASSWORD:gu97Tl5m13;DB_PORT:6379;DB_DATABASE:db0 `echo "echo \"get mykey\" | redis-cli -h 127.0.0.1 -p 6379 -a gu97Tl5m13 " | kubectl exec -it redis-ljzvzz-redis-1 --namespace ns-jcjpx -- bash ` check readonly data: Defaulted container "redis" out of: redis, metrics, lorry, init-lorry (init) Unable to use a TTY - input is not a terminal or the right kind of file Warning: Using a password with '-a' or '-u' option on the command line interface may not be safe. bxtif check cluster readonly data consistent Success check db_client batch data count `echo 'get executions_loop_key' | kbcli cluster connect redis-ljzvzz --namespace ns-jcjpx ` check db_client batch data Success `kubectl get secrets -l app.kubernetes.io/instance=redis-ljzvzz` set secret: redis-ljzvzz-redis-account-default `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.username***"` `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.password***"` `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.port***"` DB_USERNAME_PROXY:;DB_PASSWORD_PROXY:;DB_PORT_PROXY:26379 DB_USERNAME:default;DB_PASSWORD:gu97Tl5m13;DB_PORT:6379;DB_DATABASE:db0 check readonly db_client batch data count `echo "echo \"get executions_loop_key\" | redis-cli -h 127.0.0.1 -p 6379 -a gu97Tl5m13 " | kubectl exec -it redis-ljzvzz-redis-1 --namespace ns-jcjpx -- bash ` check readonly db_client batch data Success test failover podfailure check node drain check node drain success `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge PodChaos test-chaos-mesh-podfailure-redis-ljzvzz --namespace ns-jcjpx ` Warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely. Error from server (NotFound): podchaos.chaos-mesh.org "test-chaos-mesh-podfailure-redis-ljzvzz" not found Error from server (NotFound): podchaos.chaos-mesh.org "test-chaos-mesh-podfailure-redis-ljzvzz" not found apiVersion: chaos-mesh.org/v1alpha1 kind: PodChaos metadata: name: test-chaos-mesh-podfailure-redis-ljzvzz namespace: ns-jcjpx spec: selector: namespaces: - ns-jcjpx labelSelectors: apps.kubeblocks.io/pod-name: redis-ljzvzz-redis-0 mode: all action: pod-failure duration: 2m `kubectl apply -f test-chaos-mesh-podfailure-redis-ljzvzz.yaml` podchaos.chaos-mesh.org/test-chaos-mesh-podfailure-redis-ljzvzz created apply test-chaos-mesh-podfailure-redis-ljzvzz.yaml Success `rm -rf test-chaos-mesh-podfailure-redis-ljzvzz.yaml` podfailure chaos test waiting 120 seconds check cluster status `kbcli cluster list redis-ljzvzz --show-labels --namespace ns-jcjpx ` NAME NAMESPACE CLUSTER-DEFINITION VERSION TERMINATION-POLICY STATUS CREATED-TIME LABELS redis-ljzvzz ns-jcjpx Delete Abnormal Jun 19,2025 18:16 UTC+0800 app.kubernetes.io/instance=redis-ljzvzz cluster_status:Abnormal cluster_status:Abnormal cluster_status:Updating cluster_status:Abnormal cluster_status:Abnormal cluster_status:Abnormal cluster_status:Abnormal cluster_status:Abnormal cluster_status:Abnormal cluster_status:Abnormal cluster_status:Abnormal cluster_status:Abnormal cluster_status:Abnormal cluster_status:Abnormal cluster_status:Updating cluster_status:Abnormal cluster_status:Abnormal cluster_status:Abnormal cluster_status:Abnormal cluster_status:Abnormal cluster_status:Abnormal cluster_status:Abnormal cluster_status:Abnormal cluster_status:Abnormal cluster_status:Abnormal Warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely. pod "redis-ljzvzz-redis-0" force deleted cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances redis-ljzvzz --namespace ns-jcjpx ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME redis-ljzvzz-redis-0 ns-jcjpx redis-ljzvzz redis Running secondary us-west-2a 100m / 100m 512Mi / 512Mi data:2Gi ip-172-31-6-155.us-west-2.compute.internal/172.31.6.155 Jun 19,2025 18:57 UTC+0800 redis-ljzvzz-redis-1 ns-jcjpx redis-ljzvzz redis Running primary us-west-2a 100m / 100m 512Mi / 512Mi data:2Gi ip-172-31-6-232.us-west-2.compute.internal/172.31.6.232 Jun 19,2025 18:46 UTC+0800 redis-ljzvzz-redis-sentinel-0 ns-jcjpx redis-ljzvzz redis-sentinel Running us-west-2a 100m / 100m 512Mi / 512Mi data:1Gi ip-172-31-6-232.us-west-2.compute.internal/172.31.6.232 Jun 19,2025 18:47 UTC+0800 redis-ljzvzz-redis-sentinel-1 ns-jcjpx redis-ljzvzz redis-sentinel Running us-west-2a 100m / 100m 512Mi / 512Mi data:1Gi ip-172-31-1-34.us-west-2.compute.internal/172.31.1.34 Jun 19,2025 18:47 UTC+0800 redis-ljzvzz-redis-sentinel-2 ns-jcjpx redis-ljzvzz redis-sentinel Running us-west-2a 100m / 100m 512Mi / 512Mi data:1Gi ip-172-31-12-104.us-west-2.compute.internal/172.31.12.104 Jun 19,2025 18:46 UTC+0800 redis-ljzvzz-redis-twemproxy-0 ns-jcjpx redis-ljzvzz redis-twemproxy Running us-west-2a 100m / 100m 512Mi / 512Mi data:1Gi ip-172-31-10-206.us-west-2.compute.internal/172.31.10.206 Jun 19,2025 18:55 UTC+0800 redis-ljzvzz-redis-twemproxy-1 ns-jcjpx redis-ljzvzz redis-twemproxy Running us-west-2a 100m / 100m 512Mi / 512Mi data:1Gi ip-172-31-6-232.us-west-2.compute.internal/172.31.6.232 Jun 19,2025 18:48 UTC+0800 redis-ljzvzz-redis-twemproxy-2 ns-jcjpx redis-ljzvzz redis-twemproxy Running us-west-2a 100m / 100m 512Mi / 512Mi data:1Gi ip-172-31-2-181.us-west-2.compute.internal/172.31.2.181 Jun 19,2025 18:47 UTC+0800 check pod status done check cluster role check cluster role done primary: redis-ljzvzz-redis-1;secondary: redis-ljzvzz-redis-0 `kubectl get secrets -l app.kubernetes.io/instance=redis-ljzvzz` set secret: redis-ljzvzz-redis-account-default `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.username***"` `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.password***"` `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.port***"` DB_USERNAME_PROXY:;DB_PASSWORD_PROXY:;DB_PORT_PROXY:26379 DB_USERNAME:default;DB_PASSWORD:gu97Tl5m13;DB_PORT:6379;DB_DATABASE:db0 check cluster connect `echo 'echo "" | redis-cli -h redis-ljzvzz-redis-redis.ns-jcjpx.svc.cluster.local -p 6379 -a gu97Tl5m13' | kubectl exec -it redis-ljzvzz-redis-1 --namespace ns-jcjpx -- bash` check cluster connect done `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge PodChaos test-chaos-mesh-podfailure-redis-ljzvzz --namespace ns-jcjpx ` Warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely. podchaos.chaos-mesh.org "test-chaos-mesh-podfailure-redis-ljzvzz" force deleted Error from server (NotFound): podchaos.chaos-mesh.org "test-chaos-mesh-podfailure-redis-ljzvzz" not found check failover pod name failover pod name:redis-ljzvzz-redis-1 failover podfailure Success `echo 'get mykey' | kbcli cluster connect redis-ljzvzz --namespace ns-jcjpx ` check data: Connect to instance redis-ljzvzz-redis-1: out of redis-ljzvzz-redis-1(primary), redis-ljzvzz-redis-0(secondary) Unable to use a TTY - input is not a terminal or the right kind of file Warning: Using a password with '-a' or '-u' option on the command line interface may not be safe. bxtif check cluster data consistent Success `kubectl get secrets -l app.kubernetes.io/instance=redis-ljzvzz` set secret: redis-ljzvzz-redis-account-default `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.username***"` `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.password***"` `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.port***"` DB_USERNAME_PROXY:;DB_PASSWORD_PROXY:;DB_PORT_PROXY:26379 DB_USERNAME:default;DB_PASSWORD:gu97Tl5m13;DB_PORT:6379;DB_DATABASE:db0 `echo "echo \"get mykey\" | redis-cli -h 127.0.0.1 -p 6379 -a gu97Tl5m13 " | kubectl exec -it redis-ljzvzz-redis-0 --namespace ns-jcjpx -- bash ` check readonly data: Defaulted container "redis" out of: redis, metrics, lorry, init-lorry (init) Unable to use a TTY - input is not a terminal or the right kind of file Warning: Using a password with '-a' or '-u' option on the command line interface may not be safe. bxtif check cluster readonly data consistent Success check db_client batch data count `echo 'get executions_loop_key' | kbcli cluster connect redis-ljzvzz --namespace ns-jcjpx ` check db_client batch data Success `kubectl get secrets -l app.kubernetes.io/instance=redis-ljzvzz` set secret: redis-ljzvzz-redis-account-default `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.username***"` `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.password***"` `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.port***"` DB_USERNAME_PROXY:;DB_PASSWORD_PROXY:;DB_PORT_PROXY:26379 DB_USERNAME:default;DB_PASSWORD:gu97Tl5m13;DB_PORT:6379;DB_DATABASE:db0 check readonly db_client batch data count `echo "echo \"get executions_loop_key\" | redis-cli -h 127.0.0.1 -p 6379 -a gu97Tl5m13 " | kubectl exec -it redis-ljzvzz-redis-0 --namespace ns-jcjpx -- bash ` check readonly db_client batch data Success cluster update monitor KUBEBLOCKS NAMESPACE:kb-mqtcr get kubeblocks namespace done check addon prometheus enabled check addon prometheus enabled done check addon grafana enabled check addon grafana enabled done check addon apecloud-otel-collector enabled check addon apecloud-otel-collector enabled done kubectl patch cluster redis-ljzvzz --namespace ns-jcjpx --type json -p '[***"op": "replace", "path": "/spec/componentSpecs/0/disableExporter", "value": false***]' cluster.apps.kubeblocks.io/redis-ljzvzz patched check cluster status `kbcli cluster list redis-ljzvzz --show-labels --namespace ns-jcjpx ` NAME NAMESPACE CLUSTER-DEFINITION VERSION TERMINATION-POLICY STATUS CREATED-TIME LABELS redis-ljzvzz ns-jcjpx Delete Running Jun 19,2025 18:16 UTC+0800 app.kubernetes.io/instance=redis-ljzvzz check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances redis-ljzvzz --namespace ns-jcjpx ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME redis-ljzvzz-redis-0 ns-jcjpx redis-ljzvzz redis Running secondary us-west-2a 100m / 100m 512Mi / 512Mi data:2Gi ip-172-31-6-155.us-west-2.compute.internal/172.31.6.155 Jun 19,2025 18:57 UTC+0800 redis-ljzvzz-redis-1 ns-jcjpx redis-ljzvzz redis Running primary us-west-2a 100m / 100m 512Mi / 512Mi data:2Gi ip-172-31-6-232.us-west-2.compute.internal/172.31.6.232 Jun 19,2025 18:46 UTC+0800 redis-ljzvzz-redis-sentinel-0 ns-jcjpx redis-ljzvzz redis-sentinel Running us-west-2a 100m / 100m 512Mi / 512Mi data:1Gi ip-172-31-6-232.us-west-2.compute.internal/172.31.6.232 Jun 19,2025 18:47 UTC+0800 redis-ljzvzz-redis-sentinel-1 ns-jcjpx redis-ljzvzz redis-sentinel Running us-west-2a 100m / 100m 512Mi / 512Mi data:1Gi ip-172-31-1-34.us-west-2.compute.internal/172.31.1.34 Jun 19,2025 18:47 UTC+0800 redis-ljzvzz-redis-sentinel-2 ns-jcjpx redis-ljzvzz redis-sentinel Running us-west-2a 100m / 100m 512Mi / 512Mi data:1Gi ip-172-31-12-104.us-west-2.compute.internal/172.31.12.104 Jun 19,2025 18:46 UTC+0800 redis-ljzvzz-redis-twemproxy-0 ns-jcjpx redis-ljzvzz redis-twemproxy Running us-west-2a 100m / 100m 512Mi / 512Mi data:1Gi ip-172-31-10-206.us-west-2.compute.internal/172.31.10.206 Jun 19,2025 18:55 UTC+0800 redis-ljzvzz-redis-twemproxy-1 ns-jcjpx redis-ljzvzz redis-twemproxy Running us-west-2a 100m / 100m 512Mi / 512Mi data:1Gi ip-172-31-6-232.us-west-2.compute.internal/172.31.6.232 Jun 19,2025 18:48 UTC+0800 redis-ljzvzz-redis-twemproxy-2 ns-jcjpx redis-ljzvzz redis-twemproxy Running us-west-2a 100m / 100m 512Mi / 512Mi data:1Gi ip-172-31-2-181.us-west-2.compute.internal/172.31.2.181 Jun 19,2025 18:47 UTC+0800 check pod status done check cluster role check cluster role done primary: redis-ljzvzz-redis-1;secondary: redis-ljzvzz-redis-0 `kubectl get secrets -l app.kubernetes.io/instance=redis-ljzvzz` set secret: redis-ljzvzz-redis-account-default `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.username***"` `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.password***"` `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.port***"` DB_USERNAME_PROXY:;DB_PASSWORD_PROXY:;DB_PORT_PROXY:26379 DB_USERNAME:default;DB_PASSWORD:gu97Tl5m13;DB_PORT:6379;DB_DATABASE:db0 check cluster connect `echo 'echo "" | redis-cli -h redis-ljzvzz-redis-redis.ns-jcjpx.svc.cluster.local -p 6379 -a gu97Tl5m13' | kubectl exec -it redis-ljzvzz-redis-1 --namespace ns-jcjpx -- bash` check cluster connect done create curl-jq pod redis-ljzvzz-kb-curl `kubectl run --namespace kb-mqtcr redis-ljzvzz-kb-curl --restart='Never' --image docker.io/apecloud/curl-jq:0.1.0 --command -- sleep infinity ` pod/redis-ljzvzz-kb-curl created check pod status pod_status:NAME READY STATUS RESTARTS AGE redis-ljzvzz-kb-curl 0/1 ContainerCreating 0 0s check pod redis-ljzvzz-kb-curl status done `kubectl wait --for=condition=Ready pod redis-ljzvzz-kb-curl --namespace kb-mqtcr` pod/redis-ljzvzz-kb-curl condition met pod_status:NAME READY STATUS RESTARTS AGE redis-ljzvzz-kb-curl 1/1 Running 0 5s kubectl exec -it redis-ljzvzz-kb-curl --namespace kb-mqtcr -- curl -G "http://kb-addon-prometheus-server:80/api/v1/query" -d "query=sum(k8s_pod_cpu_limit)" `kubectl exec -it redis-ljzvzz-kb-curl --namespace kb-mqtcr -- curl -G "http://kb-addon-prometheus-server:80/api/v1/query" -d "query=sum(k8s_pod_cpu_limit)"` Unable to use a TTY - input is not a terminal or the right kind of file % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 121 100 121 0 0 42530 0 --:--:-- --:--:-- --:--:-- 60500 monitor_result:***"status":"success","data":***"resultType":"vector","result":[***"metric":***,"value":[1750330717.608,"23.70000000000001"]***]*** k8s_pod_cpu_limit: 1750330717.608 monitor cluster Success `kubectl delete pod redis-ljzvzz-kb-curl --namespace kb-mqtcr --force` Warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely. pod "redis-ljzvzz-kb-curl" force deleted check cluster status `kbcli cluster list redis-ljzvzz --show-labels --namespace ns-jcjpx ` NAME NAMESPACE CLUSTER-DEFINITION VERSION TERMINATION-POLICY STATUS CREATED-TIME LABELS redis-ljzvzz ns-jcjpx Delete Running Jun 19,2025 18:16 UTC+0800 app.kubernetes.io/instance=redis-ljzvzz check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances redis-ljzvzz --namespace ns-jcjpx ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME redis-ljzvzz-redis-0 ns-jcjpx redis-ljzvzz redis Running secondary us-west-2a 100m / 100m 512Mi / 512Mi data:2Gi ip-172-31-6-155.us-west-2.compute.internal/172.31.6.155 Jun 19,2025 18:57 UTC+0800 redis-ljzvzz-redis-1 ns-jcjpx redis-ljzvzz redis Running primary us-west-2a 100m / 100m 512Mi / 512Mi data:2Gi ip-172-31-6-232.us-west-2.compute.internal/172.31.6.232 Jun 19,2025 18:46 UTC+0800 redis-ljzvzz-redis-sentinel-0 ns-jcjpx redis-ljzvzz redis-sentinel Running us-west-2a 100m / 100m 512Mi / 512Mi data:1Gi ip-172-31-6-232.us-west-2.compute.internal/172.31.6.232 Jun 19,2025 18:47 UTC+0800 redis-ljzvzz-redis-sentinel-1 ns-jcjpx redis-ljzvzz redis-sentinel Running us-west-2a 100m / 100m 512Mi / 512Mi data:1Gi ip-172-31-1-34.us-west-2.compute.internal/172.31.1.34 Jun 19,2025 18:47 UTC+0800 redis-ljzvzz-redis-sentinel-2 ns-jcjpx redis-ljzvzz redis-sentinel Running us-west-2a 100m / 100m 512Mi / 512Mi data:1Gi ip-172-31-12-104.us-west-2.compute.internal/172.31.12.104 Jun 19,2025 18:46 UTC+0800 redis-ljzvzz-redis-twemproxy-0 ns-jcjpx redis-ljzvzz redis-twemproxy Running us-west-2a 100m / 100m 512Mi / 512Mi data:1Gi ip-172-31-10-206.us-west-2.compute.internal/172.31.10.206 Jun 19,2025 18:55 UTC+0800 redis-ljzvzz-redis-twemproxy-1 ns-jcjpx redis-ljzvzz redis-twemproxy Running us-west-2a 100m / 100m 512Mi / 512Mi data:1Gi ip-172-31-6-232.us-west-2.compute.internal/172.31.6.232 Jun 19,2025 18:48 UTC+0800 redis-ljzvzz-redis-twemproxy-2 ns-jcjpx redis-ljzvzz redis-twemproxy Running us-west-2a 100m / 100m 512Mi / 512Mi data:1Gi ip-172-31-2-181.us-west-2.compute.internal/172.31.2.181 Jun 19,2025 18:47 UTC+0800 check pod status done check cluster role check cluster role done primary: redis-ljzvzz-redis-1;secondary: redis-ljzvzz-redis-0 `kubectl get secrets -l app.kubernetes.io/instance=redis-ljzvzz` set secret: redis-ljzvzz-redis-account-default `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.username***"` `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.password***"` `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.port***"` DB_USERNAME_PROXY:;DB_PASSWORD_PROXY:;DB_PORT_PROXY:26379 DB_USERNAME:default;DB_PASSWORD:gu97Tl5m13;DB_PORT:6379;DB_DATABASE:db0 check cluster connect `echo 'echo "" | redis-cli -h redis-ljzvzz-redis-redis.ns-jcjpx.svc.cluster.local -p 6379 -a gu97Tl5m13' | kubectl exec -it redis-ljzvzz-redis-1 --namespace ns-jcjpx -- bash` check cluster connect done test failover dnserror check node drain check node drain success `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge DNSChaos test-chaos-mesh-dnserror-redis-ljzvzz --namespace ns-jcjpx ` Warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely. Error from server (NotFound): dnschaos.chaos-mesh.org "test-chaos-mesh-dnserror-redis-ljzvzz" not found Error from server (NotFound): dnschaos.chaos-mesh.org "test-chaos-mesh-dnserror-redis-ljzvzz" not found apiVersion: chaos-mesh.org/v1alpha1 kind: DNSChaos metadata: name: test-chaos-mesh-dnserror-redis-ljzvzz namespace: ns-jcjpx spec: selector: namespaces: - ns-jcjpx labelSelectors: apps.kubeblocks.io/pod-name: redis-ljzvzz-redis-1 mode: all action: error duration: 2m `kubectl apply -f test-chaos-mesh-dnserror-redis-ljzvzz.yaml` dnschaos.chaos-mesh.org/test-chaos-mesh-dnserror-redis-ljzvzz created apply test-chaos-mesh-dnserror-redis-ljzvzz.yaml Success `rm -rf test-chaos-mesh-dnserror-redis-ljzvzz.yaml` dnserror chaos test waiting 120 seconds check cluster status `kbcli cluster list redis-ljzvzz --show-labels --namespace ns-jcjpx ` NAME NAMESPACE CLUSTER-DEFINITION VERSION TERMINATION-POLICY STATUS CREATED-TIME LABELS redis-ljzvzz ns-jcjpx Delete Running Jun 19,2025 18:16 UTC+0800 app.kubernetes.io/instance=redis-ljzvzz check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances redis-ljzvzz --namespace ns-jcjpx ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME redis-ljzvzz-redis-0 ns-jcjpx redis-ljzvzz redis Running secondary us-west-2a 100m / 100m 512Mi / 512Mi data:2Gi ip-172-31-6-155.us-west-2.compute.internal/172.31.6.155 Jun 19,2025 18:57 UTC+0800 redis-ljzvzz-redis-1 ns-jcjpx redis-ljzvzz redis Running primary us-west-2a 100m / 100m 512Mi / 512Mi data:2Gi ip-172-31-6-232.us-west-2.compute.internal/172.31.6.232 Jun 19,2025 18:46 UTC+0800 redis-ljzvzz-redis-sentinel-0 ns-jcjpx redis-ljzvzz redis-sentinel Running us-west-2a 100m / 100m 512Mi / 512Mi data:1Gi ip-172-31-6-232.us-west-2.compute.internal/172.31.6.232 Jun 19,2025 18:47 UTC+0800 redis-ljzvzz-redis-sentinel-1 ns-jcjpx redis-ljzvzz redis-sentinel Running us-west-2a 100m / 100m 512Mi / 512Mi data:1Gi ip-172-31-1-34.us-west-2.compute.internal/172.31.1.34 Jun 19,2025 18:47 UTC+0800 redis-ljzvzz-redis-sentinel-2 ns-jcjpx redis-ljzvzz redis-sentinel Running us-west-2a 100m / 100m 512Mi / 512Mi data:1Gi ip-172-31-12-104.us-west-2.compute.internal/172.31.12.104 Jun 19,2025 18:46 UTC+0800 redis-ljzvzz-redis-twemproxy-0 ns-jcjpx redis-ljzvzz redis-twemproxy Running us-west-2a 100m / 100m 512Mi / 512Mi data:1Gi ip-172-31-10-206.us-west-2.compute.internal/172.31.10.206 Jun 19,2025 18:55 UTC+0800 redis-ljzvzz-redis-twemproxy-1 ns-jcjpx redis-ljzvzz redis-twemproxy Running us-west-2a 100m / 100m 512Mi / 512Mi data:1Gi ip-172-31-6-232.us-west-2.compute.internal/172.31.6.232 Jun 19,2025 18:48 UTC+0800 redis-ljzvzz-redis-twemproxy-2 ns-jcjpx redis-ljzvzz redis-twemproxy Running us-west-2a 100m / 100m 512Mi / 512Mi data:1Gi ip-172-31-2-181.us-west-2.compute.internal/172.31.2.181 Jun 19,2025 18:47 UTC+0800 check pod status done check cluster role check cluster role done primary: redis-ljzvzz-redis-1;secondary: redis-ljzvzz-redis-0 `kubectl get secrets -l app.kubernetes.io/instance=redis-ljzvzz` set secret: redis-ljzvzz-redis-account-default `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.username***"` `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.password***"` `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.port***"` DB_USERNAME_PROXY:;DB_PASSWORD_PROXY:;DB_PORT_PROXY:26379 DB_USERNAME:default;DB_PASSWORD:gu97Tl5m13;DB_PORT:6379;DB_DATABASE:db0 check cluster connect `echo 'echo "" | redis-cli -h redis-ljzvzz-redis-redis.ns-jcjpx.svc.cluster.local -p 6379 -a gu97Tl5m13' | kubectl exec -it redis-ljzvzz-redis-1 --namespace ns-jcjpx -- bash` check cluster connect done `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge DNSChaos test-chaos-mesh-dnserror-redis-ljzvzz --namespace ns-jcjpx ` Warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely. dnschaos.chaos-mesh.org "test-chaos-mesh-dnserror-redis-ljzvzz" force deleted Error from server (NotFound): dnschaos.chaos-mesh.org "test-chaos-mesh-dnserror-redis-ljzvzz" not found check failover pod name failover pod name:redis-ljzvzz-redis-1 failover dnserror Success `echo 'get mykey' | kbcli cluster connect redis-ljzvzz --namespace ns-jcjpx ` check data: Connect to instance redis-ljzvzz-redis-1: out of redis-ljzvzz-redis-1(primary), redis-ljzvzz-redis-0(secondary) Unable to use a TTY - input is not a terminal or the right kind of file Warning: Using a password with '-a' or '-u' option on the command line interface may not be safe. bxtif check cluster data consistent Success `kubectl get secrets -l app.kubernetes.io/instance=redis-ljzvzz` set secret: redis-ljzvzz-redis-account-default `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.username***"` `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.password***"` `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.port***"` DB_USERNAME_PROXY:;DB_PASSWORD_PROXY:;DB_PORT_PROXY:26379 DB_USERNAME:default;DB_PASSWORD:gu97Tl5m13;DB_PORT:6379;DB_DATABASE:db0 `echo "echo \"get mykey\" | redis-cli -h 127.0.0.1 -p 6379 -a gu97Tl5m13 " | kubectl exec -it redis-ljzvzz-redis-0 --namespace ns-jcjpx -- bash ` check readonly data: Defaulted container "redis" out of: redis, metrics, lorry, init-lorry (init) Unable to use a TTY - input is not a terminal or the right kind of file Warning: Using a password with '-a' or '-u' option on the command line interface may not be safe. bxtif check cluster readonly data consistent Success check db_client batch data count `echo 'get executions_loop_key' | kbcli cluster connect redis-ljzvzz --namespace ns-jcjpx ` check db_client batch data Success `kubectl get secrets -l app.kubernetes.io/instance=redis-ljzvzz` set secret: redis-ljzvzz-redis-account-default `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.username***"` `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.password***"` `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.port***"` DB_USERNAME_PROXY:;DB_PASSWORD_PROXY:;DB_PORT_PROXY:26379 DB_USERNAME:default;DB_PASSWORD:gu97Tl5m13;DB_PORT:6379;DB_DATABASE:db0 check readonly db_client batch data count `echo "echo \"get executions_loop_key\" | redis-cli -h 127.0.0.1 -p 6379 -a gu97Tl5m13 " | kubectl exec -it redis-ljzvzz-redis-0 --namespace ns-jcjpx -- bash ` check readonly db_client batch data Success cluster hscale check cluster status before ops check cluster status done cluster_status:Running No resources found in redis-ljzvzz namespace. `kbcli cluster hscale redis-ljzvzz --auto-approve --force=true --components redis --replicas 3 --namespace ns-jcjpx ` OpsRequest redis-ljzvzz-horizontalscaling-xvtxn created successfully, you can view the progress: kbcli cluster describe-ops redis-ljzvzz-horizontalscaling-xvtxn -n ns-jcjpx check ops status `kbcli cluster list-ops redis-ljzvzz --status all --namespace ns-jcjpx ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME redis-ljzvzz-horizontalscaling-xvtxn ns-jcjpx HorizontalScaling redis-ljzvzz redis Running 0/1 Jun 19,2025 19:01 UTC+0800 check cluster status `kbcli cluster list redis-ljzvzz --show-labels --namespace ns-jcjpx ` NAME NAMESPACE CLUSTER-DEFINITION VERSION TERMINATION-POLICY STATUS CREATED-TIME LABELS redis-ljzvzz ns-jcjpx Delete Updating Jun 19,2025 18:16 UTC+0800 app.kubernetes.io/instance=redis-ljzvzz cluster_status:Updating cluster_status:Updating check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances redis-ljzvzz --namespace ns-jcjpx ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME redis-ljzvzz-redis-0 ns-jcjpx redis-ljzvzz redis Running secondary us-west-2a 100m / 100m 512Mi / 512Mi data:2Gi ip-172-31-6-155.us-west-2.compute.internal/172.31.6.155 Jun 19,2025 18:57 UTC+0800 redis-ljzvzz-redis-1 ns-jcjpx redis-ljzvzz redis Running primary us-west-2a 100m / 100m 512Mi / 512Mi data:2Gi ip-172-31-6-232.us-west-2.compute.internal/172.31.6.232 Jun 19,2025 18:46 UTC+0800 redis-ljzvzz-redis-2 ns-jcjpx redis-ljzvzz redis Running secondary us-west-2a 100m / 100m 512Mi / 512Mi data:2Gi ip-172-31-8-116.us-west-2.compute.internal/172.31.8.116 Jun 19,2025 19:01 UTC+0800 redis-ljzvzz-redis-sentinel-0 ns-jcjpx redis-ljzvzz redis-sentinel Running us-west-2a 100m / 100m 512Mi / 512Mi data:1Gi ip-172-31-6-232.us-west-2.compute.internal/172.31.6.232 Jun 19,2025 18:47 UTC+0800 redis-ljzvzz-redis-sentinel-1 ns-jcjpx redis-ljzvzz redis-sentinel Running us-west-2a 100m / 100m 512Mi / 512Mi data:1Gi ip-172-31-1-34.us-west-2.compute.internal/172.31.1.34 Jun 19,2025 18:47 UTC+0800 redis-ljzvzz-redis-sentinel-2 ns-jcjpx redis-ljzvzz redis-sentinel Running us-west-2a 100m / 100m 512Mi / 512Mi data:1Gi ip-172-31-12-104.us-west-2.compute.internal/172.31.12.104 Jun 19,2025 18:46 UTC+0800 redis-ljzvzz-redis-twemproxy-0 ns-jcjpx redis-ljzvzz redis-twemproxy Running us-west-2a 100m / 100m 512Mi / 512Mi data:1Gi ip-172-31-10-206.us-west-2.compute.internal/172.31.10.206 Jun 19,2025 18:55 UTC+0800 redis-ljzvzz-redis-twemproxy-1 ns-jcjpx redis-ljzvzz redis-twemproxy Running us-west-2a 100m / 100m 512Mi / 512Mi data:1Gi ip-172-31-6-232.us-west-2.compute.internal/172.31.6.232 Jun 19,2025 18:48 UTC+0800 redis-ljzvzz-redis-twemproxy-2 ns-jcjpx redis-ljzvzz redis-twemproxy Running us-west-2a 100m / 100m 512Mi / 512Mi data:1Gi ip-172-31-2-181.us-west-2.compute.internal/172.31.2.181 Jun 19,2025 18:47 UTC+0800 check pod status done check cluster role check cluster role done primary: redis-ljzvzz-redis-1;secondary: redis-ljzvzz-redis-0 redis-ljzvzz-redis-2 `kubectl get secrets -l app.kubernetes.io/instance=redis-ljzvzz` set secret: redis-ljzvzz-redis-account-default `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.username***"` `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.password***"` `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.port***"` DB_USERNAME_PROXY:;DB_PASSWORD_PROXY:;DB_PORT_PROXY:26379 DB_USERNAME:default;DB_PASSWORD:gu97Tl5m13;DB_PORT:6379;DB_DATABASE:db0 check cluster connect `echo 'echo "" | redis-cli -h redis-ljzvzz-redis-redis.ns-jcjpx.svc.cluster.local -p 6379 -a gu97Tl5m13' | kubectl exec -it redis-ljzvzz-redis-1 --namespace ns-jcjpx -- bash` check cluster connect done No resources found in redis-ljzvzz namespace. check ops status `kbcli cluster list-ops redis-ljzvzz --status all --namespace ns-jcjpx ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME redis-ljzvzz-horizontalscaling-xvtxn ns-jcjpx HorizontalScaling redis-ljzvzz redis Succeed 1/1 Jun 19,2025 19:01 UTC+0800 check ops status done ops_status:redis-ljzvzz-horizontalscaling-xvtxn ns-jcjpx HorizontalScaling redis-ljzvzz redis Succeed 1/1 Jun 19,2025 19:01 UTC+0800 `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge opsrequests redis-ljzvzz-horizontalscaling-xvtxn --namespace ns-jcjpx ` opsrequest.apps.kubeblocks.io/redis-ljzvzz-horizontalscaling-xvtxn patched `kbcli cluster delete-ops --name redis-ljzvzz-horizontalscaling-xvtxn --force --auto-approve --namespace ns-jcjpx ` OpsRequest redis-ljzvzz-horizontalscaling-xvtxn deleted `echo 'get mykey' | kbcli cluster connect redis-ljzvzz --namespace ns-jcjpx ` check data: Connect to instance redis-ljzvzz-redis-1: out of redis-ljzvzz-redis-1(primary), redis-ljzvzz-redis-0(secondary), redis-ljzvzz-redis-2(secondary) Unable to use a TTY - input is not a terminal or the right kind of file Warning: Using a password with '-a' or '-u' option on the command line interface may not be safe. bxtif check cluster data consistent Success `kubectl get secrets -l app.kubernetes.io/instance=redis-ljzvzz` set secret: redis-ljzvzz-redis-account-default `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.username***"` `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.password***"` `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.port***"` DB_USERNAME_PROXY:;DB_PASSWORD_PROXY:;DB_PORT_PROXY:26379 DB_USERNAME:default;DB_PASSWORD:gu97Tl5m13;DB_PORT:6379;DB_DATABASE:db0 `echo "echo \"get mykey\" | redis-cli -h 127.0.0.1 -p 6379 -a gu97Tl5m13 " | kubectl exec -it redis-ljzvzz-redis-0 --namespace ns-jcjpx -- bash ` check readonly data: Defaulted container "redis" out of: redis, metrics, lorry, init-lorry (init) Unable to use a TTY - input is not a terminal or the right kind of file Warning: Using a password with '-a' or '-u' option on the command line interface may not be safe. bxtif check cluster readonly data consistent Success check db_client batch data count `echo 'get executions_loop_key' | kbcli cluster connect redis-ljzvzz --namespace ns-jcjpx ` check db_client batch data Success `kubectl get secrets -l app.kubernetes.io/instance=redis-ljzvzz` set secret: redis-ljzvzz-redis-account-default `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.username***"` `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.password***"` `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.port***"` DB_USERNAME_PROXY:;DB_PASSWORD_PROXY:;DB_PORT_PROXY:26379 DB_USERNAME:default;DB_PASSWORD:gu97Tl5m13;DB_PORT:6379;DB_DATABASE:db0 check readonly db_client batch data count `echo "echo \"get executions_loop_key\" | redis-cli -h 127.0.0.1 -p 6379 -a gu97Tl5m13 " | kubectl exec -it redis-ljzvzz-redis-0 --namespace ns-jcjpx -- bash ` check readonly db_client batch data Success get redis-sentinel replicas get redis-twemproxy replicas cluster hscale check cluster status before ops check cluster status done cluster_status:Running No resources found in redis-ljzvzz namespace. `kbcli cluster hscale redis-ljzvzz --auto-approve --force=true --components redis --replicas 2 --namespace ns-jcjpx ` OpsRequest redis-ljzvzz-horizontalscaling-x7n26 created successfully, you can view the progress: kbcli cluster describe-ops redis-ljzvzz-horizontalscaling-x7n26 -n ns-jcjpx check ops status `kbcli cluster list-ops redis-ljzvzz --status all --namespace ns-jcjpx ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME redis-ljzvzz-horizontalscaling-x7n26 ns-jcjpx HorizontalScaling redis-ljzvzz redis Running 0/1 Jun 19,2025 19:02 UTC+0800 check cluster status `kbcli cluster list redis-ljzvzz --show-labels --namespace ns-jcjpx ` NAME NAMESPACE CLUSTER-DEFINITION VERSION TERMINATION-POLICY STATUS CREATED-TIME LABELS redis-ljzvzz ns-jcjpx Delete Running Jun 19,2025 18:16 UTC+0800 app.kubernetes.io/instance=redis-ljzvzz check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances redis-ljzvzz --namespace ns-jcjpx ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME redis-ljzvzz-redis-0 ns-jcjpx redis-ljzvzz redis Running secondary us-west-2a 100m / 100m 512Mi / 512Mi data:2Gi ip-172-31-6-155.us-west-2.compute.internal/172.31.6.155 Jun 19,2025 18:57 UTC+0800 redis-ljzvzz-redis-1 ns-jcjpx redis-ljzvzz redis Running primary us-west-2a 100m / 100m 512Mi / 512Mi data:2Gi ip-172-31-6-232.us-west-2.compute.internal/172.31.6.232 Jun 19,2025 18:46 UTC+0800 redis-ljzvzz-redis-sentinel-0 ns-jcjpx redis-ljzvzz redis-sentinel Running us-west-2a 100m / 100m 512Mi / 512Mi data:1Gi ip-172-31-6-232.us-west-2.compute.internal/172.31.6.232 Jun 19,2025 18:47 UTC+0800 redis-ljzvzz-redis-sentinel-1 ns-jcjpx redis-ljzvzz redis-sentinel Running us-west-2a 100m / 100m 512Mi / 512Mi data:1Gi ip-172-31-1-34.us-west-2.compute.internal/172.31.1.34 Jun 19,2025 18:47 UTC+0800 redis-ljzvzz-redis-sentinel-2 ns-jcjpx redis-ljzvzz redis-sentinel Running us-west-2a 100m / 100m 512Mi / 512Mi data:1Gi ip-172-31-12-104.us-west-2.compute.internal/172.31.12.104 Jun 19,2025 18:46 UTC+0800 redis-ljzvzz-redis-twemproxy-0 ns-jcjpx redis-ljzvzz redis-twemproxy Running us-west-2a 100m / 100m 512Mi / 512Mi data:1Gi ip-172-31-10-206.us-west-2.compute.internal/172.31.10.206 Jun 19,2025 18:55 UTC+0800 redis-ljzvzz-redis-twemproxy-1 ns-jcjpx redis-ljzvzz redis-twemproxy Running us-west-2a 100m / 100m 512Mi / 512Mi data:1Gi ip-172-31-6-232.us-west-2.compute.internal/172.31.6.232 Jun 19,2025 18:48 UTC+0800 redis-ljzvzz-redis-twemproxy-2 ns-jcjpx redis-ljzvzz redis-twemproxy Running us-west-2a 100m / 100m 512Mi / 512Mi data:1Gi ip-172-31-2-181.us-west-2.compute.internal/172.31.2.181 Jun 19,2025 18:47 UTC+0800 check pod status done check cluster role check cluster role done primary: redis-ljzvzz-redis-1;secondary: redis-ljzvzz-redis-0 `kubectl get secrets -l app.kubernetes.io/instance=redis-ljzvzz` set secret: redis-ljzvzz-redis-account-default `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.username***"` `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.password***"` `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.port***"` DB_USERNAME_PROXY:;DB_PASSWORD_PROXY:;DB_PORT_PROXY:26379 DB_USERNAME:default;DB_PASSWORD:gu97Tl5m13;DB_PORT:6379;DB_DATABASE:db0 check cluster connect `echo 'echo "" | redis-cli -h redis-ljzvzz-redis-redis.ns-jcjpx.svc.cluster.local -p 6379 -a gu97Tl5m13' | kubectl exec -it redis-ljzvzz-redis-1 --namespace ns-jcjpx -- bash` check cluster connect done No resources found in redis-ljzvzz namespace. check ops status `kbcli cluster list-ops redis-ljzvzz --status all --namespace ns-jcjpx ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME redis-ljzvzz-horizontalscaling-x7n26 ns-jcjpx HorizontalScaling redis-ljzvzz redis Succeed 1/1 Jun 19,2025 19:02 UTC+0800 check ops status done ops_status:redis-ljzvzz-horizontalscaling-x7n26 ns-jcjpx HorizontalScaling redis-ljzvzz redis Succeed 1/1 Jun 19,2025 19:02 UTC+0800 `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge opsrequests redis-ljzvzz-horizontalscaling-x7n26 --namespace ns-jcjpx ` opsrequest.apps.kubeblocks.io/redis-ljzvzz-horizontalscaling-x7n26 patched `kbcli cluster delete-ops --name redis-ljzvzz-horizontalscaling-x7n26 --force --auto-approve --namespace ns-jcjpx ` OpsRequest redis-ljzvzz-horizontalscaling-x7n26 deleted `echo 'get mykey' | kbcli cluster connect redis-ljzvzz --namespace ns-jcjpx ` check data: Connect to instance redis-ljzvzz-redis-1: out of redis-ljzvzz-redis-1(primary), redis-ljzvzz-redis-0(secondary) Unable to use a TTY - input is not a terminal or the right kind of file Warning: Using a password with '-a' or '-u' option on the command line interface may not be safe. bxtif check cluster data consistent Success `kubectl get secrets -l app.kubernetes.io/instance=redis-ljzvzz` set secret: redis-ljzvzz-redis-account-default `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.username***"` `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.password***"` `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.port***"` DB_USERNAME_PROXY:;DB_PASSWORD_PROXY:;DB_PORT_PROXY:26379 DB_USERNAME:default;DB_PASSWORD:gu97Tl5m13;DB_PORT:6379;DB_DATABASE:db0 `echo "echo \"get mykey\" | redis-cli -h 127.0.0.1 -p 6379 -a gu97Tl5m13 " | kubectl exec -it redis-ljzvzz-redis-0 --namespace ns-jcjpx -- bash ` check readonly data: Defaulted container "redis" out of: redis, metrics, lorry, init-lorry (init) Unable to use a TTY - input is not a terminal or the right kind of file Warning: Using a password with '-a' or '-u' option on the command line interface may not be safe. bxtif check cluster readonly data consistent Success check db_client batch data count `echo 'get executions_loop_key' | kbcli cluster connect redis-ljzvzz --namespace ns-jcjpx ` check db_client batch data Success `kubectl get secrets -l app.kubernetes.io/instance=redis-ljzvzz` set secret: redis-ljzvzz-redis-account-default `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.username***"` `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.password***"` `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.port***"` DB_USERNAME_PROXY:;DB_PASSWORD_PROXY:;DB_PORT_PROXY:26379 DB_USERNAME:default;DB_PASSWORD:gu97Tl5m13;DB_PORT:6379;DB_DATABASE:db0 check readonly db_client batch data count `echo "echo \"get executions_loop_key\" | redis-cli -h 127.0.0.1 -p 6379 -a gu97Tl5m13 " | kubectl exec -it redis-ljzvzz-redis-0 --namespace ns-jcjpx -- bash ` check readonly db_client batch data Success test failover oom check node drain check node drain success `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge StressChaos test-chaos-mesh-oom-redis-ljzvzz --namespace ns-jcjpx ` Warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely. Error from server (NotFound): stresschaos.chaos-mesh.org "test-chaos-mesh-oom-redis-ljzvzz" not found Error from server (NotFound): stresschaos.chaos-mesh.org "test-chaos-mesh-oom-redis-ljzvzz" not found apiVersion: chaos-mesh.org/v1alpha1 kind: StressChaos metadata: name: test-chaos-mesh-oom-redis-ljzvzz namespace: ns-jcjpx spec: selector: namespaces: - ns-jcjpx labelSelectors: apps.kubeblocks.io/pod-name: redis-ljzvzz-redis-1 mode: all stressors: memory: workers: 1 size: "100GB" oomScoreAdj: -1000 duration: 2m `kubectl apply -f test-chaos-mesh-oom-redis-ljzvzz.yaml` stresschaos.chaos-mesh.org/test-chaos-mesh-oom-redis-ljzvzz created apply test-chaos-mesh-oom-redis-ljzvzz.yaml Success `rm -rf test-chaos-mesh-oom-redis-ljzvzz.yaml` check cluster status `kbcli cluster list redis-ljzvzz --show-labels --namespace ns-jcjpx ` NAME NAMESPACE CLUSTER-DEFINITION VERSION TERMINATION-POLICY STATUS CREATED-TIME LABELS redis-ljzvzz ns-jcjpx Delete Updating Jun 19,2025 18:16 UTC+0800 app.kubernetes.io/instance=redis-ljzvzz cluster_status:Updating cluster_status:Updating cluster_status:Abnormal cluster_status:Abnormal cluster_status:Abnormal cluster_status:Abnormal cluster_status:Abnormal cluster_status:Abnormal cluster_status:Abnormal cluster_status:Abnormal cluster_status:Abnormal cluster_status:Abnormal cluster_status:Abnormal cluster_status:Abnormal cluster_status:Abnormal cluster_status:Abnormal cluster_status:Abnormal cluster_status:Abnormal cluster_status:Abnormal cluster_status:Abnormal cluster_status:Abnormal cluster_status:Abnormal cluster_status:Abnormal cluster_status:Abnormal cluster_status:Abnormal Warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely. pod "redis-ljzvzz-redis-1" force deleted cluster_status:Updating cluster_status:Updating check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances redis-ljzvzz --namespace ns-jcjpx ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME redis-ljzvzz-redis-0 ns-jcjpx redis-ljzvzz redis Running primary us-west-2a 100m / 100m 512Mi / 512Mi data:2Gi ip-172-31-6-155.us-west-2.compute.internal/172.31.6.155 Jun 19,2025 18:57 UTC+0800 redis-ljzvzz-redis-1 ns-jcjpx redis-ljzvzz redis Running secondary us-west-2a 100m / 100m 512Mi / 512Mi data:2Gi ip-172-31-6-232.us-west-2.compute.internal/172.31.6.232 Jun 19,2025 19:05 UTC+0800 redis-ljzvzz-redis-sentinel-0 ns-jcjpx redis-ljzvzz redis-sentinel Running us-west-2a 100m / 100m 512Mi / 512Mi data:1Gi ip-172-31-6-232.us-west-2.compute.internal/172.31.6.232 Jun 19,2025 18:47 UTC+0800 redis-ljzvzz-redis-sentinel-1 ns-jcjpx redis-ljzvzz redis-sentinel Running us-west-2a 100m / 100m 512Mi / 512Mi data:1Gi ip-172-31-1-34.us-west-2.compute.internal/172.31.1.34 Jun 19,2025 18:47 UTC+0800 redis-ljzvzz-redis-sentinel-2 ns-jcjpx redis-ljzvzz redis-sentinel Running us-west-2a 100m / 100m 512Mi / 512Mi data:1Gi ip-172-31-12-104.us-west-2.compute.internal/172.31.12.104 Jun 19,2025 18:46 UTC+0800 redis-ljzvzz-redis-twemproxy-0 ns-jcjpx redis-ljzvzz redis-twemproxy Running us-west-2a 100m / 100m 512Mi / 512Mi data:1Gi ip-172-31-10-206.us-west-2.compute.internal/172.31.10.206 Jun 19,2025 18:55 UTC+0800 redis-ljzvzz-redis-twemproxy-1 ns-jcjpx redis-ljzvzz redis-twemproxy Running us-west-2a 100m / 100m 512Mi / 512Mi data:1Gi ip-172-31-6-232.us-west-2.compute.internal/172.31.6.232 Jun 19,2025 18:48 UTC+0800 redis-ljzvzz-redis-twemproxy-2 ns-jcjpx redis-ljzvzz redis-twemproxy Running us-west-2a 100m / 100m 512Mi / 512Mi data:1Gi ip-172-31-2-181.us-west-2.compute.internal/172.31.2.181 Jun 19,2025 18:47 UTC+0800 check pod status done check cluster role check cluster role done primary: redis-ljzvzz-redis-0;secondary: redis-ljzvzz-redis-1 `kubectl get secrets -l app.kubernetes.io/instance=redis-ljzvzz` set secret: redis-ljzvzz-redis-account-default `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.username***"` `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.password***"` `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.port***"` DB_USERNAME_PROXY:;DB_PASSWORD_PROXY:;DB_PORT_PROXY:26379 DB_USERNAME:default;DB_PASSWORD:gu97Tl5m13;DB_PORT:6379;DB_DATABASE:db0 check cluster connect `echo 'echo "" | redis-cli -h redis-ljzvzz-redis-redis.ns-jcjpx.svc.cluster.local -p 6379 -a gu97Tl5m13' | kubectl exec -it redis-ljzvzz-redis-0 --namespace ns-jcjpx -- bash` check cluster connect done `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge StressChaos test-chaos-mesh-oom-redis-ljzvzz --namespace ns-jcjpx ` Warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely. stresschaos.chaos-mesh.org "test-chaos-mesh-oom-redis-ljzvzz" force deleted stresschaos.chaos-mesh.org/test-chaos-mesh-oom-redis-ljzvzz patched check failover pod name failover pod name:redis-ljzvzz-redis-0 failover oom Success `echo 'get mykey' | kbcli cluster connect redis-ljzvzz --namespace ns-jcjpx ` check data: Connect to instance redis-ljzvzz-redis-0: out of redis-ljzvzz-redis-0(primary), redis-ljzvzz-redis-1(secondary) Unable to use a TTY - input is not a terminal or the right kind of file Warning: Using a password with '-a' or '-u' option on the command line interface may not be safe. bxtif check cluster data consistent Success `kubectl get secrets -l app.kubernetes.io/instance=redis-ljzvzz` set secret: redis-ljzvzz-redis-account-default `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.username***"` `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.password***"` `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.port***"` DB_USERNAME_PROXY:;DB_PASSWORD_PROXY:;DB_PORT_PROXY:26379 DB_USERNAME:default;DB_PASSWORD:gu97Tl5m13;DB_PORT:6379;DB_DATABASE:db0 `echo "echo \"get mykey\" | redis-cli -h 127.0.0.1 -p 6379 -a gu97Tl5m13 " | kubectl exec -it redis-ljzvzz-redis-1 --namespace ns-jcjpx -- bash ` check readonly data: Defaulted container "redis" out of: redis, metrics, lorry, init-lorry (init) Unable to use a TTY - input is not a terminal or the right kind of file Warning: Using a password with '-a' or '-u' option on the command line interface may not be safe. bxtif check cluster readonly data consistent Success check db_client batch data count `echo 'get executions_loop_key' | kbcli cluster connect redis-ljzvzz --namespace ns-jcjpx ` check db_client batch data Success `kubectl get secrets -l app.kubernetes.io/instance=redis-ljzvzz` set secret: redis-ljzvzz-redis-account-default `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.username***"` `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.password***"` `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.port***"` DB_USERNAME_PROXY:;DB_PASSWORD_PROXY:;DB_PORT_PROXY:26379 DB_USERNAME:default;DB_PASSWORD:gu97Tl5m13;DB_PORT:6379;DB_DATABASE:db0 check readonly db_client batch data count `echo "echo \"get executions_loop_key\" | redis-cli -h 127.0.0.1 -p 6379 -a gu97Tl5m13 " | kubectl exec -it redis-ljzvzz-redis-1 --namespace ns-jcjpx -- bash ` check readonly db_client batch data Success test failover timeoffset check node drain check node drain success `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge TimeChaos test-chaos-mesh-timeoffset-redis-ljzvzz --namespace ns-jcjpx ` Warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely. Error from server (NotFound): timechaos.chaos-mesh.org "test-chaos-mesh-timeoffset-redis-ljzvzz" not found Error from server (NotFound): timechaos.chaos-mesh.org "test-chaos-mesh-timeoffset-redis-ljzvzz" not found apiVersion: chaos-mesh.org/v1alpha1 kind: TimeChaos metadata: name: test-chaos-mesh-timeoffset-redis-ljzvzz namespace: ns-jcjpx spec: selector: namespaces: - ns-jcjpx labelSelectors: apps.kubeblocks.io/pod-name: redis-ljzvzz-redis-0 mode: all timeOffset: '-10m' clockIds: - CLOCK_REALTIME duration: 2m `kubectl apply -f test-chaos-mesh-timeoffset-redis-ljzvzz.yaml` timechaos.chaos-mesh.org/test-chaos-mesh-timeoffset-redis-ljzvzz created apply test-chaos-mesh-timeoffset-redis-ljzvzz.yaml Success `rm -rf test-chaos-mesh-timeoffset-redis-ljzvzz.yaml` timeoffset chaos test waiting 120 seconds check cluster status `kbcli cluster list redis-ljzvzz --show-labels --namespace ns-jcjpx ` NAME NAMESPACE CLUSTER-DEFINITION VERSION TERMINATION-POLICY STATUS CREATED-TIME LABELS redis-ljzvzz ns-jcjpx Delete Running Jun 19,2025 18:16 UTC+0800 app.kubernetes.io/instance=redis-ljzvzz check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances redis-ljzvzz --namespace ns-jcjpx ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME redis-ljzvzz-redis-0 ns-jcjpx redis-ljzvzz redis Running primary us-west-2a 100m / 100m 512Mi / 512Mi data:2Gi ip-172-31-6-155.us-west-2.compute.internal/172.31.6.155 Jun 19,2025 18:57 UTC+0800 redis-ljzvzz-redis-1 ns-jcjpx redis-ljzvzz redis Running secondary us-west-2a 100m / 100m 512Mi / 512Mi data:2Gi ip-172-31-6-232.us-west-2.compute.internal/172.31.6.232 Jun 19,2025 19:05 UTC+0800 redis-ljzvzz-redis-sentinel-0 ns-jcjpx redis-ljzvzz redis-sentinel Running us-west-2a 100m / 100m 512Mi / 512Mi data:1Gi ip-172-31-6-232.us-west-2.compute.internal/172.31.6.232 Jun 19,2025 18:47 UTC+0800 redis-ljzvzz-redis-sentinel-1 ns-jcjpx redis-ljzvzz redis-sentinel Running us-west-2a 100m / 100m 512Mi / 512Mi data:1Gi ip-172-31-1-34.us-west-2.compute.internal/172.31.1.34 Jun 19,2025 18:47 UTC+0800 redis-ljzvzz-redis-sentinel-2 ns-jcjpx redis-ljzvzz redis-sentinel Running us-west-2a 100m / 100m 512Mi / 512Mi data:1Gi ip-172-31-12-104.us-west-2.compute.internal/172.31.12.104 Jun 19,2025 18:46 UTC+0800 redis-ljzvzz-redis-twemproxy-0 ns-jcjpx redis-ljzvzz redis-twemproxy Running us-west-2a 100m / 100m 512Mi / 512Mi data:1Gi ip-172-31-10-206.us-west-2.compute.internal/172.31.10.206 Jun 19,2025 18:55 UTC+0800 redis-ljzvzz-redis-twemproxy-1 ns-jcjpx redis-ljzvzz redis-twemproxy Running us-west-2a 100m / 100m 512Mi / 512Mi data:1Gi ip-172-31-6-232.us-west-2.compute.internal/172.31.6.232 Jun 19,2025 18:48 UTC+0800 redis-ljzvzz-redis-twemproxy-2 ns-jcjpx redis-ljzvzz redis-twemproxy Running us-west-2a 100m / 100m 512Mi / 512Mi data:1Gi ip-172-31-2-181.us-west-2.compute.internal/172.31.2.181 Jun 19,2025 18:47 UTC+0800 check pod status done check cluster role check cluster role done primary: redis-ljzvzz-redis-0;secondary: redis-ljzvzz-redis-1 `kubectl get secrets -l app.kubernetes.io/instance=redis-ljzvzz` set secret: redis-ljzvzz-redis-account-default `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.username***"` `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.password***"` `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.port***"` DB_USERNAME_PROXY:;DB_PASSWORD_PROXY:;DB_PORT_PROXY:26379 DB_USERNAME:default;DB_PASSWORD:gu97Tl5m13;DB_PORT:6379;DB_DATABASE:db0 check cluster connect `echo 'echo "" | redis-cli -h redis-ljzvzz-redis-redis.ns-jcjpx.svc.cluster.local -p 6379 -a gu97Tl5m13' | kubectl exec -it redis-ljzvzz-redis-0 --namespace ns-jcjpx -- bash` check cluster connect done `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge TimeChaos test-chaos-mesh-timeoffset-redis-ljzvzz --namespace ns-jcjpx ` Warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely. timechaos.chaos-mesh.org "test-chaos-mesh-timeoffset-redis-ljzvzz" force deleted Error from server (NotFound): timechaos.chaos-mesh.org "test-chaos-mesh-timeoffset-redis-ljzvzz" not found check failover pod name failover pod name:redis-ljzvzz-redis-0 failover timeoffset Success `echo 'get mykey' | kbcli cluster connect redis-ljzvzz --namespace ns-jcjpx ` check data: Connect to instance redis-ljzvzz-redis-0: out of redis-ljzvzz-redis-0(primary), redis-ljzvzz-redis-1(secondary) Unable to use a TTY - input is not a terminal or the right kind of file Warning: Using a password with '-a' or '-u' option on the command line interface may not be safe. bxtif check cluster data consistent Success `kubectl get secrets -l app.kubernetes.io/instance=redis-ljzvzz` set secret: redis-ljzvzz-redis-account-default `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.username***"` `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.password***"` `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.port***"` DB_USERNAME_PROXY:;DB_PASSWORD_PROXY:;DB_PORT_PROXY:26379 DB_USERNAME:default;DB_PASSWORD:gu97Tl5m13;DB_PORT:6379;DB_DATABASE:db0 `echo "echo \"get mykey\" | redis-cli -h 127.0.0.1 -p 6379 -a gu97Tl5m13 " | kubectl exec -it redis-ljzvzz-redis-1 --namespace ns-jcjpx -- bash ` check readonly data: Defaulted container "redis" out of: redis, metrics, lorry, init-lorry (init) Unable to use a TTY - input is not a terminal or the right kind of file bxtif Warning: Using a password with '-a' or '-u' option on the command line interface may not be safe. check cluster readonly data consistent Success check db_client batch data count `echo 'get executions_loop_key' | kbcli cluster connect redis-ljzvzz --namespace ns-jcjpx ` check db_client batch data Success `kubectl get secrets -l app.kubernetes.io/instance=redis-ljzvzz` set secret: redis-ljzvzz-redis-account-default `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.username***"` `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.password***"` `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.port***"` DB_USERNAME_PROXY:;DB_PASSWORD_PROXY:;DB_PORT_PROXY:26379 DB_USERNAME:default;DB_PASSWORD:gu97Tl5m13;DB_PORT:6379;DB_DATABASE:db0 check readonly db_client batch data count `echo "echo \"get executions_loop_key\" | redis-cli -h 127.0.0.1 -p 6379 -a gu97Tl5m13 " | kubectl exec -it redis-ljzvzz-redis-1 --namespace ns-jcjpx -- bash ` check readonly db_client batch data Success test failover connectionstress check node drain check node drain success Error from server (NotFound): pods "test-db-client-connectionstress-redis-ljzvzz" not found `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge pods test-db-client-connectionstress-redis-ljzvzz --namespace ns-jcjpx ` Error from server (NotFound): pods "test-db-client-connectionstress-redis-ljzvzz" not found Warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely. Error from server (NotFound): pods "test-db-client-connectionstress-redis-ljzvzz" not found `kubectl get secrets -l app.kubernetes.io/instance=redis-ljzvzz` set secret: redis-ljzvzz-redis-account-default `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.username***"` `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.password***"` `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.port***"` DB_USERNAME_PROXY:;DB_PASSWORD_PROXY:;DB_PORT_PROXY:26379 DB_USERNAME:default;DB_PASSWORD:gu97Tl5m13;DB_PORT:6379;DB_DATABASE:db0 apiVersion: v1 kind: Pod metadata: name: test-db-client-connectionstress-redis-ljzvzz namespace: ns-jcjpx spec: containers: - name: test-dbclient imagePullPolicy: IfNotPresent image: docker.io/apecloud/dbclient:test args: - "--host" - "redis-ljzvzz-redis-redis.ns-jcjpx.svc.cluster.local" - "--user" - "default" - "--password" - "gu97Tl5m13" - "--port" - "6379" - "--database" - "db0" - "--dbtype" - "redis" - "--test" - "connectionstress" - "--connections" - "5000" - "--duration" - "60" restartPolicy: Never `kubectl apply -f test-db-client-connectionstress-redis-ljzvzz.yaml` pod/test-db-client-connectionstress-redis-ljzvzz created apply test-db-client-connectionstress-redis-ljzvzz.yaml Success `rm -rf test-db-client-connectionstress-redis-ljzvzz.yaml` check pod status pod_status:NAME READY STATUS RESTARTS AGE test-db-client-connectionstress-redis-ljzvzz 0/1 ContainerCreating 0 6s pod_status:NAME READY STATUS RESTARTS AGE test-db-client-connectionstress-redis-ljzvzz 1/1 Running 0 11s pod_status:NAME READY STATUS RESTARTS AGE test-db-client-connectionstress-redis-ljzvzz 1/1 Running 0 16s pod_status:NAME READY STATUS RESTARTS AGE test-db-client-connectionstress-redis-ljzvzz 1/1 Running 0 22s pod_status:NAME READY STATUS RESTARTS AGE test-db-client-connectionstress-redis-ljzvzz 1/1 Running 0 28s pod_status:NAME READY STATUS RESTARTS AGE test-db-client-connectionstress-redis-ljzvzz 1/1 Running 0 34s pod_status:NAME READY STATUS RESTARTS AGE test-db-client-connectionstress-redis-ljzvzz 1/1 Running 0 40s pod_status:NAME READY STATUS RESTARTS AGE test-db-client-connectionstress-redis-ljzvzz 1/1 Running 0 45s pod_status:NAME READY STATUS RESTARTS AGE test-db-client-connectionstress-redis-ljzvzz 1/1 Running 0 51s pod_status:NAME READY STATUS RESTARTS AGE test-db-client-connectionstress-redis-ljzvzz 1/1 Running 0 57s pod_status:NAME READY STATUS RESTARTS AGE test-db-client-connectionstress-redis-ljzvzz 1/1 Running 0 63s pod_status:NAME READY STATUS RESTARTS AGE test-db-client-connectionstress-redis-ljzvzz 1/1 Running 0 69s check pod test-db-client-connectionstress-redis-ljzvzz status done pod_status:NAME READY STATUS RESTARTS AGE test-db-client-connectionstress-redis-ljzvzz 0/1 Completed 0 75s check cluster status `kbcli cluster list redis-ljzvzz --show-labels --namespace ns-jcjpx ` NAME NAMESPACE CLUSTER-DEFINITION VERSION TERMINATION-POLICY STATUS CREATED-TIME LABELS redis-ljzvzz ns-jcjpx Delete Running Jun 19,2025 18:16 UTC+0800 app.kubernetes.io/instance=redis-ljzvzz check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances redis-ljzvzz --namespace ns-jcjpx ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME redis-ljzvzz-redis-0 ns-jcjpx redis-ljzvzz redis Running primary us-west-2a 100m / 100m 512Mi / 512Mi data:2Gi ip-172-31-6-155.us-west-2.compute.internal/172.31.6.155 Jun 19,2025 18:57 UTC+0800 redis-ljzvzz-redis-1 ns-jcjpx redis-ljzvzz redis Running secondary us-west-2a 100m / 100m 512Mi / 512Mi data:2Gi ip-172-31-6-232.us-west-2.compute.internal/172.31.6.232 Jun 19,2025 19:05 UTC+0800 redis-ljzvzz-redis-sentinel-0 ns-jcjpx redis-ljzvzz redis-sentinel Running us-west-2a 100m / 100m 512Mi / 512Mi data:1Gi ip-172-31-6-232.us-west-2.compute.internal/172.31.6.232 Jun 19,2025 18:47 UTC+0800 redis-ljzvzz-redis-sentinel-1 ns-jcjpx redis-ljzvzz redis-sentinel Running us-west-2a 100m / 100m 512Mi / 512Mi data:1Gi ip-172-31-1-34.us-west-2.compute.internal/172.31.1.34 Jun 19,2025 18:47 UTC+0800 redis-ljzvzz-redis-sentinel-2 ns-jcjpx redis-ljzvzz redis-sentinel Running us-west-2a 100m / 100m 512Mi / 512Mi data:1Gi ip-172-31-12-104.us-west-2.compute.internal/172.31.12.104 Jun 19,2025 18:46 UTC+0800 redis-ljzvzz-redis-twemproxy-0 ns-jcjpx redis-ljzvzz redis-twemproxy Running us-west-2a 100m / 100m 512Mi / 512Mi data:1Gi ip-172-31-10-206.us-west-2.compute.internal/172.31.10.206 Jun 19,2025 18:55 UTC+0800 redis-ljzvzz-redis-twemproxy-1 ns-jcjpx redis-ljzvzz redis-twemproxy Running us-west-2a 100m / 100m 512Mi / 512Mi data:1Gi ip-172-31-6-232.us-west-2.compute.internal/172.31.6.232 Jun 19,2025 18:48 UTC+0800 redis-ljzvzz-redis-twemproxy-2 ns-jcjpx redis-ljzvzz redis-twemproxy Running us-west-2a 100m / 100m 512Mi / 512Mi data:1Gi ip-172-31-2-181.us-west-2.compute.internal/172.31.2.181 Jun 19,2025 18:47 UTC+0800 check pod status done check cluster role check cluster role done primary: redis-ljzvzz-redis-0;secondary: redis-ljzvzz-redis-1 `kubectl get secrets -l app.kubernetes.io/instance=redis-ljzvzz` set secret: redis-ljzvzz-redis-account-default `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.username***"` `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.password***"` `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.port***"` DB_USERNAME_PROXY:;DB_PASSWORD_PROXY:;DB_PORT_PROXY:26379 DB_USERNAME:default;DB_PASSWORD:gu97Tl5m13;DB_PORT:6379;DB_DATABASE:db0 check cluster connect `echo 'echo "" | redis-cli -h redis-ljzvzz-redis-redis.ns-jcjpx.svc.cluster.local -p 6379 -a gu97Tl5m13' | kubectl exec -it redis-ljzvzz-redis-0 --namespace ns-jcjpx -- bash` check cluster connect done --host redis-ljzvzz-redis-redis.ns-jcjpx.svc.cluster.local --user default --password gu97Tl5m13 --port 6379 --database db0 --dbtype redis --test connectionstress --connections 5000 --duration 60 SLF4J(I): Connected with provider of type [ch.qos.logback.classic.spi.LogbackServiceProvider] Test Result: Connection stress test results: Duration: 60 seconds Successful connections: 2860 Failed connections: 0 Connection Information: Database Type: redis Host: redis-ljzvzz-redis-redis.ns-jcjpx.svc.cluster.local Port: 6379 Database: db0 Table: User: default Org: Access Mode: mysql Test Type: connectionstress Connection Count: 5000 Duration: 60 seconds `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge pods test-db-client-connectionstress-redis-ljzvzz --namespace ns-jcjpx ` pod/test-db-client-connectionstress-redis-ljzvzz patched (no change) Warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely. pod "test-db-client-connectionstress-redis-ljzvzz" force deleted check failover pod name failover pod name:redis-ljzvzz-redis-0 failover connectionstress Success `echo 'get mykey' | kbcli cluster connect redis-ljzvzz --namespace ns-jcjpx ` check data: Connect to instance redis-ljzvzz-redis-0: out of redis-ljzvzz-redis-0(primary), redis-ljzvzz-redis-1(secondary) Unable to use a TTY - input is not a terminal or the right kind of file Warning: Using a password with '-a' or '-u' option on the command line interface may not be safe. bxtif check cluster data consistent Success `kubectl get secrets -l app.kubernetes.io/instance=redis-ljzvzz` set secret: redis-ljzvzz-redis-account-default `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.username***"` `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.password***"` `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.port***"` DB_USERNAME_PROXY:;DB_PASSWORD_PROXY:;DB_PORT_PROXY:26379 DB_USERNAME:default;DB_PASSWORD:gu97Tl5m13;DB_PORT:6379;DB_DATABASE:db0 `echo "echo \"get mykey\" | redis-cli -h 127.0.0.1 -p 6379 -a gu97Tl5m13 " | kubectl exec -it redis-ljzvzz-redis-1 --namespace ns-jcjpx -- bash ` check readonly data: Defaulted container "redis" out of: redis, metrics, lorry, init-lorry (init) Unable to use a TTY - input is not a terminal or the right kind of file bxtif Warning: Using a password with '-a' or '-u' option on the command line interface may not be safe. check cluster readonly data consistent Success check db_client batch data count `echo 'get executions_loop_key' | kbcli cluster connect redis-ljzvzz --namespace ns-jcjpx ` check db_client batch data Success `kubectl get secrets -l app.kubernetes.io/instance=redis-ljzvzz` set secret: redis-ljzvzz-redis-account-default `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.username***"` `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.password***"` `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.port***"` DB_USERNAME_PROXY:;DB_PASSWORD_PROXY:;DB_PORT_PROXY:26379 DB_USERNAME:default;DB_PASSWORD:gu97Tl5m13;DB_PORT:6379;DB_DATABASE:db0 check readonly db_client batch data count `echo "echo \"get executions_loop_key\" | redis-cli -h 127.0.0.1 -p 6379 -a gu97Tl5m13 " | kubectl exec -it redis-ljzvzz-redis-1 --namespace ns-jcjpx -- bash ` check readonly db_client batch data Success cluster configure component_tmp: redis check cluster status before ops check cluster status done cluster_status:Running `kbcli cluster configure redis-ljzvzz --auto-approve --force=true --set maxclients=10001 --components redis --config-spec redis-replication-config --config-file redis.conf --namespace ns-jcjpx ` Will updated configure file meta: ConfigSpec: redis-replication-config ConfigFile: redis.conf ComponentName: redis ClusterName: redis-ljzvzz OpsRequest redis-ljzvzz-reconfiguring-qnpwb created successfully, you can view the progress: kbcli cluster describe-ops redis-ljzvzz-reconfiguring-qnpwb -n ns-jcjpx check ops status `kbcli cluster list-ops redis-ljzvzz --status all --namespace ns-jcjpx ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME redis-ljzvzz-reconfiguring-qnpwb ns-jcjpx Reconfiguring redis-ljzvzz redis Running -/- Jun 19,2025 19:11 UTC+0800 check cluster status `kbcli cluster list redis-ljzvzz --show-labels --namespace ns-jcjpx ` NAME NAMESPACE CLUSTER-DEFINITION VERSION TERMINATION-POLICY STATUS CREATED-TIME LABELS redis-ljzvzz ns-jcjpx Delete Updating Jun 19,2025 18:16 UTC+0800 app.kubernetes.io/instance=redis-ljzvzz cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances redis-ljzvzz --namespace ns-jcjpx ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME redis-ljzvzz-redis-0 ns-jcjpx redis-ljzvzz redis Running secondary us-west-2a 100m / 100m 512Mi / 512Mi data:2Gi ip-172-31-8-116.us-west-2.compute.internal/172.31.8.116 Jun 19,2025 19:12 UTC+0800 redis-ljzvzz-redis-1 ns-jcjpx redis-ljzvzz redis Running primary us-west-2a 100m / 100m 512Mi / 512Mi data:2Gi ip-172-31-13-32.us-west-2.compute.internal/172.31.13.32 Jun 19,2025 19:11 UTC+0800 redis-ljzvzz-redis-sentinel-0 ns-jcjpx redis-ljzvzz redis-sentinel Running us-west-2a 100m / 100m 512Mi / 512Mi data:1Gi ip-172-31-6-232.us-west-2.compute.internal/172.31.6.232 Jun 19,2025 18:47 UTC+0800 redis-ljzvzz-redis-sentinel-1 ns-jcjpx redis-ljzvzz redis-sentinel Running us-west-2a 100m / 100m 512Mi / 512Mi data:1Gi ip-172-31-1-34.us-west-2.compute.internal/172.31.1.34 Jun 19,2025 18:47 UTC+0800 redis-ljzvzz-redis-sentinel-2 ns-jcjpx redis-ljzvzz redis-sentinel Running us-west-2a 100m / 100m 512Mi / 512Mi data:1Gi ip-172-31-12-104.us-west-2.compute.internal/172.31.12.104 Jun 19,2025 18:46 UTC+0800 redis-ljzvzz-redis-twemproxy-0 ns-jcjpx redis-ljzvzz redis-twemproxy Running us-west-2a 100m / 100m 512Mi / 512Mi data:1Gi ip-172-31-10-206.us-west-2.compute.internal/172.31.10.206 Jun 19,2025 18:55 UTC+0800 redis-ljzvzz-redis-twemproxy-1 ns-jcjpx redis-ljzvzz redis-twemproxy Running us-west-2a 100m / 100m 512Mi / 512Mi data:1Gi ip-172-31-6-232.us-west-2.compute.internal/172.31.6.232 Jun 19,2025 18:48 UTC+0800 redis-ljzvzz-redis-twemproxy-2 ns-jcjpx redis-ljzvzz redis-twemproxy Running us-west-2a 100m / 100m 512Mi / 512Mi data:1Gi ip-172-31-2-181.us-west-2.compute.internal/172.31.2.181 Jun 19,2025 18:47 UTC+0800 check pod status done check cluster role check cluster role done primary: redis-ljzvzz-redis-1;secondary: redis-ljzvzz-redis-0 `kubectl get secrets -l app.kubernetes.io/instance=redis-ljzvzz` set secret: redis-ljzvzz-redis-account-default `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.username***"` `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.password***"` `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.port***"` DB_USERNAME_PROXY:;DB_PASSWORD_PROXY:;DB_PORT_PROXY:26379 DB_USERNAME:default;DB_PASSWORD:gu97Tl5m13;DB_PORT:6379;DB_DATABASE:db0 check cluster connect `echo 'echo "" | redis-cli -h redis-ljzvzz-redis-redis.ns-jcjpx.svc.cluster.local -p 6379 -a gu97Tl5m13' | kubectl exec -it redis-ljzvzz-redis-1 --namespace ns-jcjpx -- bash` check cluster connect done check ops status `kbcli cluster list-ops redis-ljzvzz --status all --namespace ns-jcjpx ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME redis-ljzvzz-reconfiguring-qnpwb ns-jcjpx Reconfiguring redis-ljzvzz redis Succeed 2/2 Jun 19,2025 19:11 UTC+0800 check ops status done ops_status:redis-ljzvzz-reconfiguring-qnpwb ns-jcjpx Reconfiguring redis-ljzvzz redis Succeed 2/2 Jun 19,2025 19:11 UTC+0800 `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge opsrequests redis-ljzvzz-reconfiguring-qnpwb --namespace ns-jcjpx ` opsrequest.apps.kubeblocks.io/redis-ljzvzz-reconfiguring-qnpwb patched `kbcli cluster delete-ops --name redis-ljzvzz-reconfiguring-qnpwb --force --auto-approve --namespace ns-jcjpx ` OpsRequest redis-ljzvzz-reconfiguring-qnpwb deleted check config variables Unable to use a TTY - input is not a terminal or the right kind of file Warning: Using a password with '-a' or '-u' option on the command line interface may not be safe. current value_actual: 10001 configure:[maxclients] result actual:[10001] equal expected:[10001] `echo 'get mykey' | kbcli cluster connect redis-ljzvzz --namespace ns-jcjpx ` check data: Connect to instance redis-ljzvzz-redis-1: out of redis-ljzvzz-redis-1(primary), redis-ljzvzz-redis-0(secondary) Unable to use a TTY - input is not a terminal or the right kind of file Warning: Using a password with '-a' or '-u' option on the command line interface may not be safe. bxtif check cluster data consistent Success `kubectl get secrets -l app.kubernetes.io/instance=redis-ljzvzz` set secret: redis-ljzvzz-redis-account-default `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.username***"` `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.password***"` `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.port***"` DB_USERNAME_PROXY:;DB_PASSWORD_PROXY:;DB_PORT_PROXY:26379 DB_USERNAME:default;DB_PASSWORD:gu97Tl5m13;DB_PORT:6379;DB_DATABASE:db0 `echo "echo \"get mykey\" | redis-cli -h 127.0.0.1 -p 6379 -a gu97Tl5m13 " | kubectl exec -it redis-ljzvzz-redis-0 --namespace ns-jcjpx -- bash ` check readonly data: Defaulted container "redis" out of: redis, metrics, lorry, init-lorry (init) Unable to use a TTY - input is not a terminal or the right kind of file bxtif Warning: Using a password with '-a' or '-u' option on the command line interface may not be safe. check cluster readonly data consistent Success check db_client batch data count `echo 'get executions_loop_key' | kbcli cluster connect redis-ljzvzz --namespace ns-jcjpx ` check db_client batch data Success `kubectl get secrets -l app.kubernetes.io/instance=redis-ljzvzz` set secret: redis-ljzvzz-redis-account-default `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.username***"` `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.password***"` `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.port***"` DB_USERNAME_PROXY:;DB_PASSWORD_PROXY:;DB_PORT_PROXY:26379 DB_USERNAME:default;DB_PASSWORD:gu97Tl5m13;DB_PORT:6379;DB_DATABASE:db0 check readonly db_client batch data count `echo "echo \"get executions_loop_key\" | redis-cli -h 127.0.0.1 -p 6379 -a gu97Tl5m13 " | kubectl exec -it redis-ljzvzz-redis-0 --namespace ns-jcjpx -- bash ` check readonly db_client batch data Success cluster update enable-all-logs `kbcli cluster update redis-ljzvzz --enable-all-logs=true --namespace ns-jcjpx ` error: name is required check cluster status `kbcli cluster list redis-ljzvzz --show-labels --namespace ns-jcjpx ` NAME NAMESPACE CLUSTER-DEFINITION VERSION TERMINATION-POLICY STATUS CREATED-TIME LABELS redis-ljzvzz ns-jcjpx Delete Running Jun 19,2025 18:16 UTC+0800 app.kubernetes.io/instance=redis-ljzvzz check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances redis-ljzvzz --namespace ns-jcjpx ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME redis-ljzvzz-redis-0 ns-jcjpx redis-ljzvzz redis Running secondary us-west-2a 100m / 100m 512Mi / 512Mi data:2Gi ip-172-31-8-116.us-west-2.compute.internal/172.31.8.116 Jun 19,2025 19:12 UTC+0800 redis-ljzvzz-redis-1 ns-jcjpx redis-ljzvzz redis Running primary us-west-2a 100m / 100m 512Mi / 512Mi data:2Gi ip-172-31-13-32.us-west-2.compute.internal/172.31.13.32 Jun 19,2025 19:11 UTC+0800 redis-ljzvzz-redis-sentinel-0 ns-jcjpx redis-ljzvzz redis-sentinel Running us-west-2a 100m / 100m 512Mi / 512Mi data:1Gi ip-172-31-6-232.us-west-2.compute.internal/172.31.6.232 Jun 19,2025 18:47 UTC+0800 redis-ljzvzz-redis-sentinel-1 ns-jcjpx redis-ljzvzz redis-sentinel Running us-west-2a 100m / 100m 512Mi / 512Mi data:1Gi ip-172-31-1-34.us-west-2.compute.internal/172.31.1.34 Jun 19,2025 18:47 UTC+0800 redis-ljzvzz-redis-sentinel-2 ns-jcjpx redis-ljzvzz redis-sentinel Running us-west-2a 100m / 100m 512Mi / 512Mi data:1Gi ip-172-31-12-104.us-west-2.compute.internal/172.31.12.104 Jun 19,2025 18:46 UTC+0800 redis-ljzvzz-redis-twemproxy-0 ns-jcjpx redis-ljzvzz redis-twemproxy Running us-west-2a 100m / 100m 512Mi / 512Mi data:1Gi ip-172-31-10-206.us-west-2.compute.internal/172.31.10.206 Jun 19,2025 18:55 UTC+0800 redis-ljzvzz-redis-twemproxy-1 ns-jcjpx redis-ljzvzz redis-twemproxy Running us-west-2a 100m / 100m 512Mi / 512Mi data:1Gi ip-172-31-6-232.us-west-2.compute.internal/172.31.6.232 Jun 19,2025 18:48 UTC+0800 redis-ljzvzz-redis-twemproxy-2 ns-jcjpx redis-ljzvzz redis-twemproxy Running us-west-2a 100m / 100m 512Mi / 512Mi data:1Gi ip-172-31-2-181.us-west-2.compute.internal/172.31.2.181 Jun 19,2025 18:47 UTC+0800 check pod status done check cluster role check cluster role done primary: redis-ljzvzz-redis-1;secondary: redis-ljzvzz-redis-0 `kubectl get secrets -l app.kubernetes.io/instance=redis-ljzvzz` set secret: redis-ljzvzz-redis-account-default `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.username***"` `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.password***"` `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.port***"` DB_USERNAME_PROXY:;DB_PASSWORD_PROXY:;DB_PORT_PROXY:26379 DB_USERNAME:default;DB_PASSWORD:gu97Tl5m13;DB_PORT:6379;DB_DATABASE:db0 check cluster connect `echo 'echo "" | redis-cli -h redis-ljzvzz-redis-redis.ns-jcjpx.svc.cluster.local -p 6379 -a gu97Tl5m13' | kubectl exec -it redis-ljzvzz-redis-1 --namespace ns-jcjpx -- bash` check cluster connect done cluster stop check cluster status before ops check cluster status done cluster_status:Running `kbcli cluster stop redis-ljzvzz --auto-approve --force=true --namespace ns-jcjpx ` OpsRequest redis-ljzvzz-stop-l6dvf created successfully, you can view the progress: kbcli cluster describe-ops redis-ljzvzz-stop-l6dvf -n ns-jcjpx check ops status `kbcli cluster list-ops redis-ljzvzz --status all --namespace ns-jcjpx ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME redis-ljzvzz-stop-l6dvf ns-jcjpx Stop redis-ljzvzz redis,redis-sentinel,redis-twemproxy Running 0/8 Jun 19,2025 19:13 UTC+0800 check cluster status `kbcli cluster list redis-ljzvzz --show-labels --namespace ns-jcjpx ` NAME NAMESPACE CLUSTER-DEFINITION VERSION TERMINATION-POLICY STATUS CREATED-TIME LABELS redis-ljzvzz ns-jcjpx Delete Stopping Jun 19,2025 18:16 UTC+0800 app.kubernetes.io/instance=redis-ljzvzz cluster_status:Stopping cluster_status:Stopping cluster_status:Stopping cluster_status:Stopping cluster_status:Stopping cluster_status:Stopping cluster_status:Stopping cluster_status:Stopping cluster_status:Stopping cluster_status:Stopping cluster_status:Stopping cluster_status:Stopping cluster_status:Stopping cluster_status:Stopping cluster_status:Stopping check cluster status done cluster_status:Stopped check pod status `kbcli cluster list-instances redis-ljzvzz --namespace ns-jcjpx ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME check pod status done check ops status `kbcli cluster list-ops redis-ljzvzz --status all --namespace ns-jcjpx ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME redis-ljzvzz-stop-l6dvf ns-jcjpx Stop redis-ljzvzz redis,redis-sentinel,redis-twemproxy Succeed 8/8 Jun 19,2025 19:13 UTC+0800 check ops status done ops_status:redis-ljzvzz-stop-l6dvf ns-jcjpx Stop redis-ljzvzz redis,redis-sentinel,redis-twemproxy Succeed 8/8 Jun 19,2025 19:13 UTC+0800 `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge opsrequests redis-ljzvzz-stop-l6dvf --namespace ns-jcjpx ` opsrequest.apps.kubeblocks.io/redis-ljzvzz-stop-l6dvf patched `kbcli cluster delete-ops --name redis-ljzvzz-stop-l6dvf --force --auto-approve --namespace ns-jcjpx ` OpsRequest redis-ljzvzz-stop-l6dvf deleted cluster start check cluster status before ops check cluster status done cluster_status:Stopped `kbcli cluster start redis-ljzvzz --force=true --namespace ns-jcjpx ` OpsRequest redis-ljzvzz-start-hjcjb created successfully, you can view the progress: kbcli cluster describe-ops redis-ljzvzz-start-hjcjb -n ns-jcjpx check ops status `kbcli cluster list-ops redis-ljzvzz --status all --namespace ns-jcjpx ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME redis-ljzvzz-start-hjcjb ns-jcjpx Start redis-ljzvzz redis,redis-sentinel,redis-twemproxy Running 0/8 Jun 19,2025 19:15 UTC+0800 check cluster status `kbcli cluster list redis-ljzvzz --show-labels --namespace ns-jcjpx ` NAME NAMESPACE CLUSTER-DEFINITION VERSION TERMINATION-POLICY STATUS CREATED-TIME LABELS redis-ljzvzz ns-jcjpx Delete Updating Jun 19,2025 18:16 UTC+0800 app.kubernetes.io/instance=redis-ljzvzz cluster_status:Updating cluster_status:Updating cluster_status:Updating check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances redis-ljzvzz --namespace ns-jcjpx ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME redis-ljzvzz-redis-0 ns-jcjpx redis-ljzvzz redis Running secondary us-west-2a 100m / 100m 512Mi / 512Mi data:2Gi ip-172-31-12-104.us-west-2.compute.internal/172.31.12.104 Jun 19,2025 19:15 UTC+0800 redis-ljzvzz-redis-1 ns-jcjpx redis-ljzvzz redis Running primary us-west-2a 100m / 100m 512Mi / 512Mi data:2Gi ip-172-31-8-116.us-west-2.compute.internal/172.31.8.116 Jun 19,2025 19:15 UTC+0800 redis-ljzvzz-redis-sentinel-0 ns-jcjpx redis-ljzvzz redis-sentinel Running us-west-2a 100m / 100m 512Mi / 512Mi data:1Gi ip-172-31-8-116.us-west-2.compute.internal/172.31.8.116 Jun 19,2025 19:15 UTC+0800 redis-ljzvzz-redis-sentinel-1 ns-jcjpx redis-ljzvzz redis-sentinel Running us-west-2a 100m / 100m 512Mi / 512Mi data:1Gi ip-172-31-12-104.us-west-2.compute.internal/172.31.12.104 Jun 19,2025 19:15 UTC+0800 redis-ljzvzz-redis-sentinel-2 ns-jcjpx redis-ljzvzz redis-sentinel Running us-west-2a 100m / 100m 512Mi / 512Mi data:1Gi ip-172-31-6-155.us-west-2.compute.internal/172.31.6.155 Jun 19,2025 19:15 UTC+0800 redis-ljzvzz-redis-twemproxy-0 ns-jcjpx redis-ljzvzz redis-twemproxy Running us-west-2a 100m / 100m 512Mi / 512Mi data:1Gi ip-172-31-2-181.us-west-2.compute.internal/172.31.2.181 Jun 19,2025 19:15 UTC+0800 redis-ljzvzz-redis-twemproxy-1 ns-jcjpx redis-ljzvzz redis-twemproxy Running us-west-2a 100m / 100m 512Mi / 512Mi data:1Gi ip-172-31-6-5.us-west-2.compute.internal/172.31.6.5 Jun 19,2025 19:15 UTC+0800 redis-ljzvzz-redis-twemproxy-2 ns-jcjpx redis-ljzvzz redis-twemproxy Running us-west-2a 100m / 100m 512Mi / 512Mi data:1Gi ip-172-31-8-95.us-west-2.compute.internal/172.31.8.95 Jun 19,2025 19:15 UTC+0800 check pod status done check cluster role check cluster role done primary: redis-ljzvzz-redis-1;secondary: redis-ljzvzz-redis-0 `kubectl get secrets -l app.kubernetes.io/instance=redis-ljzvzz` set secret: redis-ljzvzz-redis-account-default `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.username***"` `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.password***"` `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.port***"` DB_USERNAME_PROXY:;DB_PASSWORD_PROXY:;DB_PORT_PROXY:26379 DB_USERNAME:default;DB_PASSWORD:gu97Tl5m13;DB_PORT:6379;DB_DATABASE:db0 check cluster connect `echo 'echo "" | redis-cli -h redis-ljzvzz-redis-redis.ns-jcjpx.svc.cluster.local -p 6379 -a gu97Tl5m13' | kubectl exec -it redis-ljzvzz-redis-0 --namespace ns-jcjpx -- bash` check cluster connect done check ops status `kbcli cluster list-ops redis-ljzvzz --status all --namespace ns-jcjpx ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME redis-ljzvzz-start-hjcjb ns-jcjpx Start redis-ljzvzz redis,redis-sentinel,redis-twemproxy Succeed 8/8 Jun 19,2025 19:15 UTC+0800 check ops status done ops_status:redis-ljzvzz-start-hjcjb ns-jcjpx Start redis-ljzvzz redis,redis-sentinel,redis-twemproxy Succeed 8/8 Jun 19,2025 19:15 UTC+0800 `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge opsrequests redis-ljzvzz-start-hjcjb --namespace ns-jcjpx ` opsrequest.apps.kubeblocks.io/redis-ljzvzz-start-hjcjb patched `kbcli cluster delete-ops --name redis-ljzvzz-start-hjcjb --force --auto-approve --namespace ns-jcjpx ` OpsRequest redis-ljzvzz-start-hjcjb deleted `echo 'get mykey' | kbcli cluster connect redis-ljzvzz --namespace ns-jcjpx ` check data: Connect to instance redis-ljzvzz-redis-0: out of redis-ljzvzz-redis-0(primary), redis-ljzvzz-redis-1(secondary) Unable to use a TTY - input is not a terminal or the right kind of file Warning: Using a password with '-a' or '-u' option on the command line interface may not be safe. bxtif check cluster data consistent Success `kubectl get secrets -l app.kubernetes.io/instance=redis-ljzvzz` set secret: redis-ljzvzz-redis-account-default `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.username***"` `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.password***"` `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.port***"` DB_USERNAME_PROXY:;DB_PASSWORD_PROXY:;DB_PORT_PROXY:26379 DB_USERNAME:default;DB_PASSWORD:gu97Tl5m13;DB_PORT:6379;DB_DATABASE:db0 `echo "echo \"get mykey\" | redis-cli -h 127.0.0.1 -p 6379 -a gu97Tl5m13 " | kubectl exec -it redis-ljzvzz-redis-1 --namespace ns-jcjpx -- bash ` check readonly data: Defaulted container "redis" out of: redis, metrics, lorry, init-lorry (init) Unable to use a TTY - input is not a terminal or the right kind of file Warning: Using a password with '-a' or '-u' option on the command line interface may not be safe. bxtif check cluster readonly data consistent Success check db_client batch data count `echo 'get executions_loop_key' | kbcli cluster connect redis-ljzvzz --namespace ns-jcjpx ` check db_client batch data Success `kubectl get secrets -l app.kubernetes.io/instance=redis-ljzvzz` set secret: redis-ljzvzz-redis-account-default `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.username***"` `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.password***"` `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.port***"` DB_USERNAME_PROXY:;DB_PASSWORD_PROXY:;DB_PORT_PROXY:26379 DB_USERNAME:default;DB_PASSWORD:gu97Tl5m13;DB_PORT:6379;DB_DATABASE:db0 check readonly db_client batch data count `echo "echo \"get executions_loop_key\" | redis-cli -h 127.0.0.1 -p 6379 -a gu97Tl5m13 " | kubectl exec -it redis-ljzvzz-redis-1 --namespace ns-jcjpx -- bash ` check readonly db_client batch data Success test failover networkdelay check node drain check node drain success `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge NetworkChaos test-chaos-mesh-networkdelay-redis-ljzvzz --namespace ns-jcjpx ` Warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely. Error from server (NotFound): networkchaos.chaos-mesh.org "test-chaos-mesh-networkdelay-redis-ljzvzz" not found Error from server (NotFound): networkchaos.chaos-mesh.org "test-chaos-mesh-networkdelay-redis-ljzvzz" not found apiVersion: chaos-mesh.org/v1alpha1 kind: NetworkChaos metadata: name: test-chaos-mesh-networkdelay-redis-ljzvzz namespace: ns-jcjpx spec: selector: namespaces: - ns-jcjpx labelSelectors: apps.kubeblocks.io/pod-name: redis-ljzvzz-redis-0 mode: all action: delay delay: latency: 2000ms correlation: '100' jitter: 0ms direction: to duration: 2m `kubectl apply -f test-chaos-mesh-networkdelay-redis-ljzvzz.yaml` networkchaos.chaos-mesh.org/test-chaos-mesh-networkdelay-redis-ljzvzz created apply test-chaos-mesh-networkdelay-redis-ljzvzz.yaml Success `rm -rf test-chaos-mesh-networkdelay-redis-ljzvzz.yaml` networkdelay chaos test waiting 120 seconds check cluster status `kbcli cluster list redis-ljzvzz --show-labels --namespace ns-jcjpx ` NAME NAMESPACE CLUSTER-DEFINITION VERSION TERMINATION-POLICY STATUS CREATED-TIME LABELS redis-ljzvzz ns-jcjpx Delete Running Jun 19,2025 18:16 UTC+0800 app.kubernetes.io/instance=redis-ljzvzz check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances redis-ljzvzz --namespace ns-jcjpx ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME redis-ljzvzz-redis-0 ns-jcjpx redis-ljzvzz redis Running secondary us-west-2a 100m / 100m 512Mi / 512Mi data:2Gi ip-172-31-12-104.us-west-2.compute.internal/172.31.12.104 Jun 19,2025 19:15 UTC+0800 redis-ljzvzz-redis-1 ns-jcjpx redis-ljzvzz redis Running primary us-west-2a 100m / 100m 512Mi / 512Mi data:2Gi ip-172-31-8-116.us-west-2.compute.internal/172.31.8.116 Jun 19,2025 19:15 UTC+0800 redis-ljzvzz-redis-sentinel-0 ns-jcjpx redis-ljzvzz redis-sentinel Running us-west-2a 100m / 100m 512Mi / 512Mi data:1Gi ip-172-31-8-116.us-west-2.compute.internal/172.31.8.116 Jun 19,2025 19:15 UTC+0800 redis-ljzvzz-redis-sentinel-1 ns-jcjpx redis-ljzvzz redis-sentinel Running us-west-2a 100m / 100m 512Mi / 512Mi data:1Gi ip-172-31-12-104.us-west-2.compute.internal/172.31.12.104 Jun 19,2025 19:15 UTC+0800 redis-ljzvzz-redis-sentinel-2 ns-jcjpx redis-ljzvzz redis-sentinel Running us-west-2a 100m / 100m 512Mi / 512Mi data:1Gi ip-172-31-6-155.us-west-2.compute.internal/172.31.6.155 Jun 19,2025 19:15 UTC+0800 redis-ljzvzz-redis-twemproxy-0 ns-jcjpx redis-ljzvzz redis-twemproxy Running us-west-2a 100m / 100m 512Mi / 512Mi data:1Gi ip-172-31-2-181.us-west-2.compute.internal/172.31.2.181 Jun 19,2025 19:15 UTC+0800 redis-ljzvzz-redis-twemproxy-1 ns-jcjpx redis-ljzvzz redis-twemproxy Running us-west-2a 100m / 100m 512Mi / 512Mi data:1Gi ip-172-31-6-5.us-west-2.compute.internal/172.31.6.5 Jun 19,2025 19:15 UTC+0800 redis-ljzvzz-redis-twemproxy-2 ns-jcjpx redis-ljzvzz redis-twemproxy Running us-west-2a 100m / 100m 512Mi / 512Mi data:1Gi ip-172-31-8-95.us-west-2.compute.internal/172.31.8.95 Jun 19,2025 19:15 UTC+0800 check pod status done check cluster role check cluster role done primary: redis-ljzvzz-redis-1;secondary: redis-ljzvzz-redis-0 `kubectl get secrets -l app.kubernetes.io/instance=redis-ljzvzz` set secret: redis-ljzvzz-redis-account-default `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.username***"` `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.password***"` `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.port***"` DB_USERNAME_PROXY:;DB_PASSWORD_PROXY:;DB_PORT_PROXY:26379 DB_USERNAME:default;DB_PASSWORD:gu97Tl5m13;DB_PORT:6379;DB_DATABASE:db0 check cluster connect `echo 'echo "" | redis-cli -h redis-ljzvzz-redis-redis.ns-jcjpx.svc.cluster.local -p 6379 -a gu97Tl5m13' | kubectl exec -it redis-ljzvzz-redis-1 --namespace ns-jcjpx -- bash` check cluster connect done `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge NetworkChaos test-chaos-mesh-networkdelay-redis-ljzvzz --namespace ns-jcjpx ` Warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely. networkchaos.chaos-mesh.org "test-chaos-mesh-networkdelay-redis-ljzvzz" force deleted Error from server (NotFound): networkchaos.chaos-mesh.org "test-chaos-mesh-networkdelay-redis-ljzvzz" not found check failover pod name failover pod name:redis-ljzvzz-redis-1 failover networkdelay Failure test failover networkduplicate check node drain check node drain success `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge NetworkChaos test-chaos-mesh-networkduplicate-redis-ljzvzz --namespace ns-jcjpx ` Warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely. Error from server (NotFound): networkchaos.chaos-mesh.org "test-chaos-mesh-networkduplicate-redis-ljzvzz" not found Error from server (NotFound): networkchaos.chaos-mesh.org "test-chaos-mesh-networkduplicate-redis-ljzvzz" not found apiVersion: chaos-mesh.org/v1alpha1 kind: NetworkChaos metadata: name: test-chaos-mesh-networkduplicate-redis-ljzvzz namespace: ns-jcjpx spec: selector: namespaces: - ns-jcjpx labelSelectors: apps.kubeblocks.io/pod-name: redis-ljzvzz-redis-1 mode: all action: duplicate duplicate: duplicate: '100' correlation: '100' direction: to duration: 2m `kubectl apply -f test-chaos-mesh-networkduplicate-redis-ljzvzz.yaml` networkchaos.chaos-mesh.org/test-chaos-mesh-networkduplicate-redis-ljzvzz created apply test-chaos-mesh-networkduplicate-redis-ljzvzz.yaml Success `rm -rf test-chaos-mesh-networkduplicate-redis-ljzvzz.yaml` networkduplicate chaos test waiting 120 seconds check cluster status `kbcli cluster list redis-ljzvzz --show-labels --namespace ns-jcjpx ` NAME NAMESPACE CLUSTER-DEFINITION VERSION TERMINATION-POLICY STATUS CREATED-TIME LABELS redis-ljzvzz ns-jcjpx Delete Running Jun 19,2025 18:16 UTC+0800 app.kubernetes.io/instance=redis-ljzvzz check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances redis-ljzvzz --namespace ns-jcjpx ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME redis-ljzvzz-redis-0 ns-jcjpx redis-ljzvzz redis Running secondary us-west-2a 100m / 100m 512Mi / 512Mi data:2Gi ip-172-31-12-104.us-west-2.compute.internal/172.31.12.104 Jun 19,2025 19:15 UTC+0800 redis-ljzvzz-redis-1 ns-jcjpx redis-ljzvzz redis Running primary us-west-2a 100m / 100m 512Mi / 512Mi data:2Gi ip-172-31-8-116.us-west-2.compute.internal/172.31.8.116 Jun 19,2025 19:15 UTC+0800 redis-ljzvzz-redis-sentinel-0 ns-jcjpx redis-ljzvzz redis-sentinel Running us-west-2a 100m / 100m 512Mi / 512Mi data:1Gi ip-172-31-8-116.us-west-2.compute.internal/172.31.8.116 Jun 19,2025 19:15 UTC+0800 redis-ljzvzz-redis-sentinel-1 ns-jcjpx redis-ljzvzz redis-sentinel Running us-west-2a 100m / 100m 512Mi / 512Mi data:1Gi ip-172-31-12-104.us-west-2.compute.internal/172.31.12.104 Jun 19,2025 19:15 UTC+0800 redis-ljzvzz-redis-sentinel-2 ns-jcjpx redis-ljzvzz redis-sentinel Running us-west-2a 100m / 100m 512Mi / 512Mi data:1Gi ip-172-31-6-155.us-west-2.compute.internal/172.31.6.155 Jun 19,2025 19:15 UTC+0800 redis-ljzvzz-redis-twemproxy-0 ns-jcjpx redis-ljzvzz redis-twemproxy Running us-west-2a 100m / 100m 512Mi / 512Mi data:1Gi ip-172-31-2-181.us-west-2.compute.internal/172.31.2.181 Jun 19,2025 19:15 UTC+0800 redis-ljzvzz-redis-twemproxy-1 ns-jcjpx redis-ljzvzz redis-twemproxy Running us-west-2a 100m / 100m 512Mi / 512Mi data:1Gi ip-172-31-6-5.us-west-2.compute.internal/172.31.6.5 Jun 19,2025 19:15 UTC+0800 redis-ljzvzz-redis-twemproxy-2 ns-jcjpx redis-ljzvzz redis-twemproxy Running us-west-2a 100m / 100m 512Mi / 512Mi data:1Gi ip-172-31-8-95.us-west-2.compute.internal/172.31.8.95 Jun 19,2025 19:15 UTC+0800 check pod status done check cluster role check cluster role done primary: redis-ljzvzz-redis-1;secondary: redis-ljzvzz-redis-0 `kubectl get secrets -l app.kubernetes.io/instance=redis-ljzvzz` set secret: redis-ljzvzz-redis-account-default `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.username***"` `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.password***"` `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.port***"` DB_USERNAME_PROXY:;DB_PASSWORD_PROXY:;DB_PORT_PROXY:26379 DB_USERNAME:default;DB_PASSWORD:gu97Tl5m13;DB_PORT:6379;DB_DATABASE:db0 check cluster connect `echo 'echo "" | redis-cli -h redis-ljzvzz-redis-redis.ns-jcjpx.svc.cluster.local -p 6379 -a gu97Tl5m13' | kubectl exec -it redis-ljzvzz-redis-1 --namespace ns-jcjpx -- bash` check cluster connect done `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge NetworkChaos test-chaos-mesh-networkduplicate-redis-ljzvzz --namespace ns-jcjpx ` Warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely. networkchaos.chaos-mesh.org "test-chaos-mesh-networkduplicate-redis-ljzvzz" force deleted networkchaos.chaos-mesh.org/test-chaos-mesh-networkduplicate-redis-ljzvzz patched check failover pod name failover pod name:redis-ljzvzz-redis-1 failover networkduplicate Success `echo 'get mykey' | kbcli cluster connect redis-ljzvzz --namespace ns-jcjpx ` check data: Connect to instance redis-ljzvzz-redis-1: out of redis-ljzvzz-redis-1(primary), redis-ljzvzz-redis-0(secondary) Unable to use a TTY - input is not a terminal or the right kind of file Warning: Using a password with '-a' or '-u' option on the command line interface may not be safe. bxtif check cluster data consistent Success `kubectl get secrets -l app.kubernetes.io/instance=redis-ljzvzz` set secret: redis-ljzvzz-redis-account-default `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.username***"` `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.password***"` `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.port***"` DB_USERNAME_PROXY:;DB_PASSWORD_PROXY:;DB_PORT_PROXY:26379 DB_USERNAME:default;DB_PASSWORD:gu97Tl5m13;DB_PORT:6379;DB_DATABASE:db0 `echo "echo \"get mykey\" | redis-cli -h 127.0.0.1 -p 6379 -a gu97Tl5m13 " | kubectl exec -it redis-ljzvzz-redis-0 --namespace ns-jcjpx -- bash ` check readonly data: Defaulted container "redis" out of: redis, metrics, lorry, init-lorry (init) Unable to use a TTY - input is not a terminal or the right kind of file Warning: Using a password with '-a' or '-u' option on the command line interface may not be safe. bxtif check cluster readonly data consistent Success check db_client batch data count `echo 'get executions_loop_key' | kbcli cluster connect redis-ljzvzz --namespace ns-jcjpx ` check db_client batch data Success `kubectl get secrets -l app.kubernetes.io/instance=redis-ljzvzz` set secret: redis-ljzvzz-redis-account-default `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.username***"` `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.password***"` `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.port***"` DB_USERNAME_PROXY:;DB_PASSWORD_PROXY:;DB_PORT_PROXY:26379 DB_USERNAME:default;DB_PASSWORD:gu97Tl5m13;DB_PORT:6379;DB_DATABASE:db0 check readonly db_client batch data count `echo "echo \"get executions_loop_key\" | redis-cli -h 127.0.0.1 -p 6379 -a gu97Tl5m13 " | kubectl exec -it redis-ljzvzz-redis-0 --namespace ns-jcjpx -- bash ` check readonly db_client batch data Success 9 test failover dnsrandom check node drain check node drain success `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge DNSChaos test-chaos-mesh-dnsrandom-redis-ljzvzz --namespace ns-jcjpx ` Warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely. Error from server (NotFound): dnschaos.chaos-mesh.org "test-chaos-mesh-dnsrandom-redis-ljzvzz" not found Error from server (NotFound): dnschaos.chaos-mesh.org "test-chaos-mesh-dnsrandom-redis-ljzvzz" not found apiVersion: chaos-mesh.org/v1alpha1 kind: DNSChaos metadata: name: test-chaos-mesh-dnsrandom-redis-ljzvzz namespace: ns-jcjpx spec: selector: namespaces: - ns-jcjpx labelSelectors: apps.kubeblocks.io/pod-name: redis-ljzvzz-redis-1 mode: all action: random duration: 2m `kubectl apply -f test-chaos-mesh-dnsrandom-redis-ljzvzz.yaml` dnschaos.chaos-mesh.org/test-chaos-mesh-dnsrandom-redis-ljzvzz created apply test-chaos-mesh-dnsrandom-redis-ljzvzz.yaml Success `rm -rf test-chaos-mesh-dnsrandom-redis-ljzvzz.yaml` dnsrandom chaos test waiting 120 seconds check cluster status `kbcli cluster list redis-ljzvzz --show-labels --namespace ns-jcjpx ` NAME NAMESPACE CLUSTER-DEFINITION VERSION TERMINATION-POLICY STATUS CREATED-TIME LABELS redis-ljzvzz ns-jcjpx Delete Running Jun 19,2025 18:16 UTC+0800 app.kubernetes.io/instance=redis-ljzvzz check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances redis-ljzvzz --namespace ns-jcjpx ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME redis-ljzvzz-redis-0 ns-jcjpx redis-ljzvzz redis Running secondary us-west-2a 100m / 100m 512Mi / 512Mi data:2Gi ip-172-31-12-104.us-west-2.compute.internal/172.31.12.104 Jun 19,2025 19:15 UTC+0800 redis-ljzvzz-redis-1 ns-jcjpx redis-ljzvzz redis Running primary us-west-2a 100m / 100m 512Mi / 512Mi data:2Gi ip-172-31-8-116.us-west-2.compute.internal/172.31.8.116 Jun 19,2025 19:15 UTC+0800 redis-ljzvzz-redis-sentinel-0 ns-jcjpx redis-ljzvzz redis-sentinel Running us-west-2a 100m / 100m 512Mi / 512Mi data:1Gi ip-172-31-8-116.us-west-2.compute.internal/172.31.8.116 Jun 19,2025 19:15 UTC+0800 redis-ljzvzz-redis-sentinel-1 ns-jcjpx redis-ljzvzz redis-sentinel Running us-west-2a 100m / 100m 512Mi / 512Mi data:1Gi ip-172-31-12-104.us-west-2.compute.internal/172.31.12.104 Jun 19,2025 19:15 UTC+0800 redis-ljzvzz-redis-sentinel-2 ns-jcjpx redis-ljzvzz redis-sentinel Running us-west-2a 100m / 100m 512Mi / 512Mi data:1Gi ip-172-31-6-155.us-west-2.compute.internal/172.31.6.155 Jun 19,2025 19:15 UTC+0800 redis-ljzvzz-redis-twemproxy-0 ns-jcjpx redis-ljzvzz redis-twemproxy Running us-west-2a 100m / 100m 512Mi / 512Mi data:1Gi ip-172-31-2-181.us-west-2.compute.internal/172.31.2.181 Jun 19,2025 19:15 UTC+0800 redis-ljzvzz-redis-twemproxy-1 ns-jcjpx redis-ljzvzz redis-twemproxy Running us-west-2a 100m / 100m 512Mi / 512Mi data:1Gi ip-172-31-6-5.us-west-2.compute.internal/172.31.6.5 Jun 19,2025 19:15 UTC+0800 redis-ljzvzz-redis-twemproxy-2 ns-jcjpx redis-ljzvzz redis-twemproxy Running us-west-2a 100m / 100m 512Mi / 512Mi data:1Gi ip-172-31-8-95.us-west-2.compute.internal/172.31.8.95 Jun 19,2025 19:15 UTC+0800 check pod status done check cluster role check cluster role done primary: redis-ljzvzz-redis-1;secondary: redis-ljzvzz-redis-0 `kubectl get secrets -l app.kubernetes.io/instance=redis-ljzvzz` set secret: redis-ljzvzz-redis-account-default `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.username***"` `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.password***"` `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.port***"` DB_USERNAME_PROXY:;DB_PASSWORD_PROXY:;DB_PORT_PROXY:26379 DB_USERNAME:default;DB_PASSWORD:gu97Tl5m13;DB_PORT:6379;DB_DATABASE:db0 check cluster connect `echo 'echo "" | redis-cli -h redis-ljzvzz-redis-redis.ns-jcjpx.svc.cluster.local -p 6379 -a gu97Tl5m13' | kubectl exec -it redis-ljzvzz-redis-1 --namespace ns-jcjpx -- bash` check cluster connect done `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge DNSChaos test-chaos-mesh-dnsrandom-redis-ljzvzz --namespace ns-jcjpx ` Warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely. dnschaos.chaos-mesh.org "test-chaos-mesh-dnsrandom-redis-ljzvzz" force deleted Error from server (NotFound): dnschaos.chaos-mesh.org "test-chaos-mesh-dnsrandom-redis-ljzvzz" not found check failover pod name failover pod name:redis-ljzvzz-redis-1 failover dnsrandom Success `echo 'get mykey' | kbcli cluster connect redis-ljzvzz --namespace ns-jcjpx ` check data: Connect to instance redis-ljzvzz-redis-1: out of redis-ljzvzz-redis-1(primary), redis-ljzvzz-redis-0(secondary) Unable to use a TTY - input is not a terminal or the right kind of file Warning: Using a password with '-a' or '-u' option on the command line interface may not be safe. bxtif check cluster data consistent Success `kubectl get secrets -l app.kubernetes.io/instance=redis-ljzvzz` set secret: redis-ljzvzz-redis-account-default `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.username***"` `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.password***"` `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.port***"` DB_USERNAME_PROXY:;DB_PASSWORD_PROXY:;DB_PORT_PROXY:26379 DB_USERNAME:default;DB_PASSWORD:gu97Tl5m13;DB_PORT:6379;DB_DATABASE:db0 `echo "echo \"get mykey\" | redis-cli -h 127.0.0.1 -p 6379 -a gu97Tl5m13 " | kubectl exec -it redis-ljzvzz-redis-0 --namespace ns-jcjpx -- bash ` check readonly data: Defaulted container "redis" out of: redis, metrics, lorry, init-lorry (init) Unable to use a TTY - input is not a terminal or the right kind of file Warning: Using a password with '-a' or '-u' option on the command line interface may not be safe. bxtif check cluster readonly data consistent Success check db_client batch data count `echo 'get executions_loop_key' | kbcli cluster connect redis-ljzvzz --namespace ns-jcjpx ` check db_client batch data Success `kubectl get secrets -l app.kubernetes.io/instance=redis-ljzvzz` set secret: redis-ljzvzz-redis-account-default `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.username***"` `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.password***"` `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.port***"` DB_USERNAME_PROXY:;DB_PASSWORD_PROXY:;DB_PORT_PROXY:26379 DB_USERNAME:default;DB_PASSWORD:gu97Tl5m13;DB_PORT:6379;DB_DATABASE:db0 check readonly db_client batch data count `echo "echo \"get executions_loop_key\" | redis-cli -h 127.0.0.1 -p 6379 -a gu97Tl5m13 " | kubectl exec -it redis-ljzvzz-redis-0 --namespace ns-jcjpx -- bash ` check readonly db_client batch data Success test failover kill1 check node drain check node drain success `kill 1` Defaulted container "redis" out of: redis, metrics, lorry, init-lorry (init) Unable to use a TTY - input is not a terminal or the right kind of file exec return message: check cluster status `kbcli cluster list redis-ljzvzz --show-labels --namespace ns-jcjpx ` NAME NAMESPACE CLUSTER-DEFINITION VERSION TERMINATION-POLICY STATUS CREATED-TIME LABELS redis-ljzvzz ns-jcjpx Delete Updating Jun 19,2025 18:16 UTC+0800 app.kubernetes.io/instance=redis-ljzvzz cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Abnormal cluster_status:Abnormal cluster_status:Abnormal cluster_status:Abnormal cluster_status:Abnormal cluster_status:Abnormal cluster_status:Abnormal cluster_status:Abnormal cluster_status:Abnormal cluster_status:Abnormal cluster_status:Abnormal cluster_status:Abnormal cluster_status:Abnormal cluster_status:Abnormal cluster_status:Abnormal cluster_status:Abnormal cluster_status:Abnormal cluster_status:Abnormal cluster_status:Abnormal cluster_status:Abnormal cluster_status:Abnormal cluster_status:Abnormal Warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely. pod "redis-ljzvzz-redis-1" force deleted cluster_status:Updating cluster_status:Updating check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances redis-ljzvzz --namespace ns-jcjpx ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME redis-ljzvzz-redis-0 ns-jcjpx redis-ljzvzz redis Running primary us-west-2a 100m / 100m 512Mi / 512Mi data:2Gi ip-172-31-12-104.us-west-2.compute.internal/172.31.12.104 Jun 19,2025 19:15 UTC+0800 redis-ljzvzz-redis-1 ns-jcjpx redis-ljzvzz redis Running secondary us-west-2a 100m / 100m 512Mi / 512Mi data:2Gi ip-172-31-8-116.us-west-2.compute.internal/172.31.8.116 Jun 19,2025 19:26 UTC+0800 redis-ljzvzz-redis-sentinel-0 ns-jcjpx redis-ljzvzz redis-sentinel Running us-west-2a 100m / 100m 512Mi / 512Mi data:1Gi ip-172-31-8-116.us-west-2.compute.internal/172.31.8.116 Jun 19,2025 19:15 UTC+0800 redis-ljzvzz-redis-sentinel-1 ns-jcjpx redis-ljzvzz redis-sentinel Running us-west-2a 100m / 100m 512Mi / 512Mi data:1Gi ip-172-31-12-104.us-west-2.compute.internal/172.31.12.104 Jun 19,2025 19:15 UTC+0800 redis-ljzvzz-redis-sentinel-2 ns-jcjpx redis-ljzvzz redis-sentinel Running us-west-2a 100m / 100m 512Mi / 512Mi data:1Gi ip-172-31-6-155.us-west-2.compute.internal/172.31.6.155 Jun 19,2025 19:15 UTC+0800 redis-ljzvzz-redis-twemproxy-0 ns-jcjpx redis-ljzvzz redis-twemproxy Running us-west-2a 100m / 100m 512Mi / 512Mi data:1Gi ip-172-31-2-181.us-west-2.compute.internal/172.31.2.181 Jun 19,2025 19:15 UTC+0800 redis-ljzvzz-redis-twemproxy-1 ns-jcjpx redis-ljzvzz redis-twemproxy Running us-west-2a 100m / 100m 512Mi / 512Mi data:1Gi ip-172-31-6-5.us-west-2.compute.internal/172.31.6.5 Jun 19,2025 19:15 UTC+0800 redis-ljzvzz-redis-twemproxy-2 ns-jcjpx redis-ljzvzz redis-twemproxy Running us-west-2a 100m / 100m 512Mi / 512Mi data:1Gi ip-172-31-8-95.us-west-2.compute.internal/172.31.8.95 Jun 19,2025 19:15 UTC+0800 check pod status done check cluster role check cluster role done primary: redis-ljzvzz-redis-0;secondary: redis-ljzvzz-redis-1 `kubectl get secrets -l app.kubernetes.io/instance=redis-ljzvzz` set secret: redis-ljzvzz-redis-account-default `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.username***"` `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.password***"` `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.port***"` DB_USERNAME_PROXY:;DB_PASSWORD_PROXY:;DB_PORT_PROXY:26379 DB_USERNAME:default;DB_PASSWORD:gu97Tl5m13;DB_PORT:6379;DB_DATABASE:db0 check cluster connect `echo 'echo "" | redis-cli -h redis-ljzvzz-redis-redis.ns-jcjpx.svc.cluster.local -p 6379 -a gu97Tl5m13' | kubectl exec -it redis-ljzvzz-redis-0 --namespace ns-jcjpx -- bash` check cluster connect done check failover pod name failover pod name:redis-ljzvzz-redis-0 failover kill1 Success `echo 'get mykey' | kbcli cluster connect redis-ljzvzz --namespace ns-jcjpx ` check data: Connect to instance redis-ljzvzz-redis-0: out of redis-ljzvzz-redis-0(primary), redis-ljzvzz-redis-1(secondary) Unable to use a TTY - input is not a terminal or the right kind of file Warning: Using a password with '-a' or '-u' option on the command line interface may not be safe. bxtif check cluster data consistent Success `kubectl get secrets -l app.kubernetes.io/instance=redis-ljzvzz` set secret: redis-ljzvzz-redis-account-default `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.username***"` `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.password***"` `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.port***"` DB_USERNAME_PROXY:;DB_PASSWORD_PROXY:;DB_PORT_PROXY:26379 DB_USERNAME:default;DB_PASSWORD:gu97Tl5m13;DB_PORT:6379;DB_DATABASE:db0 `echo "echo \"get mykey\" | redis-cli -h 127.0.0.1 -p 6379 -a gu97Tl5m13 " | kubectl exec -it redis-ljzvzz-redis-1 --namespace ns-jcjpx -- bash ` check readonly data: Defaulted container "redis" out of: redis, metrics, lorry, init-lorry (init) Unable to use a TTY - input is not a terminal or the right kind of file Warning: Using a password with '-a' or '-u' option on the command line interface may not be safe. bxtif check cluster readonly data consistent Success check db_client batch data count `echo 'get executions_loop_key' | kbcli cluster connect redis-ljzvzz --namespace ns-jcjpx ` check db_client batch data Success `kubectl get secrets -l app.kubernetes.io/instance=redis-ljzvzz` set secret: redis-ljzvzz-redis-account-default `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.username***"` `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.password***"` `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.port***"` DB_USERNAME_PROXY:;DB_PASSWORD_PROXY:;DB_PORT_PROXY:26379 DB_USERNAME:default;DB_PASSWORD:gu97Tl5m13;DB_PORT:6379;DB_DATABASE:db0 check readonly db_client batch data count `echo "echo \"get executions_loop_key\" | redis-cli -h 127.0.0.1 -p 6379 -a gu97Tl5m13 " | kubectl exec -it redis-ljzvzz-redis-1 --namespace ns-jcjpx -- bash ` check readonly db_client batch data Success test failover networkpartition check node drain check node drain success `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge NetworkChaos test-chaos-mesh-networkpartition-redis-ljzvzz --namespace ns-jcjpx ` Warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely. Error from server (NotFound): networkchaos.chaos-mesh.org "test-chaos-mesh-networkpartition-redis-ljzvzz" not found Error from server (NotFound): networkchaos.chaos-mesh.org "test-chaos-mesh-networkpartition-redis-ljzvzz" not found apiVersion: chaos-mesh.org/v1alpha1 kind: NetworkChaos metadata: name: test-chaos-mesh-networkpartition-redis-ljzvzz namespace: ns-jcjpx spec: selector: namespaces: - ns-jcjpx labelSelectors: apps.kubeblocks.io/pod-name: redis-ljzvzz-redis-0 action: partition mode: all target: mode: all selector: namespaces: - ns-jcjpx labelSelectors: apps.kubeblocks.io/pod-name: redis-ljzvzz-redis-1 direction: to duration: 2m `kubectl apply -f test-chaos-mesh-networkpartition-redis-ljzvzz.yaml` networkchaos.chaos-mesh.org/test-chaos-mesh-networkpartition-redis-ljzvzz created apply test-chaos-mesh-networkpartition-redis-ljzvzz.yaml Success `rm -rf test-chaos-mesh-networkpartition-redis-ljzvzz.yaml` networkpartition chaos test waiting 120 seconds check cluster status `kbcli cluster list redis-ljzvzz --show-labels --namespace ns-jcjpx ` NAME NAMESPACE CLUSTER-DEFINITION VERSION TERMINATION-POLICY STATUS CREATED-TIME LABELS redis-ljzvzz ns-jcjpx Delete Running Jun 19,2025 18:16 UTC+0800 app.kubernetes.io/instance=redis-ljzvzz check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances redis-ljzvzz --namespace ns-jcjpx ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME redis-ljzvzz-redis-0 ns-jcjpx redis-ljzvzz redis Running primary us-west-2a 100m / 100m 512Mi / 512Mi data:2Gi ip-172-31-12-104.us-west-2.compute.internal/172.31.12.104 Jun 19,2025 19:15 UTC+0800 redis-ljzvzz-redis-1 ns-jcjpx redis-ljzvzz redis Running secondary us-west-2a 100m / 100m 512Mi / 512Mi data:2Gi ip-172-31-8-116.us-west-2.compute.internal/172.31.8.116 Jun 19,2025 19:26 UTC+0800 redis-ljzvzz-redis-sentinel-0 ns-jcjpx redis-ljzvzz redis-sentinel Running us-west-2a 100m / 100m 512Mi / 512Mi data:1Gi ip-172-31-8-116.us-west-2.compute.internal/172.31.8.116 Jun 19,2025 19:15 UTC+0800 redis-ljzvzz-redis-sentinel-1 ns-jcjpx redis-ljzvzz redis-sentinel Running us-west-2a 100m / 100m 512Mi / 512Mi data:1Gi ip-172-31-12-104.us-west-2.compute.internal/172.31.12.104 Jun 19,2025 19:15 UTC+0800 redis-ljzvzz-redis-sentinel-2 ns-jcjpx redis-ljzvzz redis-sentinel Running us-west-2a 100m / 100m 512Mi / 512Mi data:1Gi ip-172-31-6-155.us-west-2.compute.internal/172.31.6.155 Jun 19,2025 19:15 UTC+0800 redis-ljzvzz-redis-twemproxy-0 ns-jcjpx redis-ljzvzz redis-twemproxy Running us-west-2a 100m / 100m 512Mi / 512Mi data:1Gi ip-172-31-2-181.us-west-2.compute.internal/172.31.2.181 Jun 19,2025 19:15 UTC+0800 redis-ljzvzz-redis-twemproxy-1 ns-jcjpx redis-ljzvzz redis-twemproxy Running us-west-2a 100m / 100m 512Mi / 512Mi data:1Gi ip-172-31-6-5.us-west-2.compute.internal/172.31.6.5 Jun 19,2025 19:15 UTC+0800 redis-ljzvzz-redis-twemproxy-2 ns-jcjpx redis-ljzvzz redis-twemproxy Running us-west-2a 100m / 100m 512Mi / 512Mi data:1Gi ip-172-31-8-95.us-west-2.compute.internal/172.31.8.95 Jun 19,2025 19:15 UTC+0800 check pod status done check cluster role check cluster role done primary: redis-ljzvzz-redis-0;secondary: redis-ljzvzz-redis-1 `kubectl get secrets -l app.kubernetes.io/instance=redis-ljzvzz` set secret: redis-ljzvzz-redis-account-default `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.username***"` `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.password***"` `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.port***"` DB_USERNAME_PROXY:;DB_PASSWORD_PROXY:;DB_PORT_PROXY:26379 DB_USERNAME:default;DB_PASSWORD:gu97Tl5m13;DB_PORT:6379;DB_DATABASE:db0 check cluster connect `echo 'echo "" | redis-cli -h redis-ljzvzz-redis-redis.ns-jcjpx.svc.cluster.local -p 6379 -a gu97Tl5m13' | kubectl exec -it redis-ljzvzz-redis-0 --namespace ns-jcjpx -- bash` check cluster connect done `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge NetworkChaos test-chaos-mesh-networkpartition-redis-ljzvzz --namespace ns-jcjpx ` Warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely. networkchaos.chaos-mesh.org "test-chaos-mesh-networkpartition-redis-ljzvzz" force deleted Error from server (NotFound): networkchaos.chaos-mesh.org "test-chaos-mesh-networkpartition-redis-ljzvzz" not found check failover pod name failover pod name:redis-ljzvzz-redis-0 failover networkpartition Success `echo 'get mykey' | kbcli cluster connect redis-ljzvzz --namespace ns-jcjpx ` check data: Connect to instance redis-ljzvzz-redis-0: out of redis-ljzvzz-redis-0(primary), redis-ljzvzz-redis-1(secondary) Unable to use a TTY - input is not a terminal or the right kind of file Warning: Using a password with '-a' or '-u' option on the command line interface may not be safe. bxtif check cluster data consistent Success `kubectl get secrets -l app.kubernetes.io/instance=redis-ljzvzz` set secret: redis-ljzvzz-redis-account-default `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.username***"` `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.password***"` `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.port***"` DB_USERNAME_PROXY:;DB_PASSWORD_PROXY:;DB_PORT_PROXY:26379 DB_USERNAME:default;DB_PASSWORD:gu97Tl5m13;DB_PORT:6379;DB_DATABASE:db0 `echo "echo \"get mykey\" | redis-cli -h 127.0.0.1 -p 6379 -a gu97Tl5m13 " | kubectl exec -it redis-ljzvzz-redis-1 --namespace ns-jcjpx -- bash ` check readonly data: Defaulted container "redis" out of: redis, metrics, lorry, init-lorry (init) Unable to use a TTY - input is not a terminal or the right kind of file Warning: Using a password with '-a' or '-u' option on the command line interface may not be safe. bxtif check cluster readonly data consistent Success check db_client batch data count `echo 'get executions_loop_key' | kbcli cluster connect redis-ljzvzz --namespace ns-jcjpx ` check db_client batch data Success `kubectl get secrets -l app.kubernetes.io/instance=redis-ljzvzz` set secret: redis-ljzvzz-redis-account-default `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.username***"` `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.password***"` `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.port***"` DB_USERNAME_PROXY:;DB_PASSWORD_PROXY:;DB_PORT_PROXY:26379 DB_USERNAME:default;DB_PASSWORD:gu97Tl5m13;DB_PORT:6379;DB_DATABASE:db0 check readonly db_client batch data count `echo "echo \"get executions_loop_key\" | redis-cli -h 127.0.0.1 -p 6379 -a gu97Tl5m13 " | kubectl exec -it redis-ljzvzz-redis-1 --namespace ns-jcjpx -- bash ` check readonly db_client batch data Success cluster vscale check cluster status before ops check cluster status done cluster_status:Running `kbcli cluster vscale redis-ljzvzz --auto-approve --force=true --components redis --cpu 200m --memory 0.6Gi --namespace ns-jcjpx ` OpsRequest redis-ljzvzz-verticalscaling-ml47b created successfully, you can view the progress: kbcli cluster describe-ops redis-ljzvzz-verticalscaling-ml47b -n ns-jcjpx check ops status `kbcli cluster list-ops redis-ljzvzz --status all --namespace ns-jcjpx ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME redis-ljzvzz-verticalscaling-ml47b ns-jcjpx VerticalScaling redis-ljzvzz redis Running 0/2 Jun 19,2025 19:29 UTC+0800 check cluster status `kbcli cluster list redis-ljzvzz --show-labels --namespace ns-jcjpx ` NAME NAMESPACE CLUSTER-DEFINITION VERSION TERMINATION-POLICY STATUS CREATED-TIME LABELS redis-ljzvzz ns-jcjpx Delete Updating Jun 19,2025 18:16 UTC+0800 app.kubernetes.io/instance=redis-ljzvzz cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating cluster_status:Updating check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances redis-ljzvzz --namespace ns-jcjpx ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME redis-ljzvzz-redis-0 ns-jcjpx redis-ljzvzz redis Running secondary us-west-2a 200m / 200m 644245094400m / 644245094400m data:2Gi ip-172-31-12-104.us-west-2.compute.internal/172.31.12.104 Jun 19,2025 19:29 UTC+0800 redis-ljzvzz-redis-1 ns-jcjpx redis-ljzvzz redis Running primary us-west-2a 200m / 200m 644245094400m / 644245094400m data:2Gi ip-172-31-8-116.us-west-2.compute.internal/172.31.8.116 Jun 19,2025 19:29 UTC+0800 redis-ljzvzz-redis-sentinel-0 ns-jcjpx redis-ljzvzz redis-sentinel Running us-west-2a 100m / 100m 512Mi / 512Mi data:1Gi ip-172-31-8-116.us-west-2.compute.internal/172.31.8.116 Jun 19,2025 19:15 UTC+0800 redis-ljzvzz-redis-sentinel-1 ns-jcjpx redis-ljzvzz redis-sentinel Running us-west-2a 100m / 100m 512Mi / 512Mi data:1Gi ip-172-31-12-104.us-west-2.compute.internal/172.31.12.104 Jun 19,2025 19:15 UTC+0800 redis-ljzvzz-redis-sentinel-2 ns-jcjpx redis-ljzvzz redis-sentinel Running us-west-2a 100m / 100m 512Mi / 512Mi data:1Gi ip-172-31-6-155.us-west-2.compute.internal/172.31.6.155 Jun 19,2025 19:15 UTC+0800 redis-ljzvzz-redis-twemproxy-0 ns-jcjpx redis-ljzvzz redis-twemproxy Running us-west-2a 100m / 100m 512Mi / 512Mi data:1Gi ip-172-31-2-181.us-west-2.compute.internal/172.31.2.181 Jun 19,2025 19:15 UTC+0800 redis-ljzvzz-redis-twemproxy-1 ns-jcjpx redis-ljzvzz redis-twemproxy Running us-west-2a 100m / 100m 512Mi / 512Mi data:1Gi ip-172-31-6-5.us-west-2.compute.internal/172.31.6.5 Jun 19,2025 19:15 UTC+0800 redis-ljzvzz-redis-twemproxy-2 ns-jcjpx redis-ljzvzz redis-twemproxy Running us-west-2a 100m / 100m 512Mi / 512Mi data:1Gi ip-172-31-8-95.us-west-2.compute.internal/172.31.8.95 Jun 19,2025 19:15 UTC+0800 check pod status done check cluster role check cluster role done primary: redis-ljzvzz-redis-1;secondary: redis-ljzvzz-redis-0 `kubectl get secrets -l app.kubernetes.io/instance=redis-ljzvzz` set secret: redis-ljzvzz-redis-account-default `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.username***"` `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.password***"` `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.port***"` DB_USERNAME_PROXY:;DB_PASSWORD_PROXY:;DB_PORT_PROXY:26379 DB_USERNAME:default;DB_PASSWORD:gu97Tl5m13;DB_PORT:6379;DB_DATABASE:db0 check cluster connect `echo 'echo "" | redis-cli -h redis-ljzvzz-redis-redis.ns-jcjpx.svc.cluster.local -p 6379 -a gu97Tl5m13' | kubectl exec -it redis-ljzvzz-redis-1 --namespace ns-jcjpx -- bash` check cluster connect done check ops status `kbcli cluster list-ops redis-ljzvzz --status all --namespace ns-jcjpx ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME redis-ljzvzz-verticalscaling-ml47b ns-jcjpx VerticalScaling redis-ljzvzz redis Succeed 2/2 Jun 19,2025 19:29 UTC+0800 check ops status done ops_status:redis-ljzvzz-verticalscaling-ml47b ns-jcjpx VerticalScaling redis-ljzvzz redis Succeed 2/2 Jun 19,2025 19:29 UTC+0800 `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge opsrequests redis-ljzvzz-verticalscaling-ml47b --namespace ns-jcjpx ` opsrequest.apps.kubeblocks.io/redis-ljzvzz-verticalscaling-ml47b patched `kbcli cluster delete-ops --name redis-ljzvzz-verticalscaling-ml47b --force --auto-approve --namespace ns-jcjpx ` OpsRequest redis-ljzvzz-verticalscaling-ml47b deleted `echo 'get mykey' | kbcli cluster connect redis-ljzvzz --namespace ns-jcjpx ` check data: Connect to instance redis-ljzvzz-redis-1: out of redis-ljzvzz-redis-1(primary), redis-ljzvzz-redis-0(secondary) Unable to use a TTY - input is not a terminal or the right kind of file Warning: Using a password with '-a' or '-u' option on the command line interface may not be safe. bxtif check cluster data consistent Success `kubectl get secrets -l app.kubernetes.io/instance=redis-ljzvzz` set secret: redis-ljzvzz-redis-account-default `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.username***"` `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.password***"` `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.port***"` DB_USERNAME_PROXY:;DB_PASSWORD_PROXY:;DB_PORT_PROXY:26379 DB_USERNAME:default;DB_PASSWORD:gu97Tl5m13;DB_PORT:6379;DB_DATABASE:db0 `echo "echo \"get mykey\" | redis-cli -h 127.0.0.1 -p 6379 -a gu97Tl5m13 " | kubectl exec -it redis-ljzvzz-redis-0 --namespace ns-jcjpx -- bash ` check readonly data: Defaulted container "redis" out of: redis, metrics, lorry, init-lorry (init) Unable to use a TTY - input is not a terminal or the right kind of file Warning: Using a password with '-a' or '-u' option on the command line interface may not be safe. bxtif check cluster readonly data consistent Success check db_client batch data count `echo 'get executions_loop_key' | kbcli cluster connect redis-ljzvzz --namespace ns-jcjpx ` check db_client batch data Success `kubectl get secrets -l app.kubernetes.io/instance=redis-ljzvzz` set secret: redis-ljzvzz-redis-account-default `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.username***"` `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.password***"` `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.port***"` DB_USERNAME_PROXY:;DB_PASSWORD_PROXY:;DB_PORT_PROXY:26379 DB_USERNAME:default;DB_PASSWORD:gu97Tl5m13;DB_PORT:6379;DB_DATABASE:db0 check readonly db_client batch data count `echo "echo \"get executions_loop_key\" | redis-cli -h 127.0.0.1 -p 6379 -a gu97Tl5m13 " | kubectl exec -it redis-ljzvzz-redis-0 --namespace ns-jcjpx -- bash ` check readonly db_client batch data Success cluster update terminationPolicy WipeOut `kbcli cluster update redis-ljzvzz --termination-policy=WipeOut --namespace ns-jcjpx ` cluster.apps.kubeblocks.io/redis-ljzvzz updated check cluster status `kbcli cluster list redis-ljzvzz --show-labels --namespace ns-jcjpx ` NAME NAMESPACE CLUSTER-DEFINITION VERSION TERMINATION-POLICY STATUS CREATED-TIME LABELS redis-ljzvzz ns-jcjpx WipeOut Running Jun 19,2025 18:16 UTC+0800 app.kubernetes.io/instance=redis-ljzvzz check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances redis-ljzvzz --namespace ns-jcjpx ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME redis-ljzvzz-redis-0 ns-jcjpx redis-ljzvzz redis Running secondary us-west-2a 200m / 200m 644245094400m / 644245094400m data:2Gi ip-172-31-12-104.us-west-2.compute.internal/172.31.12.104 Jun 19,2025 19:29 UTC+0800 redis-ljzvzz-redis-1 ns-jcjpx redis-ljzvzz redis Running primary us-west-2a 200m / 200m 644245094400m / 644245094400m data:2Gi ip-172-31-8-116.us-west-2.compute.internal/172.31.8.116 Jun 19,2025 19:29 UTC+0800 redis-ljzvzz-redis-sentinel-0 ns-jcjpx redis-ljzvzz redis-sentinel Running us-west-2a 100m / 100m 512Mi / 512Mi data:1Gi ip-172-31-8-116.us-west-2.compute.internal/172.31.8.116 Jun 19,2025 19:15 UTC+0800 redis-ljzvzz-redis-sentinel-1 ns-jcjpx redis-ljzvzz redis-sentinel Running us-west-2a 100m / 100m 512Mi / 512Mi data:1Gi ip-172-31-12-104.us-west-2.compute.internal/172.31.12.104 Jun 19,2025 19:15 UTC+0800 redis-ljzvzz-redis-sentinel-2 ns-jcjpx redis-ljzvzz redis-sentinel Running us-west-2a 100m / 100m 512Mi / 512Mi data:1Gi ip-172-31-6-155.us-west-2.compute.internal/172.31.6.155 Jun 19,2025 19:15 UTC+0800 redis-ljzvzz-redis-twemproxy-0 ns-jcjpx redis-ljzvzz redis-twemproxy Running us-west-2a 100m / 100m 512Mi / 512Mi data:1Gi ip-172-31-2-181.us-west-2.compute.internal/172.31.2.181 Jun 19,2025 19:15 UTC+0800 redis-ljzvzz-redis-twemproxy-1 ns-jcjpx redis-ljzvzz redis-twemproxy Running us-west-2a 100m / 100m 512Mi / 512Mi data:1Gi ip-172-31-6-5.us-west-2.compute.internal/172.31.6.5 Jun 19,2025 19:15 UTC+0800 redis-ljzvzz-redis-twemproxy-2 ns-jcjpx redis-ljzvzz redis-twemproxy Running us-west-2a 100m / 100m 512Mi / 512Mi data:1Gi ip-172-31-8-95.us-west-2.compute.internal/172.31.8.95 Jun 19,2025 19:15 UTC+0800 check pod status done check cluster role check cluster role done primary: redis-ljzvzz-redis-1;secondary: redis-ljzvzz-redis-0 `kubectl get secrets -l app.kubernetes.io/instance=redis-ljzvzz` set secret: redis-ljzvzz-redis-account-default `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.username***"` `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.password***"` `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.port***"` DB_USERNAME_PROXY:;DB_PASSWORD_PROXY:;DB_PORT_PROXY:26379 DB_USERNAME:default;DB_PASSWORD:gu97Tl5m13;DB_PORT:6379;DB_DATABASE:db0 check cluster connect `echo 'echo "" | redis-cli -h redis-ljzvzz-redis-redis.ns-jcjpx.svc.cluster.local -p 6379 -a gu97Tl5m13' | kubectl exec -it redis-ljzvzz-redis-1 --namespace ns-jcjpx -- bash` check cluster connect done cluster volume-snapshot backup `kbcli cluster backup redis-ljzvzz --method volume-snapshot --namespace ns-jcjpx ` Backup backup-ns-jcjpx-redis-ljzvzz-20250619193100 created successfully, you can view the progress: kbcli cluster list-backups --name=backup-ns-jcjpx-redis-ljzvzz-20250619193100 -n ns-jcjpx check backup status `kbcli cluster list-backups redis-ljzvzz --namespace ns-jcjpx ` NAME NAMESPACE SOURCE-CLUSTER METHOD STATUS TOTAL-SIZE DURATION CREATE-TIME COMPLETION-TIME EXPIRATION backup-ns-jcjpx-redis-ljzvzz-20250619193100 ns-jcjpx redis-ljzvzz volume-snapshot Running Jun 19,2025 19:31 UTC+0800 backup_status:redis-ljzvzz-volume-snapshot-Running backup_status:redis-ljzvzz-volume-snapshot-Running backup_status:redis-ljzvzz-volume-snapshot-Running backup_status:redis-ljzvzz-volume-snapshot-Running backup_status:redis-ljzvzz-volume-snapshot-Running backup_status:redis-ljzvzz-volume-snapshot-Running backup_status:redis-ljzvzz-volume-snapshot-Running backup_status:redis-ljzvzz-volume-snapshot-Running backup_status:redis-ljzvzz-volume-snapshot-Running backup_status:redis-ljzvzz-volume-snapshot-Running backup_status:redis-ljzvzz-volume-snapshot-Running backup_status:redis-ljzvzz-volume-snapshot-Running check backup status done backup_status:backup-ns-jcjpx-redis-ljzvzz-20250619193100 ns-jcjpx redis-ljzvzz volume-snapshot Completed 2Gi 69s Jun 19,2025 19:31 UTC+0800 Jun 19,2025 19:32 UTC+0800 cluster restore backup Error from server (NotFound): opsrequests.apps.kubeblocks.io "redis-ljzvzz-backup" not found `kbcli cluster describe-backup backup-ns-jcjpx-redis-ljzvzz-20250619193100 --namespace ns-jcjpx ` Name: backup-ns-jcjpx-redis-ljzvzz-20250619193100 Cluster: redis-ljzvzz Namespace: ns-jcjpx Spec: Method: volume-snapshot Policy Name: redis-ljzvzz-redis-backup-policy Status: Phase: Completed Total Size: 2Gi Duration: 69s Start Time: Jun 19,2025 19:31 UTC+0800 Completion Time: Jun 19,2025 19:32 UTC+0800 Time Range Start: Jun 19,2025 19:31 UTC+0800 Time Range End: Jun 19,2025 19:31 UTC+0800 Warning Events: `kbcli cluster restore redis-ljzvzz-backup --backup backup-ns-jcjpx-redis-ljzvzz-20250619193100 --namespace ns-jcjpx ` Cluster redis-ljzvzz-backup created check cluster status `kbcli cluster list redis-ljzvzz-backup --show-labels --namespace ns-jcjpx ` NAME NAMESPACE CLUSTER-DEFINITION VERSION TERMINATION-POLICY STATUS CREATED-TIME LABELS redis-ljzvzz-backup ns-jcjpx WipeOut Jun 19,2025 19:32 UTC+0800 cluster_status: cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Creating cluster_status:Updating check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances redis-ljzvzz-backup --namespace ns-jcjpx ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME redis-ljzvzz-backup-redis-0 ns-jcjpx redis-ljzvzz-backup redis Running primary us-west-2a 200m / 200m 644245094400m / 644245094400m data:2Gi ip-172-31-10-206.us-west-2.compute.internal/172.31.10.206 Jun 19,2025 19:32 UTC+0800 redis-ljzvzz-backup-redis-1 ns-jcjpx redis-ljzvzz-backup redis Running secondary us-west-2a 200m / 200m 644245094400m / 644245094400m data:2Gi ip-172-31-1-97.us-west-2.compute.internal/172.31.1.97 Jun 19,2025 19:32 UTC+0800 redis-ljzvzz-backup-redis-sentinel-0 ns-jcjpx redis-ljzvzz-backup redis-sentinel Running us-west-2a 100m / 100m 512Mi / 512Mi data:1Gi ip-172-31-13-32.us-west-2.compute.internal/172.31.13.32 Jun 19,2025 19:32 UTC+0800 redis-ljzvzz-backup-redis-sentinel-1 ns-jcjpx redis-ljzvzz-backup redis-sentinel Running us-west-2a 100m / 100m 512Mi / 512Mi data:1Gi ip-172-31-1-34.us-west-2.compute.internal/172.31.1.34 Jun 19,2025 19:32 UTC+0800 redis-ljzvzz-backup-redis-sentinel-2 ns-jcjpx redis-ljzvzz-backup redis-sentinel Running us-west-2a 100m / 100m 512Mi / 512Mi data:1Gi ip-172-31-1-97.us-west-2.compute.internal/172.31.1.97 Jun 19,2025 19:32 UTC+0800 redis-ljzvzz-backup-redis-twemproxy-0 ns-jcjpx redis-ljzvzz-backup redis-twemproxy Running us-west-2a 100m / 100m 512Mi / 512Mi data:1Gi ip-172-31-10-206.us-west-2.compute.internal/172.31.10.206 Jun 19,2025 19:32 UTC+0800 redis-ljzvzz-backup-redis-twemproxy-1 ns-jcjpx redis-ljzvzz-backup redis-twemproxy Running us-west-2a 100m / 100m 512Mi / 512Mi data:1Gi ip-172-31-3-13.us-west-2.compute.internal/172.31.3.13 Jun 19,2025 19:32 UTC+0800 redis-ljzvzz-backup-redis-twemproxy-2 ns-jcjpx redis-ljzvzz-backup redis-twemproxy Running us-west-2a 100m / 100m 512Mi / 512Mi data:1Gi ip-172-31-7-10.us-west-2.compute.internal/172.31.7.10 Jun 19,2025 19:32 UTC+0800 check pod status done check cluster role check cluster role done primary: redis-ljzvzz-backup-redis-0;secondary: redis-ljzvzz-backup-redis-1 `kubectl get secrets -l app.kubernetes.io/instance=redis-ljzvzz-backup` set secret: redis-ljzvzz-backup-redis-account-default `kubectl get secrets redis-ljzvzz-backup-redis-account-default -o jsonpath="***.data.username***"` `kubectl get secrets redis-ljzvzz-backup-redis-account-default -o jsonpath="***.data.password***"` `kubectl get secrets redis-ljzvzz-backup-redis-account-default -o jsonpath="***.data.port***"` DB_USERNAME_PROXY:;DB_PASSWORD_PROXY:;DB_PORT_PROXY:26379 DB_USERNAME:default;DB_PASSWORD:gu97Tl5m13;DB_PORT:6379;DB_DATABASE:db0 check cluster connect `echo 'echo "" | redis-cli -h redis-ljzvzz-backup-redis-redis.ns-jcjpx.svc.cluster.local -p 6379 -a gu97Tl5m13' | kubectl exec -it redis-ljzvzz-backup-redis-0 --namespace ns-jcjpx -- bash` check cluster connect done `kbcli cluster describe-backup backup-ns-jcjpx-redis-ljzvzz-20250619193100 --namespace ns-jcjpx ` Name: backup-ns-jcjpx-redis-ljzvzz-20250619193100 Cluster: redis-ljzvzz Namespace: ns-jcjpx Spec: Method: volume-snapshot Policy Name: redis-ljzvzz-redis-backup-policy Status: Phase: Completed Total Size: 2Gi Duration: 69s Start Time: Jun 19,2025 19:31 UTC+0800 Completion Time: Jun 19,2025 19:32 UTC+0800 Time Range Start: Jun 19,2025 19:31 UTC+0800 Time Range End: Jun 19,2025 19:31 UTC+0800 Warning Events: cluster connect `kubectl get secrets -l app.kubernetes.io/instance=redis-ljzvzz-backup` set secret: redis-ljzvzz-backup-redis-account-default `kubectl get secrets redis-ljzvzz-backup-redis-account-default -o jsonpath="***.data.username***"` `kubectl get secrets redis-ljzvzz-backup-redis-account-default -o jsonpath="***.data.password***"` `kubectl get secrets redis-ljzvzz-backup-redis-account-default -o jsonpath="***.data.port***"` DB_USERNAME_PROXY:;DB_PASSWORD_PROXY:;DB_PORT_PROXY:26379 DB_USERNAME:default;DB_PASSWORD:gu97Tl5m13;DB_PORT:6379;DB_DATABASE:db0 Defaulted container "redis" out of: redis, metrics, lorry, init-lorry (init) Unable to use a TTY - input is not a terminal or the right kind of file Warning: Using a password with '-a' or '-u' option on the command line interface may not be safe. # Server redis_version:7.2.7 redis_git_sha1:00000000 redis_git_dirty:0 redis_build_id:acdbb1d3e39a157b redis_mode:standalone os:Linux 5.10.237-230.949.amzn2.x86_64 x86_64 arch_bits:64 monotonic_clock:POSIX clock_gettime multiplexing_api:epoll atomicvar_api:c11-builtin gcc_version:11.4.0 process_id:1 process_supervised:no run_id:3d22288d02f4e25b0f022f3564bb31513471e8f9 tcp_port:6379 server_time_usec:1750332792017237 uptime_in_seconds:37 uptime_in_days:0 hz:10 configured_hz:10 lru_clock:5502327 executable:/redis-server config_file:/etc/redis/redis.conf io_threads_active:0 listener0:name=tcp,bind=*,bind=-::*,port=6379 `echo 'echo "CONFIG GET maxclients" | redis-cli -h redis-ljzvzz-backup-redis-redis.ns-jcjpx.svc.cluster.local -p 6379 -a gu97Tl5m13' | kubectl exec -it redis-ljzvzz-backup-redis-0 --namespace ns-jcjpx -- bash ` Defaulted container "redis" out of: redis, metrics, lorry, init-lorry (init) Unable to use a TTY - input is not a terminal or the right kind of file Warning: Using a password with '-a' or '-u' option on the command line interface may not be safe. maxclients 10000 connect cluster Success set max_connections to 10000 delete cluster redis-ljzvzz-backup `kbcli cluster delete redis-ljzvzz-backup --auto-approve --namespace ns-jcjpx ` Cluster redis-ljzvzz-backup deleted pod_info:redis-ljzvzz-backup-redis-0 3/3 Running 0 57s redis-ljzvzz-backup-redis-1 3/3 Running 0 57s redis-ljzvzz-backup-redis-sentinel-0 2/2 Running 0 59s redis-ljzvzz-backup-redis-sentinel-1 2/2 Running 0 59s redis-ljzvzz-backup-redis-sentinel-2 2/2 Running 0 59s redis-ljzvzz-backup-redis-twemproxy-0 1/1 Running 0 59s redis-ljzvzz-backup-redis-twemproxy-1 1/1 Terminating 0 46s redis-ljzvzz-backup-redis-twemproxy-2 1/1 Running 0 31s pod_info:redis-ljzvzz-backup-redis-twemproxy-0 1/1 Terminating 0 80s redis-ljzvzz-backup-redis-twemproxy-1 1/1 Terminating 0 67s redis-ljzvzz-backup-redis-twemproxy-2 1/1 Terminating 0 52s No resources found in ns-jcjpx namespace. delete cluster pod done No resources found in ns-jcjpx namespace. check cluster resource non-exist OK: pvc No resources found in ns-jcjpx namespace. delete cluster done No resources found in ns-jcjpx namespace. No resources found in ns-jcjpx namespace. No resources found in ns-jcjpx namespace. cluster delete backup `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge backups backup-ns-jcjpx-redis-ljzvzz-20250619193100 --namespace ns-jcjpx ` backup.dataprotection.kubeblocks.io/backup-ns-jcjpx-redis-ljzvzz-20250619193100 patched `kbcli cluster delete-backup redis-ljzvzz --name backup-ns-jcjpx-redis-ljzvzz-20250619193100 --force --auto-approve --namespace ns-jcjpx ` Backup backup-ns-jcjpx-redis-ljzvzz-20250619193100 deleted No opsrequests found in ns-jcjpx namespace. `kubectl get backupschedule -l app.kubernetes.io/instance=redis-ljzvzz ` `kubectl get backupschedule redis-ljzvzz-redis-backup-schedule -ojsonpath='***.spec.schedules[*].backupMethod***' ` backupschedule.dataprotection.kubeblocks.io/redis-ljzvzz-redis-backup-schedule patched backupschedule.dataprotection.kubeblocks.io/redis-ljzvzz-redis-backup-schedule patched check backup status `kbcli cluster list-backups redis-ljzvzz --namespace ns-jcjpx ` No backups found in ns-jcjpx namespace. No backups found in ns-jcjpx namespace. backup_status:-- No backups found in ns-jcjpx namespace. backup_status:-- No backups found in ns-jcjpx namespace. backup_status:-- No backups found in ns-jcjpx namespace. backup_status:-- No backups found in ns-jcjpx namespace. backup_status:-- No backups found in ns-jcjpx namespace. backup_status:-- No backups found in ns-jcjpx namespace. backup_status:-- No backups found in ns-jcjpx namespace. backup_status:-- No backups found in ns-jcjpx namespace. backup_status:-- `kubectl get backupschedule -l app.kubernetes.io/instance=redis-ljzvzz ` `kubectl get backupschedule redis-ljzvzz-redis-backup-schedule -ojsonpath='***.spec.schedules[*].backupMethod***' ` backupschedule.dataprotection.kubeblocks.io/redis-ljzvzz-redis-backup-schedule patched backupschedule.dataprotection.kubeblocks.io/redis-ljzvzz-redis-backup-schedule patched backupschedule.dataprotection.kubeblocks.io/redis-ljzvzz-redis-backup-schedule patched backupschedule.dataprotection.kubeblocks.io/redis-ljzvzz-redis-backup-schedule patched (no change) backupschedule.dataprotection.kubeblocks.io/redis-ljzvzz-redis-backup-schedule patched backupschedule.dataprotection.kubeblocks.io/redis-ljzvzz-redis-backup-schedule patched (no change) backup_status:redis-ljzvzz-datafile-Running check backup status done backup_status:redis-ljzvzz-datafile-20250619113500 ns-jcjpx redis-ljzvzz datafile Completed 13135 13s Jun 19,2025 19:35 UTC+0800 Jun 19,2025 19:35 UTC+0800 Jun 26,2025 19:35 UTC+0800 `kubectl get backupschedule -l app.kubernetes.io/instance=redis-ljzvzz ` `kubectl get backupschedule redis-ljzvzz-redis-backup-schedule -ojsonpath='***.spec.schedules[*].backupMethod***' ` backupschedule.dataprotection.kubeblocks.io/redis-ljzvzz-redis-backup-schedule patched (no change) backupschedule.dataprotection.kubeblocks.io/redis-ljzvzz-redis-backup-schedule patched (no change) backupschedule.dataprotection.kubeblocks.io/redis-ljzvzz-redis-backup-schedule patched (no change) backupschedule.dataprotection.kubeblocks.io/redis-ljzvzz-redis-backup-schedule patched (no change) backupschedule.dataprotection.kubeblocks.io/redis-ljzvzz-redis-backup-schedule patched (no change) backupschedule.dataprotection.kubeblocks.io/redis-ljzvzz-redis-backup-schedule patched (no change) cluster restore backup Error from server (NotFound): opsrequests.apps.kubeblocks.io "redis-ljzvzz-backup" not found `kbcli cluster describe-backup redis-ljzvzz-datafile-20250619113500 --namespace ns-jcjpx ` Name: redis-ljzvzz-datafile-20250619113500 Cluster: redis-ljzvzz Namespace: ns-jcjpx Spec: Method: datafile Policy Name: redis-ljzvzz-redis-backup-policy Status: Phase: Completed Total Size: 13135 ActionSet Name: redis-physical-backup Repository: backuprepo-kbcli-test Duration: 13s Expiration Time: Jun 26,2025 19:35 UTC+0800 Start Time: Jun 19,2025 19:35 UTC+0800 Completion Time: Jun 19,2025 19:35 UTC+0800 Path: /ns-jcjpx/redis-ljzvzz-d7109871-8dfb-47a4-a517-2b090c7897ef/redis/redis-ljzvzz-datafile-20250619113500 Warning Events: `kbcli cluster restore redis-ljzvzz-backup --backup redis-ljzvzz-datafile-20250619113500 --namespace ns-jcjpx ` Cluster redis-ljzvzz-backup created check cluster status `kbcli cluster list redis-ljzvzz-backup --show-labels --namespace ns-jcjpx ` NAME NAMESPACE CLUSTER-DEFINITION VERSION TERMINATION-POLICY STATUS CREATED-TIME LABELS redis-ljzvzz-backup ns-jcjpx WipeOut Jun 19,2025 19:35 UTC+0800 cluster_status: cluster_status: cluster_status: cluster_status: cluster_status:Creating cluster_status:Updating cluster_status:Updating cluster_status:Updating check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances redis-ljzvzz-backup --namespace ns-jcjpx ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME redis-ljzvzz-backup-redis-0 ns-jcjpx redis-ljzvzz-backup redis Running primary us-west-2a 200m / 200m 644245094400m / 644245094400m data:2Gi ip-172-31-13-32.us-west-2.compute.internal/172.31.13.32 Jun 19,2025 19:35 UTC+0800 redis-ljzvzz-backup-redis-1 ns-jcjpx redis-ljzvzz-backup redis Running secondary us-west-2a 200m / 200m 644245094400m / 644245094400m data:2Gi ip-172-31-10-206.us-west-2.compute.internal/172.31.10.206 Jun 19,2025 19:35 UTC+0800 redis-ljzvzz-backup-redis-sentinel-0 ns-jcjpx redis-ljzvzz-backup redis-sentinel Running us-west-2a 100m / 100m 512Mi / 512Mi data:1Gi ip-172-31-1-97.us-west-2.compute.internal/172.31.1.97 Jun 19,2025 19:35 UTC+0800 redis-ljzvzz-backup-redis-sentinel-1 ns-jcjpx redis-ljzvzz-backup redis-sentinel Running us-west-2a 100m / 100m 512Mi / 512Mi data:1Gi ip-172-31-10-206.us-west-2.compute.internal/172.31.10.206 Jun 19,2025 19:35 UTC+0800 redis-ljzvzz-backup-redis-sentinel-2 ns-jcjpx redis-ljzvzz-backup redis-sentinel Running us-west-2a 100m / 100m 512Mi / 512Mi data:1Gi ip-172-31-13-32.us-west-2.compute.internal/172.31.13.32 Jun 19,2025 19:35 UTC+0800 redis-ljzvzz-backup-redis-twemproxy-0 ns-jcjpx redis-ljzvzz-backup redis-twemproxy Running us-west-2a 100m / 100m 512Mi / 512Mi data:1Gi ip-172-31-8-77.us-west-2.compute.internal/172.31.8.77 Jun 19,2025 19:35 UTC+0800 redis-ljzvzz-backup-redis-twemproxy-1 ns-jcjpx redis-ljzvzz-backup redis-twemproxy Running us-west-2a 100m / 100m 512Mi / 512Mi data:1Gi ip-172-31-14-205.us-west-2.compute.internal/172.31.14.205 Jun 19,2025 19:35 UTC+0800 redis-ljzvzz-backup-redis-twemproxy-2 ns-jcjpx redis-ljzvzz-backup redis-twemproxy Running us-west-2a 100m / 100m 512Mi / 512Mi data:1Gi ip-172-31-5-144.us-west-2.compute.internal/172.31.5.144 Jun 19,2025 19:35 UTC+0800 check pod status done check cluster role check cluster role done primary: redis-ljzvzz-backup-redis-0;secondary: redis-ljzvzz-backup-redis-1 `kubectl get secrets -l app.kubernetes.io/instance=redis-ljzvzz-backup` set secret: redis-ljzvzz-backup-redis-account-default `kubectl get secrets redis-ljzvzz-backup-redis-account-default -o jsonpath="***.data.username***"` `kubectl get secrets redis-ljzvzz-backup-redis-account-default -o jsonpath="***.data.password***"` `kubectl get secrets redis-ljzvzz-backup-redis-account-default -o jsonpath="***.data.port***"` DB_USERNAME_PROXY:;DB_PASSWORD_PROXY:;DB_PORT_PROXY:26379 DB_USERNAME:default;DB_PASSWORD:gu97Tl5m13;DB_PORT:6379;DB_DATABASE:db0 check cluster connect `echo 'echo "" | redis-cli -h redis-ljzvzz-backup-redis-redis.ns-jcjpx.svc.cluster.local -p 6379 -a gu97Tl5m13' | kubectl exec -it redis-ljzvzz-backup-redis-0 --namespace ns-jcjpx -- bash` check cluster connect done `kbcli cluster describe-backup redis-ljzvzz-datafile-20250619113500 --namespace ns-jcjpx ` Name: redis-ljzvzz-datafile-20250619113500 Cluster: redis-ljzvzz Namespace: ns-jcjpx Spec: Method: datafile Policy Name: redis-ljzvzz-redis-backup-policy Status: Phase: Completed Total Size: 13135 ActionSet Name: redis-physical-backup Repository: backuprepo-kbcli-test Duration: 13s Expiration Time: Jun 26,2025 19:35 UTC+0800 Start Time: Jun 19,2025 19:35 UTC+0800 Completion Time: Jun 19,2025 19:35 UTC+0800 Path: /ns-jcjpx/redis-ljzvzz-d7109871-8dfb-47a4-a517-2b090c7897ef/redis/redis-ljzvzz-datafile-20250619113500 Warning Events: cluster connect `kubectl get secrets -l app.kubernetes.io/instance=redis-ljzvzz-backup` set secret: redis-ljzvzz-backup-redis-account-default `kubectl get secrets redis-ljzvzz-backup-redis-account-default -o jsonpath="***.data.username***"` `kubectl get secrets redis-ljzvzz-backup-redis-account-default -o jsonpath="***.data.password***"` `kubectl get secrets redis-ljzvzz-backup-redis-account-default -o jsonpath="***.data.port***"` DB_USERNAME_PROXY:;DB_PASSWORD_PROXY:;DB_PORT_PROXY:26379 DB_USERNAME:default;DB_PASSWORD:gu97Tl5m13;DB_PORT:6379;DB_DATABASE:db0 Defaulted container "redis" out of: redis, metrics, lorry, init-lorry (init) Unable to use a TTY - input is not a terminal or the right kind of file Warning: Using a password with '-a' or '-u' option on the command line interface may not be safe. # Server redis_version:7.2.7 redis_git_sha1:00000000 redis_git_dirty:0 redis_build_id:acdbb1d3e39a157b redis_mode:standalone os:Linux 5.10.237-230.949.amzn2.x86_64 x86_64 arch_bits:64 monotonic_clock:POSIX clock_gettime multiplexing_api:epoll atomicvar_api:c11-builtin gcc_version:11.4.0 process_id:1 process_supervised:no run_id:73788bf65c3cd29e9ab68a9736de9306a69f0691 tcp_port:6379 server_time_usec:1750332992905580 uptime_in_seconds:38 uptime_in_days:0 hz:10 configured_hz:10 lru_clock:5502528 executable:/redis-server config_file:/etc/redis/redis.conf io_threads_active:0 listener0:name=tcp,bind=*,bind=-::*,port=6379 `echo 'echo "CONFIG GET maxclients" | redis-cli -h redis-ljzvzz-backup-redis-redis.ns-jcjpx.svc.cluster.local -p 6379 -a gu97Tl5m13' | kubectl exec -it redis-ljzvzz-backup-redis-0 --namespace ns-jcjpx -- bash ` Defaulted container "redis" out of: redis, metrics, lorry, init-lorry (init) Unable to use a TTY - input is not a terminal or the right kind of file Warning: Using a password with '-a' or '-u' option on the command line interface may not be safe. maxclients 10000 connect cluster Success set max_connections to 10000 delete cluster redis-ljzvzz-backup `kbcli cluster delete redis-ljzvzz-backup --auto-approve --namespace ns-jcjpx ` Cluster redis-ljzvzz-backup deleted pod_info:redis-ljzvzz-backup-redis-0 3/3 Running 0 45s redis-ljzvzz-backup-redis-1 3/3 Running 0 45s redis-ljzvzz-backup-redis-sentinel-0 2/2 Running 0 66s redis-ljzvzz-backup-redis-sentinel-1 2/2 Running 0 66s redis-ljzvzz-backup-redis-sentinel-2 2/2 Running 0 66s redis-ljzvzz-backup-redis-twemproxy-0 1/1 Running 0 65s redis-ljzvzz-backup-redis-twemproxy-1 1/1 Running 0 55s redis-ljzvzz-backup-redis-twemproxy-2 1/1 Running 0 43s pod_info:redis-ljzvzz-backup-redis-twemproxy-0 1/1 Terminating 0 86s redis-ljzvzz-backup-redis-twemproxy-1 1/1 Terminating 0 76s redis-ljzvzz-backup-redis-twemproxy-2 1/1 Terminating 0 64s No resources found in ns-jcjpx namespace. delete cluster pod done No resources found in ns-jcjpx namespace. check cluster resource non-exist OK: pvc No resources found in ns-jcjpx namespace. delete cluster done No resources found in ns-jcjpx namespace. No resources found in ns-jcjpx namespace. No resources found in ns-jcjpx namespace. cluster delete backup `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge backups redis-ljzvzz-datafile-20250619113500 --namespace ns-jcjpx ` backup.dataprotection.kubeblocks.io/redis-ljzvzz-datafile-20250619113500 patched `kbcli cluster delete-backup redis-ljzvzz --name redis-ljzvzz-datafile-20250619113500 --force --auto-approve --namespace ns-jcjpx ` Backup redis-ljzvzz-datafile-20250619113500 deleted No opsrequests found in ns-jcjpx namespace. cluster datafile backup `kubectl get backuprepo backuprepo-kbcli-test -o jsonpath="***.spec.credential.name***"` `kubectl get backuprepo backuprepo-kbcli-test -o jsonpath="***.spec.credential.namespace***"` `kubectl get secrets kb-backuprepo-w7bzj -n kb-mqtcr -o jsonpath="***.data.accessKeyId***"` `kubectl get secrets kb-backuprepo-w7bzj -n kb-mqtcr -o jsonpath="***.data.secretAccessKey***"` KUBEBLOCKS NAMESPACE:kb-mqtcr get kubeblocks namespace done `kubectl get secrets -l app.kubernetes.io/instance=kbcli-test-minio --namespace kb-mqtcr -o jsonpath="***.items[0].data.root-user***"` `kubectl get secrets -l app.kubernetes.io/instance=kbcli-test-minio --namespace kb-mqtcr -o jsonpath="***.items[0].data.root-password***"` minio_user:kbclitest,minio_password:kbclitest,minio_endpoint:kbcli-test-minio.kb-mqtcr.svc.cluster.local:9000 list minio bucket kbcli-test `echo 'mc config host add minioserver http://kbcli-test-minio.kb-mqtcr.svc.cluster.local:9000 kbclitest kbclitest;mc ls minioserver' | kubectl exec -it kbcli-test-minio-5c88d6b598-9v8l5 --namespace kb-mqtcr -- bash` Unable to use a TTY - input is not a terminal or the right kind of file list minio bucket done default backuprepo:backuprepo-kbcli-test exists `kbcli cluster backup redis-ljzvzz --method datafile --namespace ns-jcjpx ` Backup backup-ns-jcjpx-redis-ljzvzz-20250619193740 created successfully, you can view the progress: kbcli cluster list-backups --name=backup-ns-jcjpx-redis-ljzvzz-20250619193740 -n ns-jcjpx check backup status `kbcli cluster list-backups redis-ljzvzz --namespace ns-jcjpx ` NAME NAMESPACE SOURCE-CLUSTER METHOD STATUS TOTAL-SIZE DURATION CREATE-TIME COMPLETION-TIME EXPIRATION backup-ns-jcjpx-redis-ljzvzz-20250619193740 ns-jcjpx redis-ljzvzz datafile Running Jun 19,2025 19:37 UTC+0800 backup_status:redis-ljzvzz-datafile-Running backup_status:redis-ljzvzz-datafile-Running check backup status done backup_status:backup-ns-jcjpx-redis-ljzvzz-20250619193740 ns-jcjpx redis-ljzvzz datafile Completed 13185 10s Jun 19,2025 19:37 UTC+0800 Jun 19,2025 19:37 UTC+0800 cluster restore backup Error from server (NotFound): opsrequests.apps.kubeblocks.io "redis-ljzvzz-backup" not found `kbcli cluster describe-backup backup-ns-jcjpx-redis-ljzvzz-20250619193740 --namespace ns-jcjpx ` Name: backup-ns-jcjpx-redis-ljzvzz-20250619193740 Cluster: redis-ljzvzz Namespace: ns-jcjpx Spec: Method: datafile Policy Name: redis-ljzvzz-redis-backup-policy Status: Phase: Completed Total Size: 13185 ActionSet Name: redis-physical-backup Repository: backuprepo-kbcli-test Duration: 10s Start Time: Jun 19,2025 19:37 UTC+0800 Completion Time: Jun 19,2025 19:37 UTC+0800 Path: /ns-jcjpx/redis-ljzvzz-d7109871-8dfb-47a4-a517-2b090c7897ef/redis/backup-ns-jcjpx-redis-ljzvzz-20250619193740 Warning Events: `kbcli cluster restore redis-ljzvzz-backup --backup backup-ns-jcjpx-redis-ljzvzz-20250619193740 --namespace ns-jcjpx ` Cluster redis-ljzvzz-backup created check cluster status `kbcli cluster list redis-ljzvzz-backup --show-labels --namespace ns-jcjpx ` NAME NAMESPACE CLUSTER-DEFINITION VERSION TERMINATION-POLICY STATUS CREATED-TIME LABELS redis-ljzvzz-backup ns-jcjpx WipeOut Jun 19,2025 19:37 UTC+0800 cluster_status: cluster_status: cluster_status: cluster_status:Creating cluster_status:Creating cluster_status:Updating cluster_status:Updating cluster_status:Updating check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances redis-ljzvzz-backup --namespace ns-jcjpx ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME redis-ljzvzz-backup-redis-0 ns-jcjpx redis-ljzvzz-backup redis Running primary us-west-2a 200m / 200m 644245094400m / 644245094400m data:2Gi ip-172-31-1-97.us-west-2.compute.internal/172.31.1.97 Jun 19,2025 19:38 UTC+0800 redis-ljzvzz-backup-redis-1 ns-jcjpx redis-ljzvzz-backup redis Running secondary us-west-2a 200m / 200m 644245094400m / 644245094400m data:2Gi ip-172-31-13-32.us-west-2.compute.internal/172.31.13.32 Jun 19,2025 19:38 UTC+0800 redis-ljzvzz-backup-redis-sentinel-0 ns-jcjpx redis-ljzvzz-backup redis-sentinel Running us-west-2a 100m / 100m 512Mi / 512Mi data:1Gi ip-172-31-1-97.us-west-2.compute.internal/172.31.1.97 Jun 19,2025 19:37 UTC+0800 redis-ljzvzz-backup-redis-sentinel-1 ns-jcjpx redis-ljzvzz-backup redis-sentinel Running us-west-2a 100m / 100m 512Mi / 512Mi data:1Gi ip-172-31-10-206.us-west-2.compute.internal/172.31.10.206 Jun 19,2025 19:37 UTC+0800 redis-ljzvzz-backup-redis-sentinel-2 ns-jcjpx redis-ljzvzz-backup redis-sentinel Running us-west-2a 100m / 100m 512Mi / 512Mi data:1Gi ip-172-31-1-34.us-west-2.compute.internal/172.31.1.34 Jun 19,2025 19:37 UTC+0800 redis-ljzvzz-backup-redis-twemproxy-0 ns-jcjpx redis-ljzvzz-backup redis-twemproxy Running us-west-2a 100m / 100m 512Mi / 512Mi data:1Gi ip-172-31-1-34.us-west-2.compute.internal/172.31.1.34 Jun 19,2025 19:37 UTC+0800 redis-ljzvzz-backup-redis-twemproxy-1 ns-jcjpx redis-ljzvzz-backup redis-twemproxy Running us-west-2a 100m / 100m 512Mi / 512Mi data:1Gi ip-172-31-10-206.us-west-2.compute.internal/172.31.10.206 Jun 19,2025 19:38 UTC+0800 redis-ljzvzz-backup-redis-twemproxy-2 ns-jcjpx redis-ljzvzz-backup redis-twemproxy Running us-west-2a 100m / 100m 512Mi / 512Mi data:1Gi ip-172-31-3-13.us-west-2.compute.internal/172.31.3.13 Jun 19,2025 19:38 UTC+0800 check pod status done check cluster role check cluster role done primary: redis-ljzvzz-backup-redis-0;secondary: redis-ljzvzz-backup-redis-1 `kubectl get secrets -l app.kubernetes.io/instance=redis-ljzvzz-backup` set secret: redis-ljzvzz-backup-redis-account-default `kubectl get secrets redis-ljzvzz-backup-redis-account-default -o jsonpath="***.data.username***"` `kubectl get secrets redis-ljzvzz-backup-redis-account-default -o jsonpath="***.data.password***"` `kubectl get secrets redis-ljzvzz-backup-redis-account-default -o jsonpath="***.data.port***"` DB_USERNAME_PROXY:;DB_PASSWORD_PROXY:;DB_PORT_PROXY:26379 DB_USERNAME:default;DB_PASSWORD:gu97Tl5m13;DB_PORT:6379;DB_DATABASE:db0 check cluster connect `echo 'echo "" | redis-cli -h redis-ljzvzz-backup-redis-redis.ns-jcjpx.svc.cluster.local -p 6379 -a gu97Tl5m13' | kubectl exec -it redis-ljzvzz-backup-redis-0 --namespace ns-jcjpx -- bash` check cluster connect done `kbcli cluster describe-backup backup-ns-jcjpx-redis-ljzvzz-20250619193740 --namespace ns-jcjpx ` Name: backup-ns-jcjpx-redis-ljzvzz-20250619193740 Cluster: redis-ljzvzz Namespace: ns-jcjpx Spec: Method: datafile Policy Name: redis-ljzvzz-redis-backup-policy Status: Phase: Completed Total Size: 13185 ActionSet Name: redis-physical-backup Repository: backuprepo-kbcli-test Duration: 10s Start Time: Jun 19,2025 19:37 UTC+0800 Completion Time: Jun 19,2025 19:37 UTC+0800 Path: /ns-jcjpx/redis-ljzvzz-d7109871-8dfb-47a4-a517-2b090c7897ef/redis/backup-ns-jcjpx-redis-ljzvzz-20250619193740 Warning Events: cluster connect `kubectl get secrets -l app.kubernetes.io/instance=redis-ljzvzz-backup` set secret: redis-ljzvzz-backup-redis-account-default `kubectl get secrets redis-ljzvzz-backup-redis-account-default -o jsonpath="***.data.username***"` `kubectl get secrets redis-ljzvzz-backup-redis-account-default -o jsonpath="***.data.password***"` `kubectl get secrets redis-ljzvzz-backup-redis-account-default -o jsonpath="***.data.port***"` DB_USERNAME_PROXY:;DB_PASSWORD_PROXY:;DB_PORT_PROXY:26379 DB_USERNAME:default;DB_PASSWORD:gu97Tl5m13;DB_PORT:6379;DB_DATABASE:db0 Defaulted container "redis" out of: redis, metrics, lorry, init-lorry (init) Unable to use a TTY - input is not a terminal or the right kind of file Warning: Using a password with '-a' or '-u' option on the command line interface may not be safe. # Server redis_version:7.2.7 redis_git_sha1:00000000 redis_git_dirty:0 redis_build_id:acdbb1d3e39a157b redis_mode:standalone os:Linux 5.10.237-230.949.amzn2.x86_64 x86_64 arch_bits:64 monotonic_clock:POSIX clock_gettime multiplexing_api:epoll atomicvar_api:c11-builtin gcc_version:11.4.0 process_id:1 process_supervised:no run_id:5c7f23e098de2d8b4185b0308ab6d746ab4ff5a9 tcp_port:6379 server_time_usec:1750333140901658 uptime_in_seconds:34 uptime_in_days:0 hz:10 configured_hz:10 lru_clock:5502676 executable:/redis-server config_file:/etc/redis/redis.conf io_threads_active:0 listener0:name=tcp,bind=*,bind=-::*,port=6379 `echo 'echo "CONFIG GET maxclients" | redis-cli -h redis-ljzvzz-backup-redis-redis.ns-jcjpx.svc.cluster.local -p 6379 -a gu97Tl5m13' | kubectl exec -it redis-ljzvzz-backup-redis-0 --namespace ns-jcjpx -- bash ` Defaulted container "redis" out of: redis, metrics, lorry, init-lorry (init) Unable to use a TTY - input is not a terminal or the right kind of file Warning: Using a password with '-a' or '-u' option on the command line interface may not be safe. maxclients 10000 connect cluster Success set max_connections to 10000 delete cluster redis-ljzvzz-backup `kbcli cluster delete redis-ljzvzz-backup --auto-approve --namespace ns-jcjpx ` Cluster redis-ljzvzz-backup deleted pod_info:redis-ljzvzz-backup-redis-0 3/3 Running 0 52s redis-ljzvzz-backup-redis-1 3/3 Running 0 52s redis-ljzvzz-backup-redis-sentinel-0 2/2 Running 0 65s redis-ljzvzz-backup-redis-sentinel-1 2/2 Running 0 65s redis-ljzvzz-backup-redis-sentinel-2 2/2 Running 0 65s redis-ljzvzz-backup-redis-twemproxy-0 1/1 Running 0 65s redis-ljzvzz-backup-redis-twemproxy-1 1/1 Running 0 53s redis-ljzvzz-backup-redis-twemproxy-2 1/1 Running 0 37s pod_info:redis-ljzvzz-backup-redis-twemproxy-0 1/1 Terminating 0 86s redis-ljzvzz-backup-redis-twemproxy-1 1/1 Terminating 0 74s redis-ljzvzz-backup-redis-twemproxy-2 1/1 Terminating 0 58s No resources found in ns-jcjpx namespace. delete cluster pod done No resources found in ns-jcjpx namespace. check cluster resource non-exist OK: pvc No resources found in ns-jcjpx namespace. delete cluster done No resources found in ns-jcjpx namespace. No resources found in ns-jcjpx namespace. No resources found in ns-jcjpx namespace. cluster rebulid instances apiVersion: apps.kubeblocks.io/v1alpha1 kind: OpsRequest metadata: generateName: redis-ljzvzz-rebuildinstance- namespace: ns-jcjpx spec: type: RebuildInstance clusterName: redis-ljzvzz force: true rebuildFrom: - componentName: redis instances: - name: redis-ljzvzz-redis-0 backupName: backup-ns-jcjpx-redis-ljzvzz-20250619193740 inPlace: false check cluster status before ops check cluster status done cluster_status:Running `kubectl create -f test_ops_cluster_redis-ljzvzz.yaml` opsrequest.apps.kubeblocks.io/redis-ljzvzz-rebuildinstance-sbrtt created create test_ops_cluster_redis-ljzvzz.yaml Success `rm -rf test_ops_cluster_redis-ljzvzz.yaml` check ops status `kbcli cluster list-ops redis-ljzvzz --status all --namespace ns-jcjpx ` No opsrequests found in ns-jcjpx namespace. No opsrequests found in ns-jcjpx namespace. ops_status: No opsrequests found in ns-jcjpx namespace. ops_status: No opsrequests found in ns-jcjpx namespace. ops_status: No opsrequests found in ns-jcjpx namespace. ops_status: No opsrequests found in ns-jcjpx namespace. ops_status: No opsrequests found in ns-jcjpx namespace. ops_status: No opsrequests found in ns-jcjpx namespace. ops_status: No opsrequests found in ns-jcjpx namespace. ops_status: No opsrequests found in ns-jcjpx namespace. ops_status: No opsrequests found in ns-jcjpx namespace. ops_status: No opsrequests found in ns-jcjpx namespace. ops_status: No opsrequests found in ns-jcjpx namespace. ops_status: No opsrequests found in ns-jcjpx namespace. ops_status: No opsrequests found in ns-jcjpx namespace. ops_status: No opsrequests found in ns-jcjpx namespace. ops_status: No opsrequests found in ns-jcjpx namespace. ops_status: No opsrequests found in ns-jcjpx namespace. ops_status: No opsrequests found in ns-jcjpx namespace. ops_status: No opsrequests found in ns-jcjpx namespace. ops_status: No opsrequests found in ns-jcjpx namespace. ops_status: No opsrequests found in ns-jcjpx namespace. ops_status: No opsrequests found in ns-jcjpx namespace. ops_status: No opsrequests found in ns-jcjpx namespace. ops_status: No opsrequests found in ns-jcjpx namespace. ops_status: No opsrequests found in ns-jcjpx namespace. ops_status: No opsrequests found in ns-jcjpx namespace. ops_status: No opsrequests found in ns-jcjpx namespace. ops_status: No opsrequests found in ns-jcjpx namespace. ops_status: No opsrequests found in ns-jcjpx namespace. ops_status: No opsrequests found in ns-jcjpx namespace. ops_status: No opsrequests found in ns-jcjpx namespace. ops_status: No opsrequests found in ns-jcjpx namespace. ops_status: No opsrequests found in ns-jcjpx namespace. ops_status: No opsrequests found in ns-jcjpx namespace. ops_status: No opsrequests found in ns-jcjpx namespace. ops_status: No opsrequests found in ns-jcjpx namespace. ops_status: No opsrequests found in ns-jcjpx namespace. ops_status: No opsrequests found in ns-jcjpx namespace. ops_status: not found ops rebuildinstance check cluster status `kbcli cluster list redis-ljzvzz --show-labels --namespace ns-jcjpx ` NAME NAMESPACE CLUSTER-DEFINITION VERSION TERMINATION-POLICY STATUS CREATED-TIME LABELS redis-ljzvzz ns-jcjpx WipeOut Running Jun 19,2025 18:16 UTC+0800 app.kubernetes.io/instance=redis-ljzvzz check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances redis-ljzvzz --namespace ns-jcjpx ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME redis-ljzvzz-redis-0 ns-jcjpx redis-ljzvzz redis Running secondary us-west-2a 200m / 200m 644245094400m / 644245094400m data:2Gi ip-172-31-12-104.us-west-2.compute.internal/172.31.12.104 Jun 19,2025 19:29 UTC+0800 redis-ljzvzz-redis-1 ns-jcjpx redis-ljzvzz redis Running primary us-west-2a 200m / 200m 644245094400m / 644245094400m data:2Gi ip-172-31-8-116.us-west-2.compute.internal/172.31.8.116 Jun 19,2025 19:29 UTC+0800 redis-ljzvzz-redis-sentinel-0 ns-jcjpx redis-ljzvzz redis-sentinel Running us-west-2a 100m / 100m 512Mi / 512Mi data:1Gi ip-172-31-8-116.us-west-2.compute.internal/172.31.8.116 Jun 19,2025 19:15 UTC+0800 redis-ljzvzz-redis-sentinel-1 ns-jcjpx redis-ljzvzz redis-sentinel Running us-west-2a 100m / 100m 512Mi / 512Mi data:1Gi ip-172-31-12-104.us-west-2.compute.internal/172.31.12.104 Jun 19,2025 19:15 UTC+0800 redis-ljzvzz-redis-sentinel-2 ns-jcjpx redis-ljzvzz redis-sentinel Running us-west-2a 100m / 100m 512Mi / 512Mi data:1Gi ip-172-31-6-155.us-west-2.compute.internal/172.31.6.155 Jun 19,2025 19:15 UTC+0800 redis-ljzvzz-redis-twemproxy-0 ns-jcjpx redis-ljzvzz redis-twemproxy Running us-west-2a 100m / 100m 512Mi / 512Mi data:1Gi ip-172-31-2-181.us-west-2.compute.internal/172.31.2.181 Jun 19,2025 19:15 UTC+0800 redis-ljzvzz-redis-twemproxy-1 ns-jcjpx redis-ljzvzz redis-twemproxy Running us-west-2a 100m / 100m 512Mi / 512Mi data:1Gi ip-172-31-6-5.us-west-2.compute.internal/172.31.6.5 Jun 19,2025 19:15 UTC+0800 redis-ljzvzz-redis-twemproxy-2 ns-jcjpx redis-ljzvzz redis-twemproxy Running us-west-2a 100m / 100m 512Mi / 512Mi data:1Gi ip-172-31-8-95.us-west-2.compute.internal/172.31.8.95 Jun 19,2025 19:15 UTC+0800 check pod status done check cluster role check cluster role done primary: redis-ljzvzz-redis-1;secondary: redis-ljzvzz-redis-0 `kubectl get secrets -l app.kubernetes.io/instance=redis-ljzvzz` set secret: redis-ljzvzz-redis-account-default `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.username***"` `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.password***"` `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.port***"` DB_USERNAME_PROXY:;DB_PASSWORD_PROXY:;DB_PORT_PROXY:26379 DB_USERNAME:default;DB_PASSWORD:gu97Tl5m13;DB_PORT:6379;DB_DATABASE:db0 check cluster connect `echo 'echo "" | redis-cli -h redis-ljzvzz-redis-redis.ns-jcjpx.svc.cluster.local -p 6379 -a gu97Tl5m13' | kubectl exec -it redis-ljzvzz-redis-1 --namespace ns-jcjpx -- bash` check cluster connect done `echo 'get mykey' | kbcli cluster connect redis-ljzvzz --namespace ns-jcjpx ` check data: Connect to instance redis-ljzvzz-redis-1: out of redis-ljzvzz-redis-1(primary), redis-ljzvzz-redis-0(secondary) Unable to use a TTY - input is not a terminal or the right kind of file Warning: Using a password with '-a' or '-u' option on the command line interface may not be safe. bxtif check cluster data consistent Success `kubectl get secrets -l app.kubernetes.io/instance=redis-ljzvzz` set secret: redis-ljzvzz-redis-account-default `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.username***"` `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.password***"` `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.port***"` DB_USERNAME_PROXY:;DB_PASSWORD_PROXY:;DB_PORT_PROXY:26379 DB_USERNAME:default;DB_PASSWORD:gu97Tl5m13;DB_PORT:6379;DB_DATABASE:db0 `echo "echo \"get mykey\" | redis-cli -h 127.0.0.1 -p 6379 -a gu97Tl5m13 " | kubectl exec -it redis-ljzvzz-redis-0 --namespace ns-jcjpx -- bash ` check readonly data: Defaulted container "redis" out of: redis, metrics, lorry, init-lorry (init) Unable to use a TTY - input is not a terminal or the right kind of file Warning: Using a password with '-a' or '-u' option on the command line interface may not be safe. bxtif check cluster readonly data consistent Success check db_client batch data count `echo 'get executions_loop_key' | kbcli cluster connect redis-ljzvzz --namespace ns-jcjpx ` check db_client batch data Success `kubectl get secrets -l app.kubernetes.io/instance=redis-ljzvzz` set secret: redis-ljzvzz-redis-account-default `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.username***"` `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.password***"` `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.port***"` DB_USERNAME_PROXY:;DB_PASSWORD_PROXY:;DB_PORT_PROXY:26379 DB_USERNAME:default;DB_PASSWORD:gu97Tl5m13;DB_PORT:6379;DB_DATABASE:db0 check readonly db_client batch data count `echo "echo \"get executions_loop_key\" | redis-cli -h 127.0.0.1 -p 6379 -a gu97Tl5m13 " | kubectl exec -it redis-ljzvzz-redis-0 --namespace ns-jcjpx -- bash ` check readonly db_client batch data Success cluster delete backup `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge backups backup-ns-jcjpx-redis-ljzvzz-20250619193740 --namespace ns-jcjpx ` backup.dataprotection.kubeblocks.io/backup-ns-jcjpx-redis-ljzvzz-20250619193740 patched `kbcli cluster delete-backup redis-ljzvzz --name backup-ns-jcjpx-redis-ljzvzz-20250619193740 --force --auto-approve --namespace ns-jcjpx ` Backup backup-ns-jcjpx-redis-ljzvzz-20250619193740 deleted No opsrequests found in ns-jcjpx namespace. cluster list-logs `kbcli cluster list-logs redis-ljzvzz --namespace ns-jcjpx ` No log files found. You can enable the log feature with the kbcli command below. kbcli cluster update redis-ljzvzz --enable-all-logs=true --namespace ns-jcjpx Error from server (NotFound): pods "redis-ljzvzz-redis-1" not found cluster logs `kbcli cluster logs redis-ljzvzz --tail 30 --namespace ns-jcjpx ` Defaulted container "redis" out of: redis, metrics, lorry, init-lorry (init) + echo 'replicaof redis-ljzvzz-redis-0.redis-ljzvzz-redis-headless.ns-jcjpx.svc.cluster.local 6379' + rebuild_redis_acl_file + '[' -f /data/users.acl ']' + sed -i '/user default on/d' /data/users.acl + sed -i '/user kbreplicator on/d' /data/users.acl + sed -i '/user kbreplicator-sentinel on/d' /data/users.acl + build_redis_default_accounts build default accounts succeeded! Starting redis server cmd: exec redis-server /etc/redis/redis.conf --loadmodule /opt/redis-stack/lib/redisearch.so --loadmodule /opt/redis-stack/lib/redistimeseries.so --loadmodule /opt/redis-stack/lib/rejson.so --loadmodule /opt/redis-stack/lib/redisbloom.so --loadmodule /opt/redis-stack/lib/rediscompat.so --loadmodule /opt/redis-stack/lib/redisgears.so v8-plugin-path /opt/redis-stack/lib/libredisgears_v8_plugin.so + set +x + echo 'aclfile /data/users.acl' + echo 'build default accounts succeeded!' + start_redis_server + exec_cmd='exec redis-server /etc/redis/redis.conf' + '[' -f /opt/redis-stack/lib/redisearch.so ']' + exec_cmd='exec redis-server /etc/redis/redis.conf --loadmodule /opt/redis-stack/lib/redisearch.so ' + '[' -f /opt/redis-stack/lib/redistimeseries.so ']' + exec_cmd='exec redis-server /etc/redis/redis.conf --loadmodule /opt/redis-stack/lib/redisearch.so --loadmodule /opt/redis-stack/lib/redistimeseries.so ' + '[' -f /opt/redis-stack/lib/rejson.so ']' + exec_cmd='exec redis-server /etc/redis/redis.conf --loadmodule /opt/redis-stack/lib/redisearch.so --loadmodule /opt/redis-stack/lib/redistimeseries.so --loadmodule /opt/redis-stack/lib/rejson.so ' + '[' -f /opt/redis-stack/lib/redisbloom.so ']' + exec_cmd='exec redis-server /etc/redis/redis.conf --loadmodule /opt/redis-stack/lib/redisearch.so --loadmodule /opt/redis-stack/lib/redistimeseries.so --loadmodule /opt/redis-stack/lib/rejson.so --loadmodule /opt/redis-stack/lib/redisbloom.so ' + '[' -f /opt/redis-stack/lib/redisgraph.so ']' + '[' -f /opt/redis-stack/lib/rediscompat.so ']' + exec_cmd='exec redis-server /etc/redis/redis.conf --loadmodule /opt/redis-stack/lib/redisearch.so --loadmodule /opt/redis-stack/lib/redistimeseries.so --loadmodule /opt/redis-stack/lib/rejson.so --loadmodule /opt/redis-stack/lib/redisbloom.so --loadmodule /opt/redis-stack/lib/rediscompat.so' + '[' -f /opt/redis-stack/lib/redisgears.so ']' + exec_cmd='exec redis-server /etc/redis/redis.conf --loadmodule /opt/redis-stack/lib/redisearch.so --loadmodule /opt/redis-stack/lib/redistimeseries.so --loadmodule /opt/redis-stack/lib/rejson.so --loadmodule /opt/redis-stack/lib/redisbloom.so --loadmodule /opt/redis-stack/lib/rediscompat.so --loadmodule /opt/redis-stack/lib/redisgears.so v8-plugin-path /opt/redis-stack/lib/libredisgears_v8_plugin.so ' + echo 'Starting redis server cmd: exec redis-server /etc/redis/redis.conf --loadmodule /opt/redis-stack/lib/redisearch.so --loadmodule /opt/redis-stack/lib/redistimeseries.so --loadmodule /opt/redis-stack/lib/rejson.so --loadmodule /opt/redis-stack/lib/redisbloom.so --loadmodule /opt/redis-stack/lib/rediscompat.so --loadmodule /opt/redis-stack/lib/redisgears.so v8-plugin-path /opt/redis-stack/lib/libredisgears_v8_plugin.so ' + eval 'exec redis-server /etc/redis/redis.conf --loadmodule /opt/redis-stack/lib/redisearch.so --loadmodule /opt/redis-stack/lib/redistimeseries.so --loadmodule /opt/redis-stack/lib/rejson.so --loadmodule /opt/redis-stack/lib/redisbloom.so --loadmodule /opt/redis-stack/lib/rediscompat.so --loadmodule /opt/redis-stack/lib/redisgears.so v8-plugin-path /opt/redis-stack/lib/libredisgears_v8_plugin.so ' ++ exec redis-server /etc/redis/redis.conf --loadmodule /opt/redis-stack/lib/redisearch.so --loadmodule /opt/redis-stack/lib/redistimeseries.so --loadmodule /opt/redis-stack/lib/rejson.so --loadmodule /opt/redis-stack/lib/redisbloom.so --loadmodule /opt/redis-stack/lib/rediscompat.so --loadmodule /opt/redis-stack/lib/redisgears.so v8-plugin-path /opt/redis-stack/lib/libredisgears_v8_plugin.so cluster logs running `kbcli cluster logs redis-ljzvzz --tail 30 --file-type=running --namespace ns-jcjpx ` error: get pod component definition name in cluster.yaml fail cluster expose check cluster status before ops check cluster status done cluster_status:Running `kbcli cluster expose redis-ljzvzz --auto-approve --force=true --type vpc --enable false --components redis --namespace ns-jcjpx ` OpsRequest redis-ljzvzz-expose-5p6b9 created successfully, you can view the progress: kbcli cluster describe-ops redis-ljzvzz-expose-5p6b9 -n ns-jcjpx check ops status `kbcli cluster list-ops redis-ljzvzz --status all --namespace ns-jcjpx ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME redis-ljzvzz-expose-5p6b9 ns-jcjpx Expose redis-ljzvzz redis Running 0/1 Jun 19,2025 19:44 UTC+0800 check cluster status `kbcli cluster list redis-ljzvzz --show-labels --namespace ns-jcjpx ` NAME NAMESPACE CLUSTER-DEFINITION VERSION TERMINATION-POLICY STATUS CREATED-TIME LABELS redis-ljzvzz ns-jcjpx WipeOut Running Jun 19,2025 18:16 UTC+0800 app.kubernetes.io/instance=redis-ljzvzz check cluster status done cluster_status:Running check pod status `kbcli cluster list-instances redis-ljzvzz --namespace ns-jcjpx ` NAME NAMESPACE CLUSTER COMPONENT STATUS ROLE ACCESSMODE AZ CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE NODE CREATED-TIME redis-ljzvzz-redis-0 ns-jcjpx redis-ljzvzz redis Running secondary us-west-2a 200m / 200m 644245094400m / 644245094400m data:2Gi ip-172-31-12-104.us-west-2.compute.internal/172.31.12.104 Jun 19,2025 19:29 UTC+0800 redis-ljzvzz-redis-1 ns-jcjpx redis-ljzvzz redis Running primary us-west-2a 200m / 200m 644245094400m / 644245094400m data:2Gi ip-172-31-8-116.us-west-2.compute.internal/172.31.8.116 Jun 19,2025 19:29 UTC+0800 redis-ljzvzz-redis-sentinel-0 ns-jcjpx redis-ljzvzz redis-sentinel Running us-west-2a 100m / 100m 512Mi / 512Mi data:1Gi ip-172-31-8-116.us-west-2.compute.internal/172.31.8.116 Jun 19,2025 19:15 UTC+0800 redis-ljzvzz-redis-sentinel-1 ns-jcjpx redis-ljzvzz redis-sentinel Running us-west-2a 100m / 100m 512Mi / 512Mi data:1Gi ip-172-31-12-104.us-west-2.compute.internal/172.31.12.104 Jun 19,2025 19:15 UTC+0800 redis-ljzvzz-redis-sentinel-2 ns-jcjpx redis-ljzvzz redis-sentinel Running us-west-2a 100m / 100m 512Mi / 512Mi data:1Gi ip-172-31-6-155.us-west-2.compute.internal/172.31.6.155 Jun 19,2025 19:15 UTC+0800 redis-ljzvzz-redis-twemproxy-0 ns-jcjpx redis-ljzvzz redis-twemproxy Running us-west-2a 100m / 100m 512Mi / 512Mi data:1Gi ip-172-31-2-181.us-west-2.compute.internal/172.31.2.181 Jun 19,2025 19:15 UTC+0800 redis-ljzvzz-redis-twemproxy-1 ns-jcjpx redis-ljzvzz redis-twemproxy Running us-west-2a 100m / 100m 512Mi / 512Mi data:1Gi ip-172-31-6-5.us-west-2.compute.internal/172.31.6.5 Jun 19,2025 19:15 UTC+0800 redis-ljzvzz-redis-twemproxy-2 ns-jcjpx redis-ljzvzz redis-twemproxy Running us-west-2a 100m / 100m 512Mi / 512Mi data:1Gi ip-172-31-8-95.us-west-2.compute.internal/172.31.8.95 Jun 19,2025 19:15 UTC+0800 check pod status done check cluster role check cluster role done primary: redis-ljzvzz-redis-1;secondary: redis-ljzvzz-redis-0 `kubectl get secrets -l app.kubernetes.io/instance=redis-ljzvzz` set secret: redis-ljzvzz-redis-account-default `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.username***"` `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.password***"` `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.port***"` DB_USERNAME_PROXY:;DB_PASSWORD_PROXY:;DB_PORT_PROXY:26379 DB_USERNAME:default;DB_PASSWORD:gu97Tl5m13;DB_PORT:6379;DB_DATABASE:db0 check cluster connect `echo 'echo "" | redis-cli -h redis-ljzvzz-redis-redis.ns-jcjpx.svc.cluster.local -p 6379 -a gu97Tl5m13' | kubectl exec -it redis-ljzvzz-redis-1 --namespace ns-jcjpx -- bash` check cluster connect done check ops status `kbcli cluster list-ops redis-ljzvzz --status all --namespace ns-jcjpx ` NAME NAMESPACE TYPE CLUSTER COMPONENT STATUS PROGRESS CREATED-TIME redis-ljzvzz-expose-5p6b9 ns-jcjpx Expose redis-ljzvzz redis Succeed 1/1 Jun 19,2025 19:44 UTC+0800 check ops status done ops_status:redis-ljzvzz-expose-5p6b9 ns-jcjpx Expose redis-ljzvzz redis Succeed 1/1 Jun 19,2025 19:44 UTC+0800 `kubectl patch -p '***"metadata":***"finalizers":[]***' --type=merge opsrequests redis-ljzvzz-expose-5p6b9 --namespace ns-jcjpx ` opsrequest.apps.kubeblocks.io/redis-ljzvzz-expose-5p6b9 patched `kbcli cluster delete-ops --name redis-ljzvzz-expose-5p6b9 --force --auto-approve --namespace ns-jcjpx ` OpsRequest redis-ljzvzz-expose-5p6b9 deleted `echo 'get mykey' | kbcli cluster connect redis-ljzvzz --namespace ns-jcjpx ` check data: Connect to instance redis-ljzvzz-redis-1: out of redis-ljzvzz-redis-1(primary), redis-ljzvzz-redis-0(secondary) Unable to use a TTY - input is not a terminal or the right kind of file Warning: Using a password with '-a' or '-u' option on the command line interface may not be safe. bxtif check cluster data consistent Success `kubectl get secrets -l app.kubernetes.io/instance=redis-ljzvzz` set secret: redis-ljzvzz-redis-account-default `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.username***"` `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.password***"` `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.port***"` DB_USERNAME_PROXY:;DB_PASSWORD_PROXY:;DB_PORT_PROXY:26379 DB_USERNAME:default;DB_PASSWORD:gu97Tl5m13;DB_PORT:6379;DB_DATABASE:db0 `echo "echo \"get mykey\" | redis-cli -h 127.0.0.1 -p 6379 -a gu97Tl5m13 " | kubectl exec -it redis-ljzvzz-redis-0 --namespace ns-jcjpx -- bash ` check readonly data: Defaulted container "redis" out of: redis, metrics, lorry, init-lorry (init) Unable to use a TTY - input is not a terminal or the right kind of file Warning: Using a password with '-a' or '-u' option on the command line interface may not be safe. bxtif check cluster readonly data consistent Success check db_client batch data count `echo 'get executions_loop_key' | kbcli cluster connect redis-ljzvzz --namespace ns-jcjpx ` check db_client batch data Success `kubectl get secrets -l app.kubernetes.io/instance=redis-ljzvzz` set secret: redis-ljzvzz-redis-account-default `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.username***"` `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.password***"` `kubectl get secrets redis-ljzvzz-redis-account-default -o jsonpath="***.data.port***"` DB_USERNAME_PROXY:;DB_PASSWORD_PROXY:;DB_PORT_PROXY:26379 DB_USERNAME:default;DB_PASSWORD:gu97Tl5m13;DB_PORT:6379;DB_DATABASE:db0 check readonly db_client batch data count `echo "echo \"get executions_loop_key\" | redis-cli -h 127.0.0.1 -p 6379 -a gu97Tl5m13 " | kubectl exec -it redis-ljzvzz-redis-0 --namespace ns-jcjpx -- bash ` check readonly db_client batch data Success delete cluster redis-ljzvzz `kbcli cluster delete redis-ljzvzz --auto-approve --namespace ns-jcjpx ` Cluster redis-ljzvzz deleted pod_info:redis-ljzvzz-redis-0 3/3 Running 0 15m redis-ljzvzz-redis-1 3/3 Running 0 15m redis-ljzvzz-redis-sentinel-0 2/2 Running 0 29m redis-ljzvzz-redis-sentinel-1 2/2 Running 0 29m redis-ljzvzz-redis-sentinel-2 2/2 Running 0 29m redis-ljzvzz-redis-twemproxy-0 1/1 Running 0 29m redis-ljzvzz-redis-twemproxy-1 1/1 Running 0 29m redis-ljzvzz-redis-twemproxy-2 1/1 Running 0 29m pod_info:redis-ljzvzz-redis-twemproxy-0 1/1 Terminating 0 29m redis-ljzvzz-redis-twemproxy-1 1/1 Terminating 0 29m redis-ljzvzz-redis-twemproxy-2 1/1 Terminating 0 29m No resources found in ns-jcjpx namespace. delete cluster pod done No resources found in ns-jcjpx namespace. check cluster resource non-exist OK: pvc No resources found in ns-jcjpx namespace. delete cluster done No resources found in ns-jcjpx namespace. No resources found in ns-jcjpx namespace. No resources found in ns-jcjpx namespace. Redis Test Suite All Done! --------------------------------------Redis (Topology = replication Replicas 2) Test Result-------------------------------------- [PASSED]|[Create]|[ClusterDefinition=redis;ClusterVersion=redis-7.2.7;]|[Description=Create a cluster with the specified cluster definition redis and cluster version redis-7.2.7] [PASSED]|[Connect]|[ComponentName=redis]|[Description=Connect to the cluster] [PASSED]|[AddData]|[Values=bxtif]|[Description=Add data to the cluster] [PASSED]|[CheckAddDataReadonly]|[Values=bxtif;Role=Readonly]|[Description=Add data to the cluster readonly] [PASSED]|[Expose]|[Enable=true;TYPE=vpc;ComponentName=redis]|[Description=Expose Enable the vpc service with redis component] [PASSED]|[Failover]|[HA=Full CPU Failover;Durations=2m;ComponentName=redis]|[Description=Simulates conditions where pods experience CPU full either due to expected/undesired processes thereby testing the application's resilience to potential slowness/unavailability of some replicas due to high CPU load.] [PASSED]|[Failover]|[HA=Network Bandwidth Failover;Durations=2m;ComponentName=redis]|[Description=Simulates network bandwidth fault thereby testing the application's resilience to potential slowness/unavailability of some replicas due to bandwidth network.] [PASSED]|[VolumeExpansion]|[ComponentName=redis]|[Description=VolumeExpansion the cluster specify component redis] [PASSED]|[Failover]|[HA=Network Corrupt Failover;Durations=2m;ComponentName=redis]|[Description=Simulates network corrupt fault thereby testing the application's resilience to potential slowness/unavailability of some replicas due to corrupt network.] [PASSED]|[Failover]|[HA=Delete Pod;ComponentName=redis]|[Description=Simulates conditions where pods terminating forced/graceful thereby testing deployment sanity (replica availability & uninterrupted service) and recovery workflow of the application.] [FAILED]|[Bench]|[ComponentName=redis]|[Description=Bench the cluster service with redis component] [PASSED]|[Bench]|[Component redis-twemproxy]|[Description=Bench the cluster service] [FAILED]|[Bench]|[HostType=LB;ComponentName=redis]|[Description=Bench the cluster LB service with redis component] [PASSED]|[Restart]|[-]|[Description=Restart the cluster] [SKIPPED]|[Failover]|[HA=Evicting Pod;ComponentName=redis]|[Description=Simulates conditions where pods evicting either due to node drained thereby testing the application's resilience to unavailability of some replicas due to evicting.] [PASSED]|[Failover]|[HA=Network Loss Failover;Durations=2m;ComponentName=redis]|[Description=Simulates network loss fault thereby testing the application's resilience to potential slowness/unavailability of some replicas due to loss network.] [PASSED]|[Failover]|[HA=Pod Failure;Durations=2m;ComponentName=redis]|[Description=Simulates conditions where pods experience failure for a period of time either due to expected/undesired processes thereby testing the application's resilience to potential slowness/unavailability of some replicas due to failure.] [PASSED]|[Check Monitor]|[Enable=true]|[Description=Check Monitor Enable] [PASSED]|[Update]|[Monitor=true]|[Description=Update the cluster Monitor enable] [PASSED]|[Failover]|[HA=DNS Error;Durations=2m;ComponentName=redis]|[Description=Simulates conditions where pods experience DNS service errors for a period of time either due to expected/undesired processes thereby testing the application's resilience to potential slowness/unavailability of some replicas due to DNS service errors.] [PASSED]|[HorizontalScaling Out]|[ComponentName=redis]|[Description=HorizontalScaling Out the cluster specify component redis] [PASSED]|[HorizontalScaling In]|[ComponentName=redis]|[Description=HorizontalScaling In the cluster specify component redis] [PASSED]|[Failover]|[HA=OOM;Durations=2m;ComponentName=redis]|[Description=Simulates conditions where pods experience OOM either due to expected/undesired processes thereby testing the application's resilience to potential slowness/unavailability of some replicas due to high Memory load.] [PASSED]|[Failover]|[HA=Time Offset;Durations=2m;ComponentName=redis]|[Description=Simulates a time offset scenario thereby testing the application's resilience to potential slowness/unavailability of some replicas due to time offset.] [PASSED]|[Failover]|[HA=Connection Stress;ComponentName=redis]|[Description=Simulates conditions where pods experience connection stress either due to expected/undesired processes thereby testing the application's resilience to potential slowness/unavailability of some replicas due to high Connection load.] [PASSED]|[Reconfiguring]|[ComponentName=redis;maxclients=10001]|[Description=Reconfiguring the cluster specify component redis set maxclients=10001] [PASSED]|[Update]|[Logs=Enable]|[Description=Update the cluster Logs enable] [PASSED]|[Stop]|[-]|[Description=Stop the cluster] [PASSED]|[Start]|[-]|[Description=Start the cluster] [FAILED]|[Failover]|[HA=Network Delay;Durations=2m;ComponentName=redis]|[Description=Simulates network delay fault thereby testing the application's resilience to potential slowness/unavailability of some replicas due to delay network.] [PASSED]|[Failover]|[HA=Network Duplicate;Durations=2m;ComponentName=redis]|[Description=Simulates network duplicate fault thereby testing the application's resilience to potential slowness/unavailability of some replicas due to duplicate network.] [PASSED]|[Failover]|[HA=DNS Random;Durations=2m;ComponentName=redis]|[Description=Simulates conditions where pods experience random IP addresses being returned by the DNS service for a period of time either due to expected/undesired processes thereby testing the application's resilience to potential slowness/unavailability of some replicas due to the DNS service returning random IP addresses.] [PASSED]|[Failover]|[HA=Kill 1;ComponentName=redis]|[Description=Simulates conditions where process 1 killed either due to expected/undesired processes thereby testing the application's resilience to unavailability of some replicas due to abnormal termination signals.] [PASSED]|[Failover]|[HA=Network Partition;Durations=2m;ComponentName=redis]|[Description=Simulates network partition fault thereby testing the application's resilience to potential slowness/unavailability of some replicas due to partition network.] [PASSED]|[VerticalScaling]|[ComponentName=redis]|[Description=VerticalScaling the cluster specify component redis] [PASSED]|[Update]|[TerminationPolicy=WipeOut]|[Description=Update the cluster TerminationPolicy WipeOut] [PASSED]|[Backup]|[BackupMethod=volume-snapshot]|[Description=The cluster volume-snapshot Backup] [PASSED]|[Restore]|[BackupMethod=volume-snapshot]|[Description=The cluster volume-snapshot Restore] [PASSED]|[Connect]|[ComponentName=redis]|[Description=Connect to the cluster] [PASSED]|[Delete Restore Cluster]|[BackupMethod=volume-snapshot]|[Description=Delete the volume-snapshot restore cluster] [PASSED]|[Backup]|[Schedule=true;BackupMethod=datafile]|[Description=The cluster Schedule datafile Backup] [PASSED]|[Restore]|[Schedule=true;BackupMethod=datafile]|[Description=The cluster Schedule datafile Restore] [PASSED]|[Connect]|[ComponentName=redis]|[Description=Connect to the cluster] [PASSED]|[Delete Restore Cluster]|[Schedule=true;BackupMethod=datafile]|[Description=Delete the Schedule datafile restore cluster] [PASSED]|[Backup]|[BackupMethod=datafile]|[Description=The cluster datafile Backup] [PASSED]|[Restore]|[BackupMethod=datafile]|[Description=The cluster datafile Restore] [PASSED]|[Connect]|[ComponentName=redis]|[Description=Connect to the cluster] [PASSED]|[Delete Restore Cluster]|[BackupMethod=datafile]|[Description=Delete the datafile restore cluster] [PASSED]|[RebuildInstance]|[ComponentName=redis]|[Description=Rebuild the cluster instance specify component redis] [PASSED]|[Expose]|[Disable=true;TYPE=vpc;ComponentName=redis]|[Description=Expose Disable the vpc service with redis component] [PASSED]|[Delete]|[-]|[Description=Delete the cluster] [END]