doris-debug-cloud
Use for Doris storage-compute separation (cloud mode) issues: meta-service latency, cache miss storms, object store throughput, and shared-nothing config conflicts in compute groups.
How do I install this agent skill?
npx skills add https://github.com/apache/doris-skills --skill doris-debugIs this agent skill safe to install?
- Gen Agent Trust Hubpass
This skill provides a structured diagnostic framework for Apache Doris production environments. It focuses on identifying and resolving issues related to queries, imports, and node health using standard database administrative tools.
- Socketpass
No alerts
- Snykpass
Risk: LOW · No issues
What does this agent skill do?
Cloud (Storage-Compute Separation)
Before proceeding
Confirm cloud mode. Shared-nothing cluster commands (disk rebalance, clone, local tablet repair) are meaningless in cloud mode. Check:
SHOW FRONTENDS\G -- IsCloudMode field (Doris 3.0+)
Or inspect fe.conf for cloud_unique_id or meta_service_endpoint.
Causes
| ID | Cause | Evidence | Source anchor |
|---|---|---|---|
| A | Meta-service latency | High P99 on SHOW PROC / DDL; meta-service RPC spikes | MetaServiceClient.java |
| B | Cache miss storm | local_cache_hit_ratio near 0; high S3 GET rate post-ingest | FileCache.cpp |
| C | Object store throughput saturation | S3 throttle errors (503 SlowDown); Throughput limit exceeded | S3FileSystem.cpp |
| D | Compute group imbalance | One compute group idle, another overloaded | ComputeGroupMgr.java |
| E | Wrong config for cloud mode | BE OOM from shared-nothing compaction knobs applied in cloud | cloud vs local config divergence |
10 min triage
-- Compute group status
SHOW COMPUTE GROUPS\G
-- File cache hit ratio (Doris 3.0+)
SELECT * FROM information_schema.file_cache_stats;
# BE cache metrics
./scripts/doris-debug be-metrics --be http://$BE:8040 --grep "file_cache|local_cache"
# Object store errors in BE log
./scripts/doris-debug log-grep be/log --query-id "$QID"
grep -r "SlowDown\|503\|Throughput.*exceed" be/log/
Cause A — Meta-service latency
In cloud mode, SHOW PROC and DDL go through the meta-service layer, not direct BDBJE. Latency spikes often come from:
- Meta-service RPC overload — check
meta_service_rpc_timeout_msin fe.conf SHOW PROC '/cluster_health'on a large cluster — walks every tablet via meta-service
# Check meta-service health
curl -s "http://$MS_HOST:$MS_PORT/api/health"
Cause B — Cache miss storm
After bulk ingest (INSERT INTO SELECT or Stream Load), the file cache on compute BEs is cold. First query after ingest hits S3 directly — expect 3-10× latency.
-- Pre-warm cache after bulk ingest
SELECT COUNT(*) FROM new_table; -- full scan populates file cache
Tune cache capacity:
# be.conf — file cache in cloud mode
file_cache_path = [{"path":"/nvme0/file_cache","total_size":536870912000,"query_limit":107374182400}]
file_cache_type = whole_file_cache # or sub_file_cache for column-level
Cause C — Object store throttling
S3 has per-prefix request rate limits (~3500 PUT/GET per second per prefix). For high-concurrency cloud workloads:
# be.conf
s3_max_connections = 256 # increase parallel connections
s3_request_timeout_ms = 30000 # increase timeout
Consider sub_file_cache for cold tables with large Parquet files — reduces S3 list/get calls.
Key differences from shared-nothing
| Shared-nothing config | Cloud mode equivalent | Notes |
|---|---|---|
storage_root_path | file_cache_path | Local disk is cache only |
SHOW PROC '/backends' disk | File cache usage | Data durability is in object store |
| Clone / balance | N/A | No tablet migration |
max_tablet_version_num | Still relevant | Compaction runs on compute nodes |
compaction_* knobs | Still relevant | Tune per compute group capacity |
Source
fe/.../cloud/ComputeGroupMgr.javafe/.../cloud/MetaServiceClient.javabe/src/io/fs/s3/S3FileSystem.cppbe/src/io/cache/whole_file_cache.cppbe/src/io/cache/sub_file_cache.cpp
How can the creator link this skill?
Add the canonical catalog link to the repository README so users can inspect current installs and available audits. The publishing guide covers the complete discovery path.
<a href="https://skillzs.dev/skills/apache/doris-skills/doris-debug">View doris-debug-cloud on skillZs</a>