omni-cache
Manage the LLM response cache. View cache statistics, clear entries, configure TTL policies, and control semantic-similarity caching thresholds.
How do I install this agent skill?
npx skills add https://github.com/cheaper-inference/omniroute --skill omni-cacheIs this agent skill safe to install?
- Socketpass
No alerts
- Snykpass
Risk: LOW · No issues
- Gen Agent Trust Hubpass
The skill provides standard documentation and command examples for managing a local LLM cache via an API. No security risks were identified.
What does this agent skill do?
Overview
Manage the LLM response cache. View cache statistics, clear entries, configure TTL policies, and control semantic-similarity caching thresholds.
Authentication
All requests require a valid Bearer token or session cookie. Obtain a token via POST /api/auth/login or configure REQUIRE_API_KEY=false for local development.
Endpoints
GET /api/cache
Get cache statistics
curl http://localhost:20128/api/cache \
-H "Authorization: Bearer $OMNIROUTE_TOKEN"
DELETE /api/cache
Clear all caches
curl -X DELETE http://localhost:20128/api/cache \
-H "Authorization: Bearer $OMNIROUTE_TOKEN"
GET /api/cache/stats
Get detailed cache statistics
Returns detailed statistics for all cache layers.
curl http://localhost:20128/api/cache/stats \
-H "Authorization: Bearer $OMNIROUTE_TOKEN"
DELETE /api/cache/stats
Clear cache statistics
curl -X DELETE http://localhost:20128/api/cache/stats \
-H "Authorization: Bearer $OMNIROUTE_TOKEN"
GET /api/cache/entries
GET cache › entries
curl http://localhost:20128/api/cache/entries \
-H "Authorization: Bearer $OMNIROUTE_TOKEN"
DELETE /api/cache/entries
DELETE cache › entries
curl -X DELETE http://localhost:20128/api/cache/entries \
-H "Authorization: Bearer $OMNIROUTE_TOKEN"
GET /api/cache/reasoning
GET cache › reasoning
curl http://localhost:20128/api/cache/reasoning \
-H "Authorization: Bearer $OMNIROUTE_TOKEN"
DELETE /api/cache/reasoning
DELETE cache › reasoning
curl -X DELETE http://localhost:20128/api/cache/reasoning \
-H "Authorization: Bearer $OMNIROUTE_TOKEN"
Payloads
See the full OpenAPI specification at GET /api/openapi/spec or docs/openapi.yaml for detailed request/response schemas.
How can the creator link this skill?
Add the canonical catalog link to the repository README so users can inspect current installs and available audits. The publishing guide covers the complete discovery path.
<a href="https://skillzs.dev/skills/cheaper-inference/omniroute/omni-cache">View omni-cache on skillZs</a>