Roadmap
CoreValue milestone status — M0–M4 shipped, M5+ upcoming
This page tracks the CoreValue AI Gateway roadmap. Features listed as "Shipped" are documented in these docs. Features listed as "Upcoming" are not yet shipped — documentation will be added as each milestone ships.
Shipped (M0–M4)
| Milestone | Status | Summary |
|---|---|---|
| M0 — Correctness | ✅ Shipped | Inline cost calculation, request dimensions, response headers (Cova-Request-Cost, Cova-Provider, Cova-Model, Cova-Id, Cova-Status) |
| M1 — Unify | ✅ Shipped | Merged w2 gates (disallow list, budget gate), escrow finalization, request validation |
| M2 — Parity | ✅ Shipped | Response format mapping (6 transforms), Responses API support, GET /v1/models, 18 provider prefixes, prompt expansion (Cova-Prompt-Id) |
| M3 — Cutover | ✅ Shipped | Worker decommissioned — Hono gateway (gateway/src/) is the sole LLM request path |
| M4 — SDK + Competitor Gaps | ✅ Shipped | @cova/gateway SDK (TypeScript + Python), cross-provider translation (opt-in), fallback chains (Cova-Fallbacks), streaming FinOps (final SSE frame + /meta endpoint), semantic cache (flag deferred) |
Upcoming (M5+)
| Milestone | Status | Summary |
|---|---|---|
| M5 — MCP: Proxy + Logging | ⬜ Not started | MCP proxy path, tool-call logging, cost attribution, rate limit, billing hooks |
| M6 — MCP: Registry + Aggregation | ⬜ Not started | MCP server registry, unified endpoint, tool discovery/filtering, upstream credential injection |
| M6.1 — MCP SDK slice | ⬜ Not started | @cova/gateway mcp.* helpers (connection + listServers/listTools + logs) |
| M6.5 — Teams & Departments | ⬜ Not started | team + team_member tables, key/user → team association |
| M7 — MCP: Governance | ⬜ Not started | RBAC (team/user → server/tool), security guards (PII/DLP, prompt-injection) |
| M8 — FinOps Foundations | ⬜ Not started | Key limits, ClickHouse team_id/customer_id/feature_id columns, backfill, header validation |
| M9 — Enforcement | ⬜ Not started | Budget enforcement, key limits, model/provider restrictions |
| M10 — Reporting | ⬜ Not started | Cost reports, usage analytics, alerting |
Feature Flags
The following feature flags control gateway behavior. All default OFF unless noted.
| Flag | Default | Purpose |
|---|---|---|
RESPONSE_MAPPING_ENABLED | OFF | Response format mapping (M2 0.4) |
CROSS_PROVIDER_TRANSLATION_ENABLED | OFF | Cross-provider translation (M4) |
SEMANTIC_CACHE_ENABLED | OFF | Semantic caching (M4, implementation deferred) |
BUDGET_GATE_ENABLED | OFF | Budget gate (M1) |
DISALLOW_LIST_ENABLED | OFF | Disallow list (M1) |
ESCROW_ENABLED | OFF | Escrow finalization (M1) |
Full Roadmap
For full milestone details, acceptance criteria, and design decisions, see the ROADMAP.md file in the repository.