
Request path
- ConsoleNext.js
- GatewayFastAPI
- ProviderOpenAI · Gemini
- StreamRedis Streams
- Workeridempotent
- StorePostgreSQL
InferLens
See what every LLM request costs.
A provider-agnostic LLM gateway with streaming, fallback and traces for comparing latency, tokens and estimated cost.
- SSE streaming, cancellation, bounded retries, provider fallback and circuit-breaker recovery
- Event-driven logging through Redis Streams, background workers and dead-letter recovery
- Console for traces, replay and side-by-side provider comparisons





