Hacker News AIT2·Tools
62 pts
llmtee is a self-hosted proxy for OpenAI, Anthropic and OpenAI-compatible providers like OpenRouter, Ollama, vLLM and Groq that logs tokens, cost, latency and time to first token for every request simply by pointing a client's base URL at it. It ships as a single Go binary with SQLite, enforces per-key daily and monthly budgets with HTTP 429, and exposes data via web UI, CSV, Prometheus and an MCP server.