Open-source tool for running and managing local large language models with a simple CLI and API.
Datasette-llm, the intermediate plugin that configures LLMs for other Datasette plugins, released version 0.1a11 with support for OpenAI-compatible endpoints. Users can now point Datasette at any service speaking the OpenAI pseudo-standard protocol, including local backends like LM Studio, Ollama and llama.cpp, to power a Datasette Agent entirely on local models.
llmtee is a self-hosted proxy for OpenAI, Anthropic and OpenAI-compatible providers like OpenRouter, Ollama, vLLM and Groq that logs tokens, cost, latency and time to first token for every request simply by pointing a client's base URL at it. It ships as a single Go binary with SQLite, enforces per-key daily and monthly budgets with HTTP 429, and exposes data via web UI, CSV, Prometheus and an MCP server.