Simon Willison 博客T2·开发与工程

Datasette-llm 0.1a11 支持 OpenAI 兼容端点

原标题：datasette-llm 0.1a11

42AI 研判分

Datasette 的中间层插件 datasette-llm 发布 0.1a11 版本，新增对 OpenAI 兼容端点的支持，可将 Datasette 配置为调用任意遵循该协议的模型服务。这意味着用户能通过 LM Studio、Ollama 或 llama.cpp 等本地推理后端驱动 Datasette Agent，实现完全本地化的数据对话查询。

关联知识实体

工具Datasette 工具LM Studio 术语OpenAI 兼容端点工具llama.cpp 工具Ollama 工具datasette-llm

报道正文

datasette-llm is the intermediate plugin for Datasette that supports configuring LLMs for use with other Datasette plugins.

This release adds support for OpenAI-compatible endpoints, so you can configure Datasette to use an LLM hosted anywhere that talks the OpenAI pseudo-standard web protocol.

This means that if you're running local models with LM Studio or Ollama or llama.cpp (which just hit v1.0.0) you can run Datasette via uvx like this:

BASH

wget https://datasette.io/content.db

uvx --with datasette-agent datasette \
  --root --secret 1 \
  -s plugins.datasette-llm.default_model '{
    "model": "lmstudio-qwen",
    "model_name": "qwen/qwen3.8-27b",
    "api_base": "http://localhost:1234/v1"
  }' content.db

And you'll get a local server running a Datasette Agent instance powered by your local model!

Tags: uv, datasette-agent, llm, datasette, llms, ai, generative-ai