Rohan Paul (@rohanpaul_ai) · 2026/10/15 21:15:27
TypeLLM 开源工作流模型：基于 SGLang 约束解码实现单 API 调用类型安全执行
TypeLLM 推出首个“工作流模型”，允许开发者通过单个 JSON Schema 定义复杂依赖关系，并在一次 API 调用中完成整个工作流执行。该工具底层集成 SGLang，利用约束解码技术确保输出严格符合枚举、数值范围等类型定义，无需修改模型权重即可在 Qwen 等开源模型上获得类型安全的结构化输出。
报道全文原始报道全文
Rohan Paul (@rohanpaul_ai) · 2026-10-15 13
Open source meets type-safe AI, with TypeLLM.
Chat models give you a reply and decision models give you a choice, but TypeLLM is built to run your whole workflow in one API call.
Most production pipelines need something in between: several typed answers, some depending on others, a few that should exist only under certain conditions.
TypeLLM takes that whole shape as one JSON Schema and executes it as a dependency graph over a single shared context.
Typed LLM outputs, built in the open.
You can get schema-guaranteed outputs from a stock Qwen checkpoint without touching its weights.
The guarantee comes from how the requests are built and decoded.
TypeLLM sits on SGLang and turns a JSON Schema into constrained decoding: one scored token for an enum or boolean, bounded digits for numbers, and a dependency graph that reuses cached prefixes.
So a field can’t return a value outside its enum, because the decoder only considers the allowed candidates.
↳ 引用 @TypeLLM (TypeLLM): Chat models return messages.
Decision models return decisions.
Workflow models execute workflows.
TypeLLM introduces the first workflow model. Run an entire workflow in a single API call.
Simpler, faster, cheaper.
Try it now: https://typellm.ai/examples/ticket-workflow
