Flide 发布决策模型推理引擎较 vLLM 提速 9.5 倍

原标题：Show HN: Flide: Make Jev-like decision models up to 9.5x faster

62AI 研判分

Flide 是一款面向 Jev 类决策模型的高性能精确推理引擎，借助精确状态分叉实现较 vLLM 与 SGLang 最高 9.5 倍加速，并保证输出与单次独立推理完全一致。它已支持 30 多个本地决策模型，提供 /v1/systemone 接口，可通过 pip 直接安装。

关联知识实体

模型JEV-35B 工具vLLM 术语精确状态分叉工具Flide 工具SGLang

报道正文

本文目录2 个章节

News · Quick start · Models · Options

Flide is fast inference infrastructure for Jev-style decision models. With exact state forking it is up to 9.5 times faster than vLLM and SGLang, and every answer is the one the model gives the question alone. It serves the Jev /v1/systemone API.

🔥 News

🔥 2026-11-09 We added Ainvest-Decision, Darwin-27B-RSI-Decision and KnowLine-31B-Gen1.5 in Flide 0.1.10, and the KnowLine family now reads images.
🔥 2026-11-09 We added pplx-decider-v1.1-27b and JEV-35B in Flide 0.1.9, and /v1/systemone now takes several requests in one body.
🔥 2026-11-08 We added two decision model families in Flide 0.1.8, including AutoTrust and Clef, and also drex-max-v1.

<details><summary>Earlier news</summary>

🔥 2026-11-02 We released our paper Flide: Accelerating Decision Inference with Exact State Forking on arXiv.
🔥 2026-10-29 We added three decision model families in Flide 0.1.7, including SynACK Decide, Wald and Xor, and Gemma 4 mixture-of-experts models such as KnowLine-26B-A4B.
🔥 2026-10-29 We added two decision model families in Flide 0.1.6, including Drex and KnowLine, and flide verify checks exact forking on your own model and requests.
🔥 2026-10-28 We added six decision model families in Flide 0.1.5, including Jeffan, JevAny, Kev, Lychee, pplx-decider and StartLux, and images for Lumma and mammoth.
🔥 2026-10-26 We added five decision model families in Flide 0.1.4, including cerno, JADE, Linne, mammoth and Sieve, and also Quyet-1.0-Large.
🔥 2026-10-26 We added eight decision model families in Flide 0.1.3, including AJev, Bespoke-Nimble, Darwin, jiwo, Lumma, mogan, Quyet and Senova, and LoRA adapters now serve as they are.
🔥 2026-10-25 We added two decision model families in Flide 0.1.2, including Intern-Decision and torchcast, and a question now takes up to 256 options.
🔥 2026-10-24 We released Flide 0.1.0 on PyPI, serving Qwen3.5 and Gemma 4 chat models and the OneJev and Open-Jev decision models. Welcome to have a try.

</details>

Quick start

BASH

uv venv -p 3.12 && source .venv/bin/activate
uv pip install flide torchvision
flide serve --model OmniJev/OneJev1.6-0.8B

Any model in the model table starts the same way, for example Perplexity's decision model.

BASH

flide serve --model perplexity-ai/pplx-decider-flash-v1.2

Every one of them answers this request.

BASH

curl http://localhost:8000/v1/systemone -H "Content-Type: application/json" -d '{
  "state": "Order #1182 arrived with a cracked screen. The customer asks for a refund and attached two photos.",
  "questions": {
    "action": {"type": "choice", "instructions": "What should support do next?",
               "criteria": {"refund": "refund the order", "replace": "send a replacement", "escalate": "ask a human"}},
    "urgent": {"type": "noul", "instructions": "Does this need a reply within the hour?"}
  }
}'

See the docs for every model, images, the API and all options.

（注：更多技术实现细节与完整 API 文档请查阅原项目 README）

作者发帖说明（HN）：

Decision models need their own inference engine.

So we developed Flide, a high-performance and exact inference engine for Jev-like decision models.

Flide achieves up to a 9.5x speedup over vLLM and SGLang.

It now supports 30+ popular local Jev-like decision models.

Start to make your decision immediately:

pip install flide