Flide Launches Inference Engine for Decision Models, Up to 9.5x Faster Than vLLM

News · Quick start · Models · Options

Flide is fast inference infrastructure for Jev-style decision models. With exact state forking it is up to 9.5 times faster than vLLM and SGLang, and every answer is the one the model gives the question alone. It serves the Jev /v1/systemone API.

🔥 News

• 🔥 2026-11-09 We added Ainvest-Decision, Darwin-27B-RSI-Decision and KnowLine-31B-Gen1.5 in Flide 0.1.10, and the KnowLine family now reads images.
• 🔥 2026-11-09 We added pplx-decider-v1.1-27b and JEV-35B in Flide 0.1.9, and /v1/systemone now takes several requests in one body.
• 🔥 2026-11-08 We added two decision model families in Flide 0.1.8, including AutoTrust and Clef, and also drex-max-v1.

• 🔥 2026-11-02 We released our paper Flide: Accelerating Decision Inference with Exact State Forking on arXiv.
• 🔥 2026-10-29 We added three decision model families in Flide 0.1.7, including SynACK Decide, Wald and Xor, and Gemma 4 mixture-of-experts models such as KnowLine-26B-A4B.
• 🔥 2026-10-29 We added two decision model families in Flide 0.1.6, including Drex and KnowLine, and flide verify checks exact forking on your own model and requests.
• 🔥 2026-10-28 We added six decision model families in Flide 0.1.5, including Jeffan, JevAny, Kev, Lychee, pplx-decider and StartLux, and images for Lumma and mammoth.
• 🔥 2026-10-26 We added five decision model families in Flide 0.1.4, including cerno, JADE, Linne, mammoth and Sieve, and also Quyet-1.0-Large.
• 🔥 2026-10-26 We added eight decision model families in Flide 0.1.3, including AJev, Bespoke-Nimble, Darwin, jiwo, Lumma, mogan, Quyet and Senova, and LoRA adapters now serve as they are.
• 🔥 2026-10-25 We added two decision model families in Flide 0.1.2, including Intern-Decision and torchcast, and a question now takes up to 256 options.
• 🔥 2026-10-24 We released Flide 0.1.0 on PyPI, serving Qwen3.5 and Gemma 4 chat models and the OneJev and Open-Jev decision models. Welcome to have a try.

Quick start

uv venv -p 3.12 && source .venv/bin/activate
uv pip install flide torchvision
flide serve --model OmniJev/OneJev1.6-0.8B

Any model in the model table starts the same way, for example Perplexity's decision model.

flide serve --model perplexity-ai/pplx-decider-flash-v1.2

Every one of them answers this request.

curl http://localhost:8000/v1/systemone -H "Content-Type: application/json" -d '{
  "state": "Order #1182 arrived with a cracked screen. The customer asks for a refund and attached two photos.",
  "questions": {
    "action": {"type": "choice", "instructions": "What should support do next?",
               "criteria": {"refund": "refund the order", "replace": "send a replacement", "escalate": "ask a human"}},
    "urgent": {"type": "noul", "instructions": "Does this need a reply within the hour?"}
  }
}'

See the docs for every model, images, the API and all options.

（注：更多技术实现细节与完整 API 文档请查阅原项目 README）

作者发帖说明（HN）：

Decision models need their own inference engine.

So we developed Flide, a high-performance and exact inference engine for Jev-like decision models.

Flide achieves up to a 9.5x speedup over vLLM and SGLang.

It now supports 30+ popular local Jev-like decision models.

Start to make your decision immediately:

pip install flide