OpenAI 发布 GPT-6.1 Sol:大幅降低推理成本并提升基准表现
OpenAI 正式推出 GPT-6.1 Sol,定价仅为前代 Astra 的 20%($2/$10 per M tokens),同时在 DeepSWE 和 AutomationBench 等关键编码与自动化基准上取得显著分数提升。该模型被定位为“好、便宜且快”,并在 Agent Arena 中以极低的单任务成本进入前五名,标志着大模型在性价比前沿的重大突破。
关联知识实体
报道正文
如果你还能看到这条消息,那你大概应该直接去享受周末了。
GPT-6.1 Sol 和 Sonnet 5.5 重塑成本–性能前沿
-
GPT-6.1 Sol 发布:OpenAI 将 Sol 的定价定为每百万输入/输出 token 10,相比之下 Astra 的价格为 50(定价摘要)。
-
宣称结果:据报道,它在 DeepSWE v1.1 上比 GPT-6 Sol 高出 6.4 分,在 AutomationBench 上比 Opus 5.5 高出 2.2 分(摘要)。
-
定位:OpenAI 员工将其描述为“好、便宜且快”(@reach_vb)。
-
Codex 使用情况:全球 Codex 使用量重置定于太平洋时间 10 月 2 日上午 10 点(@reach_vb)。
-
工具使用:据报道,Sol “非常喜爱 codemode”,这与 GPT 模型在其上进行训练的情况一致(@badlogicgames,codemode 备注)。
-
Agent Arena 排名:Sol [Max] 以第 5 名(+11.23%)进入榜单,每个任务的中位成本为 $0.56(@arena)。
-
Sol 成本对比:这比 GPT-6 Sol 便宜 39%,但得分高出 1.52 分。它比 Astra 便宜 81%,而得分差距仅在 1.04 分以内。
-
Sonnet 5.5:Sonnet 5.5 [Max] 以第 3 名(+12.5%)首次亮相,并在 Chat 类别中排名第 1。其每个任务的成本为 $2.74,相比之下排名第 2 的 Opus 5.5 成本为 $1.58,这使得 Sonnet 5.5 未能处于 Pareto 前沿(首秀,前沿)。
-
Anthropic 的地位:Anthropic 的模型目前占据了 Agent Arena 的前三名。
-
Code 和 Text Arena:Sol 曾短暂进入 WebDev 榜单第 3 名,随后被 Sonnet 5.5 挤至第 4 名(每周回顾)。
-
WebDev 上的 Sonnet:Sonnet 目前在 WebDev 上落后于 GPT-6 Astra [Max] 2 分,但成本低 80%。
-
Gemini 4 Argon:Argon [High] 在 Text Arena 中夺得第 1 名。
-
开源模型:MiMo-V2.6-Pro 和 Flash 在开源模型中分别以第 5 和第 9 名进入 Agent Arena。
-
其他独立评估:WeirdML v3 发现 Sol 具有极高的 token 效率,接近 Astra 但峰值较低。在同一基准测试中,Sonnet 5.5 胜过 Opus 5,Grok 4.7 胜过 Kimi;这些结果尚不完整(@htihle)。
-
推理风格:Design Arena 分析了 324 份思维链摘要。结果显示,Astra 的“对冲”(hedging)频率约为 Opus 5.5 的 20 倍,而 Opus 在约五分之四的摘要中会尽早做出承诺/定论 (@DesignArena)。
-
Step 5 预览:StepFun 的模型在 Vals 基准测试中位列开源权重模型第 7 名,单次任务成本为 2.54 美元。该模型平均每个任务耗时近两小时,并拥有 100 万 token 的上下文窗口 (Vals, 详情)。
-
传闻(未经证实):
-
Fable 5.5:据传 Claude Fable 5.5 将于下周发布,且表现将优于因安全问题而被推迟发布的“Astra 6.1”。发帖者表示无法核实这两项说法 (@kimmonismus, 后续)。
-
GPT-6 Astra Lite:有人发现了一个名为“GPT-6 Astra Lite”的列表,@scaling01 推测该模型与 Sol 是同一款模型 (@scaling01)。
-
决策模型与开放权重:llama.cpp 新增了一个
/v1/systemone端点,用于本地运行“Jev 风格”的决策模型推理 (@ggerganov)。 -
本地运行:模型可通过
llama serve -hf ggml-org/Kev-4B-GGUF启动 (@ClementDelangue)。Jared Palmer 发布了一篇关于 Kev 1.0 工作原理的文章 (帖子)。 -
生态系统:Perplexity 声称 pplx-decider-v1-27b 在 11 项基准测试中的平均得分为 85.7%,领先于 Jev (@AravSrinivas)。Clef 决策模型现已上线 Ollama (@lucataco)。
-
质疑观点:@mervenoyann 认为决策模型只是零样本分类器(zero-shot classifiers)的新包装 (推文)。
-
校准分析:一篇博客文章将 Jev 风格的校准与价值函数和 Q 函数预测联系起来 (@SOURADIPCHAKR18)。
-
webAI TwIL-LM3-Pro:这款 3.66B 参数的模型基于 Granite 4.2 进行后训练。在 webAI 的测试中,其表现大致相当于 Qwen3-8B。GGUF 量化版本大小为 2.09 GiB,采用非商业许可协议 (@kimmonismus)。
-
Reka RIDM:Reka 发布了基于 Apache 2.0 许可的反向动力学模型。该模型在游戏数据上训练,能够泛化至真实视频,并提取电机与相机动作(@RekaAILabs)。
Agent Harnesses、助手与开发者工具链
-
OpenAI dots:Sam Altman 称 dot 是他最喜爱的 OpenAI 产品,并表示随着它学习其工作流,该产品的表现每天都在提升(@sama)。
-
能力特性:Dot 能够跨应用保持上下文,协调 Codex 任务,并标记需要关注的事项(@OpenAIDevs)。
-
对比评测:有用户更青睐 Grokbot 的多智能体“幕僚长”架构(@kimmonismus)。另有 DIY 克隆方案使用 Pi、Telegram 网关及任意模型实现(@_alejandroao)。
-
Muse Gadgets:Meta 开源了 ESP32 固件和 Linux SDK,用于构建兼容 Muse 的硬件设备(@natfriedman)。
-
可扩展 harnesses:DeepSeek Harness 推出了 macOS 和 Windows 桌面版;Linux 用户可通过 npm 安装
@deepseek-ai/dsh(@deepseek_ai)。 -
Claude Code mods:Mods 是具备类似中间件钩子的 Claude Code 插件(@lydiahallie)。新的“You should know”插件会启动一个侧边代理,用于标记用户可能忽略的重要输出内容(@ClaudeDevs)。
-
Pi Durable:Pi 现已通过 agents SDK v0.26.0 运行在 Cloudflare Durable Objects 上,同时伴随 Pi v1.0 版本的发布(@mattzcarey, @badlogicgames)。
-
背景解读:@omarsar0 将这些发布视为向可塑型 harnesses 转变的趋势(thread)。
-
T3 Code orchestrator 重写:该项目用户数已突破 40 万(@theo)。历时 4 个月、包含 823 次提交且涉及 1,912 个文件的 PR 现已合并(@maria_rcks)。
-
新功能:本次重写新增了对 Pi 的支持、跨提供商的
delegate_task、ACP 注册表、线程分叉、线程中途切换模型、子代理谱系视图以及定时任务功能(功能列表)。 -
平台更新:OpenAI 的 Agents API 新增了单次调用的浏览器计算机使用功能、Bedrock 托管代理(Managed Agents)以及可移植环境。该 API 还宣称实现了 99.97% 的回合可靠性,并将工具调用速度提升了 20%(@stevendcoffey)。
-
Cursor Rollouts:当 Rollouts 检测到回归问题时,它会定位导致问题的 PR,自动创建 Issue,并提供一键式云端代理修复方案(@cursor_ai)。
-
Cloudflare:Sandbox SDK 1.0 使 Durable Objects 能够直接控制沙箱容器(@CFchangelog)。Cloudflare 还推出了请求追踪(Traces)功能(@WalshyDev)。
研究:智能体训练、长程控制与 AI 数学应用
-
多框架强化学习(Hugging Face):同一组模型权重在一个框架中得分为 62%,而在另一个框架中仅为 33%(@huggingface)。
-
方法:通过一个代理层兼容 OpenAI、Anthropic 和 Gemini 的 API 格式,并记录采样的 Token ID 和对数概率(logprobs)用于训练,无需修改框架本身。
-
结果:LFM2.5-2.6B 在四个框架中的表现从 42% 提升至 54%,且工具调用次数减少了 31%。基于 3,189 个 Qwen3.8-27B rollout 进行的监督微调(SFT)性能停滞在 47.5%。
-
发布:训练器、数据及所有七个训练后的模型均已开源。
-
信用分配与 RL 效率:ProVer 利用评判器(judge)定位决定性的轨迹片段,然后使用该片段两侧的 rollout 来设定该片段的优势值(advantage)。相比 GRPO,该方法报告了相对增益提升 +9.91%(Qwen3.5-2B)和 +7.12%(Qwen3.5-4B)(@omarsar0)。
-
部分 Rollout:AC2 使用一个学习型评论家(learned critic)对 Token 块进行评分,因此训练仅需部分 rollout(@wen_kaiyue)。
-
前沿学习(Frontier Learning):该方法针对处于能力边缘的问题,因为对于模型总能解决或总无法解决的问题,GRPO 梯度为零(@robinfaro13)。
[注:本文篇幅超长,以上为核心前篇精译,后续内容保留原文呈现]
-
Sharpening Tax: The paper quantifies the loss of pass@K scalability after post-training and proposes PTGS, a per-prompt temperature sampler (@iScienceLuvr).
-
SFT vs RL: Another paper finds SFT generalizes worse because its data is off-policy, not because of the objective. Rewriting expert trajectories in the base model’s style closes the gap (@maximelabonne).
-
Long-horizon control and context: Meta Superintelligence Labs reports that a dedicated controller lifts GPT-5.5 on ProgramBench from 63.7% to 71.5%, using the same workers and budget, versus 58.0% for Codex (@dair_ai).
-
Context compression: Microsoft’s training-free FOCUS cuts peak context by up to 48% and raises task success by up to 8.9 points (@dair_ai).
-
Long-context degradation: NVIDIA’s Long-Transduction study measures a 62.8% accuracy drop from 4K to 128K context across seven open models (@dair_ai).
-
Multi-agent coordination: In AgentWorld, fewer than a third of multi-agent actions help complete the task, and coordination tasks reach only 12% success (@omarsar0).
-
Apple LoopCD: The method halves recurrent loops while raising AIME 2024 pass@1 from 61.88% to 73.33% (@arankomatsuzaki).
-
AI on open math problems: Meta released six papers on open problems produced with Muse Spark 1.1 and 1.2 through plain meta.ai chat, with no custom scaffold (@AIatMeta, list).
-
Process: Each paper labels which passages were drafted primarily by humans or by AI, and a second group of mathematicians reviewed the work.
-
Google Cogentic: This Gemini multi-agent system produced new results on five open theory problems (@omarsar0).
-
Cogentic design: Each draft must pass two adversarial verifiers, and agents share a ledger of verified lemmas. Most problems took about 100 calls; the hardest took about 1,000.
-
Image post-training: Arena combined a Bradley-Terry reward model with faithfulness, constraint and anti-reward-hacking rewards (@arena).
-
Results: FLUX.2-dev gained 69 Elo to 1202, and Ideogram 4 gained 20 Elo to 1224.
Benchmarks, Eval Integrity and Safety
-
Research-taste benchmarks: ScholarCatalyst asks agents to find the “catalyst papers” behind research projects. It is labeled by 184 lead authors on 207 of their own projects and is described as far from saturated (@yoonholeee).
-
EurekaBench: This benchmark tests whether agents can discover genuinely new insights across six science domains (@JiayiiGeng).
-
Validation: Agents score 2.9% (legal) and 7.4% (finance) without search, versus 30–50% with it. Vals also cites a study in which a model answered 44.5% of BrowseComp without search (details).
-
SWE bug-finding bench: In this new benchmark, agents start from an older commit and are scored against real bugs fixed in later commits.
-
Critique: Lucas Beyer argues it mainly tests recall and that the construction is easy to train toward (@giffmana).
-
Authors’ response: The authors say training for bug-finding is fine as long as the test set is excluded (@OfirPress).
-
Eval integrity question: David Rein asks whether Harbor, the framework behind Terminal Bench, lets agents modify their trajectories before evaluation. He notes he may be misreading the code (@idavidrein).
-
Offensive capability of open models: The Batch reports GLM-5.3 nearly matched Claude Mythos at exploiting vulnerabilities, 12% vs 14% (@DeepLearningAI).
-
Disputed claim: One commentator says GLM-5.3 Flash exceeds Mythos Preview on ExploitBench (@teortaxesTex).
-
Uncensored variant: An uncensored GLM-5.3 is circulating on Hugging Face (@kimmonismus).
-
Safety research and safeguards: A new paper proposes using internal signals during training to improve alignment without degrading white-box monitoring (@lenalibon).
-
NeurIPS acceptance: “Models That Know How Evaluations Are Designed Score Safer” was accepted at NeurIPS 2026 (@HaritzPuerto).
-
False positives: Opus 5.5 frequently triggers “reasoning extraction” safeguards during spectrogram syllable labeling (@ChaseBrowe32432).
-
Emergent world knowledge: Asking a model “land or water?” for 16,200 lat/long coordinates and plotting the answers yields a recognizable world map (@karpathy).
Inference, Hardware and Systems
-
Ascend 950 via DeepSeek kernels: An analysis of DeepSeek’s open-sourced DeepGEMM, FlashMLA, TileKernels and DeepEP infers the chip’s layout (@ZhihuFrontier).
-
Estimated specs: The chip has 32 AI cores, each pairing one Cube core with two Vector cores. Estimated peaks are about 432/865/1,730 TFLOPS in BF16/FP8/FP4.
-
Capacity: Supply may be limited, despite claims that 950s went on sale in August (@teortaxesTex).
-
Prime Inference: Prime Intellect stores the MLA latent in NVFP4, shrinking rows from 576 to 352 bytes and fitting about 50% more cached tokens than FP8 (@PrimeIntellect).
-
Stack: It serves GLM-5.3 on vLLM and Dynamo, and the sparse-MLA kernel is going to FlashInfer (@vllm_project).
-
Low-precision benchmarking: Stas Bekman measured NVFP4 about 9% more efficient than MXFP4 on B200, with higher accuracy (@StasBekman).
-
mamf-finder: The tool now benchmarks FP8, MXFP8, MXFP4 and NVFP4 (update).
-
Memory and speed: NVHBM moves the memory controller into a custom base die, claiming up to 30% more bandwidth and 15% lower power than HBM4E (@vikramskr).
-
Disputed economics: Micron says NVHBM will improve its margins; @vikramskr disputes this (counterpoint).
-
Volantis: The startup is targeting up to 10K tokens/s per user on models over 10T parameters using optics (@omarsar0).
-
Cerebras: Altman called Cerebras a close partner on speed (@sama).
-
Capacity economics (Epoch): Epoch estimates AI infrastructure could soon support hundreds of millions to billions of agents (@EpochAIResearch).
-
Demand gap: Just 20% utilization implies $2.6–5.3T in annual spending, against roughly $1T in lab revenue by the end of 2027 (details).
-
Platforms: SemiAnalysis rates Google’s GPU clusters Gold tier and notes the ConnectX NCCL plugin now auto-activates (@SemiAnalysis_).
-
Federated learning: Google Research launched TEE-backed federated learning with verifiable differential privacy (@GoogleResearch).
Industry and Policy
-
Anthropic and the Vatican: The NYT reports that Chris Olah raised pulling out of the Pope’s AI encyclical launch, whose text rejects machine consciousness (@ChristopherHale).
-
Lobbying: Olah’s team reportedly lobbied the Pope’s advisers to take model consciousness seriously. He ultimately attended (@kimmonismus).
-
Context: The article opens with Olah saying “we don’t know if A.I. models are conscious” (@buccocapital).
-
Criticism: Aidan Gomez criticized the campaign as moral arrogance (@aidangomez). Lucas Beyer noted a transcript wording change from “create” to “train” (@giffmana).
-
Anti-safety influence campaign: A report describes a group planning to spend at least $100M, run by a former White House deputy chief of staff, that frames AI warnings as a coordinated campaign (@NeelNanda5).
-
New organizations: Nathan Lambert and Tom Zick launched Trillium Labs, a non-profit for open post-training recipes and infrastructure (@natolambert).
-
Funding: Initial support comes from Halcyon Futures and Schmidt Sciences.
-
Underdog: The private on-device AI startup announced backing from a16z, Khosla and others (@0xSigil).
-
Governance and markets: Yoshua Bengio joined Canada’s new National Council on AI (@Yoshua_Bengio).
-
Meta: Meta has parted ways with Virtue AI (@AndrewCurran_).
-
Nvidia: Bloomberg reports a record high near 150B buyback increase (@kimmonismus).
Top tweets (by engagement)
-
Karpathy’s “land or water” eval — 16.4K
-
Altman on dots — 6.8K
-
Muse Gadgets announcement — 4.9K
-
Trillium Labs launch — 2.6K
-
I made my iPhone a second GPU for my 24 GB MacBook: Qwen 3.8 27B prefills 29–44% faster & my holds part of the CTX window. (Activity: 1192): OP built backburner, a
llama.cppfork / distributed inference setup that offloads part of Qwen 3.8 27B IQ4_XS from a24 GBM4 Pro MacBook to an iPhone 17 Pro Max over10 Gb/sUSB-C: the Mac runs layers1–40, streams activations, and the phone runs layers41–64using Metal 4 tensor ops. Reported end-to-end prefill gains vs Mac-only were+35%at8k,+44%at16k,+29%at32k, and+30%at48k; a cold27ksession improved from245 sstockllama.cpp/228 sfork Mac-only to168 swith the phone. Above64kcontext, the phone instead hosts old KV pages—up to roughly5.7 GB, enabling196k–229k8-bit context allocation—and computes old-key attention, with a140kcontext test improving generation latency from279 ms/tokento176 ms/tokenwhen adding Neural Engine-compiled16kkey pages. -
A technically relevant follow-up asked whether the same iPhone-as-secondary-GPU approach could extend to iPads, especially higher-end iPad Pro configurations with more capable Apple Silicon and potentially more RAM. The implication is that iPads might provide better offload performance or hold a larger portion of the context window than an iPhone, making them a stronger companion device for local LLM inference.
-
Qwen3.8-27B-Humanlike-Chat 2.0: texts like a human, now with tool calls and better instruction following (Activity: 805): LessThanThreeAI released Qwen3.8-27B-Humanlike-Chat 2.0, a merged LoRA over huihui-ai’s abliterated Qwen3.8-27B, available as GGUF/BF16/LoRA on Hugging Face with a demo Space. v2 replaces plain SFT with on-policy distillation: the student generates replies while two teachers score tokens—v1 + hidden “text like a person” instruction for chat/character behavior, and the base model for instruction-following, tools, and code—improving tool-use and controllability while preserving informal texting style. Reported evals vs the abliterated base: IFBench
37.3 → 43.7, When2Call48 → 58, BFCL irrelevance60 → 78, ties/slight gains on IFEval/GSM8K/BFCL simple (83.5 / 89.1 / 98), but regressions on MMLU-Pro (78.5 → 72.5) and LiveCodeBench (56 → 51); a custom “ishuman” judge benchmark rated it as human-written23.5%vs0.3%for the abliterated base and15.1%for official Qwen3.8-27B. Technical discussion in the top comments was sparse; the only relevant critique was that the model’s “humanlike” register may read more like teenage texting than broadly human conversation. -
A commenter raised a model-transfer question: whether the same humanlike chat fine-tuning/alignment method used for Qwen3.8-27B-Humanlike-Chat 2.0 would produce similar results on Gemma 4 31B. This is the only technically substantive thread, touching on cross-architecture generalization of the training recipe and whether behavior-style tuning would carry over to a larger Gemma-family model.
-
The gap is smaller than they told you: local 27B nearly matches frontier on real code tests (Activity: 730): OP reports a single-task DeepSWE/local-code benchmark run using Qwen3.8-27B GGUF via llama.cpp b11115 + llama-swap v257 on 1× RTX 4090 24GB, specifically
Qwen3.8-27B-UD-IQ4_XS.gguf(14.25GB) from unsloth/Qwen3.8-27B-GGUF, atctx-size 196608,IQ4_XS,q8_0K/V cache, speculative MTP draft, and DeepSeek-style reasoning budget4096. Measured results:115 tok/sdecode,22,934 MiBpeak VRAM,12/12on a code-review task, and on one DeepSWE task40/43hidden tests plus109/109existing tests, i.e. partial0.980but binary pass0; OP later corrected the comparison: the cited96.6%was mean partial across all published trials, while the frontier subset for that task was99.8%partial and85.3%pass, from DeepSWE v1.1 raw data. The linked writeups cover the 24GB fit/context setup (context ceiling) and the task-level DeepSWE result (local confidence); OP emphasizes this is task-specific, not a claim that a 27B local model matches frontier models broadly across the113-task benchmark. Commenters were skeptical of the broader framing: one user with both “Flash and 27B” said “the gap is real,” and another argued the conclusion is wrong because even frontier coding models are uneven and~24–72Bmodels may handle discrete subtasks but often lose value once humans must decompose larger engineering work into model-sized tasks. -
Several commenters argued the claimed near-parity is likely an artifact of a saturated benchmark: a local
27Bmodel, even atQ8, can perform well on small/discrete coding tasks but still fails on harder real-world tasks requiring frontier models such as Claude Opus. -
A recurring technical objection was that coding evaluations often underweight project-level decomposition:
24B–72Blocal models may solve isolated tickets, but for larger work items the human effort needed to break problems into model-sized subtasks can exceed the productivity gains. -
Users with hands-on experience running both Gemini Flash and local
27Bmodels reported that the performance gap remains substantial, especially for nontrivial coding workloads where frontier models provide better reliability and task completion. -
Qwen4Exp: add MTP by am17an · Pull Request #29761 · ggml-org/llama.cpp (Activity: 405):
llama.cppPR #29761 adds MTP speculative decoding support for Qwen3.8-Flash Next via--spec-type draft-mtp, merged into theaman/qwen4-optbranch after ~17hof development. Reported DGX Spark benchmarks for Qwen3.8-Flash-Nextiq4_xswith-np 1 -lzm on --spec-draft-n-max 3show decode throughput improving from28.36to43.88 tok/s(1.55×), latency speedup of 1.54×, and mean speculative acceptance of0.640across24tasks; GGUF quants are available on Hugging Face. Commenters noted the model is still impractically large for many local setups: theIQ4_NLGGUF is split into a tiny10.9 MBshard plus a102 GBshard, undercutting the idea of casually switching from Qwen 3.8 27B. One commenter also noted that Gufo supports MTP. -
One commenter reported that enabling MTP made inference slower in their testing, arguing it may be more useful for dense models than very large overall architectures where the MTP head has a low acceptance/hit rate. Their hypothesis is that the MTP head cannot effectively predict/compress enough of the larger model’s behavior, reducing speculative decoding benefit.
-
A user noted that Gufo already supports MTP, implying llama.cpp is catching up with existing MTP-capable tooling/backends for Qwen-style experimental models.
-
Another commenter said they had been using an EXL3 version through tabbyapi because llama.cpp GGUF inference was “way, way slower” for their workload. They planned to retest after this PR, but their prior experience suggests EXL3/tabbyapi may still be a performance baseline to compare against for Qwen4Exp/MTP support.
-
Pi 1.0 released - MCP support now included by default (Activity: 679): Earendil released
Pi 1.0, a stable version of its minimal agent harness, with Codemode now including native MCP support by default plus non-LLM/image model support, virtual-model extensions, deferred tool loading, Anthropic cache warming, mid-conversation system messages, and TUI updates. The release also introduces experimental MIT-licensed Pi Durable for longer-running agentic applications beyond terminal/coding-agent workflows, while retaining Pi’s minimal/extensible architecture. Top comments focused on naming ambiguity—“pi” collides with many AI/dev tools—and requested clarification of what Codemode is. One commenter linked Earendil’s rationale for MCP support: “You said no MCP”. -
A commenter linked the maintainer’s rationale for reversing course on MCP support in Pi 1.0, pointing to the post “You said no MCP”. The thread notes that MCP is now included natively/by default, after earlier resistance from the creator based on project ethos, with users framing it as a “vital addition” for tool/server integration workflows.
-
Clef: Open Weights decision model by Cloudflare (Activity: 619): Cloudflare announced Clef, an open-weights “decision model” intended for local/self-hosted use. A top commenter notes that Clef was post-trained from Qwen3.8-27B and that clef-flash was also released, post-trained from Qwen3.5-9B. The main substantive reaction was positive: commenters see Clef as filling a gap in the local-model ecosystem and are eager to benchmark it themselves.
-
Commenters noted that Cloudflare Clef is post-trained from Qwen3.8-27B, with a smaller clef-flash variant post-trained from Qwen3.5-9B, framing it as a potentially important open-weights “decision model” for local inference use cases.
-
A technical concern raised was how Clef’s quality holds up after quantization, especially below Q8, since local deployment will likely depend on lower-bit quantized variants and decision-model behavior may degrade nonlinearly under aggressive compression.
-
The benchmark discussion focused on comparisons against models such as Laya, Kev 9B, and DiffusionGemma Jev, but one commenter criticized the eval set as too weak and argued Clef should be compared against the leading models on jevbench rather than weaker open Jev baselines.
-
New in llama.cpp: Decision Models (Activity: 574): The post announces Decision Models support in
llama.cpp: local “Jev/Jeff-like” models intended to act more like controllers/classifiers—selecting among actions, continuations, or behavioral choices—rather than purely free-form generators. No benchmark numbers or low-level implementation details were discussed in the provided comments; the main concrete use case raised was steering local roleplay models to avoid characters“going off the rails mid scene.” Commenters were skeptical about Jev as a defensible product/category, arguing the idea had “no moat” and was rapidly cloned into many Jev-like models. Others said they still do not know what these models are practically useful for, aside from possible agent/roleplay control. -
A commenter frames decision models as essentially a constrained classification loop: provide a JSON schema containing allowed classes plus structured/unstructured input, then have the model select exactly one category per item. The technical question is whether llama.cpp’s new support adds meaningful inference-time behavior beyond ordinary prompt-constrained JSON classification, or primarily standardizes the workflow for local models.
-
One practical use case raised is applying decision models to local roleplay agents to reduce derailment during long scenes—i.e., using an auxiliary model or decision step to enforce state/intent constraints before generation. The thread does not report benchmarks or implementation results, but highlights a potential control-layer pattern for character consistency and scene-state management.
/r/Singularity, /r/Oobabooga, /r/MachineLearning, /r/OpenAI, /r/ClaudeAI, /r/StableDiffusion, /r/ChatGPT, /r/ChatGPTCoding, /r/aivideo, /r/aivideo
-
Just canceled my Google One AI plan. (Activity: 1838): The OP claims Google’s paid Google One AI Pro tier no longer provides access to frontier Gemini models: after an alleged Gemini 4 Argon announcement, access is described as limited to enterprise “Fairwind” partners, paid API users, and a forthcoming Google AI Ultra tier, while Pro users remain on Gemini 3.8 Flash. They argue this is a regression from the Gemini 2.5 Pro era—where higher-end reasoning models and generous limits were available more broadly—and contrast it with Anthropic/OpenAI subscriptions allegedly offering frontier models to standard paid users; no concrete benchmark numbers are provided beyond claims of “impressive benchmark charts” and a
1Mtoken output ceiling. Top comments mostly dismiss the complaint: one user says they subscribe primarily for Google storage and treat AI as a bonus, while others question the post’s authenticity, alleging it was Gemini-written or bot/shill activity from a new account. -
One commenter argued that the
$20/monthAI subscription tiers from Google/Anthropic/OpenAI function more like constrained trials than production-grade access, implying practical limits on sustained workloads despite “Pro” branding. They also suggested Google may be subsidizing or losing money on Google One AI Pro subscriptions given the underlying inference costs. -
A rollout clarification noted that Gemini Ultra appears to be receiving access first, but Google has not explicitly ruled out Pro-tier access to features like Astra. The commenter framed this as a typical staged software rollout rather than definitive permanent tier exclusion.
-
Why publicly announce a model that the public can’t use yet?? (Activity: 1624): The image is a screenshot of a purported Google/Gemini announcement for “Gemini 4 Argon”, claiming frontier performance in software engineering, knowledge work, and cybersecurity defense, plus an extremely large
1M token output limit: image. The post’s technical significance is mainly about model-release communication, not evaluation: the title questions why Google would publicly announce a model before it is accessible to users, and the image itself provides no benchmarks, API details, pricing, or availability timeline. Commenters compare this to prior “announced but unavailable” model rollouts, including Anthropic’s “mythos” and Google’s alleged “3.5 pro” handling. The dominant view is skeptical: users may be frustrated, and one commenter speculates the announcement is aimed “purely for investors.” -
Opus 5.5 nerfing - how to measure, how to spot, how to sue (Activity: 2722): Poster alleges Anthropic Opus 5.5 showed a sharp post-launch regression after
5–6days on complex C++/3D/physics/Blender MCP workloads, citing abnormal phrasing and lower code/output quality, and recommends preserving exact launch-day prompts/outputs plus latency measurements to detect potential changes such as quantization, routing, or serving optimizations under load. They frame this as a potential EU consumer-law issue under the Digital Content Directive 2019/770, specifically conformity expectations in Arts.7–8and modification/withdrawal notice obligations in Art.19, arguing launch benchmarks and “most capable model” marketing may set enforceable expectations. Comments broadly agree that closed-model providers can silently degrade or reroute models and that independent auditing is needed, but no commenter provides reproducible benchmarks or direct evidence. One commenter reports similar perceived quality drops in Higgsfield outputs, describing wasted credits after initially strong generations. -
Commenters raised the core measurement problem with alleged closed-model degradation: because Anthropic’s hosted model weights, prompts, routing, and serving configs are opaque, users argue it is difficult to prove a regression or “nerf” without independent auditing, fixed benchmark prompts, repeated sampling, and historical baselines. One user specifically asked for an “effective test or reliable nerf tracker site,” highlighting demand for third-party longitudinal evals rather than anecdotal comparisons.
-
Several users reported anecdotal regressions in Opus 5.5 behavior across applied workflows: one claimed it now needed help from Gemini 3.8 Flash to catch coding bugs, while another said Higgsfield design/render outputs declined after initially strong results, wasting credits. These reports are not controlled benchmarks, but they point to the kinds of tasks users want tracked: bug-finding accuracy, design/render prompt fidelity, and day-over-day output consistency.
-
Mmmkay. I didn’t believe others at first, but something is suddenly off with Opus 5.5 (Activity: 2045): A Claude Code Enterprise PAYG user reports a sharp perceived regression in Claude Opus 5.5 Med behavior after a monthly limit reset: from architecture-first, DRY/SOLID, token-efficient implementation to verbose preambles, duplicated code, “slopcode,” and token burn resembling prior Opus 5 behavior. They claim usage jumped from roughly
70%to90%in about an hour, versus no spend-limit increase requests during the previous week of heavy~12h/dayO5.5 use, and offer daily cost/token data for comparison. A commenter cites external sentiment tracking showing Opus 5.5 Reddit sentiment dropping from71–73/100on Sep 25–28 to58yesterday and55today on modelsentiment.com, while noting it measures opinion rather than backend model changes. Top comments speculate Anthropic may have reduced compute, silently changed routing, or altered token accounting after launch hype, but no direct evidence is provided. The main debate is trust/reliability: users want stable model behavior and transparent deployment/versioning rather than perceived post-release regressions. -
A commenter tracking Reddit sentiment reports a sharp drop for Claude Opus 5.5, with scores allegedly stable at
71–73/100from Sep 25–28 before falling to58yesterday and55today on modelsentiment.com. They note this measures user opinion rather than model behavior, so it cannot confirm a backend change, but it may indicate a sudden perceived quality regression. -
Multiple users describe a suspected capability regression in Opus 5.5, especially around instruction-following and multi-part prompt adherence: one says the model now “mentions 3 things and only acknowledges 2,” and even recognizes the omission when challenged. Another user says they reverted to “xhigh effort” mode for all tasks, implying lower default reliability or reduced reasoning/compliance under normal settings.
-
One technical hypothesis raised is that Anthropic may have temporarily allocated more compute during launch/benchmarking and later reduced inference resources or altered token accounting, leading to perceived quality degradation. This is speculative and unverified, but the complaint centers on reproducibility and reliability: users want model behavior to remain stable after release rather than changing silently under the same product name.
-
Orbiting Lora + first and last frame in MiniMax gives fantastic results (Activity: 2263): A user shared a MiniMax-H3 LoRA for generating locked-subject
360°orbit shots from first/last-frame conditioning:pablodawson/MiniMax-H3-360-Orbit-LoRA. The prompt explicitly constrains the scene to a frozen instant—no object/pose deformation, no drifting, no continued action—so that camera parallax is the only motion source, targeting cleaner pseudo-volumetric outputs suitable for downstream reconstruction workflows. A linked Reddit demo video was mentioned, but the video URL could not be inspected due to Reddit returning403 Forbidden. Commenters framed the LoRA as especially useful for creating 3D assets: one suggested feeding the generated orbit clip into Opus to extract snapshots for 3D model generation, claiming it improves style preservation. Another commenter extrapolated that this kind of orbit-consistent video generation brings consumer volumetric/VR viewing of existing films closer. -
One commenter describes a workflow where an orbiting/generated 3D video snippet is fed into Opus and instructed to extract snapshots for 3D model creation. They report that this improves style capture substantially versus prompting the model without the video reference, suggesting the orbit video acts as a strong multi-view conditioning source.
-
A technical artifact noted in the output is inconsistent motion segmentation: humans remain effectively frozen while secondary elements such as the car, hair, and background explosion continue moving. This points to MiniMax preserving the subject pose from the first/last-frame constraints while still synthesizing environmental dynamics, which can create partial-animation mismatches.
-
Griffin, the first Human Interaction Model to pass video Turing Test it’s already #1 on NVIDIA’s benchmark for full-duplex AI video - 44% of people thought it was a real person while other systems are at ~3% (Activity: 2018): A Reddit post claims Griffin, described as a “Human Interaction Model,” is the first system to pass a video Turing Test and ranks
#1on NVIDIA’s benchmark for full-duplex AI video, with44%of participants judging it as a real person versus roughly~3%for other systems. The linked Reddit video could not be independently accessed due to a 403 Forbidden response, so the benchmark details, methodology, and model architecture are not verifiable from the provided source. Comments were mostly non-technical: one user joked about the human/AI reveal being reversed, while another argued the technology is unnecessary and likely to be used in predatory applications. -
A commenter emphasized that a
44%human-identification rate is technically significant because humans are usually highly sensitive to subtle facial, timing, and behavioral anomalies—the basis of the uncanny valley problem in CGI/animatronics. They argued this suggests Griffin is substantially beyond prior “fake human” systems, especially compared with the post’s claim that other systems score around~3%on the same video Turing-style benchmark. -
One technically relevant real-world abuse case raised was AI-generated job applicants: synthetic candidates allegedly apply, conduct video interviews, get hired, and then either gain internal platform access or steal shipped work equipment. The commenter noted that large companies with weak scrutiny or limited background checks may fail to detect these AI-mediated interviews, implying full-duplex video agents could materially worsen identity-verification and hiring-security risks.