Together AI released Together Compiler, a system in which AI agents continuously re-tune the inference forward pass as production traffic shifts. Its core is a persistent serving engine that hot-reloads agent-written forward passes without restarts, backed by a 12-layer fast screening tier and a 60-layer slow tier that confirms gains on real traffic. Together claims up to 2.6x TPS over the best open configurations on SemiAnalysis InferenceX, though some gains are marginal and all figures are self-reported; the system is closed source and already live on its serverless endpoints.
Forward Pass
前向传播
The process of computing outputs from inputs in a neural network
Curated Intelligence
Developers used the Handwired tool to transform a JavaScript-based mini desktop OS, Mini OS, into a neural network model. The experiment demonstrates mapping standard UI logic like lists and animations into a 130-layer network with 9,909 weights that renders directly to the DOM, validating the feasibility of code-to-neural-network conversion.
This article introduces 'System One' decision models like Jev, which generate structured outputs from fixed options in a single forward pass by masking the vocabulary, offering significant latency advantages over traditional multi-step LLM decoding. It provides a GitHub repository guiding developers through dataset construction, fine-tuning, and calibration to build low-latency, deterministic classification or decision-making models.
Google introduces TimesFM-3, a time series foundation model enabling zero-shot multivariate forecasting in a single forward pass. It breaks the univariate limitation of previous versions, significantly outperforming other models on major benchmarks and offering direct access via BigQuery's AI.FORECAST command.
OpenAI released the open-source Privacy Filter on Hugging Face Hub, capable of detecting eight categories of Personally Identifiable Information (PII) in a single forward pass over a 128k context. The Hugging Face team built three demo apps—Document Privacy Explorer, Image Anonymizer, and SmartRedact Paste—to showcase its immediate deployability for long-text and multimedia privacy tasks.