Termsslug: inference-speed

Inference Speed

推理速度

The rate at which a model generates output tokens, typically measured in tokens per second.

Curated Intelligence

8 items · Page 1/1
Hacker News AIT2·Models
78 pts
Moonshot AI Releases Kimi K3.1 Pro with 1M Context and Highspeed Variant

Moonshot AI has officially launched Kimi K3.1 Pro, its first 3T-class model featuring a 1 million token context window and substantial improvements in coding, 3D creation, and financial modeling. The accompanying K3.1 Pro Highspeed variant delivers identical capabilities at approximately 2–3x the inference speed, aiming to provide more responsive interactions.

量子位官网T2·Models
42 pts
OpenAI Launches 'Crazy 28 Days': GPT-6 Inference Speed Up 50%

OpenAI's Codex lead launched a 28-day intensive update sprint, delivering a ~50% inference speed boost for GPT-6 Astra and Sol on day one. Despite the performance optimization, community reaction was largely sarcastic, viewing it as PR damage control following prior latency issues and commercialization controversies.

OpenAI 官方博客T1·Models
48 pts
OpenAI Previews Ultrafast Mode: GPT-5.6 Sol at 14x Speed

OpenAI has introduced a new API service tier called Ultrafast, boosting GPT-5.6 Sol inference speed by up to 14 times. Powered by Cerebras hardware, it delivers output rates of up to 750 tokens per second. Currently in preview, this feature targets real-time applications requiring ultra-low latency.

Google DeepMindT1·Models
68 pts
Google DeepMind Launches Nano Banana 2: Merging Pro Quality with Flash Speed

Google DeepMind has launched Nano Banana 2, a new image generation model that combines the advanced world knowledge of Nano Banana Pro with the lightning-fast speed of Gemini Flash. The model offers production-ready specs, subject consistency, and rapid editing capabilities across Google products like the Gemini app and Search. Additionally, Google is integrating C2PA Content Credentials into its SynthID technology to improve the verifiability of AI-generated content.

Hugging Face BlogT1·Models
35 pts
Hugging Face Releases SmolLM Series

Hugging Face has launched the SmolLM series of lightweight large language models, emphasizing a balance between blazing-fast inference and remarkable power. The series aims to provide efficient solutions for resource-constrained environments; however, the current material only contains the title, lacking specific parameters, benchmark data, and architectural details.