Termsslug: pre-training

Pre-training

预训练

Process of learning general feature representations on large-scale unlabeled data

Curated Intelligence

19 items · Page 1/2
量子位官网T2·Models
72 pts
Tencent Releases Hunyuan Hy4, Scales WorkBuddy Tenfold as Demand Surges

Tencent released Hunyuan Hy4, its latest flagship LLM, adding vision understanding for the first time and substantially scaling pretraining and post-training. First-day demand overwhelmed capacity, prompting a tenfold expansion of the WorkBuddy inference cluster and higher free quotas. Hy4 ranks second among Chinese models on Artificial Analysis' intelligence index and first among open models on Agent Arena, at roughly $0.78 per task.

IT之家 · 智能时代T2·Models
58 pts
Tencent Hunyuan Hy4 Demand Surges, Inference Cluster Scaled Tenfold

Tencent Hunyuan's Hy4 hit quota limits on its first day of launch inside WorkBuddy, prompting a tenfold emergency expansion of its inference cluster and higher free-tier quotas, while Hy3's free access was extended to November 15. Compared with the preview, Hy4 substantially scales pre- and post-training, adds vision for the first time, and is billed as the company's first entry among top open-source models, with weights and a system card promised soon.

Hacker News AIT2·Models
72 pts
Tencent Releases Hy4 Open-Source Model with First Vision Capabilities

Tencent released Hy4, substantially scaling both pre-training and post-training over its preview version and adding vision capabilities for the first time. The model claims major gains in instruction following, long-context understanding, long-horizon tasks and deep research, positioning Hy among the strongest open-source models and emphasizing product co-design for real-world productivity.

IT之家 · 智能时代T2·Models
78 pts
Tencent Releases Hunyuan Hy4, Adding Vision and Computer-Use Capabilities

Tencent has released the official Hunyuan Hy4 model, substantially scaling pre- and post-training versus the preview and adding vision understanding and computer-use capabilities for the first time, alongside gains in instruction following, long-context comprehension and long-horizon tasks. Tencent claims Hy4 is its first model to rank among the strongest open-source models and plans to release weights with vLLM/SGLang ecosystem support, while acknowledging a sizable gap to top closed models on hard math and long-horizon coding benchmarks.

IT之家 · 智能时代T2·Models
86 pts
Microsoft Completes Pre-training of 2.8T-Parameter MAI-Base-2 Model

Microsoft has completed pre-training its next-generation foundation model, MAI-Base-2, featuring 2.8T total parameters (80B active) and outperforming all tested open-weight models. The company claims a 4x to 12x improvement in compute efficiency over DeepSeek-V4-Pro-Base, attributed to scientific scaling, co-design, and data scaling strategies. Preparations for the successor, MAI-Base-3, are already underway.

IT之家 · 智能时代T2·Models
78 pts
Microsoft Launches MAI-Base-2: Claims Performance Surpasses GPT-5.6 Underlying Model with One-Quarter Compute

Microsoft AI CEO Mustafa Suleyman announced that the in-house foundation model MAI-Base-2 outperforms the OpenAI internal model powering GPT-5.6 during pre-training, using only one-quarter of the compute. The model also claims superior computational efficiency compared to DeepSeek, requiring just one-twelfth of the compute, signaling Microsoft's strategic move toward an independent and efficient LLM infrastructure.

IT之家 · 智能时代T2·Models
78 pts
Meta Launches Muse Wonder Flagship Models: Code Capabilities Surge to Rival Anthropic and OpenAI

Meta has launched the Muse Wonder and Muse Wonder Full flagship AI models, achieving scores in reasoning, writing, and coding tests that approach Anthropic's top-tier performance. As Meta's first product explicitly targeting frontier model benchmarks, it is developed under Chief AI Officer Alexandr Wang to enhance code generation capabilities, aiming to compete in the AI programming market dominated by rivals while powering the agentic app Muse.

GitHub Trending AIT2·Open Source
68 pts
LLMs-from-scratch Hits 106k Stars: Build GPT from Scratch

Sebastian Raschka's open-source project LLMs-from-scratch has surpassed 106,000 GitHub stars, establishing itself as a benchmark resource for understanding LLM internals. The repository accompanies the book of the same name, providing end-to-end code for data preprocessing, Transformer implementation, pretraining, and fine-tuning to help developers grasp how large language models work by building them from scratch.