Termsslug: engram-parameters

Engram Parameters

Engram 参数

A 64B parameter module in Hy4 flash kept outside the activation path to expand memory and knowledge capacity.

Curated Intelligence

1 items · Page 1/1
IT之家 · 智能时代T2·Open Source
78 pts
Tencent Open-Sources Hy4 flash with 224B Total Parameters

Tencent Hunyuan has officially open-sourced the Hy4 flash family, including the standard, FP8, and Base variants, available on GitHub, Hugging Face, ModelScope, and GitCode. The model carries 224B total parameters (including 64B Engram parameters) while activating only 12B per token, supports multimodal input and a 1M-token context window, and is positioned as the most cost-effective Hy model to date, already deployed across Tencent Cloud TokenHub, Yuanbao, WeCom, and other products. Tencent also teased that the full Hy4 model is being open-sourced soon.

Engram Parameters | Today for AI