Tencent open-sources Hy4 flagship MoE: 770B total, 49B active, 1M context
Tencent's Hy team has open-sourced Hy4, Hy4-FP8 and the pretrained Hy4-base weights on Hugging Face. Hy4 is a new-generation multimodal Mixture-of-Experts flagship with a 770B-parameter language backbone, 49B text parameters plus 1.23B vision parameters active per token, text/image/video understanding and a 1,048,576-token context under the Tencent Hy License.