Tencent Open-Sources Hy4: 770B-Parameter Flagship, 49B Active and a 1M-Token Context
Tencent has released the open weights for Hy4, its 770-billion-parameter flagship model with 49 billion active parameters per token, a 1M-token context and a system card — but under a custom licence, not Apache 2.0.

At a glance: Tencent has released the open weights for Hy4, the flagship model of its Hy family, just over two weeks after launching it as an API-only model. The download covers three checkpoints — the instruction-tuned Hy4, an FP8-quantised copy and the pre-trained base model — on Hugging Face, ModelScope and GitCode, alongside a system card with a full safety evaluation. Hy4 carries 770 billion total parameters with about 49 billion active per token, reads text, images and video, and holds a million tokens of context. The catch is the licence: the preview shipped under Apache 2.0, but the full model uses Tencent’s own Hy License, which draws a line at large commercial API businesses. The benchmark figures below are Tencent’s own, published in the model card, and no independent lab has had time to reproduce them.
Tencent announced the release on X on 20 November, and Tencent published the Hy4 model card on Hugging Face the same morning. This is the release the open-weight community has been waiting for since Hy4 launched on 4 November. At launch Tencent said the weights would follow, then Hy4 Flash, the smaller and cheaper sibling, got its weights first on 17 November. Now the flagship has followed. The Hy team is holding a live question session on Reddit’s r/LocalLLaMA on Friday, 8 to 10 in the morning Pacific time, which is 9 to 11 in the evening in Pakistan.
What Hy4 actually is
Hy4 is a mixture-of-experts model, and the headline number needs the usual unpacking. The language backbone holds 770 billion parameters across 78 layers: one dense layer, then 77 layers that each hold 256 routed experts plus one shared expert. A router picks 8 routed experts per token, so about 49 billion parameters fire for each token, plus 1.23 billion for the vision encoder. That is the number that decides serving costs, and it is why a 770-billion-parameter model can be run at all outside a hyperscaler.
The context window is one million tokens, matching the biggest models on the market, and the model takes in text, images and video. Under the hood, Tencent lists attention built on Gated DeepSeek Sparse Attention with an IndexCache, which picks the top 2,048 tokens for each query to attend to instead of the whole million, and a residual design it calls identity Hyper-Connections. There is also a built-in speculative decoding drafter, DFly2, a 3.3-billion-parameter model that reuses Hy4’s key-value cache so each drafted token looks at about 2,000 keys at most, however long the context runs.
What sets Hy4 apart from most open-weight releases is what Tencent trained it to do. It supports computer-use workflows across command-line and graphical interfaces, with targeted training on professional software such as Blender and CAD and on long workflows that span several applications. For game development, Tencent worked with its own Interactive Entertainment Group on training data and evaluations, and adapted the model for Unreal Engine, Unity and Godot. For finance and office work, it built thousands of realistic workspaces and tens of thousands of tasks with its financial technology arm, and had 213 finance professionals judge the results. That breadth is the pitch: one model for coding, research, office work and operating a computer.
Pricing: the same as the API launch
Nothing about the price has changed, because the model itself has not changed. Hy4 has been available through Tencent Cloud and OpenRouter since 4 November at $0.834 per million input tokens and $2.501 per million output tokens. What changes now is access: anyone can download the weights and run the model on their own hardware, or fine-tune it, instead of calling Tencent’s endpoint. The download is not small. The standard checkpoint is about 1.55 terabytes, the FP8 copy about 0.79 terabytes and the base model about 1.54 terabytes, so a full run still assumes a multi-GPU server. A community GGUF build has already appeared for smaller setups.
| Model | Total parameters | Active per token | Context | Input / 1M tokens | Output / 1M tokens |
|---|---|---|---|---|---|
| Tencent Hy4 | 770B | 49B | 1M | $0.83 | $2.50 |
| Tencent Hy4 Flash | 220B | ~12B | 1M | $0.035* | $0.14* |
| Alibaba Qwen4-Max | 2.4T | Not disclosed | 1M | $1.50 | $4.50 |
| Google Gemini 4 Neon | Not disclosed | Not disclosed | 1M | $3 | $15 |
| OpenAI GPT-6.2 Astra | Not disclosed | Not disclosed | Not disclosed | $8 | $40 |
*OpenRouter pricing for Hy4 Flash. Tencent Cloud lists ¥0.5 / ¥2 per million tokens, halved through 30 November. Hy4 Flash is the cheaper sibling: Tencent says it costs about a twentieth as much per task as the full Hy4, which is why the two models are aimed at different jobs.
Benchmarks: Tencent’s own numbers, and an honest admission
On the few-shot base-model tests in the model card, Hy4 Base leads DeepSeek-V4-Pro-Base on most of the knowledge and reasoning rows: 91.6 on MMLU against 91.1, 73.9 on MMLU-Pro against 73.4, 62.7 on SuperGPQA against 54.8, and 71.6 on U-MATH against 64.8. It trails on the coding row, 74.0 on MBPP-plus against 79.1, and Tencent is open about that. In its own words, a gap remains between Hy4 and the top proprietary models on research-level mathematics, long-horizon coding, model self-improvement and advanced visual question answering. That is a frank admission to put in a launch document, and it is worth more than another chart.
The finance numbers are the most interesting, because they come from people rather than a test set. Across 579 real-world financial tasks, judged by 213 finance professionals, Hy4 scored 3.04 out of 4, ahead of DeepSeek-V4.1-Flash at 2.97, Kimi K3.1 Pro at 2.68 and GLM-5.3 at 2.68. Tencent also says it cut the hallucination rate from 15.76% on Hy4 preview to 5.45%, and improved 19.1% on its GameDev benchmark and 9.8% on GameLogic. Every one of those figures comes from Tencent, so treat them as the vendor’s case for the model until outside testing weighs in. The weights are public now, so that testing can start immediately.
The licence changed, and it matters
Hy4 preview, released on 28 August, was under Apache 2.0. Hy4 uses the Tencent Hy License, version 1.0. It is derived from Apache 2.0, and Tencent says its main change is the commercial terms for large model-as-a-service businesses in Section 10. A business that runs the model as a service needs a separate written licence from Tencent if its worldwide gross revenue tops $50 million in any 12 months, or before it uses the model in a product with more than 100 million monthly users. Internal use is exempt, as long as neither the model, a derivative nor their outputs reach third parties. The licence counts fine-tuned, quantised, distilled, merged and pruned versions as derivative works.
For most developers and small teams, the weights are free to download and use. For the big API providers, they are not. That is the same line Tencent drew with Hy4 Flash, and it is now the house position for the whole Hy family. Anyone planning to build on Hy4 should read the licence before the model card, because the terms, not the weights, decide what “open” means here.
How to run it, and what Tencent recommends it for
The three checkpoints serve different jobs. Hy4 is the instruction-tuned model for direct use in chat, reasoning and agent tasks, with two reasoning modes, high and no-think. Hy4-FP8 is the same model quantised to 8-bit, which cuts memory use for production serving. Hy4 base is the pre-trained model with no instruction tuning, aimed at teams that want to continue training it themselves. Both vLLM and SGLang have prebuilt Hy4 images, and the repository carries fine-tuning scripts for DeepSpeed, LLaMA-Factory and ms-swift. Tencent recommends a temperature of 0.9 and a top_p of 1.0, with reasoning defaulting to high for deep work.
Tencent recommends the full Hy4 for complex, long-horizon work: deep research, scientific computing, long software engineering tasks, game development and computer use. For everyday productivity it points users at Hy4 Flash instead, which is cheaper per task. That split is honest, and it matches the benchmarks: the flagship has the higher intelligence ceiling, and the price is the hardware to run it. The open question now is what the community does with a 770-billion-parameter model it can finally download. The timing is worth noting. K2-Horizon opened its full model fleet a day before Hy4 Flash, Qwen4-Max launched as a closed flagship the same week, and Gemini 4 Neon arrived from Google two days earlier. The open-weight race is now moving in weekly steps, and Tencent has just put its biggest model on the table.
What to watch
- Independent testing: whether outside labs reproduce Tencent’s benchmark figures and the finance blind-test score now that the weights are public.
- The licence in practice: whether large API providers accept the Tencent Hy License terms or steer clear of the weights.
- Community builds: how quickly the GGUF build and fine-tunes spread, and what hardware the community settles on for a 770-billion-parameter model.
- The AMA: what the Hy team says on Reddit’s r/LocalLLaMA about the roadmap, including whether more of the Hy family follows.
- Rival answers: whether Alibaba, DeepSeek or the Western labs answer a 770-billion-parameter open model of their own.
What is Tencent Hy4?
Tencent’s flagship Hy model, a natively multimodal mixture-of-experts model with 770 billion total parameters, about 49 billion active per token, and a 1-million-token context window. It reads text, images and video, and supports computer-use workflows. It launched as an API-only model on 4 November 2026, and its weights were released on 20 November 2026.
Is Hy4 open source?
The weights are open to download, but not under a standard open-source licence. Hy4 uses the Tencent Hy License 1.0. Model-as-a-service providers earning over $50 million a year or serving over 100 million monthly active users need a separate written licence from Tencent. Internal enterprise use is exempt. The earlier Hy4 preview was under Apache 2.0.
What are the three Hy4 versions?
Hy4 is the instruction-tuned model for chat, reasoning and agent tasks. Hy4-FP8 is the same model quantised to 8-bit for lower memory use in production serving. Hy4 base is the pre-trained model without instruction tuning, for teams that want to fine-tune it themselves. All three are on Hugging Face, ModelScope and GitCode.
How much does Hy4 cost?
Through Tencent Cloud and OpenRouter, Hy4 costs $0.834 per million input tokens and $2.501 per million output tokens. Running the open weights yourself costs whatever your own hardware costs: the standard checkpoint is about 1.55 terabytes, the FP8 copy about 0.79 terabytes and the base model about 1.54 terabytes.
How does Hy4 score on benchmarks?
On Tencent’s own few-shot tests the base model scores 91.6 on MMLU, 73.9 on MMLU-Pro and 71.6 on U-MATH, ahead of DeepSeek-V4-Pro-Base on most knowledge rows but behind it on coding. In a blind test of 579 financial tasks judged by 213 professionals, Hy4 scored 3.04 out of 4, ahead of DeepSeek-V4.1-Flash at 2.97. All of these figures are Tencent’s own reporting.


