What is Hy4?

Hy4 preview is an innovative open-source Mixture-of-Experts model designed for numerous practical productivity applications, such as software development, office tasks, game creation, and scientific research. With an astounding 770 billion parameters and 49 billion activated per token, it features a remarkable 1 million-token context window, enabling it to adeptly handle extensive codebases, large sets of documents, and intricate multi-step operations. The model's architecture incorporates 78 layers that utilize Gated DeepSeek Sparse Attention and IndexCache for efficient sparse index reuse across layers, while identity Hyper-Connections are implemented to improve information flow within the model. Furthermore, a specialized Multi-Token Prediction layer supports speculative decoding, significantly boosting its performance. Hy4 preview is engineered to understand, strategize, troubleshoot, and verify complex engineering initiatives, all while delivering substantial advancements in the quality of front-end visuals and interaction design, ultimately serving as an essential tool for experts in a wide range of fields. This versatility makes it an outstanding choice for professionals seeking to enhance their productivity and efficiency in various projects.

Integrations

Offers API?:
Yes, Hy4 provides an API

Screenshots and Video

Hy4 Screenshot 1

Company Facts

Company Name:
Tencent
Date Founded:
1998
Company Location:
China
Company Website:
hy.tencent.ai/research/hy4-preview

Product Details

Deployment
SaaS
Training Options
Documentation Hub
Support
Web-Based Support

Product Details

Target Company Sizes
Individual
1-10
11-50
51-200
201-500
501-1000
1001-5000
5001-10000
10001+
Target Organization Types
Mid Size Business
Small Business
Enterprise
Freelance
Nonprofit
Government
Startup
Supported Languages
English

Hy4 Categories and Features