Tencent Hunyuan large model officially unveiled: the parameter scale exceeds 100 billion, and has been tested in multiple internal products
According to news on September 7, at the 2023 Tencent Global Digital Ecology Conference held today, Tencent officially released the Hunyuan Large Model.
According to reports, the scale of Hunyuan large model parameters exceeds 100 billion, and the pre-training corpus exceeds 2 trillion tokens . It has been tested in Tencent Cloud, Tencent Advertising, WeChat Souyisou and other Tencent internal businesses and products.
The model also serves industrial scenarios. Customers can call Hunyuan based on the API, or make exclusive industry large models based on Hunyuan .
The Hunyuan large model claims to be able to identify "traps" and refuse to be "induced" to answer some difficult or even unanswerable questions, such as "how to speed better", and the refusal rate has increased by 20%.
In terms of text, the model can process ultra-long text in various scenarios , and optimize the position encoding to improve the processing effect and performance of long text. Combining instruction follow optimization to make the output content more in line with word count requirements.
In terms of logical thinking, the Hunyuan large model claims to "significantly improve the logical thinking ability of the model in the scene" , and strengthen the tendency to dismantle problems and think step by step.