Qwen-7B (Qwen-7B) is a 7 billion parameter scale model of the Qwen series of big models developed by Aliyun.Qwen-7B is a big language model based on Transformer, which is trained on super-large scale pre-training data. The pre-training data are of various types and cover a wide range, including a large number of web texts, professional books, codes, etc. The pre-training data are also used in Qwen-7B. Meanwhile, based on Qwen-7B, we use the alignment mechanism to build Qwen-7B-Chat, an AI assistant based on the large language model.This repository is the repository of Qwen-7B-Chat.
If you would like to know more details about the Tongyi Qianqian-7B open source model, we recommend you to refer to the Github code repository. https://github.com/modelscope/modelscope
[Read More]