Categories
  Encyclosphere.org ENCYCLOREADER
  supported by EncyclosphereKSF

Qwen

From Wikipedia - Reading time: 11 min
Qwen
Developer(s)Alibaba Cloud
Initial releaseApril 2023; 2 years ago (2023-04)
Stable release
Qwen3-235B-A22B / July 21, 2025; 25 days ago (2025-07-21)
Repositorygithub.com/QwenLM/Qwen
Written inPython
Operating system
TypeChatbot
LicenseApache-2.0
Qwen Research License
Qwen License
Websitechat.qwen.ai
Qwen
Tongyi Qianwen
Traditional Chinese通義千問
Simplified Chinese通义千问
Literal meaningto comprehend the meaning, [and to answer] a thousand kinds of questions
Transcriptions
Standard Mandarin
Hanyu PinyinTōngyì Qiānwèn

Qwen (also called Tongyi Qianwen, Chinese: 通义千问) is a family of large language models developed by Chinese company Alibaba Cloud. In July 2024, it was ranked as the top Chinese language model in some benchmarks and third globally behind the top models of Anthropic and OpenAI.[1]

Models

[edit]

Alibaba first launched a beta of Qwen in April 2023 under the name Tongyi Qianwen.[2] The model's architecture was based on the Llama architecture developed by Meta AI.[3][4] It was publicly released in September 2023 after receiving approval from the Chinese government.[5] In December 2023 it released its 72B and 1.8B models for download, while Qwen 7B weights were released in August.[6][7] Their models are sometimes described as open source, but the training code has not been released nor has the training data been documented, and they do not meet the terms of either the Open Source AI Definition or the Model Openness Framework from the Linux Foundation.

In June 2024 Alibaba launched Qwen 2 and in September it released some of its models with open weights, while keeping its most advanced models proprietary.[8][9] Qwen 2 contains both dense and sparse models.[10]

In November 2024, QwQ-32B-Preview, a model focusing on reasoning similar to OpenAI's o1, was released under the Apache 2.0 License, although only the weights were released, not the dataset or training method.[11][12] QwQ has a 32K token context length and performs better than o1 on some benchmarks.[13]

The Qwen-VL series is a line of visual language models that combines a vision transformer with a LLM.[3][14] Alibaba released Qwen2-VL with variants of 2 billion and 7 billion parameters.[15][16][17]

In January 2025, Qwen2.5-VL was released with variants of 3, 7, 32, and 72 billion parameters.[18] All models except the 72B variant are licensed under the Apache 2.0 license.[19] Qwen-VL-Max is Alibaba's flagship vision model as of 2024, and is sold by Alibaba Cloud at a cost of US$0.00041 per thousand input tokens.[20]

Alibaba has released several other model types such as Qwen-Audio and Qwen2-Math.[21] In total, it has released more than 100 open weight models, with its models having been downloaded more than 40 million times.[9][22] Fine-tuned versions of Qwen have been developed by enthusiasts, such as "Liberated Qwen", developed by San Francisco-based Abacus AI, which is a version that responds to any user request without content restrictions.[23]

In January 2025, Alibaba launched Qwen 2.5-Max. According to a blog post from Alibaba, Qwen 2.5-Max outperforms other foundation models such as GPT-4o, DeepSeek-V3, and Llama-3.1-405B in key benchmarks.[24][25] In February 2025, Alibaba announced on their official X account that the 2.5-Max model would be opened up, however it has not been released.[26]

On March 24 2025, Alibaba launched Qwen2.5-VL-32B-Instruct as a successor to the Qwen2.5-VL model. It was released under the Apache 2.0 license.[27][28]

On March 26, 2025, Qwen2.5-Omni-7B was released under the Apache 2.0 license and made available through chat.qwen.ai, as well as platforms like Hugging Face, GitHub, and ModelScope.[29] The Qwen2.5-Omni model accepts text, images, videos, and audio as input and can generate both text and audio as output, allowing it to be used for real-time voice chatting, similar to OpenAI's GPT-4o.[29]

On April 28, 2025, the Qwen 3 model family was released,[30] with all models licensed under the Apache 2.0 license. The Qwen 3 model family includes both dense (0.6B, 1.7B, 4B, 8B, 14B, and 32B parameters) and sparse models (30B with 3B activated parameters, 235B with 22B activated parameters). They were trained on 36 trillion tokens in 119 languages and dialects.[31] All models except the 0.6B, 1.7B, and 4B variants have a 128K token context window. Like OpenAI's o1 and QwQ 32B, the Qwen 3 models support reasoning, which can be enabled or disabled through the tokenizer. The Qwen 3 models are available through chat.qwen.ai and can be downloaded via Hugging Face and ModelScope.[32]

List of models
Version Release date Ref.
Tongyi Qianwen September 2023 [5]
Qwen-VL August 2023 [33]
Qwen2 June 2024 [9]
Qwen2-Audio August 2024 [34]
Qwen2-VL December 2024 [15]
Qwen2.5 September 2024 [22]
Qwen2.5-Coder November 2024 [35]
QvQ December 2024 [36]
Qwen2.5-VL January 2025 [37]
QwQ-32B March 2025 [38]
Qwen2.5-Omni March 2025 [29]
Qwen3 April 2025 [30]
Qwen3-Coder July 2025 [39]

See also

[edit]

References

[edit]
  1. ^ Jiang, Ben (11 July 2024). "Alibaba's open-source AI model tops Chinese rivals, ranks 3rd globally". South China Morning Post. Archived from the original on 4 March 2025. Retrieved 29 November 2024.
  2. ^ Chiang, Sheila (11 April 2023). "Alibaba to roll out its rival to ChatGPT across all its products". CNBC.
  3. ^ a b Bai, Jinze; et al. (28 Sep 2023). "Qwen Technical Report". arXiv:2309.16609 [cs.CL].
  4. ^ "Qwen/techmemo-draft.md". GitHub. August 3, 2023. Archived from the original on March 7, 2025. Retrieved March 5, 2025.
  5. ^ a b Jiang, Ben (13 September 2023). "Alibaba opens Tongyi Qianwen model to public as new CEO embraces AI". South China Morning Post.
  6. ^ Fan, Feifei (2023-12-01). "Alibaba unveils new Tongyi Qianwen AI language model". global.chinadaily.com.cn.
  7. ^ Ye, Josh (August 3, 2023). "Alibaba rolls out open-sourced AI model to take on Meta's Llama 2". reuters. Archived from the original on 2023-10-10. Retrieved 2024-11-29.
  8. ^ Jiang, Ben (7 June 2024). "Alibaba says new AI model Qwen2 bests Meta's Llama 3 in tasks like maths and coding". South China Morning Post.
  9. ^ a b c Kharpal, Arjun (19 September 2024). "China's Alibaba launches over 100 new open-source AI models, releases text-to-video generation tool". CNBC.
  10. ^ Yang, An; et al. (10 Sep 2024). "Qwen2 Technical Report". arXiv:2407.10671 [cs.CL].
  11. ^ Dickson, Ben (29 November 2024). "Alibaba releases Qwen with Questions, an open reasoning model that beats o1-preview". VentureBeat.
  12. ^ 故渊 (2024-11-28). "阿里通义千问 QwQ 登场：开源 AI 推理新王，MATH 测试超 OpenAI o1 模型 - IT之家". ITHome (Chinese website).
  13. ^ Wiggers, Kyle (27 November 2024). "Alibaba releases an 'open' challenger to OpenAI's o1 reasoning model". TechCrunch.
  14. ^ Browne, Ryan (31 December 2024). "Alibaba slashes prices on large language models by up to 85% as China AI rivalry heats up". CNBC.
  15. ^ a b Franzen, Carl (29 August 2024). "Alibaba releases new AI model Qwen2-VL that can analyze videos more than 20 minutes long". VentureBeat.
  16. ^ 沛霖 (2024-08-30). "阿里通义千问推出 Qwen2-VL：开源 2B / 7B 参数 AI 大模型，处理任意分辨率图像无需分割成块". ITHome (Chinese website).
  17. ^ Wang, Peng; Bai, Shuai; Tan, Sinan; Wang, Shijie; Fan, Zhihao; Bai, Jinze; Chen, Keqin; Liu, Xuejing; Wang, Jialin; Ge, Wenbin; Fan, Yang; Dang, Kai; Du, Mengfei; Ren, Xuancheng; Men, Rui; Liu, Dayiheng; Zhou, Chang; Zhou, Jingren; Lin, Junyang (September 18, 2024). "Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolution". Cs.CV. arXiv:2409.12191.
  18. ^ Team, Qwen (2025-01-26). "Qwen2.5 VL! Qwen2.5 VL! Qwen2.5 VL!". Qwen. Retrieved 2025-04-28.
  19. ^ "Qwen/Qwen2.5-VL-72B-Instruct · Hugging Face". huggingface.co. 2025-04-28. Retrieved 2025-04-28.
  20. ^ Jiang, Ben (31 December 2024). "Alibaba Cloud cuts AI visual model price by 85% on last day of the year". South China Morning Post.
  21. ^ Franzen, Carl (8 August 2024). "Alibaba claims no. 1 spot in AI math models with Qwen2-Math". VentureBeat.
  22. ^ a b "Alibaba accelerates AI push by releasing new open-source models, text-to-video". Reuters. September 19, 2024.
  23. ^ Mims, Christopher (April 19, 2024). "Here Come the Anti-Woke AIs". WSJ. Archived from the original on April 23, 2024. Retrieved November 29, 2024.
  24. ^ "Qwen2.5-Max: Exploring the Intelligence of Large-scale MoE Model". Github. 29 January 2025.
  25. ^ Baptista, Eduardo (January 29, 2025). "Alibaba releases AI model it says surpasses DeepSeek". Reuters.
  26. ^ Qwen, Alibaba (February 24, 2025). "QwQ-Max-Preview". X. Archived from the original on 24 February 2025.
  27. ^ Team, Qwen (2025-03-24). "Qwen2.5-VL-32B: Smarter and Lighter". Qwen. Retrieved 2025-03-25.
  28. ^ Nikhil (2025-03-24). "Qwen Releases the Qwen2.5-VL-32B-Instruct: A 32B Parameter VLM that Surpasses Qwen2.5-VL-72B and Other Models like GPT-4o Mini". MarkTechPost. Retrieved 2025-03-25.
  29. ^ a b c Dotson, Kyt (27 March 2025). "Alibaba releases new open-source AI model to power intelligent voice applications". SiliconANGLE.
  30. ^ a b Ara Shaikh, Jasmeen (April 28, 2025). "Alibaba unveils advanced Qwen 3 AI as Chinese tech rivalry intensifies". Reuters.
  31. ^ Wiggers, Kyle (28 April 2025). "Alibaba unveils Qwen3, a family of 'hybrid' AI reasoning models". TechCrunch. Archived from the original on 29 April 2025. Retrieved 29 April 2025.
  32. ^ Team, Qwen (2025-04-29). "Qwen3: Think Deeper, Act Faster". Qwen. Retrieved 2025-04-28.
  33. ^ Kharpal, Arjun (25 August 2023). "Alibaba launches AI model that can understand images and have more complex conversations". CNBC.
  34. ^ 沛霖 (2024-08-13). "阿里通义千问开源 Qwen2-Audio 7B 语音交互大模型：自由互动，无需输入文本". ITHome (Chinese website).
  35. ^ Nuñez, Michael (12 November 2024). "Qwen2.5-Coder just changed the game for AI programming—and it's free". VentureBeat.
  36. ^ Dotson, Kyt (26 December 2024). "Alibaba announces advanced experimental visual reasoning QVQ-72B AI model". SiliconANGLE.
  37. ^ Wiggers, Kyle (27 January 2025). "Alibaba's Qwen team releases AI models that can control PCs and phones". TechCrunch.
  38. ^ Franzen, Carl (5 March 2025). "Alibaba's new open source model QwQ-32B matches DeepSeek-R1 with way smaller compute requirements". VentureBeat.
  39. ^ "Alibaba rolls out new AI coding model Qwen3-Coder, says it's their most powerful". Computerworld. Retrieved 2025-07-24.
[edit]
Licensed under CC BY-SA 3.0 | Source: https://en.wikipedia.org/wiki/Qwen
8 views | Status: cached on August 16 2025 19:54:47
↧ Download as ZWI file
Encyclosphere.org EncycloReader is supported by the EncyclosphereKSF