Talk:Qwen

Qwen is not based on Llama.

The source does not say that Qwen is just a modified version of Llama, as the article insinuates. It just says that it used a similar training method. Rajaseas (talk) 01:03, 11 March 2025 (UTC)

"Qwen is just a modified version of Llama" is not the same statement as "Qwen's architecture was based on Llama."

>It just says that it used a similar training method.

What do you mean by this? What is a training method? What is the difference between a training method and an architecture?

The Qwen whitepaper states:

>ARCHITECTURE

>QWEN is designed using a modified version of the Transformer architecture. Specifically, we have adopted the recent open-source approach of training large language models, LLaMA (Touvron et al., 2023a), which is widely regarded as the top open-source LLM.

To me, "Specifically" modifies "modified version of the Transformer architecture" and "adopted the recent open-source approach of training large language models, LLaMA" is what specifies it. I don't see any other way to read it. Similarly, The techmemo states:

>Qwen-7B is a transformer-based decoder-only language model with an architecture similar to the LLaMA series of models

and

>Model architecture: Qwen-7B is built with architecture similar to LLaMA

Is there a difference between the statements "Qwen's architecture is similar to that of Llama" and "Qwen's architecture was based on Llama," taking into account that Qwen was aware of llama and states that it adopted it? It's not like the architecture was similar by happenstance. J2UDY7r00CRjH (talk) 01:49, 11 March 2025 (UTC)

I removed "with various modifications," which was based on the line "Our modifications to the architecture include" followed by five modifications. Does this help? J2UDY7r00CRjH (talk) 01:55, 11 March 2025 (UTC)

Wiki Education assignment: WRIT 340 for Engineers - Spring 2026 -8am

This article was the subject of a Wiki Education Foundation-supported course assignment, between 7 January 2026 and 30 April 2026. Further details are available on the course page. Student editor(s): S.luna3, Cylius4 (article contribs).

— Assignment last updated by 1namesake1 (talk) 16:25, 31 March 2026 (UTC)

Should we add the pronunciation of Qwen (/kwɛn/)?

From official videos, for example https://www.youtube.com/watch?v=y7qGprw0Ybs, Qwen appears to be pronounced as /kwɛn/. Since the pronunciation is not very clear from the name itself, should the pronunciation be added to the article?

I could not find a non-YouTube source to support this point, and I am not very familiar with English Wikipedia's writing and sourcing standards. Therefore, I am proposing this change here first, and I hope more experienced editors can decide whether this addition is meaningful and whether the source is acceptable. Michael nju (talk) 11:56, 14 June 2026 (UTC)