QwQ-32B-Preview logo

QwQ-32B-Preview

Visit

QwQ-32B-Preview is Qwen's experimental 32B reasoning model from November 2024, built on Qwen2.5-32B with 32,768 context under Apache 2.0; QwQ-32B followed.

Share:
View alternatives

QwQ-32B-Preview is an experimental research model from the Qwen Team, announced in a blog post dated November 28, 2024, and focused on AI reasoning. The Hugging Face card lists about 32.5B parameters, a 32,768-token context length and the Apache-2.0 license, and says it is built on Qwen2.5-32B. It was a preview, and on March 6, 2025 the Qwen Team published its QwQ-32B reasoning model, trained with scaled reinforcement learning and also released under Apache 2.0.

Key features

  • Architecture: per the card, a causal language model with RoPE, SwiGLU, RMSNorm and attention QKV bias, 64 layers, and grouped-query attention with 40 query heads and 8 key-value heads.
  • Context: 32,768 tokens.
  • Vendor benchmark claims from the blog post: GPQA 65.2%, AIME 50.0%, MATH-500 90.6% and LiveCodeBench 50.0%. These are Qwen's own results.
  • Stated limitations: unexpected language mixing or switching, circular reasoning loops that produce long answers without a conclusion, a need for stronger safety measures, and weaker common-sense reasoning and nuanced language understanding than its math and coding strength.
  • License: Apache-2.0 on the Hugging Face card.

Use cases

  • Studying early open reasoning models and how their outputs differ from standard chat models.
  • Math and coding experiments on local hardware that can host a 32B model.
  • Comparing the preview with the later QwQ-32B release.

Pricing and availability

The weights are free to download from Hugging Face under Apache-2.0. Qwen describes the model as an experimental research model, so treat it as a preview, not a production default. The card requires a recent transformers version, since versions before 4.37.0 fail with a KeyError: 'qwen2'. We checked the sources on 2026-10-29. The cards list no hosted price.

Getting started

  1. Update transformers to a recent version.
  2. Load Qwen/QwQ-32B-Preview from Hugging Face and use its chat template.
  3. Allow long generations, since reasoning outputs can be lengthy, and watch for language mixing or loops.
  4. For new work, evaluate QwQ-32B (March 2025), which Qwen released as a follow-up reasoning model.

FAQ

What is QwQ-32B-Preview?

An experimental 32B reasoning model from the Qwen Team, announced November 28, 2024.

What is its context length?

32,768 tokens, per the Hugging Face card.

What came after it?

QwQ-32B, published March 6, 2025 under Apache 2.0, trained with scaled reinforcement learning.

What are its known problems?

Qwen lists language mixing, circular reasoning loops, a need for stronger safety measures, and weaker common-sense reasoning.

Is it open source?

The weights are on Hugging Face under Apache-2.0.

Alternatives

Conclusion

QwQ-32B-Preview is an early open reasoning model with clear limits and an open license, now followed by QwQ-32B. Read the blog post and model card, and browse more in the models category.

Comments

No comments yet. Be the first to comment!