Qwen3.8-Flash-Next

Qwen3.8-Flash-Next is Alibaba's open-weight release from August 26, 2026 that previews the architecture behind the upcoming Qwen4 family. It is a multimodal mixture-of-experts model with 125B total parameters but only 6B active per token, plus a 51B-parameter N-gram embedding layer that runs in system RAM rather than GPU memory. The team frames it as "a new architecture, towards ultimate cost-efficiency": it delivers better results than Qwen3.7-Plus at roughly one-ninth the training cost.

Model Specifications

Key Features

• Qwen4 architecture preview: the hybrid Gated DeltaNet + Gated Attention design first seen in Qwen3-Next is released early so the community can examine the architecture before the full Qwen4 family is built on it.
• Very sparse activation: only 6B parameters are active per token out of 125B, which keeps inference cost low while holding onto a large parameter budget.
• N-gram embedding layer: a 51B-parameter "phrase dictionary" that stores common word groups as standalone entries, sitting in regular system RAM at relatively low additional cost.
• Multimodal: native image-text-to-text input covers screenshots, charts, and document understanding.
• Cost-efficiency play: roughly one-ninth the training cost of Qwen3.7-Plus with better results, with the largest gains in coding and office tasks.
• ModelScope + Transformers support: first-class ModelScope support with OpenAI and Anthropic-compatible API specifications, plus easy local serving via transformers serve.

Use Cases

Who Should Use This Tool?

• Architecture watchers who want to see the next-generation Qwen design before the Qwen4 family lands.
• Cost-sensitive builders who want a small-active-count MoE for agentic coding and office workloads.
• Local deployers with a GPU that can hold a 125B model, since the N-gram layer offloads to RAM.
• Teams already on Qwen Cloud who want the production Qwen3.8-Flash API when it goes live.

Problems It Solves

1. Training cost: an earlier architecture release lets the community prototype against Qwen4's efficiency at a fraction of the compute.
2. Inference cost: 6B active out of 125B means cheap per-token serving with a large total capacity.
3. Memory pressure: the 51B N-gram table lives in system RAM, so a large chunk of the model never needs to touch the GPU.

Pricing

Weights are free to download from Hugging Face or ModelScope (Qwen license). The hosted path is Qwen3.8-Flash on QwenCloud, priced at $0.16 per million input tokens and $0.47 per million output tokens; a production API version was announced as coming soon. For reference, the flagship Qwen3.8-Max is about twelve times that on both input and output.

Advantages & Unique Selling Points

Compared to Competitors:

1. Versus Qwen3.7-Plus: better results at roughly one-ninth the training cost, with the biggest wins in coding and office tasks.
2. Versus DeepSeek-V4-Flash: leads the majority of published benchmark tasks despite being a smaller-active-parameter model.
3. Versus Qwen3.8-Max: sits just below the flagship but costs about one-twelfth as much, an order-of-magnitude gap on both input and output.
4. Versus Anthropic Claude Opus 4.6: wins across most tested rows on Qwen's published leaderboard.

What Makes It Stand Out:

• The N-gram embedding layer runs in RAM, an unusual split that lowers GPU memory pressure.
• It is the early look at Qwen4, not a point upgrade of an existing generation.

User Reviews

Community reception was strong and fast-moving. On r/opencode and r/LocalLLaMA, Qwen released Qwen3.8-Flash-Next the same day as GLM-5.3-Flash, and the two became the day's main talking point. Existing Qwen3.8-27B users noted the family's tendency to overthink, a trait carried forward. On the NVIDIA DGX Spark forums, builders weighed whether a 6B-active model can run a quantized FP8 variant on dual sparks, noting the large embedding table raises questions about the dtype and quantization of those 51B parameters.

Getting Started

Quick Start Guide

1. Download: pull the weights from Huyuqi Face or ModelScope, e.g. huggingface download Qwen/Qwen3.8-Flash-Next.
2. Serve locally: run transformers serve Qwen/Qwen3.8-Flash-Next, or use a local runtime with a quantized build to fit your GPU.
3. Use Qwen Code: pair it with the open-source terminal coding agent optimized for Qwen models.
4. Go hosted: call the Qwen3.8-Flash API on QwenCloud, which supports OpenAI and Anthropic-compatible specs.

Integration

• Hugging Face and ModelScope for weights, fine-tuning (via LLaMA-Factory), and serving.
• Qwen Cloud API with OpenAI and Anthropic-compatible specifications.
• Qwen Code, the open-source terminal coding agent.

Frequently Asked Questions

Is Qwen3.8-Flash-Next a MoE model?

Yes. It is a multimodal MoE with 125B total parameters and 6B active per token, plus a 51B N-gram embedding layer.

Is it the Qwen4 model?

No. It is an early architecture preview of Qwen4. The full Qwen4 family will be built on this design, but this release is the experimental precursor.

What is the context window?

262,144 tokens natively, extensible to roughly one million tokens using YaRN.

What is the license?

The weights carry a Qwen-specific license (not Apache 2.0), downloadable from Hugging Face and ModelScope. The production Qwen3.8-Flash API is a hosted service.

Alternatives

• Qwen3.8-27B: a dense Apache 2.0 companion for local deployment and small-batch inference.
• GLM-5.3-Flash: another August 26 cost-efficiency release, 320B total / 18B active, MIT.
• DeepSeek V4 Flash: a strong open model for cost-sensitive agentic workloads.

Tips & Best Practices

1. Plan for the embedding table: the 51B N-gram parameters mostly sit in RAM, so memory planning differs from a typical MoE; confirm the dtype and quantization before deployment.
2. Watch the "preview" caveat: this is an architecture release, so benchmark on your own tasks before relying on it for production.
3. Match to hardware: a 6B-active model is the kind of build that runs fast on dual-Spark or modest GPU setups once the embedding table is offloaded.

Conclusion

Qwen3.8-Flash-Next is Alibaba's open look at how it intends to build Qwen4: very sparse activation, a RAM-resident N-gram table, and a training cost roughly one-ninth that of the previous generation while beating it on coding and office work. For builders who want a cheap, current-generation open-weight MoE with a glimpse of what comes next, it is the release to examine. Start with the Qwen blog announcement or the GitHub repo for the technical report.