> ## Documentation Index
> Fetch the complete documentation index at: https://miles.radixark.com/docs/llms.txt
> Use this file to discover all available pages before exploring further.

# Qwen

> Miles recipes for the full Qwen3, Qwen3.5, and Next line — dense and MoE, through the Qwen4-architecture Qwen3.8-Flash-Next.

Miles ships ready-to-run RL recipes for every generation of the Qwen line: the dense Qwen3 series (0.6 B → 32 B), the Qwen3.5 family with its gated-attention architecture, the Qwen3 and Qwen3.5 MoE variants, the Gated-Delta-Net Qwen3-Next-80B-A3B, and Qwen3.8-Flash-Next — the GDN + QSA hybrid that previews the Qwen4 architecture.

## Variants

| Family             | Class           | Sizes                                   | Recipe                                                |
| ------------------ | --------------- | --------------------------------------- | ----------------------------------------------------- |
| Qwen3              | Dense           | 0.6 B · 1.7 B · 4 B · 8 B · 14 B · 32 B | [qwen3](/docs/models/qwen/qwen3)                           |
| Qwen3              | MoE             | 3 B / 30 B · 22 B / 235 B               | [qwen3-moe](/docs/models/qwen/qwen3-moe)                   |
| Qwen3.5            | Dense           | 4 B · 9 B · 27 B                        | [qwen3-5](/docs/models/qwen/qwen3-5)                       |
| Qwen3.5            | MoE             | 3 B / 35 B                              | [qwen3-5-moe](/docs/models/qwen/qwen3-5-moe)               |
| Qwen3.6            | Dense           | 27 B                                    | [qwen3-6](/docs/models/qwen/qwen3-6)                       |
| Qwen3.6            | MoE             | 3 B / 35 B                              | [qwen3-6-moe](/docs/models/qwen/qwen3-6-moe)               |
| Qwen3.8            | Dense           | 27 B                                    | [qwen3-8](/docs/models/qwen/qwen3-8)                       |
| Qwen3-Next         | MoE (GDN)       | 3 B / 80 B                              | [qwen3-next](/docs/models/qwen/qwen3-next)                 |
| Qwen3.8-Flash-Next | MoE (GDN + QSA) | 6 B / 176 B                             | [qwen3-8-flash-next](/docs/models/qwen/qwen3-8-flash-next) |

## Fastest path to train

Qwen3-4B on a single 8× H100 node — the canonical starter recipe:

```bash theme={null}
cd /root/miles
hf download Qwen/Qwen3-4B --local-dir /root/models/Qwen3-4B
python scripts/run_qwen3_dense.py --model-name Qwen3-4B
```

Dataset is [DAPO-Math-17k](https://huggingface.co/datasets/zhuzilin/dapo-math-17k) at `/root/datasets/dapo-math-17k/dapo-math-17k.jsonl`. See the [Qwen3 Dense](/docs/models/qwen/qwen3) page for the full walkthrough, weight conversion, and variants.

## Which variant do I pick?

* **Learning Miles for the first time** → Qwen3-4B ([qwen3](/docs/models/qwen/qwen3)). Fits one H100 node, fast loop.
* **Need MoE on a single node** → Qwen3-30B-A3B ([qwen3-moe](/docs/models/qwen/qwen3-moe)).
* **Scaling to multi-node** → Qwen3-235B-A22B ([qwen3-moe](/docs/models/qwen/qwen3-moe)).
* **Latest dense architecture (gated attention, A\_log FP32)** → Qwen3.5-4B ([qwen3-5](/docs/models/qwen/qwen3-5)).
* **Hybrid MTP / speculative decoding experiments** → Qwen3.5-35B-A3B ([qwen3-5-moe](/docs/models/qwen/qwen3-5-moe)).
* **Gated-Delta-Net (fla backend, real-CP)** → Qwen3-Next-80B-A3B ([qwen3-next](/docs/models/qwen/qwen3-next)).
* **Qwen4-architecture preview (hyper-connections, QSA sparse attention, PLE)** → Qwen3.8-Flash-Next ([qwen3-8-flash-next](/docs/models/qwen/qwen3-8-flash-next)).