Low Precision RL
Unified block-wise FP8, MXFP8, and NVFP4 recipes with matched training and
rollout precision.
INT4 QAT
W4A16 quantization-aware training for fitting large models on a single
8-GPU node.
Rollout Routing Replay (R3)
Capture expert routing during inference and replay during training. The
mechanism that keeps MoE RL stable.
Speculative Decoding
Draft + target speculative rollout, with online MTP-SFT for the draft.
On-Policy Distillation
Train a student on its own rollouts while matching teacher token
probabilities through SGLang or Megatron teacher modes.
Disaggregated RL Rollout
Scale rollout across clusters and regions through an independent service,
with versioned policy publication and request attribution.
LoRA Training and Serving
Train LoRA adapters with SFT or RL and serve them through SGLang from the
same checkpoint.