Perplexity and NVIDIA proposed JOLT a self-distillation training method
The report states that Perplexity and NVIDIA proposed JOLT, incorporating the teacher branch into training as well, and achieved Qwen3-0.6B accuracy in the MATH test. 72.14%AppWorld results show higher performance after adding the student's final task reward.