AI Distillation Study Reports Uneven Gains From Reweighting Surprising Tokens

A preprint finds that reweighting tokens surprising to an AI student can shift math results, but gains vary by model size and task.

Developing Light · https://developinglight.com/editorial/developing-light