Self-Distillation

AdviSD: Steering Frontier LLMs via Targeted Multi-Turn Self-Distillation

微型顧問的逆襲：AdviSD 透過目標多輪自我蒸餾精準引導前沿大模型

AdviSD enables a small trainable advisor to steer frozen frontier LLMs using natural-language advice, leveraging selective self-distillation to filter and learn only from high-impact corrections.