Category: Knowledge Distillation

• Is Your Model's Attention Drifting? RUC and Tsinghua University Introduce LeaF: Pruning Distracting Tokens for Focused Learning
• NVIDIA's Llama Nemotron Series: Key Technologies Explained
• ZTE Research: LLM Adaptive Question Difficulty Grading Distillation Gives Small Models 'Long Chain Thinking'