Adaptive Temperature Distillation Shrinks Multilingual AI Models for Classroom Use
A new distillation framework that adjusts its temperature per language and sample compresses a 560-million-parameter multilingual model into a 66-million-parameter ...

