no code implementations • COLING 2022 • Mehdi Rezagholizadeh, Aref Jafari, Puneeth Salad, Pranav Sharma, Ali Saheb Pasand, Ali Ghodsi
A case in point is that the best performing checkpoint of the teacher might not necessarily be the best teacher for training the student in KD.