View Attach Info

这种方式其实并不会大幅降低学生模型的训练成本.

软标签的蒸馏，才有可能大幅降低学生模型的训练成本。但是软标签蒸馏的前提是教师和学生模型是同构的，并且开源

Add new attachment

In order to upload a new attachment to this page, please use the following box to find the file, then click on “Upload”.
« This page (revision-3) was last changed on 26-Feb-2026 11:28 by 14.155.118.177