View Attach Info
This is version . It is not the current version, and thus it cannot be edited.
[Back to current version]   [Restore this version]

这种方式其实并不会大幅降低学生模型的训练成本.

软标签的蒸馏，才有可能大幅降低学生模型的训练成本。但是软标签蒸馏的前提是教师和学生模型是同构的，并且开源

Add new attachment

In order to upload a new attachment to this page, please use the following box to find the file, then click on “Upload”.
« This particular version was published on 17-Jan-2026 11:44 by 185.140.209.89.