JSPWiki: Comment: Distillation

More...

这种方式其实并不会大幅降低学生模型的训练成本.

软标签的蒸馏，才有可能大幅降低学生模型的训练成本。但是软标签蒸馏的前提是教师和学生模型是同构的，并且开源

Change Note

Toolbar

link h1 h2 h3 bold italic mono sup sub strike br hr pre code dl toc tab table img quote sign Undo Redo

Find Replace Match Case RegExp Replace all

Comment signature

Your name Remember me?

Homepage or email

Sneak Preview

Add new attachment

Ho hum, it seems that the EditPageHelp page is missing. Someone must’ve done something to the installation...

You can copy the text from the EditPageHelp page on jspwiki.org.

G’day (anonymous guest) My Prefs

View Page Source

睿达智能客服项目
#

团队使命和愿景
团队价值观
第一阶段基于LLM+RAG 方案
第二阶段基于LLM+自成长小模型方案
第三阶段用自成长大模型方案
学术目标
营收目标
技术分享
量化分享
竞争对手
事业伙伴风采
全球倡议

JSPWiki v2.8.3

In order to upload a new attachment to this page, please use the following box to find the file, then click on “Upload”.
Select file:
Change Note:

Toolbar

Add new attachment

睿达智能客服项目#

睿达智能客服项目
#