TokenToSeaSkill 广场
English 控制台

Kermt Add Cmim Pretrain

NVIDIA官方

Convert a grover_base checkpoint (encoder-only or encoder + vocab heads) into a hybrid checkpoint by adding a randomly-initialized cMIM decoder + latent_dist, then continue pretraining on the user's corpus as hybrid (vocab + contrast). Effectively kermt-continue-pretrain with a one-time ckpt-conversion step prepended.

安装

npx skills add NVIDIA/skills --skill kermt-add-cmim-pretrain