TokenToSeaSkills Hub
中文 Console

Kermt Add Cmim Pretrain

NVIDIAOfficial

Convert a grover_base checkpoint (encoder-only or encoder + vocab heads) into a hybrid checkpoint by adding a randomly-initialized cMIM decoder + latent_dist, then continue pretraining on the user's corpus as hybrid (vocab + contrast). Effectively kermt-continue-pretrain with a one-time ckpt-conversion step prepended.

Install

npx skills add NVIDIA/skills --skill kermt-add-cmim-pretrain