DevOps & Infrastructure

KERMT Pretrain Scratch

Pretrain a fresh KERMT model from scratch on a user-provided corpus. Builds a new vocabulary from the corpus, instantiates the model architecture from defaults, and launches pretrain_ddp.py inside the kermt container (detached for long runs). Unlike kermt-continue-pretrain, no starting checkpoint is loaded — the model is randomly initialized.

Publisher / source
NVIDIA Skills (Verified)
Upstream record
NVIDIA/skills
Version
Version 2
Published
Publication review
Approved for publication
Content fingerprint
33f9eeb51b365351e708f5411c19b6bdedc2e6371130a1dff7ab5382713f7fa1