Mcore Migrate Gpt To Hybrid
NVIDIA/Megatron-LM/skills/mcore-migrate-gpt-to-hybrid
ai-mlOfficial
Official Provider SkillView repo
Migration guide for moving Megatron Core GPTModel checkpoints, model providers, training commands, and layer mappings to HybridModel, including the mechanical steps for transferring an existing pretrain_gpt.py launch script.
Files1 files
SKILL.md151 lines
Loading editor…
Install
RecommendedOne command — your agent picks it up automatically.
Select an AI agent above to see the install command.
or
Manual Install
More stepsDownload the file and paste it into your agent's system prompt.
Skill details
Versionv1.0.0
AuthorNVIDIA
Categoryai-ml
Skill IDNVIDIA/Megatron-LM/skills/mcore-migrate-gpt-to-hybrid
Related skills
Mcore Build And DependencyContainer-based dev environment setup and dependency management for Megatron-LM. Covers acquiring and launching the CI container, uv package management, and updating uv.lock.Mcore Bump Base ImageBump the NVIDIA PyTorch base image (`nvcr.io/nvidia/pytorch:YY.MM-py3`) used by Megatron-LM CI. Covers the two pin sites (GitHub CI in `docker/.ngc_version.dev` and GitLab CI in `.gitlab/stages/01.build.yml`), the post-bump CI loop (re-run functional tests, refresh golden values, mark broken tests), and the gotchas that bit PRsMcore CicdCI/CD reference for Megatron-LM. Covers CI pipeline structure, PR scope labels, triggering internal GitLab CI (which force-pushes the current branch to a pull-request/BRANCH ref — always dry-run and verify the destination first; never run against shared or protected branches), and CI failure investigation.Mcore Create IssueInvestigate a failing GitHub Actions run or job and create a GitHub issue for the failure.Mcore Linting And FormattingLinting and formatting for Megatron-LM. Covers running autoformat.sh, tools (ruff, black, isort, pylint, mypy), and code style rules.Mcore Onboard Gb200 1node TestsOnboard 1-node GitHub MR functional tests for GB200 from existing mr-scoped 2-node tests.