Mcore Migrate Gpt To Hybrid
NVIDIA/Megatron-LM/skills/mcore-migrate-gpt-to-hybrid
ai-mlResmi
Resmi Sağlayıcı Skill'iView repo
Migration guide for moving Megatron Core GPTModel checkpoints, model providers, training commands, and layer mappings to HybridModel, including the mechanical steps for transferring an existing pretrain_gpt.py launch script.
Dosyalar1 dosya
SKILL.md151 satır
Loading editor…
Kurulum
ÖnerilenTek komut — ajanınız otomatik olarak devreye alır.
Kurulum komutunu görmek için yukarıdan bir AI aracı seçin.
veya
Manuel Kurulum
Daha fazla adımDosyayı indirin ve ajanınızın sistem istemine yapıştırın.
Skill detayları
Versiyonv1.0.0
YazarNVIDIA
Kategoriai-ml
Skill IDNVIDIA/Megatron-LM/skills/mcore-migrate-gpt-to-hybrid
İlgili skill'ler
Mcore Build And DependencyContainer-based dev environment setup and dependency management for Megatron-LM. Covers acquiring and launching the CI container, uv package management, and updating uv.lock.Mcore Bump Base ImageBump the NVIDIA PyTorch base image (`nvcr.io/nvidia/pytorch:YY.MM-py3`) used by Megatron-LM CI. Covers the two pin sites (GitHub CI in `docker/.ngc_version.dev` and GitLab CI in `.gitlab/stages/01.build.yml`), the post-bump CI loop (re-run functional tests, refresh golden values, mark broken tests), and the gotchas that bit PRsMcore CicdCI/CD reference for Megatron-LM. Covers CI pipeline structure, PR scope labels, triggering internal GitLab CI (which force-pushes the current branch to a pull-request/BRANCH ref — always dry-run and verify the destination first; never run against shared or protected branches), and CI failure investigation.Mcore Create IssueInvestigate a failing GitHub Actions run or job and create a GitHub issue for the failure.Mcore Linting And FormattingLinting and formatting for Megatron-LM. Covers running autoformat.sh, tools (ruff, black, isort, pylint, mypy), and code style rules.Mcore Onboard Gb200 1node TestsOnboard 1-node GitHub MR functional tests for GB200 from existing mr-scoped 2-node tests.