Search results

MegatronMIMO 2026 Q3-Q4 Roadmap

area:modelModel implementations and HF bridge logicModel implementations and HF bridge logic

featureNew capabilities, enhancements, or enablement workNew capabilities, enhancements, or enablement work

roadmap

trackingTracking issue for an ongoing project with smaller stepsTracking issue for an ongoing project with smaller steps

Status: Open.

#4392 In NVIDIA-NeMo/Megatron-Bridge;

· liding-nv opened on Jun 16, 2026

[feature] Support offline tokenized + index-only packed mode for SFT datasets

area:dataDataset builders, preprocessing, and samplersDataset builders, preprocessing, and samplers

community-request

featureNew capabilities, enhancements, or enablement workNew capabilities, enhancements, or enablement work

needs-triageNew item needs classification and ownershipNew item needs classification and ownership

Status: Open.

#4351 In NVIDIA-NeMo/Megatron-Bridge;

· muyihao opened on Jun 14, 2026

[feature] Move Energon task-encoder construction into the provider's build_datasets() to avoid drifting from the overridden config

area:dataDataset builders, preprocessing, and samplersDataset builders, preprocessing, and samplers

community-request

featureNew capabilities, enhancements, or enablement workNew capabilities, enhancements, or enablement work

needs-triageNew item needs classification and ownershipNew item needs classification and ownership

Status: Open.

#4343 In NVIDIA-NeMo/Megatron-Bridge;

· nayopu opened on Jun 13, 2026

Qwen3.6 MoE/MTP bridge mapping should use fused MTP expert tensors

area:modelModel implementations and HF bridge logicModel implementations and HF bridge logic

bugSomething isn't workingSomething isn't working

community-request

needs-triageNew item needs classification and ownershipNew item needs classification and ownership

Status: Open.

#4329 In NVIDIA-NeMo/Megatron-Bridge;

· LoganVegnaSHOP opened on Jun 12, 2026

Qwen3-VL MTP embedding path needs CP shard before SP scatter

area:modelModel implementations and HF bridge logicModel implementations and HF bridge logic

bugSomething isn't workingSomething isn't working

community-request

waiting-on-maintainersWaiting on maintainers to respondWaiting on maintainers to respond

Status: Open.

#4328 In NVIDIA-NeMo/Megatron-Bridge;

· LoganVegnaSHOP opened on Jun 12, 2026

GDN TransformerConfig construction still rejects context parallelism

area:trainingTraining loop, callbacks, and runtime integrationTraining loop, callbacks, and runtime integration

bugSomething isn't workingSomething isn't working

community-request

needs-triageNew item needs classification and ownershipNew item needs classification and ownership

Status: Open.

#4327 In NVIDIA-NeMo/Megatron-Bridge;

· LoganVegnaSHOP opened on Jun 12, 2026

[bug] [DSV4-Flash] fused_mla_rope_inplace produces NaN/extreme attention output at iter-1 on H100

area:perfPerformance optimizations and benchmarkingPerformance optimizations and benchmarking

bugSomething isn't workingSomething isn't working

community-request

needs-triageNew item needs classification and ownershipNew item needs classification and ownership

Status: Open.

#4321 In NVIDIA-NeMo/Megatron-Bridge;

· linmuchuiyang opened on Jun 12, 2026

Add lazy per-model Transformers version guards for Bridge

area:buildDependencies, packaging, images, and environment setupDependencies, packaging, images, and environment setup

featureNew capabilities, enhancements, or enablement workNew capabilities, enhancements, or enablement work

trackingTracking issue for an ongoing project with smaller stepsTracking issue for an ongoing project with smaller steps

Status: Open.

#4314 In NVIDIA-NeMo/Megatron-Bridge;

· cuichenx opened on Jun 11, 2026

Improve Megatron Bridge UX based on prototype MBridge comparison

area:ckptCheckpoint conversion, loading, export, and save pathsCheckpoint conversion, loading, export, and save paths

area:modelModel implementations and HF bridge logicModel implementations and HF bridge logic

featureNew capabilities, enhancements, or enablement workNew capabilities, enhancements, or enablement work

trackingTracking issue for an ongoing project with smaller stepsTracking issue for an ongoing project with smaller steps

Status: Open.

#4294 In NVIDIA-NeMo/Megatron-Bridge;

· yaoyu-33 opened on Jun 11, 2026

[bug] Reduce layer count in nemo:26.04 to prevent OverlayFS max depth exceeded errors

area:buildDependencies, packaging, images, and environment setupDependencies, packaging, images, and environment setup

bugSomething isn't workingSomething isn't working

community-request

waiting-on-maintainersWaiting on maintainers to respondWaiting on maintainers to respond

Status: Open.

#4266 In NVIDIA-NeMo/Megatron-Bridge;

· anuragmudgil0699 opened on Jun 10, 2026

[bug] nemotron_omni SFT loss mask never supervises assistant <|im_end|> terminator, so free-form fine-tunes fail to learn when to stop

area:dataDataset builders, preprocessing, and samplersDataset builders, preprocessing, and samplers

bugSomething isn't workingSomething isn't working

community-request

waiting-on-maintainersWaiting on maintainers to respondWaiting on maintainers to respond

Status: Open.

#4265 In NVIDIA-NeMo/Megatron-Bridge;

· ShiChenAI opened on Jun 10, 2026

[26.08] Extended Megatron FSDP example: verify combinations & document caveats

area:trainingTraining loop, callbacks, and runtime integrationTraining loop, callbacks, and runtime integration

featureNew capabilities, enhancements, or enablement workNew capabilities, enhancements, or enablement work

trackingTracking issue for an ongoing project with smaller stepsTracking issue for an ongoing project with smaller steps

Status: Open.

#4246 In NVIDIA-NeMo/Megatron-Bridge;

· cuichenx opened on Jun 9, 2026