Skip to content

fix(gemma4_moe): re-tie lm_head to active embed_tokens on MoE path#2601

Merged
yuhezhang-ai merged 4 commits into
NVIDIA-NeMo:mainfrom
Achyuthan-S:Achyuthan-S/fix/gemma4-moe-tied-lm-head
Jun 22, 2026
Merged

fix(gemma4_moe): re-tie lm_head to active embed_tokens on MoE path#2601
yuhezhang-ai merged 4 commits into
NVIDIA-NeMo:mainfrom
Achyuthan-S:Achyuthan-S/fix/gemma4-moe-tied-lm-head

fix(gemma4_moe): make lm_head re-tie follow top-level config flag

bed4c65
Select commit
Loading
Failed to load commit list.
DCO / DCO succeeded Jun 17, 2026 in 0s

DCO

All commits are signed off!

View more details on DCO