Skip to content

Commit d643a1e

Browse files
committed
remove no exp in moe
1 parent c73595a commit d643a1e

2 files changed

Lines changed: 0 additions & 4 deletions

File tree

src/maxtext/configs/models/deepseek3-671b-2dfsdp.yml

Lines changed: 0 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -70,8 +70,6 @@ logical_axis_rules: [
7070
['activation_stage', 'stage'],
7171
['embed', ['fsdp']],
7272
['embed_moe', ['fsdp']],
73-
['embed_no_exp', ['fsdp']],
74-
['embed_no_exp_moe', ['fsdp']],
7573
['q_lora', ['fsdp']],
7674
['kv_lora', ['fsdp']],
7775
['layers', 'stage'],

src/maxtext/configs/models/deepseek3-671b-batchsplit.yml

Lines changed: 0 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -71,8 +71,6 @@ logical_axis_rules: [
7171
['activation_stage', 'stage'],
7272
['embed', ['fsdp']],
7373
['embed_moe', ['fsdp']],
74-
['embed_no_exp', ['fsdp']],
75-
['embed_no_exp_moe', ['fsdp']],
7674
['q_lora', ['fsdp']],
7775
['kv_lora', ['fsdp']],
7876
['layers', 'stage'],

0 commit comments

Comments
 (0)