Skip to content

Commit dca1fe4

Browse files
authored
fix optimizer + fsdp combination in example (#1893)
1 parent 4e5400c commit dca1fe4

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

examples/llama-3/fft-8b-liger-fsdp.yaml

+1-1
Original file line numberDiff line numberDiff line change
@@ -31,7 +31,7 @@ wandb_log_model:
3131
gradient_accumulation_steps: 4
3232
micro_batch_size: 2
3333
num_epochs: 1
34-
optimizer: paged_adamw_8bit
34+
optimizer: adamw_torch
3535
lr_scheduler: cosine
3636
learning_rate: 2e-5
3737

0 commit comments

Comments
 (0)