-
Notifications
You must be signed in to change notification settings - Fork 178
Pull requests: pytorch/torchtitan
Author
Label
Projects
Milestones
Reviews
Assignee
Sort
Pull requests list
[DO NOT REVIEW] gaps to enable FDSP2 cpu offloading
CLA Signed
This label is managed by the Meta Open Source bot.
#622
opened Oct 16, 2024 by
weifengpy
Loading…
[Not for land] Settings to make Llama3-8B on 8 GPUs faster
CLA Signed
This label is managed by the Meta Open Source bot.
[not for land] TE experiments, take 2
CLA Signed
This label is managed by the Meta Open Source bot.
#614
opened Oct 14, 2024 by
vkuzo
Loading…
[DO NOT REVIEW] --experimental.fsdp_sharding_on_largest_dim
CLA Signed
This label is managed by the Meta Open Source bot.
#607
opened Oct 9, 2024 by
weifengpy
Loading…
ensure reproducible determinsitc numerics
CLA Signed
This label is managed by the Meta Open Source bot.
#597
opened Oct 2, 2024 by
weifengpy
Loading…
fix mixed precision for This label is managed by the Meta Open Source bot.
replicate
/ pure DDP
CLA Signed
#591
opened Sep 29, 2024 by
152334H
Loading…
[not for land yet] hack max and abs out of ops eligible for AC
CLA Signed
This label is managed by the Meta Open Source bot.
#580
opened Sep 17, 2024 by
vkuzo
Loading…
add pp validation for schedule
CLA Signed
This label is managed by the Meta Open Source bot.
#568
opened Sep 5, 2024 by
H-Huang
Loading…
Moved logits This label is managed by the Meta Open Source bot.
.float()
to loss and compiled it if compiling
CLA Signed
#551
opened Aug 21, 2024 by
awgu
Loading…
[DO NOT REVIEW] Runtime estimation with FakeTensor + TorchDispatchMode
CLA Signed
This label is managed by the Meta Open Source bot.
#536
opened Aug 20, 2024 by
weifengpy
Loading…
[Not for land] Added changes for GPT-2 perf
CLA Signed
This label is managed by the Meta Open Source bot.
[Not for land] Added GPT-2-like config
CLA Signed
This label is managed by the Meta Open Source bot.
[torchtitan][debug] integrated CommDebugMode into TorchTitan
CLA Signed
This label is managed by the Meta Open Source bot.
#480
opened Jul 24, 2024 by
sinhaanshul
Loading…
[not for land] TE experiments
CLA Signed
This label is managed by the Meta Open Source bot.
#477
opened Jul 23, 2024 by
vkuzo
Loading…
[POC] Adam-mini without explicit collectives
CLA Signed
This label is managed by the Meta Open Source bot.
Updates to support new sdpa function
CLA Signed
This label is managed by the Meta Open Source bot.
#458
opened Jul 13, 2024 by
jainapurva
•
Draft
Fix parsing of pp split points from toml file
CLA Signed
This label is managed by the Meta Open Source bot.
[DO NOT MERGE][example] fold batch and sequence dimensions to accelerate Sequence Parallel
CLA Signed
This label is managed by the Meta Open Source bot.
#437
opened Jul 4, 2024 by
tianyu-l
Loading…
Add load from HF ckpts to FSDP model fails.
CLA Signed
This label is managed by the Meta Open Source bot.
#427
opened Jun 25, 2024 by
MinghaoYan
•
Draft
Previous Next
ProTip!
What’s not been updated in a month: updated:<2024-09-17.