Skip to content

Issues: huggingface/nanotron

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

36 Open 41 Closed
36 Open 41 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

ImportError: cannot import name 'LoggingArgs' from partially initialized module 'nanotron.config.config error (circular imports)
#235 opened Oct 24, 2024 by Akhilvallala2023
Learning rate restart broken with Nanoset?
#233 opened Sep 25, 2024 by Pclanglais
5
[feature] Use Unified Sequence Parallel (USP) instead of Ring attention
#226 opened Sep 1, 2024 by feifeibear
Use different positional embeddings
#225 opened Aug 28, 2024 by aflah02
2
error resuming from checkpoint if PP > 1
#221 opened Aug 23, 2024 by moussaKam
2
Will audio input training be supported in the future? enhancement New feature or request
#210 opened Jul 26, 2024 by zira-wang
multi-node pp hang when enable gradient accumulation
#209 opened Jul 24, 2024 by yuuxiaooqingg
4
[Bug] Missing _is_using_mup when resume checkpoint bug Something isn't working good first issue Good for newcomers help wanted Extra attention is needed
#198 opened Jun 14, 2024 by xrsrke
Add Debug utility to be able to preview first samples used for training good first issue Good for newcomers help wanted Extra attention is needed
#184 opened May 27, 2024 by NouamaneTazi
PyTorch profiler is unable to serialize numpy datatypes sometimes inserted as process group ranks
#177 opened May 22, 2024 by hatanp
We don't save checkpoint after training ends good first issue Good for newcomers help wanted Extra attention is needed Low Priority
#163 opened May 6, 2024 by NouamaneTazi
out of memory for continuing pretraining llama3-8B
#161 opened May 3, 2024 by ckzbullbullet
5
moe in src and load balancing losses
#159 opened May 2, 2024 by haeggee
2
Add data loading time in log
#154 opened Apr 26, 2024 by XinDongol
FEAT: Support 1.58-bit LLMs training enhancement New feature or request good first issue Good for newcomers help wanted Extra attention is needed Low Priority
#114 opened Mar 21, 2024 by younesbelkada
1
[Features] support gradient checkpointing for memory saving
#99 opened Mar 5, 2024 by zguo0525
1
[Feature] All GPUs within the same TP group load training data from shared memory enhancement New feature or request help wanted Extra attention is needed Low Priority
#91 opened Mar 3, 2024 by xrsrke
[Unit Test] Add unit tests for DistributedTrainer good first issue Good for newcomers help wanted Extra attention is needed High Priority
#90 opened Mar 2, 2024 by xrsrke
5
[Unit Test] Add unit test for DoReMi's trainer Medium Priority
#89 opened Mar 2, 2024 by xrsrke
@xrsrke
[Feature] Use CUDA event for measuring elasped time enhancement New feature or request good first issue Good for newcomers help wanted Extra attention is needed
#88 opened Mar 2, 2024 by xrsrke
[Feature] Asyncronous Serialization enhancement New feature or request good first issue Good for newcomers help wanted Extra attention is needed
#87 opened Mar 2, 2024 by xrsrke
[Feature] Kernel Fusion of Layer Norm and GeLU enhancement New feature or request help wanted Extra attention is needed
#86 opened Mar 2, 2024 by xrsrke
[Feature] LAMB optimizer enhancement New feature or request help wanted Extra attention is needed
#85 opened Mar 2, 2024 by xrsrke
[Feature] Parallel transformer block enhancement New feature or request help wanted Extra attention is needed High Priority
#84 opened Mar 2, 2024 by xrsrke
@xrsrke
Continued Pretraining on Llama 7b.
#79 opened Feb 23, 2024 by wiseyy
8
ProTip! no:milestone will show everything without a milestone.