Skip to content

Commit

Permalink
Replace TE patch with TE+dropout patch (#288)
Browse files Browse the repository at this point in the history
Transformer Engine in Pax currently lacks dropout support. This PR
updates the TE patch to add support dropout.
  • Loading branch information
ashors1 authored Oct 9, 2023
1 parent 003240c commit 71b1c45
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion rosetta/patchlist-paxml.txt
Original file line number Diff line number Diff line change
Expand Up @@ -5,4 +5,4 @@
# - External Pull Requests (These are pull requests with upstream paxml and are of the form "pull/$PULLID/head")
# - Note: Only the first column is used as a git-ref, so anything after is a comment

pull/46/head # adds Transformer Engine support
mirror/patch/add_dropout_support_to_te # adds Transformer Engine support (+ dropout support)

0 comments on commit 71b1c45

Please sign in to comment.