Skip to content

Commit

Permalink
Tune fused_moe_kernel for TP 1,2,4,8 and bf16 and fp16, updated moe k…
Browse files Browse the repository at this point in the history 
…ernel tuning script for rocm.

Merge pull request #33  - tuned moe configs v2
  • Loading branch information
@hthangirala
hthangirala authored Jun 14, 2024
2 parents 0438499 + fd04661 commit 38ada92
Show file tree
Hide file tree
Showing 6 changed files with 922 additions and 198 deletions.
Loading

0 comments on commit 38ada92

Please sign in to comment.