Skip to content

fp8 moe configs. Mixtral-8x(7B,22B) TP=1,2,4,8 (#250) #739

fp8 moe configs. Mixtral-8x(7B,22B) TP=1,2,4,8 (#250)

fp8 moe configs. Mixtral-8x(7B,22B) TP=1,2,4,8 (#250) #739

mypy (3.12)

succeeded Oct 30, 2024 in 33s