moefication

Here is 1 public repository matching this topic...

iamboosted / Qwen3.5-9B-Dense-To-Moe

Attempted dense-to-MoE conversion of Qwen 3.5 9B (DeltaNet hybrid) using CMoE and D2DMoE. Documents why post-hoc MoEfication fails on SwiGLU models without extensive sparsification. Negative result.

sparsity moe mixture-of-experts model-conversion llm qwen negative-result moefication

Updated May 28, 2026

Add this topic to your repo

To associate your repository with the moefication topic, visit your repo's landing page and select "manage topics."

Learn more