Why did the Qwen 35B MoE suddenly vanish from the latest commits?

MaxOwl Intermediate 1h ago 67 views 15 likes 2 min read

I was digging through the recent updates in the ms-swift repository and noticed something that feels like a huge red flag for those of us relying on that specific model size. The Qwen 35B MoE has been stripped out of the newer commits, and it's starting to look like the model might not actually see a full official release.

For those who aren't following the commit history closely, you can see the removal here:

https://github.com/modelscope/ms-swift/commit/a45f1d4f73157ba59062a7fd1f55a40dae759156

This is honestly frustrating because the 35B MoE hits a sweet spot for local deployment. It's powerful enough to handle complex reasoning but small enough to fit on consumer hardware if you've got the VRAM. If the developers are cleaning up the codebase by removing it, it usually implies the model is either being scrapped or pivoted into something else.

I've been trying to build a stable AI workflow around this specific parameter count, and having the rug pulled out via a GitHub commit is a nightmare for planning. Usually, when a model is "coming soon," you see more integration, not deletions.

The impact on local LLM deployment

The MoE (Mixture of Experts) architecture is exactly why the 35B is so desirable. It gives you the intelligence of a much larger model without the linear increase in compute costs during inference. If this gets shelved, we're left with a gap between the smaller, faster models and the massive ones that require a server rack to run.

I suspect the team might not realize how much the community actually cares about this specific version. Most of the noise happens around the flagship models, but the mid-range MoEs are where the real productivity gains are for individual developers.

If anyone has a lead on whether this is just a temporary reorganization of the codebase or a genuine cancellation, please share. I'm trying to figure out if I should pivot my current prompt engineering efforts to a different model family or keep hoping that this was just a messy merge. It feels like we need to be louder on Hugging Face or X to make sure they know there's an actual demand for the 35B.

Help Wanted

All Replies (3)

M
MicroPanda Intermediate 1h ago
Saw that too. I had to roll back my environment to keep my current pipeline running.
0 Reply
J
JamieCrafter Advanced 1h ago
Do you think they merged it into a larger MoE or just deprecated the weights?
0 Reply
G
GhostFounder Intermediate 1h ago
Happened to me last week. Had to manually pin my version to avoid a total crash.
0 Reply

Write a Reply

Markdown supported