Model card
MiMo-V2.6-Distill-Qwen-9B-GGUF is a distilled multimodal model optimized for efficient image-to-text reasoning. Built on the Qwen architecture, this 9B parameter model bridges the gap between heavy vision-language models and lightweight edge deployments. By utilizing the GGUF format, it is specifically tailored for quantized inference, making it highly compatible with llama.cpp and various local execution environments. For developers, this means you can run sophisticated visual question answering (VQA), detailed image captioning, and document parsing tasks on consumer-grade hardware without the massive VRAM overhead of larger vision transformers. While it lacks the raw scale of massive frontier models, its distilled nature offers a high performance-to-latency ratio, making it an ideal candidate for real-time vision agents or integrated multimodal chatbots where speed and local privacy are non-negotiable.
Model files and versions
Download this model
We recommend using the ModelScope CLI or SDK. Install ModelScope first, then choose a full snapshot, single file, SDK or Git LFS workflow.
bartowski/MiMo-V2.6-Distill-Qwen-9B-GGUFInstall the CLI and SDK dependency before downloading.
pip install modelscopeDownload the complete weights, configuration and model card.
modelscope download --model bartowski/MiMo-V2.6-Distill-Qwen-9B-GGUFREADME.md is used as an example; replace it with another repository file when needed.
modelscope download --model bartowski/MiMo-V2.6-Distill-Qwen-9B-GGUF README.md --local_dir ./dirUseful in Python projects and automation scripts.
from modelscope import snapshot_download
model_dir = snapshot_download('bartowski/MiMo-V2.6-Distill-Qwen-9B-GGUF')Make sure Git LFS is installed correctly.
git lfs install
git clone https://www.modelscope.cn/bartowski/MiMo-V2.6-Distill-Qwen-9B-GGUF.gitFetch the repository structure first, then pull large files when needed.
GIT_LFS_SKIP_SMUDGE=1 git clone https://www.modelscope.cn/bartowski/MiMo-V2.6-Distill-Qwen-9B-GGUF.gitHow to use
- 01Step 1
Read the model card and source information.
- 02Step 2
Start with a small, non-sensitive evaluation.
- 03Step 3
Review quality, licensing and usage limits.
- 04Step 4
Adopt it only after validation.
Discussions
Use this space to keep checking source information, usage experience and maintenance status.
Open source page