Model card
Ternary-Bonsai-2-27B-Abliterated is a specialized GGUF quantization of the 27B parameter Bonsai-2 architecture, fine-tuned specifically to minimize refusal triggers and alignment constraints. For developers working on uncensored roleplay, creative writing, or complex instruction-following tasks where standard safety filters often cause false positives, this model offers a significantly more permissive reasoning path. By utilizing the GGUF format, it is optimized for efficient deployment on consumer-grade hardware via llama.cpp, making it highly accessible for local inference. While it maintains the core logic and linguistic capabilities of the base model, the 'abliterated' technique fundamentally alters its response patterns to ensure higher compliance with user prompts. It sits in a sweet spot for developers who need a medium-sized model that balances high-quality prose with a lack of restrictive guardrails, making it a robust choice for private, local-first AI applications.
Model files and versions
Download this model
We recommend using the ModelScope CLI or SDK. Install ModelScope first, then choose a full snapshot, single file, SDK or Git LFS workflow.
Hikari07jp/Ternary-Bonsai-2-27B-Abliterated-GGUFInstall the CLI and SDK dependency before downloading.
pip install modelscopeDownload the complete weights, configuration and model card.
modelscope download --model Hikari07jp/Ternary-Bonsai-2-27B-Abliterated-GGUFREADME.md is used as an example; replace it with another repository file when needed.
modelscope download --model Hikari07jp/Ternary-Bonsai-2-27B-Abliterated-GGUF README.md --local_dir ./dirUseful in Python projects and automation scripts.
from modelscope import snapshot_download
model_dir = snapshot_download('Hikari07jp/Ternary-Bonsai-2-27B-Abliterated-GGUF')Make sure Git LFS is installed correctly.
git lfs install
git clone https://www.modelscope.cn/Hikari07jp/Ternary-Bonsai-2-27B-Abliterated-GGUF.gitFetch the repository structure first, then pull large files when needed.
GIT_LFS_SKIP_SMUDGE=1 git clone https://www.modelscope.cn/Hikari07jp/Ternary-Bonsai-2-27B-Abliterated-GGUF.gitHow to use
- 01Step 1
Read the model card and source information.
- 02Step 2
Start with a small, non-sensitive evaluation.
- 03Step 3
Review quality, licensing and usage limits.
- 04Step 4
Adopt it only after validation.
Discussions
Use this space to keep checking source information, usage experience and maintenance status.
Open source page