Overview

Pony Diffusion V6 XL is a specialized fine-tune of SDXL designed for high-fidelity character generation and precise stylistic control. Unlike general-purpose base models, V6 XL is trained on a curated dataset that excels at understanding natural language prompts alongside tag-based descriptors, making it a powerful tool for developers building AI art pipelines or character-driven assets. It significantly reduces the 'prompt fighting' common in earlier models, offering superior anatomical accuracy and a vast range of artistic styles. Integration is straightforward via standard Diffusers or ComfyUI workflows, providing a robust alternative for those needing consistent character identity and complex posing without extensive LoRA stacking.

Highlights

High-precision character anatomy and posing control
Strong compatibility with SDXL ecosystem and LoRAs
Supports both natural language and tag-based prompting
Reduced artifacts compared to standard SDXL base
Optimized for diverse artistic and stylized outputs

Usage

Install

# Install Hugging Face transformers
pip install transformers torch

SDK Usage

# Load model with transformers
from transformers import AutoModel, AutoTokenizer

model = AutoModel.from_pretrained("LyliaEngine/Pony_Diffusion_V6_XL")
tokenizer = AutoTokenizer.from_pretrained("LyliaEngine/Pony_Diffusion_V6_XL")

Hugging Face Download

We recommend downloading the model via the Hugging Face CLI or Hub SDK.

Guidance：Before downloading, install huggingface_hub with:

Guidance

pip install -U huggingface_hub

CLI Download

Download the full repository

huggingface-cli download LyliaEngine/Pony_Diffusion_V6_XL

Download a single file to a local folder (e.g. config.json into ./dir)

huggingface-cli download LyliaEngine/Pony_Diffusion_V6_XL config.json --local-dir ./dir

See the official docs for more CLI options

SDK Download

# 模型下载
from huggingface_hub import snapshot_download
model_dir = snapshot_download('LyliaEngine/Pony_Diffusion_V6_XL')

Git Download

Make sure git-lfs is installed first

Git Download

git lfs install
git clone https://huggingface.co/LyliaEngine/Pony_Diffusion_V6_XL

To skip LFS large-file downloads, use:

Skip LFS

GIT_LFS_SKIP_SMUDGE=1 git clone https://huggingface.co/LyliaEngine/Pony_Diffusion_V6_XL

Model files are hosted on the Hugging Face Hub — download directly via HF CLI / SDK / Git, not through this site.

PyTorch / Transformers Usage

Install Transformers

pip install -U transformers torch

Load the model and run inference

from transformers import AutoModelForCausalLM, AutoTokenizer

model = AutoModelForCausalLM.from_pretrained('LyliaEngine/Pony_Diffusion_V6_XL')
tokenizer = AutoTokenizer.from_pretrained('LyliaEngine/Pony_Diffusion_V6_XL')

Full Documentation

来源: HuggingFace

---
tags:

text-to-image

stable-diffusion

lora

diffusers

template:sd-lora

widget:

text: >-

score_9, score_8_up, score_7_up, score_6_up, score_5_up, score_4_up,
source_furry, beautiful female anthro shark portrait, dramatic lighting,
dark background
output:
url: images/00056-4212032008 (1).jpeg
base_model: Bakanayatsu/Pony-Diffusion-V6-XL-for-Anime
instance_prompt: None
license: cdla-permissive-2.0
---

Pony_Diffusion_V6_XL

Model description

!tmpwcaemsmp.png
!ponydiffwall2.png

Pony Diffusion V6 is a versatile SDXL finetune capable of producing stunning SFW and NSFW visuals of various anthro, feral, or humanoids species and their interactions based on simple natural language prompts.

CHECK "ABOUT THIS VERSION" ON THE RIGHT IF YOU ARE NOT ON "V6" FOR IMPORTANT INFORMATION.

Please join our Discord Server to support development of new versions of this model and get access to free SD bot and check out more examples of this model capabilities on our prompt sharing website or follow the author on Twitter.
Important information

Make sure you load this model with clip skip 2 (or -2 in some software), otherwise you will be getting low quality blobs.

This model supports a wide array of styles and aesthetics but provides an opinionated default prompt template that allows generation of high quality samples with no negative prompt and otherwise default settings

score_9, score_8_up, score_7_up, score_6_up, score_5_up, score_4_up, just describe what you want, tag1, tag2

(previous Pony Diffusion models used a simpler score_9 quality modifier, the longer version of V6 XL version is a training issue that was too late to correct during training, you can still use score_9 but it has a much weaker effect compared to full string. You can learn more about these tags here).

The model is designed to not need negative prompts in most cases and does not need other quality modifiers like "hd", "masterpiece", etc...

Other special data selection tags include, 'source_pony', 'source_furry', 'source_cartoon' and 'source_anime' and ratings of 'rating_safe', 'rating_questionable' and 'rating_explicit'.

This model is capable of recognizing many popular and obscure characters and series.

If you are looking specifically for pony style, I recommend using one of the two following templates `anthro/feral pony, rest of the prompt` or `source_pony, rest of the prompt`.

This model is trained on combination of natural language prompts and tags and is capable of understanding both, so describing intended result using normal language works in most cases, although you can add some tags after the main prompt to boost them.

Using Euler a with 25 steps and resolution of 1024px is recommended although model generally can do most supported SDXL resolution.

This model will sometimes generate pseudo signatures that are hard to remove even with negative prompts, this is unfortunately a training issue that would be corrected in future models. If that's an issue for you I suggest trying V5.5 or inpainting.

Special thanks

Iceman for helping to procure necessary training resources

Haru for assistance with captioning efforts

Cookie for technical expertise in training

PSAI Server Subscribers for supporting the project costs

PSAI Server Moderators for being vigilant and managing the community

Technical details

The model has been trained on ~2.6M images aesthetically ranked based on authors personal preferences, with roughly 1:1 ratio between anime/cartoon/furry/pony datasets and 1:1 ratio between safe/questionable/explicit ratings. About 50% of all images has been captioned with high quality detailed captions, which results in very strong natural language capabilities.

All images has been trained with both captions (when available) and tags, artists' names have been removed and source data has been filtered based on our Opt-in/Opt-out program. Any explicit content involving underage characters has been filtered out.
License

This model is licensed under a modified Fair AI Public License 1.0-SD (https://freedevproject.org/faipl-1.0-sd/) license.

The following modifications have been added to Fair AI Public License:

You are not permitted to run inference of this model on websites or applications allowing any form of monetization (paid inference, faster tiers, etc.). This applies to any derivative models or model merges.

If you want to use this model commercially, please reach us at [email protected].

Explicit permission for commercial inference has been granted to CivitAi and Hugging Face.

Source

https://civitai.com/models/257749

Credit

https://civitai.com/user/PurpleSmartAI

Trigger words

You should use None to trigger the image generation.

Download model

Weights for this model are available in Safetensors format.

Download them in the Files & versions tab.