I’ve been trying to transition from SD1.5 to SDXL for a while, but old prompting habits die hard.
Even more difficult was finding a model to produce the look I prefer. Most seem to love realism, 3D pixar style, anime, and super airbrushed.
If you have any tips for SDXL models, loras, prompting for this style, etc. please let me know!
parameters:
1girl, demon woman with bangs and ram horns and wings, holding bloody human heart, solo, sitting with knees up, (full body:0.6), looking at viewer, (dark fantasy theme:1.1) (glowing eyes:1.05), thick lines, flat shading
Negative prompt: low quality, deformed, embedding:negativeXL_D, embedding:unaestheticXL_Sky3.1,
Steps: 10, Sampler: dpmpp_3m_sde_simple, CFG scale: 1.0, Seed: 212036223314935, Size: 1024x1024, Model hash: 268a170aa6, Model: grogmixTURBO_v10
(and some inpainting/upscaling)
Check out the important information section on Pony Diffusion V6 XL’s page. It says: “Make sure you load this model with clip skip 2 (or -2 in some software), otherwise you will be getting low quality blobs.”. Find some images you like and work off of their prompts to learn to make your own,
Thanks for the reply, but yeah, I’ve definitely tried that. In ComfyUI for this model, setting it to -2 doesn’t actually do anything compared to no node for that at all. Setting it to -1 of course ruins it though.
It seems really temperamental with the styles. It seems to vastly change just by changing a few words that aren’t related to style at all.
This is the best I’ve gotten with it after hours if fiddling. Most of the image is good, but the face and hands never are.
Try using some LoRA. You have to use LoRA trained on Pony Diffusion, since the training process moved it far away enough from regular SDXL that Controlnets aren’t even compatible with it,
Yeah it seems like loras are necessary. For that image I used the concept art twilight lora.