Fix AI Hands: Why They Fail and the Real ControlNet Workflow

TL;DR

• The viral Civitai articles claiming "5-funny-looking-fingers:2" and "physical-defects:2" embeddings give 99% perfect hands — those embeddings don't exist. Searches of the Civitai API return zero results.
• Real hand-fixing uses ControlNet OpenPose hand detection (21 keypoints, ~85% detection accuracy) plus targeted inpainting — not negative embeddings.
• Hands fail because they're anatomically complex (27 bones, intricate musculature), not because of missing prompt tokens.

The Embeddings You Read About Don't Exist

Two popular Civitai articles from late 2023 claim specific negative embeddings force Stable Diffusion and SDXL to generate perfect hands. One article promotes 5-funny-looking-fingers:2 with a "99% perfect hands in SD" claim. The other recommends physical-defects:2, unhealthy-deformed-joints:2, unhealthy-hands:2 with a "fails only 1 in 20 images" statistic.

Neither embedding exists. Direct queries to the Civitai API for "funny-looking-fingers", "physical-defects", "unhealthy-hands", and "unhealthy-deformed-joints" all return empty result sets. The articles' authors appear to have invented these embedding names and their associated performance metrics.

This matters because thousands of users have likely wasted time searching for embeddings that were never published. The actual solutions require a different approach entirely.

Why AI Hands Fail in the First Place

Understanding the root cause tells you why no single prompt token or embedding can "fix" hands.

SDXL improved overall coherence over SD 1.5 but introduced new hand artifacts — users report "half-finger truncation" and "octopus-like finger multiplication" at higher resolutions. These aren't embedding failures; they're fundamental limitations of 2D diffusion on 3D structures.

The Real Workflow: ControlNet + Inpainting

The production approach combines hand detection with targeted regeneration. This isn't a one-click fix — it's a repeatable pipeline.

Step 1: Detect Hands with ControlNet OpenPose

ControlNet includes a dedicated hand detector (annotator/openpose/hand.py) that outputs 21 keypoints per hand. The model loads hand_pose_model.pth from Hugging Face and runs multi-scale inference (0.5×, 1×, 1.5×, 2×) with Gaussian peak refinement.

from ControlNet import OpenposeDetector
detector = OpenposeDetector()
canvas, result = detector(oriImg, hand=True)
# result contains hand keypoints: [{x, y}, ...] × 21 per hand

Detection accuracy: ~85–90% in controlled conditions (clear hand visibility, good lighting). Drops significantly with occlusion, motion blur, or unusual poses.

Step 2: Generate Precise Masks from Keypoints

Convert the 21 keypoints into tight bounding boxes, then expand by 15–20% to include wrist context. The Stable Diffusion web UI inpainting tab accepts these masks directly — white regions get regenerated, black regions stay untouched.

The "Only masked" option is critical — it renders the hand at the full model resolution (e.g., 1024×1024 for SDXL) regardless of its size in the source image.

Step 3: Inpaint with a Dedicated Hand Prompt

Use the inpainting tab with these settings:

Prompt template:

5 distinct fingers, realistic human hand anatomy, correct proportions, natural skin texture, visible knuckles, proper fingernails, [pose description], sharp focus, subsurface scattering

Negative prompt (actual tokens that exist):

deformed fingers, extra fingers, missing fingers, fused fingers, mutated hands, poorly drawn hands, claw, talon, webbed fingers, blurry, low quality

These are standard negative tokens, not special embeddings. They work because they're in the model's vocabulary, not because of a secret embedding file.

Step 4: Iterate and Refine

First pass rarely produces perfect results. Typical workflow:

1. Generate 4–8 variations at denoising 0.75
2. Pick the best, mask remaining issues
3. Second pass at denoising 0.55 for refinement
4. Optional: high-res fix or ControlNet tile upscale for final detail

Negative Embeddings: What They Are and Aren't

Textual inversion (negative embeddings) does exist in Stable Diffusion. You train a small vector that represents "bad hand anatomy" by feeding the model examples of deformed hands, then use that token in negative prompts.

But:

• You must create it yourself — no universal "hand fix" embedding works across models
• Training requires 20–50 curated bad-hand images and 5–10k steps
• The resulting .pt or .safetensors file is model-specific (SD 1.5 vs SDXL)
• Effect is modest: typically 5–15% reduction in obvious artifacts, not 99% perfection

The Civitai articles conflate this real technique with fictional embedding names and impossible performance claims.

SDXL-Specific Considerations

SDXL's dual text encoders (OpenCLIP ViT-G + CLIP ViT-L) and 1024×1024 native resolution change the hand-fixing calculus:

Practical tip: For SDXL, generate at 1024×1024, then inpaint hands at denoising 0.6–0.7 with the refiner enabled. The refiner's second pass often resolves the "half-finger" artifacts without extra work.

Common Errors and Fixes

FAQ

Do I need a special embedding to fix hands? No. The embeddings named in viral Civitai articles don't exist. Standard negative tokens plus ControlNet detection + inpainting work better.

Why do my hands still look wrong after inpainting? Most common: mask too tight (cuts off wrist context) or denoising too extreme. Expand mask, lower denoising to 0.55–0.65, add "forearm visible" to prompt.

Does ControlNet hand detection work on SDXL? Yes. The detector is model-agnostic — it outputs keypoints from any RGB image. Use those keypoints to build masks for SDXL inpainting.

How many inpainting passes are normal? 2–3 passes is typical. First pass fixes gross anatomy, second refines proportions, third (optional) polishes skin detail.

Can I automate this? Yes. The sd-webui-controlnet extension includes "Inpaint Only Masked" scripts that chain detection → masking → inpainting. See automation guide.

What about Depth/Normal ControlNet for hands? Depth maps help with 3D structure but add complexity. OpenPose hand keypoints are faster and sufficient for most cases. Depth is better for full-body pose transfer.

Do LoRAs help with hands? Hand-specific LoRAs exist but are hit-or-miss. They bias toward training poses. Inpainting with a good prompt is more flexible.

Sources

Internal Links

• Stable Diffusion automation guide
• ControlNet installation and models
• SDXL prompting best practices
• Inpainting mask techniques
• Training custom textual inversion embeddings

Image Placeholders