AI Model Wiki

    Skip to main content
    7 min read
    Lesson 1 of 6

    What Is Stable Diffusion?

    From the course Stable Diffusion Mastery: Local AI Image Generation

    Stable Diffusion is an open-source AI image generation model that you can run on your own computer — completely free, with no usage limits, and full control over your outputs. It's the foundation of the open-source AI art movement.

    How Stable Diffusion Works

    Stable Diffusion uses a technique called latent diffusion. Here's the simplified process:

    1. Start with noise — The model begins with a field of random noise (like TV static)
    2. Guided denoising — Using your text prompt as guidance, the model iteratively removes noise, step by step
    3. Latent space — Instead of working with full-resolution pixels, it operates in a compressed "latent" space, making it fast enough to run on consumer GPUs
    4. Text encoding — Your prompt is converted into numerical representations by a CLIP text encoder, which guides the diffusion process

    Key Versions

    • Stable Diffusion 1.5 (SD 1.5) — The original workhorse. Still widely used due to the massive ecosystem of models, LoRAs, and extensions built around it. Resolution: 512×512.
    • Stable Diffusion XL (SDXL) — Major upgrade with better composition, text rendering, and higher native resolution (1024×1024). Requires more VRAM.
    • Stable Diffusion 3.5 — Latest version using a new MMDiT architecture. Improved text rendering, better anatomy, and more accurate prompt following.
    • FLUX — While not technically Stable Diffusion, FLUX (by Black Forest Labs, founded by SD's original creators) is the spiritual successor. FLUX.1 and FLUX.2 offer state-of-the-art quality.

    Why Run Locally?

    • No cost per image — Generate thousands of images without subscription fees
    • No content filters — Full creative freedom (with ethical responsibility)
    • No data sharing — Your prompts and images stay on your machine
    • Customization — Train custom models, use LoRAs, apply ControlNet
    • Speed — With a good GPU, generation takes 5-15 seconds per image

    Hardware Requirements

    • Minimum: NVIDIA GPU with 6GB VRAM (GTX 1660, RTX 3060)
    • Recommended: NVIDIA GPU with 8-12GB VRAM (RTX 3070, RTX 4070)
    • Ideal: NVIDIA GPU with 16GB+ VRAM (RTX 4080, RTX 4090)
    • RAM: 16GB minimum, 32GB recommended
    • Storage: 50GB+ for models and outputs

    Stable Diffusion democratized AI image generation. For the first time, anyone with a decent GPU can generate professional-quality images locally, with no recurring costs.

    Key Takeaways

    • •Stable Diffusion is an open-source AI image model you can run locally for free
    • •It uses latent diffusion — guided denoising in compressed space for efficiency
    • •Key versions: SD 1.5, SDXL, SD 3.5, and the spiritual successor FLUX
    • •Running locally means no cost per image, no filters, and full privacy
    • •Minimum hardware: NVIDIA GPU with 6GB VRAM, recommended 8-12GB
    0 of 6 lessons marked complete

    Progress is kept in this browser only.