top of page



Danger Girl X Box Logo

Real girls, shaped by real experiences, form the heart of the DangerVerse: a mature, neo-noir cinematic universe teeming with captivating narratives and danger.


Inside the Black Box: How Does Stable Diffusion Training Work, and Why Should You Care?

Updated: Jun 25

How does Stable Diffusion Training Work? AI Girl Cross arms, teaching in skirt

How does Stable Diffusion Training Work?

Stable Diffusion is a trailblazing text-to-image AI model, popular due to its open-source nature and transparency. Its unique licensing model has facilitated its integration into numerous platforms, including Midjourney, NightCafe, and Stability AI's DreamStudio.

The Training Data: A Treasure Trove of Images and Text

How does Stable Diffusion Training Work? The driving force behind Stable Diffusion's abilities is the colossal amount of data it's been trained on. Thanks to a partnership with non-profit organization LAION, Stability AI was able to access the expansive datasets provided by Common Crawl, a digital library that collates billions of web pages each month. However, accessing and navigating these datasets can prove challenging due to their size and complexity.

How Data is Collected and Sorted

LAION meticulously compiled and categorized HTML image tags with alt-text attributes, resulting in a vast assembly of over five billion image pairs. These pairs were sorted based on their language, resolution, the likelihood of having a watermark, and their aesthetic score.

Understanding the Initial Training Phase

Stable Diffusion's initial training is conducted on lower-resolution images from LAION's datasets. Progress is then checked using another dataset subset, LAION-Aesthetics v2 5+, that filters out images of lower quality or those with watermarks.

The Influence of Renowned Artists on Training

The training data for Stable Diffusion incorporates the work of over 1,800 artists, providing a rich source of creative influence. This list of artists includes well-known names like Phil Koch, Erin Hanson, Steve Henderson, and the prolific Thomas Kinkade. In an intriguing turn of events, artist Greg Rutkowski's work was extensively used in Stable Diffusion training, garnering him considerable fame. However, it's important to remember that not every artist might see such a drastic increase in recognition.

Factoring Fictional Characters into Training

Popular fictional characters play a significant role in Stable Diffusion's training. Characters from the Marvel Cinematic Universe, Star Wars, DC comics, and the evergreen Mickey Mouse are used as training inputs, enabling the AI to generate imaginative images based on text prompts related to these characters.

The Exciting Future of Stable Diffusion

Stable Diffusion exemplifies the leaps made in the field of AI image generation. Its efficiency in transforming natural language descriptions into visually appealing digital images is a testament to the potential of AI models. As we dive deeper into the workings of Stable Diffusion and compare it with other models, we're likely to uncover even more fascinating applications of AI in the realm of art.

Keep an eye out for more developments in this dynamic field!


Leave a comment below to let me know if this information becomes outdated. I will do my best to keep this blog updated as time goes on.

Stay up to date with what's happening with Stability AI and Stable Diffusion.


Click on one of the questions below to learn more about Stable Diffusion.

Understanding Stable Diffusion:

Learn how to use Stable Diffusion and much more. Visit the link below-

40 views0 comments

Are you an influential force seeking powerful collaborations? Or perhaps an emerging athlete, eager to etch your story?

Polaroids raining on a fitness model in white lingerie.jpg

Thanks for subscribing!

bottom of page