The Algorithmic Bridge

The Algorithmic Bridge

Share this post

The Algorithmic Bridge
The Algorithmic Bridge
What You May Have Missed #10
Weekly Top Picks

What You May Have Missed #10

Stable Diffusion 2 / Generative AI news / Meta's Cicero and Neurosymbolic AI / AI misinformation / Four bits on automation / Using robots to talk to animals

Alberto Romero's avatar
Alberto Romero
Nov 28, 2022
∙ Paid
6

Share this post

The Algorithmic Bridge
The Algorithmic Bridge
What You May Have Missed #10
Share
Imagen
Stable Diffusion has learned to draw hands! Credit: Emad Mostaque

Stable Diffusion 2 may not be so bad after all

Stability.ai released Stable Diffusion 2 (SD 2) on November 23. Although highly anticipated, people were disappointed at the company’s decisions regarding changes to the training dataset and the new text/image encoder (OpenCLIP-ViT/H).

I wrote an analysis for TAB this week where I argued SD 2 is technically superior to its predecessors and more artist-friendly, but users wanted—and expected—to keep taking advantage of an all-to-common form of non-accountability.

Because of those dataset changes, prompting techniques that worked with SD may not work with SD 2. People are now trying to figure out ways to update our collective knowledge of SD 2’s latent visual space (i.e. find which prompt heuristics work).

Here’s a thread highlighting the advantages and uniqueness of SD 2, and a few tips on how to prompt it:

Twitter avatar for @recatm
Catmus 夹喵又 @recatm
For prompt enginering of SD2, either too short or too long prompt doesn't work well. I found SD2 can offer higher controllability with more precision than 1.5 So highly targeted prompt design is possible, not stacking of keywords or artist refer as blindfold alchemy anymore. 4/n
fine-art oil landscape painting of Iceberg cliffs, Arctic Ocean, lonely island, sunset, magic time, by Bruce_Pennington, Minimalism, epic perspective, artistic, atmospheric, masterpiece, vivid color, HDR, darker shadow, high contrast, golden ratio composition, hyper-detailed  -W 960 -S 6753514390
fine-art watercolor landscape painting of Iceberg cliffs, Arctic Ocean, sunset, magic time, by Andreas Rocha, Minimalism, artistic, atmospheric, masterpiece, darker shadow, high contrast, golden ratio composition, hyper-detailed  -W 960 -S 9252202207
fine-art oil landscape painting of Iceberg cliffs, Arctic Ocean, lonely island, sunset, magic time, by Michael Whelan, Minimalism, epic perspective, artistic, atmospheric, masterpiece, vivid color, HDR, darker shadow, high contrast, golden ratio composition, hyper-detailed   -W 960 -S 6753514390
fine-art oil landscape painting of Iceberg cliffs, Arctic Ocean, sunset, magic time, by Chesley Bonestell, artistic, atmospheric, masterpiece, vivid color, HDR, golden ratio composition, hyper-detailed  -W 960 -S 3071271062
6:26 PM ∙ Nov 27, 2022
23Likes2Retweets

SD 2 seemed to be a step back, but some (if not most) of the apparent problems seem to disappear with good prompts. Users should approach the new model as a new tool—re-learning to prompt SD 2 is necessary. As a user says, “yes, you need to work for it with #StableDiffusion2 but you can get an incredible level of detail:”

Twitter avatar for @TomLikesRobots
TomLikesRobots @TomLikesRobots
Yes, you need to work for it with #StableDiffusion2 but you can get an incredible level of detail. This is a raw output at 768x768. No upscaling or facial restoration. I can imagine this getting insanely good with a bit of tweaking/finetuning. #AIart
Image
Twitter avatar for @EMostaque
Emad @EMostaque
Raw #StableDiffusion2 output from text prompt in (un)surprisingly few steps by @masslevel Really do recommend folk take some time to explore the model, even more versatile than before with some exciting things in the pipeline.. https://t.co/a3irlzNnuK
9:09 PM ∙ Nov 26, 2022
376Likes61Retweets

Also, models built on top of SD may not work with SD 2.

Devs are already shipping solutions: KaliYuga, an artist and developer who works at Stability.ai, trained a Dreambooth model with SD 2 (people were worried it wouldn’t be possible with the new version).

And Pharmapsychotic released a new CLIP interrogator adapted to the new Stable Diffusion encoder.

Generative AI news

Besides Stable Diffusion 2, things keep going at all corners of the generative AI space.

This post is for paid subscribers

Already a paid subscriber? Sign in
© 2025 Alberto Romero
Privacy ∙ Terms ∙ Collection notice
Start writingGet the app
Substack is the home for great culture

Share