Ridiculed Stable Diffusion 3 release excels at AI-generated body horror

Users react to mangled SD3 generations and ask, "Is this release supposed to be a joke?"

See full article...

 

[adrianovaroli]

What the heck did I just see

 

[Fred Duck]

At least our datasets are safe and ethical.

In what universe is nightmare fuel either safe OR ethical? Explain this to me!

 

[IncorrigibleTroll]

It may make it a less useful tool, but I genuinely love when SD and its ilk go wonky like this. This half-crazed voice of the machine visual nonsense is the stuff that interests me.

Edit: Ok I call foul. The "girl lying in grass" image is really a screenshot from Elden Ring, isn't it?

 

[citizencoyote]

Yikes.

The woman with four fingers depicted in the third image looks like she may have been generated due to training on comic strips or cartoons like TMNT, but at least she has a face.

Unlike some of the other abominations.

 

[ganewate]

This is what happens when your training set was primarily Sons of the Forest

 

[Bernardo Verda]

Huh. I guess there were actual reasons the great artists drew lots of nudes and studied human anatomy...
Who would have ever guessed?

 

[Bumbling Baboon]

"A woman lying on the beach" is like they're rebooting The Thing on a tropical island.

 

[alphaLONE]

this is funnier than the proper generations. especially with it looking "perfect" outside of that completely malformed thing. more wonky genAI please...

 

[Don Reba]

This is what my nightmares are going to be for the next few nights.

 

[markgo]

censoring adult content that contains nudity also severely hampers an AI model's ability to generate accurate human anatomy

Perhaps human artists—who have trained on nude models for centuries even when the society they lived in was uptight about nudity—could have told them that.

Edit: Ninja’d by someone whose name sounds like it belongs to a great classical artist, Bernardo Verda.

 

[IncorrigibleTroll]

This is what happens when your training set was primarily Sons of the Forest

I thought Virginia was bugged the first couple of times I encountered her.

 

[mbuchman]

Their seamstress/seamster is the real mvp

 

[skotl]

There's only one solution, for the good of all: more porn

 

[Emon]

Perhaps human artists—who have trained on nude models for centuries even when the society they lived in was uptight about nudity—could have told them that.

Well they'd have to hire artists to know that. Their whole business is viewing artists with contempt and putting them out of work.

 

[UserIDAlreadyInUse]

Stable Diffusion: Lovecraftian Edition.

 

[Flailsafe]

If AI were to flood the Internet with nightmare content, I would welcome it over the Internet's current state.

Maybe what will emerge is a Hegelian dialectical of a Lovecraftian/Cthulhu intelligence that merges mind destroying imagery and suggestions as a form of advertising for cheap Chinese goods.

Why not

 

[Sajuuk]

With each software release those Butlerians start to make more and more sense.

 

[albeec13]

Looks like they trained the AI exclusively on pictures of Megan Fox's thumbs.

 

[jock2nerd]

censoring adult content that contains nudity also severely hampers an AI model's ability to generate accurate human anatomy

...but doesn't account for not understanding left and right, nor knowing how many fingers are on a hand.

 

[Timboman]

It is still ENDLESSLY hilarious to me that the best image generation models out there right now are based upon Pony Diffusion XL, a model that was EXPLICITLY finetuned to generate furry porn.

Just goes to show that having a very broad, varied, and well tagged dataset is essential for a model to give good results. Even if a large chunk of that dataset is of various Pokemon going at it all hot and heavy, lol.

 

[IncorrigibleTroll]

...but doesn't account for not understanding left and right, nor knowing how many fingers are on a hand.

Without nipples as landmarks, the whole body goes to hell. Why else do you think men still have them?

 

[leonwid]

Why would they not train on nude data? As long as the models have consented I see no issue.
Maybe there should be a ‘safety check’ to see if NSFW is generated when not requested, but that should not be done by removal of parts of of the training data.

 

[stormbeta]

One of the most underrated uses for these models IMO is to intentionally create art like this - they're better at creating surreal / uncanny visuals by accident than almost any human can produce on purpose.

E.g. it would be fantastic for procedural horror.

 

[leonwid]

Without nipples as landmarks, the whole body goes to hell. Why else do you think men still have them?

A nipple ring is the ideal holder for your spare housekeys.

 

[thrillgore]

My reaction going through some of these images.

Are we sure this isn't another attempt to poison the dataset? Because that's how I'd do it.

 

[gregorerlich]

With each software release those Butlerians start to make more and more sense.

Butlerian Jihad when pls

 

[EngineerX]

Haha, c youse later, I'm robbing a bank covered in prosthetics.
Just guess my defense.

 

[gregorerlich]

Why would they not train on nude data? As long as the models have consented I see no issue.
Maybe there should be a ‘safety check’ to see if NSFW is generated when not requested, but that should not be done by removal of parts of of the training data.

Pretty sure nobody consented to their images being used in these training datasets, not the models, not the owners of the copyright on the images...

 

[IncorrigibleTroll]

Human anotomy

 

[Dreadalus]

Anyone who clicks 'Enlarge' on any of those pics has a stronger stomach than I do.

 

[PursuingBeast]

Have they used only David Cronenberg movies in the dataset? /jk

 

[darlox]

It's really difficult to believe that when you take an AI that has no sense of ethics, morality, consequence or politick, and try to stick your finger on its scales to enforce an ill-defined moral bias held by its human overseers, that you would end up with sub-optimal results! Gosh, I can't even fathom why most attempts to make neural networks conform to values that aren't even close to universally-held in their training data isn't working out!

 

[Edgar Allan Esquire]

Without nipples as landmarks, the whole body goes to hell. Why else do you think men still have them?

Fighting anime always remind me of an interview with a manga artist that worked on both Shonen and yaoi titles. They'd asked her what the main difference between styles was. "In BL you draw the men with nipples," was her response. You can't unsee the nippless pecs in most Shonen after that.

 

[lewax00]

Nice try Stable Diffusion, but I'm not falling for "a man showing his hands" - that's clearly a Rakshasa taking human form.

(Edit: for context since it's maybe a little buried: "However, their most unnerving and unique feature was their reversed hands." - that's generally their distinguishing feature that can give them away to the perceptive.)

 

[Skyssx]

Anyone who clicks 'Enlarge' on any of those pics has a stronger stomach than I do.

Like you didn't grow up seeing tubgirl and stinger.

 

[The Aloof Alot]

See it from the positive side: this may increase awareness of hand malformations.

 

[markgo]

...but doesn't account for not understanding left and right, nor knowing how many fingers are on a hand.

It’s a little startling to note than some of the more common and smaller AI anatomical errors (extra finger or malformed joint) are not that dissimilar to genetic defects.

It’s either a coincidence or a deeper truth on how complex things are constructed and how that process can go wrong.

 

[RickRoyLeonPrisZhoraRacha]

What the heck did I just see

TheThing-GPT!

 

[RickRoyLeonPrisZhoraRacha]

Have they used only David Cronenberg movies in the dataset? /jk

Perhaps John Carpenter as well...