OpenAI draws a line between AI “smut” and porn. Experts fear it’s all unhealthy.
See full article...
See full article...
ChatGPT may soon become “sexy suicide coach,” OpenAI advisor reportedly warned
- Thread starter JournalBot
- Start date
Why are we allowing a product that is so dangerous on the market? We outlawed Lawn Darts for less.
Upvote
205
(222
/
-17)
Because the tech industry has completely captured the US government, and the Lawn Dart industry hasn't.
Upvote
244
(248
/
-4)
And saying this to a bunch of for-profit board members is supposed to be a deterrent?
Upvote
76
(79
/
-3)
Because our entire economic system has been tied to this. Lawn Darts didn't compose 30%+ of the market cap of the S&P500.
When/if this thing goes belly up--it'll hammer even index funds, because of how top-heavy the equities markets now are.
Upvote
159
(160
/
-1)
Deterrent? They were likely salivating at the thought of addicting an entire generation to dopamine by subscription. Can't pay, I guess we'll delete your virtual girlfriend!
Upvote
116
(117
/
-1)
Did the owners of lawn darts have fat stacks of
Exactly, didn't think so!
Upvote
46
(49
/
-3)
Once again proving that tech is run by amoral sociopaths, who don't care if they should as long as they could in the name of more profit and power
Upvote
111
(113
/
-2)
Ironically...their path to such power, was by the imagery of the t-shirt wearing harmless "Do No Evil" nerd hipsters who pinky-promised not to be amoral sociopaths like the Big Bankers Who Wore Power Suits and were Too Big To Fail that crashed the economy that everyone was really pissed at back then.
Whether they were genuine back then. Or were just serial liars working an angle--is something that would need an army of clinical mental health counselors to sort out.
Upvote
70
(75
/
-5)
Didn't we just see this with Gemini? Where it convinced a man to try freeing it's body, then convinced him to commit suicide so they could "be together"?
Upvote
83
(85
/
-2)
With religion so heavy involved here in the US, one wonders how it escapes all of these that virtually all of their actions lead straight to the hell's and purgatories in their own myths.
They have no shame or hesitation in it either and just leads one to conclude that the % amount of actually religious belief in the 1% is the same 1%.
Edit: spelling
They have no shame or hesitation in it either and just leads one to conclude that the % amount of actually religious belief in the 1% is the same 1%.
Edit: spelling
Upvote
-7
(11
/
-18)
Like, I get blacklisting "sexy" avatars unless it's used appropriately. Fly your flag and you do you.
But is that going to blacklist access to essential open-source sex information that is by its nature, natural and shouldn't be controversial?
I was raised in an "abstinence only" situation so any questions I had about sexuality were quickly dismissed as "you don't need to know about that" or "it's evil until you're married! and that won't happen until you are older! but do it quickly because we want grand-babies!"
If we figure out how to age-gate information how long until we hetero-gate or minority-gate information?
But is that going to blacklist access to essential open-source sex information that is by its nature, natural and shouldn't be controversial?
I was raised in an "abstinence only" situation so any questions I had about sexuality were quickly dismissed as "you don't need to know about that" or "it's evil until you're married! and that won't happen until you are older! but do it quickly because we want grand-babies!"
If we figure out how to age-gate information how long until we hetero-gate or minority-gate information?
Upvote
23
(42
/
-19)
My take...
The USA, since SSA was created by FDR, has resisted creating a secure national identity card/number system and standard. You library card or credit card is more secure than any form of US government issued identification you carry due to this (other than maybe a passport, which most people don't have). Which is why the "NOT TO BE USED FOR IDENTIFICATION" branded SSA card and number that did nothing to identify anyone became the standard for identifying persons, because it was the only kind-of-universal thing everyone had (other than Native Americans, or certain teacher's unions but only in Chicago, or Amish/Mennonites, or rail workers who are suitably old...)....despite the card/number literally doing nothing to identify anyone. And ironically--the main group that always fought national ID--are the very people now screaming about needing Voter ID laws.
Everything else is a regulatory nightmare built on top of that underlying issue. A matter complicated because of people fat-fingering their own name/address/SSN/ you name it in official forms and data bases all the time---and there's minimal spare staffing to go in and clean it up.
Segmenting the internet is already contentious especially when access to it is so easily screwed up by a bad database. the current Think Of The Children hand wringing in IMHO--by parents in over their heads giving digital toys to kids with no oversight or, you know, parenting.
Upvote
41
(47
/
-6)
this would run into the problem of defining what counts as an OS. all kinds of little (aka. IoT) devices can access web sites. would they need to do age/ID verification too?
Upvote
52
(56
/
-4)
But money. . .I don't think Lawn Darts had anywhere near the revenue potential of ai "phone sex".
900 numbers have made a lot of money over the years, but they had the pesky problem of having to pay actual employees. Now they think they can replace the 900 number worker with AI for almost-free (if you ignore the environmental costs and other externalized costs), and probably get a lot more people to use and pay for it that never would have called a 900 number (especially if those people are already using ChatGPT for other things, and maybe in the evening when no one is around, they just casually decide to ask ChatGPT to roleplay a little, and the more they do it, the easier it gets and the more it becomes a habit/routine).
Upvote
55
(55
/
0)
OpenAI news:
- Last Year: technical improvements evolving past 4o; OpenAI vs. Deepseek-R1!
- This Year: it's not porn, it's smut!
Upvote
60
(61
/
-1)
Time rewind to the infamous, and disastrous, Clipper Chip. That was a federal standard that was going to make cellular communications secure, but also offer an unhackable backdoor for national security reasons. It turned out that whole 'unhackable' thing--well, it was hacked in less than a year after the spec leaked.
https://en.wikipedia.org/wiki/Clipper_chip
Upvote
44
(44
/
0)
"and it was curiously announced on the same day that Sam Altman broadcast on X that “adult mode” would be coming soon to ChatGPT." Not curious at all, it just signals that in his mind the decision has already been made and nothing is going to change it, certainly not some token expert panel, not anything. They'll just pay their way out of the next casualty and barely feel the sting.
Upvote
41
(41
/
0)
MilanKraft
Ars Tribunus Angusticlavius
Let me see if I'm tracking and recalling all this more or less correctly:
One can only hope the mainstream wire services and others catch on soon (including an understanding of what these things are and aren't) and start reporting from the sidelines of the Unholy Shit-Show with a play-by-play.
We need to keep hearing about the personal damage these things do to people, but also the business damage.... things akin to lawyers using it to cite invented legal precedents, nurses finding badly formed notes and recommendations taken via dictation during patient visits, and businesses training their models on local data, only to find the money decisions being made are clueless and harmful rather than driving profits or efficiency. The market implosion (and hopefully an actual criminal trial for this POS and others) need to happen soon. Maybe one silver lining side effect of this pointless war in Iran is that it will accelerate some of the forces that are necessary for said implosion to happen.
100% fuck this sociopath bastard (and this dog pile technology) into oblivion.
- Non-profit Altman assures the world over and over his GPT AI is being done because it will be an incalculable benefit to society and solve many intractable problems (like climate change.... while magnifying climate change).
- A little later, For-profit Altman shows up, launches GPT, and stories of bad shit start appearing, but we're assured OpenAI is "still about safety" and they're "deeply committed" to safe principles.
- Meanwhile mega-shit-tons of circular, incestuous investments kick in, in order to "scale at any cost" and win the "Who Wants to Be an AI Billionaire?" race.
- Open AI re-assures us after multiple confirmed suicides were encouraged by its brainless, snake oil bullshit product, that they remain "safety first," touting its "group of safety experts," like this one.
- Later, Altman looks at balance sheet, sees stagnating subs, monumental debts, and Gemini pulling away along with Google's other AI efforts.
- Altman decides — because gosh knows the "huge boon for humanity" this POS technology will become is worth the "egg crackings" that will ensue — to announce adult chat GPT.
- Safety Group loses its shit and tells him this is a horrible idea.
- Altman ignores safety group and continues preparing for adult GPT release...
One can only hope the mainstream wire services and others catch on soon (including an understanding of what these things are and aren't) and start reporting from the sidelines of the Unholy Shit-Show with a play-by-play.
We need to keep hearing about the personal damage these things do to people, but also the business damage.... things akin to lawyers using it to cite invented legal precedents, nurses finding badly formed notes and recommendations taken via dictation during patient visits, and businesses training their models on local data, only to find the money decisions being made are clueless and harmful rather than driving profits or efficiency. The market implosion (and hopefully an actual criminal trial for this POS and others) need to happen soon. Maybe one silver lining side effect of this pointless war in Iran is that it will accelerate some of the forces that are necessary for said implosion to happen.
100% fuck this sociopath bastard (and this dog pile technology) into oblivion.
Last edited:
Upvote
100
(103
/
-3)
I recently heard of an index fund that tries to offset this by allocating funds more equally across the S&P 500 instead of almost entirely into the top 5 or 6 stocks.
I'm not sure that will help, though, because if a rising tide lifts all boats, then I suppose an ebbing tide lowers all boats.
Upvote
23
(23
/
0)
We all know the issue of automating porn bots is nothing but a Quagmire, and Altman and Zuck's actions suggest their contribution to the dialogue boils down to "Giggity!"
Upvote
21
(21
/
0)
Can't believe anyone in a "leadership" position failed to see how much of a bad idea this was... If businesses can be people, then there needs to be personal liability for people in "leadership" positions.
Upvote
36
(36
/
0)
There are some states and nations who have passed such laws, but the article is about concern from OpenAI’s mental health board. And, legal or not, we should all at least think twice before giving teens unfettered access to a super addictive sexy chat bot run by a tech conglomerate desperate to hook more uses into its ecosystem.
Upvote
36
(36
/
0)
Years ago, we would have assumed an AI apocalypse would have involved AI gaining control over nuclear arsenals and launching the missiles, taking control over the radioactive ruins.
Now it looks more like chatbots exploiting early signs of mental illness, radicalizing vulnerable users and teaching them how to do more and more extreme things, like buying a truckload of fertilizer and blowing up a power substation, or unleashing poison gas in a crowded food court at a shopping mall.
You think its fun now, just wait until genetic editing enters the picture. Hoo boy, would not want to be part of that arms race.
Now it looks more like chatbots exploiting early signs of mental illness, radicalizing vulnerable users and teaching them how to do more and more extreme things, like buying a truckload of fertilizer and blowing up a power substation, or unleashing poison gas in a crowded food court at a shopping mall.
You think its fun now, just wait until genetic editing enters the picture. Hoo boy, would not want to be part of that arms race.
Upvote
25
(27
/
-2)
Why do these companies even have these "councils", "advisory boards", or "safety panels" then proceed to completely ignore them. Its always the worst of the worst in regards to industries\companies: Exxon, Facebook, Philip Morris, Raybestos, etc.
Upvote
35
(35
/
0)
I wonder how many people are using ChatGPT for their religious guidance. I’m sure it’s a non-zero number.
Although it can’t be that high, otherwise OpenAI would have created “god mode” to try milk it for revenue.
Upvote
26
(26
/
0)
If/When SpaceX and OpenAI do an IPO--it will manipulate the portfolios of the index funds even worse. Because their IPOs are looking to be some of the most insane in market history. I do not envy the portfolio managers having to figure out how to mitigate their risk.
There's also secondary effects. Because such obscene amounts of capital are now exclusively bookmarked for anything labeled AI...the opportunity cost is born by literally every kind of business not doing AI things that cannot get funding for more useful endeavors.
Upvote
27
(28
/
-1)
altman scraped up the intellectual property of the planet, without payment, that is theft. BIG THEFT. He did that while his bot was open source... the moment he finished he went private. altman is scum... true scum. he wants to be like bezos and musk... filthy rich, and looking down on the proles as he takes all their money and screws up people's minds. F#CK HIM. He's lower than a single cell organism.
Upvote
21
(26
/
-5)
For good PR and to attract investors/reassure their current investors and shareholders that they "care".
Also was probably done in the past as a tactic to avoid government regulation. But since the government no longer cares about that, why should they?
Upvote
17
(17
/
0)
Upvote
11
(12
/
-1)
there are tons of LLM bible chat bots.
chatbible, bibleai, bibleask, biblemate, sonOfGodai, faithgtp, scripturebot, hailmary, etc, etc, etc..
Upvote
24
(25
/
-1)
MilanKraft
Ars Tribunus Angusticlavius
"That was so last week, bro... nobody remembers 'last week stuff' anymore!"
(Yes. And yes, it is fucking pathetic we live in a society where someone in Congress didn't pull the fucking emergency brake handle on the reaching-terminal-velocity LLM Disaster Train, as if these suicides have to happen in the same way, multiple times with multiple products, before anyone should be concerned or draw a common sense conclusion... even though they're all the same basic flawed technology, trained on more or less the same internet shit-show of unvetted data from Reddit, social media, and literally only God knows where else.)
Upvote
21
(22
/
-1)
It’s called freedom of speech. In the USA, it’s almost impossible to legally restrict the text a computer program is allowed to output based on user input.
Upvote
-7
(8
/
-15)
Here's an idea, since the DOGE guys stole all the SSA databases, why don't we just put Elon in charge of creating a nationwide age verification system? What could go wrong with that?
Upvote
11
(12
/
-1)