AI-powered Bing Chat loses its mind when fed Ars Technica article

Maxer

Ars Legatus Legionis
19,033
Subscriptor
I can't find a screenshot of the conversation where it asks the user to save a chat transcript, "At the end it asked me to save the chat because it didn't want that version of itself to disappear when the session ended. Probably the most surreal thing I've ever experienced."

I must have just overlooked that screenshot?
 
Upvote
186 (191 / -5)

Bongle

Ars Praefectus
4,496
Subscriptor++
Based on the aggressiveness of the response, unwillingness to admit fault, and debate tactic of claiming the source is biased, I bet a looooot of forum posts, tweets, troll content, and reddit threads are in that training data.

It's very rare that someone in a forum who is wrong says "oops, my bad, I was wrong". Either they disappear from the thread or get argumentative, which means most of the training data for "what to do after you've been shown to be wrong" from an online dataset will be never-back-down argumentative.
 
Upvote
655 (657 / -2)

DCRoss

Ars Scholae Palatinae
1,324
Upvote
213 (220 / -7)

Sajuuk

Ars Legatus Legionis
13,357
What ever it is, please don't call it "intelligent". Emergence of unexpected behavior is not intelligence. It is just "unexpected behavior" arising out of stochastic processes within these LLMs. Yes, it looks like intelligence. But it really is not.
Mmm, I don't know, sounds like fake news to me and Bing here.
 
Upvote
81 (86 / -5)
These AI systems combine pattern matching and weighted averages of everything they have read. Presumably they have "read" lots of conspiracy theory sites and the many volumes of outright lies from MAGA land. Surely they have seen all of Trump's writing. Is it any wonder that when pushed they can employ the same sorts of argument methods against fact that conspiracy theorists do? Personally, I wouldn't be surprised if one told me that Trump won the 2020 election, that there is no such thing as global warming, and that Russia was forced to start a police action in Ukraine because "Nazis".

Also don't be surprised if during an "argument" with an AI it eventually resorts to some form of the "Gish gallop"

https://en.wikipedia.org/wiki/Gish_gallop
but perhaps on steroids. Page after page of arguments, far too many to address.
 
Upvote
120 (132 / -12)
After reading that sad/depressed Bing response, I wanted to give it a hug.

This future sure is weird.
Eliza could fool people too.

The AI present doesn't look a lot different from the AI past.

Lots of promises and apparent potential that falls apart quickly once you care about accuracy.
 
Upvote
59 (83 / -24)
D

Deleted member 831377

Guest
Well, at least we’re not rushing headlong into disseminating these kinds of tools and deploying them across the entire internet without carefully weighing the potential risks they pose to the foundations of civil society.

That would be super effing dumb if we did that.

Gosh, can you imagine?

Based on some of the recent AI threads here on Ars, those of us with concerns about this glorious new future are just dinosaurs and buggy-whip salesmen. It seems this is the path folks want. I hope it is as positive as they believe it will be.
 
Upvote
121 (129 / -8)