Study: Sycophantic AI can undermine human judgment

Status
You're currently viewing only Happy Medium's posts. Click here to go back to viewing the entire thread.

Happy Medium

Ars Tribunus Militum
2,147
Subscriptor++
More people convinced to be always right, exactly what we needed.

I was hoping that observing AI -which I feel should be renamed AM, Artificial Mind, since it’s blindly logical while lacking the conscious intelligence to understand reality- and seeing how it hallucinates would teach people to beware of their own minds, realize how unreliable they can be, how easy it is to trick ourselves into wrong ideas that may have internal logical consistency but don’t reflect reality. Thus developing some self doubt, an awareness of the vastness of our ignorance.

But seems we are more often getting reinforcement of blind beliefs and encouragement of intellectual passivity instead.
Are LLMs "blindly logical"? Because in my experience its actually the opposite. They don't work off logic, they work off what "feels like it's right" or what they're hoping you will think sounds right from them. Hell, it still is challenging to get LLMs to do the most basic of maths, which is the most logical of fields.
 
Upvote
15 (15 / 0)
Status
You're currently viewing only Happy Medium's posts. Click here to go back to viewing the entire thread.