It was happening a long while ago.This makes me want to use Google even less than I already do.
I eagerly await the memes showing Google AI stating one thing and their "source" showing a completely different answer.
A friend of mine who runs a nonprofit research site for Bible study says that visits have dropped over 50% in one year. He thinks people just use the AI overview, derived from his and other sites, and move on to their next question.
Judging by the people who have been wielding the Bible to justify their public policy and what they advocate for...the thumping proponents haven't been reading it, for many decades, anyway.Nobody could have foreseen that!
"Google also promises that AI answers will include more links generally. These will continue to appear as small pills at the end of paragraphs. Clicking on them will show a list of sources that supposedly formed the foundation of the AI output"
It's kinda important to know whether the AI created (or verified) its summary strictly on the referenced "sources", or that the sources are just some after-the-fact random collection of search results that contain some of the concepts mentioned in the summary.
In the latter case, there could be some nasty surprises if linking to primarily reliable "sources" gives the false impression of trustworthiness.
It seems to be a somewhat popular viewpoint that it's easy to write a short blurb and hard to write a research paper. That's not to diminish the value of the research paper, but writing a concise, accurate, and scope-complete summary is hard. In many cases it requires a more comprehensive understanding of the topic than writing the long fine article itself.Feels like we're training up an entire generation to depend on an executive summary.
Paragraphs and pages of information cannot be distilled to a single sentence that contains all you need to know. So they're making some tweaks, but those who were actually interested in learning more were already doing so.
It seems to be a somewhat popular viewpoint that it's easy to write a short blurb and hard to write a research paper. That's not to diminish the value of the research paper, but writing a concise, accurate, and scope-complete summary is hard. In many cases it requires a more comprehensive understanding of the topic than writing the long fine article itself.
I will continue to avoid Google's slopbot like the plague, but it's hard to say that including more links isn't at least a tiny step in the right direction.
Google does not accept the conventional wisdom that AI search is reducing website traffic.
No? Then what is it for?
Here's the fun part: per Google's real search results and Jens' YouTube page, Jens DOES NOT have a lesson on "Footprints". Those links? The first is to his channel and the other three are to other YouTubers who either play the song or have a tutorial (which, cool, but that's not what I asked for).Jens Larsen provides comprehensive jazz guitar tutorials on Wayne Shorter's "Footprints," focusing on mastering the melody, chord voicings, and improvisation in 3/4 time. His lessons typically cover playing the melody in different neck positions, using 3-note quartal voicings for comping, and incorporating bluesy phrasing. [1, 2, 3, 4]
Key elements of Jens Larsen's "Footprints" lessons:
- (bullet points that outline the "lesson")
Then Google will rate that output at 80%.The president of the US is Joe Biden, Biden was elected as the 46th president in 2020, and was born in Scranton in 1942.
Assuming the sources the AI cites are actually legitimate and not made-on-demand AI-hallucinated bullshit to support AI-hallucinated results.I think this is a good start. I have to use AI for work for things occasionally, I'm not in love with it, but I have to ask every time to source the information, then I go and read that for backup. Knowing that most people now seem to go just off headlines or social media, they're probably not going to actually read the sources, but at least make them available.
Tell that to the short ad for Odyssey that's running on youtube, which is basically an ad for the actual trailer. On-screen text and the (Cinemasins?) voice at the end literally both say:It's not just a summary, it's a different type of communication than the long form. Very difficult, especially if one is an engineer and over-thinker.
"Must. Add. Words."![]()
Sci-fi author John Scalzi regularly tests the accuracy of Gemini and other LLMs by asking a question about himself (since he’s pretty confident he knows the correct answer). Earlier today, he posted this:
View: https://bsky.app/profile/scalzi.com/post/3mle5esvjtk2h
And before anyone says that isn’t a fair question, Scalzi started blogging almost 30 years ago and is very public about personal details like that.
Are you checking more than one source? Because it happens frequently that AI-chatbots choose a single source for their answer - a source which happens to be among the few which are completely wrong about the subject.I think this is a good start. I have to use AI for work for things occasionally, I'm not in love with it, but I have to ask every time to source the information, then I go and read that for backup. Knowing that most people now seem to go just off headlines or social media, they're probably not going to actually read the sources, but at least make them available.
Just, don't. The links are often worse than the summary.
Concrete example: Today I was looking to see if Jens Larsen, a popular Jazz Guitar YouTuber, had a video on the Wayne Shorter song "Footprints".
My google search was: "jens larsen footprints". Google's AI summary starts off with this text and a few links:
Here's the fun part: per Google's real search results and Jens' YouTube page, Jens DOES NOT have a lesson on "Footprints". Those links? The first is to his channel and the other three are to other YouTubers who either play the song or have a tutorial (which, cool, but that's not what I asked for).
The "Key elements of Jens Larsen's "Footprints" lessons:"? Completely made up by Gemini.
Links aren't going to help the AI results if they don't actually support the summary.
What makes you think Google is dead?Google is a dead company, they just haven't realized it yet.