How dare you be the bigger person!I think we're distracting ourselves. His point was irrelevant and IMHO you didn't need to make it sillier--probably anymore than I needed to point out that's what you were doing.
Here... I'm putting down my dull butter knife and backing away from the argument![]()
My aspiration after two years of therapy is to suck less.How dare you be the bigger person!
It's hard, good job.My aspiration after two years of therapy is to suck less.
- We know, for a fact, that AI output was used. It is IRRELEVANT whether the quotes were fabricated to this analysis. Those words were taken from the output of an AI and put directly into the article. EVEN IF THE QUOTES WERE ACCURATE, THE AUTHOR DIDN’T DO THAT WORK. That’s AI output. Period.
It absolutely is, and I tried to convey this in my post. "Here's how I imagine that worked," would have been a better way to put it than, "Here's my mental model of how that worked".
My default assumption is that clearing recent work was not done cavalierly. If it wasn't done cavalierly, it probably involved a lot of toil that was not emphasized in the two sentences that shared its results.
My suggestion was to share the details of that toil. Personally, I'm a lot more inclined to accept a less than perfect answer (and let's be honest, perfect would be no event like this, so that horse is out of the barn) when I can see an honest effort to address the issue.
We have ZERO information that his “head clearing” was what caused the retraction. What we know for certain is that after publication, the original author came to Ars and said in no uncertain terms that Ars was falsely quoting him. That’s when shit hit the fan. Benj says that he asked for the article to be pulled because he was too sick to fix it. Which seems to have been AFTER it became obvious it was a major problem.If I've read it correctly, as soon as his head cleared he had an 'oh, fuck!' moment and requested the article be yanked.
Not used AI to pull quotes to avoid the terrible labor of … reading a short blog post and selecting a sentence or two to quote.Not sure what else he could have done?
And that’s exactly what happened. It’s ALSO what would have happened if it had generated a real quote.I strongly suspect, rightly or wrongly, some people's definitions of "publication of AI-generated material" isn't this literal, and they may assume it means something like "when an LLM is doing the writing for you."
Not "exactly that" at all. I'm not going to complain overmuch about my 12h ejection--Aurich enforced a standing rule, after all, which is pretty much what I'm advocating in the first place.Whether or not it's ironic for a former Ars journalist who has been describing why posting something a person didn't say as a direct quote is a violation of journalistic standards to be ejected for doing exactly that...
Agreed.And that’s exactly what happened. It’s ALSO what would have happened if it had generated a real quote.
Let’s say you and I do an interview, and I pull out several quotes to use. Now you may have said the words in the quote, but part of my job as an author is choosing which parts to quote. Which means choosing the parts to quote is part of the writing itself. If I instead tell an LLM to pick the best quotes the resulting selections ARE AI-generated material.
Again, even if the quotes were real, he had a duty to disclose that he had generated them this way. Because that’s HIS job as an author. If the AI had worked, it would have performed part of the author’s job: selecting the portions of a blog to quote IS generating material. Because we expect a human in the loop. Even if they were real quotes, Benj couldn’t tell you if the quotes were in context. He couldn’t tell you if they were the most interesting quotes. He couldn’t tell you why he picked those lines, or why they were more relevant than other quotes. Because he wouldn’t have generated that content. Those choices would have been AI generated even if they were real.
There's two situations here, and we don't know which one applies:
1 - he requested the article be yanked as soon as he was thinking clearly (good outcome)(still not great, mind).
2 - he requested the article to be yanked as a result of the shit hitting the fan (bad outcome).
It'll be up to Ars to determine which they think is true, and what action is applicable as a result. But as I say, when it comes to 'trust' issues with Ars articles I think there are bigger fish to fry.
For whatever it's worth, I wasn't trying to argue against this interpretation, just suggesting that if this is the intended interpretation, they need to make sure that's very clear in the policy. It might seem obvious that this is the intention, but I'm just not sure the current phrasing makes that as clear as it could be. (Then again, we haven't seen the actual, full policy.)And that’s exactly what happened. It’s ALSO what would have happened if it had generated a real quote.
Let’s say you and I do an interview, and I pull out several quotes to use. Now you may have said the words in the quote, but part of my job as an author is choosing which parts to quote. Which means choosing the parts to quote is part of the writing itself. If I instead tell an LLM to pick the best quotes the resulting selections ARE AI-generated material.
The only quibble I have is this is an ideal learning opportunity for people studying journalism in the (somewhat dystopian) era we now find ourselves in, and the 'what and why' of this error being more visible would be useful for that (apologies, I'm not expressing this sentiment as well as I would like, guess that's why I'm not a journalist).How refreshing to own a mistake and correct it - if only this was the societal standard instead of a rare instance in a particularly honest enclave.
Thanks Ars, renewal time is soon, i guess that decision will continue to be settled.
Slashdot still exists? Huh, I had no idea!Ironically, I was able to find the retracted article by visiting Slashdot.
I’m sorry, but no, “his head magically cleared hours later, at the exact same time as the person he misquoted showed up in the comments thread, but then was also magically unclear enough that, per his own words, he was too sick to fix the article, despite literally having the author in the comments, who he could literally just ask for quotes” is not equally as plausible as “the person who was misquoted showed up, it caused a kerfluffle, and they reached out to Benj who was, as he said, too sick to fix it”.And on the flip side there's very little to say it isn't.
I’m not saying he wasn’t ill. I’m saying that the overwhelming likelihood is that the reason the article was pulled isn’t because his head magically cleared right around the time the person he misquoted was already in the comments explaining that those were false quotes.If Ars' investigation leads them to the 'he was never ill and he did this deliberately' conclusion then yes, yeet him onto the job market. It would be appropriate.
That is a serious failure of our standards. Direct quotations must always reflect what a source actually said
My point is that even the most restrictive interpretation, that the author cannot use content generated by an LLM, is violated by having the LLM pull quotes. Because the LLM pulling quotes IS GENERATING CONTENT.For whatever it's worth, I wasn't trying to argue against this interpretation, just suggesting that if this is the intended interpretation, they need to make sure that's very clear in the policy. It might seem obvious that this is the intention, but I'm just not sure the current phrasing makes that as clear as it could be. (Then again, we haven't seen the actual, full policy.)
The only quibble I have is this is an ideal learning opportunity for people studying journalism in the (somewhat dystopian) era we now find ourselves in, and the 'what and why' of this error being more visible would be useful for that (apologies, I'm not expressing this sentiment as well as I would like, guess that's why I'm not a journalist).
Can I ask which site you will be moving on to, which presumably you believe has a higher watermark for integrity?[...] This is not the first issue with intergrity they've had and at some point as a reader you have to admit there is something broken with the culture regardless of how much you enjoy the content.
I mean, the Conde Nast publication has people searching anywhere but their own website to find out why there's a terse apology with 1200 comments and no real explanation as to what happened or regarding who. Well, unless you feel like sifting through 1200 comments.Ars really should have either done something in conjunction with Edwards posting on Bluesky, or should have stopped Edwards posting on Bluesky, I agree with that. I also think everyone should remember that we are at the start of the first working day since this happened and even if Aurich & Ken are pulling 18 hour days since Friday, that's not going to help when there's nobody to answer the phone at Conde HQ.
As for this comparison? 404 Media are the most incredible gossips so this specific comparison isn't a surprise at all, and with the context I've given above, it says more about 404 Media than it does about Ars.
this is not a serious comment, right? that cannot possibly be the standard against which we judge Ars's editorial policies, else they could literally do no wrong. i appreciate people having different opinions on how we should respond to the current topic, but please try to live in the real world.There's another former Ars author who cannot be named, and compared to that, well this is absolutely nothing.
I mean, the Conde Nast publication has people searching anywhere but their own website to find out why there's a terse apology with 1200 comments and no real explanation as to what happened or regarding who. Well, unless you feel like sifting through 1200 comments.
On the other hand, the "incredible gossips" put together an article that covered the bases of explaining what happened, and in a professional manner.
https://www.404media.co/ars-technic...fabricated-quotes-about-ai-generated-article/
Oh, and Aftermath put together a roundup as well, albeit more as a blog than professional reporting.
https://aftermath.site/story-about-...ecause-journalist-used-ai-that-made-mistakes/
So that's two indie outlets keeping me better informed on this topic than Ars is, and they did it over a holiday weekend with no fuss or fanfare.
It's one, the other is hallucinated.You do not have and will not have a "dual amd 9950x3d" system because there are no motherboards that support that configuration.
saying no one should lose their job over this is perfectly reasonable and you are not the only one to say that, but what you also said, and what i am responding to specifically (which is why i quoted it) is "There's another former Ars author who cannot be named, and compared to that, well this is absolutely nothing"; in making that comparison, you seem to be suggesting that any future editorial transgression should be compared to one of the most widely-condemned atrocities you could imagine an Ars author committing prior to deciding whether those responsible should face any consequences.My opinion is nobody should lose their job over this. Very clearly many people disagree.
Keep information/article available, whatever the f'ing AI bots do with it later on, well their responsibility. Shite in, shite out.So while I can see the first level of argument "hide this from AI", I both don't think it hides it from AI at all and I think it's a possible case of "the cure is worse than the disease".