GitHub says it can no longer absorb "escalating inference cost" from it heaviest AI users.
See full article...
See full article...
tl;dr "eventually, product must be sold for more than it costs to produce"Subsidizing that level of usage through heavily discounted subscription rates has apparently become untenable for GitHub
I hear many anecdotes about individual employees burning $10k+/month of tokens for marginal gains in productivity. Look up "tokenmaxxing" if you want to melt your brain. GitHub probably made this change because they can't viably sustain a bunch ofAnd so it begins.... curious how this will affect the economics of recent hiring trends with mass layoffs that were done because of "AI" (or, so those CEOs claimed). Pricing for these LLMs needs to go up probably 10-20x (my guesstimate) to ensure these companies aren't losing money hand over fist. And then suddenly people start to look a lot less expensive again.
LLMs certainly have their value with some use cases, but humans still can add even more value. Hopefully the pendulum swings back to a more balanced state.
On one level its funny, but I hope Github would cut the connection before they roll out the price increases.So how long before the article about someone who left their agent running for several days looking for the seahorse emoji and now they have a $10k bill they can't pay?
Klarna rehired human customer service reps after firing them all for AI (but they are being offered gig worker jobs).And so it begins.... curious how this will affect the economics of recent hiring trends with mass layoffs that were done because of "AI" (or, so those CEOs claimed). …
Hopefully the pendulum swings back to a more balanced state.
It is almost like the words "charity" and "business" were always two separate words and ideas for a reason.Are they expecting profit within the AI-business now? Good thinking…
We can only hope
This should be entertaining!
I'm guessing a lot of people have been using Copilot precisely because the cost has been subsidised. So those people will now jump ship to whatever LLM provider is still offering a subsidised service. And then that LLM provider will have to raise their prices...
And then the industry will go around this loop a few times, until there's no more subsidised LLM services left for people to take advantage of. At which point, we'll finally see how big the commercial customer base actually is for LLM models.
I suspect the results will be far too small to justify the current valuations of companies such as OpenAI!
I go to lots of tech events in a tech hub and frequently offer mentorship and help to startups. I am not kidding when I say I’d get fired quickly at any normal SaaS company if I had AI numbers.Oh thank god. We're about to see how useful these products are when they're not subsidized.
Counter-argument: you don't have to love them, but Microsoft is basically a mature company that is well-conditioned to sell regular products to regular customers for regular money.The reckoning has begun, though I would not have predicted that GitHub/Microsoft would be one of the first to cave and start passing the bill onto users.
And so it begins.... curious how this will affect the economics of recent hiring trends with mass layoffs that were done because of "AI" (or, so those CEOs claimed). Pricing for these LLMs needs to go up probably 10-20x (my guesstimate) to ensure these companies aren't losing money hand over fist. And then suddenly people start to look a lot less expensive again.
LLMs certainly have their value with some use cases, but humans still can add even more value. Hopefully the pendulum swings back to a more balanced state.
I can't imagine that cliff is very far off if deep pocket entities like Microsoft are already reaching for the brakes to reign in ballooning costs. It answers why Anthropic was so desperate for "investment" in the past week or soCounter-argument: you don't have to love them, but Microsoft is basically a mature company that is well-conditioned to sell regular products to regular customers for regular money.
This is another SKU in MS's staid, conventional product lineup. When OpenAI/Anthropic/etc. need to make this reorientation, that's all she wrote, that's all they have. It will be the coyote having run 100 feet out over the cliff edge and that will be a very interesting day in the office.
IDK about "conventional". Microsoft is increasingly a web infra and SaaS company. Microsoft has stopped caring about Windows, because it is 10% of their total revenue. Copilot is 5%. This was 2023 revenue:Counter-argument: you don't have to love them, but Microsoft is basically a mature company that is well-conditioned to sell regular products to regular customers for regular money.
This is another SKU in MS's staid, conventional product lineup. When OpenAI/Anthropic/etc. need to make this reorientation, that's all she wrote, that's all they have. It will be the coyote having run 100 feet out over the cliff edge and that will be a very interesting day in the office.