Buy your RAM (and SSDs) now.

redleader

Ars Legatus Legionis
35,891
"SSDs will be next"

AFAIK AI likes to make large constant writes, making perhaps QLC less suitable? Other than the lower endurance, its also slower than TLC. Both things that doesn't really affect desktop use. So hopefully QLC drives will still be OK'ish.
If you're placing a big enough order you can get the vender to swap the QLC firmware for TLC.
 

Cool Modine

Ars Tribunus Angusticlavius
9,188
Subscriptor
The DOA set of DDR4 ECC 4x 32GB that I ordered direct from v-color on September 16: I didn’t have the replacement kit in hand until November 10th.

The price of that kit went from $300 to $640 by the time I had working RAM in hand. This better be all I need for the homelab in the foreseeable future.
 

SportivoA

Ars Tribunus Militum
1,769
If you're placing a big enough order you can get the vender to swap the QLC firmware for TLC.
Depending on how things collapse/turn over, there might be some interesting parts on the surplus market (eventually). However, unlike STH's experience with prior used enterprise SSDs, I suspect training storage SSDs will be thrashed to hell. Some might be at-lifetime. At least the server RAM shouldn't be too funky?
 

Demento

Ars Legatus Legionis
15,543
Subscriptor
I'd bought a 5070Ti in the summer, but the retailer intentionally fucked it up because they didn't mean for those two discounts to stack.

I saw the RAM price thing kicking off and bought myself a used 5070Ti Super for around the price of a stock 9070 (no X or T) instead. (I have an OG G-sync screen, the 9070 was card+monitor cost)

I'm really, really glad I did the mrs's upgrade from Ivy Bridge to Zen4 in the summer and didn't wait. And that's it. I have enough storage, I think, for now. Ready to huddle down and buy nothing for the next 18 months.
I did, of course, mean a 4070Ti Super. Which is probably obvious by context, but figured I'd point it out after the edit window closed.
I'm at 1440 for the foreseeable, and it's plenty.
 

IceStorm

Ars Legatus Legionis
26,224
Moderator
Jay thinks this won't affect video cards because different fab lines make GDDR and DDR


View: https://www.youtube.com/watch?v=x9xjAGnz10I


What Jay forgot to read was the fine print: OpenAI didn't buy memory per se, they bought raw wafer capacity.

It doesn't matter what fab line is in use, what matters is that 40% of SK Hynix and Samsung wafer capacity was lost, on the same day. The same wafers are used for both. The rest of the AI companies bought virtually all of the rest in a panic.

And, like clockwork, AMD announced price increase of at least 10% to their partners:
https://videocardz.com/newz/amd-radeon-gpus-may-cost-10-more

AMD has no large stockpile of GDDR like nVidia maintains. If you want a Radeon GPU, buy it this week.
 
Last edited:

SportivoA

Ars Tribunus Militum
1,769
And everyone is going to reprioritize fab allocations based on foreseeable profits now that half of everything is on 70% allocation or worse. Basically that means hoping to suck up more LLM cash sloshing around and leaving most of us out to dry very much like GPUs were 8 months ago. If you can't get 100% of the parts of a consumer-facing SKU, it can't be sold!
Plus AMD pretty much already came out and said prices are gonna go up. There's no guesswork involved there.
AIBs have also signaled this happening soon enough.
 
AMD has no large stockpile of GDDR like nVidia maintains. If you want a Radeon GPU, buy it this week.
FOMO wins again, I just got a 9070 xt. (For anyone who needs further incentive, PayPal buy-now-pay-later is doing 20% cash back on Newegg purchases.)

After I sell my 4070 super I'll get a ~20% performance upgrade for ~$100, not something I usually bother with, but I also get to try to break free of Windows gaming.

For some more anecdata, as I looked through old purchase history I see that I paid $150 for a 2x16gb DDR4 kit in 2020, and $200 in 2021. I remember being grumpy about the pandemic prices back then...
 

IceStorm

Ars Legatus Legionis
26,224
Moderator
MLID put up a written version of his video:
https://www.mooreslawisdead.com/post/sam-altman-s-dirty-dram-deal

From the article, here's the crux of the problem:

And let’s just say it: Here is the uncomfortable truth Sam Altman is always loath to admit in interviews: OpenAI is worried about losing its lead. The last 18 months have seen competitors catching up fast — Anthropic, Meta, xAI, and specifically Google’s Gemini 3 has gotten a ton of praise just in the past week. Everyone’s chasing training capacity. Everyone needs memory. DRAM is the lifeblood of scaling inference and training throughput. Cutting supply to your rivals is not a conspiracy theory. It’s a business tactic as old as business itself. And so, when you consider how secretive OpenAI was about their deals with Samsung and SK Hynix, but additionally how unready they were to immediately utilize their warehouses of DRAM wafers – it sure seems like a primary goal of these deals was to deprive the market, and not just an attempt to protect OpenAI's own supply…

OpenAI was afraid of their competition catching up, so they kneecapped their competitors by buying as much wafer capacity as possible.
 
  • Angry
Reactions: HyperSplatt
Man that bubble is going to pop HARD.
That's what bubbles do, and that's why it's called popping. But as with any self respecting bubble, the timing is impossible to predict.

A few days ago, I saw a related news report about Deutsche Bank. They loaned money to various parties for the construction of AI datacenters; apparently they used their usual contracts for buildings and construction. So Deutsche Bank was thinking that those contracts would run 10 years or 20 years.

Now the bankers have realized that those debtors might not last so many years ... and so the strategists at Deutsche Bank are evaluating options to re-pack those loans into other "finance products" and sell them on. Does anybody still remember that very distant past of 2008? No? Great! - Then we have "Derivatives" to sell!

And that was only the one bank which was caught talking about the matter. It's gonna be interesting times.
 

Anonymous Chicken

Ars Tribunus Militum
1,964
Subscriptor
Now the bankers have realized that those debtors might not last so many years ... and so the strategists at Deutsche Bank are evaluating options to re-pack those loans into other "finance products" and sell them on. Does anybody still remember that very distant past of 2008? No? Great! - Then we have "Derivatives" to sell!
Yeah but by now everyone has heard of the AI bubble, the "finance products" probably go to someone who attempts to price in the risk.
 

abj

Ars Legatus Legionis
18,320
Subscriptor
Investor, best known for being one of the first (at least the first to find a way to capitalize off of) to recognize the housing bubble pre-2008, making hundreds of millions after the crash on CDO shorts. Been in the news a lot due to his current shorts on AI companies.
I would say he is best known for being portrayed by Christian Bale in a popular movie biased on the Michael Lewis called The Big Short.
 

abj

Ars Legatus Legionis
18,320
Subscriptor
Well, if he can correctly pinpoint the timing of the AI bubble bursting, then he definitely knows something about bubbles that no economist has yet modeled and publicized. Interesting!
Timing a bubble is hard, Burry went all in too early and nearly bankrupted his fund.
 

Sunner

Ars Praefectus
4,868
Subscriptor++
Really happy I got myself a new build including 64GB of RAM during the summer. Fuck all this AI bullshit.
I guess a new GPU won't be on the table until the bubble pops though. Or maybe I should start a publically traded company with AI in the name as a get rich quick scheme.
Hmm, how does AI powered windshield wipers sound? Or is that already a thing?
 

SportivoA

Ars Tribunus Militum
1,769
I guess a new GPU won't be on the table until the bubble pops though. Or maybe I should start a publically traded company with AI in the name as a get rich quick scheme.
What do you have right now? (and is there something out there you want?) Because GPUs haven't been swept up by the price increases quite yet, but all vendors have indicated that they will be once the supply chain shakes out.
 

Sunner

Ars Praefectus
4,868
Subscriptor++
What do you have right now? (and is there something out there you want?) Because GPUs haven't been swept up by the price increases quite yet, but all vendors have indicated that they will be once the supply chain shakes out.
A 4070Ti so it's not like I can't play games. In fact I might not need (being very liberal with the word "need" there) a new GPU until Witcher 4.
 
  • Like
Reactions: SportivoA
Are any builders or big OEMs selling systems with not-too-terrible RAM markups?

I'm looking into speccing a system for a relative, they are into astrophotography and want a system that can process image stacks faster than a mid/high end laptop from a few years ago. That workload will use all the CPU cores, RAM (hah!) and high speed storage you can throw at it. Some software also takes advantage of CUDA acceleration but nothing they're using routinely.

Staying in the consumer hardware space I'd be looking at a 5950x 9950x with 64+ GB RAM, at least one very fast PCIE 5 SSD, and a hand-me-down 4070s GPU. Maybe a motherboard with multiple PCIE 5x4 SSD slots or just an expansion card to use the second PCIE 5x16 slot for SSDs.

I haven't searched extensively but it seems like the 5800x3d 9800x3d is usually the highest spec CPU in gaming prebuilts, and most systems with a 5950x 9950x are sold as an "(AI) workstation" for 2x the cost of anything sold as a gaming PC.

Maybe if they have the budget they can eat the RAM premium and I can build it as a Christmas present...
 
Last edited: