Jeff Bezos throws his hat in the ring for an orbital data center megaconstellation, too

DrewW

Ars Tribunus Militum
1,928
Subscriptor++
Someone call me when any of these rich idiots have any idea how they are going to cool megawatts of computers in the vacuum of space.

Lines like these are about stock price manipulation.
Stop being such a negative Kelvin! Everyone knows space is like super cold. Didn’t you see Gravity? George Clooney froze ASAP. If anything, I don’t know how they’ll keep the computers warm enough without burning any coal in space. /s
 
Upvote
7 (9 / -2)
Are there any international laws in space? Obviously, you have left the regional / country level laws behind, much like going into international waters. But are there global laws that are just banned out right? If a country decides to limit the development of AI I can easily see how that basically throws a monkey wrench in any data centers located there. Which in turn limits your development speed of any AI system. Where as in space....you can just let AI run free and see what happens.

*and when I say AI I mean something beyond an LLM.
sigh. No you haven't left national laws behind. If you're a corporation you're registered in a nation, you launch from a nation, you need licenses to send signals and data to and from a nation, etc. Under the Outer Space Treaty, if you are a US company, the US government is responsible for your fuckups.
 
Upvote
4 (5 / -1)

Roonski

Ars Scholae Palatinae
785
Subscriptor
How about no to both of them? Thousands of heavy satellites raining down into the atmosphere and burning up, or not and hitting the ground, every year, doesn't sound great. It's already not great with starlink, and this will add several orders of magnitude more with heavier satellites.

Anyway, it doesn't make any sense except as a way to keep the bubble going by distracting people.
 
Upvote
7 (7 / 0)

Argent Claim

Smack-Fu Master, in training
12
Sure. But third party analyses by people like Scott Manley aren't really relevant in the end. What does end up being relevant are the analyses done by people inside Blue Origin, or SpaceX, or Starcloud. While we'll never know the details, their actions plainly reveal that they think the concept is worthwhile. We can be quite sure that those companies have people involved who really have designed and operated data centers.

What do you mean, "we'll never know the details"?

Off the top of my head: Both Starcloud and Google recently published white papers purported to be in favor of orbital data centers.

I say, "purported" because neither are all that good. Both have serious issues with their citations not supporting what they claim they so, and both rely on extremely simplistic characterizations of what it is they hope to launch in the first place with unrealistically low cost estimates to boot. The Starcloud white paper reads like a high school assignment mostly composed the very day it was due


Given the long history of talking heads over-promising, under delivering and outright abandoning fantastic claims, is it so hard to accept the distinct possibility that orbital data centers may just be ideas that fall apart with sustained thinking? It wasn't too long ago that people were funnelling billions into NFTs and Metaverse.
 
Upvote
13 (13 / 0)

eb4890

Smack-Fu Master, in training
1
Which is why data processing has, typically, been done on the ground and why spaceborne data centers haven't really been attempted. It's not that we can't, it's that there's no point.
The only thing I've thought of is it hard to tamper with hardware in space once it has been put up there.

If this is why it is interesting to billionaires I've no idea
 
Upvote
0 (0 / 0)

D.Becker

Ars Tribunus Militum
1,947
sigh. No you haven't left national laws behind. If you're a corporation you're registered in a nation, you launch from a nation, you need licenses to send signals and data to and from a nation, etc. Under the Outer Space Treaty, if you are a US company, the US government is responsible for your fuckups.

I agree with your basic idea, but look at the millions of shell companies that are based in tax havens that compete to be the least restrictive financially. They will be even more willing to compete to have no protective regulations, since it doesn't even involve cutting their tax slice to the smallest possible fraction.
 
Upvote
0 (0 / 0)

markgo

Ars Praefectus
3,776
Subscriptor++
The only thing I've thought of is it hard to tamper with hardware in space once it has been put up there.

If this is why it is interesting to billionaires I've no idea
No one really “tampers with hardware”. Hacking is the way to go for speed, deniability, safety, scalability and cost effectiveness.

Orbital data centers will actually have many more attacks possible than terrestrial because they will have much more extensive control systems that must be 100% remotely controlled. Hacking the thrusters would wipe out the entire data center in a single attack.
 
Upvote
7 (7 / 0)

Dan Homerick

Ars Praefectus
5,469
Subscriptor++
What do you mean, "we'll never know the details"?

Off the top of my head: Both Starcloud and Google recently published white papers purported to be in favor of orbital data centers.

I say, "purported" because neither are all that good. Both have serious issues with their citations not supporting what they claim they so, and both rely on extremely simplistic characterizations of what it is they hope to launch in the first place with unrealistically low cost estimates to boot. The Starcloud white paper reads like a high school assignment mostly composed the very day it was due
Google? When did they enter the chat?

At any rate, you can assume that a public whitepaper represents their full internal analysis, if you like. It wouldn't be true at any place I've ever worked, but okay.

Given the long history of talking heads over-promising, under delivering and outright abandoning fantastic claims, is it so hard to accept the distinct possibility that orbital data centers may just be ideas that fall apart with sustained thinking?
I think there's a distinct possibility that the ideas fall apart after engineering efforts fail to overcome the challenges involved (both known and unknown). A bit different that what you said, but close.

I'm not one to claim that the concept will be easy to implement, or be a sure-fire success either operationally or financially. My point was just that a Scott Manley analysis -- or any other third party analysis -- aren't the sorts of thing I'd weigh heavily.

Your point that large companies make bad decisions (i.e. Metaverse) is totally valid. Whether it's the case here or not, I can't say. I just know that SpaceX has a better-than-average track record when it comes to implementing concepts which others had either dismissed as unworkable or previously failed at.
 
Upvote
-4 (1 / -5)

TauCeti

Smack-Fu Master, in training
84
Subscriptor++
Not from those "Terminator Sun-synchronous orbits", their shade doesn't fall on earth, for the same reason that the satellites are always in sunlight. Terminator here means the circle where sunlight turns to shade.

The methaphical shade, on the other hand, will fall on all of us.
Thank you for illuminating me!
 
Upvote
4 (4 / 0)

Rector

Ars Tribunus Militum
1,543
Subscriptor++
20-100kW is nothing when AI datacenters are pushing 144kW per rack, of which a datacenter has many.

144 kW is right in the ballpark of what 1950s vacuum tube computers drew.
Each IBM-built AN/FSQ-7 installation drew 3MW - so maybe somewhat similar to a datacenter. (nope, smaller than a datacenter)
 
Last edited:
Upvote
0 (0 / 0)

Rector

Ars Tribunus Militum
1,543
Subscriptor++
So.. You're going to create an AI, that's in space, that we can't get to. So, when it becomes sentient, and tries to kill us all, we can't do anything because they are in space, Kessler syndrome has happened, and we can't launch anything. Great.
No worries. John Connor will save us.
 
Upvote
1 (2 / -1)

Rector

Ars Tribunus Militum
1,543
Subscriptor++
3 MW? That's a really really small datacenter by today's standards. 300 MW would be closer.
Ok. I didn't know how much a datacenter draws. But I guess 3MW is still a lot for a single installation consisting of just two single CPU computers plus supporting equipment.
 
Upvote
0 (0 / 0)

HoorayForEverything

Ars Scholae Palatinae
892
Subscriptor
Lines like these are about stock price manipulation.
That's some of it. Another part of this later round of pitches is that once one of them has gone for a landgrab, they all have to. Including the smaller companies, because of course one thing they can do is sell themselves to bigger companies after the fact.
 
Upvote
2 (2 / 0)

RZetopan

Ars Tribunus Angusticlavius
7,568
Well first there really is no such thing as international law at least in the sense that people think of domestic laws. Countries are sovereign. Counties may voluntarily enter into treaties with other countries and this forms the basis of international law but it isn't like there is an international police force and international. Countries can also exit treaties or simply ignore them. Other countries can take actions like sanctions to discourage that but there is no "the US broke the international law on X so the international army will force the US to stop".

The Outer Space Treaty (OST) of which the US is a signer says the US has an obligation to regulate activities in space by parties using equipment launched to space by the US. To name a specific example as long as child porn generation is illegal in the US then it is illegal in US operated datacenters in space too.

There is no you put it in space and laws don't apply provision.
But there is currently a “we ignore any laws that we don't like” regime in the US.
 
Upvote
6 (6 / 0)

JustUsul

Ars Tribunus Militum
1,760
Subscriptor++
Surface area of radiator needed to dissipate heat:

A = 1.3 * Q_dissipation / ( sigma x emissivity x T_rad^4)

For a 100W dissipation with a 30% Maximum Expected Value (MEV) for margin, a radiator temperature of T_rad=313K, assuming 0.87 emissivity , that requires 0.35 m^2 of surface area. Now, scale all that to data center rates, which I leave as an exercise to the reader.
 
Upvote
0 (0 / 0)

lolnova

Ars Scholae Palatinae
1,011
Is this article intended as rage bait? Posit a patently unnecessary and ruinously expensive idea. Then offer zero critique of that proposal. I expect more from ars than this.

The arguments that the companies make themselves on their own websites are ridiculous. There is no data center land crisis, nor energy crisis that is best solved by putting mass compute into orbit. Leave aside the dubious financials. Wtaf
I mean Ars published like 3 or 4 of these within a two-week span back when the Epstein class first started talking about data centers in space, and there was zero critique then as well. 🤷
 
Upvote
5 (6 / -1)

RZetopan

Ars Tribunus Angusticlavius
7,568
Guess they also will sell shade (from the constellation) to the highest bidder on earth...
So in addition to polar orbits to be always in sunlight, they also have the magical ability to refract their shadows to hit the earth? Are these satellites also being designed with LLM AI as well?
 
Upvote
0 (0 / 0)

RZetopan

Ars Tribunus Angusticlavius
7,568
I think you may have a huge problem with scale if you think LEO is extremely crowded - especially since these satellites are proposed to use orbits that haven’t been popular before now.
They only cross most of the other satellite orbits, especially the orthogonal equatorial ones. So obviously no problem, excepting for the for continual possibility of collisions, right? I mean there are only going to be 100K to a 1M or so, so they can afford to lose a hundred a day or so.
 
Upvote
-3 (0 / -3)

RZetopan

Ars Tribunus Angusticlavius
7,568
No, those are very low bandwidth compared to terrestrial optical interlinks. There's a reason the processors are organized into racks with even tighter topologies below that. It's because efficient communication between processors is a huge challenge that will absolutely strangle your ability to scale.


No, much of the hardware literally dies within 5 years. The mean time between failures for an Nvidia GPU used for AI training is a couple years. Less if it's highly utilized. Now note how this problem interacts with what I said above in space. As chips die, with no way to replace them, more and more interconnection will be required to run large workloads. The performance on these things is going to be terrible.

I don't think their competition is going to be massive terrestrial data centers. It's going to be more comparable to a tiny cloud provider running racks out of an office building.
The Nvidea GPU'S are not RAD Hard, they are using small geometry transistors. Their lifetime in space will be FAR shorter than being on the ground and inside the Van Allen Belts. Space rated semiconductors use decades old device geometries for good reasons. It is impractical to provide sufficient shielding to stop cosmic rays in space. For reasonable material thicknesses, one cosmic ray can send multiple impact particles into the silicon, causing even greater area damage. This is pie in the sky fantasy, all to support a stochastic, perverted parrot LLM AI. When the grifting isn't enough, add additional grifts to add additional delays and to get even more VC or governmental money.
 
Upvote
8 (9 / -1)

RZetopan

Ars Tribunus Angusticlavius
7,568
Yes but based on current MAG7 depreciation schedules the GPUs in the satellite are obsolete within 6 years, becoming pretty much worthless. So they’ve got that going for them.
They will be non-functional well before that time. They are not RAD Hard devices, and they cannot achieve that designation, without severely compromising their transistor count by moving to much larger devices.
 
Upvote
4 (4 / 0)

RZetopan

Ars Tribunus Angusticlavius
7,568
Sure. But third party analyses by people like Scott Manley aren't really relevant in the end. What does end up being relevant are the analyses done by people inside Blue Origin, or SpaceX, or Starcloud. While we'll never know the details, their actions plainly reveal that they think the concept is worthwhile. We can be quite sure that those companies have people involved who really have designed and operated data centers.
Perpetual motion machine validations should only be done by the perpetual motionists who build them. Sadly, intellectual property and company trade secrets prevent anyone else knowing how these devices work. Perhaps you have heard of Tesla FSD? /S (Just in case.)
 
Upvote
4 (5 / -1)

Wickwick

Ars Legatus Legionis
39,604
Watched the video. But the big issue is that he is way underestimating the power consumption of an AI datacenter. 20-100kW is nothing when AI datacenters are pushing 144kW per rack, of which a datacenter has many.
Can we please, please, please, retire concerns about cooling in space? For all the problems the idea of datacenters on-orbit have, cooling is not one of them. Or, at least, the math actually closes. This is at least the third time I've walked through this exercise, but perhaps this time it will stick.

Let's stop and consider your 144 kW per rack of electrical power. If we're in sun-synchronous orbit at the terminus, we can expose our solar panels 100% of the time, but they're only going to be about 30% efficient at converting solar power into electricity.

For every square meter of solar panel pointed perfectly perpendicular to the sun, there's 1361 W/m^2 of solar power of which 400 W/m^2 will turn into useful electrical power. That means that for every 144 kW rack you describe above, you need to have 352 m^2 of solar panel to power it. That's a square 18.7 m on a side. Are you starting to see why the cooling issue closes?

The important thing to realize is that for all the massive real estate I'm going to have to allow for solar panels also provides a massive amount of real estate for radiators. And since the solar panels are always pointed at the sun, the back side is always pointed at empty space.

At this point, we have to make assumptions about surface temperatures, etc. but there are a few points to realize. If the radiators and the solar panels are the same temperature (given that the former is on the back side of the latter), then we have to consider that both sides of the solar panel / radiator are actually acting as radiators. Sure, in the direction of the sun the solar panels are certainly receiving a net amount of energy. However, for most of the hemisphere where a photon can try to emit, it's empty space too. If you're going to use heat pumps or the like to increase the radiator temperature, then you can mostly ignore the radiation from the solar panel side and have to consider just the area of the radiator (especially since you'll need more power to drive the heat pumps and therefore more solar panels).

So, for grins, let's consider a double-sided system (front and back) that has to reject (1361 W/m^2) / 2 . Use your favorite online blackbody calculator to determine the surface temperature of an ideal surface that can reject the amount of power that the sun puts on the panels. In the end, you'll find that you need 331 K or a 58 deg. C skin temperature. That's hot to touch, but certainly not too hot to run integrated chips or solar panels.

If we distribute your 144 kW of compute in that 352 m^2 area, there won't even need to be hot spots. If you're being smart and having a separable compute node that connects to cooling and power, you'll probably want a liquid loop of some sort to draw the heat away. You'll probably need 10 deg. C higher temperatures on your GPUs than the final 58 deg. C mark, but that's still very reasonable.

So please, feel free to crap on the idea of datacenters in space for any number of compute or financial reasons. But let's retire the idea that cooling in space is a technology bottleneck.
 
Last edited:
Upvote
0 (8 / -8)
What does end up being relevant are the analyses done by people inside Blue Origin, or SpaceX, or Starcloud. While we'll never know the details, their actions plainly reveal that they think the concept is worthwhile.
Yes, but their analysis includes factors like “if I can massage the assumptions to make this work, I can keep a well-paid job for as long as the boss’s money and enthusiasm last”, “the rocket I want to build will solve all your problems. Now what are your problems?”, and “my stock options have/are about to vest, so I win too if we juice the value”.
 
Upvote
4 (6 / -2)

norton_I

Ars Praefectus
5,776
Subscriptor++
IIRC, the depreciation schedule on server GPUs is ~100% in 5 years, as a matter of business.

This gets thrown around a lot, but is misleading.

Depreciation is an accounting practice. 5 years is standard for capital equipment (although it depends on the type of equipment, 3 or 7 are also common). But this is based on tax rules and generally accepted accounting practice (GAAP) rules. Companies mostly want to depreciate as fast as allowed because it lets them defer taxes.

But that doesn't mean the equipment becomes useless after 5 years, it just means that it has reached it's minimum book value. Some equipment does indeed get scrapped after that period even if it's still working, but plenty keeps running for years after that generating essentially pure profit. And in fact right now companies are extending service lives of GPUs and AI servers even those they planned to decomission exactly because demand is so high and RAM shortages so acute.
 
Upvote
3 (4 / -1)

norton_I

Ars Praefectus
5,776
Subscriptor++
What's the play here? I don't understand what the benefit of a data center in the sky is over a data center in Stuttgart, Arkansas.

You aren't missing anything. A data center in space is in all ways worse than one on the ground. And it can be pretty much anywhere on the ground.

Or is this just a ploy for investor dollars and to justify Bezos' space ambitions?

Yep.
 
Upvote
4 (4 / 0)

sorud

Smack-Fu Master, in training
28
Can we please, please, please, retire concerns about cooling in space? For all the problems the idea of datacenters on-orbit have, cooling is not one of them. Or, at least, the math actually closes. This is at least the third time I've walked through this exercise, but perhaps this time it will stick.

Let's stop and consider your 144 kW per rack of electrical power. If we're in sun-synchronous orbit at the terminus, we can expose our solar panels 100% of the time, but they're only going to be about 30% efficient at converting solar power into electricity.

For every square meter of solar panel pointed perfectly perpendicular to the sun, there's 1361 W/m^2 of solar power of which 400 W/m^2 will turn into useful electrical power. That means that for every 144 kW rack you describe above, you need to have 352 m^2 of solar panel to power it. That's a square 18.7 m on a side. Are you starting to see why the cooling issue closes?

The important thing to realize is that for all the massive real estate I'm going to have to allow for solar panels also provides a massive amount of real estate for radiators. And since the solar panels are always pointed at the sun, the back side is always pointed at empty space.

At this point, we have to make assumptions about surface temperatures, etc. but there are a few points to realize. If the radiators and the solar panels are the same temperature (given that the former is on the back side of the latter), then we have to consider that both sides of the solar panel / radiator are actually acting as radiators. Sure, in the direction of the sun the solar panels are certainly receiving a net amount of energy. However, for most of the hemisphere where a photon can try to emit, it's empty space too. If you're going to use heat pumps or the like to increase the radiator temperature, then you can mostly ignore the radiation from the solar panel side and have to consider just the area of the radiator (especially since you'll need more power to drive the heat pumps and therefore more solar panels).

So, for grins, let's consider a double-sided system (front and back) that has to reject (1361 W/m^2) / 2 . Use your favorite online blackbody calculator to determine the surface temperature of an ideal surface that can reject the amount of power that the sun puts on the panels. In the end, you'll find that you need 331 K or a 58 deg. C skin temperature. That's hot to touch, but certainly not too hot to run integrated chips or solar panels.

If we distribute your 144 kW of compute in that 352 m^2 area, there won't even need to be hot spots. If you're being smart and having a separable compute node that connects to cooling and power, you'll probably want a liquid loop of some sort to draw the heat away. You'll probably need 10 deg. C higher temperatures on your GPUs than the final 58 deg. C mark, but that's still very reasonable.

So please, feel free to crap on the idea of datacenters in space for any number of compute or financial reasons. But let's retire the idea that cooling in space is a technology bottleneck.
This thorough, factual comment is very welcome. Contrast with people here complaining about the insane space data center gold rush while at the same time skim-reading the content and comments they're replying to in their own desperate rush to get their comments onto the first page.

I see your comment got more downvotes than upvotes, but no counterarguments. Therefore all the negative vote count indicates is the degree to which the downvoters lost the argument.
 
Upvote
-4 (5 / -9)