Tech stack at a glance
The orbital data centre idea rests on seven technology layers: the physical satellite bus and payload, the communication links that connect it to ground and space, the AI accelerators that do the compute, the software that turns hardware into useful work, the scaling laws that tell us how to get the most useful work per watt, Jensen Huang's 5-layer cake (the canonical NVIDIA framing of the AI factory stack), and Karpathy's software eras (how the same orbital compute is programmed three different ways). Understanding these layers lets you see how an orbital AI hosting system works as a whole.
Every section follows the same structure: ๐ฏ Primer (one-sentence summary) โ ๐ Mermaid diagram (futuristic neon style) โ ๐ Examples / analogies โ ๐ At a glance (scannable bullet list) โ ๐ In depth (the full prose).
| Layer | What | Why for orbital DC |
|---|---|---|
| Satellite hardware | Bus, payload, solar, ADCS, thermal, propulsion, radiation shielding | Without a reliable, radiation-hardened bus and payload, AI hardware cannot survive long enough to deliver useful inference in orbit. |
| Satellite communication & internet | Frequency bands, link budget, ground stations, ISL, Walker constellations, latency math | An orbital data centre is useless if it cannot send and receive data at high rates with low latency to users on Earth or in space. |
| AI hardware | GPUs (H100 โ Vera Rubin), custom silicon (Tenstorrent, Groq, Cerebras, TPU), COTS vs rad-hard | The harsh radiation environment of LEO demands specialised AI accelerators that can survive total ionising dose and single-effect effects while delivering the teraflops needed for modern LLMs. |
| AI software | Inference engines (vLLM, TGI, llama.cpp, TensorRT-LLM), MoE, omnimodel, reasoning models | Efficient AI software stretches limited orbital compute further, letting more useful work happen per watt and per second of satellite lifetime. |
| Scaling laws | Chinchilla, Kaplan, emergent abilities, test-time compute (o1/R1), the bitter lesson | Knowing which scale (data, model size, or compute) gives the biggest return on investment lets an orbital data centre allocate its scarce power, thermal budget, and compute seconds for maximum useful work per watt. |
| Jensen Huang's 5-layer cake | Energy โ chips โ infrastructure โ models โ applications (NVIDIA's canonical AI factory framing) | Huang's stack identifies energy as the only binding constraint on orbital AI compute. Every other layer is a function of how many watts you can deliver to the payload. The application layer is the only place where economic value is created. |
| Karpathy's software eras | Software 1.0 (human code) โ 2.0 (neural network weights) โ 3.0 (LLM prompts in natural language) | The orbital implication: a Software 3.0 stack on orbit can be re-tasked without uploading new weights. The model itself doesn't move; the program does. This collapses the iteration cost of orbital AI from weeks to seconds. |
๐ฐ๏ธ Satellite Hardware
The physical foundation of orbital AI
๐ฏ Primer: A satellite is two boxes glued together โ the bus (everything that keeps it alive) and the payload (everything that does the work). For an orbital AI data centre the payload is the AI accelerator farm; the bus is what keeps the farm powered, cool, oriented, and alive.
graph TD Payload["Payload
(AI accelerators)"] Power["โก Power
solar + battery"] ADCS["๐งญ ADCS
pointing"] Thermal["๐ก๏ธ Thermal
radiators"] Comms["๐ก Comms
antennas"] Prop["๐ Propulsion
station-keeping"] Rad["โข๏ธ Radiation
shielding"] Bus(["Bus: keeps the payload alive"]) Payload --> Bus Power --> Bus ADCS --> Bus Thermal --> Bus Comms --> Bus Prop --> Bus Rad --> Bus classDef bus fill:#0f172a,stroke:#34d399,color:#e2e8f0; classDef payload fill:#0ea5e9,stroke:#0284c7,color:#0a0e1a; class Bus bus; class Payload payload;
๐ Examples
- ๐ฐ๏ธ Starlink v2 Mini โ ~800 kg wet mass, ~50 kW solar array, Hall-effect thrusters for orbit maintenance, krypton-ion propulsion for de-orbit. Bus does everything; payload is the phased-array user antennas.
- ๐ฐ๏ธ Starcloud-1 ("High Machines") โ first orbital data centre prototype. 1ร H100 GPU wrapped in aluminium shielding on a Starcloud bus. Payload is the GPU; bus is what keeps it alive at ~500 km.
- ๐ก๏ธ ISS external logistics โ same engineering problem at 400 km: solar arrays produce ~120 kW, ammonia loops dump heat to radiators, gyros + reaction wheels keep orientation, and propellant holds the altitude.
๐ At a glance
- โก Power โ solar arrays + batteries cover the 35-min eclipse per 90-min orbit
- ๐งญ ADCS โ star trackers + reaction wheels point antennas within 0.1ยฐ
- ๐ก๏ธ Thermal โ heat pipes + radiators reject waste heat (vacuum = no air cooling)
- ๐ Propulsion โ electric thrusters counter LEO atmospheric drag
- โข๏ธ Radiation โ shielding + rad-hard parts + ECC memory + redundancy
- ๐ Reliability โ dual- or triple-string critical subsystems (no repairman in space)
๐ In depth
๐ Bus and payload
The bus is the satellite's service module: power, ADCS, thermal, propulsion, comms, radiation shielding. The payload is the mission-specific equipment โ for an ODC that's the AI accelerator farm. In a ground data centre the rack is the unit; in orbit the satellite is the unit, and the bus is everything that keeps that unit online.
โก Power: solar arrays and batteries
Sunlight in LEO is intense and nearly continuous. A typical 400-km circular orbit has a period of ~90 min, with ~35 min of eclipse per orbit and ~55 min of sunlight (ScienceDirect: LEO overview โ "approximately 65 min in the Sun and eclipsed for 35 min"; ERAU IJAA: "in LEO the maximum eclipse duration remains close to 35 minutes"). Modern tripleโjunction gallium arsenide solar arrays convert >30 % of that light into electricity. During eclipse, lithiumโion batteries (or emerging solidโstate designs) supply power. For a 10 kW AI payload, you need roughly 25 mยฒ of solar panels and a battery bank sized for the ~35-min eclipse.
๐งญ ADCS
To keep solar panels sun-pointed and antennas aligned with ground stations, the satellite must know its orientation (determination) and adjust it (control). Determination uses star trackers, sun sensors, magnetometers, and gyroscopes. Control uses reaction wheels, magnetorquers, and occasionally thrusters. Precise pointing (<0.1ยฐ) is essential for high-gain Ka-band or optical links that carry terabits per second of data.
๐ก๏ธ Thermal control
Electronics generate heat; in vacuum the only way to dump it is thermal radiation. Heat pipes move waste heat from AI chips to radiator panels coated with high-emissivity white paint. Louvers or variable-conductance heat pipes adjust radiator effectiveness as the satellite moves in and out of eclipse. Without this, chips would overheat and throttle within minutes.
๐ Propulsion and station-keeping
LEO suffers from atmospheric drag, which slowly decays altitude. Electric propulsion (Hall-effect thrusters or ionisers) or resistojets provide the small, continuous thrust needed to maintain orbit. For a 500 kg satellite at 550 km, โ0.1 m/s per day of delta-v counters drag. Propulsion also enables de-orbit maneuvers at end-of-life to mitigate space debris.
โข๏ธ Radiation shielding
Total ionising dose (TID) and single-event effects (SEE) can flip bits or latch up COTS electronics. Mitigation:
- ๐ก๏ธ Shielding โ aluminium or tantalum walls around sensitive components
- ๐งฌ Rad-hard parts โ specialised CPUs, FPGAs, memory designed for space
- ๐งฎ ECC memory โ error-correcting codes detect and correct bit flips
- ๐ Redundancy โ triple-modular-redundant (TMR) logic for critical loops
๐ Reliability
Space missions cannot call a repairman. Critical subsystems are duplicated (dual-string avionics) or tripled (TMR). Watchdog timers reset frozen processors, and latch-up protection cuts power to a faulty chip before it drags down the bus. MTBF > 5 years is typical for GEO comms sats; LEO ODCs aim for similar longevity despite the harsher radiation environment.
๐งฉ Putting it all together
An orbital data centre's hardware looks like a traditional comm-sat bus, but with a payload optimised for dense compute and high-speed inter-satellite links. The bus must deliver kilowatts of clean power, point within a tenth of a degree, dump megawatts of waste heat, and shield the AI chips from radiation. When all of these subsystems work together, the satellite can host an AI accelerator for years โ turning the vacuum of LEO into a usable data centre.
๐ก Satellite Communication & Internet
Linking orbital data centres to the ground
๐ฏ Primer: A satellite is a relay โ it forwards data between ground stations, between users, and between satellites. The orbital data centre case adds three constraints: terabit-per-second throughput (because AI payloads move big data), single-digit-millisecond latency (because real-time inference matters), and continuous global coverage (because the satellite is moving at 7.7 km/s and only sees any one ground station for ~10 minutes at a time).
graph LR User(["๐ค User on Earth"]) GS1(["๐ก Ground station A"]) GS2(["๐ก Ground station B"]) SAT1["๐ฐ๏ธ Sat 1
(over A)"] SAT2["๐ฐ๏ธ Sat 2
(mid-orbit)"] SAT3["๐ฐ๏ธ Sat 3
(over B)"] User -->|RF Ku/Ka| GS1 GS1 -->|RF Ka| SAT1 SAT1 -.->|"๐ฆ Optical ISL
(~100 Gbps)"| SAT2 SAT2 -.->|"๐ฆ Optical ISL"| SAT3 SAT3 -->|RF Ka| GS2 GS2 -->|fiber| User classDef sat fill:#0ea5e9,stroke:#0284c7,color:#0a0e1a; classDef gs fill:#10b981,stroke:#047857,color:#0a0e1a; class SAT1,SAT2,SAT3 sat; class GS1,GS2 gs;
๐ Examples
- ๐ฐ๏ธ Starlink โ uses Ka-band user links + optical ISLs between satellites. ~160 Gbps per satellite, ~50 ms user-to-cloud latency.
- ๐ก OneWeb โ Ku-band user links, no ISL (relies entirely on ground stations). Lower throughput per sat but simpler architecture.
- ๐ฆ NASA's LCRD โ laser comms demo between GEO and ground. Showed 1.244 Gbps optical downlink over 35,786 km โ proves optical ISLs scale.
๐ At a glance
- ๐ถ Frequency bands โ Ku (12โ18 GHz) for broadcast, Ka (26.5โ40 GHz) for broadband, optical (~1550 nm) for ISLs at terabit rates
- ๐ Link budget โ transmit power + antenna gain โ path loss โ margin = positive C/N
- ๐ Ground stations โ 15โ30 stations globally for continuous coverage from LEO
- ๐ฆ Optical ISLs โ laser crosslinks, ~100 Gbps per link, narrow beam = no interference
- ๐ฐ๏ธ Walker constellation โ (i:t:p:f) pattern guarantees continuous coverage as satellites pass overhead
- โฑ๏ธ Latency โ ~1.67 ms one-way at 500 km; ~30 ms end-to-end with one ISL hop
๐ In depth
๐ถ Frequency bands
Most commercial satellites use Ku-band (12โ18 GHz) and Ka-band (26.5โ40 GHz). Higher frequencies offer wider bandwidth and higher data rates but suffer more from rain fade and require more precise pointing. Emerging Q/V bands (33โ50 GHz) and optical links (near-infrared, โ1550 nm) reach hundreds of gigabits per second with narrow beams. An ODC for AI workloads will likely combine Ka-band for broad coverage and optical ISLs for the space-space backbone.
๐ Link budget
The link budget balances transmit power, antenna gains, path loss, and receiver sensitivity to compute the carrier-to-noise ratio (C/Nโ). A positive link margin ensures a given bit error rate. For a 500 km LEO slant range, free-space path loss is about โ173 dB at 30 GHz. High-gain phased-array antennas on both satellite and ground can recover 60โ80 dB each, leaving a workable margin for high-order modulation (e.g. 32-APSK).
๐ Ground station
A ground station is the terrestrial terminus of the link โ large dish (or phased array), low-noise amplifier (LNA), downconverter, modem. For an ODC constellation you need a network of stations spaced so at least one is in view of each satellite at any time. Typical LEO constellations use 15โ30 stations distributed globally. Modern stations track multiple satellites simultaneously and switch bands in milliseconds.
๐ฆ Inter-satellite link (ISL)
ISLs allow satellites in the same constellation to talk directly, relaying data around the world without hopping to the ground each time. This reduces latency and increases resilience. Optical ISLs (laser comms) are becoming standard โ narrow beams, high frequency (~200 THz), multi-gigabit to terabit per second with small terminals. RF ISLs (Ka-band) exist but are limited by beamwidth and interference.
๐ฐ๏ธ Walker constellation
A Walker delta pattern (i:t:p:f) describes how satellites are placed in orbital planes to provide continuous coverage. Parameters:
- i โ inclination (degrees)
- t โ number of orbital planes
- p โ phasing between planes
- f โ number of satellites per plane
For a global LEO constellation with minimal handover, common choices are 55ยฐ inclination, 32 planes, 50 sats per plane (~1600 total). The pattern ensures that as one satellite moves out of range, another is already in view, enabling seamless handover for both user links and ISLs.
โฑ๏ธ Latency
Three main components:
- ๐ Propagation โ light-speed travel time. 500 km altitude โ ~1.67 ms one-way, ~3.3 ms round-trip.
- ๐ ๏ธ Processing โ modems, error correction, routing tables.
- โณ Queueing โ TDMA / FDMA slot waits.
With optical ISLs and modern onboard processing, end-to-end latency (user โ ODC โ user) can stay under 10 ms for intra-constellation traffic and under 30 ms to a well-located ground station.
๐ Modulation and coding
To squeeze more bits per hertz, satellites use complex modulation (QPSK, 8-PSK, 16-APSK, 32-APSK, 64-QAM) paired with forward error correction (LDPC, Turbo). Adaptive coding and modulation (ACM) changes the scheme on the fly based on real-time link conditions (rain fade, elevation), maintaining the highest possible throughput while keeping the link locked.
๐งญ Phased array antenna
Instead of a single dish that must be mechanically steered, modern satellites use phased-array antennas โ many small radiating elements whose phases are controlled electronically to steer the beam in milliseconds. This enables rapid switching between users, rapid ISL re-acquisition, and precision pointing for optical terminals. Phased arrays also support multiple simultaneous beams, improving spectral efficiency.
๐งฉ Putting it all together
An ODC's communication subsystem must provide:
- ๐ก High-gain steerable antennas (phased array or dish) for both RF and optical
- ๐ Flexible modem spanning Ku / Ka / Q / V bands and optical
- ๐ Robust link budget with margins for weather, pointing loss, aging
- ๐ฆ Optical ISL capability to form a low-latency space-space backbone
- ๐ฐ๏ธ Constellation design (Walker or similar) for continuous ground + ISL coverage
- ๐ง ACM + scheduling to maximise throughput under varying conditions
When these work together, the ODC can receive terabytes of raw sensor data per day, distribute processing across the constellation, and return refined insights to Earth with latency comparable to a terrestrial fibre connection.
โก AI Hardware
From GPUs to rad-hard ASICs
๐ฏ Primer: An AI accelerator is a chip that does matrix multiplications very fast โ GPUs are the general-purpose workhorse, TPUs are Google's custom silicon, and ASICs are purpose-built for one model class. For an orbital data centre the challenge is: the best chips (H100, Vera Rubin) weren't designed to fly in space, so we either shield them, replace them with rad-hard equivalents, or use many smaller chips instead of one big one.
graph TD App["๐ค Application
(LLM inference, vision)"] Arch["๐๏ธ Architecture
(dense ยท MoE ยท sparse)"] Chip["โก Chip class"] App --> Arch --> Chip Chip --> COTS["COTS
H100 ยท Vera Rubin ยท TPU
high teraflops ยท needs shielding"] Chip --> RAD["Rad-hard ASIC
Tenstorrent ยท Groq ยท Cerebras
lower perf ยท built for space"] Chip --> LOT["Many small chips
scale-out ยท redundancy"] classDef app fill:#34d399,stroke:#047857,color:#0a0e1a; classDef chip fill:#0ea5e9,stroke:#0284c7,color:#0a0e1a; class App app; class COTS,RAD,LOT chip;
๐ Examples
- โก H100 on Starcloud-1 โ first COTS H100 in orbit (Dec 2025). Aluminium shielding + ECC + watchdog timers. Used for the first LLM trained in orbit (Gemma-2B).
- ๐งฌ Tenstorrent Grayskull โ radiation-tested RISC-V AI core. Selected for ESA's ASCEND demonstrator.
- ๐ฎ Groq Cardinal โ deterministic dataflow architecture; LEO radiation evaluation underway.
- ๐ง Cerebras WSE-2 โ single-die wafer-scale engine; studies look at modular redundancy + liquid-metal cooling for space.
- ๐ฑ Samsung Mach-1 / BrainChip Akida โ neuromorphic ASICs built in rad-hard fabs for inference at the edge.
๐ At a glance
- โก COTS GPUs โ H100, Vera Rubin, TPU v4 โ industry-leading perf but not space-rated
- โข๏ธ Radiation hardening โ enclosed layout transistors, dual-intermediate contacts, triple-modular redundancy, ECC, watchdog timers
- ๐ก๏ธ Shielding + monitoring โ aluminium / tantalum walls + error correction + scrubbing for COTS in space
- ๐ก๏ธ Thermal โ heat pipes + radiators (no convection in vacuum)
- โ๏ธ Trade-off โ rad-hard lags COTS by 1โ2 process nodes; bridge with more chips, lower precision (FP8/INT4), sparsity-aware engines
- ๐ฏ Sweet spot for ODCs โ many small rad-tolerant chips + one big COTS accelerator behind shielding for peak loads
๐ In depth
๐ From COTS to rad-hard
Commercial-off-the-shelf (COTS) AI accelerators such as NVIDIA's H100 or Google's TPU v4 offer industry-leading performance (hundreds of teraflops FP16) but are not designed for space. Total ionising dose (TID) gradually degrades transistor thresholds; single-event effects (SEE) like bit flips or latch-up cause sudden failures. To fly in LEO for years, AI hardware must be either:
- โข๏ธ Radiation-hardened by design โ specialised fabrication processes, enclosed layout techniques, rad-tolerant libraries
- ๐ก๏ธ Shielded and monitored โ COTS parts behind shielding, with ECC memory, watchdog timers, periodic scrubbing
๐ฐ๏ธ Current space-qualified options (2026)
Few AI accelerators have flown in space. Demonstrations:
- H100 on Starcloud-1 (Dec 2025) โ COTS H100 + aluminium shielding + error-detecting code; first LLM trained in orbit (Gemma-2B)
- Tenstorrent Grayskull โ radiation-tested RISC-V AI core; ESA ASCEND demonstrator
- Groq Cardinal โ deterministic dataflow architecture; LEO radiation evaluation in progress
- Cerebras WSE-2 โ wafer-scale engine; modular redundancy + liquid-metal cooling studies
- Custom ASICs โ Samsung Mach-1, BrainChip Akida in rad-hard fabs (TSMC, GlobalFoundries)
๐ก๏ธ Radiation-hardening techniques
- ๐งฌ Enclosed layout transistors (ELT) โ prevent rad-induced leakage at the oxide interface
- ๐ Dual-intermediate contact (DIC) โ reduces single-event upset (SEU) sensitivity
- ๐ณ๏ธ Triple-modular redundancy (TMR) voting โ three copies vote; masks single-point failures
- ๐งฎ EDAC โ parity + ECC memory + register files + scrubbing
- โฑ๏ธ Watchdog timers โ reset processors that hang due to SEE latch-up
- ๐ Power-gating + isolation โ shut down faulty blocks to prevent contagion
๐ก๏ธ Thermal and power
AI accelerators consume watts to kilowatts and generate proportionate heat. In vacuum, convection does not exist; heat must conduct to radiator panels and radiate away. High-power AI chips therefore require:
- ๐ฐ Heat pipes / vapor chambers โ move heat from die to bus structure
- ๐ค High-emissivity coatings โ white paint or anodised aluminium with ฮต > 0.8
- ๐ Thermal straps โ conductive links between chips and radiators
- ๐ง Active cooling (rare) โ pumped fluid loops for >100 W densities (still experimental)
โ๏ธ Performance vs. reliability trade-offs
A rad-hard AI accelerator typically lags its COTS counterpart by one or two process nodes (e.g., rad-hard 28 nm vs. COTS 5 nm). The gap is bridged by:
- ๐ข More chips โ scale-out with many modest-power accelerators
- ๐๏ธ Lower precision โ FP8 / INT4 inference-only formats reduce transistor count and power
- ๐ฒ Approximate computing โ tolerate small errors for higher throughput or lower power
- ๐ณ๏ธ Sparsity-aware engines โ skip zero weights in LLMs
๐งฉ Putting it all together
For an orbital data centre, the AI hardware layer balances three drivers:
- โข๏ธ Survivability โ withstand TID, SEE, latch-up, thermal cycling for the mission (3โ5 years in LEO)
- ๐ Performance โ deliver enough teraflops / tokens-per-second for the workload (real-time video analytics, LLM inference for constellation telemetry)
- โก Power + thermal โ stay within the bus's power budget and radiator capacity
When these are satisfied, the ODC can host an AI accelerator that continuously ingests sensor data, runs inference, and downloads results to ground stations โ turning the vacuum of LEO into a usable AI factory.
๐ See also
- ๐ ยง6 Jensen Huang's 5-layer cake โ the AI chip choices above sit inside Huang's "chips" layer (the second of five: energy โ chips โ infrastructure โ models โ applications). For orbital data centres the chip layer is gated by the energy layer above; you cannot double the teraflops without doubling the solar array area, the battery capacity, and the thermal radiator mass.
๐ง AI Software
From inference engines to omnimodels
๐ฏ Primer: AI software is everything between the chip and the user's API call. In an orbital data centre the stack has to extract every possible token per joule because power and compute seconds are scarce. Three layers matter: the inference engine (vLLM, TGI, llama.cpp, TensorRT-LLM) that serves the model, the model architecture (dense, MoE, omnimodel, reasoning), and the optimisations (quantisation, KV cache, speculative decoding, continuous batching).
graph LR User(["๐ค API request"]) Engine["๐ง Inference engine
vLLM ยท TGI ยท llama.cpp ยท TensorRT-LLM"] Model["๐ง Model
dense ยท MoE ยท omnimodel ยท reasoning"] Opt["โก Optimisations
FP8 ยท KV cache ยท speculative ยท batching"] User -->|prompt| Engine Engine -->|forward pass| Model Engine -.->|"tunes"| Opt Model -.->|"trained weights"| Engine Engine -->|tokens| User classDef engine fill:#0ea5e9,stroke:#0284c7,color:#0a0e1a; classDef model fill:#34d399,stroke:#047857,color:#0a0e1a; classDef opt fill:#f59e0b,stroke:#b45309,color:#0a0e1a; class Engine engine; class Model model; class Opt opt;
๐ Examples
- ๐ vLLM โ PagedAttention KV cache management. Almost zero memory waste, ~10ร throughput vs naive serving on H100. The de-facto open-source standard.
- ๐ข llama.cpp โ pure C/C++, runs on CPUs and modest GPUs, GGUF quantisation. Lets a 70B model run on a workstation, or a 7B model run on a satellite's housekeeping CPU.
- ๐งช TensorRT-LLM โ NVIDIA's FP8 + tensor-parallel engine. Best per-watt throughput on H100 / Vera Rubin.
- ๐ณ Mixtral 8x7B (MoE) โ 46 B total params but only ~12 B active per token. Trades storage for compute efficiency.
- ๐ค DeepSeek R1 (reasoning) โ chain-of-thought before answering; uses 10โ100ร more compute per query but solves hard problems classical LLMs miss.
๐ At a glance
- ๐ง Inference engines โ vLLM (best throughput), TGI (latency), llama.cpp (portable), TensorRT-LLM (NVIDIA-tuned)
- ๐ณ MoE โ many params, few active per token; better FLOPs-per-quality ratio
- ๐ Omnimodel โ one model handles text + image + audio; less storage and switching overhead
- ๐ค Reasoning โ o1 / R1 style; spend more compute on thinking before answering
- ๐๏ธ Quantisation โ FP16 โ FP8 / INT4; halves memory bandwidth at minimal accuracy cost
- ๐ KV cache โ PagedAttention (vLLM) eliminates fragmentation; compression + sliding-window for long sequences
- โก Speculative decoding โ small draft + big target = 2โ3ร throughput for memory-bound workloads
- ๐ฆ Continuous batching โ fill slots as they free up; ~2ร utilisation vs static batches during contact windows
๐ In depth
๐ง Inference engines
An inference engine takes a trained model and serves it via an API (gRPC, HTTP, or custom binary). Key features for space:
- ๐ High throughput โ many requests per second
- โฑ๏ธ Low latency โ time to first token
- ๐ฆ Efficient batching โ amortise overhead
- ๐พ Low memory footprint โ fit within satellite RAM
- ๐ฏ Deterministic execution โ no jitter interfering with attitude control
Popular open-source engines:
- vLLM โ PagedAttention for KV cache, near-zero waste, high throughput, low latency
- TGI โ latency-optimised, tensor parallelism, quantisation
- llama.cpp โ pure C/C++, runs on CPUs, GGML/GGUF quantisation, highly portable
- TensorRT-LLM โ NVIDIA-optimised, TensorRT kernels, FP8/TF32 precision
๐ณ Mixture of Experts (MoE)
MoE replaces a dense feed-forward layer with a set of expert networks and a gating network that selects which experts to run per token. Benefits:
- ๐ก Compute efficiency โ only a fraction of experts active per token
- ๐ Parameter scaling โ trillions of params, billions active per token
- ๐ก๏ธ Fault tolerance โ if one expert fails (radiation hit), gating routes around it
Notable: Mixtral 8x7B, DeepSeekMoE, Google Switch Transformer, NVIDIA Vera Rubin (rumoured MoE).
๐ Omnimodel
A single model handling multiple modalities (text, image, video, audio) and multiple tasks (classification, generation, reasoning) without task-specific fine-tuning. For an ODC, this reduces the need to store and switch between many specialised models, saving storage and simplifying the stack.
Research: Google's UniCM, NVIDIA's Omni-Modal, vision-language models (BLIP, Flamingo) taking steps toward omni-capability.
๐ค Reasoning models
Reasoning models (OpenAI o1-series, DeepSeek R1) are trained to spend more compute on thinking before answering. In an ODC, a reasoning mode could activate for high-value tasks (anomaly detection in constellation telemetry) while a faster, lighter model handles routine housekeeping.
๐๏ธ Quantisation
Reduces numerical precision (FP16 โ INT8 / FP8), cutting memory bandwidth and storage:
- โก Post-training quantisation (PTQ) โ quick conversion, small accuracy drop
- ๐ฏ Quantisation-aware training (QAT) โ higher fidelity, requires retraining
- ๐ FP8 (E4M3, E5M2) โ supported on Hopper and Blackwell, 2ร speedup over FP16
๐ KV cache optimisation
During autoregressive generation, the model caches previous keys and values to avoid recomputation. Optimisations:
- ๐ PagedAttention (vLLM) โ non-contiguous pages, no fragmentation
- ๐๏ธ Cache compression โ quantise or low-rank approximation
- ๐ช Sliding window โ discard oldest tokens when cache exceeds limit
โก Speculative decoding
A small fast draft model proposes multiple future tokens; the target verifies them in parallel. Accepted drafts effectively multiply throughput. Pairs can be (small Llama, large Llama) or (tiny transformer, MoE). Particularly effective when the target is memory-bandwidth bound.
๐ฆ Continuous batching
Adds new requests to the batch as soon as a slot frees up (when a request finishes). Keeps utilisation high and reduces tail latency โ important during bursty contact windows.
๐งฉ Putting it all together
An ODC's AI software stack should:
- ๐ง Pick the inference engine matched to the hardware (vLLM for GPUs, llama.cpp for CPUs, TensorRT-LLM for NVIDIA)
- ๐ณ Prefer MoE for more model capacity per active FLOP
- ๐ Consider an omnimodel to reduce model-switching overhead
- ๐๏ธ Quantise (FP8 / INT8) to shrink memory footprint
- ๐ Optimise KV cache with paging or compression
- โก Use speculative decoding for latency-sensitive workloads
- ๐ฆ Continuous batching to maximise utilisation during contact windows
- ๐ค Reasoning mode for high-value, infrequent tasks
When these layers work together, the same hardware processes more sensor data, runs more inference queries, and delivers more insights per watt and per second of orbital lifetime.
๐ See also
- ๐ ยง6 Jensen Huang's 5-layer cake โ inference engines + model architectures sit inside Huang's "models" layer (the fourth of five: energy โ chips โ infrastructure โ models โ applications). The orbital data centre's unique value comes from running this layer in space, where latency to the user, data sovereignty, and edge-data privacy all favour the orbital position.
- ๐ ยง7 Karpathy's software eras โ the same models are programmed three different ways: as human code (Software 1.0), as trained neural network weights (Software 2.0), or as English prompts to an LLM (Software 3.0). The orbital implication is significant: a Software 3.0 stack on orbit can be re-tasked without uploading new weights โ the prompt is the program.
๐ Scaling Laws
How model performance grows with data, compute, and parameters
๐ฏ Primer: Scaling laws are empirical rules that say loss falls as a power law when you add more data, parameters, or compute. For an orbital data centre โ where watts, thermal, and compute seconds are all scarce โ the practical question is: which of those three resources gives the biggest quality improvement per joule?
graph TD R["๐ Loss
(lower = better)"] P["๐ Parameters
(model size)"] T["๐ Tokens
(training data)"] C["โก Compute
(FLOPs)"] P -->|"scales as X^-ฮฑ"| R T -->|"scales as X^-ฮฑ"| R C -->|"scales as X^-ฮฑ"| R P <-.->|"coupled"| T T <-.->|"coupled"| C P <-.->|"coupled"| C classDef loss fill:#34d399,stroke:#047857,color:#0a0e1a; classDef axis fill:#0ea5e9,stroke:#0284c7,color:#0a0e1a; class R loss; class P,T,C axis;
๐ Examples
- ๐ฆซ Chinchilla (DeepMind, 2022) โ trained Gopher (280 B) and Chinchilla (70 B). Same compute, Chinchilla got better loss because it used 4ร more tokens. Lesson: scale data with model size.
- ๐ Kaplan (OpenAI, 2020) โ first big scaling-laws paper. Showed smooth power-law loss across 8 orders of magnitude. Some exponents later refined by Chinchilla.
- ๐ช Emergent abilities โ at ~10ยฒยฒ FLOPs, LLMs suddenly do multi-step arithmetic, follow complex instructions, and use tools. Below threshold, they can't.
- ๐ง o1 / R1 (test-time compute) โ same model, but instead of 1 forward pass it does 100. ~10ร better on hard math/coding problems, ~100ร more FLOPs per query.
๐ At a glance
- ๐ Power law โ Loss = A ยท X^(โฮฑ) + B (irreducible noise floor); straight line on log-log
- ๐ฆซ Chinchilla-optimal โ for every doubling of params, double the training tokens
- ๐ Kaplan exponents โ earlier scaling rules; trends within a regime, less prescriptive than Chinchilla
- ๐ช Emergent abilities โ abilities appear abruptly past a critical scale (reasoning, tool use, multi-step arithmetic)
- โฑ๏ธ Test-time compute โ o1 / R1 spend 10โ100ร more FLOPs per query to think harder; trades latency for accuracy
- ๐ฅฒ The bitter lesson โ generic + scalable (transformer + search) beats hand-crafted heuristics over the long run
- ๐ฏ For an ODC โ pick the compute-optimal model for your watt budget; reserve test-time compute for high-value tasks
๐ In depth
๐ The power-law form
Most scaling laws follow a power law:
Loss = A ยท X^(โฮฑ) + B
where X is the resource (data, parameters, or compute), A and ฮฑ are positive constants, and B is the irreducible loss floor. On a log-log plot, this appears as a straight line with slope โฮฑ.
๐ Three primary scalings
- ๐ Data scaling โ loss improves with more training tokens (model + compute fixed)
- ๐ Model size scaling โ loss improves with more parameters (data + compute fixed)
- โก Compute scaling โ loss improves with more training FLOPs (data + model fixed)
In practice the three are coupled: more compute lets you train a bigger model or train the same model on more data.
๐ฆซ Chinchilla (data-optimal scaling)
In 2022, DeepMind's Chinchilla project showed that for a given compute budget, doubling params without doubling tokens wastes compute. The compute-optimal point doubles both in proportion: for every 2ร params, 2ร tokens. "Chinchilla-optimal" or "data-optimal" models are not wasting compute on an over-large model starved of data.
๐ Kaplan et al. (earlier scaling laws)
Before Chinchilla, Kaplan et al. (2020) analysed scaling across many orders of magnitude and proposed slightly different exponents. Their work showed loss decreases smoothly as you scale any of the three, but did not emphasise the compute-optimal balance Chinchilla highlighted. Kaplan's laws are still useful for understanding trends within a regime (e.g., how much loss improves if you just double the data).
๐ช Emergent abilities
Certain abilities appear abruptly only when a model exceeds a critical scale:
- ๐งฎ Multi-step arithmetic
- ๐ ๏ธ Tool use
- ๐ฌ Following complex multi-instruction prompts
- ๐ช Situational awareness
For an ODC, this means a slightly larger model might suddenly gain a useful capability (reasoning about satellite telemetry) without a proportional cost increase โ provided you are past the threshold.
โฑ๏ธ Test-time compute (o1 / R1)
Recent work (OpenAI o1-series, DeepSeek R1) shows that allocating compute at inference time dramatically improves performance on hard problems. Instead of one forward pass, the model generates a chain-of-thought, evaluates multiple candidates, or uses search-like strategies. You spend more seconds (and watts) for a more accurate answer. For an ODC, you could reserve a fraction of the compute budget for high-value, infrequent tasks (anomaly detection in downlink data) where extra time to think is worthwhile.
๐ฅฒ The bitter lesson
Rich Sutton's "bitter lesson": over the long term, the most effective AI approaches leverage computation via general-purpose methods (search, learning), not hand-encoded knowledge. In scaling-law terms: simply scaling up compute, data, and model size with a generic architecture (transformer) tends to beat carefully hand-crafted models. For an ODC, this reinforces investing in a scalable, general-purpose AI stack (transformer + MoE) over a narrow, hand-tuned solution.
๐งฉ Putting it all together for an orbital data centre
An ODC has a fixed power budget (watts from solar), a thermal dissipation limit (watts you can radiate), and a compute budget (ops per second without overheating). To maximise useful work per watt:
- ๐ฏ Pick the compute-optimal point โ for the FLOPs you can afford per second, choose a model size + dataset on the Chinchilla-optimal curve
- ๐ช Watch for emergent abilities โ if a slightly larger model (still within budget) gains a needed capability, the extra watts may be worth it
- โฑ๏ธ Reserve test-time compute โ for infrequent but critical inferences, spending extra seconds on chain-of-thought improves accuracy dramatically
- ๐ฅฒ Follow the bitter lesson โ prefer general-purpose scalable architecture over specialised heuristics
By treating power, thermal, and compute as constrained resources and applying scaling-law insights, an ODC can allocate its scarce budget for maximum scientific and economic return per watt of orbital lifetime.
๐๏ธ Jensen Huang's 5-Layer Cake
NVIDIA's framing of the AI factory stack โ energy, chips, infrastructure, models, applications
๐ฏ Primer: Jensen Huang's canonical framing of the AI industry is five layers stacked vertically: energy โ chips โ infrastructure โ models โ applications. Every layer pulls on every layer beneath it. For orbital AI, the punchline is that energy is the only binding constraint โ every chip, every kilowatt, every orbital plane must answer to the application, not the other way around.
graph TD L1["โก Layer 1 โ Energy
(the only binding constraint)"] L2["๐ Layer 2 โ Chips
(transform energy โ computation)"] L3["๐ญ Layer 3 โ Infrastructure
(land, power, cooling, networking)"] L4["๐ง Layer 4 โ Models
(LLMs, reasoning, protein AI, physics)"] L5["๐ฏ Layer 5 โ Applications
(where economic value is created)"] L1 --> L2 --> L3 --> L4 --> L5 L5 -.->|"pulls on every layer below"| L1 classDef base fill:#0f172a,stroke:#34d399,color:#e2e8f0; classDef mid fill:#0ea5e9,stroke:#0284c7,color:#0a0e1a; classDef top fill:#f59e0b,stroke:#b45309,color:#0a0e1a; class L1 base; class L2,L3 mid; class L4,L5 top;
In March 2026, NVIDIA's CEO Jensen Huang published a canonical framing of the AI industry: "AI is a 5-layer cake". The layers, in his exact words, are: energy โ chips โ infrastructure โ models โ applications (NVIDIA blog, 10 March 2026; this exact ordering is also reproduced verbatim in secondary reporting).
Each layer pulls on the ones beneath it. Huang's full sentence: "Every successful application pulls on every layer beneath it, all the way down to the power plant that keeps it alive." (NVIDIA blog)
๐ Examples
- ๐ญ NVIDIA's own AI factories โ Huang mentions "tens of thousands of processors" orchestrated into "AI factories". Stargate (OpenAI + NVIDIA + Oracle + SoftBank) is the $500 B, 10 GW physical instantiation of his mental model.
- ๐ช๐บ Sovereign AI โ the EU's โฌ200 B AI factory programme explicitly adopts Huang's 5-layer cake. Each country runs its own AI factory stack: data centres โ chips โ models โ applications.
- ๐ฐ๏ธ Orbital data centre โ the 5 layers map cleanly: Layer 1 = solar arrays + batteries; Layer 2 = H100 / Vera Rubin; Layer 3 = Walker constellation of LEO sats with optical ISLs; Layer 4 = MoE LLM split across satellites; Layer 5 = real-time inference close to users + European data sovereignty.
๐ At a glance
- โก Energy โ the only binding constraint; every layer above is a function of watts delivered
- ๐ Chips โ processors that turn electrons into tokens (H100, Vera Rubin, TPU)
- ๐ญ Infrastructure โ the AI factory itself: data centres, networking, cooling
- ๐ง Models โ language, biology, chemistry, physics, robotics, autonomous systems
- ๐ฏ Applications โ drug discovery, robotics, copilots, self-driving โ where the money is
- ๐ Every layer pulls on every layer below โ energy is the floor; applications are the ceiling
๐ In depth
โก Layer 1 โ Energy
"Intelligence generated in real time requires power generated in real time. Every token produced is the result of electrons moving, heat being managed and energy being converted into computation. There is no abstraction layer beneath this." (NVIDIA blog)
This is the binding constraint on orbital AI: in LEO, a typical 400-km circular orbit has a period of ~90 min, with ~35 min of eclipse per orbit and ~55 min of sunlight (ScienceDirect: LEO overview โ "approximately 65 min in the Sun and eclipsed for 35 min"; ERAU IJAA: "in LEO the maximum eclipse duration remains close to 35 minutes"). So a 10 kW AI payload needs roughly 25 mยฒ of triple-junction GaAs solar arrays (โ30 % BOL efficiency under AM0 โ 1361 W/mยฒ) plus a battery bank sized for the ~35-min eclipse โ see ยง1 satellite hardware.
๐ Layer 2 โ Chips
Processors designed to "transform energy into computation efficiently at massive scale" (NVIDIA blog). For an orbital data centre, this means GPUs (H100 โ Vera Rubin) or custom silicon (Tenstorrent, Groq, Cerebras, TPU) that survive total ionising dose and single-event effects โ see ยง3 AI hardware.
๐ญ Layer 3 โ Infrastructure
"Land, power delivery, cooling, construction, networking and the systems that orchestrate tens of thousands of processors into one machine. These systems are AI factories." (NVIDIA blog)
In orbit, the "AI factory" is the satellite cluster itself โ a Walker constellation of LEO satellites each running part of a model in a fault-tolerant fabric. See ยง2 satellite communication for the inter-satellite links that stitch the factory together.
๐ง Layer 4 โ Models
"AI models understand many kinds of information: language, biology, chemistry, physics, finance, medicine and the physical world itself. Language models are only one category." (NVIDIA blog)
See ยง4 AI software for the inference engines (vLLM, TGI, llama.cpp, TensorRT-LLM), model architectures (MoE, omnimodels, reasoning models), and optimisation techniques that turn a model into an orbital service.
๐ฏ Layer 5 โ Applications
"Drug discovery platforms. Industrial robotics. Legal copilots. Self-driving cars. A self-driving car is an AI application embodied in a machine. A humanoid robot is an AI application embodied in a body. Same stack. Different outcomes." (NVIDIA blog)
For orbital data centres the most valuable applications are latency-sensitive: real-time inference close to the user, model fine-tuning on edge data, and federated training across a satellite cluster.
๐ฐ Why this framing matters for orbital AI
Huang's stack makes the orbital case concrete in two ways. First, it identifies energy as the only binding constraint โ every other layer is a function of how many watts you can deliver to the payload. This is the same constraint that drives the entire data-centre industry to co-locate with cheap power (NVIDIA blog: "a few hundred billion dollars into [the buildout]; trillions of dollars"). For orbit, the trade-off is solar array area vs. payload mass vs. downlink capacity โ a triple constraint that has no terrestrial analogue.
Second, the framing makes the application layer the only place where economic value is created. An orbital data centre that runs the same model as a ground cloud has no advantage; it must run models that benefit from being in space (latency to the user, sovereignty of European data, edge inference on space-generated data). The 5-layer cake forces a top-down read: every chip, every kilowatt, every orbital plane must answer to the application, not the other way around.
๐ Cross-references
- ๐ From ยง3 AI hardware: the chip layer choices (H100, Vera Rubin, Tenstorrent, Groq, Cerebras, TPU) sit inside Huang's "chips" tier.
- ๐ From ยง4 AI software: the model architecture choices (dense, MoE, omnimodel, reasoning) and inference engine choices (vLLM, TGI, llama.cpp, TensorRT-LLM) sit inside Huang's "models" tier. See also ยง7 Karpathy's software eras for the same models classified by how they are programmed (weights vs. prompts).
๐ฎ Karpathy's Software Eras
Software 1.0 (human code), 2.0 (neural network weights), 3.0 (LLM prompts in natural language)
๐ฏ Primer: Karpathy's framing is that the same task can be programmed three different ways: (1) hand-written code (Software 1.0), (2) trained neural network weights (Software 2.0), or (3) English prompts to an LLM (Software 3.0). For an orbital data centre the punchline is that Software 3.0 changes the upgrade story โ to give the satellite a new capability you change the prompt, not the weights.
graph LR Task["๐ฏ Task
(e.g. sentiment classification)"] S1["๐จโ๐ป Software 1.0
Python / C++
hand-written rules"] S2["๐ง Software 2.0
trained NN weights
dataset + architecture"] S3["๐ฌ Software 3.0
English prompt
programs the LLM"] Task --> S1 Task --> S2 Task --> S3 S1 -.->|"compiled from code"| Output["๐ค Output"] S2 -.->|"compiled from data"| Output S3 -.->|"in-context program"| Output classDef era1 fill:#0ea5e9,stroke:#0284c7,color:#0a0e1a; classDef era2 fill:#10b981,stroke:#047857,color:#0a0e1a; classDef era3 fill:#f59e0b,stroke:#b45309,color:#0a0e1a; class S1 era1; class S2 era2; class S3 era3;
๐ Examples
- ๐ Sentiment classification โ Karpathy's running example throughout the YC talk: classify a tweet as positive/negative. Software 1.0 = a Python rule-based classifier or sklearn pipeline. Software 2.0 = a trained MLP on a labelled dataset. Software 3.0 = a few-shot LLM prompt: "Classify this tweet as POSITIVE or NEGATIVE. Tweet: '{tweet}'. Answer:".
- ๐ค Tesla Autopilot โ Karpathy observed at Tesla that the C++ stack (Software 1.0) shrank over time as neural networks (Software 2.0) absorbed capabilities (image stitching across cameras, lane keeping). The C++ was being deleted, not added.
- ๐ฐ๏ธ Orbital inference โ Software 1.0: rule-based anomaly detector. Software 2.0: a fine-tuned anomaly model uploaded as weights. Software 3.0: prompt the in-orbit LLM with the new anomaly taxonomy in English. The Software 3.0 path skips the upload.
๐ At a glance
- ๐จโ๐ป Software 1.0 โ human-written code in Python/C++; explicit logic
- ๐ง Software 2.0 โ neural network weights compiled from data via backprop + SGD
- ๐ฌ Software 3.0 โ English prompts that program an LLM; "we're now programming computers in English"
- ๐ The source-of-truth axis โ code โ weights โ English (the "language" becomes progressively more human)
- ๐ฐ๏ธ Orbital implication โ Software 3.0 changes the upgrade path: prompt change vs. weight upload
- โฑ๏ธ Iteration cost โ Software 1.0: minutes (edit + run); Software 2.0: weeks (retrain + push); Software 3.0: seconds (change prompt)
๐ In depth
๐จโ๐ป Software 1.0 (the classical stack)
In a 2017 essay, Andrej Karpathy introduced a distinction that has since reshaped how engineers talk about AI code: Software 1.0 is "classical stack" code (Python, C++, etc.), and Software 2.0 is "neural network weights" (Karpathy, Software 2.0, 11 November 2017). The essay's exact framing: "I sometimes see people refer to neural networks as just 'another tool in your machine learning toolbox'... Unfortunately, this interpretation completely misses the forest for the trees. Neural networks are not just another classifier, they represent the beginning of a fundamental shift in how we develop software. They are Software 2.0."
The "classical stack" of Software 1.0 is what we're all familiar with โ written in Python, C++, etc. By writing each line of code, the programmer "identifies a specific point in program space with some desirable behavior" (2017 essay).
๐ง Software 2.0 (neural network weights)
Software 2.0 is written in much more abstract, human-unfriendly language: the weights of a neural network. No human is involved in writing this code (there are too many weights). Instead, we specify the goal (e.g., a dataset of input-output pairs), write a rough skeleton (the architecture), and let backpropagation + stochastic gradient descent search for the program.
The source code of Software 2.0 is the dataset + the architecture; the weights are "compiled from data rather than written by hand" (MindStudio summary, 2 May 2026).
๐ฌ Software 3.0 (LLM prompts in natural language)
In June 2025, Karpathy extended the framework at YC AI Startup School with a new tier: Software 3.0 (transcript, 18 June 2025; annotated notes by Latent Space; official YC library page). His exact framing: "neural networks became programmable with large language models. And so I see this as quite new, unique, it's a new kind of a computer. And so in my mind, it's worth giving it a new designation of Software 3.0. And basically, your prompts are now programs that program the LLM."
Two properties distinguish 3.0 from 1.0 and 2.0:
- ๐ The "source" is English, not code or weights. This makes the medium radically more accessible โ anyone who can write a sentence can program an LLM.
- ๐ The program is "live", executed in-context by the model at inference time. There is no compile step; the prompt is the program.
Karpathy: "remarkably we're now programming computers in English. And so when this blew my mind a few, I guess, years ago now, I tweeted this, and I think it captured the attention of a lot of people, and this is my currently pinned tweet, is that remarkably we're now programming computers in English" (YC talk transcript).
๐ The three eras, side by side
Karpathy uses sentiment classification as a running example: "...if you're doing sentiment classification, for example, you can imagine writing some amount of Python to basically do sentiment classification, or you can train a neural net, or you can prompt a large language model" (singjupost transcript; Medium summary, 20 June 2025). Same task, three implementations:
- ๐จโ๐ป Software 1.0: a hand-written Python classifier (rule-based or scikit-learn pipeline). Source code:
.pyfiles. The programmer "identifies a specific point in program space with some desirable behavior" (2017 essay). - ๐ง Software 2.0: a trained neural network. Source code: dataset + architecture. The weights are compiled from data. Optimisation is backprop + SGD.
- ๐ฌ Software 3.0: a few-shot LLM prompt. Source code: English. Your prompts are now programs that program the LLM.
๐ The Latent Space summary
Latent Space's annotation of the YC talk noted that Karpathy's diagram shows the patchwork/coexistence of all three eras: "Software 3.0 is eating 1.0/2.0" and "a huge amount of software will be rewritten" (Latent Space annotation). The 2017 essay concluded with a similar image: "Software (1.0) is eating the world, and now AI (Software 2.0) is eating software."
๐ฐ๏ธ Why this matters for orbital data centres
The three eras map directly onto orbital AI economics:
- ๐จโ๐ป Software 1.0 in orbit โ hand-written code: deterministic, low-power, debuggable from the ground. Ideal for housekeeping, ADCS, fault detection.
- ๐ง Software 2.0 in orbit โ trained weights uploaded as files. High accuracy on narrow tasks (anomaly detection, classification). Iteration cost: weeks (retrain, validate, upload, verify).
- ๐ฌ Software 3.0 in orbit โ an LLM running on orbit, with new capabilities shipped as English prompts via the ground link. Iteration cost: seconds (change the prompt, no upload). The on-orbit model stays put; only the prompt moves.
The practical consequence: an orbital data centre running Software 3.0 can upgrade its capability without uploading new weights. The iteration cost of orbital AI collapses from "weeks (retrain + push weights)" to "seconds (change prompt)". Combined with the latency, sovereignty, and edge-data privacy that makes the orbital case uniquely valuable, Software 3.0 is the lever that makes the orbital AI factory economical.
S-Curves and Market Timing
How adoption curves shape the orbital compute opportunity
An S-curve plots adoption over time: slow start, rapid take-off, then saturation. For orbital compute, the adoption curve tells us when to jump technological generations โ and why the "mid-2027 architecture lock" is a timing decision, not just a thesis.
The Bass diffusion model (1969)
Try it live above this section: the interactive plot lets you drag p, q, m, and the time window. As you slide, the curve re-shapes, t* (peak year) re-positions, and the metrics panel updates. Defaults are the worked example below (p = 0.05, q = 0.40, m = 100 โ t* โ 4.6 years).
The canonical math for adoption of a new product. Three parameters:
- p (innovation coefficient): external influence (PR, founders, specialists). Typical range 0.01โ0.03.
- q (imitation coefficient): word-of-mouth, peer influence. Typical range 0.30โ0.50.
- m (ultimate market potential): total adopters at saturation.
Differential equation
dN/dt = [p + qยทN/m] ยท [m โ N]
N(t) = cumulative adopters at time t. The term [m โ N] is the remaining market.
Closed-form solution
N(t) = m ยท [1 โ exp(โ(p+q)ยทt)] / [1 + (q/p)ยทexp(โ(p+q)ยทt)]
Key derived properties
- Time of peak sales (new adopters per period):
t* = [1/(p+q)] ยท ln(q/p) - Cumulative adoption at peak:
N(t*) = m ยท (p+qโ2p) / (2(p+qโp))โ varies, often ~50% ofmfor highq - Growth-onset heuristic:
N(t) โ m ยท p/q(illustrative only)
For disruptive innovations, q tends higher. For corporate infrastructure (like orbital compute), p tends slightly higher (more strategic buyers).
Applying Bass to high machines / orbital compute
The relevant market is commercial orbital compute (not consumer). Use strategic-markets defaults: p = 0.05 (capital decision, not consumer FOMO), q = 0.40 (typical imitation), m = 100 (relative TAM units).
The 4 phases (my read, July 2026)
Late introduction (~2024-2027)
- ~$1.02B+ raised across 11+ startups (per
state-of-the-art.mdfunding table) - 1 AI model trained in space (Starcloud, Dec 2025)
- Multiple FCC filings, reusable launch drops $/kg to LEO
- Early bets: $1.1B/$2B valuations on Starcloud, Cowboy Space
- ~$1.02B+ raised across 11+ startups (per
Inflection expected (2027-2029)
- Mid-2027 architecture lock (prime contractors standardise orbital AI compute)
- 4,300-satellite network (1 GW compute) technically launched
- First commercial contracts (satellite operators + hyperscaler adjacency)
- Series A โ Series B transition for leaders
Take-off (if it happens) โ 2029-2032
- $35B projected market by 2030 (MarketsandMarkets, sources.db entry 23)
- Mass multi-tenant deployments
- New architecture-standard firms emerge
- EU data sovereignty case hardens (forced demand)
Plateau โ 2032+
- Market consolidation (~3-5 firms dominate)
- Standards locked, "computing in space" is a procurement decision
What the math says
With p = 0.05, q = 0.40, m = 100:
t* = ln(0.40/0.05) / 0.45 = ln(8) / 0.45 โ 4.6 years
N(t*) โ 100 ยท (0.45 โ 0.10) / (2ยท0.45 โ 0.10) = 100 ยท 0.35/0.80 โ 44 units
Interpretation: from time-of-introduction, peak new deployments happen in ~4.5 years. If introduction = 2024 (Starcloud-2 era), peak โ 2028-2029. The architecture lock must land 1-2 years before peak โ ~2027, matching the existing claim. Good sanity check.
Strategic S-curve (Foster) insight
Every technologyโs performance is an S-curve. When your curve plateaus, you must jump to a new one:
- First S-curve: Initial orbital compute (closed-vendor: AOCS/power/thermal/GPU optimised independently)
- Second S-curve: Standardised compute bus (concurrent engineering of whole sat โ AI4CE PhD work target)
- Third S-curve: Orbital DC-as-a-service (multi-tenant, edge-cloud primitives in space)
Jumping too early = building standard for a market that doesnโt exist. Too late = primes lock curve 1 and the standard moves without you. The inflection is the jump window.
Open questions for further work
- Validate introduction date: Was 2024 right? Or 2026 (SpaceX mega-merger + FCC filing)? Shifts peak by 1-2 years.
- Estimate
min compute capacity units: GW-class orbital data centres ร $/GW ร lifetime. The 4,300-sat/1-GW number is a start. - Real data on early adopters: Who funded what in 2024-2026? Sequoia/a16z/NFX/Coinbase bets map to the
pcoefficient. - Comparable S-curve: Cloud adoption (AWS 2006 โ 2013 โ 2020+) is the cleanest analog.
Python sketch (copyable)
import numpy as np
from scipy.optimize import curve_fit
def bass(t, p, q, m):
"""Cumulative adopters N(t) at time t (years)."""
return m * (1 - np.exp(-(p + q) * t)) / (1 + (q / p) * np.exp(-(p + q) * t))
def bass_new(t, p, q, m):
"""New adopters per period (derivative)."""
N = bass(t, p, q, m)
return (p + q * N / m) * (m - N)
# Fit to data: years (t_data) and cumulative adopters (N_data)
# p0 = [0.03, 0.38, N_data.max() * 3] # initial guess
# popt, pcov = curve_fit(bass, t_data, N_data, p0=p0, maxfev=10_000)
# print("p, q, m:", popt)
# Peak sales time
t_peak = np.log(popt[1] / popt[0]) / (popt[0] + popt[1])
This is a 2-3 hour desk exercise. The data-side work (collecting 2024-2026 capital raised + sats launched per quarter + GPU launches in space) is the harder part. Worth doing if JP wants to defend the "mid-2027 architecture lock" claim with a number, not just a thesis.