Featured Post

The $200 Billion AI Capex Shift: How Big Tech Offloads GPU Costs

The artificial intelligence arms race has forced tech giants and cloud providers into an unprecedented spending spree. Deploying state-of-th...

Saturday, October 17, 2026

The AI Bottleneck Shift: From Chips to Credit

 Introduction: The Question Underneath Every GPU

For most of the past three years, the public conversation about artificial intelligence (AI) has been a conversation about chips. Who has the GPUs? How many did a lab buy? When will the next generation ship? Then the conversation moved to power: gigawatt campuses, gas turbines parked behind datacenter fences, nuclear restarts and grid queues measured in years. Both conversations reflected real bottlenecks at the time.

But underneath every GPU order and every power contract sits a quieter question: who is paying for all of this, and how?

A recent podcast of the SemiAnalysis Weekly, titled "Nvidia's Backstop Universe," puts that question at the centre of the AI story. Its argument is simple to state and profound in its implications.

The AI build-out is no longer primarily constrained by chips or by power sites. It is constrained by credit, by the willingness and ability of capital markets to lend enormous sums against assets that are new, fast-depreciating, technically complex and often owned by companies that do not have investment-grade credit ratings.

The way the industry is bridging that gap is fascinating. Nvidia and the hyperscalers (HPS - Microsoft, Amazon, Google, Meta and Oracle) are effectively renting out their balance sheets. They put their creditworthiness between lenders and the riskier companies that build and operate much of the new capacity. The episode's phrase for it is "Balance Sheet as a Service."

This post analyses SemiAnalysis weekly podcast and explores that argument from first principles and is built in six parts, each answering one question:

  • Part I - Why is AI demand changing shape (training → inference → agents)? How did we get here from Cloud 1.0? What does the AI stack look like, and what describes AI as an industry
  • Part II - Neoclouds. Who are these new GPU clouds, how do they differ from each other, how do they fund themselves, and what does the Nvidia–CoreWeave relationship tell us?
  • Part III - The financing challenge. How big is the bill, why financing is now the bottleneck, how project finance works, what a backstop actually is, and what is inside Nvidia's roughly $497 billion "backstop universe."
  • Part IV - The economics. A simple financial model of a GPU cluster, the financial levers that move returns, profitability per megawatt, residual values, and the shift from GPUs to custom ASICs.
  • Part V - Markets and risk. How credit markets are reacting, why rising bond yields worry equity investors, the willingness-versus-ability debate, where durable agentic demand comes from, and what could go wrong.
  • Part VI - Bringing it together. An end-to-end walk-through of financing a campus, what it all means for sellers, buyers and builders, a glossary, and references for further reading.

Ten key takeaways

  1. The real AI bill is about $11.3 trillion of capex from 2024 to 2029, with roughly $7 trillion of debt outstanding by 2029, per the episode.
  2. The binding constraint has moved from chips, to power and sites, to financing.
  3. Demand is changing shape, from one-off training, to real-time inference, to always-on agentic AI, which makes it more continuous and more financeable.
  4. Lenders want long-term offtake from investment-grade counterparties; most AI labs and Neoclouds aren't investment grade.
  5. Nvidia and the hyperscalers bridge that gap by lending their balance sheets , "Balance Sheet as a Service", with Nvidia's commitments estimated at about $497 billion.
  6. Neoclouds are not all alike: platform-led, full-stack, access-layer and infrastructure led players carry very different risks.
  7. In a simple cluster model, price, utilisation, capex and leverage dominate returns; a backstop can roughly triple debt capacity.
  8. The industry's long-term structure is unsettled: parts may look like software, parts like telecom.
  9. Custom ASICs, rising bond yields and customer concentration are the main pressures on the model.
  10. Nvidia's backstop capacity (~46 GW) is far below the ~240 GW needed, so credit markets must learn to underwrite AI on its own merits.

Part I - Why is AI demand changing shape: Three Eras of AI

Before talking about money, it helps to understand why the amount of compute the world wants keeps growing, and why its shape matters to lenders. A useful framing, popularised in industry keynotes, divides the AI revolution into three eras:

Article content
Three eras of AI

Era 1: Training - "One Time"

Training is the process of building a model: feeding enormous amounts of data through a neural network for weeks or months until it learns useful patterns. Training is compute-hungry but episodic. A lab assembles a very large cluster, runs a training job, then moves on to the next model.

From a financing perspective, training demand is lumpy. It comes in big blocks tied to specific projects. If a lab decides to delay its next model, or finds a more efficient way to train, demand for a particular cluster can disappear quickly. That makes training clusters harder to finance on their own merits, lenders worry about what happens between training runs.

Example: A lab rents 20,000 GPUs for four months to train a new model. Once training finishes, it needs only a fraction of those GPUs for experiments. If the neocloud has no other customer lined up, those GPUs sit idle. A lender to that neocloud sees a revenue stream with a cliff at month four.

Era 2: Inference - "Real Time"

Inference is using the trained model: every time someone asks a chatbot a question, a coding assistant suggests a line, or an enterprise app summarises a document, the model runs on GPUs and generates tokens. Inference demand follows users. It happens in real time, all day, across time zones, and grows as adoption grows.

For lenders, inference is more attractive than training because it looks more like a utility: a steady flow of usage that converts directly into revenue per token. The more inference there is, the more predictable demand becomes.

Example: An enterprise rolls out an AI assistant to 10,000 staff. Each person makes about 40 requests a day. That's 400,000 requests a day, every working day, generating a predictable baseline of compute demand, and of revenue for whoever serves it.

Era 3: Agentic AI - "All Time"

Agentic AI refers to systems that don't just answer a question but carry out multi-step tasks: researching, planning, calling tools, writing and testing code, filling in forms, checking their own work, and handing off to other agents. A single human request can trigger dozens or hundreds of model calls. Agents can also run unattended, overnight, continuously, monitoring systems or processing queues.

That is why the era is labelled "all time." Demand stops being tied to the number of humans typing and becomes tied to the number of tasks delegated to software. It is potentially far larger, and far more continuous, than human-driven inference.

Example: A claims-processing team deploys an agent that reads each incoming claim, checks policy rules, requests missing documents, drafts a decision and routes exceptions to a human. Each claim might involve 50 model calls. At 5,000 claims a day, that's 250,000 calls, running around the clock, regardless of office hours.

Why the eras matter for financing: The three eras matter to this story for three reasons:

  1. Demand durability: Lenders want long, predictable revenue. Inference and agentic workloads are more continuous than training, which makes AI capacity look more financeable over time.
  2. Hardware mix: Training rewards the most flexible, most powerful chips (mostly Nvidia GPUs). High-volume, stable inference rewards the cheapest cost per token, which is where custom chips (ASICs) compete strongly. That shift affects the long-term value of GPU fleets that are being financed today.
  3. Revenue linkage: In the training era, compute is a cost centre funded by investors. In the inference and agentic eras, compute is directly tied to revenue, that is every token served is (in principle) a token sold. That linkage is what ultimately repays the debt.

In the training era, compute is a cost centre funded by investors. In the inference and agentic eras, compute is directly tied to revenue, that is every token served is (in principle) a token sold. That linkage is what ultimately repays the debt.

From Cloud 1.0 to the AI Cloud

AI infrastructure did not appear from nowhere. It is the latest stage in a long evolution of cloud computing, and each stage changed why customers buy and how providers finance themselves. Understanding that evolution makes it easier to see why Neoclouds exist and why the financing model looks the way it does.

Article content
Cloud evolution: each era had a different primary sales trigger

Cloud 1.0 (2008-2013): public cloud, OPEX reduction - The first wave of cloud adoption was mostly public cloud, centred on specific business functions like email, CRM, collaboration, test and development environments. The main sales trigger was cost: turning capital expenditure on servers into operating expenditure, and reducing the cost of running IT. The focus was fulfilment: getting existing workloads delivered more cheaply.

Financially, this era established the hyperscaler model. A few very large companies invested heavily in datacentres and recovered that investment through millions of small, recurring customer payments. Their own balance sheets funded the build.

Cloud 2.0 (2014–2019): public and private, scale and agility - The second wave brought both public and private cloud into mainstream business and operational functions. The trigger shifted from cost to scale and agility, launching products faster, scaling up and down with demand, and protecting revenue by keeping systems available. It was both fulfilment-centric and demand-centric.

This is the era in which hyperscalers became some of the largest capital spenders in the world, still largely self-funded from strong cash flows.

Cloud 3.0 (2020 onwards): distributed and hybrid - The third wave, accelerated by COVID, made cloud the platform of choice across all functions. Architectures became distributed and hybrid, mixing public cloud, private infrastructure and edge locations. The triggers moved again: resilience, customer experience, and revenue protection and generation. Cloud became demand-centric: not just a cheaper place to run things, but the place where new revenue is created.

The distributed cloud battle: control versus portability: A key strategic tension in Cloud 3.0 is between deep integration with one provider and portability across many.

Article content
Control vs Portability

  • Walled garden ("Apple of cloud") - high control, low multicloud reach. AWS and Azure are placed here: deep integration with the provider's own capabilities, consistency, and cloud-service-provider-native design. The customer gets a rich, coherent platform but is more tied to it.
  • Portability ("Android of cloud") - lower control, high multicloud reach. Google and IBM/Red Hat are placed here: deep integration with a multicloud stack, a portability layer, flexibility and container-native design.
  • "Paradise" - high control and high portability. Everyone wants it; few achieve it.
  • Legacy - limited control and limited portability; the starting point for many organisations.

Cloud-native and multicloud architectures pull in different directions and have a heavy impact on exit strategy. Both have a place in a distributed cloud, but a cloud strategy must avoid contradicting itself.

Why this matters for AI financing - The same tension now plays out in AI compute, and it has financing consequences:

  • Hyperscaler AI capacity is the walled garden: It is integrated with the provider's models, data services and security, and is funded from investment-grade (IG, good credit rating) balance sheets.
  • Neocloud capacity is closer to the portability end: Customers can rent raw GPU capacity and run whatever models and software they like. That flexibility attracts AI labs and developers, but Neoclouds don't have hyperscaler balance sheets, so they need external financing and often backstops.
  • Customers' exit strategy becomes lenders' risk: If customers can move workloads easily between providers, a Neocloud's revenue is less sticky, which is exactly why lenders insist on long-term, take-or-pay contracts.

Example: An AI lab runs inference on a Neocloud using containerised, open tooling. When a cheaper provider offers capacity, the lab could move within weeks, unless it is locked into a five-year reserved contract. For the Neocloud's lender, the portability that attracted the customer is precisely why the contract matters more than the relationship.

The AI cloud: a fourth wave - Extending the above framework, the AI cloud can be seen as a fourth wave. Its sales trigger is capability: access to frontier models, agents and productivity gains that weren't possible before. Its financing model is different from earlier waves because the capital required is so large and so concentrated in fast-depreciating hardware that even the hyperscalers' cash flows aren't enough on their own.

The AI Stack - Who Does What

To talk about who is backstopping whom, we need a shared map. The AI industry can be thought of as a layered stack. Capital flows up the stack to build things; revenue flows down the stack to pay that capital back. Every financing structure in this post is ultimately an attempt to make those two flows line up in timing, size and certainty.

Article content
The AI stack: capital flows up to build capacity, revenue flows down to repay it.

Layer 1: Capital providers - At the base are the people with money: equity investors (venture capital, growth funds, sovereign wealth funds, public shareholders), banks, private credit funds, insurance companies and pension funds that buy bonds, and the asset-backed securities (ABS) market, which packages loans or leases into tradable securities. Each has a different appetite.

Equity investors accept the risk of losing everything in exchange for unlimited upside. Senior lenders want to be repaid first, with interest, and care far more about the downside than the upside. Insurance and pension money typically wants long-dated, highly rated, predictable cash flows. This mismatch of appetites is the key to the whole backstop phenomenon.

Layer 2: Datacentres and power - Next is physical infrastructure: land, buildings ("shells"), cooling, electrical gear, substations, grid connections and power. It is owned by hyperscalers, specialist developers, infrastructure funds and, increasingly, energy companies. Power is procured through power purchase agreements (PPAs), where a buyer commits to purchase electricity at an agreed price for many years. Some AI campuses use "behind-the-meter" generation like on-site gas turbines (ex xAI), fuel cells or other sources that don't depend on a slow grid connection.

Datacenter infrastructure is long-lived: a building and its electrical systems can last 15 to 20 years or more. That makes it relatively friendly to traditional infrastructure finance.

Layer 3: Compute - On top of the datacenter sits compute: Nvidia GPUs (H100, H200, B200, GB200, GB300 and successors), alternative accelerators often called XPUs or ASICs (custom chips designed by or for hyperscalers), Google's TPUs, plus servers, high-bandwidth memory, networking switches, optics and cables.

Unlike the building, compute is short-lived in economic terms. A new generation arrives every year or two and can be several times more capable. That makes compute much harder to finance with long-term debt: lenders worry about what the hardware will be worth in five or six years.

Layer 4: Clouds - hyperscalers and neoclouds - The cloud layer turns physical compute into a rentable service. Hyperscalers are the giant, diversified providers like Microsoft Azure, AWS, Google Cloud, Oracle, and Meta (which mostly builds for itself). Most have strong investment-grade credit ratings and enormous cash flows from other businesses.

Neoclouds are newer, AI-focused providers that specialise in GPU capacity like CoreWeave, Nebius, Lambda, Crusoe, Fluidstack, Nscale and others. They are fast and technically focused but younger, more leveraged and usually not investment grade.

Layer 5: AI labs and model providers - AI labs train frontier models and sell access through consumer products and APIs. They are enormous consumers of compute for training and, increasingly, inference. Many are growing revenue very quickly but are not consistently profitable on a full-company basis and are not investment-grade borrowers.

Layer 6: Users and enterprises - At the top are the people and organisations who pay: consumers on subscriptions, developers paying per token, and enterprises buying AI features in software they already use. This is where the money that ultimately repays every loan in the stack originates.

Worked example: Following one dollar through the stack

Article content
Following one dollar through the stack

Example. An Australian health software company embeds an AI assistant in its case management product and pays an AI lab $1 for a batch of API tokens. The lab pays a cloud provider, say a Neocloud, to host the model on GPUs. The Neocloud uses the rental income to pay interest and principal on the loan that bought the GPUs, rent to its datacenter landlord, and its power bill. The landlord services its construction loan and pays its investors. Each layer takes a margin, and each layer's lender relies on the layer above to keep paying.

That chain is the whole story in miniature. If the dollar at the top keeps flowing, reliably, for years, everyone below gets repaid. If lenders doubt the dollar will keep flowing, or doubt the creditworthiness of the company promising to pay it, they either refuse to lend or demand much higher interest. Backstops exist to calm those doubts.

What Kind of Industry Is AI? Lessons From Telecom

Every large infrastructure wave eventually settles into an industry structure: who earns the margins, who carries the capital, and how volatile returns are. Telecom is the comparison most often reached for, so it is worth being precise about what telecom became, and why AI might, or might not, follow the same path.

Telecom: an infrastructure-driven, high-volume, low-margin industry - Telecom is the archetype of a capital-heavy, infrastructure-driven business. Operators spend vast sums on fibre, towers, spectrum, switching and undersea cables, then recover that investment by selling enormous volumes of a fairly standardised product like minutes, messages, megabytes at low unit prices. Over time, three forces push telecom towards high volume and low margin:

  • Commoditisation: A gigabyte of data from one carrier is much the same as a gigabyte from another. Once networks are built, price becomes the main point of competition.
  • High fixed costs, low marginal costs: Most of the cost is incurred building the network. Carrying one more gigabyte costs almost nothing, so carriers are tempted to cut prices to fill capacity, which pushes prices down for everyone.
  • Regulation and utility-like expectations: Communication is treated as essential infrastructure, which limits pricing power and often caps returns.

The result is an industry with steady but modest returns, heavy debt, and limited ability to capture the value created on top of its networks. The value of the internet largely went to the companies that built services on the pipes, like search (Google), social media (Facebook), e-commerce (AMZN), cloud software (Salesforce), rather than to the companies that laid the pipes.

The telecom boom and bust: demand was real, financing was mistimed - The late-1990s telecom build-out is the cautionary tale. Carriers borrowed heavily to lay fibre on the expectation of explosive internet traffic. Traffic did grow explosively, but not quickly enough to repay the debt on the original timeline, and vendor financing amplified the problem: equipment makers lent money to their own customers so they could keep buying equipment. When the cycle turned, many carriers failed, equipment makers suffered large losses on the loans they had extended, and huge amounts of fibre went unused ("dark fibre") for years.

Two lessons carry over directly to AI.

First, demand can be real and the financing can still be wrong, timing matters as much as direction.
Second, when suppliers finance their own customers, their fortunes become tightly linked; a slowdown hits the supplier twice (twin balance sheet impact), once through lower sales and again through losses on support it has extended.

This pattern is worth keeping in mind when reading about Nvidia's backstops.

Where AI is different: There are important differences between AI and telecom:

  • Asset life: Fibre lasts decades; a GPU's frontier economic life is a few years. Dark fibre could wait years for demand to catch up. Idle GPUs lose value much faster.
  • Funders: Much of the AI build-out is being funded or supported by some of the strongest balance sheets in the world, not just highly leveraged carriers.
  • Revenue today: Unlike the early internet, AI is already producing substantial revenue at the top of the stack, with some frontier-token gross margins approaching 90% in their models.
  • Product differentiation: A frontier model is not (yet) a commodity in the way a gigabyte is. Quality differences between models still command price differences.

Article content
Telecom vs AI
A frontier model is not (yet) a commodity in the way a gigabyte is. Quality differences between models still command price differences.

So what type of industry will AI become? Honestly, this is not settled yet, and it may not be one type at all. Different layers of the AI stack may end up looking like different industries.

Article content
Capital outlay vs Margins

  • Asset-light, high margin (software-like): This is where model IP and AI applications would sit if differentiation persists. The bull case for AI labs is that tokens behave like software: high gross margins, value captured in IP and brand.
  • Capital-heavy, high margin (rare): Very few industries sustain both. It usually requires a moat like scarce technology, a monopoly position or extreme scale. Nvidia currently sits here, earning high margins on scarce chips. Hyperscalers also sit here, benefiting from scale and integration.
  • Capital-heavy, low margin (telecom-like): This is the risk for pure GPU rental. If compute becomes a commodity, a GPU-hour from one provider is much like a GPU-hour from another, then Neoclouds start to look like telecom carriers: big assets, heavy debt, price competition, thin margins.
  • Asset-light, low margin. Resellers, integrators and server OEMs (which the episode notes are the exception to expanding profitability) often end up here, squeezed between powerful suppliers and powerful customers.

Three possible futures for the AI industry structure

  1. The "software" future: Models stay differentiated, token margins stay high, and value accrues to labs and applications. Infrastructure earns decent returns but not extraordinary ones.
  2. The "telecom" future: Models converge in quality, open models close the gap, price competition drives token prices down, and capacity is overbuilt. Infrastructure becomes a high-volume, low-margin utility; heavily leveraged players struggle.
  3. The "split" future: Different layers settle differently: chips and frontier models keep high margins for a time, while raw GPU rental becomes commodity-like, and agentic applications capture value in specific industries. This seems the most likely, and it is precisely why lenders care so much about which layer they are lending to and who stands behind the contract.

The "split" future: Different layers settle differently: chips and frontier models keep high margins for a time, while raw GPU rental becomes commodity-like, and agentic applications capture value in specific industries. This seems the most likely, and it is precisely why lenders care so much about which layer they are lending to and who stands behind the contract.

Example: Two Neoclouds each own 10,000 GPUs. Neocloud A rents them by the hour on spot terms to whoever pays most this month, a telecom-like model exposed to price wars. Neocloud B has signed five-year take-or-pay contracts with an investment-grade hyperscaler and offers managed inference software on top. Same hardware, very different industries, and very different borrowing costs.

Why this matters for financing: Lenders price risk based on what they think the industry will become. If they believe AI compute is heading for the telecom future, they will demand short loans, big equity cushions and strong guarantees. If they believe in the software future, they will lend more freely. Backstops from Nvidia and hyperscalers essentially say to lenders: "Whatever this industry becomes, we will stand behind the downside." The question for the rest of this article is how far that promise can stretch.

Part II - Neoclouds

What is a Neocloud? A Neocloud is a cloud provider built specifically around AI compute, mainly GPUs, and increasingly other accelerators. Unlike a hyperscaler, a neocloud doesn't offer hundreds of general-purpose services. Its core product is fast access to large, well-networked AI clusters, plus varying amounts of software to make them easy to use.

The term covers a wide range of companies, from those that own power plants and datacentres to those that mostly provide a software layer over capacity rented from others.

What they share is focus: they exist because AI demand grew faster than the hyperscalers could supply it, and because AI labs wanted capacity on terms that hyperscalers weren't always willing to offer.

Why Neoclouds exist

Article content
Why Neocclouds

  • Speed. During the GPU shortage, Neoclouds were often able to stand up capacity faster than hyperscalers, which had to balance AI against their broader businesses.
  • Specialisation. AI clusters have unusual requirements, very high-density power and liquid cooling, high-bandwidth networking between thousands of GPUs, and specialised scheduling software. A company that does only this can optimise for it.
  • Allocation. Nvidia has an interest in a diverse customer base rather than depending on a handful of hyperscalers that are also building competing chips. Supporting Neoclouds broadens its market.
  • Flexibility for labs. AI labs often want raw capacity, custom configurations and less lock-in than a hyperscaler's integrated platform. Neoclouds sit closer to the "portability".
  • Hyperscaler overflow. Hyperscalers themselves sometimes contract capacity from Neoclouds to meet their own customers' demand without building everything themselves.

How Neoclouds make money

At its simplest, a neocloud buys GPUs (usually with borrowed money), installs them in datacenters (owned or leased), and rents them out.

Revenue comes in three broad forms:

  • Reserved/contracted capacity: a customer commits to a set number of GPUs for one to five years, usually paying whether or not it uses them (take-or-pay). This is the revenue lenders like most.
  • On-demand capacity: customers pay by the hour for what they use. Higher price per hour, but unpredictable.
  • Managed services: inference APIs, training platforms, storage and developer tools layered on top of raw compute. These can raise margins and stickiness.

The Neocloud Map: platform depth versus physical ownership

Not all neoclouds are alike. The following "Neocloud Map" plots them along two dimensions, with a key message: physical ownership is not the same as platform depth

Article content
Neocloud Map

The two axes are:

  • Horizontal - physical stack integration: At the left, the provider is partner-heavy: it leases space or relies on third-party infrastructure. At the right, it owns or controls power, datacentres and physical infrastructure.
  • Vertical - compute, cloud and platform integration: At the bottom, the offering is core infrastructure: GPU access, clustering and basic orchestration. At the top, it is a full cloud stack: inference, training, storage, networking, developer platform and managed services.

That produces four archetypes:

  • Platform-led (top-left): more software, partner-heavy on the physical side. Examples on the map: Fireworks AI, Together AI, Runpod. They compete on developer experience, inference performance and ease of use, often running on capacity owned by others.
  • Full-stack (top-right): deep platform plus deep physical integration. Examples: Nebius, CoreWeave, Lambda, Fluidstack. They aim to be a complete AI cloud and control much of their own infrastructure.
  • Access layer (bottom-left): focused on GPU access and inference with limited integration. Example: Vultr.
  • Infrastructure-led (bottom-right): a physical infrastructure focus with a narrower platform. Examples: TensorWave, Crusoe, Voltage Park, Nscale. Their edge is power, sites and the ability to build capacity.

Why the quadrant matters to lenders: Each archetype carries a different risk profile, and therefore a different financing mode
Article content
Why the quadrant matters to lenders

Example: A platform-led Neocloud raising $200 million might sell equity to venture investors because it has few hard assets to borrow against. An infrastructure-led Neocloud raising $2 billion for a 100 MW campus will use project finance secured on the power assets and the GPU contracts, and may need a lease or PPA guarantee from a stronger party to close the deal.

Movement across the map: The map isn't static. Platform-led players often try to move right by securing their own capacity, because owning infrastructure improves margins and guarantees supply. Infrastructure-led players try to move up by adding software, because platforms make customers stickier and support higher prices. Full-stack players try to defend their position by scaling both. Every move requires capital, and much of it requires debt.

How the four archetypes make money: a simple comparison: The quadrant a neocloud occupies shapes its profit and loss statement, not just its strategy. The comparison below uses illustrative proportions to show the typical "shape" of each business, not data for any named company.

Article content
How the four archetypes make money

Three practical consequences follow.

  • First, platform-led players are exposed to the price of capacity they rent: when GPU-hour prices rise (as the H100 rebound can happen, discussed later), their margins get squeezed unless they can pass the cost on.
  • Second, full-stack and infrastructure-led players carry the asset risk: they benefit when GPU prices are strong but carry the debt if prices fall.
  • Third, the access layer is where commoditisation bites first, the telecom-like corner of the industry.

Example: Suppose GPU-hour prices rise 20% in a year because new generations are sold out. A full-stack Neocloud with spare owned capacity earns more on every uncontracted GPU. A platform-led inference provider that rents capacity sees its main cost rise by 20% and must either raise its token prices or accept lower margins. The same market move is good news for one quadrant and bad news for another, a reminder that "Neocloud" is not a single business model.

The Neocloud life cycle

Most neoclouds follow a recognisable path. They start by renting or buying a small number of GPUs and selling access (access layer). As they win larger customers, they sign longer contracts and use them to raise GPU-backed debt (moving toward full-stack). To control costs and secure supply, they lease or build their own datacentres and secure power (moving right on the map). Along the way they add software, schedulers, inference engines, storage, developer tools, to make customers stickier (moving up). Each step requires more capital, and each step changes which financing tools are available. By the time a Neocloud is full-stack, it is raising billions in debt, signing multi-year offtakes with hyperscalers and labs, and, increasingly, relying on backstops from Nvidia or others to make those debts financeable.

Neoclouds versus hyperscalers at a glance

Article content
Neoclouds versus Hyperscalers at a glance

Ways to Fund AI Compute: Neocloud Debt vs SPV Leaseback

Once you need billions of dollars of GPUs, there are broadly two ways to pay for them. The supplied comparison graphic frames these as two "consolidated capital pathways."

Article content
AI compute funding strategies:

Strategy 1: The Neocloud / PaaS route - In the first route, associated with CoreWeave and Nebius, the Neocloud borrows money secured on its GPU clusters and the customer contracts that use them. The customer contract (the "platform-as-a-service" revenue offtake) provides the cash flow; the hardware provides the collateral.

  • Financial structure: GPU-collateralised debt.
  • Balance sheet impact: the debt sits on the Neocloud's balance sheet as a liability.
  • Cost of capital (per the graphic): about 8.5%-11.0%.
  • Accounting feel: the Neocloud carries capex; its customer pays PaaS operating expense.

Example: A Neocloud signs a four-year, $2 billion contract with a hyperscaler. It buys $1.6 billion of GPUs, borrowing $1.2 billion against the contract and the hardware at about 10%. The customer pays monthly; the Neocloud uses that to pay interest and principal. If the Neocloud stumbles, lenders can seize the GPUs and step into the contract.

Strategy 2: The SPV sale-leaseback route - In the second route, the hardware is owned by a special-purpose vehicle (SPV), a separate company set up only to own the assets. The SPV is "bankruptcy-remote": if the operating company fails, the SPV's assets are ring-fenced from its other creditors. The SPV raises money from investors, buys the equipment, and leases it to the user. The diagram above labels this the "Amazon/NVDA $8B structure" as an example of the model.

  • Financial structure: a bankruptcy-remote SPV.
  • Balance sheet impact: designed to be off the user's balance sheet as an operating lease (subject to accounting rules).
  • Cost of capital (per the graphic): about 5.5%–7.2%, because a well-structured SPV with strong lessees and asset isolation can achieve very high (triple-A-style) ratings on its senior debt.
  • Accounting feel: the user pays a lease, a pure operating expense, rather than carrying capex.

Example: A hyperscaler wants $8 billion of GPUs but would prefer not to add $8 billion to its own capex and debt. An SPV is created; investors fund it with highly rated notes and some equity; the SPV buys the GPUs and leases them to the hyperscaler for five years. The hyperscaler pays lease rentals as operating expense. Investors get a highly rated, ring-fenced cash flow. Everyone's cost of capital is lower than if a non-IG Neocloud had borrowed directly.

The SPV is "bankruptcy-remote": if the operating company fails, the SPV's assets are ring-fenced from its other creditors. The SPV raises money from investors, buys the equipment, and leases it to the user

What the difference in cost of capital means: The gap between roughly 9.75% (midpoint of route 1) and roughly 6.35% (midpoint of route 2) is about 340 basis points. On $5 billion of financing, that's about $170 million a year in interest. Over five years, that is close to the cost of a further 15,000 or so GPUs at today's prices (illustratively). Cost of capital isn't a technicality, it decides who can afford to build.

A simple way to think about the choice is to ask two questions: how strong is the user's credit, and does it want the assets on its balance sheet?

Article content
Credit Strength vs Balance Sheet

The bottom-right cell is where backstops become essential. A weak-credit user can't make an SPV highly rated on its own; it needs a stronger party to stand behind the lease or the asset value.

Case Study - How Money and GPUs Move Between Nvidia and CoreWeave

The relationships described in this post are easiest to understand through a real example. The supplied graphic (by Boring Biz, as of 13 October 2026, citing CoreWeave's Q2 2026 results and filings, Nvidia's SEC filings, Reuters and Bloomberg) maps the flows between Nvidia, CoreWeave, CoreWeave's lenders and its largest customers.

Article content
Source : SemiAnalysis - Money and GPU flows between Nvidia, CoreWeave, lenders and customers
Article content
CoreWeave - Financial View (Q2 2026)

The flows, one at a time

  • Nvidia → CoreWeave (money and commitments): Nvidia invested equity of $2.35 billion across 2023, 2025 and 2026; has been a cloud customer renting CoreWeave capacity since 2023; and provides a backstop to buy unsold capacity through 2032, with a $6.3 billion initial order.
  • CoreWeave → Nvidia (money back): CoreWeave buys Nvidia systems, often via OEMs such as Dell, and has been first in line for GB200, GB300 and Vera Rubin. Its 2026 capex guidance is $35–39 billion.
  • Nvidia → OpenAI. A $30 billion Nvidia equity investment in OpenAI (February 2026). OpenAI is in turn a CoreWeave customer.
  • Lenders → CoreWeave. Private credit, banks and bondholders have provided debt of $35.1 billion on the balance sheet at 30 June 2026, with GPU-backed loans used since 2023.
  • CoreWeave → lenders. Interest expense of $640 million in Q2 2026.
  • Customers → CoreWeave. A revenue backlog of $104 billion at 30 June 2026. Microsoft accounted for 67% of 2025 revenue; OpenAI had an $11.9 billion initial contract; Meta has a $21 billion contract through 2032.

What this case teaches

  • Growth and leverage together: Revenue is more than doubling year on year and the backlog is enormous, yet the company reports a net loss, partly because interest costs are large. That is typical of a capital-intensive business in a build phase: assets are paid for up front; revenue arrives over years.
  • Backlog is the collateral: A $104 billion backlog is what allows $35 billion of debt. Lenders are lending against contracted future revenue from large customers.
  • Concentration matters: With Microsoft at 67% of 2025 revenue, CoreWeave's credit is heavily linked to one customer's commitment. That's good (Microsoft is very creditworthy) and risky (a change in Microsoft's plans would matter a lot).
  • Circularity: Money flows from Nvidia to CoreWeave (equity, rental, backstop), from Nvidia to OpenAI (equity), from OpenAI to CoreWeave (contracts), and from CoreWeave back to Nvidia (GPU purchases). Critics describe this as circular financing: the supplier helps fund customers who then buy its products. Supporters argue it is a rational way to accelerate an ecosystem in which the supplier has strong conviction. Both can be true, and the telecom vendor-financing lesson discussed previously tells why markets watch it closely.
  • The backstop in action. Nvidia's commitment to buy unsold capacity through 2032 is a textbook example of the rental-floor-style backstops discussed in Chapter 12: it reduces the risk that CoreWeave is left with idle GPUs, and that in turn makes lenders more comfortable.

Critics describe this as circular financing: the supplier helps fund customers who then buy its products. Supporters argue it is a rational way to accelerate an ecosystem in which the supplier has strong conviction. Both can be true, and the telecom vendor-financing lesson discussed previously tells why markets watch it closely.

Example: Imagine a lender reviewing a new $3 billion GPU-backed loan to a company like CoreWeave. It sees: a backlog with three very large customers, an Nvidia commitment to buy unsold capacity, and a history of growing revenue. It also sees a net loss, heavy interest costs and high customer concentration. The lender's decision will hinge on whether the contracts and the backstop cover the debt service even if one large customer slows down. That is precisely the analysis this article equips you to follow.

The Financing Challenge

The Scale of the Bill - Why $11.3 Trillion, Not $1 Trillion

Headlines about hyperscalers spending "hundreds of billions" a year, and commentary about "$1 trillion" of AI investment, badly understate the real requirement, according to the SemiAnalysis. Its estimate of total AI-related CAPEX, IT equipment plus datacenter infrastructure, from 2024 to 2029 is approximately $11.3 trillion.

Why the popular number is too small: The difference is scope. The commonly cited figure counts what a handful of large public companies spend. The $11.3 trillion figure includes:

  • Hyperscalers - the big public cloud and internet companies.
  • Neoclouds - the GPU-focused clouds dicussed earlier
  • Independent datacenter operators - developers and landlords who build and lease capacity to others.
  • The full stack of equipment - not just GPUs, XPUs and TPUs, but servers, networking and power infrastructure.

It is like estimating the cost of a new city by counting only the houses built by the three largest builders. You miss the smaller builders, the roads, the substations and the apartment blocks built on spec.

How much of it is debt?

This is where the story becomes a financing story. According to semianalysis estimates, by 2029 roughly $7 trillion of debt will be outstanding to fund the build-out, and that net new funding needs are currently running at about $1 trillion per year. Even the richest technology companies cannot fund trillions purely from operating cash flow, and many participants have far less cash. So a large share must be borrowed, through bonds, bank loans, project finance, private credit and asset-backed securities.

Example. A 100 MW AI campus at the episode's figure of about $40 million per MW for GB300-class deployments costs roughly $4 billion. A young neocloud might have $400 million of equity. The other $3.6 billion must come from lenders. Multiply that across hundreds of planned campuses and the trillions add up quickly.

Why this matters outside finance: The cost and availability of capital at the bottom of the stack shows up at the top, that is in GPU-hour rates, token prices, the capacity limits vendors impose, and which regions get new AI capacity first.

Financing is a supply chain, and like any supply chain, its bottlenecks ripple outward.

How the Binding Constraint Moved - Chips, Then Power, Then Money

The "Trinity" of AI project constraints - For every AI infrastructure project needs the following at the same time

Article content
Every AI project needs three things at once
If any one is missing, the project stalls. The question at any moment is which of the three is scarcest.
Article content
The binding constraint has moved from compute, to power and sites, to financing.

Phase 1: Compute and memory - In 2023 and 2024 the scarce resource was silicon: GPUs on allocation, long lead times, constrained high-bandwidth memory and packaging. According to the SemiAnlayis, this has largely been relieved through more supply and "de-speccing", configuring systems with less of a scarce component. The reduced SOCAMM memory on NVL72 racks. SOCAMM is a compact, low-power memory module; fitting less per rack means each rack consumes less of a constrained part.

Article content
What is de-speccing

Example: If a supplier can deliver modules for 1,000 racks at full specification, trimming memory per rack by a quarter covers about 1,333 racks. Some workloads lose a little performance, but many more customers get capacity.

Phase 2: Power and sites - Next came finding somewhere to plug it all in: hundreds of megawatts per campus, slow grid connections, limited suitable land. According to the SemiAnlayis, this has also largely been addressed through capital mobilisation, money paying for faster construction and early equipment orders, plus refurbished sites with existing grid connections, and behind-the-meter power built on site.

Example: A developer buys a retired industrial site with an existing 300 MW connection, refurbishes the electrical infrastructure and adds on-site gas generation. Within 18 months it has a powered shell ready for GPUs, possible only because investors funded the purchase up front.

Phase 3: Financing - With chips and sites increasingly available, the scarcest part of the Trinity is now capital, specifically debt that is willing to lend on acceptable terms to the companies that need it. When the constraint was chips, power came from allocation. When it was sites, power shifted to developers and utilities. Now power accrues to whoever has the strongest balance sheet, and to whoever is willing to lend that balance sheet to others.

When the constraint was chips, power came from allocation. When it was sites, power shifted to developers and utilities. Now power accrues to whoever has the strongest balance sheet, and to whoever is willing to lend that balance sheet to others.

Project Finance 101 - Offtake, Investment Grade and Spreads

To understand backstops, we need four project finance ideas. None is complicated once we go through an example.

Article content
Key themes for backstops

  • Concept 1: Offtake - An offtake agreement is a contract in which a customer commits in advance to buy a project's output. In energy, a utility might buy all the electricity from a wind farm for 15 years. In AI, the output is compute capacity, GPU-hours or reserved megawatts. Lenders love offtake because it converts an uncertain future into contracted revenue. The question changes from "will anyone want these GPUs?" to "will this customer honour this contract?" The episode notes that most AI project financing requires a long-term offtake, typically five years, from an investment-grade counterparty.
  • Concept 2: Investment grade - Rating agencies (S&P, Moody's, Fitch) grade borrowers on their likelihood of repaying. Ratings of BBB-/Baa3 and above are "investment grade" (IG); below that is "high yield." The distinction matters because many of the largest pools of capital, insurers, pension funds, many bank programs, are restricted to, or strongly favour, IG exposure. Most hyperscalers are IG, several very highly. Most AI labs and neoclouds are not.
  • Concept 3: Non-recourse project finance: In project finance, lenders lend to a special-purpose vehicle that owns a specific asset, and are repaid only from that asset's cash flows. If the project fails, they can take the asset but usually cannot chase the parent company. That's why the quality of the offtake contract is so crucial: it is effectively the only thing between the lender and a loss.
  • Concept 4: Credit spreads: A credit spread is the extra interest a borrower pays above a risk-free benchmark (such as US Treasuries) to compensate for default risk. It is measured in basis points (bp); 100 bp equals 1 percentage point. A Z-spread is a technical measure of that premium across the whole yield curve; think of it simply as "the risk premium."

The investment-grade gap

In one sentence: the companies most urgently needing AI compute (labs and Neoclouds) generally aren't IG, but the lenders with the most money generally want IG offtake. The solution is to insert an IG company in the middle
Article content
Credit intermediation: a hyperscaler stands between a non-IG AI lab and the lender.

Example: An AI lab wants 200 MW of capacity for five years. Lenders won't finance a neocloud against the lab's contract alone. So the lab signs with a hyperscaler, which signs a five-year offtake with a Neocloud that builds and runs the cluster. The Neocloud takes the hyperscaler contract to lenders. Because the payer is now IG, lenders lend more at a lower spread. The hyperscaler earns a margin for standing in the middle, and takes the risk that the lab doesn't pay.

Backstop credit is not zero risk Even with a strong counterparty, lenders charge for the risk that the project itself goes wrong: the cluster is late, underperforms or is poorly run. According to SemiAnalysis this is known as execution risk, linking it to what they call it as "ClusterMAX risk." Example: Meta's debt at roughly a 97 bp Z-spread versus CoreWeave project financing at around 200 bp.

Article content
Source : SemiAnalysis - Even with a strong counterparty, lenders price in execution risk.

Example (illustrative). On a $2 billion loan, an extra 100 bp costs $20 million a year, about $100 million over five years. That's why Neoclouds care so much about operational track records: better execution can translate directly into cheaper debt.

Backstops Explained - What They Are and How They Work

In baseball, the backstop is the fence behind home plate that stops balls going any further. In finance, a backstop is a commitment by a stronger party to absorb a loss, fill a funding gap or buy an asset if things don't go to plan. It doesn't usually provide money on day one; it provides certainty that money will be there if needed. That certainty is what lenders are really buying.
Article content
Everyday example how Backtops work
A helpful everyday analogy is a parent guaranteeing a young adult's apartment lease. The landlord would hesitate to rent to someone with no credit history. With a parent's guarantee, the landlord is happy, not because the parent will pay the rent, but because the parent would pay if the tenant didn't. The tenant gets the apartment; the parent takes on a contingent obligation; the landlord gets comfort. Replace "tenant" with neocloud, "parent" with Nvidia or a hyperscaler and "landlord" with lenders, and you have the backstop universe.

The main types of backstop

Article content
The main types of backstop
Why backstops work: Transferring credit - The essence of a backstop is credit transfer. A lender's risk depends on who ultimately pays. If the ultimate payer becomes a company with a strong balance sheet, the lender's risk falls, the loan gets bigger and the interest rate falls. The backstop provider is effectively selling insurance and getting paid in fees, in upside sharing, or in extra product sales.
Article content
Backstop - Credit Transfer

The cost of a backstop: contingent liabilities - Backstops aren't free. They are contingent liabilities, obligations that only become real if something goes wrong. Many sit off the provider's balance sheet, appearing in notes to the accounts rather than as debt. That creates two concerns:

  • Visibility. Investors may underestimate total exposure if commitments are scattered across many types of agreements.
  • Correlation. Backstops tend to be called at exactly the time the provider's core business is weakest. If AI demand fell, Nvidia would sell fewer chips and be asked to honour more floors and guarantees at the same time.

A useful way to judge any backstop is to ask two questions: how likely is it to be called, and how painful would it be if it were?
Article content
Backstop risk: probability of being called vs severity if called.

  • Comfort (unlikely, small). Priority supply allocations, memoranda of understanding, soft support. Useful signals; low cost.
  • Routine support (likely, small). Cloud services agreements where the provider genuinely uses the capacity. These are "called" every month, but the provider gets real value in return.
  • Tail risk (unlikely, large). Residual value guarantees, lease and PPA guarantees. Normally never paid, but potentially very large in a downturn or a technology leap.
  • Danger zone (likely and large). Broad rental floors across many customers in a weak market. A sensible provider limits how much sits here.

Example: Nvidia's commitment to rent capacity for its own research sits in "routine support": it uses the GPUs. Its residual value guarantee on a large complex sits in "tail risk": unlikely to be paid if GPU prices hold, very costly if they collapse. A floor of $3.25 per hour across many Neoclouds sits closer to the danger zone if market rates fell well below the floor.

Backstops are not new: Aircraft manufacturers support airline financing through export credit agencies and guarantees. Car makers run captive finance companies. Equipment makers routinely offer vendor finance. Energy projects are routinely backed by government or utility offtake. What's new in AI is the scale, the speed and the short life of the underlying asset.

Inside Nvidia's Backstop Universe - Roughly $497 Billion of Commitments

What the SemiAnalysis team found: Their claim is that Nvidia has committed roughly $497 billion across multiple categories of guarantees and support. Many sit off its balance sheet, not recorded as debt in the traditional sense, but representing real or contingent obligations. The categories are:

  • AI cloud agreements with neoclouds.
  • Datacenter leases.
  • Power purchase agreement (PPA) guarantees.
  • Cloud services agreements.
  • Supply and capacity commitments, especially memory.
  • Residual value guarantees.

Article content
Source : SemiAnalysis - Off Balance Sheet Commitments

Why would a chip company guarantee other people's obligations?

Nvidia's growth depends on customers being able to afford its systems. If neoclouds and labs can't raise money, they can't place orders. In a world where financing is the bottleneck, the fastest way to sell more systems is to make customers more financeable. Nvidia has an exceptionally strong balance sheet; by putting some of it behind customers, it unlocks financing that would otherwise be unavailable or prohibitively expensive. It converts creditworthiness into product demand aka "Balance Sheet as a Service."

There's a strategic angle too. Nvidia's largest customers, the hyperscalers, are scaling their own chips. A thriving neocloud ecosystem that buys Nvidia systems diversifies Nvidia's customer base. Backstops help keep that ecosystem growing.

Article content
Who backstops whom: Nvidia and hyperscalers sit between capital markets and less-creditworthy builders and users

Structure 1: AI cloud agreements and the AICP rental floor - The most distinctive structure is what the SemiAnalysis team calls is the NVIDIA AI Compute Partnership (AICP) program. Nvidia guarantees a minimum rental rate on GPU capacity operated by a Neocloud, on average about $3.25 per GPU-hour for six years. If demand falls short, Nvidia effectively stands ready to take the capacity at that floor. In exchange, it commonly receives a share of the upside, revenue-share arrangements of often 50% of rental income above the floor.

Article content
An AICP-style rental floor turns an uncertain rental stream into financeable revenue.

Example (illustrative). A Neocloud deploys 10,000 GPUs. At $3.25/hr, around the clock, each GPU earns about $28,470 a year, so the fleet earns roughly $285 million a year — about $1.7 billion over six years — even in a downside case. Lenders can size a loan against that. If the market rate is $4.25/hr, the extra $1/hr is shared: $0.50 to the neocloud, $0.50 to Nvidia. Nvidia has turned its guarantee into an option on the upside; the neocloud has turned an uncertain business into a financeable one.

Economically, Nvidia is selling insurance on GPU rental prices and being paid in upside participation. If demand stays strong, it earns extra income at little cost. If demand weakens, it pays for capacity no one else wants, just as its own chip sales would likely be falling.

Structure 2: Datacenter leases - Developers typically need a long-term lease from a creditworthy tenant before they can raise construction finance. When Nvidia signs or guarantees a lease, the developer borrows against Nvidia's credit.

Example: A developer is building a 150 MW powered shell for a Neocloud whose credit isn't strong enough for the developer's lenders. Nvidia guarantees the lease for the initial term. The construction loan is approved at a much tighter spread.

Structure 3: PPA guarantees - Power generators and their lenders need to know the buyer of the power will pay for many years. Nvidia may guarantee a Neocloud's or operator's PPA so the power project itself can be financed.

Example: An energy company will build on-site generation for an AI campus only if the 10-year offtake is creditworthy. Nvidia guarantees the operator's PPA payments. The generator is financed, the campus gets power sooner, and Nvidia's GPUs get a home.

Structure 4: Cloud services agreements - Under cloud services agreements, Nvidia itself commits to buy cloud capacity, for research, its own cloud services or resale. That gives the provider contracted revenue from a highly creditworthy counterparty. The CoreWeave case in Chapter 7 shows Nvidia renting capacity since 2023.

Structure 5: Supply and capacity commitments - Nvidia commits to buy components, particularly memory, to secure supply. These commitments give suppliers the confidence to expand manufacturing, but must be paid for whether or not Nvidia needs the volume.

Example: A memory maker will add a production line only with firm multi-year orders. Nvidia signs a take-or-pay commitment. The line gets built and supply is secured, but if demand fell, Nvidia would still owe for the volume.

Structure 6: Residual value guarantees - A residual value guarantee (RVG) promises an asset will be worth at least a certain amount at a future date; the guarantor pays any shortfall. For GPUs, RVGs address lenders' biggest worry: what the hardware will be worth when the loan ends. The episode cites a $105 billion residual value guarantee associated with the Ports Pike complex as an indication of scale.

Example: A vehicle buys $1 billion of GPUs on a six-year loan structured so $300 million remains outstanding at maturity, to be repaid by selling the hardware. Nvidia guarantees the hardware will be worth at least $300 million. If it sells for $200 million, Nvidia pays $100 million. Because the "balloon" is protected, lenders accept smaller repayments in early years, improving the project's cash flow.

Hyperscalers play the same game

Hyperscalers also act as balance-sheet providers. When Microsoft, Oracle, Google or Amazon sign long-term capacity agreements with Neoclouds on behalf of AI labs, they substitute their credit for that of a less-creditworthy end user. The motive differs, hyperscalers secure capacity they can resell or use; Nvidia sustains demand for its product but the mechanism is the same.

Part IV - The Economics

A Simple Financial Model of a GPU Cluster

Talking about backstops and spreads in the abstract only gets you so far. This section builds a deliberately simple financial model of a single GPU cluster, the kind a Neocloud might finance, so you can see how the numbers fit together and why lenders, equity investors and guarantors each care about different things.

Everything discussed here is illustrative. The inputs are round, plausible numbers chosen to make the mechanics clear, not estimates of any real company's economics. The model is pre-tax and ignores working capital, refinancing and many other real-world details.

Step 1: The inputs

Article content
Source: SemiAnalysis - Inputs for A GPU Cluster

Step 2: Revenue

  • Revenue = GPUs × price per hour × hours per year × utilisation.
  • 25,000 × $3.50 × 8,760 × 95% ≈ $728 million per year.

Step 3: Operating costs

  • Power: 25,000 × 1.5 kW × 8,760 hours × $0.08 ≈ $26 million.
  • Datacenter lease: 25,000 × $0.25 × 8,760 ≈ $55 million.
  • Operations and support: 10% × $728 million ≈ $73 million.
  • Total operating costs ≈ $154 million.

Step 4: EBITDA (earnings before interest, tax, depreciation and amortisation) is a proxy for operating cash flow: $728 million - $154 million ≈ $574 million per year, an EBITDA margin of about 79%. That seems very high, and it is, because the biggest cost of a GPU cluster isn't operating cost; it's the capex. The real question is whether $574 million a year for five years, plus whatever the hardware is worth at the end, pays back $1,750 million with an adequate return.

Step 5: Debt service - The Neocloud borrows 70% of capex $1,225 million at 9.5% over five years, repaid in equal annual instalments. The annual payment (interest plus principal) is about $319 million.

Step 6: Cash to equity - Cash left for equity holders = EBITDA debt service ≈ $574 million - $319 million ≈ $255 million per year, plus the residual value of about $262 million at the end of year five.

Article content
Source: SemiAnalysis - GPU Cluster Economics
Article content
Source: SemiAnalysis - GPU Cluster Economics

Step 7: The key outputs of a GPU Cluster Economics: The project IRR of about 22% sits within the 20-30% range the where projects are typically underwritten to, without relying on residual value. Remove the residual entirely and the project IRR in this model falls by about 2.6 percentage points, still close to 20%.

Article content
Source: SemiAnalysis - Key Outputs of a GPU Cluster Economics

Understanding the outputs - Three numbers and three audiences

Article content
Source: SemiAnalysis - Three numbers and Three audiences

  • Project IRR is the annualised return on the whole $1,750 million, as if it were all equity. It measures the quality of the asset.
  • Equity IRR is the return to the $525 million of equity after debt is serviced. Because debt is cheaper than the project's return, borrowing magnifies equity returns, here from about 22% to about 44%.
  • DSCR (debt service coverage ratio) is what lenders watch. A DSCR of 1.80x means EBITDA covers debt payments 1.8 times. Lenders typically require a minimum, say 1.25-1.40x, with a cushion for bad years.

The downside case: Now suppose the market weakens and there is no contract or backstop: the price falls to $2.00 per hour and utilisation to 70%.

Article content
Source: SemiAnalysis - Utilisation case (Base vs Downside)
A DSCR of 0.61x means the cluster cannot pay its debt. Equity is largely wiped out and lenders face losses unless the hardware can be sold for enough. The same cluster that looks wonderful at $3.50 and 95% is a disaster at $2.00 and 70%. That gap is precisely what backstops and long-term contracts are designed to close.

Sensitivity: price × utilisation - The heatmap below shows project IRR across combinations of price and utilisation. Think of it as a 5×5 version of a 2×2: high price and high utilisation is the "boom" corner; low and low is the "bust" corner.

Article content
Project IRR sensitivity to price per GPU-hour and billable utilisation (illustrative model).

Three observations stand out:

  • First, the model needs both a decent price and high utilisation; neither alone is enough.
  • Second, below about $2.50 per hour the project struggles at almost any utilisation.
  • Third, the slope is steep: each $0.50 change in price moves project IRR by roughly 5-7 percentage points.

Why backstops change the maths: debt capacity: Lenders size loans on what they believe is a realistic downside, not the base case. A common method is to ask: what is the largest loan that still has a DSCR of at least 1.30x in the case we're underwriting? The answer depends heavily on who stands behind the revenue.
Article content
Source: SemiAnalysis - Debt capacity of the same cluster under three credit scenarios (illustrative model, 1.30x minimum DSCR, 5-year amortising).

  • No backstop: Lenders underwrite a cautious case ($2.00 at 70%) and charge 11%. Maximum debt: about $554 million, roughly 32% of capex. The Neocloud would need to find more than $1.2 billion of equity.
  • Nvidia-style floor: Lenders can underwrite the guaranteed floor ($3.25 at 95%) and, with less risk, charge 8.5%. Maximum debt: about $1.6 billion, over 90% of capex. In practice lenders would cap loan-to-value around 70–80%, but the floor lets them go to that cap comfortably.
  • IG hyperscaler offtake: Lenders underwrite the contract ($3.50 at 95%) with an investment-grade payer at about 7%. Debt capacity exceeds the cost of the cluster.

This is the single clearest demonstration of "Balance Sheet as a Service." The cluster, the GPUs and the datacenter are identical in all three bars. The only thing that changes is whose balance sheet stands behind the revenue, and that alone roughly triples how much can be borrowed.

Adding the backstop to the model: what a rental floor is worth

Now add an Nvidia-style floor of $3.25 per GPU-hour, with a 50% share of any rental income above the floor going to the guarantor. Compare four cases on the same cluster:

Article content
Source: SemiAnalysis

Read the above table as an insurance contract.

  • In the downside, the floor turns a cluster that cannot pay its debt service( DSCR 0.61x) into one that comfortably can (1.65x).
  • In the upside, the Neocloud gives up about 7 points of project IRR and roughly 19 points of equity IRR to the guarantor.
  • The Neocloud is trading away part of its best case to eliminate its worst case, exactly what anyone buying insurance does.

From the guarantor's side, the arithmetic is mirrored. In good times it collects $0.50 per GPU-hour on the excess, about $104 million a year on this cluster at a $4.25 market rate. In bad times it pays $1.25 per hour on capacity it must absorb, roughly $260 million a year here if it took all the capacity at $3.25 against a $2.00 market. Whether that is a good trade depends on the probability of each state of the world, and as discussed earlier under Backstops, the bad state for the backstop is also the bad state for the guarantor's core business.

Example: A Neocloud chief financial officer presents both versions to the board. Without the floor, the lender offers about a third of the capex as debt at 11%; the company must raise more than $1.2 billion of equity, diluting existing shareholders heavily. With the floor, the lender offers 70% at 8.5%. The board accepts the floor and the upside share because the cost of not having it, dilution, or not building at all, is far higher than the upside given away.

Financial Levers - What Really Moves Returns

A "lever" is any input that management, lenders or guarantors can influence to change the outcome. Understanding which levers matter most tells you where to focus negotiation, engineering effort and risk management.

The tornado chart: The tornado chart below changes one input at a time, holding everything else at base case, and shows how far project IRR moves.

Article content
Tornado chart: change in project IRR when each lever is flexed (illustrative model, base project IRR 21.8%).

The levers, from most to least powerful

  • Price per GPU-hour: A ±20% change moves project IRR by about ±9–10 points. Price is set by contracts (fixed for the term) or by the market (volatile). Levers: contract length, rate floors, revenue sharing, and moving up the value chain into managed services that command higher prices.
  • Utilisation: Dropping from 95% to 76% costs about 10 points of IRR; going to 100% adds only about 2.5. That asymmetry matters: there is little upside but lots of downside. Levers: take-or-pay contracts, good scheduling software, a diverse customer base, and fast deployment so GPUs start earning sooner.
  • Capex per GPU: Paying 20% more for the same capacity costs about 7 points; paying 20% less adds about 10. Levers: purchasing scale, vendor relationships, "de-speccing" configurations, buying at the right point in the product cycle, and avoiding construction delays that tie up capital.
  • Asset life / contract term: A four-year life instead of five costs almost 6 points; six years adds about 3.5. Levers: longer contracts, re-leasing to inference workloads once frontier training moves on, and maintaining hardware so it stays rentable.
  • Residual value: Moving from 15% to 0% or 30% shifts IRR by about ±2.5 points. Modest in this model, because projects are underwritten not to depend on it, but crucial to lenders' balloon repayments and to RVG providers.
  • Datacenter lease and power: A ±20% change shifts IRR by less than 1 point each. In GPU economics, power and rent matter far less than price, utilisation and capex. (They matter a lot more to the datacenter developer whose whole business they are.)

The leverage lever: a double-edged sword - Debt is the lever that most dramatically changes returns to equity, in both directions.

Article content
Source: SemiAnalysis - Equity IRR at different levels of debt, base case vs a soft case (illustrative model).

  • In the base case, raising debt from zero to 80% of capex lifts equity IRR from about 22% to about 58%.
  • In a soft case ($2.75 at 80% utilisation), the same increase drags equity IRR from about +5% to about –10%, and at 80% debt the DSCR falls below 1.0x, the cluster can no longer cover its debt.

This is why lenders insist on equity cushions and why backstops that support the downside are so valuable: they let borrowers use more leverage without facing ruin if the market softens.

The cost-of-capital lever: As discussed earlier, the gap between Neocloud debt (about 8.5–11%) and SPV/IG-style funding (about 5.5–7.2%). In this model, cutting the interest rate from 9.5% to 6.5% on $1,225 million of debt reduces annual debt service from about $319 million to about $294 million and raises cash to equity by roughly 10%. Credit quality is a financial lever in its own right, and backstops are the most direct way to pull it.

Article content
Source: SemiAnalysis - Cost of Capital
Article content
Levers: impact versus controllability

The top-left cell is where backstops live. Nobody can control the market price of GPU-hours five years out, but a floor, a take-or-pay contract or an RVG can transfer that risk to someone better able to bear it.

Levers for each player

  • Neocloud: contract length and coverage, capex discipline, deployment speed, operational excellence (to narrow the execution-risk spread), and adding software to escape commodity pricing.
  • Lender: loan-to-value, DSCR covenants, amortisation profile, cash sweeps, security over GPUs and contracts, and requiring backstops.
  • Nvidia (as guarantor): floor level, term, upside share, and how much total exposure to accept in each quadrant of the backstop risk matrix.
  • Hyperscaler (as intermediary): the margin it earns between lab and neocloud, contract terms on both sides, and its own rating headroom.
  • AI lab (as end customer): reserved vs on-demand mix, model efficiency (more tokens per GPU-hour), and pricing.

Profitability Is Extremely High at Most Layers

Revenue per megawatt: According to SemiAnalysis, Frontier token generation can generate up to $100 million of revenue per megawatt per year on GB300 systems that cost about $40 million per megawatt to deploy. Neoclouds renting capacity on five-year contracts were earning roughly $12 million per MW per year a few months ago.

Article content
Source: SemiAnalysis Per-megawatt economics

In other words, at the upper end, a megawatt of the latest systems serving frontier tokens at high utilisation can earn its entire deployment cost in about five months. The Neocloud renting out that same megawatt earns far less, but against $40 million of cost still pays back in about three and a half years before operating costs, and its revenue is contracted.

Example: A neocloud deploys 50 MW at $40 million per MW, $2 billion. At $12 million per MW per year, it earns $600 million a year in rent. The lab renting that capacity might generate several billion dollars a year of token revenue on it if it keeps utilisation high. The lab captures most of the value; the neocloud captures a smaller but more secure slice.

Gross margins on tokens: Gross margins on frontier API tokens can approach 90% in some models, accounting for cache hits and high utilisation.

  • Cache hits - when part of a prompt has been seen before (a long system prompt or a document reused across requests), the model can reuse earlier computation. Providers charge less for cached tokens, but their cost to serve is lower still.
  • Utilisation - the share of time GPUs do paid work. Idle GPUs still cost money. High utilisation spreads fixed costs across more revenue.

Example: A lab sells 1 million output tokens for $15. If its cost, after cache reuse and high batch utilisation is $1.50, its gross margin is 90%. If utilisation halves, cost per token roughly doubles to $3, and margin falls to 80%.

Profitability across the stack

Article content
Profitability at each layer
The catch: Margin is not cash flow, and gross margin is not net profit. Labs spend heavily on training, research staff and free usage; Neoclouds like CoreWeave report net losses while growing quickly because of interest and depreciation. The financing question isn't "is AI profitable at the margin?", the question often is, but "is that profit reliable enough, for long enough, to repay trillions of dollars of debt?"

Residual Value and the Strange Economics of GPU Depreciation

What residual value means: Residual value is what an asset is worth at the end of a period of use for a car lease, what the car is worth when you hand it back; for a GPU cluster, what the hardware can be sold or re-rented for after the financing term. It determines how much of a loan must be repaid from operating cash flows versus from selling or re-leasing the asset.

The conservative approach: don't count on it: Most AI projects, per the episode, are underwritten to achieve 20–30% IRR over 5–6 years without relying on residual value. Anything the hardware is worth afterwards is upside. A 20–30% hurdle is high compared with traditional infrastructure, reflecting the perceived risk.

Example: A $1 billion cluster generating about $350 million a year of net cash for five years, with zero residual, produces an IRR of roughly 22%. If the hardware is worth $200 million at the end, the IRR rises to roughly 25%. The underwriting doesn't need the residual, but every dollar of it helps.

The theoretical depreciation curve: In theory, a GPU's value should fall as better GPUs arrive. If a new GPU delivers three times the performance at a similar hourly price, the old one should rent for roughly a third as much per unit of work. This "relative performance" model implies steep depreciation.

What actually happened: the curve broke: This curve broke in late 2025 because demand outstripped supply. H100 rental prices, for a GPU that shipped in volume in 2023, rebounded sharply toward early-2023 levels of about $3 per hour on one-year terms. Newer GPUs like GB300 are sold out, so buyers "cascade down the stack" to older hardware.

Example: A start-up needs 512 GPUs for inference next month. No GB300 or H200 capacity is available. It signs a one-year deal for H100s at about $3/hr. Multiply that across thousands of buyers and older GPUs, which were supposed to be getting cheaper, are in demand again.

The cascade effect: Think of the GPU market as a staircase. New demand arrives at the top step (the latest generation). When it's full, demand spills to the next step, then the next. As long as total demand exceeds supply, every step stays full and prices hold. If supply at the top expands suddenly, demand drains back up, and the lowest steps empty first.

Article content
Source: SemiAnalysis - The cascade effect
Why this matters for financing: The rebound is good news for anyone who financed H100 clusters, and it makes residual value guarantees look less risky in the short term. But is today's strength permanent, or a symptom of shortage? If supply catches up, or if a shift to custom chips like ASIC changes what inference runs on, the theoretical curve could reassert itself quickly. This uncertainty is exactly what makes lenders cautious and backstops valuable.

The Shift From GPUs to ASICs and What It Means for Financing

Major tech companies including Microsoft, Meta, Amazon, and Google are actively scaling their own custom ASICs (application-specific integrated circuits). As AI workloads continue to shift from model training to inference, the adoption of specialised ASICs is accelerating, positioning custom silicon to capture a rapidly growing share of total chip volumes by 2030

What is an ASIC: An ASIC (application-specific integrated circuit) is a chip designed for a particular job. A GPU is a flexible, programmable engine that can run almost any AI workload well. An ASIC gives up some flexibility to run a narrower set of workloads more cheaply or more efficiently. In AI, the main examples are Google's TPUs, Amazon's Trainium and Inferentia, Meta's MTIA and Microsoft's Maia. Many are designed with partners such as Broadcom or Marvell.

Why inference favours ASICs

  • Stability: Training frontier models changes constantly, new architectures, new techniques. Flexibility is valuable, and GPUs, with Nvidia's mature software ecosystem, dominate. Inference for a popular model is more stable: the same model runs billions of times, so it's worth optimising hardware for it.
  • Cost per token: In inference, the winning metric is cost per token at acceptable speed. A chip that does one job very efficiently can beat a more general chip.
  • Control: Hyperscalers that design their own chips capture the margin they would otherwise pay to a chip vendor and control their own supply.

The market-share projection

Article content
Projected compute market share, training vs inference, 2024 vs 2030 (redrawn from the supplied chart).

  • Training: Nvidia GPUs hold about 78% in both 2024 and 2030, with others (ASIC, CPU, smaller GPUs) at about 22%. Training remains GPU territory.
  • Inference: GPUs (Nvidia, AMD and others) fall from about 95% in 2024 to about 45% in 2030, while ASICs/TPUs rise from about 5% to about 55%.

Combine that with the three eras discussed in the beginning, demand is shifting from training to inference and agents, and the implication is clear: a growing share of the total compute market could run on non-GPU silicon.

GPUs vs ASICs

Article content
Where GPUs vs ASICs win: workload novelty against buyer scale and software control.

  • GPU heartland (novel workloads, labs and Neoclouds). Frontier research and varied training. Flexibility and software ecosystem win.
  • Contested (novel workloads, hyperscalers). Hyperscalers train frontier models on both GPUs and their own chips.
  • Flexible inference (stable workloads, many customers). Neoclouds and enterprises serving many models for many customers still value GPUs' flexibility, which also helps GPUs keep resale value.
  • ASIC heartland (stable workloads, hyperscalers). High-volume inference on a hyperscaler's own models, where custom chips can win on cost per token.

Why this matters for AI financing

  • Residual values: If more inference moves to ASICs, the "cascade" that has kept older GPUs in demand could weaken. That increases the risk on residual value guarantees and on loans with large balloon payments.
  • Who borrows: ASICs are mostly deployed by hyperscalers, financed from IG balance sheets. GPUs are the main asset of Neoclouds, financed with GPU-backed debt and backstops. A shift to ASICs shifts the financing mix toward hyperscaler balance sheets.
  • Nvidia's incentive: Backstopping Neoclouds is partly a strategic defence: a strong, independent Neocloud ecosystem is a market for Nvidia systems that isn't building its own chips. The more hyperscalers shift to ASICs, the more valuable that ecosystem becomes to Nvidia, and the more it may be willing to stand behind it

Correlated risk: Should customer adoption shift heavily toward ASICs and reduce GPU demand, Nvidia would face a dual vulnerability: falling product sales alongside heightened financial exposure from vendor backstops, mirroring past telecom sector financing patterns.

The counter-arguments: To be balanced, Nvidia continues to release new generations quickly, its software ecosystem is deeply entrenched, its systems are also used for inference at very large scale, and agentic workloads may be less "stable" than classic inference, keeping flexibility valuable. Custom chips are costly to design and take years to mature. The projection is a forecast, not a certainty.

Example: A lender is considering a six-year loan against an H100-class fleet with a 25% balloon. In a world where inference stays largely on GPUs, the fleet might still rent for inference in year six. In a world where 55% of inference has moved to ASICs, the same fleet may struggle to find tenants. The lender's answer: a shorter tenor, a smaller balloon, or a residual value guarantee from someone else.

Part V - Markets and Risk

Credit Markets Are Already Reacting

Hyperscaler spreads are widening: One clear indicator being monitored is that credit spreads on hyperscaler debt have widened, Amazon and Oracle are among those. Wider spreads mean investors want more compensation to lend to these companies than before. Why would that happen to some of the most creditworthy companies in the world?

  • Supply: They are issuing much more debt, and markets need a higher yield to absorb it.
  • Concentration: Bond investors have limits on exposure to any single issuer or sector.
  • Contingent obligations: Capacity agreements and guarantees may not appear as debt, but analysts increasingly factor them in.
  • Uncertainty: The long-term return on AI investment at this scale isn't yet proven.

Example : A hyperscaler that used to borrow at 70 bp over Treasuries now pays 100 bp. On $50 billion of new bonds, the extra 30 bp costs $150 million a year, and signals that bond investors are pricing in AI-related risk.

AI debt is becoming a major asset class

According to SemiAnalysis, AI-related debt is rapidly scaling to become the second-largest US asset-backed financing market behind mortgages, already overtaking auto loans, student loans, and credit cards. Furthermore, 2026 is projected to be the point at which AI debt accounts for more than 10% of all US debt issuance. Mortgages, auto loans and credit cards are mature markets built over decades with deep data on defaults and recoveries. AI infrastructure debt has emerged in a few years, backed by assets whose long-run behaviour is still largely unknown.

Why ABS matters: Asset-backed securities pool assets that generate cash (mortgages, car loans, equipment leases) and issue bonds backed by that cash, often in tranches. AI debt is moving into ABS-style structures because they let lenders slice risk and reach a much wider pool of investors. But they also mean investors who may not deeply understand GPU economics are buying exposure to them.

Example: A Neocloud pools 30 customer contracts backed by GPU clusters and issues a $3 billion ABS deal in three tranches. An insurer buys $500 million of the AAA senior tranche because it pays more than comparable corporate bonds. The insurer is now indirectly exposed to GPU rental markets, customer credit and residual values — without ever having analysed a datacenter.

What lenders need to learn: Lenders need better tools to evaluate GPU economics, cluster execution risk, token profitability and residual values. Without them, credit is priced conservatively, or, more dangerously, inconsistently.

How a Lender Looks at an AI Deal, A Practical Checklist

Everything so far can be condensed into the questions a careful lender, credit committee or rating analyst asks about an AI infrastructure financing. It is also a useful checklist for anyone on the other side of the table like a Neocloud, a developer, or a vendor whose customers need financing.

Article content
Source SemiAnalysis: Lender Checklist

Example: A credit committee reviewing a $1.5 billion GPU loan scores each of the eight areas from 1 to 5. The deal scores well on payer quality (IG hyperscaler offtake), revenue firmness (five-year take-or-pay) and structure (70% LTV with cash sweep), but poorly on concentration (one end customer) and residual value (large balloon on hardware likely to face ASIC competition). The committee approves the loan on condition that the balloon is reduced or covered by a residual value guarantee, a typical outcome, and a direct illustration of why backstops exist.

Bond Yields Versus Equities - Why Markets Are Worried

The AI build-out isn't happening in a vacuum. It is being financed in global bond markets that are also absorbing government deficits, inflation risk and central bank policy. When bond yields rise, it affects AI in two ways at once: it makes AI debt more expensive, and it changes how investors value AI equities. This chapter explains why.

Bond yields in plain English: A bond's yield is the annual return an investor earns for lending money by buying it. The US 10-year Treasury yield is the benchmark "risk-free" long-term interest rate for the world. Almost every other long-term rate, mortgages, corporate bonds, project finance, is priced as the Treasury yield plus a spread.

Bond prices and yields move in opposite directions. If yields rise, existing bonds with lower coupons are worth less, so their prices fall.

Why rising yields hurt equities, especially growth equities

The value of a share is, in theory, the present value of all the cash a company will generate in the future. To work out present value, investors discount future cash flows using an interest rate that starts with the risk-free yield. When yields rise:

  • Future cash is worth less today: A dollar in ten years is worth less when the discount rate is higher.
  • Long-duration companies are hit hardest: Companies whose value depends on profits far in the future, like many AI and technology stocks, fall more than companies with steady near-term profits.
  • Bonds become competition: If a safe Treasury pays a high yield, investors need a bigger expected return to justify the risk of owning shares.

Example. An AI company is expected to generate $10 billion of cash in year ten. At a 7% discount rate, that's worth about $5.1 billion today. At 9%, it's worth about $4.2 billion. A two-point rise in the discount rate removes nearly a fifth of the value of that future cash — without anything changing about the business.

The stock–bond correlation and the 5.25% threshold

Article content
Why rising bond yields worry equity markets during the AI build-out.

The chart above (Bloomberg/MacroBond) plots the US 10-year yield against the rolling correlation between stocks and bonds. Its message is that stocks and bonds are almost never strongly negatively correlated when the 10-year yield is above about 5.25%.

Why does that matter: For most of the past two decades, when yields were low, bonds and stocks tended to move in opposite directions in a sell-off: when stocks fell, investors rushed into government bonds, bond prices rose, and portfolios were cushioned. That negative correlation is what makes the classic "60/40" portfolio (60% shares, 40% bonds) work.

When yields are high, typically because inflation and the cost of money are the main concern, that cushion tends to disappear. Stocks and bonds can fall together, because the same thing (rising rates) is hurting both. Historically, as the chart shows, above about 5.25% on the 10-year the strongly negative correlation almost never appears.

Why markets are worried in the context of AI: Put the pieces together and you can see why investors watch bond yields so closely during the AI build-out:

  • The AI build-out adds to bond supply: With roughly $1 trillion a year of new funding needs and AI debt expected to exceed 10% of US issuance in 2026, AI is a significant new borrower competing with governments and other companies for the same pool of savings. More supply of bonds can mean a higher yield is needed to clear the market.
  • Higher yields raise the cost of AI projects: Every AI loan is priced off Treasuries plus a spread. If base yields rise and spreads widen at the same time, project IRRs fall as discussed earlier how cost-of-capital lever works in reverse.
  • Higher yields lower AI equity valuations: AI-exposed companies are some of the longest-duration assets in the market, so they are especially sensitive to discount rates.
  • The hedge breaks: If yields rise into the zone where stocks and bonds stop offsetting each other, investors heavily exposed to AI equities lose their usual shock absorber. That can make sell-offs sharper.

A feedback loop: Lower equity valuations make it harder for AI companies to raise equity; higher yields make debt more expensive; that makes projects harder to finance; which in turn can weigh on AI equities again.

Yields versus AI demand

Article content
Yields vs AI Demand

Example:. A Neocloud plans to refinance a $3 billion construction loan into a five-year bond. When it planned the project, Treasuries plus spread implied a 7.5% coupon. By completion, yields have risen and spreads widened, so the coupon is 9.5%. On $3 billion, that's $60 million more interest a year, and the Neocloud's share price has also fallen, making new equity expensive. Nothing about its GPUs or customers has changed; the cost of money has.

Keeping it in perspective: Bond-market concerns don't mean AI is a bubble or that a crisis is coming. They mean the financing of AI is now big enough to interact with, and be affected by, the broader economy. That is a defining feature of an infrastructure build-out, and it's exactly why credit has become the bottleneck.

Where Durable Demand Comes From - Agentic AI and the Decision Matrix

Lenders ultimately need to believe that demand will last for the life of their loans. The most important source of new, durable demand is the move to agentic AI. But how far will organisations actually let AI act on their behalf? A useful framework comes from MIT Sloan.

The AI Decision Matrix: The following Matrix (adapted from I. Sebastian, P. Weill, T. Haskamp and J. vom Brocke, "Designing Decision Rights for AI," 2026, MIT Sloan) is a framework for deciding how humans and autonomous AI agents should share decision-making, based on two dimensions: ambiguity and risk.

Article content
AI Decision Matrix

Each decision has three components: Frame (define the decision), Act (take or recommend actions) and Learn (own and improve outcomes). Each component can be done by a human, a human with AI, or AI alone.

  • Routine (low ambiguity, low risk) - well-defined decisions with limited downside. Approach: automate and monitor. Frame, act and learn can all be done by AI.
  • Consequential (low ambiguity, high risk) - well-defined decisions with broad impact on many people or significant resources. Approach: manage to ensure reliability. AI frames and acts; humans own learning.
  • Exploratory (high ambiguity, low risk) - new or unclear decisions where learning matters more than precision. Approach: enable experimentation to learn fast. Human with AI frames; AI acts; humans own learning.
  • Strategic (high ambiguity, high risk) - new or unclear decisions with organisation - or ecosystem-wide consequences. Approach: lead with continuous oversight. Human with AI frames and acts; humans own learning.

Why this matters for compute demand: The matrix is about governance, but it has a direct link to infrastructure economics. Every decision that moves into the "AI acts" section becomes a source of continuous, machine-driven compute demand, the "all time" era. Routine decisions are the first and largest pool: invoice matching, ticket triage, scheduling, data validation, claims checks. As governance frameworks like this one give organisations confidence to delegate, the volume of agentic work grows, and so does demand for inference.

Example:. A large insurer maps its decisions onto the matrix. It finds 70% of claims decisions are routine (automate), 20% consequential (AI with managed oversight), and 10% need human judgement. Moving the routine 70% to agents adds millions of model calls a month, demand that is continuous, contract-like and tied to business processes rather than to staff typing prompts.

What lenders should take from this

  • •Routine-quadrant demand is the most financeable: It is high-volume, repetitive and embedded in operations, closer to utility demand than to discretionary spend.
  • Governance accelerates adoption: Clear decision rights reduce the risk that organisations pull back after an AI mistake, making demand more durable.
  • Demand quality varies by quadrant: Exploratory usage is valuable but volatile; routine and consequential usage is stickier. Lenders assessing an AI lab's revenue could ask how much of it comes from embedded, process-level use.

The same matrix applied to AI financing decisions can also guide how financial institutions use AI in their own credit decisions:

  • Routine: automated monitoring of covenants, utilisation reports and payment schedules.
  • Consequential: AI-assisted underwriting of standard GPU loans with human sign-off on outcomes.
  • Exploratory: AI-assisted modelling of residual value curves for new hardware generations.
  • Strategic: whether to commit billions to a new asset class, humans lead, with AI analysis.

The Core Debate - Willingness Versus Ability

The emerging debate is about the future of AI as a contest between two forces, that is Willingness vs Ability.

Willingness: demand and profitability - Willingness is whether customers want AI enough to pay for it, and whether sellers can do so profitably.

  • Token prices for frontier capabilities are holding steady or rising.
  • Model efficiency keeps improving, so each dollar of compute delivers more useful work.
  • User utility keeps increasing - models are doing more valuable tasks, and agents are taking on whole workflows.
  • "You can't go back" - once people experience high-quality AI tools, they don't want to work without them.

Example: A legal team adopts an AI drafting assistant. A contract review that took two days now takes two hours. At renewal, the question isn't whether to keep it but whether to upgrade. That is willingness, revenue at the top of the stack that ultimately repays lenders at the bottom.

Ability: financing capacity - whether the capital system can fund the build-out fast enough. Here the episode sees the binding constraint. Nvidia's balance sheet can support a large but finite amount of backstops, an estimated 46 GW. Total incremental capacity required is about 240 GW.

Article content
Source: SemiAnalysis - Nvidia's estimated backstop capacity covers only a fraction of incremental capacity required.

Example: If the remaining ~194 GW were deployed at about $40 million per MW, it would imply several trillion dollars of investment that must be financed by someone other than Nvidia like hyperscalers, sovereign funds, infrastructure investors, private credit and public bond and ABS markets.

The Willingness vs Ability

Article content
Four possible futures for the AI build-out, depending on willingness and ability.

  • Credit-constrained boom (high willingness, low ability): Demand is strong but money is scarce. Capacity is rationed, prices stay high, backstops are in heavy demand. The episode suggests this is roughly where we are today.
  • Sustained build-out (high willingness, high ability): Capital markets learn to underwrite AI on its own merits and the 240 GW gets built.
  • Overbuild / bust (low willingness, high ability): Easy credit funds capacity that demand doesn't fill, the telecom 2001 pattern.
  • Stall (low willingness, low ability): Projects are cancelled, and the industry consolidates.

Why IG backstops alone can't close the gap: Only a limited number of investment-grade (IG) companies have the scale and appetite to stand behind tens of billions of dollars of AI commitments, and each is limited by rating agencies, shareholders and its own risk appetite. If they all approach their limits at once, the model stops scaling. Therefore the lending market must evolve beyond pure IG backstops, through:

  • Lender education: understanding GPU economics, cluster execution risk and token profitability, so lenders can lend against the asset and business, not just the guarantor.
  • Better residual value models: so lenders can confidently value hardware at the end of a financing.
  • Risk-tranching structures: so conservative investors buy safe slices and risk-tolerant investors take the rest.
  • Better tools: independent operator ratings, utilisation data and pricing benchmarks that make AI infrastructure behave like a mature asset class.

Example: In five years, a pension fund analyst might evaluate a GPU-backed bond the way she evaluates an aircraft lease today: checking the operator's execution score, the hardware generation's historical residual curve, the contracted-versus-spot revenue mix and the token-revenue health of end customers. If those tools exist and are trusted, capital can flow without Nvidia signing every guarantee.

What Could Go Wrong - Stress-Testing the Backstop Model

Any honest explanation of a financing system should ask how it behaves under stress. The structures in this section outlines various failure modes.

Article content
What Could Go Wrong

Scenario 1: Demand pauses -Enterprise adoption slows for a year, an economic downturn, regulation, or models that don't visibly improve. Spot rental prices fall. Neoclouds with uncontracted capacity feel it first; those with floors lean on guarantors.

Example: Market rates fall from $4/hr to $2.50/hr. A Neocloud with a $3.25 floor calls on the guarantee for $0.75/hr across 10,000 GPUs, that is about $66 million a year that the guarantor must cover. Multiply across many Neoclouds and the cost shows up in the guarantor's results, just as its chip sales are also under pressure.

Scenario 2: A technology leap - A new architecture, a breakthrough in model efficiency, or a rapid move of inference to ASICs makes existing clusters much less valuable. Residual values fall; RVGs are called; junior tranches absorb losses.

Example: A new architecture delivers five times the inference throughput per watt. The expected resale value of a previous-generation fleet drops from 30% of cost to 10%. On a $5 billion fleet, that's a $1 billion swing, absorbed first by equity, then the B-piece, with any RVG stepping in according to its terms.

The irony: efficiency gains strengthen the willingness case but can erode the value of assets already financed.

Scenario 3: An operator stumbles - A Neocloud delivers a cluster late or suffers serious reliability problems. Its customer may claim service credits or terminate. This is the execution risk that explains the ~100 bp gap between Meta's bonds and CoreWeave's project financing.

Example: A 100 MW cluster is four months late because of a cooling defect. The hyperscaler customer is owed several months of service credits. First-year cash falls well short of plan, reserves are drawn, and the Neocloud's next financing is priced wider.

Scenario 4: Credit markets tighten - Rates rise or a broader credit event makes lenders cautious. Sound projects struggle to refinance; new ones are delayed. With AI debt projected to exceed 10% of US issuance in 2026, a pullback would be felt quickly, and rising yields hit AI equities at the same time.

Scenario 5: Concentration: Many of the largest commitments depend on a small number of AI labs and hyperscalers. CoreWeave's 67% revenue concentration with Microsoft in 2025 is one visible example. If a key customer cut its compute plan, multiple lenders, Neoclouds and guarantors would feel it at once.

Example: Three Neoclouds each sign offtake agreements with the same hyperscaler, whose end customer for all three is a single AI lab. On paper, lenders see three projects with an IG offtaker. In reality, all depend on one lab's growth.

Scenario 6: Circularity unwinds: Where suppliers invest in customers who buy their products, a slowdown can travel around the loop: lower demand → lower supplier sales → less appetite for further investment and backstops → harder financing for customers → lower demand. This is the vendor-financing dynamic that hurt telecom equipment makers after 2001.

Why stress testing doesn't contradict the bull case: None of these scenarios means the build-out will fail. Railways, electricity, telecom and the internet all went through financing booms, busts and restructurings and still delivered transformative infrastructure. Financing structures determine who bears the pain when things go wrong and how fast the system recovers. Understanding backstops, tranches and residual value guarantees is how you understand who those people will be
Article content
Who bears the pain

Part VI - Bringing It Together

The End-to-End Flow - Financing a 200 MW AI Campus

Here is one end-to-end, illustrative walk-through that ties every concept together.

  • 1Demand appears. An AI lab forecasts it needs 200 MW more inference capacity because enterprise API and agentic revenue is growing quickly. (Eras; willingness; decision matrix.)
  • The lab can't borrow cheaply. It isn't investment grade. (The IG gap.)
  • A hyperscaler steps in. The lab signs a multi-year compute deal with an IG hyperscaler, which signs a five-year offtake with a full-stack neocloud. (Credit intermediation.)
  • The Neocloud needs a site. An infrastructure-led developer offers a refurbished industrial site with an existing grid connection plus behind-the-meter gas. (Neocloud map; power constraint solved by capital.)
  • The developer needs a creditworthy lease. Nvidia guarantees part of the Neocloud's lease and the PPA for on-site power. (Lease and PPA guarantees.)
  • The Neocloud buys compute. It orders GB300 racks; memory supply is secured by Nvidia's multi-year commitments. (Supply commitments; de-speccing.)
  • The financing route is chosen. Part of the hardware is financed with GPU-backed debt on the Neocloud's balance sheet; part goes into a bankruptcy-remote SPV leased to the hyperscaler at a lower cost of capital. (Two funding strategies.)
  • Lenders size the debt. They underwrite the hyperscaler offtake and Nvidia's support, at a DSCR cushion, charging a spread that still includes execution risk. (Financial model; ClusterMAX risk.)
  • The capital stack is tranched. Senior A notes, a B-piece and equity, with partial Nvidia residual value support. (Tranching; RVGs.)
  • Some of it reaches ABS markets. Senior notes are sold to insurers and pension funds, priced off Treasury yields plus a spread. (AI debt as an asset class; bond yields.)
  • Capacity goes live. The lab serves tokens at high margins; revenue flows down through the hyperscaler to the Neocloud, which pays the developer, the power provider and lenders. (Revenue down the stack.)
  • Upside is shared. If rental prices exceed any floor, Nvidia shares the excess. (AICP revenue share.)
  • In year five or six, the hardware is refinanced, re-leased for inference, or sold. If it's worth less than guaranteed, Nvidia makes up the gap. If inference has largely moved to ASICs, that's when it will show. (Residual value; ASIC shift.)

Who carries which risk?

Article content
Who Carries the Risk in AI Build
The big picture in one paragraph: AI demand creates revenue at the top of the stack. That revenue is attractive but held by companies lenders don't fully trust. Nvidia and the hyperscalers lend their trust through their balance sheets, so money can flow from capital markets to the builders. It's working today, and profitability across most layers is strong. But the amount of trust available is finite, bond markets are starting to push back, custom chips are changing the long-run value of GPUs, and the build-out ambition is far larger than any single balance sheet. The industry's next challenge is to make AI infrastructure financeable on its own merits
Article content
The Big Picture

What It Means for You

For technology sellers and account executives

  • Capacity and pricing at the top reflect financing at the bottom. If credit tightens, expect slower capacity growth and firmer pricing for premium models.
  • Vendor stability is a selling point. Customers increasingly ask where AI workloads run and who stands behind them. Being able to explain the Hyperscaler vs Neocloud distinction builds credibility in technical due diligence and third-party risk reviews.
  • Platform choice is a risk conversation. Solutions on a major hyperscaler inherit that provider's resilience and balance sheet, a legitimate point in regulated sectors like health, government and financial services.
  • Sell to the decision matrix. Frame AI use cases by quadrant: routine processes to automate, consequential ones to manage with oversight. That helps customers adopt faster and makes the value easier to measure.

Example: An enterprise risk team asks whether a vendor's AI features depend on a single small GPU provider. The vendor explains that inference runs through a major cloud provider's managed AI service with regional failover. That answer, grounded in the dynamics in this article, can close a third-party risk question that might otherwise delay a deal.

For enterprise buyers

  • Expect AI pricing to reflect real infrastructure economics. Frontier token prices, per the episode, are holding or rising.
  • Lock in capacity where it matters. If AI underpins critical workflows, consider committed capacity or reserved throughput, just as labs do with offtake.
  • Ask about concentration risk and exit strategy. Know which clouds and providers your AI vendors depend on, and how portable your workloads are (the control-versus-portability 2×2 in Chapter 2).

For delivery and architecture teams

  • Efficiency is economic. Caching, batching and right-sizing models drive the high gross margins discussed in Chapter 15, and reduce your own costs.
  • Design for portability where practical, so capacity or pricing changes don't strand your solution.
  • Expect hardware diversity. As inference moves partly to ASICs, design so models can run on different accelerators through managed services.

For investors and finance teams

  • Read the footnotes. Off-balance-sheet commitments, capacity agreements and guarantees can be substantial contingent exposure.
  • Watch spreads and yields. Hyperscaler and AI-related spreads, and the 10-year Treasury yield relative to the threshold where stocks and bonds stop hedging each other, are early signals.
  • Watch GPU rental prices and the ASIC share of inference. They are the best real-time indicators of residual value risk.
  • Use the levers. Price, utilisation, capex and leverage dominate returns; power and rent matter far less for the GPU owner.

Conclusion

Article content
The Most Important Chip May Be the Credit Rating
For three years, the AI race looked like a race for silicon, then a race for power. The SemiAnalysis episode makes a compelling case that it has become a race for credit. Nvidia's roughly $497 billion of commitments, the hyperscalers' role as credit intermediaries, AICP rental floors, residual value guarantees, SPV leasebacks and tranched capital structures are all versions of the same move: using strong balance sheets to make weaker ones financeable.
That move has worked remarkably well. Demand looks durable, especially as agentic AI turns compute into an "all time" utility. Token economics look strong. Even older GPUs are earning more than anyone expected. But the picture has real tensions. Neoclouds like CoreWeave are growing fast but carry heavy debt and customer concentration. Nvidia's customers are building their own chips. Bond markets are absorbing an unprecedented wave of AI debt, and rising yields could raise the cost of capital and remove the hedge investors rely on. And the industry's long-term structure is not yet settled (software-like, telecom-like or split).
Nvidia's estimated 46 GW of backstop capacity is a fraction of the 240 GW the industry wants to build. Closing that gap will require lenders to understand AI infrastructure deeply enough to underwrite it on its own merits: GPU economics, cluster execution, token profitability and residual values. Whether that happens fast enough, and whether today's demand proves durable through a full credit cycle, will decide how big and how fast the AI build-out becomes.

For everyone working in technology, it is worth watching not just the next chip launch, but the next bond deal.

--

References and Further Reading: core figures in this article come from the SemiAnalysis episode summary and the charts supplied with the brief. The further reading below is a starting point for anyone who wants to go deeper. Titles and authors are given so they can be searched directly; please check the original sources for the latest versions and figures before citing them.

Primary sources used in this article

  • SemiAnalysis Weekly, "Nvidia's Backstop Universe" (episode and summary) — the source of the $11.3T capex, ~$7T debt, ~$497B Nvidia commitments, AICP floor, 46 GW vs 240 GW, and related figures.
  • SemiAnalysis, ClusterMAX ratings of GPU cloud providers - background on execution risk.
  • Boring Biz, "How Money and GPUs Move Between NVIDIA and CoreWeave" (graphic, as of 13 October 2026), citing CoreWeave Q2 2026 results, 10-K and 8-Ks, Nvidia 13F and SEC filings, Reuters and Bloomberg.
  • CoreWeave investor relations - quarterly results, 10-K and 8-K filings.
  • Nvidia investor relations - annual reports and SEC filings, including notes on purchase obligations and guarantees.
  • Bloomberg / MacroBond chart, "Stock–bond correlation vs US 10-year yield" (as supplied).
  • "Market Share Splits 2024 to 2030: Training vs Inference" (chart, as supplied).
  • Social media post dated 13 October 2026 on hyperscalers scaling custom chips and ASIC volumes surpassing GPUs by 2030 (as supplied; an opinion, not advice).
  • "AI Compute Funding Strategies: Neocloud/PaaS vs SPV Leaseback" (comparison graphic, as supplied).
  • "The Neocloud Map"
  • "Cloud Evolution - Adoption 2008 to 2022" and "Distributed Cloud - Battle AWS vs Google" (slides, as supplied, citing Gartner, HBR, Forrester, McKinsey and BCG).
  • I. Sebastian, P. Weill, T. Haskamp and J. vom Brocke, "Designing Decision Rights for AI" (MIT Sloan, 2026), source of the AI Decision Matrix.
  • Nvidia keynote framing of AI eras (training, inference, agentic AI), as shown in the supplied "The AI Revolution" slide

Further reading on AI investment and financing

  • David Cahn (Sequoia Capital), "AI's $600B Question" (2024) - on the gap between AI infrastructure spend and end-user revenue.
  • Goldman Sachs Global Investment Research, "Gen AI: Too Much Spend, Too Little Benefit?" (2024) — a debate-style report on AI capex returns.
  • McKinsey & Company, "The cost of compute: a $7 trillion race to scale data centers" (2025).
  • Bain & Company, Technology Report 2025 — on revenue needed to fund AI compute demand.
  • International Energy Agency, "Energy and AI" (2025) — on datacenter power demand.
  • Rating agency commentary (S&P, Moody's, Fitch) on datacenter ABS, GPU-backed financing and hyperscaler credit

Further reading on infrastructure cycles and telecom

  • Carlota Perez, Technological Revolutions and Financial Capital (2002) - the classic framework for how financial bubbles accompany technology build-outs.
  • Andrew Odlyzko, writings on internet traffic growth and the telecom bubble - on how real demand and mistimed financing coexisted.
  • Analyses of the 2000–2002 telecom bust and vendor financing (e.g. histories of Lucent, Nortel and fibre carriers) on supplier-financed demand.

Further reading on markets and rates

  • Research on the stock–bond correlation and inflation regimes from central banks and asset managers on why bonds hedge equities in some regimes but not others.

Disclaimer: This article is for education only and is not financial or investment advice. Worked examples and the financial model are simplified illustrations, not reported data.