Terran Labs
Back to resources

The AI Budget Audit: What Actually Survives When the CFO Starts Asking for ROI

23 minadmin10/30/2026

There is a specific kind of silence that falls over a boardroom when a chief financial officer asks a simple question about an artificial intelligence programme and nobody has a number to offer. It is not hostility. It is recalibration. For roughly half a decade, AI spending sat outside the normal machinery of capital discipline – funded from innovation pools, defended with seat counts, and measured with dashboards that tracked enthusiasm rather than economics. That arrangement is now unravelling, and the people unwinding it are not technologists. They are the budget owners.

What follows is an attempt to map that shift honestly: why it is happening, what the new evaluation logic actually looks like, which companies have already made the transition, and where the hidden costs sit that make most AI business cases quietly wrong. The thesis is uncomfortable but not complicated. Deploying models is not the same thing as creating value, and the gap between those two activities is where an enormous amount of money is currently disappearing.

The Permission Slip Nobody Renewed

Enterprise AI did not arrive through the front door of financial governance. It arrived through the side entrance marked "innovation", and for several years that entrance came with a generous exemption. Projects were approved on the strength of a demonstration rather than a forecast. Vendor relationships were established before use cases were defined. Internal centres of excellence were staffed and celebrated. None of this was irrational at the time – the technology was genuinely new, the competitive fear was genuine, and the cost of being late felt higher than the cost of being wrong.

But exemptions expire. The mechanism by which they expire is rarely a formal policy change. It is a migration of ownership. When AI budgets are held by a CTO or an innovation lab, the relevant question is "can we build it?". When those same budgets migrate to a CFO or a line-of-business P&L owner, the question becomes "what does it return?", and the second question is far less forgiving. The same project, with the same technology and the same team, can look like a strategic bet under one owner and an unexplained expense under another.

This is the reckoning in its plainest form. It is not a rejection of AI. It is the application of ordinary corporate finance to a category that had been temporarily excused from it. And once that happens, a great many programmes discover that they were never designed to survive the scrutiny.

Adoption Is an Input; Value Is an Output

The single most useful distinction a leadership team can make right now is between adoption and value, and the two are routinely confused because adoption is measurable weekly while value is measurable quarterly at best.

Adoption describes absorption. It counts how much technology an organisation has taken in: how many licences were provisioned, how many employees logged in last month, how many prompts were submitted, how many proofs of concept cleared their demo. These are real numbers, and they are seductive precisely because they always go up. A well-run rollout will produce a rising adoption curve almost automatically.

Value describes output. It shows up in operating margin, in the marginal cost of processing a claim, in the working capital a business no longer needs to hold, in the transaction volume a fixed headcount can now absorb. Value is harder to measure because it requires a counterfactual – what would this have cost without the system? – and organisations are generally poor at building counterfactuals before they deploy something.

Here is the trap. Overlay sophisticated models on a fragmented, manual, badly governed operating architecture and nothing about the unit economics changes. You have added a subscription line to the cost base and produced a demo that photographs well. The inefficiency underneath is untouched, and now it is slightly more expensive to run. This is not a technology failure. It is an architecture failure wearing a technology costume.

What Changed Between the Pilot Era and the Reckoning Era

The contrast between the two eras is stark enough that it is worth setting out plainly, because teams still operating on the old assumptions are being quietly defunded while believing they are performing well.

  • Who holds the money. In the experimentation era, funding came from discretionary innovation pools, R&D budgets, and technology leadership. In the reckoning era, it comes from the CFO, the CEO, and P&L owners who are accountable for margin.
  • What counts as success. The old scorecard tracked seat provisioning, active users, pilot throughput, and prompt volume. The new one tracks operating margin expansion, total cost of ownership, and absolute unit cost reduction.
  • How governance works. Open-ended exploration and permissive cost caps have given way to stage-gated capital allocation, audited baselines, and a willingness to kill portfolios outright.
  • What the real bottleneck is. In the early years the constraint was talent, model choice, and compute. Today the constraint is architectural inertia, siloed operating models, and the change resistance of people whose jobs the system is meant to reshape.
  • How projects end. Perpetual pilots and unvalidated proofs of concept have been replaced by baseline benchmarking, causal impact auditing, and pre-agreed kill triggers.

The fifth item is the one that unsettles teams most, and it should. A pilot that never ends is not a pilot. It is an operating expense with an optimistic name.

Weak AI, Strong Economics

A second conceptual error has cost enterprises dearly: the belief that transformative value requires human-like general intelligence. It does not, and waiting for it is an expensive way to lose a decade.

The economic framework set out by Marco Iansiti and Karim Lakhani in Competing in the Age of AI makes the point with unusual clarity. Enormous market capitalisation and operational dominance have been generated not by systems that simulate consciousness or emotional nuance, but by specialised, task-specific prediction engines applied directly to the core execution path of a business. The industry calls this weak AI, which is a terrible name for the most economically powerful software ever deployed.

Weak AI is narrow by design. It sets a price. It predicts which customer will leave. It ranks a credit applicant. It reroutes a delivery. It flags a tumour in an image. Each of these is a bounded, discrete task that previously required human cognitive processing, and each can be handled at near-zero marginal cost once the system is running inside the workflow rather than beside it.

The strategic objective is therefore not to replicate human cognition across a corporate hierarchy. It is to remove human labour from the critical path of value delivery, and to keep humans where they genuinely add leverage: system design, exception handling, governance, and the judgement calls that the model is not authorised to make. That reframing sounds modest. In practice it is the difference between a company whose costs scale linearly with volume and one whose costs barely move.

Scale, Scope, and Learning: The Three Levers

To understand why so many AI deployments fail to appear on the income statement, it helps to separate a company’s business model from its operating model. The business model describes how value is promised and captured: positioning, segments, proposition, pricing, target margins. The operating model describes how that promise is actually delivered: architecture, assets, capabilities, workflows, systems.

Operating models compete along three dimensions, and AI only matters insofar as it moves one of them.

  • Scale is the capacity to serve growing volume at declining marginal cost. Traditional firms fail here because growth requires proportional human effort, and human effort brings coordination overhead.
  • Scope is the capacity to offer adjacent products by reusing shared assets – a common data layer, a common identity system, a common set of APIs. Firms without shared infrastructure cannot expand scope without duplicating cost.
  • Learning is the capacity to capture transaction data, extract insight, improve the model, and redeploy the improvement across the whole footprint. This is the compounding lever, and it is the one most enterprises leave almost entirely unused.

In a traditional operating model, human labour sits directly on the critical path. Every additional claim, loan application, warehouse pick, or routed delivery consumes roughly constant human time. Complexity inflates marginal cost, slows execution, and degrades experience precisely as the business succeeds. Software on the critical path breaks that relationship. An incremental transaction costs almost nothing to process, so scale stops punishing the firm and starts rewarding it.

The AI Factory as an Operating Machine

The organisations that have made this transition reliably share a common structure, which is best understood as a factory: a repeatable, componentised decision engine that industrialises how the company makes operational choices. Four components matter, and skipping any one of them is usually visible in the results within a year.

The data pipeline extracts, cleans, normalises, integrates, and governs data from internal and external sources. Its job is to collapse fragmented silos into a single high-integrity layer that prediction models can actually consume. Without it, every model becomes a bespoke data engineering project, and the marginal cost of the next use case never falls.

Algorithm development trains the models themselves – supervised, unsupervised, and reinforcement or bandit approaches – and replaces manual judgement with real-time prediction inside the workflow. The measure of success is decision throughput and unit cost, not model elegance.

The experimentation platform runs A/B tests, randomised controlled trials, and causal validation. This is the component enterprises most often skip, and it is the one that prevents non-performing models from scaling. Without causal validation, teams cannot distinguish real impact from correlation, so they scale whatever felt convincing in the demo.

Software infrastructure and APIs decouples components into modular services with standard interfaces. This is what allows independent teams to deploy without coordination meetings, and – critically – what allows external partners to plug into the enterprise runtime, which is how an internal capability becomes a revenue line.

Read those four components as an assembly line and the logic becomes clear. Value does not come from any single model. It comes from the fact that the second, tenth, and hundredth model cost dramatically less to build and deploy than the first, because the line already exists.

Ant Financial: What a Two-Yuan Loan Teaches About Cost Structure

The clearest available illustration of marginal cost collapse is Ant Financial, spun out of Alibaba’s escrow payment platform. Serving more than 700 million individual users and over 10 million small and medium enterprises with fewer than 10,000 employees puts it in a different economic category from a legacy bank – Bank of America, for comparison, historically needed around 209,000 employees to serve roughly 67 million customers across a physical branch network.

Its micro-lending arm MYbank runs what is known as the 3-1-0 model: three minutes for a user to complete an application on a phone, one second for algorithmic credit approval, zero human intervention. Behind that second sits a decision engine evaluating more than 3,000 real-time risk control strategies, drawing on consumer behaviour records inside the Alibaba ecosystem, seller transaction data such as point-of-sale velocity and refund frequency, government records covering legal and tax compliance, and partner telemetry from hotel and ride-hailing networks that feeds the Zhima Credit scoring engine.

The number that matters is the operating cost per loan: roughly RMB 2, against approximately RMB 2,000 at a traditional commercial bank. That is a thousandfold difference, and it is not achieved by a better model alone. It is achieved by removing human adjudication from the loop entirely while keeping the risk framework credible. The system handles peak loads of 120,000 transactions per second at 99.99% availability, which means the cost advantage does not degrade under pressure.

The adjacent lesson is Yu’e Bao, the automated investment product that let Alipay users sweep idle wallet balances into money market funds with no minimum deposit. It collected RMB 500 billion within nine months of launch and became the world’s largest single money market fund. No branch network, no relationship managers, no account minimums – just a distribution channel that already existed, pointed at a product that previously required human intermediation.

Ocado: Turning Grocery Logistics Into a Software Business

Ocado operates in one of the least forgiving commercial environments available: online grocery in the United Kingdom, where margins are thin and perishable logistics are brutal. Its response was not to optimise human picking. It was to remove the aisle entirely.

Its automated fulfilment centres run thousands of coordinated bots across three-dimensional grids, some facilities spanning a footprint comparable to eleven soccer fields with tens of miles of internal conveyor. Proprietary algorithms handle navigation and pathing so the grid does not deadlock under load, while a demand engine reads purchase history, regional weather, and local events to predict orders days ahead. That forecast connects directly to farm suppliers, so refrigerated trucks arrive as produce is harvested rather than after it has sat in a distribution centre. Once orders are loaded, routing algorithms continuously recalculate delivery paths against traffic, roadworks, and weather.

The reported result is a 98.5% on-time delivery rate. The more interesting outcome is strategic: Ocado now licenses the Ocado Smart Platform to retailers including Kroger in the United States and Sobeys in Canada. A company that could never win on grocery margin converted its operating model into a high-margin software and automation business. That is scope expansion produced by shared infrastructure, and it is only possible because the underlying capability was built as a platform rather than as an internal tool.

Amazon: The Mandate That Broke the Silos

By 2002, Amazon’s expansion from books into apparel, electronics, and home goods had collided with its own architecture. The central codebase, a monolithic C system called Obidos, was buckling. Teams overwrote each other’s work, dependencies delayed releases, and coordination meetings consumed the time that should have gone into building.

Jeff Bezos’s response was an internal directive of unusual bluntness, and its substance is worth restating because it is frequently misremembered as a technical memo when it was actually an organisational one. Every team would expose its data and functionality exclusively through standard service interfaces. Teams would communicate only through those interfaces – no shared memory, no direct database reads, no direct code linking, no informal back channels. Implementation language and database technology were irrelevant. Every interface had to be designed from the outset to be externalisable to third-party developers. And anyone who failed to comply would be removed.

The mandate converted a monolith into a service-oriented architecture, culminating in the Santana redesign, and reorganised engineering into autonomous two-pizza teams that no longer needed to negotiate every change. But the decisive consequence was structural: decoupling data pipelines from application layers let Amazon aggregate transaction data at scale, which is what made dynamic pricing, warehouse pathing, collaborative filtering recommendations, and Alexa’s language processing possible at all. And because every internal interface had been built to be externalisable, the company had a business model waiting for it. AWS was not an accident of infrastructure. It was the mandate compounding.

Microsoft: Making the Cloud the Internal Default

When Satya Nadella took over in February 2014, Microsoft was anchored to a declining desktop paradigm, bound to on-premise licensing, and slowed by divisional rivalry while developer attention moved toward Linux on AWS.

What makes the turnaround instructive is the sequence. Azure leadership was reassigned to an executive from the traditional Windows Server division, signalling that cloud was no longer a fringe experiment but the new core runtime. Scott Guthrie then required internal product teams to install, configure, and run Azure for their own workloads, which is a far more effective quality control mechanism than any internal review board, because it forces engineers to personally experience the friction they ship. In parallel, Kurt DelBene led Core Services Engineering and Operations in consolidating internal IT, operations, and finance stacks onto a common architecture, building a unified data catalogue, componentised algorithm repositories, and enterprise-wide operational telemetry.

None of that is an AI story in the narrow sense. It is a prerequisite story. Unified internal data and a single runtime are what allow a company to train and deploy models across its own operations, and to then sell those capabilities outward with credibility.

When the Dashboard Lies: Metric Fixation at Work

The most common mechanism of self-deception in enterprise AI is a metric that is easy to collect and only loosely connected to money. Goodhart’s law covers the failure mode precisely: when a measure becomes a target, it ceases to be a good measure. Teams are not being dishonest when they optimise the measured thing. They are responding rationally to incentives that were set badly.

Consider a support organisation that deploys a conversational agent and evaluates it on average handle time and speed to first-contact resolution. Those are reasonable operational metrics. They are also trivially gameable. Scripts and staff are incentivised to close complex inquiries early, hand customers between departments, and offer answers that clear the ticket rather than solve the problem. Handle time falls beautifully. Escalations climb, satisfaction collapses, and churn accelerates a quarter later. The local metric was optimised to the point of destroying customer lifetime value.

The alternative is to insist on metrics that touch the balance sheet directly. Absolute cost per transaction, quantified as the marginal change in the direct cost of processing a claim or approving an application or resolving a ticket. Decision latency, measured end to end from raw data intake to executed decision – reducing image segmentation from eight minutes to fifteen seconds is a number a CFO can price. Defect and rework rate, which captures the savings from eliminated errors, manual entry mistakes, compliance failures, and repeat processing. Prompt volume, by contrast, is not a value metric at all. High prompt volume often indicates confusion, hallucination, or a workflow so poorly designed that users must talk their way through it every time.

The Total Cost of Ownership Iceberg

Most AI business cases are wrong in the same direction, and the reason is that they model the visible peak of the iceberg and stop. Licence fees and API consumption are real, but they are the small part. What sinks the return is everything layered beneath the waterline.

  • Data pipeline engineering. Legacy data is fragmented, unstandardised, and trapped in incompatible systems. Building extract-transform-load pipelines, normalising data lakes, reconciling schemas, and maintaining continuous hygiene is not a one-off capital cost. It is durable infrastructure work, and in many transformations it consumes the majority of the budget before a single model is trained.
  • Compute and data egress. Production inference at scale, model retraining cycles, and the cost of moving data between environments routinely exceed the original licence estimate, especially once experimentation becomes continuous.
  • Change management and process re-engineering. This is the line item finance teams habitually under-provision by an order of magnitude. Redesigning a workflow so that a model can actually sit inside it, retraining the people whose jobs the workflow describes, and managing the resistance that follows is slow, political, and expensive.
  • Model drift, retraining, and governance. Models decay. Behaviour changes, distributions shift, regulations tighten. Continuous telemetry, periodic retraining, and audit trails are permanent operating costs, not project phases.

A business case that shows a two-year payback on licence cost alone has not produced a payback estimate. It has produced a best case.

The Friction Nobody Budgets For

It is worth dwelling on that change management cost, because it is where the arithmetic of enterprise AI most often breaks.

Technology deployments fail socially before they fail technically. The people whose workflow is being restructured are not passive recipients of an improvement; they are participants in an outcome, and they have their own read on what the system means for them. When an AI initiative is announced as efficiency, everyone in the room hears headcount. At that point the incentive to make the system succeed is not obviously aligned with individual interests, and the resulting resistance is rarely overt. It looks like slow adoption, quiet non-compliance, workarounds that route around the model, and the patient accumulation of reasons why the new process does not quite fit this particular team’s exceptional circumstances.

The organisations that handle this well tend to do three things differently. They are explicit about what the system will and will not change. They move humans deliberately into exception handling, oversight, and design roles rather than leaving the question unresolved. And they measure the workflow, not just the model, so that a drop in throughput is visible immediately instead of surfacing in a quarterly review as a mystery.

Governance That Kills Projects Early and Cheaply

Stage-gating is unglamorous and it is the highest-return process change available to most enterprises, because the cost of killing a project in month three is a rounding error against the cost of discovering in year two that it cannot be defended.

What that requires in practice is a baseline established before deployment – the current cost per transaction, the current decision latency, the current defect rate – and a pre-agreed threshold that defines failure. Without a baseline there is no counterfactual, and without a counterfactual there is no argument that will survive an audit. Causal validation matters here for the same reason. A model that correlates with improvement is not evidence of improvement, and randomised testing inside production is the only mechanism that reliably separates the two.

Pre-agreed kill triggers also change behaviour upstream. Teams that know a project will be examined against a threshold in ninety days design their pilots to produce evidence rather than enthusiasm, which is precisely the cultural shift the reckoning is demanding.

The Data Foundation Nobody Wants to Fund

There is a persistent mismatch between what executives want to fund and what makes AI work. Visibility goes to models, interfaces, and demos. Money and patience are needed for schema reconciliation, identity resolution, lineage, and data quality – the plumbing that determines whether the tenth use case costs a fraction of the first or the same amount.

This is why platform investments always look worse on a per-project business case than point solutions, and why organisations that fund project by project end up with a portfolio of disconnected tools and no compounding advantage. The correct framing is that the data layer is not overhead attached to a project. It is the asset that makes future projects cheap, and it belongs on the capex plan rather than in a programme’s contingency line.

Short-Term Savings Versus Structural Value

As budget owners tighten the screws, they face a genuine tension worth naming: how to refuse vague appeals to "strategic positioning" without destroying the multi-year assets that actually create durable advantage. Both failure modes are expensive. Accepting unmeasurable claims restores the old permissiveness. Cutting everything that cannot pay back within twelve months produces a company with excellent near-term margins and no structural position.

The distinction that helps is where the value is stored. Localised task automation, vendor licence consolidation, and desktop-level efficiency gains are real and worth banking, and they are entirely replaceable by a competitor who buys the same tools. The durable assets are different in kind, and there are three of them.

  • Proprietary data pipelines. Operational data that is captured, cleaned, and normalised in a way competitors cannot acquire or replicate, because it is a byproduct of how the firm actually runs.
  • Cumulative learning loops. Decision engines that improve as transaction volume grows, so that scale itself becomes a quality advantage rather than merely a cost advantage.
  • Multi-sided network effects. Modular, API-driven architecture that lets partners, vendors, and customers plug into the enterprise runtime, converting internal capability into a platform other people build on.

Notice that all three are assets rather than projects. They do not have a payback period in the conventional sense, which is exactly why they require a different governance conversation – and exactly why they are the first thing cut when a reckoning turns into a panic.

The Questions Budget Owners Should Ask Next Quarter

For anyone on the funding side of the table, a short and unforgiving question set is more useful than a framework.

  • What was the cost per transaction, per decision, or per resolution before this system existed, and what is it now, measured the same way?
  • What would happen to that number if we switched the system off tomorrow? If the answer is "nothing", the value is not in the system.
  • How many humans were on the critical path before, and how many are on it now? Where did the remaining ones go, and is that a decision or a drift?
  • What does the total cost of ownership look like including pipeline engineering, change management, drift retraining, and governance – not just licences?
  • If we build the next use case on this platform, does it cost less than this one did? If not, we have bought tools rather than infrastructure.

Where This Leaves the Enterprise

The era of unvalidated experimentation has closed, and pretending otherwise is now the most expensive form of optimism available to a leadership team. But it is worth being precise about what is ending. It is not AI spending. It is the exemption from financial discipline that AI spending once enjoyed. Those are different things, and conflating them leads organisations into the opposite error – defunding the structural work precisely when the hype-driven competitors are being cleared out.

The organisations that will look back on this period as a starting point rather than a setback are doing a fairly specific set of things. They are retiring pilots that cannot produce evidence and saying so publicly. They are replacing adoption dashboards with cost, latency, and defect metrics that sit on the same page as margin. They are investing in software foundations and data layers that make the next ten use cases cheap. They are enforcing causal experimentation so that scaling decisions rest on measured effect rather than persuasive narrative. And they are deliberately moving human labour off the critical execution path into design, exception handling, and governance, where judgement still compounds.

None of that is glamorous, and almost none of it photographs well. It is, however, the difference between an organisation that has an AI strategy and one that has an AI bill. The reckoning is not a downturn in the technology. It is the moment the technology is finally asked to behave like capital – and the firms that answer that question with architecture rather than enthusiasm are the ones that will still be compounding in five years.