{"id":10714,"date":"2026-01-19T18:49:35","date_gmt":"2026-01-20T00:49:35","guid":{"rendered":"https:\/\/attentionmedia.io\/?p=10714"},"modified":"2026-01-19T18:49:35","modified_gmt":"2026-01-20T00:49:35","slug":"why-ai-is-the-most-unpredictable-cost-in-the-martech-stack","status":"publish","type":"post","link":"https:\/\/attentionmedia.io\/?p=10714","title":{"rendered":"Why AI is the most unpredictable cost in the martech stack"},"content":{"rendered":"
\"\"<\/div>\n

Early in my career, the technology contracts I signed were fairly straightforward. I knew what I was paying for, how many seats I had and what was included. Even as data volumes grew and systems became more complex, costs were still mostly understandable. You could estimate what it took to store, move and process data. It wasn\u2019t always obvious, but it was knowable. <\/p>\n

That sense of clarity is fading. Watching two new data centers rise just outside my neighborhood is a physical reminder of how quickly we\u2019re scaling compute for AI \u2014 and of the entirely different cost structure it introduces, one that\u2019s harder to see, harder to predict and harder to control.<\/p>\n

Everyone is focused on the upside: productivity, creativity, velocity and new capabilities. But the financial architecture beneath those gains is still immature. Most organizations don\u2019t know the actual cost of a single AI interaction, what drives usage spikes or whether model consumption is aligned to actual value. AI doesn\u2019t behave like the infrastructure we spent decades learning to manage. It behaves like a series of invisible inference events happening everywhere at once, triggered by anyone.<\/p>\n

As AI shifts from experiment to core capability inside marketing systems \u2014 powering content, personalization, segmentation, decisioning and orchestration \u2014 the reckoning becomes inevitable. If marketing and operations leaders don\u2019t build real cost literacy and visibility now, AI will become the fastest-growing, least predictable line item in the martech budget.<\/p>\n

Why this is different \u2014 and why the data supports it<\/h2>\n

AI doesn\u2019t just add a new line item to technology budgets \u2014 it changes how cost behaves. Recent research shows that AI costs scale faster, less linearly and with far less visibility than previous generations of technology. The 2025 State of AI Cost Management Report<\/a> found that 84% of companies are already experiencing measurable gross-margin erosion from AI infrastructure, with 26% reporting a margin impact of 16% or higher. More concerning, 80% of enterprises miss their AI infrastructure forecasts by more than 25%, signaling this is not a planning failure but a structural one.<\/p>\n

At the infrastructure level, the cost curve itself is steepening. The cost to train the most compute-intensive models has increased at roughly 2.4 times per year<\/a>. This is driven by accelerator hardware, specialized staff, interconnects and energy demands. While most companies aren\u2019t training frontier models directly, these economics cascade downstream through API pricing, hosted platforms and cloud infrastructure.<\/p>\n

For most organizations, however, the real exposure comes from inference \u2014 the cost of using AI at scale. As systems become more agentic and dynamic, a single request increasingly fans out into multiple model calls, retrieval steps, tool invocations and safety checks. Research on dynamic reasoning systems<\/a> shows that while these architectures improve flexibility and performance, they also introduce significant overhead in tokens, latency, energy and infrastructure, with diminishing returns as complexity increases.<\/p>\n

Importantly, this cost escalation is not inevitable. Empirical studies show that better agent design and orchestration can materially reduce spend without sacrificing performance. One recent paper demonstrated<\/a> a 28.4% reduction in operational cost while retaining more than 96% of benchmark performance, underscoring that architecture \u2014 not just model choice \u2014 is a primary cost driver.<\/p>\n

What makes AI especially difficult to manage is that many of its highest costs aren\u2019t where organizations expect them. Beyond model usage, companies routinely underestimate expenses tied to networking, data movement, storage, redundancy, energy, cooling and operational overhead.<\/p>\n

The result is a cost structure that is consumption-based, distributed and opaque by default. AI spend does not arrive neatly packaged as a license fee. It accumulates through thousands \u2014 or millions \u2014 of invisible interactions, triggered by people, workflows and increasingly by other machines.<\/p>\n

Dig deeper: <\/em><\/strong>AI productivity gains, like vendors\u2019 AI surcharges, are hard to find<\/em><\/strong><\/a><\/p>\n

Why this becomes a problem at scale<\/h2>\n

At an individual level, AI is already delivering value. Multiple studies show meaningful productivity gains for knowledge workers \u2014 faster drafting, quicker analysis and less time spent on repetitive tasks. That impact is real, visible and easy to feel.<\/p>\n

What\u2019s far less common is seeing those gains translate cleanly at the organizational level. Recent research highlights a widening gap between personal productivity benefits and enterprise-wide return. McKinsey\u2019s The State of AI in 2025<\/a> reports that while AI adoption is widespread, only a small percentage of companies have successfully scaled AI into production in ways that deliver material financial impact. Many remain stuck in pilots, fragmented deployments or narrowly scoped use cases that don\u2019t compound into durable advantage.<\/p>\n

At the same time, spending is accelerating. Most organizations are investing aggressively in AI infrastructure while missing cost forecasts and experiencing margin erosion. This creates a dangerous dynamic: companies feel pressure to keep up in the AI race, even when the path to value isn\u2019t clear.<\/p>\n

This is how cost problems emerge quietly. Teams experiment in parallel. Tools proliferate. Usage grows faster than governance. Infrastructure scales before outcomes are well understood. The result isn\u2019t reckless behavior \u2014 it\u2019s misalignment. Investment decisions are being made faster than organizations can gain clarity on which AI use cases deserve scale, which should remain constrained and which should be shut down entirely. The risk isn\u2019t that AI fails to deliver value. It\u2019s that value emerges unevenly while cost accumulates everywhere.<\/p>\n

This is where marketing organizations sit squarely in the blast radius \u2014 and also where they have the most leverage. Marketing teams are often early adopters, high-volume users and constant experimenters, embedding AI into content, personalization, decisioning and testing long before enterprise guardrails are fully formed. Without a transparent cost structure and ownership model, what begins as local efficiency can quickly become a systemic margin issue.<\/p>\n

There\u2019s a familiar lesson here. Just as strong brand foundations amplify performance marketing \u2014 rather than replace it \u2014 AI infrastructure must come before AI scale. Organizations that invest in the underlying structure, governance and operating model will get more value from the tools they adopt. Those who don\u2019t risk spending their way into AI without ever building the base it needs to work.<\/p>\n

Dig deeper: <\/em><\/strong>Scaling AI starts with people, not technology<\/em><\/strong><\/a><\/p>\n

How marketing organizations should think about AI cost structure<\/h2>\n

In many conversations, AI is treated as the outcome. In some products, that may be true. But at the enterprise level \u2014 especially in marketing \u2014 AI is a means to an outcome, not the outcome itself. Like Excel, dashboards or experimentation frameworks, AI is a tool. And like all tools, it is neutral by nature.<\/p>\n

What makes AI different is not intent but variability. This tool operates across many models, workflows, agents and infrastructure layers, each with distinct and compounding costs.<\/p>\n

Managing that variability requires structure. Below are the core steps marketing, operations and technology leaders should take to build cost awareness and control before scale makes those decisions harder.<\/p>\n

1. Map AI workflows and match tasks to models<\/h3>\n

Action:<\/strong> Make AI usage explicit<\/a> before you scale it.\u00a0<\/p>\n