Skip to content
AI & Cloud2 min read

Reading Your Cloud Bill as an Architecture Diagram

Cloud spend is the most honest description of your system that exists. A method for turning a line-item invoice into a prioritised cloud native architecture backlog.

Daniel Okafor

Head of AI & Cloud Engineering

Global network connections at night, representing cloud native architecture and cloud spend

Architecture diagrams describe intent. Cloud bills describe behaviour. When the two disagree, the bill is right. We now open every cloud native architecture review with three months of cost and usage data rather than with a whiteboard, because the invoice finds problems the diagram hides.

Three patterns the bill reveals immediately

Data transfer that should not exist

Cross-availability-zone transfer charges are a direct measure of chatty services that were meant to be colocated. A service pair generating thousands of dollars a month in inter-zone traffic is telling you it should be one deployment, or that your client is not zone-aware.

Compute that is provisioned for a peak that never comes

Average CPU utilisation under fifteen percent across a fleet is not prudence, it is an untested autoscaling policy. The fix is rarely smaller instances; it is load testing the scale-up path so the team trusts it enough to lower the floor.

Storage tiers nobody chose

Object storage growing linearly with no lifecycle policy is a retention decision made by default rather than by anyone. It is also, in regulated industries, a compliance exposure - you are keeping data longer than your own policy says you should.

  • Tag enforcement first: untagged spend is unattributable spend, and unattributable spend never gets fixed.

  • Cost per tenant and cost per request, published next to latency on the same dashboard.

  • A monthly review that produces backlog items, not a spreadsheet.

  • Commit to savings plans only after the architecture work is done, never before.

Cost per request belongs in your service level objectives

Teams optimise what they see. When a service owner can see that their p95 latency improved twelve percent while cost per thousand requests rose forty percent, they make a real trade-off. When they only see latency, the trade-off is made silently and discovered by finance a quarter later.

Efficiency is a property of a system that someone is watching. Nothing more mystical than that.

Snippet
cost_per_1k_requests = (compute + data_transfer + managed_services) / requests * 1000

The one thing not to do

Do not run a cost-cutting sprint. Cost is a symptom; sprints attack symptoms and the spend returns within two quarters because the architecture that produced it is unchanged. Convert the bill into architecture work with owners and dates, and the savings persist because the shape of the system changed.

Share

Working on something like this?

We embed dedicated dev teams and senior architects into enterprise programmes: AI & cloud solutions, legacy modernization and full-stack web engineering.