cloudpatterns.appClassroomKatasWhiteboardBlog
Z3 · Operations & Cost

Autoscale economics

Autoscale economics

Silver

A fleet sized for the evening peak is paid for at peak size all day, even at 4 a.m. Autoscaling lets the bill follow the traffic instead — you pay for instance-hours, so fewer servers in quiet hours means a smaller bill. How much you save depends on how far the peak is above the average; flat traffic saves almost nothing. Every safety setting has a price — a higher minimum, more headroom and a slower scale-in all cost money, and a maximum caps the bill but turns away anything above it. Known peaks can be scheduled ahead of time, and the steady base that always runs can be bought cheaper with a long-term commitment.

Use when
Traffic with a clear daily or weekly rhythm, where the peak is far above the average · A stateless tier whose fleet is sized for the peak all day · Peaks you can predict — a schedule adds capacity before they arrive
Avoid when
Flat traffic — the fleet barely changes, so there is little to save · Spikes shorter than an instance's start-up time — you pay for instances that arrive too late · Stateful tiers such as the primary database
Trade-offs
A higher minimum and more headroom lower the risk of slow requests, at a price paid every hour · Slow scale-in avoids flapping but keeps paying for capacity after the peak has passed · A maximum caps the bill and the capacity together — traffic above it is turned away · Commitments cut the price of the always-on base, but are paid whether or not it is used
Requires
Autoscaling, How cloud billing works
3 objectives · 9 misconceptions
  • predict Predict a day's instance-hours and bill for a fleet sized for the peak and for an autoscaled one, from a traffic curve and one server's capacity.
  • explain Explain how the minimum, headroom, scale-in delay and maximum each trade money against the risk of being slow or turning users away.
  • choose Choose how to pay for each part of the load — a commitment for the steady base, on-demand autoscaling for the daily swing, a schedule for known peaks, spot for work that can be interrupted.
  • Not true: Turning on autoscaling always cuts the bill.
  • Not true: You start paying for a new instance only once it is serving traffic.
  • Not true: The minimum instance count only matters when traffic is low, so it doesn't affect the bill.
  • Not true: A maximum instance count only protects the bill — it never affects users.
  • Not true: Scaling in as fast as possible saves money with no downside.
  • Not true: Headroom is wasted money and should be cut to zero.
  • Not true: The cheapest plan is to commit to the peak capacity for three years.
  • Not true: Spot capacity is just a cheaper server, fine for any tier.
  • Not true: A schedule removes the need for a metric-based scaling rule.

Neighborhood

Autoscale economics
contrast withRight-sizing
On linesCost Line

Progress is saved on this device