Module 6: Power, heat and running costs · Lesson 6.1 · about 15 min
Watts at rest and at full load
How much power AI machines draw while idle, while reading a prompt and while writing, and how to measure your own.
Module 6 · about 15 minutes · read first: 4.4. You’ll be able to estimate how many kWh your AI machine uses.
1. Why this matters
Local AI has no per-token bill, but it does have an electricity bill. For a laptop it is tiny; for a big graphics card used all day it can be a real monthly cost. Knowing the watts is the first step to knowing the money (Lesson 6.2).
Two words first. A watt (W) is how fast a machine uses power right now. A kilowatt-hour (kWh) is an amount of energy: 1,000 watts for one hour. Think of a tap: watts are how far it is open, hours how long it runs, and kWh the water in the bucket. Your bill charges for the bucket.
2. Three states
- Idle (model loaded, nobody asking): a Mac mini a few watts to about 10 W, a desktop with a graphics card about 50 to 90 W, a 128 GB box somewhere between.
- Reading a prompt (prefill): short bursts at close to full power.
- Writing: the graphics card often runs below its rated power because it waits on memory (Lesson 4.2), but still high.
Rough whole-machine figures while writing (at the wall, estimates):
| Machine | While writing |
|---|---|
| Laptop or Mac mini | about 20 to 40 W |
| Mac mini Pro or Mac Studio | about 50 to 120 W |
| PC with RTX 5060 Ti (180 W card) | about 200 to 280 W |
| PC with RTX 3090 (350 W card) | about 350 to 500 W |
| PC with RTX 5090 (575 W card) | about 500 to 800 W |
| 128 GB AI box | about 150 to 250 W |
Here is one working day on a desktop with a graphics card. The shaded area under the line is the energy:
- W
- Watts: how fast the machine is using power in that state, read from a plug-in meter.
- h
- Hours spent in that state each day.
- ÷ 1,000
- Turns watt-hours into kilowatt-hours, the unit on your bill.
- Physical meaning
- The energy is the area under the power line over the day. A tall, short spike of work can hold less area than a long, low strip of idling, which is why switching off or sleeping often saves more than any setting.
“A 350 W graphics card always draws 350 W.” That is its maximum. While writing it often waits on memory and draws less; while idle it may draw a few tens of watts. Only a plug-in meter tells you what your machine really uses for your work.
3. Measure, do not guess
A plug-in power meter (an inexpensive gadget sold in hardware shops) shows real watts. Note idle, writing and peak. You can also lower a card’s power limit by 20 to 30% with the maker’s tool: since writing is memory-bound, speed often drops only a little.
Maths and principle
Principle: energy is power multiplied by time, added up for each state.
Equation: kWh = (W writing × h writing + W idle × h idle) ÷ 1,000.
Analogy: a tap: watts are how far it is open, hours how long it runs, kWh the water in the bucket.
Try it: 250 W for 2 hours of writing plus 60 W idle for 6 hours? ((500 + 360) ÷ 1,000 = 0.86 kWh a day.)
4. Worked example
Made-up numbers. Sana measures her PC: 70 W idle, 260 W writing. She had been leaving it on all day. Switching it to sleep when not in use saves about 0.5 kWh a day, more than her actual AI use costs.
5. Practice
- Pick your machine in the calculator and set your hours.
- Why does a graphics card often draw less than its rated power while writing?
- How could you halve your idle energy?
Answers
- Note the kWh per month; Lesson 6.2 turns it into money.
- It waits on memory, so its maths units are not fully busy.
- Sleep or shut down the machine when idle, or unload the model if the engine keeps the card busy.
New words: watt (W), kilowatt-hour (kWh), power limit, plug-in power meter.
- Watts are the rate of use; kilowatt-hours (watts × hours ÷ 1,000) are what your bill charges for.
- An AI machine has three states: idle, reading a prompt (near full power) and writing (often below rated power).
- Hours of idling can use more energy than the AI work: sleep the machine between jobs.
- Measure with a plug-in meter; a 20 to 30% lower power limit often costs little speed.
Check yourself
Sources
- Graphics card board power (RTX 5060 Ti 180 W, RTX 3090 350 W, RTX 5090 575 W): NVIDIA product pages via Compute Market, updated 1 November 2026, https://compute-market.com
- India: about US$0.077 per kWh for homes, 2023 to 2025 average (about ₹6.5), GlobalPetrolPrices, https://www.globalpetrolprices.com/India/electricity_prices/
- Canada (Ontario): time-of-use prices from 1 November 2026, 9.1¢, 14.6¢ and 18.9¢ per kWh, Ontario Energy Board via NOW Toronto, https://nowtoronto.com/news/ontario-electricity-rates-dropping-november-2026-what-to-know/
- USA: average home price 18.2¢ per kWh in August 2026 (EIA data), ElectricRates.org, https://electricrates.org/states/report/2026-08/
- UK: price cap 1 October to 31 December 2026, 26.32p per kWh and 54.83p a day, Ofgem, https://www.ofgem.gov.uk/news/changes-energy-price-cap-between-1-october-and-31-december-2026
Your ticks stay in this browser. Save them as a file on the course home.
Updated 2026-11-22. Prices and model names change fast: check the official source before you buy.