Home / Learn / Data & AI / Offline AI / Lesson 6.1
All lessons

Module 6: Power, heat and running costs · Lesson 6.1 · about 15 min

Watts at rest and at full load

How much power AI machines draw while idle, while reading a prompt and while writing, and how to measure your own.

Key points, meanings and formulas on one page: choose "Save as PDF" in the print box.

Module 6 · about 15 minutes · read first: 4.4. You’ll be able to estimate how many kWh your AI machine uses.

Energy is power multiplied by time, so a machine left idling for hours can use more electricity than the AI work itself.

1. Why this matters

Local AI has no per-token bill, but it does have an electricity bill. For a laptop it is tiny; for a big graphics card used all day it can be a real monthly cost. Knowing the watts is the first step to knowing the money (Lesson 6.2).

Two words first. A watt (W) is how fast a machine uses power right now. A kilowatt-hour (kWh) is an amount of energy: 1,000 watts for one hour. Think of a tap: watts are how far it is open, hours how long it runs, and kWh the water in the bucket. Your bill charges for the bucket.

Calculator: your AI power bill

Prices checked 18 November 2026; check your own bill, which is the official source for you. Watts are whole-machine estimates at the wall while the model is writing; idle machines draw far less (Lesson 6.1). Measure yours with a plug-in power meter.

2. Three states

  • Idle (model loaded, nobody asking): a Mac mini a few watts to about 10 W, a desktop with a graphics card about 50 to 90 W, a 128 GB box somewhere between.
  • Reading a prompt (prefill): short bursts at close to full power.
  • Writing: the graphics card often runs below its rated power because it waits on memory (Lesson 4.2), but still high.

Rough whole-machine figures while writing (at the wall, estimates):

Machine While writing
Laptop or Mac mini about 20 to 40 W
Mac mini Pro or Mac Studio about 50 to 120 W
PC with RTX 5060 Ti (180 W card) about 200 to 280 W
PC with RTX 3090 (350 W card) about 350 to 500 W
PC with RTX 5090 (575 W card) about 500 to 800 W
128 GB AI box about 150 to 250 W

Here is one working day on a desktop with a graphics card. The shaded area under the line is the energy:

Measure. A plug-in meter shows 70 W while the model sits loaded and idle, and 260 W while it writes.
The work. Four half-hour bursts of writing: 2 hours in all. 260 W × 2 h = 520 Wh = 0.52 kWh.
The waiting. The other 8 hours it idles at 70 W: 70 × 8 = 560 Wh = 0.56 kWh. The idle time uses more energy than the work. Day total: 1.08 kWh.
Sleep instead. Put the machine to sleep between jobs (about 2 W). Idle energy falls to about 0.02 kWh, and the day's total roughly halves to 0.54 kWh.
kWh=Wwriting×hwriting+Widle×hidle1000
W
Watts: how fast the machine is using power in that state, read from a plug-in meter.
h
Hours spent in that state each day.
÷ 1,000
Turns watt-hours into kilowatt-hours, the unit on your bill.
Physical meaning
The energy is the area under the power line over the day. A tall, short spike of work can hold less area than a long, low strip of idling, which is why switching off or sleeping often saves more than any setting.

“A 350 W graphics card always draws 350 W.” That is its maximum. While writing it often waits on memory and draws less; while idle it may draw a few tens of watts. Only a plug-in meter tells you what your machine really uses for your work.

3. Measure, do not guess

A plug-in power meter (an inexpensive gadget sold in hardware shops) shows real watts. Note idle, writing and peak. You can also lower a card’s power limit by 20 to 30% with the maker’s tool: since writing is memory-bound, speed often drops only a little.

Maths and principle

Principle: energy is power multiplied by time, added up for each state.

Equation: kWh = (W writing × h writing + W idle × h idle) ÷ 1,000.

Analogy: a tap: watts are how far it is open, hours how long it runs, kWh the water in the bucket.

Try it: 250 W for 2 hours of writing plus 60 W idle for 6 hours? ((500 + 360) ÷ 1,000 = 0.86 kWh a day.)

4. Worked example

Made-up numbers. Sana measures her PC: 70 W idle, 260 W writing. She had been leaving it on all day. Switching it to sleep when not in use saves about 0.5 kWh a day, more than her actual AI use costs.

5. Practice

  1. Pick your machine in the calculator and set your hours.
  2. Why does a graphics card often draw less than its rated power while writing?
  3. How could you halve your idle energy?
Answers
  1. Note the kWh per month; Lesson 6.2 turns it into money.
  2. It waits on memory, so its maths units are not fully busy.
  3. Sleep or shut down the machine when idle, or unload the model if the engine keeps the card busy.

New words: watt (W), kilowatt-hour (kWh), power limit, plug-in power meter.

  • Watts are the rate of use; kilowatt-hours (watts × hours ÷ 1,000) are what your bill charges for.
  • An AI machine has three states: idle, reading a prompt (near full power) and writing (often below rated power).
  • Hours of idling can use more energy than the AI work: sleep the machine between jobs.
  • Measure with a plug-in meter; a 20 to 30% lower power limit often costs little speed.

Check yourself

1Your PC draws 250 W while the model writes and 60 W idle. Which number matters most for the bill?
2What is a kilowatt-hour?
3What is the most reliable way to know your machine's real power draw?

Sources

Your ticks stay in this browser. Save them as a file on the course home.

Updated 2026-11-22. Prices and model names change fast: check the official source before you buy.