| Mobile Web

Microsoft says ChatGPT power use per query may be up to 20 times lower than estimates

Microsoft released an analysis saying the electricity used to send one question to a large language model can be far lower than widely cited figures. Assuming a 300-token response, it put the median at 0.31 watt-hours, with the middle 50 percent ranging from 0.16 to 0.60 watt-hours. It said earlier estimates may have overstated usage by 4 to 20 times by not reflecting batch processing and real-world GPU utilisation.