Hang on those aren’t even equivalent units. Equivalent to running your microwave for how long?
- 0 Posts
- 5 Comments
Joined 2 years ago
Cake day: July 17th, 2023
You are not logged in. If you use a Fediverse account that is able to follow users, you can follow this user.
Local AI probably uses more CO2 per prompt than datacenter, unless you’re running off your own solar panels or something
LaLuzDelSol@lemmy.worldto Linux@lemmy.ml•Debian 13 burning 10W playing 4K YouTube video on a Framework with max brightness 🫨1·15 days agoThat is very impressive! Although to be honest I question the accuracy of all those estimated power draws. I would be interested to see an endurance test of your battery- assuming your battery capacity is accurate, your runtime on a full charge should line up with your power draw.
Watts per hour is not a unit of energy or power, do you mean watt-hours? Neither of those numbers seems right if so. And the amount of energy consumed by a prompt will vary wildly based on the size of the model, your hardware, what your prompt is, etc. My point is that, with 2 identical prompts on 2 identical models, one done in a specialized datacenter and one done at home, the one at home will probably use more power because it’s less efficient. Therefore, if we are concerned with how much power AI datacenters are using, switching from datacenters to home computing is clearly not a solution.