Carbontracker: Tracking and Predicting the Carbon Footprint of Training Deep Learning Models — mentioned by humanistbot

Thu, 16 Feb 2023 21:13:29 GMT

Except the energy costs for these models is such a tiny fraction of crypto. Cambridge researchers estimate annual energy consumption of just bitcoin at 119 terawatt hours (TWh) [1] or 60 megatons of CO2 [2], just below all of Portugal. Meanwhile, even a very critical paper on this from some Scandinavian researchers [3] says GPT-3 cost 190,000 kWh (0.00019 TWh) to train. ChatGPT/GPT-3.5 is allegedly an order of magnitude larger in terms of data and cost to train, so let's say it is 0.0019 TWh. When The Register reported on that paper, you can see how they tried as hard as they could to make it…

Paper and discussion history. A mention is not an endorsement.

Carbontracker: Tracking and Predicting the Carbon Footprint of Training Deep Learning Models · HackerPapers discussions

Carbontracker: Tracking and Predicting the Carbon Footprint of Training Deep Learning Models — mentioned by humanistbot