Physical Address

304 North Cardinal St.
Dorchester Center, MA 02124

This tool estimates how much electricity your chatbot messages consume


Thank you or thank you when you want, and how much electricity you use from an AI model? Facial Engineer Julien Delavande Hugging, so he built a means of to help arrive in response.

Energy consumes energy when AI models are running each time. GPUs and scale related calculation works on specialized chips that need a lot of power to carry out the workload. It is not easy to close model power consumption, but this wide expected The growing use of AI technologies will need new summits of electricity in the next few years.

The requirement for the EU fuel for fuel led to some companies to follow environmentally friendly strategies. Delavande’s attention to this and perhaps some AI users aims to break.

“Even small energy savings can scale between millions of surveys – the model can affect the main environment,” Delavande and other creators wrote in a statement.

Delavanda’s tool is designed to work with open source fronts for models such as META LLAM 3.3 70B and Google Gemma 3. The instrument assesses the energy consumption of the messages that the consumption of consumption in Nate-Clock or Joule. It also compares the model energy use with common home appliances such as microwave and LEDs.

According to the tool, the LLA 3.3 70B is equivalent to use a microwave or 0.02 seconds to use approximately 0.1841 watt to write a typical email – 0.12 seconds.

It’s just that the calculations of the instrument – it’s worth remembering that calculations are. Delavande does not claim incredibly accurate. Again, everything – serving as a reminder that ChatBots included.

“Projects are pushed for transparency in the open source society, such as EU energy score and EU’s energy trace transparency. One day, energy use may be as visible as nutritional labels!” Delavande and his co-chairs wrote.





Source link

Leave a Reply

Your email address will not be published. Required fields are marked *