AI X Sustainability

NVIDIA claiming to be significantly cutting energy use for tokens.

Like many people, I am conflicted by the potential benefits of AI, and the potential harms. These potential harms come in many different flavours, and one of those is energy consumption.

But yesterday Bob Pette, NVIDIA’s vice president, shared a perspective on energy consumption that I haven’t considered before. He claims that NVIDIA are “…designing our systems with not just performance in mind, but with energy efficiency in mind.”

To back up that claim, he explained that NVIDIA energy use for token generation has been reduced by 100,000x in the last decade, and looks set to continue to reduce in the future.

While this doesn’t allay all of my fears, it does give me some hope about the potential for sustainable solutions as AI explodes in every direction.

Find out more here.

Inspiration from Russell.