AI uses a lot of energy, either for training or inferring. People have started to be concerned about the carbon emissions of AI. Most of the time, engineers choose a solution for hosting AI by only looking at the cost and availability of GPU chips! Some “GPU as a Service” solutions are appearing, basically offering hosting solutions, but specific to AI. They choose any cost effective datacenter to run the computing load of their customer. Imagine a “GPU as a Service” but under the hood, using only datacenters powered by green electricity. That would remove the burden of AI engineer to choose a “low co2” hosting.
3