Power consumption of AI servers nears that of a small country

Fresh report analysing total power usage of AI servers suggests consumption is through the roof!

The likes of the Nvidia H100 GPU consume up to 700W alone, let alone all the other components around it.

French firm Schneider Electric reports that power consumption of AI servers will total around 4.3GW in 2023, which is slightly lower than the power consumption of the nation of Cyprus (4.7GW) in 2021. The company anticipates that power consumption of AI workloads will grow at a compound annual growth rate (CAGR) of 26% to 36%, which suggests that by 2028, AI workloads will consume between 13.5GW and 20GW, which is more than Iceland consumed in 2021.

In 2023, the total power consumption of all data centres is estimated to be 54GW, with AI workloads accounting for 4.3GW of this demand, according to Schneider Electric. Within these AI workloads, the distribution between training and inference is charcterised by 20% of the power being consumed for training purposes, and 80% allocated to inference tasks. This means that AI workloads will be responsible for approximately 8% of the total power consumption of all data centres this year. Schneider Electric recommends transitioning from the conventional 120/208V distribution to 240/415V to better accommodate the high- power densities of AI workloads. For cooling, a shift from air cooling to liquid cooling is advised to enhance processor reliability and energy efficiency, although immersive cooling might produce even better results. The racks used should also be more capacious, with specifications such as being at least 750mm wide and having a static weight capacity greater than 1,800kg. 

See the full report here:

If corporations truly cared about the environment, then they's be using LESS resources and not more.

What is another job of government?

Over 8 years ago or on the 15th of June 2015, the colony’s state media aired on a programme called ‘Q&A’ the topic of the Magna Carta (‘Great Charter’ in Latin) from 1215.

Then Speaker of the House of Representatives Ms. Bronwyn Bishop stated (at 12m16s) 

that “The first job of a government is to look after the safety of its people”

See: https://www.youtube.com/watch?v=6RYy3T8ygY4&t=736s

Also note that the Australian Government did not allow ‘Free Speech’ on this topic on the YouTube platform by turning off comments.

The government’s ‘people’ are those in the Executive that being the Monarch, Governor General, the Parliament that being the MPs, lawmakers and the Judiciary that being the Courts and police.

The general population/serfs/plebs are not part of the government’s ‘people’.

MANY people may have problems in comprehending Ms. Bishops statement, where a simple analogy can be made substituting the word government for a 'favourite' company or international corporation, e.g:

“The first job of Google is to look after the safety of its people”

That means Google’s customers are not on the radar, or of zero significance in relation to the policy.

So what could be the second job of those in government, or even a highly prioritised agenda?

To rort the tax pool to the maximum without any consequences?

To give money for mates jobs in falsified tenders, irrespective of any legal action?

To implement actions that punish people, which have zero legal and lawful basis to exist therefore let alone to be enacted upon?

To commit criminal actions when in office with the intention to get away with them?

Or why not to enact pain and suffering or austerity on the general population to a predefined level that is just below then rioting.

That is what is happening to Australians at this point in time, where the Australian Government is responsible for the housing crisis, rental crisis, job crisis, and high inflation ‘crisis’ where all these actions are carried out to a level just below people having enough and rioting, just like in Sri Lanka.

The people in the Australian Government, must really hate the (mums & dads) tax payers, the very people that afford those in government to have an exorbitant tax rorting lifestyle even after they have left office.

Remembering, silence is acquiescence.