Artificial intelligence is like a cake, says Jensen Huang, the boss of
Nvidia, a chipmaker.
ai applications, such as chatbots, are at the top. The next layer down is software, like the large language models (
llms) on which chatbots run. Then comes hardware, the semiconductors needed to train the models. This spring
China’s ai firms are busy baking all of these layers. ByteDance, the company behind TikTok, has unveiled a slick new video-generation app. DeepSeek, a flashy startup, is due to release a powerful new
llm. And Huawei, China’s tech champion, will unveil a new
ai chip.
Though these firms keep China in the
ai race with America, they are not pushing it into the lead. But there is another layer of
Mr Huang’s cake that goes underneath all the others, and that is energy. Semiconductors require vast amounts of it to run the trillions of calculations behind the
ai models. And China’s electrical grid has far more cheap power than the West. This disparity is known as the electron gap. Can China use it to achieve
ai supremacy?
American companies seem spooked at the prospect. Sam Altman, the boss of OpenAI, has predicted the cost of ai will “eventually converge with the cost of energy”. In October his firm warned that China’s power advantage could “put us leadership [in ai] at risk”. The following month Mr Huang predicted that China “will win the ai race” for the same reason. In January Elon Musk, who owns xAI, another ai company, said that “based on current trends, China will far exceed the rest of the world in ai compute” because of its grid.
ai companies are increasingly worried about access to energy. They are building
ever bigger and more power-hungry data centres to support smarter models. Some are now at the gigawatt (
gw) scale: equivalent to the power capacity of a nuclear-power station. Global demand to power such data centres could surge to 68
gw by 2027 and 327
gw by 2030, say researchers at
rand, an American think-tank.
America’s ageing grid is already struggling to keep up. There is a huge backlog of data centres waiting to be connected. Firms are also wrestling with local opposition because data centres can push up power prices for residential users. Some are building off-grid generators. Others suggest ideas like building data centres in space rather than doing so in America. “Many ai projects are now constrained not by chip supply but by…whether enough reliable electricity can reach the building,” says one person at a semiconductor firm.
China has no such worries. Its power grid, the world’s largest, is still growing at a blistering pace thanks to massive state investment. It added over 500gw of capacity just last year, to reach a total capacity of 3,800gw, more than double that of America’s. Over the next five years China is set to add six times as much capacity as its rival. A bonanza of wind and solar projects is driving growth. And half of the world’s nuclear-power plants are also under construction in China, while the country is still building lots of coal-fired power. Chinese data centres can secure power for around three cents per kilowatt-hour, according to official figures, around half the rate many American ones pay. And because the government sets residential power prices separately, there is little risk of public opposition to power-hungry infrastructure.
Still, for all the panic about an electron gap, China is not yet exploiting it. A big reason is a shortage of chips. Since 2019 tightening American export restrictions have made it harder for Chinese firms to buy or build the advanced chips (those with feature sizes of seven nanometres [nm] or less) that power the latest models. Last year China’s tech firms were estimated to have spent $24bn on ai infrastructure, such as data centres; American ones spent over $350bn. Investments in data centres by China’s local governments have been mismanaged, leading to many getting built to low standards. Some reportedly have utilisation rates as low as 20%.
As a result, China’s computing infrastructure is far weaker than its energy abundance could allow. Take Yanggao, a dusty spot in the northern province of Shanxi. Local officials claim it has become a “computing county”. A giant data centre has sprung up on the site of a former pig farm. It enjoys cheap power from wind farms, solar panels and a coal-fired power station; a cold climate to aid cooling; and a river to supply water. State-run media have paraded it as part of an “ai wave” sweeping the province. But less than 0.1% of its chips are capable of the intense calculations needed to train ais, according to a manager there.
There are signs that China will soon start leveraging its energy advantage. On March 5th Li Qiang, the prime minister, mentioned “hyperscale computing” (ie, giant data centres) for the first time in his annual state-of-the-nation address, promising to “launch new infrastructure projects co-ordinating computing capacity and electricity supply” this year. Chinese hyperscalers, meanwhile, are ramping up investment. Ken Liu, an analyst at ubs, a bank, expects China to build another 25gw of ai data centres by 2029, having built just 5gw over the past two years.
A build-out at that speed, notes Mr Liu, will depend on China manufacturing many more high-end chips domestically. Years of efforts to that end are bearing fruit. Huawei’s homegrown 7nm ai chips are still less powerful than American offerings, but they can close the performance gap when lots are stacked together. That consumes more energy, but it matters less when electricity is cheap. This year China’s leading foundry, Semiconductor Manufacturing International Corporation, which makes most of Huawei’s 7nm chips, plans to double its capacity for making them. In March, Reuters news agency reported that Hua Hong, another Chinese foundry, was also starting to make 7nm chips.
Officials are encouraging data centres in the western provinces that have plenty of wind, solar and hydropower (and cooler average temperatures). By 2028, China hopes to connect all these data centres into a single pool that can provide cheap computing resources nationwide. Such efforts should allow China’s power advantage to more than make up for its weakness in chips by the late 2020s, reckons Lin Boqiang, of the China Institute for Energy Policy Studies at Xiamen University. “All we have to do is keep building,” he says.
At the moment, China’s leaders are mainly focused on ai deployment: trying to push ai tools into the broader economy to make it more productive. Officials are especially excited about applying ai to the physical world through such things as self-driving vehicles, robots and smart factories. Abundant energy, and hence cheaper ai models, should help as companies will be more likely to actually use them.
For American tech bosses like Mr Altman the electron gap is more worrying in relation to the idea of artificial general intelligence (agi), an ai that can surpass the cognitive abilities of humans. An agi might suck up far more power than even today’s cutting-edge ais. Might China be the one to eventually develop it? Until recently China’s leaders have seemed wary of the idea, seeing it as more of a risk than an opportunity. But in October Alibaba became the first big Chinese firm to announce it was pursuing agi. And in March China released its new five-year plan, for the period to 2030. It included a call to “explore development paths for agi”. ■
Subscribers can sign up to Drum Tower, our new weekly newsletter, to understand what the world makes of China—and what China makes of the world.