- US Fed Chair sees 'further disinflation' in economy
- Epic Games sues Google and Samsung over app store
- Officials see no shortages from likely US port strike
- UK families of Gaza hostages warn Lebanon attack 'takes focus away'
- Shares in Stellantis, Aston Martin skid on profit warnings
- Dali prints found in London garage sold at auction
- ECB chief backs bank mergers amid UniCredit, Commerzbank talk
- China stocks soar on stimulus, but US and Europe retreat
- 100 dead in storm Helene damage, flooding across US southeast
- China stocks soar on stimulus, Europe slides on automaker woes
- German antitrust watchdog steps up monitoring of Microsoft
- Nepal's urban poor count cost of 'nightmare' floods
- E.Guinea, Gabon clash at ICJ over oil-rich islands
- New blow for UK's Starmer as growth data disappoints
- China's top banks to tweak mortgage rates to boost housing market
- Muslim women break taboos navigating east London's waterways
- Nepal dam-building spree powers electric vehicle boom
- More than 60 dead from storm Helene as rescue, cleanup efforts grow
- Dozens missing, 9 dead in migrant boat wreck off Spanish Canaries
- Death toll from Hurricane John hits eight in Mexico
- Storm Helene's toll rises as rescue and cleanup efforts gain pace
- SpaceX launches mission to return stranded astronauts
- Storm Helene kills 44, threatens more 'catastrophic' flooding as cleanup begins
- SpaceX set to launch mission to return stranded astronauts
- Storm Helene kills 44, threatens more 'catastrophic' flooding
- Boeing strike grinds on as latest talks fail to reach agreement
- Iran 'news' sites, hackers target Trump ahead of US election
- US ports brace for potential dockworkers strike
- Japan's speedy, spotless Shinkansen bullet trains turn 60
- US hurricane deaths rise to 44, fears of more 'catastrophic' flooding
- Global stocks mostly rise, cheering Beijing stimulus
- Europe en route for Moon with new simulator, says astronaut Pesquet
- Fireworks forecast if comet survives risky Sun flypast
- Argentina judge orders dictionary to delete pejorative definition of 'Jewish'
- Global stocks rise on rate hopes, Beijing stimulus
- S.African woman turns 118, among the oldest in the world
- UK clears $4 bn AI partnership between Amazon, Anthropic
- Barca fans barred from Champions League away game over racist banner
- Chinese stocks extend surge, Europe higher on Beijing stimulus
- Pope says Church must 'seek forgiveness' for child sexual abuse
- China caps week of 'bazooka' stimulus for ailing economy with rate cut
- Cuts, cash, credit: China bids to jumpstart flagging economy
- France's debt weighs heavier ahead of budget debate
- Iran treads carefully, backing Hezbollah while avoiding war
- Return to sender: waste stranded at sea stirs toxic dispute
- 'Broken' news industry faces uncertain future
- On remote Greek island, migratory birds offer climate clues
- Taken from mother by nuns, victim seeks answers as pope visits Belgium
- China cuts amount banks hold in reserve to boost lending
- Hong Kong, Shanghai extend surge as China optimism boosts markets
RBGPF | 7.18% | 64.75 | $ | |
CMSC | -0.13% | 24.74 | $ | |
RYCEF | -0.14% | 7.03 | $ | |
CMSD | -0.72% | 24.9 | $ | |
SCS | 1.28% | 13.32 | $ | |
NGG | -0.1% | 69.66 | $ | |
GSK | 0.11% | 40.755 | $ | |
BCC | -1.23% | 139.775 | $ | |
RIO | -0.09% | 71.165 | $ | |
VOD | -0.85% | 10.005 | $ | |
JRI | 0.66% | 13.67 | $ | |
RELX | -0.38% | 47.38 | $ | |
AZN | 0.23% | 77.8 | $ | |
BCE | -1.19% | 34.775 | $ | |
BP | -0.11% | 31.385 | $ | |
BTI | -0.89% | 36.515 | $ |
AI chip crunch: startups vie for Nvidia's vital component
The artificial intelligence revolution is fully underway, but soaring demand for its most crucial component has startups scratching their heads on how they can deliver on AI's promise.
Generative AI's lifeblood is a book-sized semiconductor known as the graphics processing unit (GPU) -- built by one company, Nvidia.
Nvidia's CEO and founder Jensen Huang made a wild bet years ago that the world would soon clamor for a powerful chip usually used for making video games, but that could build AI as well.
No company working with the generative AI models that fuel today's frenzy can get off the ground without Nvidia's singular product: the latest model is the H100 and its accompanying software.
That painful reality is one that Amazon, Intel, AMD and others are scrambling to fix with their own alternatives, but those attempts could take years.
- 'Not a lot of GPUs' -
And with the biggest tech companies throwing all their financial might into generative AI, the smaller fish must go on the hunt to secure Nvidia’s holy grail.
"Around the world, it is becoming very hard to get thousands of GPUs because all these big companies are putting in billions of dollars, stockpiling GPUs," said Fangbo Tao, co-founder of Mindverse.AI, a Singapore-based startup.
"There's not a lot of GPUs around," he said.
Tao spoke to AFP at the TechCrunch Disrupt conference in San Francisco, where AI startups jostled to make their pitches to Silicon Valley's venture capitalists (VC).
ChatGPT took the world by storm just as Silicon Valley was caught in a nasty hangover from the pandemic when investors threw money at startups, convinced that life had gone irreversibly online.
That turned out to be far-fetched, and the US tech scene entered a downturn with rounds of layoffs and VC money dried up.
Thanks to AI, some of the old mojo is back, and anyone with those two letters on their resume will likely see a red carpet rolled out on the legendary Sand Hill Road, home to Silicon Valley’s most storied investors.
But as the startups walk away with their VC cash, the money in their pockets will be quickly forked out to Nvidia for GPUs either directly or through providers to bring their AI dreams to execution.
"We call on a lot of the big cloud providers (Microsoft, AWS and Google) ), and they all tell us even they are having trouble getting supplies," said Laurent Daudet, CEO of AI startup LightOn.
The problem is most acute for companies involved in training generative AI models, which requires that power hungry GPUs work at peak capacity to process troves of data ingested from the internet.
The computing needs are so massive that only a few companies can stump up the cash to build one of these state-of-the-art large language models.
- 'Sucking the oxygen' -
The ten billion dollars investment by Microsoft into OpenAI is widely understood to be paid out as credits to access purpose-built data centers humming with Nvidia GPUs.
Google has built its own models and now Amazon on Monday said it was pumping four billion dollars into Anthropic AI, another company that trains AI.
Training on that mountain of data "is sucking out almost all the oxygen from the GPU market right now," said Said Ouissal, CEO of Zededa, a company that works on making AI less power hungry.
"You're looking at mid-next year, maybe late next year before you're actually going to get delivery on new orders. The shortage doesn't seem to be letting up," added Wes Cummins, CEO Applied Digital, a company that supplies AI infrastructure.
Companies on the AI frontlines also point out that Nvidia’s primordial role makes it the de-facto kingmaker on where the technology is going.
The market is "almost entirely driven by the big players -- Googles, Amazons, Metas" that have the "enormous amounts of data and enormous amounts of capital," former Nvidia engineer Jacopo Pantaleoni told The Information.
"This was not the world I wanted to help build," he said.
Some veterans of Silicon Valley said that the frenzied days of Nvidia GPUs will not last forever and that other options will inevitably emerge.
Or the cost of entry will prove too high, even for the giants, bringing the current boom down to earth.
Ch.Lefebvre--CPN