Why Nvidia Isn’t the Only Success Story of the AI Revolution

Nvidia’s market value jumped $207 billion (roughly Rs. 17 lakh crore) in the two days after the US chip designer on May 24 gave an amazingly good revenue outlook following a season of bad news for the semiconductor industry. Yet there’s a handful of other technology companies that may benefit even more from the race to embrace artificial intelligence.

There are numerous ways to put this forecast and subsequent reaction into context. The sales figure is 53 percent more than analysts had expected, and 33 percent higher than the company’s previous record achieved in March last year. The first-day pop was the third-largest gain in US history, while the two-day gain eclipsed the market cap of all but 48 stocks across the globe.

Among those companies dwarfed by the $200 billion jump in Nvidia’s value are two of the most-important enablers of the AI revolution. Between them, Korea’s SK Hynix and Boise-based Micron Technology command 52 percent of the global market for dynamic random-access memory. Combined, they’re worth just $140 billion (roughly Rs. 11 lakh crore). Their only rival, Samsung Electronics, accounts for 43 percent of the DRAM industry — just one of at least four global sectors it leads — while it trades at $317 billion (roughly Rs. 26 lakh crore).

If the generative AI sector is going to take off, as Nvidia and its clients believe, then established giants like Microsoft and newcomers such as OpenAI are set to pound on the doors of Samsung, SK Hynix and Micron.

Machines that crunch reams of data, analyse patterns in video, audio and text, and spit out replicas of human-created content are going to need memory chips. In fact, AI companies are likely to buy up more DRAM than any other slice of the technology sector in history.

The reason for this demand for memory chips is quite straightforward: Nvidia’s AI chips differ from standard processors by inhaling huge amounts of data in a single gulp, crunching numbers in one go, then spitting out the results all at once. But for this power advantage to be realized, they need the information to be fed into the computer quickly and without delay. That’s where memory chips come in.

Processors don’t read data directly from a hard drive — that’s too slow and inefficient. The first choice is to keep it in temporary storage within the chip itself. But there’s not enough room to hold much here — chipmakers prefer to devote this precious real estate to number-crunching functions. So, the second-best option is to use DRAM.

When you’re processing billions of pieces of information in a single go you need that data close at hand and delivered quickly. A lack of adequate DRAM in a system will slow down a computer significantly, neutralizing the value of spending $10,000 (roughly Rs. 8.2 lakh) on the best processors to run sophisticated chatbots. Which means that for every high-end AI processor bought, as much as 1 Terabyte of DRAM may be installed — that’s 30-times more than a high-end laptop.

Such hunger for memory means that DRAM sold for use in servers is set to outpace that installed in smartphones sometime this year, according to Taipei-based researcher TrendForce.

These systems also need to be able to save large amounts of their output nearby so that it can be read and written quickly. That’s done on NAND Flash, the same chips used in smartphones and most modern laptops. Samsung is the global leader in this space, followed by Japan’s Kioxia Holdings Corp. (a spinoff from Toshiba Corp.) and SK Hynix.

Together, DRAM and NAND accounted for $8.9 billion (roughly Rs. 73,000 crore) of revenue at Samsung last quarter, far outpacing the $4.3 billion (roughly Rs. 35,000 crore) Nvidia got from its data-center business that includes products used for AI. To put that in context, though, this was the worst performance for Samsung’s memory division in seven years, and its AI-related memory sales are only a fraction of total revenue.

Both figures are set to grow. For every high-end AI chip sold to customers, another dozen DRAM chips will be shipped, and that means more revenue for Samsung, SK Hynix and Micron. As Nvidia grows, so too will these three companies that collectively control 95 percent of the DRAM market.

There’s no doubt the AI revolution is here, with makers of cool chatbots, ubiquitous search engines and high-powered processors among the biggest winners. But those churning out boring old memory chips won’t be left out either.

© 2023 Bloomberg LP