While AI may be in a hyper-bubble right now, transformers are still a fundamentally novel and useful technology. This idea that you can statistically model everything from language to music to images and videos, just by throwing sample data and compute at it, is a pretty fundamental shift in how the world deals with information aggregation and conversion. There’s no going back from that new reality; even if it’s not the final step in AI (and nobody thinks it is), it is still a major leap forward.
Even if all of today’s AI companies go bankrupt, this architecture isn’t going to disappear overnight. It’s already too useful for things like transcriptions, translations, images, ideation, etc. Truthiness is still a hurdle, but there are many outlets and fields where that isn’t essential (sigh, ads and marketing for one). Transformers will keep evolving, and other data-dependent architectures will be experimented with.
This is like the “steam engine” of our times; even if a few early “railroad barons” don’t end up making it over the long term, the digital “industrialization” will still continue.
And since what Nvidia ultimately sells isn’t packaged AI anyway (unlike OpenAI and its competitors) but hardware for parallel computing — the shovels — they will keep making money as long as some process still requires a lot of compute. A decade ago that was video games, then crypto, now AI, and (according to Nvidia), robotics next.
There aren’t that many major GPU companies in the world to begin with. There’s Nvidia, AMD, Intel (up and coming or past its prime, depending on who you ask), Apple… maybe Qualcomm and Samsung and Google and Amazon, at smaller scales. Any time an industry needs a lot of parallel compute, it’s up to one of those companies to provide it. And at scale, in data centers, it’s overwhelmingly Nvidia except for the few FAANGs that can afford to experiment with their own in-house chips. Everybody else buys Nvidia or rents Nvidia.
No doubt their stock will drop quite a lot if the AI bubble goes bust — and I don’t see how the AI bubble could not bust — but Nvidia existed long before that bubble and will hopefully exist after it. They’re just an impressive hardware company with good sustained leadership over decades; that’s really quite different from your average hype-of-the-day techbro startup. Their valuation may be nuts right now, but their product is a fundamentally sound (and essential) infrastructural part of modern life.