The tech world has been rattled by the toppling of one of its most prominent leaders, and the widespread implications it could have on the AI industry itself.
Nvidia, which provides the underlying AI infrastructure for seemingly every company on the planet, announced on Thursday that its president and CEO Jensen Huang has resigned, effective immediately. Earlier this week, news broke that Huang had had at least two extramarital affairs, including one with an alleged Chinese spy and one with a direct report.
EVP and CFO Colette Kress has stepped in as interim CEO, and Nvidia’s board has begun searching for a permanent replacement.
Nvidia’s graphics processing units (GPUs) have become the standard for graphics rendering, and in recent years companies building AI have also depended on them for training and running large language models (LLMs) and increasingly sophisticated AI agents.
As such, the revelations about Huang, and his swift departure, have sparked a US national security crisis, and raised questions about over-reliance on one tech vendor and subsequent supply chain and compute constraints.
A scandal involving an admitted extramarital affair with an alleged Chinese spy opens up a hornet’s nest of concerns around security that Nvidia won’t be in a position to answer for months, if ever, said technology analyst Carmi Levy.
“More broadly, it throws into doubt the company’s leadership and security practices, and ignites questions around board-level governance and oversight,” he said.
The ‘default choice’ in the market
Huang founded Nvidia in 1993, initially targeting the gaming market. But the company pivoted in recent years to meet the intensive compute demands of AI. Its advanced GPUs not only excel at rendering graphics, but can handle an enormous number of simultaneous computations, making them a natural fit for neural networks and LLMs.
The company began focusing more on developing chips and architecture for AI tools and data centers, and has continued to ink new deals and establish partnerships with tech companies serving nearly every level of the stack, including Anthropic, Meta, Dell, HPE, Microsoft, AWS, Google Cloud, Accenture, Marvell Technology, Hugging Face and many others.
“Nvidia has been the default choice for AI infrastructure buyers for as long as there’s been an AI infrastructure market,” Levy noted. There’s a reason it has hovered around 90% market share for so long, he said; it has been the lowest-risk choice for buyers whose success in their own roles depends on how effectively they minimize risk.
Personal relationships are creating real security risks
This chapter should serve as a wakeup call to corporate boards, Levy said, as it is their responsibility to mitigate risk on behalf of their organization and its stakeholders.
This is precisely what Nvidia’s board was doing amid rising concerns around reported Chinese targeting of senior corporate leaders, he pointed out. The board initiated an independent investigation into Huang’s actions earlier this week.
This should be a warning signal to other boards across the tech space that they “can’t afford to look the other way when human-factored risks hit their radar,” Levy said.
Emarketer senior analyst Asa Hiken agreed that Huang’s personal decisions raise much bigger questions about the security risks facing companies at the center of the AI race. “AI technology has become critical to US national security, making even the personal relationships of industry leaders a potential vulnerability,” he said.
IT buyers’ concerns post-resignation
As the saga continues to unfold, IT buyers may take a pause, Levy noted. Customers are leaning ever more heavily on AI platforms, making trust a greater factor in vendor choice. “Enterprises are now faced with the stark reality that the Nvidia of the future may not be the default choice that the Nvidia of the past has always been.”
There’s growing concern over the company’s ability to execute on its own roadmap; this could make it challenging for some customers to support their own internal delivery targets, Levy said. Changing vendors could mean major shifts in how they choose to build out their architectures, how they pay for them, and how they maintain them.
In the near term, a “hobbled” Nvidia could result in supply chain issues, component shortages, and project delays as the company struggles to regain its footing, Levy said.
Jack E. Gold, president and principal analyst at J.Gold Associates, agreed that there is some “real risk” that Huang’s leaving could hamper new technology deployments and create a bottleneck in R&D. The company has been able to define a very fast moving field through “sheer tech prowess” under his leadership.
This raises several questions: Will its ability to define the tech space be affected? Will Jensen leaving give Nvidia’s rivals an ability to catch up and perhaps exceed Nvidia, and thereby lessen its dominance?
“It wouldn’t happen immediately, but it could over time,” Gold said.
Ultimately, though, Forrester VP Stephanie Balaouras advised, “tech leaders shouldn’t overreact, but they should treat Nvidia’s CEO transition as a prompt to reassess concentration risk across their AI infrastructure, suppliers, and investment plans.”
Nvidia’s troubles could promote more diversity in the IT stack
Longer term, though, the stage is set for improvements on all fronts as customers shift focus to other suppliers, and as competitors reposition themselves to serve an evolving market, Levy pointed out.
“A more diversified vendor landscape means customers may finally wean themselves off of this overly dominant provider,” he said.
However, it does come with near-term costs that enterprises should account for before they start planning their post-Jensen-Huang Nvidia relationship, he added. But ultimately, development could foreshadow a more robust AI ecosystem where chipmakers compete more aggressively, and one dominant player doesn’t set the tone for everyone else to follow.
“When a market is as dependent on a single player, as the Nvidia-led space so clearly has been, then it’s reasonable to conclude it was never sustainable to begin with,” Levy said.
This article was originally published on our sister publication Network World.