China's Bold New Strategy to Break Free from Nvidia's CUDA Grip: Software-Defined Chips

In a surprising shift that could reshape the global AI chip landscape, China is abandoning the idea of copying Nvidia's famous CUDA software. Instead, a top semiconductor expert has proposed a completely different path forward.

The plan is called software-defined chips, a concept that flips traditional chip design on its head. Rather than building hardware first and then writing software to fit, this approach lets the software dynamically reconfigure the chip's hardware on the fly.

The Problem: Nvidia's Impossible Moat

To understand why China is looking for a new path, you first need to understand Nvidia's strength. Nvidia CEO Jensen Huang has repeatedly described CUDA as the company's strongest moat. But what exactly is CUDA?

Simply put, CUDA is Nvidia's software ecosystem. It is the toolset that millions of AI developers around the world use to write programs that run on Nvidia chips. Because developers are so comfortable with CUDA, they naturally stick with Nvidia hardware.

This creates a powerful lock-in effect. According to Wei Shaojun, an executive at the China Semiconductor Industry Association, the global AI industry has become deeply tied to Nvidia's GPGPU architecture and CUDA ecosystem, creating what he calls a model-architecture-ecosystem triple dependency. China sees this as a major vulnerability. If access to Nvidia technology is restricted, the country's entire AI industry could be at risk.

The Traditional Approach: Why Copying CUDA Won't Work

The obvious solution would be for China to build its own version of CUDA, creating a competing software ecosystem that developers can switch to. But Wei Shaojun has a different view. He believes that building translation layers and separate ecosystems to replicate CUDA's success would require massive resources, and even then, success is not guaranteed.

"If we just follow existing chip architectures, we will likely only trail behind others and struggle to catch up," Wei warned during the SEMICON CHINA 2026 Global Semiconductor Industry Strategy Summit. He argues that the AI chip industry needs disruptive thinking, not imitation.

The Bold Alternative: Software-Defined Chips (SDCs)

Wei Shaojun has proposed shifting focus toward software-defined chips.

In an SDC system, developers do not need a CUDA-like layer to run their workloads. Instead, the chips use a flexible grid that gets configured through instructions generated by a compiler. In traditional GPUs, a hardware scheduler decides what to do next. In SDCs, the compiler plans every single data movement down to the exact clock cycle. This is called deterministic compilation.

The Strategic Advantage

The beauty of this approach is that it does not rely on advanced manufacturing processes. While China faces restrictions on accessing the most sophisticated chip-making equipment, SDCs offer a path forward through architectural innovation rather than relying solely on smaller transistor sizes. Wei Shaojun emphasizes that this could help China build an independent computing system despite limitations on advanced process nodes.

The Challenges: Why This Is Not Easy

Wei Shaojun is honest about the difficulties. The SDC approach comes with significant trade-offs.

• Complex Compiler Requirements: The compiler becomes the brain of the entire operation. It must perfectly schedule every instruction, every data movement, and every timing decision. This is an enormous engineering challenge.
• Routing and Branching Issues: Unlike traditional chips with predictable paths, SDCs must handle complex routing of data. Ensuring that everything arrives at the right place at the right time is difficult.
• Structural Changes: SDCs require completely rethinking how chips are designed. This means new tools, new testing methods, and new manufacturing approaches.
• Workload Limitations: Current SDC solutions like SambaNova and Groq are designed for specific workloads, primarily AI inference. They are not yet direct replacements for GPUs in all scenarios.

What This Means for the Future

For Nvidia

Nvidia's CUDA moat has seemed unassailable for years. But if China successfully develops software-defined chips that do not need CUDA, it could create a parallel AI ecosystem that operates entirely independently of Western technology.

For Global AI Development

If the SDC approach proves successful, it could lead to more diverse AI hardware options. Developers might no longer be locked into a single vendor's ecosystem.

For China

Success here would mean reduced vulnerability to US export restrictions, an independent AI computing infrastructure, and potential leadership in next-generation chip architecture.

Wei Shaojun's Final Warning

Wei Shaojun closed his remarks with a powerful statement about China's approach to this challenge:

"Even if our own technology is not good enough at the start, it must still be used. Trial and error may not succeed, but without trying, we will certainly fall behind."

He added: "The maturity of technology requires real-world application scenarios to refine it, and the cultivation of an ecosystem requires the accumulation of time. This race tests not only technical strength but also strategic determination."

Frequently Asked Questions

Key Takeaways Summary

The Bottom Line

China is not trying to beat Nvidia at its own game. Instead, it is trying to change the game entirely. By focusing on software-defined chips that can be reconfigured dynamically, Chinese researchers hope to bypass the CUDA lock-in that has kept the AI industry tied to Nvidia for years.

The challenges are enormous. The compiler technology required is incredibly complex. But as Wei Shaojun argues, the alternative of simply accepting dependence on Western technology is worse.

Whether this bold strategy will succeed remains to be seen. But one thing is certain: the global AI chip race just got a lot more interesting.