Podcast —19 November, 2026

Data & Dimensions | Ep. 22 - NVIDIA Wants You to Generate Your Own Tokens

In this episode of Data & Dimensions, host Neil Barbour speaks with Justin Walker, Senior Director of Product Management at NVIDIA, about RTX Spark, NVIDIA’s push to bring powerful agentic AI directly onto the PC. Walker explains how systems built around RTX Spark combine Blackwell-based GPU compute, large pools of memory and local AI models to let users run agents directly on their own hardware.

Key takeaways

  • The AI PC could change how people interact with software. NVIDIA’s vision is for users to increasingly tell an agent what they want accomplished rather than open, learn and operate each application themselves. Walker argues that the "killer app" is therefore less a particular piece of software than this agentic way of interacting with the PC.

  • Local and cloud AI are complementary rather than competing models. RTX Spark is designed to run capable models locally, while NVIDIA’s NeMo Switchyard can route requests to more powerful cloud models when needed. That creates a hybrid model in which routine work can remain on-device while particularly demanding tasks tap frontier AI in the cloud. 

  • NVIDIA sees unlimited local inference as part of the economic case. Walker compares generating tokens locally to generating electricity with solar panels: Once the marginal cost of using the resource falls, people may find more reasons to use it. NVIDIA’s own heavy-use test generated what it calculated as roughly $1,200 worth of cloud-equivalent tokens in a month using about $20 of electricity, although the value proposition looks very different for lighter AI users.

  • Gaming provides NVIDIA with a precedent for getting consumers comfortable with local AI. Walker points to DLSS, introduced in 2018, as an early mass-market application of local AI and says roughly 90% of NVIDIA gamers now use it. NVIDIA’s bet is that agentic AI can follow a similar path if consumers see it making their PCs more useful while preserving the gaming and creative capabilities they already expect from RTX hardware.

Credits:

  • Host: Neil Barbour, Industry Analyst TMT, S&P Global Market Intelligence Kagan
  • Guest: Justin Walker, Senior Director of Product Management at NVIDIA
  • Produced & Edited By: Neil Barbour, Carl Schmidt, Neri Reyes
  • Published With Assistance From: Feranmi Adeoshun, Patrick Moroney, Barb Dalumpines

Learn more about Market Intelligence