
Jensen Huang: NVIDIA - The $4 Trillion Company & the AI Revolution | Lex Fridman Podcast #494
Jensen Huang discusses NVIDIA's extreme co-design approach and rack-scale engineering that powers the AI computing revolution
In this wide-ranging conversation with legendary computer scientist Brian Kernighan, Lex explores the foundational technologies and ideas that shaped modern computing. Kernighan begins by recounting the early days of UNIX development at Bell Labs, providing vivid details about the collaborative environment and the practical problems the team was trying to solve. He emphasizes how UNIX emerged not from grand master plans but from solving real problems with elegance and simplicity.
The discussion then turns to UNIX philosophy itself, exploring principles like keeping tools simple, composability, and building systems that do one thing well. Kernighan reflects on how these principles have proven remarkably durable across decades of computing evolution. When asked whether programming is art or science, Kernighan suggests it contains elements of both, requiring creativity and expression alongside rigorous logical thinking.
A significant portion of the episode focuses on programming languages. Kernighan discusses AWK, the text processing language he co-created, explaining its surprising longevity and continued relevance in a world of more modern languages. He then discusses the evolution toward C, detailing the process of designing and writing the famous C Programming Language book with Dennis Ritchie. More recently, he reflects on Go, a language designed with modern concerns in mind while maintaining philosophical connections to earlier systems languages.
Kernighan provides practical advice about learning new programming languages, emphasizing that understanding underlying concepts matters more than memorizing syntax. He expresses measured skepticism about JavaScript's complexity while acknowledging the practical necessity of its dominance in web development.
The conversation shifts to AMPL, an algebraic modeling language for large-scale optimization problems. Kernighan explains how AMPL allows mathematicians and engineers to express complex optimization problems in readable form, separating the problem specification from the solver algorithms. He also discusses graph theory and its applications across diverse fields.
When the topic turns to artificial intelligence, Kernighan reflects on the state of AI research in 1964 and how the field has evolved dramatically since then. He offers thoughtful perspectives on the future of AI, expressing both optimism about its potential benefits and some caution about trajectory and implications. The discussion includes reflections on Moore's law and whether it can continue indefinitely.
Toward the end, the conversation broadens to consider how computers have become deeply embedded in modern life and society. Kernighan reflects on the broader implications of technological change and offers philosophical observations about learning, growth, and living a meaningful life. Throughout the episode, his experience spanning from UNIX origins through contemporary programming paradigms provides historical context and practical wisdom about how to think about computing and technology.
“The UNIX philosophy was about solving real problems with simplicity and elegance”
“Programming is both an art and a science, requiring creativity alongside logical rigor”
“The best tools are those that do one thing well and work together”
“Understanding concepts matters far more than memorizing programming language syntax”
“We built these systems to solve problems we were actually facing, not to create grand designs”