))
Episode 8 - Moore's Law, Exponential Improvements, AI Chips, Emergent Behavior
Manage episode 407381688 series 3560533
תוכן מסופק על ידי Jeff Hwang and Seymour Duncker. כל תוכן הפודקאסטים כולל פרקים, גרפיקה ותיאורי פודקאסטים מועלים ומסופקים ישירות על ידי Jeff Hwang and Seymour Duncker או שותף פלטפורמת הפודקאסט שלהם. אם אתה מאמין שמישהו משתמש ביצירה שלך המוגנת בזכויות יוצרים ללא רשותך, אתה יכול לעקוב אחר התהליך המתואר כאן https://he.player.fm/legal.
The news that Gordon Moore passed away broke last Friday just as we were recording the previous episode. Today, Jeff and Seymour discuss Moore's legacy, the past and future of Moore's Law, and how advancements in microchips have been the foundation of deep learning for more than a decade. Links:
- NY Times obituary for Gordon Moore and a remembrance by Walden Kirsch at Intel.
- Apple's latest iPhone has an A16 Bionic system-on-a-chip with 16 billion transistors, compared to 1993's then ground-breaking Intel Pentium which had 3 million transistors.
- Articles on Moore's Law and Dennard Scaling
- Excellent piece by The Computer History Museum in Mountain View, CA.
- 2018 piece by Micron on Moore's Law and Dennard Scaling (aka MOSFET scaling).
- 2007 piece in IEEE on 30 years of Dennard/MOSFET scaling (PDF).
- Types of chips
- AI Accelerators and Deep Learning Processors (DLP).
- CPUs, FPGAs, and ASICs.
- Google's Tensor Processing Units (TPUs).
- Accleration of AI progress above Moore's Law
- Seymour refers to the chart in this 2021 IEEE Spectrum article.
- 2022 article in Discover magazine by the Physics arXiv Blog.
Send questions/comments to stepfunctionpod@gmail.com and find us on the web at www.stepfunction.org.
19 פרקים
שתפו
