881: Beyond GPUs: The Power of Custom AI Accelerators, with Emily Webber

Super Data Science: ML & AI Podcast with Jon Krohn

תוכן מסופק על ידי Jon Krohn. כל תוכן הפודקאסטים כולל פרקים, גרפיקה ותיאורי פודקאסטים מועלים ומסופקים ישירות על ידי Jon Krohn או שותף פלטפורמת הפודקאסט שלהם. אם אתה מאמין שמישהו משתמש ביצירה שלך המוגנת בזכויות יוצרים ללא רשותך, אתה יכול לעקוב אחר התהליך המתואר כאן https://he.player.fm/legal.

2M ago 1:17:06

MP3•בית הפרקים

Additional materials: www.superdatascience.com/881

This episode is brought to you by ODSC, the Open Data Science Conference.

Interested in sponsoring a SuperDataScience Podcast episode? Email natalie@superdatascience.com for sponsorship information.

In this episode you will learn:

(08:36) Emily’s work on AWS’ SageMaker and Trainium
(23:54) How AWS Neuron lets builders tailor their approach to using frameworks
(29:07) Why using an accelerator is better than using a GPU
(35:29) The key differences between AWS Trainium and AWS Trainium2
(52:45) How to select between AWS Trainium and AWS Trainium2

1203 פרקים

#Data Science #Science #Tech #Software Development #Jon Krohn

881: Beyond GPUs: The Power of Custom AI Accelerators, with Emily Webber

Super Data Science: ML & AI Podcast with Jon Krohn

1,118 subscribers

published 2M ago

שתפו

MP3•בית הפרקים

Additional materials: www.superdatascience.com/881

This episode is brought to you by ODSC, the Open Data Science Conference.

Interested in sponsoring a SuperDataScience Podcast episode? Email natalie@superdatascience.com for sponsorship information.

In this episode you will learn:

(08:36) Emily’s work on AWS’ SageMaker and Trainium
(23:54) How AWS Neuron lets builders tailor their approach to using frameworks
(29:07) Why using an accelerator is better than using a GPU
(35:29) The key differences between AWS Trainium and AWS Trainium2
(52:45) How to select between AWS Trainium and AWS Trainium2

1203 פרקים

#Data Science #Science #Tech #Software Development #Jon Krohn

כל הפרקים

1
894: In Case You Missed It in May 2025 29:32

לפני יומיים29:32

29:32

In this episode of “In Case You Missed It”, Jon Krohn takes clips from interviews with guests in May 2025. From AI agent integration and RAG-based chatbots to education through virtual reality headsets and data harmonization, this episode explores how industry leaders are developing the tools and technologies that can improve operations, education, healthcare, and marketing. Highlight clips are with John Roese, Global Chief Technology Officer and Chief AI Officer at Dell Technologies (Episode 887), Senior Developer Relations Engineer at Posit, PBC Jeroen Janssens and Lead Data Scientist at Xomnia Thijs Nieuwdorp (Episode 885), Founder of CEEK Mary Spio (Episode 889), and Martin Brunthaler, Co-founder and Chief Technology Officer at Adverity (Episode 891). Additional materials: ⁠ ⁠www.superdatascience.com/894⁠⁠ Interested in sponsoring a SuperDataScience Podcast episode? Email natalie@superdatascience.com for sponsorship information.…

1
893: How to Jumpstart Your Data Career (by Applying Like a Scientist), with Avery Smith 1:17:51

לפני 5 ימים1:17:51

1:17:51

Avery Smith is a passionate and motivational YouTuber and careers educator for data science. In this episode, Jon Krohn asks Avery about the tools and tricks he has learned from personal experience and from his students in how to get ahead in the tech industry. Avery shares the “learning ladder” he uses to help newcomers start on the right foot with great examples from former bootcamp students who have put his theories into practice. And, if you’re using LinkedIn to find jobs, Avery explains why this might be one of the reasons you’re not getting work. Additional materials: ⁠ www.superdatascience.com/893 This episode is brought to you by Adverity, the conversational analytics platform and by the Dell AI Factory with NVIDIA Interested in sponsoring a SuperDataScience Podcast episode? Email natalie@superdatascience.com for sponsorship information. In this episode you will learn: (04:02) How to take the jump into a data science career (15:19) Avery’s recommended strategy for starting a career in data science (18:10) Recommendations for people learning data science with LLMs (32:52) What should go into a data science portfolio (46:07) Why Avery prefers practice over theory in teaching data science (48:25) The bare minimum to get your first job in data science…

1
892: We’re In The AI “Trough of Disillusionment” (and that’s Great!) 12:24

לפני 9 ימים12:24

12:24

Businesses have entered a “trough of disillusionment” for AI. In this Five-Minute Friday, Jon Krohn learns why Fortune 500 execs are so frustrated with the tools and how they can work their way up the “slope of enlightenment” towards effective AI. Hear why AI takeup hasn’t so far gone to plan in the corporate world and what that world needs from AI to encourage greater business engagement. Additional materials: ⁠ ⁠⁠www.superdatascience.com/892⁠⁠⁠ Interested in sponsoring a SuperDataScience Podcast episode? Email natalie@superdatascience.com for sponsorship information.…

1
891: Conversational AI is Overhauling Data Analytics, with Martin Brunthaler 1:02:08

לפני 12 ימים1:02:08

1:02:08

Martin Brunthaler talks to Jon Krohn about founding Adverity, a data analytics platform for marketing that simplifies integrating data from multiple sources and crunching them into actionable insights. Learn how Adverity became a data analytics powerhouse serving multiple industries, and why Martin thinks AI will strengthen rather than diminish the job market for data scientists, data analysts, and machine learning engineers. Additional materials: www.superdatascience.com/891 Today’s episode is brought to you by Trainium2, the latest AI chip from AWS and by the Dell AI Factory with NVIDIA Interested in sponsoring a SuperDataScience Podcast episode? Email natalie@superdatascience.com for sponsorship information. In this episode you will learn: (03:52) How Martin co-founded Adverity (14:26) The features of Adverity (39:24) If data analysts, data scientists, and ML engineers should worry about Adverity making their job redundant (48:29) Martin’s predictions for the future for data analysts and data scientists (51:39) Martin’s tips for success as a CTO…

1
890: The “State of AI” Report 2025 6:44

לפני 16 ימים6:44

6:44

In this week’s Five-Minute Friday, Jon Krohn reveals highlights from Stanford University’s AI Index Report. Released a few weeks ago by the Institute for Human-Centered AI, this annual report details the incredible technical advances, policies, and investments in artificial intelligence. Hear which models achieve the best performance relative to their size, in what scenarios top AI systems can outperform humans (and when humans still outperform AI), and more in Jon’s five key takeaways. Additional materials: ⁠ ⁠www.superdatascience.com/890⁠⁠ Interested in sponsoring a SuperDataScience Podcast episode? Email natalie@superdatascience.com for sponsorship information.…

1
889: AI-Powered Virtual Reality: The Future of Education and Entertainment, with Mary Spio 1:06:59

לפני 19 ימים1:06:59

1:06:59

Founder of CEEK’s Mary Spio talks to Jon Krohn about how the platform contributes to the emerging community of digital creators with its blockchain-powered virtual experiences. Hear how Mary got her first investors for CEEK and how it is used across industries as diverse as education, entertainment, aviation, and healthcare. Additional materials: ⁠⁠ ⁠www.superdatascience.com/889⁠ This episode is brought to you by ⁠⁠ Adverity, the conversational analytics platform ⁠⁠ and by the ⁠⁠ Dell AI Factory with NVIDIA ⁠⁠ . Interested in sponsoring a SuperDataScience Podcast episode? Email natalie@superdatascience.com for sponsorship information. In this episode you will learn: (03:42) What CEEK is and the multiple industries it serves (38:47) How Mary developed VR headsets to reduce nausea experienced by women headset users (42:10) The growing potential for immersive experiences (44:36) How to mitigate the risks of immersive-experience misuse (51:56) Mary’s tips for career success…

1
888: Teams of Agents: The Next Frontier in AI Collaboration, with Mike Pell 31:32

לפני 23 ימים31:32

31:32

Mike Pell speaks to Jon Krohn about The Microsoft Garage, a program that drives the culture of innovation at the tech multinational, and how listeners can apply their principles to foster innovation in their workplace. In this Five-Minute Friday, you’ll hear more about Microsoft’s approaches to agentic AI, the future of human-AI collaboration in the workplace, and why experimentation and curiosity are critical skills for the future of work. Additional materials: ⁠www.superdatascience.com/888⁠ Interested in sponsoring a SuperDataScience Podcast episode? Email natalie@superdatascience.com for sponsorship information.…

1
887: Multi-Agent Teams, Quantum Computing and the Future of Work, with Dell’s Global CTO John Roese 1:02:04

לפני 26 ימים1:02:04

1:02:04

Jon Krohn speaks to John Roese about the promise of multi-agent teams for business, the benefits of agentic AI systems that can identify and complete tasks independently, and how these systems demand new authentication, authorization, security and knowledge-sharing standards. They also discuss how to use AI to refine project ideas down to a core business need, as well as the new and emerging careers in the tech industry and beyond, all thanks to AI. Additional materials: ⁠⁠ www.superdatascience.com/887 This episode is brought to you by ⁠ Adverity, the conversational analytics platform ⁠ and by the ⁠ Dell AI Factory with NVIDIA ⁠ . Interested in sponsoring a SuperDataScience Podcast episode? Email natalie@superdatascience.com for sponsorship information. In this episode you will learn: (03:54) Why ROI is the most important aspect of an AI-driven project (14:06) Why high-impact AI projects trigger a flywheel of success (23:32) The future of agentic systems (30:28) How to manage agentic systems at scale (46:36) The disruptive nature of quantum computing…

1
886: In Case You Missed it In April 2025 35:49

לפני 30 ימים35:49

35:49

Our In Case You Missed It episode for April has clips on NVIDIA’s and Dell’s product and service offers including an overview of NVIDIA’s GPUs, AI Enterprise, and its microservices. You’ll also hear about AWS’ focus on bringing choice to customers and the incredible power of its Graviton CPU, how Zerve opens access to AI deployment, Merck KGaA, Darmstadt, Germany’s multi-chip integration, and why reliance on the cloud might soon become a practice of times past. Additional materials: ⁠ www.superdatascience.com/886⁠ Interested in sponsoring a SuperDataScience Podcast episode? Email natalie@superdatascience.com for sponsorship information.…

1
885: Python Polars: The Definitive Guide, with Jeroen Janssens and Thijs Nieuwdorp 1:15:22

לפני 5 weeks1:15:22

1:15:22

Jeroen Janssens and Thijs Nieuwdorp are data frame library Polars’ greatest advocates in this episode with Jon Krohn, where they discuss their book, Python Polars: The Definitive Guide , best practice for using Polars, why Pandas users are switching to Polars for data frame operations in Python, and how the library reduces memory usage and compute time up to 10x more than Pandas. Listen to the episode to be a part of an O’Reilly giveaway! Additional materials: ⁠www.superdatascience.com/885 This episode is brought to you by Trainium2, the latest AI chip from AWS , by Adverity, the conversational analytics platform and by the Dell AI Factory with NVIDIA . Interested in sponsoring a SuperDataScience Podcast episode? Email natalie@superdatascience.com for sponsorship information. In this episode you will learn: (07:44) Why Jeroen and Thijs wrote Python Polars: The Definitive Guide (21:54) Best practices in Polars (25:55) Why Polars has so many users (34:32) The benefits of the Great Tables package (51:06) Jeroen and Thijs’ partnership with NVIDIA and Dell for Python Polars: The Definitive Guide…

1
884: Model Context Protocol (MCP) and Why Everyone’s Talking About It 6:44

לפני 5 weeks6:44

6:44

Model Context Protocol (MCP) is Anthropic’s hottest tool, with over 1,000 community-built MCP servers in operation by February alone. In this Five-Minute Friday, Jon Krohn explains what took so long for users to catch on: Anthropic released MCP in November 2024. Hear more about the buzz behind MCP, its applications, and how easy it is to get started. Additional materials: ⁠ www.superdatascience.com/884⁠ Interested in sponsoring a SuperDataScience Podcast episode? Email natalie@superdatascience.com for sponsorship information.…

1
883: Blackwell GPUs Are Now Available at Your Desk, with Sama Bali and Logan Lawler 1:04:03

לפני 6 weeks1:04:03

1:04:03

Returning after the “Super Bowl of AI”, NVIDIA GTC, Sama Bali and Logan Lawler talk to Jon Krohn about their respective work at tech giants NVIDIA and Dell. Sama and Logan discuss the next-gen Blackwell GPUs to their collaboration with Dell in launching Pro-Max PCs specially designed to take on heavy computational workloads as well as the incredible performance of GB 10 and GB 300 workstations, and the widening accessibility of AI developer tools and models. Additional materials: www.superdatascience.com/883 This episode is brought to you by ODSC, the Open Data Science Conference , by Adverity, the conversational analytics platform and by the Dell AI Factory with NVIDIA . Interested in sponsoring a SuperDataScience Podcast episode? Email natalie@superdatascience.com for sponsorship information. In this episode you will learn: (07:29) About Dell’s Pro Max PCs (14:01) Why having a Blackwell GPU from Nvidia is a great option for those new to training and deploying AI models (36:47) When it makes sense for a data scientist to switch from a Unix to a Windows based system (46:33) Logan’s and Sama’s predictions for AI…

1
882: 40x Hotter Than the Sun: The ASML Machines That Make AI Chips 9:45

לפני 6 weeks9:45

9:45

This week’s five-minute Friday heads to the Netherlands to find out more about Dutch company ASML, the brains behind the lithography machines that build AI chips. Jon Krohn walks through how ASML came to dominate the market, where they’re headed next, and how ASML’s complex machines shape AI chips as well as the very future of AI. Additional materials: www.superdatascience.com/882 Interested in sponsoring a SuperDataScience Podcast episode? Email natalie@superdatascience.com for sponsorship information.…

1
881: Beyond GPUs: The Power of Custom AI Accelerators, with Emily Webber 1:17:06

לפני 7 weeks1:17:06

1:17:06

Emily Webber speaks to Jon Krohn about her work at Amazon Web Services, from its Annapurna Labs-developed Nitro System, a foundational technology that can enhance securities and performance in the cloud and how Trainium2 became AWS’ most powerful AI chip with four times the compute of Trainium. Hear the specs of AWS’s chips and when to use them. Additional materials: www.superdatascience.com/881 This episode is brought to you by ODSC , the Open Data Science Conference . Interested in sponsoring a SuperDataScience Podcast episode? Email natalie@superdatascience.com for sponsorship information. In this episode you will learn: (08:36) Emily’s work on AWS’ SageMaker and Trainium (23:54) How AWS Neuron lets builders tailor their approach to using frameworks (29:07) Why using an accelerator is better than using a GPU (35:29) The key differences between AWS Trainium and AWS Trainium2 (52:45) How to select between AWS Trainium and AWS Trainium2…

1
880: Manus, DeepSeek and China’s AI Boom 10:17

לפני 7 weeks10:17

10:17

First developed in China, Manus AI and DeepSeek have made great waves on an international scale. Sought-after for their cost-effectiveness compared to US-made tech, Manus AI and DeepSeek are quickly becoming dominant technologies inside the country. In this five-minute Friday, Jon Krohn asks: Do these technologies warrant the huge amount of resources spent on them by multiple industries in China, and what makes hype become a mainstay? Additional materials: www.superdatascience.com/880 Interested in sponsoring a SuperDataScience Podcast episode? Email natalie@superdatascience.com for sponsorship information.…

ברוכים הבאים אל Player FM!

Player FM סורק את האינטרנט עבור פודקאסטים באיכות גבוהה בשבילכם כדי שתהנו מהם כרגע. זה יישום הפודקאסט הטוב ביותר והוא עובד על אנדרואיד, iPhone ואינטרנט. הירשמו לסנכרון מנויים במכשירים שונים.

תקשיבו ל-500+ נושאים

דומה לSuper Data Science: ML & AI Podcast with Jon Krohn

פודקאסטים ששווה להאזין

Super Data Science: ML & AI Podcast with Jon Krohn « » 881: Beyond GPUs: The Power of Custom AI Accelerators, with Emily Webber

881: Beyond GPUs: The Power of Custom AI Accelerators, with Emily Webber

פודקאסטים ששווה להאזין

ברוכים הבאים אל Player FM!

דומה לSuper Data Science: ML & AI Podcast with Jon Krohn

מדריך עזר מהיר

Super Data Science: ML & AI Podcast with Jon Krohn « »
881: Beyond GPUs: The Power of Custom AI Accelerators, with Emily Webber