17 subscribers
התחל במצב לא מקוון עם האפליקציה Player FM !
פודקאסטים ששווה להאזין
בחסות


Solving the GPU shortage: software to 2-4X existing GPU utilization
Manage episode 376711847 series 2809813
GPUs are rare and expensive right now. Every company doing AI model training needs more, and NVIDIA can't build enough, especially of the NVIDIA H100 GPU.
Run.ai CEO and co-founder Omri Geller says he has a software solution to this hardware problem.
The key: GPUs are mostly idle, even in high-demand settings. According to Geller, his software 2X to 4Xs your GPU capacity on existing hardware, simply by streamlining workloads and maximizing GPU usage time.
In this TechFirst, we chat about:
- the GPU shortage
- how many GPUs we need
- what Open AI is using right now
- whether OpenAI is getting dumber or not
- and much more
As always, get a full transcript and subscribe to the audio podcast at my website:
https://johnkoetsier.com/category/tech-first/
332 פרקים
Manage episode 376711847 series 2809813
GPUs are rare and expensive right now. Every company doing AI model training needs more, and NVIDIA can't build enough, especially of the NVIDIA H100 GPU.
Run.ai CEO and co-founder Omri Geller says he has a software solution to this hardware problem.
The key: GPUs are mostly idle, even in high-demand settings. According to Geller, his software 2X to 4Xs your GPU capacity on existing hardware, simply by streamlining workloads and maximizing GPU usage time.
In this TechFirst, we chat about:
- the GPU shortage
- how many GPUs we need
- what Open AI is using right now
- whether OpenAI is getting dumber or not
- and much more
As always, get a full transcript and subscribe to the audio podcast at my website:
https://johnkoetsier.com/category/tech-first/
332 פרקים
כל הפרקים
×
1 Nuclear waste can solve our AI power problem (and more) 41:06

1 Neura Robotics's new humanoid robot can lift 220 pounds 33:51

1 Tiny AI: 8 kilobyte neural networks in shoes, bikes, cameras 18:27

1 IBM's Starling quantum computer: 20,000X faster than today's quantum computers 24:23

1 Inside the race to build humanoid robots with Apptronik CEO Jeff Cardenas 42:43

1 This personal AI is your 'twin mind' 21:24

1 Massive Microsoft quantum computer breakthrough via entirely new state of matter (!!!) 42:54

1 Europe's answer to humanoid robots: 'best in world' coming this June 39:21

1 Humanoid robots in homes by 2026: Peter Diamandis 40:06

1 Humanoid robots: friends not just workers? 21:45

1 Predicting space weather with AI 25:46

1 Robot love: could you love an AI? 36:35

1 Making games with your voice, with Roblox' chief scientist 39:41

1 How do we know when a machine is smart? 29:53
ברוכים הבאים אל Player FM!
Player FM סורק את האינטרנט עבור פודקאסטים באיכות גבוהה בשבילכם כדי שתהנו מהם כרגע. זה יישום הפודקאסט הטוב ביותר והוא עובד על אנדרואיד, iPhone ואינטרנט. הירשמו לסנכרון מנויים במכשירים שונים.