17 subscribers
התחל במצב לא מקוון עם האפליקציה Player FM !
Solving the GPU shortage: software to 2-4X existing GPU utilization
Manage episode 376711847 series 2809813
GPUs are rare and expensive right now. Every company doing AI model training needs more, and NVIDIA can't build enough, especially of the NVIDIA H100 GPU.
Run.ai CEO and co-founder Omri Geller says he has a software solution to this hardware problem.
The key: GPUs are mostly idle, even in high-demand settings. According to Geller, his software 2X to 4Xs your GPU capacity on existing hardware, simply by streamlining workloads and maximizing GPU usage time.
In this TechFirst, we chat about:
- the GPU shortage
- how many GPUs we need
- what Open AI is using right now
- whether OpenAI is getting dumber or not
- and much more
As always, get a full transcript and subscribe to the audio podcast at my website:
https://johnkoetsier.com/category/tech-first/
328 פרקים
Manage episode 376711847 series 2809813
GPUs are rare and expensive right now. Every company doing AI model training needs more, and NVIDIA can't build enough, especially of the NVIDIA H100 GPU.
Run.ai CEO and co-founder Omri Geller says he has a software solution to this hardware problem.
The key: GPUs are mostly idle, even in high-demand settings. According to Geller, his software 2X to 4Xs your GPU capacity on existing hardware, simply by streamlining workloads and maximizing GPU usage time.
In this TechFirst, we chat about:
- the GPU shortage
- how many GPUs we need
- what Open AI is using right now
- whether OpenAI is getting dumber or not
- and much more
As always, get a full transcript and subscribe to the audio podcast at my website:
https://johnkoetsier.com/category/tech-first/
328 פרקים
כל הפרקים
×
1 Inside the race to build humanoid robots with Apptronik CEO Jeff Cardenas 42:43

1 This personal AI is your 'twin mind' 21:24

1 Massive Microsoft quantum computer breakthrough via entirely new state of matter (!!!) 42:54

1 Europe's answer to humanoid robots: 'best in world' coming this June 39:21

1 Humanoid robots in homes by 2026: Peter Diamandis 40:06

1 Humanoid robots: friends not just workers? 21:45

1 Predicting space weather with AI 25:46

1 Robot love: could you love an AI? 36:35

1 Making games with your voice, with Roblox' chief scientist 39:41

1 How do we know when a machine is smart? 29:53

1 Can cat qbits save quantum computing? 28:17

1 4000 developers on AI generating code 23:29

1 Boston Dynamics & the golden age of robots 33:42

1 World's tallest autonomous robot works in a warehouse 25:06

1 Moon first, then Mars: a chat with astronaut Jack Fischer 38:53


1 Water from air for 10 cents a gallon? 23:22




1 No-notch iPhones, FaceID on Android, biometrics everywhere 32:59


1 Apple Vision Pro: future of surgical training? 20:21


1 Oysters reporting water quality? Not science fiction! 25:49

1 Here's an all-wheel drive e-bike ... with ChatGPT 26:10

1 App store for your brain: reading brain waves to fix sleep, pain, learning 21:49

1 Hacking reality: Apple Vision Pro and security 14:51

1 Smart buildings 2024: not just energy consumers 21:59
ברוכים הבאים אל Player FM!
Player FM סורק את האינטרנט עבור פודקאסטים באיכות גבוהה בשבילכם כדי שתהנו מהם כרגע. זה יישום הפודקאסט הטוב ביותר והוא עובד על אנדרואיד, iPhone ואינטרנט. הירשמו לסנכרון מנויים במכשירים שונים.