התחל במצב לא מקוון עם האפליקציה Player FM !
Building the AI Hyperscaler with Kubernetes
Manage episode 426169667 series 3332465
In this episode of the Kubernetes Bytes podcast, Bhavin sits down with Brandon Jacobs, an Infrastructure architect at Coreweave. They discuss how Coreweave has adopted Kubernetes to build the AI hyperscaler. The discussion dives into details around how Coreweave handles Day 0 and Day 2 operations for AI labs that need access to GPUs. They also talk about lessons learnt and best practices for building a Kubernetes based cloud.
Check out our website at https://kubernetesbytes.com/
Episode Sponsor: Nethopper
Learn more about KAOPS: nethopper.io
For a supported-demo: info@nethopper.io
Try the free version of KAOPS now!
https://mynethopper.com/auth
Cloud Native News:
- https://siliconangle.com/2024/06/24/ollama-addresses-remote-execution-flaw-following-wiz-discovery/
- https://siliconangle.com/2024/06/18/suse-acquires-kubernetes-observability-startup-stackstate/
Show links:
- https://www.linkedin.com/in/brandonrjacobs/
- https://www.coreweave.com/
Timestamps:
- 00:01:39 Cloud Native News
- 00:05:30 Interview with Brandon
- 00:51:37 Key takeaways
88 פרקים
Manage episode 426169667 series 3332465
In this episode of the Kubernetes Bytes podcast, Bhavin sits down with Brandon Jacobs, an Infrastructure architect at Coreweave. They discuss how Coreweave has adopted Kubernetes to build the AI hyperscaler. The discussion dives into details around how Coreweave handles Day 0 and Day 2 operations for AI labs that need access to GPUs. They also talk about lessons learnt and best practices for building a Kubernetes based cloud.
Check out our website at https://kubernetesbytes.com/
Episode Sponsor: Nethopper
Learn more about KAOPS: nethopper.io
For a supported-demo: info@nethopper.io
Try the free version of KAOPS now!
https://mynethopper.com/auth
Cloud Native News:
- https://siliconangle.com/2024/06/24/ollama-addresses-remote-execution-flaw-following-wiz-discovery/
- https://siliconangle.com/2024/06/18/suse-acquires-kubernetes-observability-startup-stackstate/
Show links:
- https://www.linkedin.com/in/brandonrjacobs/
- https://www.coreweave.com/
Timestamps:
- 00:01:39 Cloud Native News
- 00:05:30 Interview with Brandon
- 00:51:37 Key takeaways
88 פרקים
כל הפרקים
×
1 Database as a service with Percona Everest 1:02:44


1 Increasing AI adoption using Kubernetes 52:03

1 Monolith to Microservices using Kubernetes at Guidewire 1:06:28

1 Inference in Action: Scaling Al Smarter with Inferless 55:17

1 Container security with Wiz 1:02:33

1 Dagger.io Deep Dive with Co-Founder Sam Alba 1:06:24

1 Running Ray on Kubernetes with KubeRay 53:06

1 Building scalable data platforms using Data on EKS 1:02:20

1 Deploy and fine-tune LLM models on Kubernetes using KAITO 44:17

1 The business case for cloud-native and Kubernetes 54:24

1 Building the AI Hyperscaler with Kubernetes 54:56

1 Shifting Minds: Exploring OpenShift's AI Landscape 1:05:07

1 Training Machine Learning (ML) models on Kubernetes 55:29

1 The evolution of service mesh technologies 1:08:00
ברוכים הבאים אל Player FM!
Player FM סורק את האינטרנט עבור פודקאסטים באיכות גבוהה בשבילכם כדי שתהנו מהם כרגע. זה יישום הפודקאסט הטוב ביותר והוא עובד על אנדרואיד, iPhone ואינטרנט. הירשמו לסנכרון מנויים במכשירים שונים.