1,535 subscribers
התחל במצב לא מקוון עם האפליקציה Player FM !
Software and hardware acceleration with Groq
Manage episode 474823772 series 2385063
How do you enable AI acceleration (at both the hardware and software layers) that stays ahead of rapid industry shifts? In this episode, Dhananjay Singh from Groq dives into the evolving landscape of AI inference and acceleration. We explore how Groq optimizes the serving layer, adapts to industry shifts, and supports emerging model architectures.
Featuring:
- Dhananjay Singh – LinkedIn, X
- Chris Benson – Website, GitHub, LinkedIn, X
- Daniel Whitenack – Website, GitHub, X
Links:
Sponsors:
- Augment Code - Developer AI that uses deep understanding of your large codebase and how you build software to deliver personalized code suggestions and insights. Augment provides relevant, contextualized code right in your IDE or Slack. It transforms scattered knowledge into code or answers, eliminating time spent searching docs or interrupting teammates.
324 פרקים
Manage episode 474823772 series 2385063
How do you enable AI acceleration (at both the hardware and software layers) that stays ahead of rapid industry shifts? In this episode, Dhananjay Singh from Groq dives into the evolving landscape of AI inference and acceleration. We explore how Groq optimizes the serving layer, adapts to industry shifts, and supports emerging model architectures.
Featuring:
- Dhananjay Singh – LinkedIn, X
- Chris Benson – Website, GitHub, LinkedIn, X
- Daniel Whitenack – Website, GitHub, X
Links:
Sponsors:
- Augment Code - Developer AI that uses deep understanding of your large codebase and how you build software to deliver personalized code suggestions and insights. Augment provides relevant, contextualized code right in your IDE or Slack. It transforms scattered knowledge into code or answers, eliminating time spent searching docs or interrupting teammates.
324 פרקים
כל הפרקים
×
1 Reimagining actuarial science with AI 40:59

1 Agentic AI for Drone & Robotic Swarming 46:27

1 AI in the shadows: From hallucinations to blackmail 44:50

1 AI hot takes and debates: Autonomy 45:36

1 Behind-the-Scenes: VC Funding for AI Startups 41:48

1 Federated learning in production (part 2) 45:25

1 Federated learning in production (part 1) 44:38

1 Model Context Protocol Deep Dive 42:23

1 Seeing beyond the scan in neuroimaging 42:58

1 Open source AI to tackle your backlog 42:04

1 Orchestrating agents, APIs, and MCP servers 42:52

1 Software and hardware acceleration with Groq 43:24
ברוכים הבאים אל Player FM!
Player FM סורק את האינטרנט עבור פודקאסטים באיכות גבוהה בשבילכם כדי שתהנו מהם כרגע. זה יישום הפודקאסט הטוב ביותר והוא עובד על אנדרואיד, iPhone ואינטרנט. הירשמו לסנכרון מנויים במכשירים שונים.