התחל במצב לא מקוון עם האפליקציה Player FM !
How Attackers Trick AI: Lessons from Gandalf’s Creator
Manage episode 472050790 series 3585084
🔒 How Secure is AI? Gandalf’s Creator Exposes the Risks 🔥
AI security is under attack, and hackers are finding new ways to manipulate AI systems. In this episode, Guy Podjarny sits down with Mateo Rojas-Carulla, co-founder of Lakera and creator of Gandalf, to break down the biggest threats facing AI today—from prompt injections and jailbreaks to data poisoning and agent manipulation.
What You’ll Learn:
- How attackers exploit AI vulnerabilities in real-world applications
- Why AI models struggle to separate instructions from external data
- How Gandalf’s 60M+ attack attempts revealed shocking insights
- What the Dynamic Security Utility Framework (DSEC) means for AI safety
- Why red teaming is critical for preventing AI disasters
Whether you’re a developer, security expert, or just curious about AI risks, this episode is packed with must-know insights on keeping AI safe in an evolving landscape.
💡 Can AI truly be secured? Or will attackers always find a way? Drop your thoughts in the comments! 👇
Watch the episode on YouTube: https://youtu.be/RKCvlJT_r4s
Join the AI Native Dev Community on Discord: https://tessl.co/4ghikjh
Ask us questions: podcast@tessl.io
פרקים
1. How Attackers Trick AI: Lessons from Gandalf’s Creator (00:00:00)
2. Over-Permission in AI Systems (00:02:00)
3. Nebulous AI Functionality (00:07:00)
4. Jailbreaks and Prompt Injections Attacks (00:10:00)
5. Introducing the Dynamic Security Utility Framework (00:18:34)
6. Security in Agentic Systems (00:23:34)
7. Red Teaming for Ai Security Testing (00:28:34)
8. The Future of Agentic Systems (00:35:34)
9. LangChain and Real-World Vulnerabilities (00:42:34)
10. Proactive Security Strategies (00:48:34)
54 פרקים
How Attackers Trick AI: Lessons from Gandalf’s Creator
The AI Native Dev - from Copilot today to AI Native Software Development tomorrow
Manage episode 472050790 series 3585084
🔒 How Secure is AI? Gandalf’s Creator Exposes the Risks 🔥
AI security is under attack, and hackers are finding new ways to manipulate AI systems. In this episode, Guy Podjarny sits down with Mateo Rojas-Carulla, co-founder of Lakera and creator of Gandalf, to break down the biggest threats facing AI today—from prompt injections and jailbreaks to data poisoning and agent manipulation.
What You’ll Learn:
- How attackers exploit AI vulnerabilities in real-world applications
- Why AI models struggle to separate instructions from external data
- How Gandalf’s 60M+ attack attempts revealed shocking insights
- What the Dynamic Security Utility Framework (DSEC) means for AI safety
- Why red teaming is critical for preventing AI disasters
Whether you’re a developer, security expert, or just curious about AI risks, this episode is packed with must-know insights on keeping AI safe in an evolving landscape.
💡 Can AI truly be secured? Or will attackers always find a way? Drop your thoughts in the comments! 👇
Watch the episode on YouTube: https://youtu.be/RKCvlJT_r4s
Join the AI Native Dev Community on Discord: https://tessl.co/4ghikjh
Ask us questions: podcast@tessl.io
פרקים
1. How Attackers Trick AI: Lessons from Gandalf’s Creator (00:00:00)
2. Over-Permission in AI Systems (00:02:00)
3. Nebulous AI Functionality (00:07:00)
4. Jailbreaks and Prompt Injections Attacks (00:10:00)
5. Introducing the Dynamic Security Utility Framework (00:18:34)
6. Security in Agentic Systems (00:23:34)
7. Red Teaming for Ai Security Testing (00:28:34)
8. The Future of Agentic Systems (00:35:34)
9. LangChain and Real-World Vulnerabilities (00:42:34)
10. Proactive Security Strategies (00:48:34)
54 פרקים
כל הפרקים
×
1 Vibe Coding SimCity II: Injecting Chaos with Natural Disasters and AI Tools 1:00:42

1 Vibe Coding SimCity: Prototyping Tiny Towns with AI Dev Tools 44:00

1 Exploring LLM Observability with Traceloop's Gal Kleinman 40:26

1 From Builder to Orchestrator—Confronting the Software Engineer’s Identity Crisis 54:37

1 Is Code Dead & The $1B Solo Startup Myth - 5 AI Realities with Tessl's Guy Podjarny 29:03

1 AI's Transformative Impact on Development with Alex Komorske 31:25

1 Datadog CEO Olivier Pomel on AI Security, Trust, and the Future of Observability 59:59

1 Intent-Driven Development: Insights from Patrick Debois 45:11

1 How Attackers Trick AI: Lessons from Gandalf’s Creator 54:35

1 AI Gone Rogue? LLM Werewolf Showdown 54:43

1 Monthly Roundup: AI Model Wars, GPT-4.5 vs. Sonnet 3.7, and the Future of AI Dev Tools 42:09

1 The Future of Audio AI: Insights from Mati Staniszewski of ElevenLabs 1:02:52

1 Building the Ultimate AI-Powered Development Environment with Farhath Razzaque 36:16

1 DeepSeek R1: Ask Me Anything - Open Weights, MoE innovations, Model Distillation and more! 33:18

1 Live Monthly: News on DeepSeek, Stargate, StackBlitz (Bolt.new) funding, prompting, and more 51:46
ברוכים הבאים אל Player FM!
Player FM סורק את האינטרנט עבור פודקאסטים באיכות גבוהה בשבילכם כדי שתהנו מהם כרגע. זה יישום הפודקאסט הטוב ביותר והוא עובד על אנדרואיד, iPhone ואינטרנט. הירשמו לסנכרון מנויים במכשירים שונים.