MLOps Meetup #34: Streaming Machine Learning with Apache Kafka and Tiered Storage // Kai Waehner, Confluent

MLOps.community

Player FM - Internet Radio Done Right

57 subscribers

הוסף לפני four שנים

תוכן מסופק על ידי Demetrios. כל תוכן הפודקאסטים כולל פרקים, גרפיקה ותיאורי פודקאסטים מועלים ומסופקים ישירות על ידי Demetrios או שותף פלטפורמת הפודקאסט שלהם. אם אתה מאמין שמישהו משתמש ביצירה שלך המוגנת בזכויות יוצרים ללא רשותך, אתה יכול לעקוב אחר התהליך המתואר כאן https://he.player.fm/legal.

Skip Intro

1
Zoey Deutch (Nouvelle Vague) 37:44

לפני 11 ימים37:44

הפעל מאוחר יותר

רשימות

לייק

אהבתי

37:44

Zoey Deutch returns to Skip Intro to talk about her latest transformation in Nouvelle Vague as American actress Jean Seberg. Directed by acclaimed filmmaker Richard Linklater — and a love letter to the French New Wave classic Breathless — Nouvelle Vague wasn’t the first time that Linklater and Deutch shared a film set. Deutch shares how Linklater compares rehearsals to athletics, starting exciting new chapters in her personal life, hilarious irrational fears, and the deep love she has for her sister, Maddie. Video episodes are also available on the Still Watching Netflix YouTube Channel. Listen to more from Netflix Podcasts .…

לפני 5 שנים 52:48

MP3•בית הפרקים

MLOps Meetup #34! This week, we talk to Kai Waehner about the beast that is Apache Kafka and how many different ways you can use it!

Join the Community: ⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠https://go.mlops.community/YTJoinIn⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠

Get the newsletter: ⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠https://go.mlops.community/YTNewsletter⁠

// Key takeaways:

-Kafka is much more than just messaging

-Kafka is the de facto standard for processing huge volumes of data at scale in real-time

-Kafka and Machine Learning are complementary for various use cases (including data integration, data processing, model training, model scoring, and monitoring)

// Abstract:

The combination of Apache Kafka, tiered storage, and machine learning frameworks such as TensorFlow enables you to build a scalable, reliable, but also simple infrastructure for all machine learning tasks using the Apache Kafka ecosystem and Confluent Platform. This discussion features a predictive maintenance use case within a connected car infrastructure, but the discussed components and architecture are helpful in any industry.

// Bio:

Kai Waehner is a Technology Evangelist at Confluent. He works with customers across the globe and with internal teams like engineering and marketing. Kai’s main area of expertise lies within the fields of Big Data Analytics, Machine Learning, Hybrid Cloud Architectures, Event Stream Processing, and Internet of Things. He is a regular speaker at international conferences such as Devoxx, ApacheCon, and Kafka Summit, writes articles for professional journals, and shares his experiences with new technologies on his blog: www.kai-waehner.de.

Join our Slack community: https://go.mlops.community/slack

Connect with Demetrios on LinkedIn: https://www.linkedin.com/in/dpbrinkm/

Connect with Kai: contact@kai-waehner.de / @KaiWaehner / LinkedIn (https://www.linkedin.com/in/megachucky/)

________Show Notes_______

Blogpost tiered storage

https://www.confluent.io/blog/streaming-machine-learning-with-tiered-storage/

https://www.confluent.io/resources/kafka-summit-2020/apache-kafka-tiered-storage-and-tensorflow-for-streaming-machine-learning-without-a-data-lake/

Blogpost about using Kafka as a database

https://www.kai-waehner.de/blog/2020/03/12/can-apache-kafka-replace-database-acid-storage-transactions-sql-nosql-data-lake/

Example repo on github

https://github.com/kaiwaehner/hivemq-mqtt-tensorflow-kafka-realtime-iot-machine-learning-training-inference

Model serving vs embedded Kafka

https://www.confluent.io/blog/machine-learning-real-time-analytics-models-in-kafka-applications/

https://www.confluent.io/kafka-summit-san-francisco-2019/event-driven-model-serving-stream-processing-vs-rpc-with-kafka-and-tensorflow/

Istio blog post

https://www.kai-waehner.de/blog/2019/09/24/cloud-native-apache-kafka-kubernetes-envoy-istio-linkerd-service-mesh/

482 פרקים

MLOps Meetup #34: Streaming Machine Learning with Apache Kafka and Tiered Storage // Kai Waehner, Confluent

MLOps.community

57 subscribers

published לפני 5 שנים

שתפו

MP3•בית הפרקים

MLOps Meetup #34! This week, we talk to Kai Waehner about the beast that is Apache Kafka and how many different ways you can use it!

Get the newsletter: ⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠https://go.mlops.community/YTNewsletter⁠

// Key takeaways:

-Kafka is much more than just messaging

-Kafka is the de facto standard for processing huge volumes of data at scale in real-time

-Kafka and Machine Learning are complementary for various use cases (including data integration, data processing, model training, model scoring, and monitoring)

// Abstract:

// Bio:

Join our Slack community: https://go.mlops.community/slack

Connect with Demetrios on LinkedIn: https://www.linkedin.com/in/dpbrinkm/

Connect with Kai: contact@kai-waehner.de / @KaiWaehner / LinkedIn (https://www.linkedin.com/in/megachucky/)

________Show Notes_______

Blogpost tiered storage

https://www.confluent.io/blog/streaming-machine-learning-with-tiered-storage/

https://www.confluent.io/resources/kafka-summit-2020/apache-kafka-tiered-storage-and-tensorflow-for-streaming-machine-learning-without-a-data-lake/

Blogpost about using Kafka as a database

https://www.kai-waehner.de/blog/2020/03/12/can-apache-kafka-replace-database-acid-storage-transactions-sql-nosql-data-lake/

Example repo on github

https://github.com/kaiwaehner/hivemq-mqtt-tensorflow-kafka-realtime-iot-machine-learning-training-inference

Model serving vs embedded Kafka

https://www.confluent.io/blog/machine-learning-real-time-analytics-models-in-kafka-applications/

https://www.confluent.io/kafka-summit-san-francisco-2019/event-driven-model-serving-stream-processing-vs-rpc-with-kafka-and-tensorflow/

Istio blog post

https://www.kai-waehner.de/blog/2019/09/24/cloud-native-apache-kafka-kubernetes-envoy-istio-linkerd-service-mesh/

482 פרקים

כל הפרקים

1
Context Engineering, Context Rot, & Agentic Search with the CEO of Chroma, Jeff Huber 44:55

לפני 4 ימים44:55

44:55

Jeff Huber is the CEO of Chroma , working on context engineering and building reliable retrieval infrastructure for AI systems. Context Engineering, Context Rot, & Agentic Search with the CEO of Chroma, Jeff Huber // MLOps Podcast #348. Join the Community: https://go.mlops.community/YTJoinIn Get the newsletter: https://go.mlops.community/YTNewsletter // Abstract Jeff Huber drops some hard truths about “context rot” — the slow decay of AI memory that’s quietly breaking your favorite models. From retrieval chaos to the hidden limits of context windows, he and Demetrios Brinkmann unpack why most AI systems forget what matters and how Chroma is rethinking the entire retrieval stack. It’s a bold look at whether smarter AI means cleaner context — or just better ways to hide the mess. // Bio Jeff Huber is the CEO and cofounder of Chroma. Chroma has raised $20M from top investors in Silicon Valley and builds modern search infrastructure for AI. // Related Links Website: https://www.trychroma.com/ ~~~~~~~~ ✌️Connect With Us ✌️ ~~~~~~~ Catch all episodes, blogs, newsletters, and more: https://go.mlops.community/TYExplore Join our Slack community [ https://go.mlops.community/slack ] Follow us on X/Twitter [@mlopscommunity]( https://x.com/mlopscommunity ) or [LinkedIn]( https://go.mlops.community/linkedin )] Sign up for the next meetup: [ https://go.mlops.community/register ] MLOps Swag/Merch: [ https://shop.mlops.community/ ] Connect with Demetrios on LinkedIn: /dpbrinkm Connect with Jeff on LinkedIn: /jeffchuber/ Timestamps: [00:00] AI intelligence context clarity [00:37] Context rot explanation [03:02] Benchmarking context windows [05:09] Breaking down search eras [10:50] Agent task memory issues [17:21] Semantic search limitations [22:54] Context hygiene in AI [30:15] Chroma on-device functionality [38:23] Vision for precision systems [43:07] ML model deployment challenges [44:17] Wrap up…

1
Reliable Voice Agents 38:21

לפני 7 ימים38:21

38:21

Brooke Hopkins is the CEO of Coval , a company making voice agents more reliable. Reliable Voice Agents // MLOps Podcast #347 with Brooke Hopkins, Founder of Coval. Join the Community: https://go.mlops.community/YTJoinIn Get the newsletter: https://go.mlops.community/YTNewsletter // Abstract Voice AI is finally growing up—but not without drama. Brooke Hopkins joins Demetrios Brinkmann to unpack why most “smart” voice systems still feel dumb, what it actually takes to make them reliable, and how startups are quietly outpacing big tech in building the next generation of voice agents. // Bio Brooke Hopkins is the founder of Coval, a simulation and evaluation platform for AI agents. She previously led the evaluation job infrastructure at Waymo. There, her team was responsible for the developer tools for launching and running simulations, and she engineered many of the core simulation systems from the ground up. // Related Links Website: https://www.coval.dev/ ~~~~~~~~ ✌️Connect With Us ✌️ ~~~~~~~ Catch all episodes, blogs, newsletters, and more: https://go.mlops.community/TYExplore Join our Slack community [ https://go.mlops.community/slack ] Follow us on X/Twitter [@mlopscommunity]( https://x.com/mlopscommunity ) or [LinkedIn]( https://go.mlops.community/linkedin )] Sign up for the next meetup: [ https://go.mlops.community/register ] MLOps Swag/Merch: [ https://shop.mlops.community/ ] Connect with Demetrios on LinkedIn: /dpbrinkm Connect with Brooke on LinkedIn: /bnhop/ Timestamps: [00:00] Workshop feedback [02:21] IVR frustration and transition [05:06] Voice use cases in business [11:00] Voice AI reliability challenge [18:46] Voice AI reliability issues [24:35] Injecting context [27:16] Conversation flow analysis [34:52] AI overgeneralization and confidence [37:41] Wrap up…

1
The Future of AI Operations: Insights from PwC AI Managed Services 41:27

לפני 11 ימים41:27

41:27

Rani Radhakrishnan is a Principal at PwC US, leading work on AI-managed services, autonomous agents, and data-driven transformation for enterprises. The Future of AI Operations: Insights from PwC AI Managed Services // MLOps Podcast #345 with Rani Radhakrishnan, Principal, Technology Managed Services - AI, Data Analytics and Insights at PwC US. Huge thanks to PwC for supporting this episode! Join the Community: https://go.mlops.community/YTJoinIn Get the newsletter: https://go.mlops.community/YTNewsletter // Abstract In today’s data-driven IT landscape, managing ML lifecycles and operations is converging. On this podcast, we’ll explore how end-to-end ML lifecycle practices extend to proactive, automation-driven IT operations. We'll discuss key MLOps concepts—CI/CD pipelines, feature stores, model monitoring—and how they power anomaly detection, event correlation, and automated remediation. // Bio Rani Radhakrishnan, a Principal at PwC, currently leads the AI Managed Services and Data & Insight teams in PwC US Technology Managed Services. Rani excels at transforming data into strategic insights, driving informed decision-making, and delivering innovative solutions. Her leadership is marked by a deep understanding of emerging technologies and a commitment to leveraging them for business growth. Rani’s ability to align and deliver AI solutions with organizational outcomes has established her as a thought leader in the industry. Her passion for applying technology to solve tough business challenges and dedication to excellence continue to inspire her teams and help drive success for her clients in the rapidly evolving AI landscape. // Related Links Website: https://www.pwc.com/us/managedservices https://www.pwc.com/us/en/tech-effect.html ~~~~~~~~ ✌️Connect With Us ✌️ ~~~~~~~ Catch all episodes, blogs, newsletters, and more: https://go.mlops.community/TYExplore Join our Slack community [ https://go.mlops.community/slack ] Follow us on X/Twitter [@mlopscommunity]( https://x.com/mlopscommunity ) or [LinkedIn]( https://go.mlops.community/linkedin )] Sign up for the next meetup: [ https://go.mlops.community/register ] MLOps Swag/Merch: [ https://shop.mlops.community/ ] Connect with Demetrios on LinkedIn: /dpbrinkm Connect with Rani on LinkedIn: /rani-radhakrishnan-163615 Timestamps: [00:00] Getting to Know Rani [01:54] Managed services [03:50] AI usage reflection [06:21] IT operations and MLOps [11:23] MLOps and agent deployment [14:35] Startup challenges in managed services [16:50] Lift vs practicality in ML [23:45] Scaling in production [27:13] Data labeling effectiveness [29:40] Sustainability considerations [37:00] Product engineer roles [40:21] Wrap up…

1
The GPU Uptime Battle 1:33:45

לפני 14 ימים1:33:45

1:33:45

Andy Pernsteiner is the Field CTO at VAST Data, working on large-scale AI infrastructure, serverless compute near data, and the rollout of VAST’s AI Operating System. The GPU Uptime Battle // MLOps Podcast #346 with Andy Pernsteiner, Field CTO of VAST Data.Huge thanks to VAST Data for supporting this episode! Join the Community: https://go.mlops.community/YTJoinIn Get the newsletter: https://go.mlops.community/YTNewsletter // Abstract Most AI projects don’t fail because of bad models; they fail because of bad data plumbing. Andy Pernsteiner joins the podcast to talk about what it actually takes to build production-grade AI systems that aren’t held together by brittle ETL scripts and data copies. He unpacks why unifying data - rather than moving it - is key to real-time, secure inference, and how event-driven, Kubernetes-native pipelines are reshaping the way developers build AI applications. It’s a conversation about cutting out the complexity, keeping data live, and building systems smart enough to keep up with your models. // Bio Andy is the Field Chief Technology Officer at VAST, helping customers build, deploy, and scale some of the world’s largest and most demanding computing environments. Andy has spent the past 15 years focused on supporting and building large-scale, high-performance data platform solutions. From humble beginnings as an escalations engineer at pre-IPO Isilon, to leading a team of technical Ninjas at MapR, he’s consistently been in the frontlines solving some of the toughest challenges that customers face when implementing Big Data Analytics and next-generation AI solutions. // Related Links Website: www.vastdata.com https://www.youtube.com/watch?v=HYIEgFyHaxk https://www.youtube.com/watch?v=RyDHIMniLro The Mom Test by Rob Fitzpatrick: https://www.momtestbook.com/ ~~~~~~~~ ✌️Connect With Us ✌️ ~~~~~~~ Catch all episodes, blogs, newsletters, and more: https://go.mlops.community/TYExplore Join our Slack community [ https://go.mlops.community/slack ] Follow us on X/Twitter [@mlopscommunity]( https://x.com/mlopscommunity ) or [LinkedIn]( https://go.mlops.community/linkedin )] Sign up for the next meetup: [ https://go.mlops.community/register ] MLOps Swag/Merch: [ https://shop.mlops.community/ ] Connect with Demetrios on LinkedIn: /dpbrinkm Connect with Andy on LinkedIn: /andypernsteiner Timestamps: [00:00] Prototype to production gap [00:21] AI expectations vs reality [03:00] Prototype vs production costs [07:47] Technical debt awareness [10:13] The Mom Test [15:40] Chaos engineering [22:25] Data messiness reflection [26:50] Small data value [30:53] Platform engineer mindset shift [34:26] Gradient description comparison [38:12] Empathy in MLOps [45:48] Empathy in Engineering [51:04] GPU clusters rolling updates [1:03:14] Checkpointing strategy comparison [1:09:44] Predictive vs Generative AI [1:17:51] On Growth, Community, and New Directions [1:24:21] UX of agents [1:32:05] Wrap up…

1
The Evolution of AI in Cyber Security // Jeff Schwartzentruber // #344 35:14

לפני 21 ימים35:14

35:14

Dr. Jeff Schwartzentruber is a Senior Machine Learning Scientist at eSentire, working on anomaly detection pipelines and the use of large language models to enhance cybersecurity operations. The Evolution of AI in Cyber Security // MLOps Podcast #344 with Jeff Schwartzentruber, Staff Machine Learning Scientist at eSentire. Join the Community: https://go.mlops.community/YTJoinIn Get the newsletter: https://go.mlops.community/YTNewsletter // Abstract Modern cyber operations can feel opaque. This talk explains—step by step—what a security operations center (SOC) actually does, how telemetry flows in from networks, endpoints, and cloud apps, and what an investigation can credibly reveal about attacker behavior, exposure, and control gaps. We then trace how AI has shown up in the SOC: from rules and classic machine learning for detection to natural-language tools that summarize alerts and turn questions like “show failed logins from new countries in the last 24 hours” into fast database queries. The core of the talk is our next step: agentic investigations. These GenAI agents plan their work, run queries across tools, cite evidence, and draft analyst-grade findings—with guardrails and a human in the loop. We close with what’s next: risk-aware auto-remediation, verifiable knowledge sources, and a practical checklist for adopting these capabilities safely. // Bio Dr. Jeff Schwartzentruber holds the position of Sr. Machine Learning Scientist at eSentire – a Canadian cybersecurity company specializing in Managed Detection and Response (MDR). Dr. Schwartzentruber’s primary academic and industry research has been concentrated on solving problems at the intersection of cybersecurity and machine learning (ML). Over his +10-year career, Dr. Schwartzentruber has been involved in applying ML for threat detection and security analytics for several large Canadian financial institutions, public sector organizations (federal), and SME’s. In addition to his private sector work, Dr. Schwartzentruber is also an Adjunct Faculty at Dalhousie University in the Department of Computer Science, a Special Graduate Faculty member with the School of Computer Science at the University of Guelph, and a Sr. Advisor on AI at the Rogers Cyber Secure Catalysts. // Related Links Website: https://www.esentire.com/ ~~~~~~~~ ✌️Connect With Us ✌️ ~~~~~~~ Catch all episodes, blogs, newsletters, and more: https://go.mlops.community/TYExplore Join our Slack community [ https://go.mlops.community/slack ] Follow us on X/Twitter [@mlopscommunity]( https://x.com/mlopscommunity ) or [LinkedIn]( https://go.mlops.community/linkedin )] Sign up for the next meetup: [ https://go.mlops.community/register ] MLOps Swag/Merch: [ https://shop.mlops.community/ ] Connect with Demetrios on LinkedIn: /dpbrinkm Connect with Jeff on LinkedIn: /jeff-schwartzentruber/…

1
Thousands of Fine-Tuned Models 37:47

לפני 22 ימים37:47

37:47

Jaipal Singh Goud is the CTO at Prem AI, working on model customization and privacy-preserving compute. This episode was recorded at the Plan B studios in Lugano, Switzerland. For more information, visit https://pow.space/ How do fine-tuned models and RAG systems power personalized AI agents that learn, collaborate, and transform enterprise workflows? What kind of technical challenges do we need to first examine before this becomes real? Demetrios Brinkmann - Founder of MLOps Community ~~~~~~~~ ✌️Connect With Us ✌️ ~~~~~~~ Catch all episodes, blogs, newsletters, and more: https://go.mlops.community/TYExplore Join our Slack community [ https://go.mlops.community/slack ] Follow us on X/Twitter [@mlopscommunity]( https://x.com/mlopscommunity ) or [LinkedIn]( https://go.mlops.community/linkedin )] Sign up for the next meetup: [ https://go.mlops.community/register ] MLOps Swag/Merch: [ https://shop.mlops.community/ ]…

1
The Semantic Layer and AI Agents // David Jayatillake // #343 50:37

לפני 5 weeks50:37

50:37

The Semantic Layer and AI Agents // MLOps Podcast #343 with David Jayatillake, VP of AI at Cube.dev. Join the Community: https://go.mlops.community/YTJoinIn Get the newsletter: https://go.mlops.community/YTNewsletter // Abstract David Jayatillake argues that the real battle in data isn’t about AI — it’s about who controls the semantics. In this episode, he calls out how proprietary BI tools quietly lock companies into their ecosystems, making data less open and less useful. David and Demetrios debate whether semantic layers should live in open-source hands and how AI agents might soon replace entire chunks of manual data engineering. From feature stores to LLM-driven analytics, this conversation challenges how we think about ownership, access, and the future of data workflows. // Bio Experienced and world-renowned data, technology, and AI leader. Expert in the application of LLMs to the semantic layer. Writes at davidsj.substack.com about data, leadership, architecture, venture capital, and artificial intelligence. Two-time co-founder in the data space. Founded Delphi Labs, which focused on applying LLMs to semantic layers to enable data democratization. Regular data conference, podcast, panel, and webinar speaker. // Related Links Website: davidsj.substack.com ~~~~~~~~ ✌️Connect With Us ✌️ ~~~~~~~ Catch all episodes, blogs, newsletters, and more: https://go.mlops.community/TYExplore Join our Slack community [ https://go.mlops.community/slack ] Follow us on X/Twitter [@mlopscommunity]( https://x.com/mlopscommunity ) or [LinkedIn]( https://go.mlops.community/linkedin )] Sign up for the next meetup: [ https://go.mlops.community/register ] MLOps Swag/Merch: [ https://shop.mlops.community/ ] Connect with Demetrios on LinkedIn: /dpbrinkm Connect with David on LinkedIn: /david-jayatillake/…

1
Building Claude Code: Origin, Story, Product Iterations, & What's Next // Siddharth Bidasaria // #342 50:28

לפני 5 weeks50:28

50:28

Building Claude Code: Origin, Story, Product Iterations, & What's Next // MLOps Podcast #342 with Siddharth Bidasaria, Member of Technical Staff at Anthropic. Join the Community: https://go.mlops.community/YTJoinIn Get the newsletter: https://go.mlops.community/YTNewsletter // Abstract Demetrios Brinkmann talks with Siddharth Bidasaria about Anthropic’s Claude code — how it was built, key features like file tools and Spotify control, and the team’s lean, user-focused approach. They explore testing, subagents, and the future of agentic coding, plus how users are pushing its limits. // BioSoftware engineer. Founding team of Claude Code. Ex-Robinhood and Rubrik. // Related Links Bio: https://sidb.io/ Sid's Blog: https://sidb.io/posts/ I Let An AI Play Pokémon! - Claude plays Pokémon Creator: https://youtu.be/nRHeGJwVP18 How Data Platforms Affect ML & AI // Jake Watson // MLOps Podcast #207: https://youtu.be/xWApMuyct_4 The Agent Landscape - Lessons Learned Putting Agents Into Production: https://youtu.be/lRGldru7ohU ~~~~~~~~ ✌️Connect With Us ✌️ ~~~~~~~ Catch all episodes, blogs, newsletters, and more: https://go.mlops.community/TYExplore Join our Slack community [ https://go.mlops.community/slack ] Follow us on X/Twitter [ @mlopscommunity ]( https://x.com/mlopscommunity ) or [LinkedIn]( https://go.mlops.community/linkedin )] Sign up for the next meetup: [ https://go.mlops.community/register ] MLOps Swag/Merch: [ https://shop.mlops.community/ ] Connect with Demetrios on LinkedIn: /dpbrinkm Connect with Marco on LinkedIn: /siddharthbidasaria/ Timestamps: [00:00] MCP servers usage creativity [00:34] Claude's code origin story [05:17] R&D freedom and tools [09:08] Model potential discovery [12:06] Model adaptation strategies [19:13] Steerability vs pattern alignment [22:09] Features to delete [24:12] Moore's law in LLMs [32:42] Power user surprises [35:56] Sub-agent evolution insights [39:54] Agent communication governance [45:26] At-scale agent coordination [49:56] Wrap up…

1
Building an Agentic AI Memory Framework 50:34

לפני 6 weeks50:34

50:34

What if AI could actually remember like humans do? Biswaroop Bhattacharjee joins Demetrios Brinkmann to challenge how we think about memory in AI. From building Cortex—a system inspired by human cognition—to exploring whether AI should forget, this conversation questions the limits of agentic memory and how far we should go in mimicking the mind. Guest speaker: Biswaroop Bhattacharjee - Senior ML Engineer at Prem AI Host :Demetrios Brinkmann - Founder of MLOps Community ~~~~~~~~ ✌️Connect With Us ✌️ ~~~~~~~ Catch all episodes, blogs, newsletters, and more: https://go.mlops.community/TYExplore Join our Slack community [ https://go.mlops.community/slack ] Follow us on X/Twitter [@mlopscommunity]( https://x.com/mlopscommunity ) or [LinkedIn]( https://go.mlops.community/linkedin )] Sign up for the next meetup: [ https://go.mlops.community/register ] MLOps Swag/Merch: [ https://shop.mlops.community/ ] #podcast #aiinfrastructure #aiagents #memory…

1
LLMs at Scale: Infrastructure That Keeps AI Safe, Smart & Affordable // Marco Palladino// # 341 51:13

לפני 7 weeks51:13

51:13

LLMs at Scale: Infrastructure That Keeps AI Safe, Smart & Affordable // MLOps Podcast #341 with Marco Palladino, Kong's Co-Founder and CTO. Join the Community: https://go.mlops.community/YTJoinIn Get the newsletter: https://go.mlops.community/YTNewsletter // Abstract While conversations around AI regulations continue to evolve, the responsibility for AI continues to be with developers. In this episode, Marco Palladino, CTO and co-founder of Kong Inc., explores what it means to build and scale AI responsibly when the rulebook is still being written. He explains that infrastructure should be the frontline defense for enforcing governance, security, and reliability in AI deployments. Marco shares how Kong’s technologies, including AI Gateway and AI Manager, help organizations rein in shadow AI, reduce LLM hallucinations, improve observability, and act as the foundation for agentic workflows. // Bio Marco Palladino is an inventor, software developer, and internet entrepreneur. As the CTO and co-founder of Kong, he is Kong’s co-author, responsible for the design and delivery of the company’s products, while also providing technical thought leadership around APIs and microservices within both Kong and the external software community. Prior to Kong, Marco co-founded Mashape in 2010, which became the largest API marketplace and was acquired by RapidAPI in 2017. // Related Links Website: https://konghq.com/ https://www.youtube.com/watch?v=odpPVeQZjHU https://www.thestack.technology/the-big-interview-kong-cto-marco-palladino/ ~~~~~~~~ ✌️Connect With Us ✌️ ~~~~~~~ Catch all episodes, blogs, newsletters, and more: https://go.mlops.community/TYExplore Join our Slack community [ https://go.mlops.community/slack ] Follow us on X/Twitter [@mlopscommunity]( https://x.com/mlopscommunity ) or [LinkedIn]( https://go.mlops.community/linkedin )] Sign up for the next meetup: [ https://go.mlops.community/register ] MLOps Swag/Merch: [ https://shop.mlops.community/ ] Connect with Demetrios on LinkedIn: /dpbrinkm Connect with Marco on LinkedIn: /marcopalladino/ Timestamps: [00:00] Agent-mediated interactions shift [01:17] Kong connectivity and agents [04:36] Transcript cleanup request [08:11] MCP server use cases [12:37] Agent world possibilities [15:55] Business communication evolution [18:55] System optimization [25:36] AI gateway patterns [31:30] Investment decision making [35:54] Building conviction process [41:34] Polished customer conversation [46:37] AI gateway R&D future [50:52] Wrap up…

1
Best AI Hackathon Project Ever? [Bite Size Episode] 9:08

לפני 8 weeks9:08

9:08

AI Conversations Powered by Prosus Group Unicorn Mafia won the recent hackathon at Raise Summit and explained to me what they built, including all the tech they used under the hood to make their AI agents work. Winners: Charlie Cheesman - Co-founder at 60x.ai Marissa Liu - Tech Lead, Reporting at Watershed Ana Shevchenko - Software Engineer II at Spotify Fergus McKenzie-Wilson - Co-founder at 60x.ai Alex Choi - Founding Engineer at Medfin Host: Demetrios Brinkmann - Founder of MLOps Community ~~~~~~~~ ✌️Connect With Us ✌️ ~~~~~~~ Catch all episodes, blogs, newsletters, and more: https://go.mlops.community/TYExplore Join our Slack community [ https://go.mlops.community/slack ] Follow us on X/Twitter [@mlopscommunity]( https://x.com/mlopscommunity ) or [LinkedIn]( https://go.mlops.community/linkedin )] Sign up for the next meetup: [ https://go.mlops.community/register ] MLOps Swag/Merch: [ https://shop.mlops.community/ ]…

1
On-Device AI Agents in Production: Privacy, Performance, and Scale // Varun Khare & Neeraj Poddar // #340 46:10

לפני 8 weeks46:10

46:10

1
Are Evals Dead? 25:24

לפני 9 weeks25:24

25:24

AI Conversations Powered by Prosus Group Your AI agent isn’t failing because it’s dumb—it’s failing because you refuse to test it. Chiara Caratelli cuts through the hype to show why evaluations—not bigger models or fancier prompts—decide whether agents succeed in the real world. If you’re not stress-testing, simulating, and iterating on failures, you’re not building AI—you’re shipping experiments disguised as products. Guest speaker: Chiara Caratelli - Data Scientist @ Prosus Group Host: Demetrios Brinkmann - Founder of MLOps Community ~~~~~~~~ ✌️Connect With Us ✌️ ~~~~~~~ Catch all episodes, blogs, newsletters, and more: https://go.mlops.community/TYExplore Join our Slack community [ https://go.mlops.community/slack ] Follow us on X/Twitter [@mlopscommunity]( https://x.com/mlopscommunity ) or [LinkedIn]( https://go.mlops.community/linkedin )] Sign up for the next meetup: [ https://go.mlops.community/register ] MLOps Swag/Merch: [ https://shop.mlops.community/ ]…

1
The DuckLake Lakehouse Format // Hannes Mühleisen // #339 57:24

לפני 10 weeks57:24

57:24

1
How LiveKit Became An AI Company By Accident 32:34

לפני 10 weeks32:34

32:34

AI Conversations Powered by Prosus Group Russ d'Sa shares how LiveKit went from a small open-source project during the pandemic to powering voice interfaces for giants like OpenAI. He talks about the turning point when LiveKit teamed up on ChatGPT’s voice features, the challenges of making AI sound human, and why voice could be the future of multimodal AI. It’s a story of chance, big shifts, and building the backbone of tomorrow’s AI. Guest speakers: Russ Dsa - CEO of LiveKit Host: Demetrios Brinkmann - Founder of MLOps Community ~~~~~~~~ ✌️Connect With Us ✌️ ~~~~~~~ Catch all episodes, blogs, newsletters, and more: https://go.mlops.community/TYExplore Join our Slack community [ https://go.mlops.community/slack ] Follow us on X/Twitter [ @mlopscommunity ]( https://x.com/mlopscommunity ) or [LinkedIn]( https://go.mlops.community/linkedin )] Sign up for the next meetup: [ https://go.mlops.community/register ] MLOps Swag/Merch: [ https://shop.mlops.community/ ] #voiceagents #podcast…

ברוכים הבאים אל Player FM!

Player FM סורק את האינטרנט עבור פודקאסטים באיכות גבוהה בשבילכם כדי שתהנו מהם כרגע. זה יישום הפודקאסט הטוב ביותר והוא עובד על אנדרואיד, iPhone ואינטרנט. הירשמו לסנכרון מנויים במכשירים שונים.

תקשיבו ל-500+ נושאים

57 subscribers

Crayola Color Wonder Magic Light Brush, Mess Free Painting Station for Kids, Toddler Toys & Activities, Holiday & Christmas Gifts for Kids, Ages 3+

Tubi: Watch Free Movies & TV Shows

Medicube Zero Pore Pads 2.0, Dual-Textured Facial Toner Pads for Exfoliation and Pore Care with 4.5% AHA Lactic Acid & 0.45% BHA Salicylic Acid, Ideal for All Skin Types, Korean Skin Care (70 units)

Nespresso Capsules Vertuo, Variety Pack, Medium and Dark Roast Coffee, 30 Count Coffee Pods, Brews 7.8 oz.

2025 Panini Donruss Football Trading Cards Tin

2025 P,D AU/BU Lincoln Shield Cents US Mint Uncirculated 2 Coin Set

PYAJUU Stray Kids Laser Photocard 50pcs Stray Kids Laser Card Kpop Stray Kids LOMO Cards Kpop Straykids 5-Strar Album Card Stray Kids Photo Cards 5-Star Postcard Gift for Fans Daugher

Wicked: For Good – The Soundtrack

Golden

פודקאסטים ששווה להאזין

1
Zoey Deutch (Nouvelle Vague) 37:44

MLOps.community « »
MLOps Meetup #34: Streaming Machine Learning with Apache Kafka and Tiered Storage // Kai Waehner, Confluent

MLOps Meetup #34: Streaming Machine Learning with Apache Kafka and Tiered Storage // Kai Waehner, Confluent

פודקאסטים ששווה להאזין

כל הפרקים

1
Context Engineering, Context Rot, & Agentic Search with the CEO of Chroma, Jeff Huber 44:55

1
Reliable Voice Agents 38:21

1
The Future of AI Operations: Insights from PwC AI Managed Services 41:27

1
The GPU Uptime Battle 1:33:45

1
The Evolution of AI in Cyber Security // Jeff Schwartzentruber // #344 35:14

1
Thousands of Fine-Tuned Models 37:47

1
The Semantic Layer and AI Agents // David Jayatillake // #343 50:37

1
Building Claude Code: Origin, Story, Product Iterations, & What's Next // Siddharth Bidasaria // #342 50:28

1
Building an Agentic AI Memory Framework 50:34

1
LLMs at Scale: Infrastructure That Keeps AI Safe, Smart & Affordable // Marco Palladino// # 341 51:13

1
Best AI Hackathon Project Ever? [Bite Size Episode] 9:08

1
On-Device AI Agents in Production: Privacy, Performance, and Scale // Varun Khare & Neeraj Poddar // #340 46:10

1
Are Evals Dead? 25:24

1
The DuckLake Lakehouse Format // Hannes Mühleisen // #339 57:24

1
How LiveKit Became An AI Company By Accident 32:34

ברוכים הבאים אל Player FM!

57 subscribers

Crayola Color Wonder Magic Light Brush, Mess Free Painting Station for Kids, Toddler Toys & Activities, Holiday & Christmas Gifts for Kids, Ages 3+

Tubi: Watch Free Movies & TV Shows

Medicube Zero Pore Pads 2.0, Dual-Textured Facial Toner Pads for Exfoliation and Pore Care with 4.5% AHA Lactic Acid & 0.45% BHA Salicylic Acid, Ideal for All Skin Types, Korean Skin Care (70 units)

פודקאסטים ששווה להאזין

MLOps.community « » MLOps Meetup #34: Streaming Machine Learning with Apache Kafka and Tiered Storage // Kai Waehner, Confluent

MLOps Meetup #34: Streaming Machine Learning with Apache Kafka and Tiered Storage // Kai Waehner, Confluent

פודקאסטים ששווה להאזין

ברוכים הבאים אל Player FM!

מדריך עזר מהיר

MLOps.community « »
MLOps Meetup #34: Streaming Machine Learning with Apache Kafka and Tiered Storage // Kai Waehner, Confluent