ML Engineering Teams and Niche Chat Bot Experiences with Demetrios Brinkmann

Open||Source||Data

This episode features an interview with Demetrios Brinkmann, Founder of the MLOps Community, an organization for people to share best practices around MLOps. Demetrios fell into the Machine Learning Operations world and has since interviewed leading names around MLOps, data science, and machine learning.

In this episode, Sam sits down with Demetrios to discuss LLM in production use cases, ML engineering teams, and the LLM Survey Report from the MLOps Community.

-------------------

"I think the most novel ones that I saw from the survey were when a chat bot would prompt a human as opposed to the human prompting the chat bot. It's almost like you have this LLM coach. And in that way, it's not necessarily like this isn't LLM in production that an end user is getting that's not outside the business or that is outside the business. It's more like internally, you can think about maybe it's an accountant and the accountant is filing my taxes for the year. As they're filing them, the LLM is prompting them on different tax laws that maybe they weren't thinking about or different ways that they could file things." – Demetrios Brinkmann

-------------------

Episode Timestamps:

(04:30): LLMs as the new standard

(19:26): Key LLM in production use cases

(31:18): What open source data means to Demetrios

(34:36): What Demetrios is seeing in open source AI models

(42:44): One question Demetrios wishes to be asked

(44:41): Demetrios’s advice for the audience

(47:19): Backstage takeaways with executive producer, Audra Montenegro

-------------------

Links:

LinkedIn - Connect with Demetrios

Read the LLM Survey Report

Listen to The MLOps Podcast