התחל במצב לא מקוון עם האפליקציה Player FM !
The Metrics Revolution: Scaling
Manage episode 418755846 series 3474148
This story was originally published on HackerNoon at: https://hackernoon.com/the-metrics-revolution-scaling.
Identify the metrics that are agnostic of the form factor - these are core metrics for the conversational AI agent in question.
Check more stories related to machine-learning at: https://hackernoon.com/c/machine-learning. You can also check exclusive content about #ai, #google-assistant, #conversational-ai, #user-perceived-metrics, #user-reported-metrics, #reliability-and-latency, #ground-truth-metric, #production-metric, and more.
This story was written by: @pmukherjee. Learn more about this writer by checking @pmukherjee's about page, and for more stories, please visit hackernoon.com.
Discusses a simple solution for scaling performance evaluation infrastructure to multiple work factors. I am also the first author patent holder in this area - Standardizing analysis metrics across multiple devices. https://patents.google.com/patent/US20240031261A1/en Identify the metrics that are agnostic of the form factor - these are core metrics for the conversational AI agent in question. Identify the logging signals needed for instrumenting these metrics. Adding mapping configuration for the corresponding logging signals on each form factor. Transform the form factor specific logging signals to an uniform space which is agnostic of the form factor. The metric instrumentation framework will only be based on the uniform logging signals.
316 פרקים
Manage episode 418755846 series 3474148
This story was originally published on HackerNoon at: https://hackernoon.com/the-metrics-revolution-scaling.
Identify the metrics that are agnostic of the form factor - these are core metrics for the conversational AI agent in question.
Check more stories related to machine-learning at: https://hackernoon.com/c/machine-learning. You can also check exclusive content about #ai, #google-assistant, #conversational-ai, #user-perceived-metrics, #user-reported-metrics, #reliability-and-latency, #ground-truth-metric, #production-metric, and more.
This story was written by: @pmukherjee. Learn more about this writer by checking @pmukherjee's about page, and for more stories, please visit hackernoon.com.
Discusses a simple solution for scaling performance evaluation infrastructure to multiple work factors. I am also the first author patent holder in this area - Standardizing analysis metrics across multiple devices. https://patents.google.com/patent/US20240031261A1/en Identify the metrics that are agnostic of the form factor - these are core metrics for the conversational AI agent in question. Identify the logging signals needed for instrumenting these metrics. Adding mapping configuration for the corresponding logging signals on each form factor. Transform the form factor specific logging signals to an uniform space which is agnostic of the form factor. The metric instrumentation framework will only be based on the uniform logging signals.
316 פרקים
כל הפרקים
×
1 The Ethics of Local LLMs: Responding to Zuckerberg's "Open Source AI Manifesto" 12:44

1 NExT-GPT: Any-to-Any Multimodal LLM: Abstract and Intro 10:03

1 These 13 Hidden Open-Source Libraries Will Help You Become an AI Wizard 🧙♂️🪄 11:16
ברוכים הבאים אל Player FM!
Player FM סורק את האינטרנט עבור פודקאסטים באיכות גבוהה בשבילכם כדי שתהנו מהם כרגע. זה יישום הפודקאסט הטוב ביותר והוא עובד על אנדרואיד, iPhone ואינטרנט. הירשמו לסנכרון מנויים במכשירים שונים.