))
Metrics Reloaded: The Oracle
Manage episode 418752228 series 3474385
תוכן מסופק על ידי HackerNoon. כל תוכן הפודקאסטים כולל פרקים, גרפיקה ותיאורי פודקאסטים מועלים ומסופקים ישירות על ידי HackerNoon או שותף פלטפורמת הפודקאסט שלהם. אם אתה מאמין שמישהו משתמש ביצירה שלך המוגנת בזכויות יוצרים ללא רשותך, אתה יכול לעקוב אחר התהליך המתואר כאן https://he.player.fm/legal.
This story was originally published on HackerNoon at: https://hackernoon.com/metrics-reloaded-the-oracle.
Ground truth and production metrics complement each others for ensuring performance.
Check more stories related to tech-stories at: https://hackernoon.com/c/tech-stories. You can also check exclusive content about #ai-assistant, #performance-evaluation, #conversational-ai-agents, #ground-truth-metrics, #user-perceived-metrics, #user-reported-metrics, #data-points, #automated-lab-testing, and more.
This story was written by: @pmukherjee. Learn more about this writer by checking @pmukherjee's about page, and for more stories, please visit hackernoon.com.
Focus on how to obtain these metrics in a manner that is easy to use, accurate and actionable. Ground truth and production metrics complement each others for ensuring performance. These two metric pipeline should be used to improve each other. Metric collection from production should not affect degrading performance. Metrics should dictate what logs needed to be added. Logs should be harmless and simple. Metrics derivation and logs should be orthogonal. We discuss more details on scaling performance metrics infrastructure in the final part of the trilogy
332 פרקים
שתפו
