
התחל במצב לא מקוון עם האפליקציה Player FM !
פודקאסטים ששווה להאזין
בחסות


1 When Karen Tries TikTok Law on No-Nonsense Cops — Ends in DUI Arrest 1:39:00
Using Airflow To Power Machine Learning Pipelines at Optimove with Vasyl Vasyuta
Manage episode 455155998 series 2948506
Data orchestration and machine learning are shaping how organizations handle massive datasets and drive customer-focused strategies. Tools like Apache Airflow are central to this transformation. In this episode, Vasyl Vasyuta, R&D Team Leader at Optimove, joins us to discuss how his team leverages Airflow to optimize data processing, orchestrate machine learning models and create personalized customer experiences.
Key Takeaways:
(01:59) Optimove tailors marketing notifications with personalized customer journeys.
(04:25) Airflow orchestrates Snowflake procedures for massive datasets.
(05:11) DAGs manage workflows with branching and replay plugins.
(05:41) The "Joystick" plugin enables seamless data replays.
(09:33) Airflow supports MLOps for customer data grouping.
(11:15) Machine learning predicts customer behavior for better campaigns.
(13:20) Thousands of DAGs run every five minutes for data processing.
(15:36) Custom versioning allows rollbacks and gradual rollouts.
(18:00) Airflow logs enhance operational observability.
(23:00) DAG versioning in Airflow 3.0 could boost efficiency.
Resources Mentioned:
https://www.linkedin.com/in/vasyl-vasyuta-3270b54a/
Optimove -
https://www.linkedin.com/company/optimove/
https://airflow.apache.org/
https://www.snowflake.com/
Datadog -
https://www.datadoghq.com/
https://astronomer.typeform.com/airflowsurvey24
Thanks for listening to “The Data Flowcast: Mastering Airflow for Data Engineering & AI.” If you enjoyed this episode, please leave a 5-star review to help get the word out about the show. And be sure to subscribe so you never miss any of the insightful conversations.
#AI #Automation #Airflow #MachineLearning
73 פרקים
Using Airflow To Power Machine Learning Pipelines at Optimove with Vasyl Vasyuta
The Data Flowcast: Mastering Apache Airflow ® for Data Engineering and AI
Manage episode 455155998 series 2948506
Data orchestration and machine learning are shaping how organizations handle massive datasets and drive customer-focused strategies. Tools like Apache Airflow are central to this transformation. In this episode, Vasyl Vasyuta, R&D Team Leader at Optimove, joins us to discuss how his team leverages Airflow to optimize data processing, orchestrate machine learning models and create personalized customer experiences.
Key Takeaways:
(01:59) Optimove tailors marketing notifications with personalized customer journeys.
(04:25) Airflow orchestrates Snowflake procedures for massive datasets.
(05:11) DAGs manage workflows with branching and replay plugins.
(05:41) The "Joystick" plugin enables seamless data replays.
(09:33) Airflow supports MLOps for customer data grouping.
(11:15) Machine learning predicts customer behavior for better campaigns.
(13:20) Thousands of DAGs run every five minutes for data processing.
(15:36) Custom versioning allows rollbacks and gradual rollouts.
(18:00) Airflow logs enhance operational observability.
(23:00) DAG versioning in Airflow 3.0 could boost efficiency.
Resources Mentioned:
https://www.linkedin.com/in/vasyl-vasyuta-3270b54a/
Optimove -
https://www.linkedin.com/company/optimove/
https://airflow.apache.org/
https://www.snowflake.com/
Datadog -
https://www.datadoghq.com/
https://astronomer.typeform.com/airflowsurvey24
Thanks for listening to “The Data Flowcast: Mastering Airflow for Data Engineering & AI.” If you enjoyed this episode, please leave a 5-star review to help get the word out about the show. And be sure to subscribe so you never miss any of the insightful conversations.
#AI #Automation #Airflow #MachineLearning
73 פרקים
כל הפרקים
×
1 Scaling Airflow for Enterprise Data Platforms at PepsiCo with Kunal Bhattacharya 19:04

1 Building a Unified Data Platform at Pattern with William Graham 24:09

1 How Astronomer Turns Proactive Monitoring Into Customer Success with Collin McNulty 25:34

1 Overcoming Data Engineering Challenges at Daiichi Sankyo Europe GmbH with Evgenii Prusov 19:26

1 Building a Data-Driven Beauty and Wellness Marketplace at StyleSeat with Paschal Onuorah 23:05

1 Building the Future of Airflow Execution at Astronomer with Ian Buss and Piotr Chomiak 22:25

1 Scaling On-Prem Airflow With 2,000 DAGs at Numberly with Sébastien Crocquevieille 24:17

1 How Moniepoint Group Uses Airflow for Exposure Monitoring with Adeolu Adegboye 21:32

1 Inside Bosch’s Airflow 3 Revolution: Remote Execution with Jens Scheffler 28:02

1 Inside Modern Data Infrastructure at Massdriver with Cory O’Daniel and Jake Ferriero 31:24

1 The Future of Airflow Telemetry with Bolke de Bruin 21:55

1 Transforming the Airflow UI for Cloudera’s Users with Shubham Raj 22:28

1 Streamlining Thousands of Data Pipelines at Lyft with Yunhao Qing 19:34

1 Transforming Customer Education in Data Engineering at Astronomer with Marc Lamberti 22:19

1 Embracing Data Mesh and SQL Sensors for Scalable Workflows at lastminute.com with Alberto Crespi 30:09

1 The AI-Ready Pipeline: Reimagining Airflow at Veyer® Logistics with Anu Pabla 23:21

1 Streamlining AI and ML Operations at IBM with BJ Adesoji and Ryan Yackel 24:44

1 Inside the Custom Framework for Managing Airflow Code at Wix with Gil Reich 31:02

1 Modernizing Legacy Data Systems With Airflow at Procter & Gamble with Adonis Castillo Cordero 22:13

1 Building an End-to-End Data Observability System at Netflix with Joseph Machado 38:54

1 Why Developer Experience Shapes Data Pipeline Standards at Next Insurance with Snir Israeli 30:28

1 Data Quality and Observability at Tekmetric with Ipsa Trivedi 22:49

1 Introducing Apache Airflow® 3 with Vikram Koka and Jed Cunningham 27:28

1 Airflow in Action: Powering Instacart's Complex Ecosystem 25:14

1 From ETL to Airflow: Transforming Data Engineering at Deloitte Digital with Raviteja Tholupunoori 27:42

1 A Deep Dive Into the 2025 State of Airflow Survey Results with Tamara Fingerlin of Astronomer 23:26

1 The Software Risk That Affects Everyone and How To Address It with Michael Winser and Jarek Potiuk 28:27

1 Building Scalable ML Infrastructure at Outerbounds with Savin Goyal 36:46

1 Customizing Airflow for Complex Data Environments at Stripe with Nick Bilozerov and Sharadh Krishnamurthy 27:40

1 Harnessing Airflow for Data-Driven Policy Research at CSET with Jennifer Melot 17:54
ברוכים הבאים אל Player FM!
Player FM סורק את האינטרנט עבור פודקאסטים באיכות גבוהה בשבילכם כדי שתהנו מהם כרגע. זה יישום הפודקאסט הטוב ביותר והוא עובד על אנדרואיד, iPhone ואינטרנט. הירשמו לסנכרון מנויים במכשירים שונים.