התחל במצב לא מקוון עם האפליקציה Player FM !
Why Developer Experience Shapes Data Pipeline Standards at Next Insurance with Snir Israeli
Manage episode 481301881 series 2053958
Creating consistency across data pipelines is critical for scaling engineering teams and ensuring long-term maintainability.
In this episode, Snir Israeli, Senior Data Engineer at Next Insurance, shares how enforcing coding standards and investing in developer experience transformed their approach to data engineering. He explains how implementing automated code checks, clear documentation practices and a scoring system helped drive alignment across teams, improve collaboration and reduce technical debt in a fast-growing data environment.
Key Takeaways:
(02:59) Inconsistencies in code style create challenges for collaboration and maintenance.
(04:22) Programmatically enforcing rules helps teams scale their best practices.
(08:55) Performance improvements in data pipelines lead to infrastructure cost savings.
(13:22) Developer experience is essential for driving adoption of internal tools.
(19:44) Dashboards can operationalize standards enforcement and track progress over time.
(22:49) Standardization accelerates onboarding and reduces friction in code reviews.
(25:39) Linting rules require ongoing maintenance as tools and platforms evolve.
(27:47) Starting small and involving the team leads to better adoption and long-term success.
Resources Mentioned:
https://www.linkedin.com/in/snir-israeli/
Next Insurance | LinkedIn
https://www.linkedin.com/company/nextinsurance/
Next Insurance | Website
https://www.nextinsurance.com/
https://airflow.apache.org/
https://www.astronomer.io/events/roadshow/london/
https://www.astronomer.io/events/roadshow/new-york/
https://www.astronomer.io/events/roadshow/sydney/
https://www.astronomer.io/events/roadshow/san-francisco/
https://www.astronomer.io/events/roadshow/chicago/
Thanks for listening to “The Data Flowcast: Mastering Apache Airflow® for Data Engineering and AI.” If you enjoyed this episode, please leave a 5-star review to help get the word out about the show. And be sure to subscribe so you never miss any of the insightful conversations.
#AI #Automation #Airflow #MachineLearning
61 פרקים
Why Developer Experience Shapes Data Pipeline Standards at Next Insurance with Snir Israeli
The Data Flowcast: Mastering Apache Airflow ® for Data Engineering and AI
Manage episode 481301881 series 2053958
Creating consistency across data pipelines is critical for scaling engineering teams and ensuring long-term maintainability.
In this episode, Snir Israeli, Senior Data Engineer at Next Insurance, shares how enforcing coding standards and investing in developer experience transformed their approach to data engineering. He explains how implementing automated code checks, clear documentation practices and a scoring system helped drive alignment across teams, improve collaboration and reduce technical debt in a fast-growing data environment.
Key Takeaways:
(02:59) Inconsistencies in code style create challenges for collaboration and maintenance.
(04:22) Programmatically enforcing rules helps teams scale their best practices.
(08:55) Performance improvements in data pipelines lead to infrastructure cost savings.
(13:22) Developer experience is essential for driving adoption of internal tools.
(19:44) Dashboards can operationalize standards enforcement and track progress over time.
(22:49) Standardization accelerates onboarding and reduces friction in code reviews.
(25:39) Linting rules require ongoing maintenance as tools and platforms evolve.
(27:47) Starting small and involving the team leads to better adoption and long-term success.
Resources Mentioned:
https://www.linkedin.com/in/snir-israeli/
Next Insurance | LinkedIn
https://www.linkedin.com/company/nextinsurance/
Next Insurance | Website
https://www.nextinsurance.com/
https://airflow.apache.org/
https://www.astronomer.io/events/roadshow/london/
https://www.astronomer.io/events/roadshow/new-york/
https://www.astronomer.io/events/roadshow/sydney/
https://www.astronomer.io/events/roadshow/san-francisco/
https://www.astronomer.io/events/roadshow/chicago/
Thanks for listening to “The Data Flowcast: Mastering Apache Airflow® for Data Engineering and AI.” If you enjoyed this episode, please leave a 5-star review to help get the word out about the show. And be sure to subscribe so you never miss any of the insightful conversations.
#AI #Automation #Airflow #MachineLearning
61 פרקים
כל הפרקים
×
1 Embracing Data Mesh and SQL Sensors for Scalable Workflows at lastminute.com with Alberto Crespi 30:09

1 The AI-Ready Pipeline: Reimagining Airflow at Veyer® Logistics with Anu Pabla 23:21

1 Streamlining AI and ML Operations at IBM with BJ Adesoji and Ryan Yackel 24:44

1 Inside the Custom Framework for Managing Airflow Code at Wix with Gil Reich 31:02

1 Modernizing Legacy Data Systems With Airflow at Procter & Gamble with Adonis Castillo Cordero 22:13

1 Building an End-to-End Data Observability System at Netflix with Joseph Machado 38:54

1 Why Developer Experience Shapes Data Pipeline Standards at Next Insurance with Snir Israeli 30:28

1 Data Quality and Observability at Tekmetric with Ipsa Trivedi 22:49

1 Introducing Apache Airflow® 3 with Vikram Koka and Jed Cunningham 27:28

1 Airflow in Action: Powering Instacart's Complex Ecosystem 25:14

1 From ETL to Airflow: Transforming Data Engineering at Deloitte Digital with Raviteja Tholupunoori 27:42

1 A Deep Dive Into the 2025 State of Airflow Survey Results with Tamara Fingerlin of Astronomer 23:26

1 Airflow’s Role in the Rise of DataOps with Andy Byron 26:15

1 The Software Risk That Affects Everyone and How To Address It with Michael Winser and Jarek Potiuk 28:27

1 Building Scalable ML Infrastructure at Outerbounds with Savin Goyal 36:46
ברוכים הבאים אל Player FM!
Player FM סורק את האינטרנט עבור פודקאסטים באיכות גבוהה בשבילכם כדי שתהנו מהם כרגע. זה יישום הפודקאסט הטוב ביותר והוא עובד על אנדרואיד, iPhone ואינטרנט. הירשמו לסנכרון מנויים במכשירים שונים.