#064 Data Engineering At Booking.com Case Study

Plumbers of Data Science

Player FM - Internet Radio Done Right

94 subscribers

הוסף לפני seven שנים

תוכן מסופק על ידי Andreas Kretz. כל תוכן הפודקאסטים כולל פרקים, גרפיקה ותיאורי פודקאסטים מועלים ומסופקים ישירות על ידי Andreas Kretz או שותף פלטפורמת הפודקאסט שלהם. אם אתה מאמין שמישהו משתמש ביצירה שלך המוגנת בזכויות יוצרים ללא רשותך, אתה יכול לעקוב אחר התהליך המתואר כאן https://he.player.fm/legal.

World of Secrets

1
The Killing Call: 1. The death of a star 35:12

לפני 10 ימים35:12

הפעל מאוחר יותר

רשימות

לייק

אהבתי

35:12

Sidhu Moose Wala explodes onto the Canadian music scene. His sound is a fusion of two worlds - hip-hop with the poetic language of rural Punjab, where he is from. After years of struggle he’s making it. But with the spotlight comes a dark side. As his fame grows, so do the threats. "We will kill you." Presented by broadcaster and DJ Bobby Friction and investigative journalist Ishleen Kaur. Season 8 of World of Secrets, The Killing Call, is a BBC Eye investigation for the BBC World Service. Archive audio credits: Lovepreet Waraich, Malwa TV, BritAsia TV, MPHONE Canteeni Mandeer, GK Digital, Thakur Media, Capital Extra, Famous Punjab TV, ModernSings, Dheeth.jeha, RealRohitBlogs, Mirror Now, India Today. Here’s a link to the BBC Eye two-part documentary films, which we recommend you watch after listening to this podcast: https://bit.ly/thekillingcall If you are in the UK, you can watch on iPlayer: https://www.bbc.co.uk/programmes/m002f18y…

לפני 6 שנים 59:09

MP3•בית הפרקים

סדרה בארכיון ("עדכון לא פעיל" status)

When? This feed was archived on August 04, 2020 21:15 (5y ago). Last successful fetch was on March 10, 2020 15:30 (5+ y ago)

Why? עדכון לא פעיל status. השרתים שלנו לא הצליחו לאחזר פודקאסט חוקי לזמן ממושך.

What now? You might be able to find a more up-to-date version using the search function. This series will no longer be checked for updates. If you believe this to be in error, please check if the publisher's feed link below is valid and contact support to request the feed be restored or if you have any other concerns about this.

A look into how booking.com is doing data engineering.

84 פרקים

#Tech #Data Science #Andreas Kretz

#064 Data Engineering At Booking.com Case Study

Plumbers of Data Science

94 subscribers

published לפני 6 שנים

שתפו

MP3•בית הפרקים

סדרה בארכיון ("עדכון לא פעיל" status)

When? This feed was archived on August 04, 2020 21:15 (5y ago). Last successful fetch was on March 10, 2020 15:30 (5+ y ago)

Why? עדכון לא פעיל status. השרתים שלנו לא הצליחו לאחזר פודקאסט חוקי לזמן ממושך.

A look into how booking.com is doing data engineering.

84 פרקים

#Tech #Data Science #Andreas Kretz

כל הפרקים

1
#085 Big Data and Data Science Landscape plus trying to read Tweets with Nifi 43:06

לפני 6 years43:06

43:06

We are looking into the network communication protocol map. I first saw this like 10 years ago and its awesome. Then we check out the Big Data and Data Science Landscape image. It shows you all the tools available to do data science, machine learning and data engineering. Which is very helpful if you are researching for tools to use. Before using the Twitter API you got to create a developer account. So, I show you how I created one. After that I tried to get Nifi to download Tweets but it is not working.…

1
#084 Behind the scenes: Audio podcast, free transcriptions and GitHub 51:21

לפני 6 years51:21

51:21

Today's podcast is a bit of a behind the scenes. What it takes to do a audio podcast. How you can get audio to text transcriptions for free. .Also Github questions on how to work with branches on the Cookbook

1
#083 Data Engineering at OLX Case Study 1:10:53

לפני 6 years1:10:53

1:10:53

Today a case study about OLX with a guest it was super fun! Here are the slides Alexeyand I talked about: https://www.slideshare.net/mobile/AlexeyGrigorev/image-models-infrastructure-at-olx

1
#082 Reading Tweets With Apache Nifi & IaaS vs PaaS vs SaaS 1:19:06

לפני 6 years1:19:06

1:19:06

In this episode we install the Nifi docker container and look into how we can extract the twitter data. We are also talking about the differences between infrastructure as a service, platform as a service and application as a service.

1
#081 How to get tweets from the Twitter API 1:09:47

לפני 6 years1:09:47

1:09:47

In this episode we look into the Twitter API documentation, which I love by the way. How can we get old tweets for a certain hashtags and how to get current live tweets for these hashtags.

1
#080 How To Find A Job In Germany & Answering Mails 54:54

לפני 6 years54:54

54:54

Tips on how you find a job in Germany and two super interesting mails.

1
#079 Trying to stay true to myself and making the cookbook public on GitHub 24:34

לפני 6 years24:34

24:34

The cookbook my Youtube, it will be for free, forever! Check out the data engineering cookbook on GitHub: https://github.com/andkret/Cookbook

1
#078 Cookbook collaboration and updates 31:08

לפני 6 years31:08

31:08

Updates of the cookbook and how to collaborate on it

1
#077 Lambda and Kappa Architecture 1:22:01

לפני 6 years1:22:01

1:22:01

In this episode we talk about the lambda architecture with stream and batch processing as well as a alternative the Kappa Architecture that consists only of streaming. Also Data engineer vs data scientist and we discuss Andrew Ng's AI Transformation Playbook

1
#076 Cloud vs On Premise How To Decide 1:15:56

לפני 6 years1:15:56

1:15:56

How do you choose between Cloud vs On-Premise, pros and cons and what you have to think about. Because there are good reasons to not go cloud. Also thoughts on how to choose between the cloud providers by just comparing instance prices. Otherwise the comparison will drive you insane.

1
#075 Creating the Course Structure For My Data Engineering Course 53:18

לפני 6 years53:18

53:18

In this episode we go over the ideas I have for the data engineering course structure. It was your chance for you to influence what we put in there.

1
#074 Starting My Data Engineering Online Course 1:01:19

לפני 6 years1:01:19

1:01:19

In this video we go over some of the 100+ comments I received on LinkedIn about a data engineering training.

1
#073 Data Engineering At LinkedIn Case Study 1:12:21

לפני 6 years1:12:21

1:12:21

Let's check out how LinkedIn is processing data

1
#072 Data Engineering At Twitter Case Study 56:27

לפני 6 years56:27

56:27

How is Twitter doing Data Engineering? Oh man, they have a lot of cool things to share these tweets.

1
#071 Data Engineering At Spotify Case Study 43:04

לפני 6 years43:04

43:04

In this episode we are looking at the data engineering at Spotify, my favorite music streaming service. How do they process all that data?

Plumbers of Data Science

1
#070 The Engineering Culture At Spotify 54:37

לפני 6 years54:37

54:37

In this podcast we look at the engineering culture at Spotify, my favorite music streaming service. The process behind the development of Spotify is really awesome.

Plumbers of Data Science

1
#069 Data Engineering At Pinterest Case Study 1:06:56

לפני 6 years1:06:56

1:06:56

A look into how Pinterest is doing data engineering.

Plumbers of Data Science

1
#068 A Budget Data Science PC Build 21:24

לפני 6 years21:24

21:24

Configuring a sub 1000 dollar PC for data engineering and machine learning Link to the builds: 900$ build: https://pcpartpicker.com/list/22ThcY 1500$ build: https://pcpartpicker.com/list/hXJdV6

Plumbers of Data Science

1
#067 Data Engineering At NASA Case Study 1:01:43

לפני 6 years1:01:43

1:01:43

A look into how NASA is doing data engineering.

Plumbers of Data Science

1
#066 How To Do Data Science From A Data Engineers Perspective 31:48

לפני 6 years31:48

31:48

A simple introduction how to do data science in the context of the internet of things.

Plumbers of Data Science

1
#065 Data Engineering At CERN Case Study 1:16:24

לפני 6 years1:16:24

1:16:24

A look into how CERN is doing Data Engineering. They get huge amounts of data from the Large Hydron Colider. Let's check it out.

Plumbers of Data Science

1
#064 Data Engineering At Booking.com Case Study 59:09

לפני 6 years59:09

59:09

A look into how booking.com is doing data engineering.

Plumbers of Data Science

1
#063 Data Engineering At Airbnb Case Study 1:02:59

לפני 6 years1:02:59

1:02:59

A look into how Airbnb is doing Data Engineering.

Plumbers of Data Science

1
#062 Data Engineering At Netflix Case Study 49:14

לפני 6 years49:14

49:14

How Netflix is doing Data Engineering using their Keystone platform

Plumbers of Data Science

1
#061 Reworking My Cookbook For Data Engineering 16:58

לפני 6 years16:58

16:58

I decided to rework the cookbook focusing more on case studies and less on explaining tools. People keep asking me for a path to become a data engineer and, let's be honest, you will never achieve that with just knowledge of the tools. Finding out how companies do data engineering on their data science platforms is way more useful. Over the next weeks we will go over each study on my YouTube channel. The stuff we talk about will then go into the cookbook too.…

Plumbers of Data Science

1
#060 What Is Hadoop And Is Hadoop Still Relevant In 2019? 24:12

לפני 6 years24:12

24:12

A Introduction into Hadoop HDFS, YARN and MapReduce. Yes, Hadoop is still relevant in 2019 even if you look into serverless tools.

Plumbers of Data Science

1
#059 A Look Into The Siemens Mindsphere IoT Platform? | #059 53:31

לפני 6 years53:31

53:31

The Internet of things is a huge deal. There are many platforms available. But, which one is actually good? Join me on a 50 minute dive into the Siemens Mindsphere online documentation. I have to say I was super unimpressed by what I found. Many limitations, unclear architecture and no pricing available? Not good!…

Plumbers of Data Science

1
#058 Guitars And Data Live Stream 1:36:29

לפני 6 years1:36:29

1:36:29

A stream full of mediocre guitar playing and great Q&A about Hadoop.

Plumbers of Data Science

1
#057 Introducing The Plumbers Medium Publication 12:59

לפני 6 years12:59

12:59

I have created a Medium Publication especially for us Plumbers of Data Science who work in Data Engineering and Big Data. It's called, you guessed it, Plumbers of Data Science.

Plumbers of Data Science

1
#056 NoSQL Key Value Stores Explained With HBase 58:16

לפני 6 years58:16

58:16

What is the difference between SQL and NoSQL? In this episode I show you on the example of HBase how a key/value store works.

Plumbers of Data Science

1
#38 Morning advice to beginner Data Scientists and Data Engineers 37:05

לפני 7 years37:05

37:05

What's the difference between Data Scientists & Data Analysts? What to do to find internships or a full time job? Data Scientist and Engineer in large and small companies where's the difference? Are Data Engineers generalists or specialists? Just some questions I go over in this podcast. You sent me over 100 Questions so, I finally worked up the guts to start with the Q&A videos. Answering your questions one by one. Turns out it's a lot of fun :)…

Plumbers of Data Science

1
#037 How To Boost Teamwork With Version Control 17:05

לפני 7 years17:05

17:05

Without the proper tools and techniques of version control the team's efficiency goes down the drain. In this episode I talk about how tools like Jira enable you to collect bugs, future features or change requests. How they enable you to create and organize versions, add items to a version and assign items to developers. Once this is done, the team can efficiently start coding with the help of source code management systems like GitHub. How does all that work? Check out this episode to find out :)…

Plumbers of Data Science

1
#036 Why Distributed Processing Is Super Important 22:30

לפני 7 years22:30

22:30

You need to become comfortable with distributed processing. Data Science or the Internet of Things, the amount of data that is getting produced and processed grows like crazy. In this podcast I talk about how a platform for distributed processing looks like. I talk about the different layers that need parallelization, as well as the tools you can use for on premise installations or clouds like AWS, Azure or Google Cloud. Big Data tools like Kafka, Spark or server less like Kinesis or Lambda functions.…

Plumbers of Data Science

1
#035 Learning By Doing Is The Best Thing Ever! 11:38

לפני 7 years11:38

11:38

For me, school and university was hard. The lectures, sitting down and getting told how things work. Reading books and learning dry stuff was a drag. I was never good at writing tests. Some people excel at this. I was often envious. Over the years I found out what my problem is. I learn differently. I am a learning by doing guy. What does that means and how am I dealing with it? Check out this episode. Maybe you have the same problem.…

Plumbers of Data Science

1
#034 Talent Stacks For Data Engineers 22:30

לפני 7 years22:30

22:30

Becoming an expert in single skill is not the way to go for a data engineer. In this episode I talk about which talents go good together in terms of technical and personal ones. So, that you build up a stack of knowledge that will make you a great data engineer.

Plumbers of Data Science

1
#033 How APIs Rule The World 36:15

לפני 7 years36:15

36:15

Strong APIs make a good platform. In this episode I talk about why you need APIs and why Twitter is a great example. Especially JSON APIs are my personal favorite. Because JSON is also important in the Big Data world, for instance in log analytics. How? Check out this episode!

Plumbers of Data Science

1
#032 How to Design Security Zones and Lambda Architecture 17:42

לפני 7 years17:42

17:42

Security is everything! That's why today, I took some time to give you some tips about how to make a good design. The Lambda Architecture with stream and batch processing is one of the cornerstones for Big Data and Data Science. How does that fit into a security zone design? Check out this episode :)…

Plumbers of Data Science

1
#031 IT Networking Infrastructure and Linux 32:16

לפני 7 years32:16

32:16

The understanding of how information is transported over the network is super important. OS wise you will mostly encounter Linux so here are some important Linux basics you need to know. Firewalls, Ports, IP-Adresses, Routers and Switches, only a few things I talk about in this podcast. Networking infrastructure also matters for Big Data systems like Hadoop, Kafka and Spark.…

Plumbers of Data Science

1
#030 Why the hardware and the GPU is super important 19:40

לפני 7 years19:40

19:40

Knowing the hardware is super important for a data engineer. Even if you are using cloud servers. CPU, RAM, GPU, HDD, SSD... Especially the GPU is a great help to Data Scientists who are doing machine learning.

Plumbers of Data Science

1
#029 A New Mission 5:24

לפני 7 years5:24

5:24

I am bringing the Podcast back! Lets call it season 2. New name, new mission: Helping you become a data engineer. Daily podcast, recorded in my car or my office, getting you up to speed ASAP.

Plumbers of Data Science

1
4 Vs Of Big Data Are Enough! 11:05

לפני 7 years11:05

11:05

8 V's, 10 V's, 12 V's . The best way to explain Big Data is to use the four V's: Volume, Velocity, Variety and Veracity. In this podcast episode I talk about why nobody needs 10 or more V's of big data. And how Big Data is almost a must have, to do data science and especially machine learning. The music in this episode is the song The Quiet Earth by Thomas Barrandon. Check out his awesome music on Bandcamp. He is also on Spotify ;) Have fun!…

Plumbers of Data Science

1
Why Companies Badly Need Data Scientists And Engineers 3:19

לפני 7 years3:19

3:19

In this episode I give you my take on why companies badly need data scientists and engineers. Because in this data driven world, you can accomplish a lot with just a few people. All you need is a vision, some sense for business and a lot of skill.

Plumbers of Data Science

1
What You Need To Know About Data Engineering 16:28

לפני 7 years16:28

16:28

This podcast is all about what you as a data engineer really do. From building platforms to collaboration with data scientists and customers. Everything you need to know to get insight into a data engineers life.

Plumbers of Data Science

1
I'm a Big Data Engineer and it's Super Awesome! 6:44

לפני 7 years6:44

6:44

There is this other data science job called data engineer and it's super important. Because data science does not equal data scientist. In today's podcast I talk about how I finally realized that data engineering is my real passion. Definitely check it out, chances are high that data engineering is your thing too.…

Plumbers of Data Science

1
BI vs Data Science vs Big Data 7:43

לפני 7 years7:43

7:43

I have recently been asked: "What is the difference between BI, Data Science and Big Data". So, it thought I make a quick podcast about this for you guys. I think especially beginners will help this a lot.

ברוכים הבאים אל Player FM!

Player FM סורק את האינטרנט עבור פודקאסטים באיכות גבוהה בשבילכם כדי שתהנו מהם כרגע. זה יישום הפודקאסט הטוב ביותר והוא עובד על אנדרואיד, iPhone ואינטרנט. הירשמו לסנכרון מנויים במכשירים שונים.