#018: Implementing background jobs

Artistry of Code

📚 ABOUT THE EPISODE
Welcome to the 18th episode of the main series!
This time Grzegorz Godlewski and Marek Urbanowicz met up to discuss their experience and recommendations on implementing background jobs. Any system which is growing in scale, will need those at some point either to implement performance improvements (by putting some work into the background) or new business requirements (which are supposed to run in background).
Tune in for insights on how this can be done! 🎧
📑 TOPICS COVERED
👉 How simple business analysis can help you in determining candidates for background jobs
👉 What software architecture patterns come in handy while implementing them
👉 What are the best practices for reliable implementations
👉 Some tools/products which you might consider for your implementation
⌚ TIMELINE
00:00 - Intro
01:14 - How to identify candidates for background jobs
08:28 - Employ the transactional outbox pattern
11:53 - Dealing with state in background jobs
15:29 - Scheduling and processing batched operations
18:40 - Avoiding state with Event Carried State Transfer pattern
21:14 - Silver bullets and golden hammers - the tooling
28:08 - Emphasis on idempotency
🔗 LINKS FROM THE EPISODE
M. Fowler: What do you mean by “Event-Driven”?
https://martinfowler.com/articles/201701-event-driven.html
Transactional outbox pattern description
https://microservices.io/patterns/data/transactional-outbox.html
BullMQ
https://docs.bullmq.io/
RabbitMQ Delayed Message Plugin
https://github.com/rabbitmq/rabbitmq-delayed-message-exchange
Temporal:
https://temporal.io/
🤝 CONTACT US / COLLABORATION
If you:
- want to send us your valuable feedback
- you would like to appear on the show as a guest
- you would like to help out the show to grow
- you would like to sponsor the show
Then please contact us via: [e-mail]
You can also check out our website: https://artistryofcode.com
😍 FOLLOW US ON SOCIAL MEDIA
Facebook: https://www.facebook.com/ArtistryOfCode
Twitter: https://twitter.com/ArtistryOfCode
LinkedIn: https://www.linkedin.com/company/artistry-of-code
Reddit: https://www.reddit.com/r/ArtistryOfCode/
Grzegorz Godlewski
LinkedIn: https://www.linkedin.com/in/ggodlewski/
Twitter: https://twitter.com/GGodlewski
Marek Urbanowicz
LinkedIn: https://www.linkedin.com/in/marek-urbanowicz-0ba65254/
Twitter: https://twitter.com/UrbanowiczDev
Artur Wolny
LinkedIn: https://www.linkedin.com/in/artur-wolny-35150664/