51 subscribers
התחל במצב לא מקוון עם האפליקציה Player FM !
פודקאסטים ששווה להאזין
בחסות


1 Tiffany Yu — Smashing Stereotypes and Building a Disability-Inclusive World 30:23
108. How to Solve Lambda Python Cold Starts
Manage episode 389516288 series 2980070
In this episode, we discuss how you can use Python for data science workloads on AWS Lambda. We cover the pros and cons of using Lambda for these workloads compared to other AWS services. We benchmark cold start times and performance for different Lambda deployment options like zip packages, layers, and container images. The results show container images can provide faster cold starts than zip packages once the caches are warmed up. We summarize the optimizations AWS has made to enable performant container image deployments. Overall, Lambda can be a good fit for certain data science workloads, especially those that are bursty and need high concurrency.
💰 SPONSORS 💰 AWS Bites is brought to you by fourTheorem, an Advanced AWS Partner. If you are moving to AWS or need a partner to help you go faster, check us out at fourtheorem.com ! In this episode, we mentioned the following resources.
- Our blog post detailing our research on how to optimise Python Data Science in AWS Lambda: https://fourtheorem.com/optimise-python-data-science-aws-lambda/
- The repository with our benchmarks and related visualizations: https://github.com/fourTheorem/lambda-datasci-perf
- On-demand Container Loading on AWS Lambda (AWS Paper): https://arxiv.org/abs/2305.13162
Do you have any AWS questions you would like us to address? Leave a comment here or connect with us on X, formerly Twitter: - https://twitter.com/eoins - https://twitter.com/loige
149 פרקים
Manage episode 389516288 series 2980070
In this episode, we discuss how you can use Python for data science workloads on AWS Lambda. We cover the pros and cons of using Lambda for these workloads compared to other AWS services. We benchmark cold start times and performance for different Lambda deployment options like zip packages, layers, and container images. The results show container images can provide faster cold starts than zip packages once the caches are warmed up. We summarize the optimizations AWS has made to enable performant container image deployments. Overall, Lambda can be a good fit for certain data science workloads, especially those that are bursty and need high concurrency.
💰 SPONSORS 💰 AWS Bites is brought to you by fourTheorem, an Advanced AWS Partner. If you are moving to AWS or need a partner to help you go faster, check us out at fourtheorem.com ! In this episode, we mentioned the following resources.
- Our blog post detailing our research on how to optimise Python Data Science in AWS Lambda: https://fourtheorem.com/optimise-python-data-science-aws-lambda/
- The repository with our benchmarks and related visualizations: https://github.com/fourTheorem/lambda-datasci-perf
- On-demand Container Loading on AWS Lambda (AWS Paper): https://arxiv.org/abs/2305.13162
Do you have any AWS questions you would like us to address? Leave a comment here or connect with us on X, formerly Twitter: - https://twitter.com/eoins - https://twitter.com/loige
149 פרקים
כל הפרקים
×
1 145. We Tried Amazon DSQL So You Don’t Have To (But You Might Want To) 28:34

1 144. Lambda Billing Changes, Cold Start Costs, and Log Savings: What You Need to Know 13:22

1 143. Is App Runner better than Fargate? 42:09

1 141. Step Functions with JSONata and Variables 15:43

1 140. DuckDB Meets AWS: A Match Made in Cloud 17:38

1 139. Building Great APIs with Powertools 24:32

1 138. How Do You Become A Cloud Architect? 39:02

1 136. 20 Amazing New AWS Features 17:39

1 135. Serverless is making a comeback where you least expect it 21:46

1 133. Building Businesses in the Cloud with Fiona McKenna 28:28

1 132. GitHub Action Runners on AWS 24:40

1 131. What do you do about CloudFormation Drift? 19:44
ברוכים הבאים אל Player FM!
Player FM סורק את האינטרנט עבור פודקאסטים באיכות גבוהה בשבילכם כדי שתהנו מהם כרגע. זה יישום הפודקאסט הטוב ביותר והוא עובד על אנדרואיד, iPhone ואינטרנט. הירשמו לסנכרון מנויים במכשירים שונים.