התחל במצב לא מקוון עם האפליקציה Player FM !
#35 Mamba to Challenge the Transformer Architecture?
Manage episode 399488659 series 3332503
Welcome to the cozy corner of the tech world where ones and zeros mingle with casual chit-chat. Datatopics Unplugged is your go-to spot for relaxed discussions around tech, news, data, and society.
Dive into conversations that should flow as smoothly as your morning coffee (but don't), where industry insights meet laid-back banter. Whether you're a data aficionado or just someone curious about the digital age, pull up a chair, relax, and let's get into the heart of data, unplugged style!
In this episode, "Mamba to Challenge the Transformer Architecture?", we delve into a spectrum of tech topics and scrutinize the facets of productivity in the engineering realm. Here's a sneak peek of what we're discussing today:
- Checkout or Switch: Exploring new tech tools and their necessity. For further reading, check out this article.
- Mamba: A Viable Replacement for Transformers?: Discussing Mamba's potential to replace Transformer models in AI, and the paradigm shift it represents. Learn more in this LinkedIn post and look forward to its presentation at the ICLR 2024 conference.
- Biggest Productivity Killers in the Engineering Industry: Identifying the top productivity obstacles in engineering, including perfectionism, procrastination, and context-switching. Dive deeper into the topic here.
- Meta's Copyright Contradiction: Analyzing Meta's approach to copyright law in protecting its AI model while contesting similar protections for others. More on this discussion can be found here.
- Speeding Up Postgres Analytical Queries: Showcasing how pg_analytics enhances Postgres analytical queries by 94x, posing a question on the need for other tools. For more insights, visit this blog post.
Intro music courtesy of fesliyanstudios.com
פרקים
1. Meta's Copyright and Fair Use (00:00:00)
2. Understanding the Mamba Architecture in NLP (00:08:52)
3. Git Version Control and Transformer Architecture (00:14:15)
4. Productivity Killers and Git Commands (00:23:10)
5. Software Engineering (00:31:48)
6. Switching Contexts and Analyzing Postgres Performance (00:41:05)
84 פרקים
Manage episode 399488659 series 3332503
Welcome to the cozy corner of the tech world where ones and zeros mingle with casual chit-chat. Datatopics Unplugged is your go-to spot for relaxed discussions around tech, news, data, and society.
Dive into conversations that should flow as smoothly as your morning coffee (but don't), where industry insights meet laid-back banter. Whether you're a data aficionado or just someone curious about the digital age, pull up a chair, relax, and let's get into the heart of data, unplugged style!
In this episode, "Mamba to Challenge the Transformer Architecture?", we delve into a spectrum of tech topics and scrutinize the facets of productivity in the engineering realm. Here's a sneak peek of what we're discussing today:
- Checkout or Switch: Exploring new tech tools and their necessity. For further reading, check out this article.
- Mamba: A Viable Replacement for Transformers?: Discussing Mamba's potential to replace Transformer models in AI, and the paradigm shift it represents. Learn more in this LinkedIn post and look forward to its presentation at the ICLR 2024 conference.
- Biggest Productivity Killers in the Engineering Industry: Identifying the top productivity obstacles in engineering, including perfectionism, procrastination, and context-switching. Dive deeper into the topic here.
- Meta's Copyright Contradiction: Analyzing Meta's approach to copyright law in protecting its AI model while contesting similar protections for others. More on this discussion can be found here.
- Speeding Up Postgres Analytical Queries: Showcasing how pg_analytics enhances Postgres analytical queries by 94x, posing a question on the need for other tools. For more insights, visit this blog post.
Intro music courtesy of fesliyanstudios.com
פרקים
1. Meta's Copyright and Fair Use (00:00:00)
2. Understanding the Mamba Architecture in NLP (00:08:52)
3. Git Version Control and Transformer Architecture (00:14:15)
4. Productivity Killers and Git Commands (00:23:10)
5. Software Engineering (00:31:48)
6. Switching Contexts and Analyzing Postgres Performance (00:41:05)
84 פרקים
All episodes
×
1 #84 Let’s Get Meta: Why the Metadata You Ignore Might Be Costing You - with Special Guest Corentin 1:01:01

1 #83 Who’s Minding the Metadata? Why Data Quality Matters in GenAI (Quality Time With Paolo) 50:49

1 #82 AI Cracked a Decades-Old Science Problem & Europe’s Push for Digital Sovereignty, The Secret Behind MCP, and The Cloud Hack That Slashes Costs By 62%. 1:21:02

1 #81 AI Code Assistants: The Good, The Bad & The Overhyped, plus Python’s UV Glow-Up & Postman’s Existential Crisis 1:12:52

1 #80 AI Agents Run Wild, DeepSeek Breaks Records, Polars Cloud Expands, and Perplexity Reinvents Search 1:07:27

1 #79 The $6 AI Model? France’s $85B Bet, DeepSeek's Censorship & The Python Upgrades You Need 1:07:42

1 #78 The AI Act Lands, Meta Pauses, OpenAI Complains & DeepSeek Rises 44:36

1 #77 DeepSeek R1: The ‘Open’ AI That’s Shaking Up OpenAI - Plus OpenAI’s Operator, Stargate, ByteDance, & more 1:15:38

1 #76 AI at what cost? Environmental toll, Trump vs AI regulation, creative impact, & poisoned text for AI scrapers. 1:01:44

1 #75 Developer Productivity in 2025: AI Replaces Engineers, Biden’s AI Chip Regulations, UV’s Killer Feature, and Doom in a PDF 1:14:17

1 #74 Hello 2025! OpenAI’s O3, Deep Seek V3, Bolt.new and Doom Goes Artsy 1:09:35

1 #73 LLM Hunger Games: The Ultimate Showdown - Rootsconf recap (Part 3) 32:09

1 #72 Mastering Communication in the Workplace – Rootsconf Recap (Part 2) 27:59

1 #71 Navigating GenAI: How Organizations Must Adapt to Paradigm Shifts – Rootsconf Recap (part 1) 35:20

1 #70 What's Next for AI? A Recap of 2024 and Predictions for 2025 1:52:52

1 #69 From Engineer to CEO: Alex Gallego on Building Red Panda 1:04:44

1 #68 GenAI meets Minecraft, OpenAI’s O1 Leak, Strava’s AI Moves, HTMX vs. React & Octoverse Trends 1:33:06

1 #67 The AI Race: ChatGPT's New Web Search, Meta’s Llama AI Scaling Efforts & Python 3.13's Upgrades 1:09:54

1 #66 From Will Smith to Meta's MovieGen: How AI Video Got Real. Plus Claude 3.5’s “Computer Use” & Open Source Tools 59:34

1 #65 The Art of Data Storytelling: A Deep Dive with Angelica Lo Duca 1:04:20

1 #64 Python WTF moments, Rust rants & Quantum flops 1:06:05

1 #63 What’s Next for Open Source? Astral’s business model, WordPress, Deno 2.0 & One Year of DataTopics! 57:31

1 #62 The End of Pandas, Rise of Ibis: AI, Function Calling, & Python’s New Tools 1:13:44

1 #61 AI is Officially Smarter Than Humans: First Look at OpenAI O1 'Strawberry' 1:24:33

1 #60 AI and the Paris 2024 Olympics: From Tech to Yusuf Dikec Memes 47:49

1 #59 Did AI Accurately Predict the Euro 2024 Winners? (Part 2) 1:13:25

1 #58 Maximizing Productivity: Bookmarklets, Q Command-Line, RouteLLM, and DuckDB Extensions 46:37

1 #57 Can the Music Industry Win the Battle Against AI? 1:23:18

1 #56 What Skills Do You Need to Become an AI Engineer? & Tech Updates: Claude 3.5, Safe Superintelligence Inc. & more 51:39

1 #55 Can AI Predict Euro 2024 Winners? 59:37
ברוכים הבאים אל Player FM!
Player FM סורק את האינטרנט עבור פודקאסטים באיכות גבוהה בשבילכם כדי שתהנו מהם כרגע. זה יישום הפודקאסט הטוב ביותר והוא עובד על אנדרואיד, iPhone ואינטרנט. הירשמו לסנכרון מנויים במכשירים שונים.