Multimodal Video Understanding

Infinite Curiosity Pod with Prateek Joshi

Player FM - Internet Radio Done Right

14 subscribers

הוסף לפני three שנים

תוכן מסופק על ידי Prateek Joshi. כל תוכן הפודקאסטים כולל פרקים, גרפיקה ותיאורי פודקאסטים מועלים ומסופקים ישירות על ידי Prateek Joshi או שותף פלטפורמת הפודקאסט שלהם. אם אתה מאמין שמישהו משתמש ביצירה שלך המוגנת בזכויות יוצרים ללא רשותך, אתה יכול לעקוב אחר התהליך המתואר כאן https://he.player.fm/legal.

<div class="span index">1</div> <span><a class="" data-remote="true" data-type="html" href="/series/ask-grumpy">Ask Grumpy</a></span>

1
Ask Grumpy

בטל רישום

לפני 10 hoursלפני 10h ago

בטל רישום

שבועי

Ask Grumpy, a podcast featuring Steve Bender, AKA Southern Living’s Grumpy Gardener is back for Season 3. For more than 30 years, Grumpy has been sharing advice on what to grow, when to plant, and how to manage just about anything in your garden. Tune in for short episodes every Wednesday and Saturday as Grumpy answers reader questions, solves seasonal conundrums, and provides need-to-know advice for gardeners with his very Grumpy sense of humor. Be sure to follow Ask Grumpy wherever you listen so you don't miss an episode.

לפני שנה 42:12

MP3•בית הפרקים

Jae Lee is the cofounder and CEO of Twelve Labs, where they are building video understanding infrastructure to help developers build programs that can see, hear, and understand the world. He was previously the Lead Data Scientist at the Ministry of National Defense in South Korea. He has a bachelors in computer science from UC Berkeley.
In this episode, we cover a range of topics including:
- What is multimodal video understanding
- State of play in multimodal video
- The founding of Twelve Labs
- The launch of Pegasus-1
- Four core principles: Efficient Long-form Video Processing, Multimodal Understanding, Video-native Embeddings, Deep Alignment between Video and Language Embeddings
- Differences between multimodal vs traditional video analysis
- In what ways can malicious actors misuse this technology?
- The future of multimodal video understanding
Jae's favorite books:
- Deep Learning (Authors: Ian Goodfellow, Yoshua Bengio, Aaron Courville)
- The Giving Tree (Author: Shel Silverstein)
--------
Where to find Prateek Joshi:
Newsletter: https://prateekjoshi.substack.com
Website: https://prateekj.com
LinkedIn: https://www.linkedin.com/in/prateek-joshi-91047b19
Twitter: https://twitter.com/prateekvjoshi

171 פרקים

#Tech #Prateek Joshi

Multimodal Video Understanding

Infinite Curiosity Pod with Prateek Joshi

14 subscribers

published לפני שנה

שתפו

MP3•בית הפרקים

171 פרקים

#Tech #Prateek Joshi

כל הפרקים

1
Converting Cameras into Autonomous AI Agents | Rish Gupta, CEO of Spot AI 38:50

לפני 29 ימים38:50

38:50

Rish Gupta is the cofounder and CEO of Spot AI, a video AI platform for the physical world. They've raised $93M from amazing investors such as Scale, Bessemer, and Qualcomm Ventures. Rish's favorite book: Atlas Shrugged (Author: Ayn Rand) (00:01) Introduction (00:32) Video-AI basics: ingesting camera feeds across diverse networks (02:42) Edge-vs-cloud trade-offs for compute, storage, and bandwidth (05:40) Mapping the sector: hardware waves to cloud cameras to pure-software layer (07:43) Founding insight: why Spot AI attacked the video layer now (11:35) Bare-bones MVP: two-page dashboard that unified camera access (15:34) First-10-customer lessons & pruning the ideal customer profile (ICP) (18:54) Go-to-market experiments: ICP variants, pain points, and channels (23:00) Early-team blueprint: engineering-heavy, founders run sales (24:03) Hardware stance: free IP cameras to simplify one-vendor buying (26:01) Biggest tech hurdle: supporting thousands of camera brands & configs (27:00) Sales challenge: outbound fatigue forces novel GTM motions (28:55) Future vision: each camera becomes an autonomous AI agent with a "job" (30:25) Key AI unlock: massive context windows enabling flow-state reasoning (32:14) Rapid-fire round -------- Where to find Rish Gupta: LinkedIn: https://www.linkedin.com/in/profilerish/ -------- Where to find Prateek Joshi: Newsletter: https://prateekjoshi.substack.com Website: https://prateekj.com LinkedIn: https://www.linkedin.com/in/prateek-joshi-91047b19 X: https://x.com/prateekvjoshi…

1
Are AI Phone Agents Ready for Prime Time? | Alex Levin, CEO of Regal 45:21

לפני 5 weeks45:21

45:21

Alex Levin is the cofounder and CEO of Regal, a platform for AI phone agents. They've raised $82M from amazing investors such as Emergence Capital. Alex's favorite book: The PayPal Wars (Author: Eric M. Jackson) (00:01) Introduction (02:37) Evolution of customer contact tools and legacy players (06:02) Launching Regal: Origin story and early challenges (08:41) MVP strategy and problems worth solving (11:46) Lessons from 0 to 10 customers: Growth mistakes and hiring (16:13) Ideal early-stage team construction and hiring philosophy (19:06) Sequencing hires as company scales (20:58) What makes a good investor and how to leverage them (25:42) Best and worst experiments while building Regal (29:04) Internal use of AI at Regal across teams (31:49) The future of AI phone agents and near-term blockers (34:13) Rapid Fire Round -------- Where to find Alex Levin: LinkedIn: https://www.linkedin.com/in/alexlevin1/ -------- Where to find Prateek Joshi: Newsletter: https://prateekjoshi.substack.com Website: https://prateekj.com LinkedIn: https://www.linkedin.com/in/prateek-joshi-91047b19 X: https://x.com/prateekvjoshi…

1
What it Takes to Build a BI Platform | Colin Zima, CEO of Omni 40:07

לפני 6 weeks40:07

40:07

Colin Zima is the cofounder and CEO of Omni, a data platform that combines the consistency of a shared data model with the speed and freedom of SQL. They recently raised their $69M Series B led by ICONIQ Growth. He was previously the Chief Analytics Officer at Looker. Colin's favorite book: Blink (Author: Malcolm Gladwell) (00:01) Introduction (01:10) What Is a Data Model and Why It Matters (03:27) Gaps in the Modern Data Stack (05:38) The Staying Power of SQL (07:29) Origin Story: Why Omni Was Created (10:13) Lessons from Building the MVP (12:48) Go-to-Market Insights: Zero to Ten Customers (16:02) Founder-Led Sales and Marketing Tactics (18:58) Company Building: Recruiting and Product Challenges (21:34) Product Positioning in a Crowded Market (23:26) Design Philosophy in Enterprise Software (28:21) Omni's Tech Stack and Development Strategy (28:57) Real-World Use of AI Inside the Company (31:01) Future of Data Tooling and Role of AI (33:49) Rapid Fire Round -------- Where to find Colin Zima: LinkedIn: https://www.linkedin.com/in/colinzima/ -------- Where to find Prateek Joshi: Newsletter: https://prateekjoshi.substack.com Website: https://prateekj.com LinkedIn: https://www.linkedin.com/in/prateek-joshi-infinite X: https://x.com/prateekvjoshi…

1
Building Billing Infrastructure for AI Companies | Alvaro Morales, CEO of Orb 38:21

לפני 7 weeks38:21

38:21

Alvaro Morales is the cofounder and CEO of Orb, a usage-based billing product for modern software companies. They've raised $44M to date from amazing investors such as Mayfield, Menlo Ventures, and Greylock. Alvaro's favorite book: Conversation in the Cathedral (Author: Mario Vargas Llosa) (00:01) Introduction (00:35) What is Usage-Based Billing? (02:27) Challenges in Metering Usage (04:14) Examples of Consumption-Based Products (05:49) Tools for Usage Metering and Billing (09:08) Founding Story and Validation of Orb (12:11) Building the MVP for a Billing System (14:48) Acquiring the First 10 Customers (18:33) Scaling Sales & Marketing After Initial Traction (21:09) Building the Team & Ideal Candidate Profile (23:26) Technology Stack Behind Orb (25:55) Real-Time Analytics vs Streaming for Billing (27:18) Other Key Components of Orb's Solution (28:38) Why Incumbents Haven’t Solved This Problem (31:09) How Orb Uses AI Internally (32:53) Most Exciting AI Advancements for the Future (34:30) Rapid Fire Round -------- Where to find Alvaro Morales: LinkedIn: https://www.linkedin.com/in/alvaro-morales/ -------- Where to find Prateek Joshi: Newsletter: https://prateekjoshi.substack.com Website: https://prateekj.com LinkedIn: https://www.linkedin.com/in/prateek-joshi-infinite X: https://x.com/prateekvjoshi…

1
Turning Legal Services to APIs | Jay Madheswaran, CEO of Eve 41:02

לפני 9 weeks41:02

41:02

Jay Madheswaran is the cofounder and CEO of Eve, a legal AI platform for plaintiff law firms. They recently raised their $47M Series A from Andreessen Horowitz, Lightspeed, and Menlo Ventures. He was previously a partner at Lightspeed and the first engineer at Rubrik. Jay's favorite book: The Truth Detector (Author: Jack Schafer) (00:01) Introduction (00:44) Overview of Legal AI and Industry Impact (03:53) Daily Operations in Plaintiff Law Firms (05:49) Identifying and Launching Eve's MVP (08:58) Framework for Building an Effective MVP (12:02) Acquiring Early Customers (Zero to Ten) (14:20) Scaling Beyond Early Customers: Growth Strategies (16:08) Encouraging Word-of-Mouth and Inbound Growth (18:21) Product Development and Customer Feedback Loops (20:27) Eve's Technology Stack and Internal AI Usage (22:16) Team Structure and Leadership Development (24:20) Role and Impact of Designers in Early Startups (27:15) Future Trends in Legal AI: Consolidation vs. Specialization (30:29) Exciting AI Advancements Relevant to Eve (31:58) Rapid Fire Questions -------- Where to find Jay Madheswaran: LinkedIn: https://www.linkedin.com/in/jayanth1/ -------- Where to find Prateek Joshi: Newsletter: https://prateekjoshi.substack.com Website: https://prateekj.com LinkedIn: https://www.linkedin.com/in/prateek-joshi-91047b19 X: https://x.com/prateekvjoshi…

1
Is LLM the New Operating System? | Anant Bhardwaj, CEO of Instabase 45:37

לפני 10 weeks45:37

45:37

Anant Bhardwaj is the founder and CEO of Instabase, an AI-native unstructured data platform. They've raised $322M in funding to date from NEA, Andreessen Horowitz, Greylock, and Index Ventures. He did his masters from Stanford and PhD from MIT. Anant's favorite book: The Singularity Is Near (Author: Ray Kurzweil) (00:07) Defining Unstructured Data (01:18) The Growth of Unstructured Data and Its Challenges (02:05) Evolution of Tools for Analyzing Unstructured Data (04:25) How Large Language Models (LLMs) Changed Data Processing (05:27) Do We Still Need ETL in the LLM Era? (06:05) Structured Queries vs. Direct Unstructured Querying (08:22) Applying LLMs in Enterprise Settings (09:34) Ensuring Accuracy in AI-Driven Data Analysis (11:29) SQL vs. AI-Driven Queries in Business Use Cases (13:48) Retrieval-Augmented Generation (RAG) for Enterprise AI (15:02) The Founding of Instabase and Its Early Vision (19:03) Building the MVP of Instabase (22:52) First 10 Customers: Lessons from Early Sales (26:01) Scaling Customer Acquisition: Experiments and Failures (30:35) When to Hire a Sales Team: Key Lessons (33:52) AI Adoption at Instabase for Internal Productivity (37:48) The Technology Stack Behind Instabase (42:36) Transition from OS-Based Architecture to LLM-Based System (43:45) Rapid Fire Questions -------- Where to find Anant Bhardwaj: LinkedIn: https://www.linkedin.com/in/anantpb/ -------- Where to find Prateek Joshi: Newsletter: https://prateekjoshi.substack.com Website: https://prateekj.com LinkedIn: https://www.linkedin.com/in/prateek-joshi-91047b19 X: https://x.com/prateekvjoshi…

1
Building AI Agents That Actually Work | Malte Kosub, CEO of Parloa 33:54

לפני 12 weeks33:54

33:54

Malte Kosub is the cofounder and CEO of Parloa, an AI agent platform for customer service. They raised their $66M Series B led by Altimeter. Malte's favorite book: The Qualified Sales Leader (Author: John McMahon) (00:01) Introduction (00:26) Overview of AI in Customer Support (01:33) The Current Landscape of AI Agents (02:46) Enterprise Adoption of AI Agents (04:16) The Founding Story of Parloa (06:25) Deciding What Goes into V1 of a Product (07:56) Achieving 99.9999% Accuracy in AI Agents (09:29) How to Identify Customer Needs for AI Products (10:55) Scaling from Early Customers to the Next 10 (12:41) Growth Experiments: What Worked and What Didn’t (14:42) Current State of Parloa: Capabilities and Scale (16:36) Structuring Teams for AI-First Companies (18:49) Technology Stack and Internal AI Use Cases (21:29) How to Pitch an AI Product to Enterprises (23:32) Essential Tools Used Inside the Company (25:41) AI’s Role in Daily Life and Workflows (27:54) The Future of AI Agents in Customer Support (28:37) Can AI Agents Fully Replace Human Agents? (29:05) Exciting AI Advancements Impacting Parloa (30:06) Rapid Fire Round -------- Where to find Malte Kosub: LinkedIn: https://www.linkedin.com/in/maltekosub/ -------- Where to find Prateek Joshi: Newsletter: https://prateekjoshi.substack.com Website: https://prateekj.com LinkedIn: https://www.linkedin.com/in/prateek-joshi-infinite X: https://x.com/prateekvjoshi…

1
3000 Customers, One Bold Pivot: Building the First Generative AI Copilot for Lawyers | Scott Stevenson, CEO of Spellbook 44:07

לפני 13 weeks44:07

44:07

Scott Stevenson is the cofounder and CEO of Spellbook. They launched the first generative AI copilot for lawyers. It's used by more than 3,000 law firms and are growing really fast. They most recently raised $20M Series A from investors such as Inovia, Bling, and Moxxie. Scott's favorite book: Zero to One (Author: Peter Thiel) (00:01) Introduction (00:06) The basics of legal AI and its applications (02:57) How lawyers use AI for contract review and drafting (03:22) Inspiration from GitHub Copilot and AI’s role in legal work (04:19) AI in litigation vs. transactional legal work (06:37) Why AI adoption in legal work accelerated (07:07) The launch story of Spellbook (07:45) Finding the right problem to solve in legal tech (10:11) How GitHub Copilot influenced Spellbook’s early direction (11:42) Spellbook’s first prototype and early traction (13:11) The moment Spellbook realized it had product-market fit (14:31) Measuring actual product usage and customer adoption (15:27) Early learnings from new customers (17:59) Growth experiments: what worked and what failed (20:48) Discovering unexpected customer segments (22:50) Company building philosophy and structuring Spellbook (26:18) Avoiding over-optimization for structure in startups (30:21) How to decide what to ship in a startup (32:21) Pattern-matching vs. narrative reasoning in product development (35:39) Lessons from AI contract review and LLM usage (36:14) Rapid-fire round…

1
The Outer Loop of AI-Powered Coding | Merrill Lutsky, CEO of Graphite 41:26

לפני 14 weeks41:26

41:26

Merrill Lutsky is the cofounder and CEO of Graphite, an AI-powered code reviewer that's used by tens of thousands of users. They are backed by amazing investors including Andreessen Horowitz. Merrill's favorite book: Never Split the Difference (Author: Chris Voss) (00:01) Introduction (00:06) Teaching AI to Understand Code (02:40) AI-Assisted Code Generation and Code Review (06:20) Current Landscape of AI-Assisted Code Review (09:04) Motivation Behind Launching Graphite (16:52) Landing the First Paying Users and Early Learnings (21:42) Growth Experiments: Wins and Misses (26:27) Current Scale of Graphite (29:12) Tech Stack Behind Graphite (33:12) Future of AI-Assisted Coding and Graphite’s Role (35:37) Rapid Fire Round -------- Where to find Merrill Lutsky: LinkedIn: https://www.linkedin.com/in/merrill-lutsky/ -------- Where to find Prateek Joshi: Newsletter: https://prateekjoshi.substack.com Website: https://prateekj.com LinkedIn: https://www.linkedin.com/in/prateek-joshi-91047b19 X: https://x.com/prateekvjoshi…

1
Behind the Scenes of AI Video | Amit Jain, founder of Luma AI 48:19

לפני 16 weeks48:19

48:19

Amit Jain is the cofounder and CEO of Luma AI, an AI platform to create realistic looking videos. They're backed by Andreessen Horowitz, Amazon, and AMD. He was previously at Apple where he worked on VisionPro. Amit's favorite book : Skunk Works (Authors: Ben R. Rich, Leo Janos) (00:01) Introduction (00:26) How Can AI Models Generate Realistic Videos (02:38) The Current Landscape of Video Generation (06:16) Teaching AI Models the Laws of Physics (09:47) Founding Luma: Deciding on the First Product Version (12:56) Validating Market Need & User Feedback (16:42) Key Learnings from Ray 1 Before Launching Ray 2 (21:24) Growth Hacks That Moved the Needle (24:27) From Zero Users to Today: The Growth Journey (27:53) Building a Community Around Luma (30:57) Luma’s Technology Stack & AI Infrastructure (36:42) Biggest Technical Challenges in Building Luma (39:24) The Future of Video Generation & AI's Role (41:54) Rapid Fire Round -------- Where to find Amit Jain: LinkedIn: https://www.linkedin.com/in/gravicle/ -------- Where to find Prateek Joshi: Newsletter: https://prateekjoshi.substack.com Website: https://prateekj.com LinkedIn: https://www.linkedin.com/in/prateek-joshi-91047b19 X: https://x.com/prateekvjoshi…

1
Building an AI-Powered Terminal | Zach Lloyd 38:06

לפני 17 weeks38:06

38:06

Zach Lloyd is the cofounder and CEO of Warp, the intelligent terminal powered by AI. They recently raised their $50M Series B led by Sequoia Capital. He was previously the cofounder of SelfMade and the interim CTO of TIME. Zach's favorite book : The Death of Ivan Ilyich (Author: Leo Tolstoy) (00:01) Introduction (00:07) Basics of the Terminal: What It Does and Why Developers Use It (01:48) Foundation of Warp: Addressing Terminal Shortcomings (05:00) Initial Feature Set: Building Warp’s Early Product (07:19) Product Iteration and Retaining Early Users (10:15) AI Integration in Warp: Initial Use Cases and Evolution (14:00) Technical Challenges: Building Warp in Rust (16:25) Feature Prioritization: Balancing Feedback and Vision (18:26) Warp's Tech Stack: Languages, Frameworks, and Tools (22:22) Cross-Platform Development Challenges (23:07) Importance of Design: Competitive Advantage in Dev Tools (26:10) Hiring for Design in Early-Stage Startups (30:22) Warp’s Vision for the Next Five Years (32:15) Lessons from Scaling Warp: Advice to Younger Self (34:02) Rapid Fire Round -------- Where to find Zach Lloyd: LinkedIn: https://www.linkedin.com/in/zachlloyd/ -------- Where to find Prateek Joshi: Newsletter: https://prateekjoshi.substack.com Website: https://prateekj.com LinkedIn: https://www.linkedin.com/in/prateek-joshi-91047b19 Twitter: https://twitter.com/prateekvjoshi…

1
When Robots Go Haywire, Who Picks Up The Tab? | Amias Gerety 48:54

לפני 18 weeks48:54

48:54

Amias Gerety is a partner at QED Investors, a fintech-focused VC firm with $3.8 Billion under management. He was previously the Assistant Secretary at the US Department of Treasury. And he graduated from Harvard. Amias's favorite finance book: Lombard Street: A Description of the Money Market (Author: Walter Bagehot) (00:01) Introduction (00:46) Why Do Robots Need Insurance? (03:04) Challenges for Insurance Companies with Robot Liability (07:34) Risks of Autonomous Robots in Industrial vs. Domestic Settings (12:22) Cybersecurity and Hacking Risks in Robotics (15:41) Importance and Challenge of Historical Data in Robotics Insurance (18:52) Leveraging Telemetry Data for Risk Modeling (22:09) Creating a Functional Insurance Market for Robotics (26:42) Should Robots Be Independent Legal Entities? (28:34) Should Robots Buy Their Own Insurance? (32:30) Partnerships Between Insurers and Robotics Companies (37:11) Regulatory Framework for Robotics Insurance (38:57) Advice for Founders in Robotics Insurance (40:07) Rapid Fire Round -------- Where to find Amias Gerety: LinkedIn: https://www.linkedin.com/in/amias-gerety/ -------- Where to find Prateek Joshi: Newsletter: https://prateekjoshi.substack.com Website: https://prateekj.com LinkedIn: https://www.linkedin.com/in/prateek-joshi-91047b19 Twitter: https://twitter.com/prateekvjoshi…

1
Building MotherDuck to a $400M Company 49:18

לפני 19 weeks49:18

49:18

Jordan Tigani is the cofounder and CEO of MotherDuck, a data warehouse platform based on open source database DuckDB. They've raised $100M in funding from amazing investors like Andreessen Horowitz, Felicis, Madrona, and Altimeter. He was previously the CPO at SingleStore and spent 11 years at Google before that. He has a degree in electrical engineering from Harvard. Jordan's favorite book : The Master and Margarita (Author: Mikhail Bulgakov) (00:01) Introduction (00:08) Founding of MotherDuck (01:12) The Philosophy of Shipping Products at MotherDuck (05:02) Founding Story and Identifying the Market Opportunity (10:57) Building the First Version and Overcoming Early Challenges (12:23) Validating Customer Needs and Asking the Right Questions (18:24) Deciding What Features to Prioritize and Exclude (21:30) Positioning a New Product in a Mature Market (27:36) Overcoming Challenges in Scaling MotherDuck (32:29) Measuring Success of New Features in Enterprise Products (36:20) Structuring the Organization for Effective Execution (41:09) Preparing MotherDuck for the AI Native Era (43:28) Rapid Fire Round -------- Where to find Jordan Tigani: LinkedIn: https://www.linkedin.com/in/jordantigani/ -------- Where to find Prateek Joshi: Newsletter: https://prateekjoshi.substack.com Website: https://prateekj.com LinkedIn: https://www.linkedin.com/in/prateek-joshi-91047b19 Twitter: https://twitter.com/prateekvjoshi…

לפני 2 years27:38

27:38

In this episode, the host Prateek Joshi talks about 13 areas in Biology where Generative AI is going to make a big impact: 1. Drug discovery 2. Protein design 3. Synthetic data generation 4. Discovering gene regulatory networks 5. Metagenomics 6. Ecology 7. Drug repurposing 8. Genome assembly 9. Disease prediction and diagnosis 10. Single-cell transcriptonomics 11. Evolutionary biology 12. Protein-Protein interaction 13. Personalized medicine -------- Where to find Prateek Joshi: Newsletter: https://prateekjoshi.substack.com Website: https://prateekj.com LinkedIn: https://www.linkedin.com/in/prateek-joshi-91047b19 Twitter: https://twitter.com/prateekvjoshi…

ברוכים הבאים אל Player FM!

Player FM סורק את האינטרנט עבור פודקאסטים באיכות גבוהה בשבילכם כדי שתהנו מהם כרגע. זה יישום הפודקאסט הטוב ביותר והוא עובד על אנדרואיד, iPhone ואינטרנט. הירשמו לסנכרון מנויים במכשירים שונים.