Training your own LLM, Domain specific models | Naveen Rao, cofounder and CEO of MosaicML

Infinite Curiosity Pod with Prateek Joshi

Naveen Rao is the cofounder and CEO of MosaicML, a platform that enables you to train and deploy large AI models on your data in your secure environment. They've raised funding from amazing investors such as Lux Capital, Data Collective, and Maverick Ventures. Prior to this, he was the cofounder of Nervana. It got acquired by Intel for $408M.
In this episode, we cover a range of topics including:
- AI compute workloads
- Compute platform for training and inference
- How to train your own LLM
- Ways to reduce the cost of training AI models
- Advantages of training domain specific models
- In-context learning
- Context windows of LLMs
- Moat of AI-infused businesses
Naveen's favorite book: The Righteous Mind (Author: Jonathan Haidt)
--------
Where to find Prateek Joshi:
Newsletter: https://prateekjoshi.substack.com
Website: https://prateekj.com
LinkedIn: https://www.linkedin.com/in/prateek-joshi-91047b19
Twitter: https://twitter.com/prateekvjoshi