#054 - React Native Music Game with Kim Chouard (Skia, NativeWind, Expo AV)

Rocket Ship

In this conversation, Simon Grimm interviews Kim Chouard, a developer and educator, about his journey in coding, the challenges of building a multiplatform music game using React Native, and the innovative app Odisei Play that aims to help users learn to play wind instruments. Kim shares insights on the creative aspects of coding, the evolution of React Native, and the technology stack behind Odisei Play, including audio handling and pitch recognition. The discussion highlights the importance of education, creativity, and community in the tech space. In this conversation, Kim Chouard discusses the evolving landscape of development tools, particularly focusing on AI tools and their implications for new developers. He shares insights on the Expo audio package and the challenges faced in audio synchronization within applications. The discussion also delves into the use of Skia for performance optimization in React Native applications, highlighting its capabilities and the need for better documentation. Finally, Kim emphasizes the importance of a web-first approach in React Native development, advocating for a unified community that leverages the strengths of both web and mobile development.

Learn React Native - https://galaxies.dev

Kim Chouard

• Kim X: https://x.com/KimChouard
• Kim personal: https://chouard.kim/
• Kim LinkedIn: https://www.linkedin.com/in/kimchouard/

Links

• Odisei Music's website (creator of Odisei Play): https://odiseimusic.com/
• Kim AppJS Talk: https://www.youtube.com/watch?v=PGvhniTxpu4&ab_channel=SoftwareMansion
• Expo AV: https://docs.expo.dev/versions/latest/sdk/av/
• Chromatic: https://www.chromatic.com/
• Storybook: https://storybook.js.org/

Takeaways

• Kim's mission is to leverage games for alternative education.
• Coding can be a creative process, not just technical.
• Building a music game requires precise timing and performance.
• React Native's rapid evolution presents both opportunities and challenges.
• Odisei Play aims to make learning wind instruments accessible and fun.
• The app combines elements of gamification and music education.
• Skia is crucial for the performance of the Odisei Play app.
• Bluetooth technology can be optimized for real-time music applications.
• AI tools like Cursor can enhance coding efficiency.
• Community support is vital for navigating the fast-paced tech landscape. AI tools can accelerate development but may lead to inconsistencies.
• Expo AV is the only production-ready audio library available now, although it has some limitation
• New opportunities of more robust alternatives for audio handling are on the horizon (expo-audio, react-native audio, etc.)
• Audio synchronization remains a significant challenge in app development.
• Skia provides a powerful canvas for creating high-performance applications.
• The integration of web technologies can enhance React Native development.
• Community collaboration is essential for overcoming development hurdles.
• Real-time audio recognition is complex and requires advanced algorithms.
• A web-first approach can simplify the development process for React Native.
• The React Native community is passionate and supportive.
• Future advancements in 3D and game development are on the horizon.