Synthesia Behind the Scenes: Lights, Camera, Avatars!

In #Synthesia Behind the Scenes: Lights, Camera, Avatars!, @Tosin Oshinyemi (Lead Avatar Producer) and @Josh Baker-Mendoza (Technical Supervisor) went deep into the creative and technical process behind Synthesia’s avatars—everything from casting and directing performances to AI processing and the future of Synthesia’s avatars.

GMT20250227-160206_Recording_gallery_1920x968.mp4

The Avatar Production team’s passion for their craft is clear. Every avatar, from the friendly Ada to the polished corporate spokespersons, is a result of meticulous planning, artistic direction, and advanced AI research.

We’re making tools that help people connect, teach, and inspire in ways they never could before.

— Tosin Oshinyemi

While AI avatars represent a leap forward in technology, they remain deeply human at their core. Tosin and Josh emphasized that their work isn’t about replacing people—it’s about enhancing human communication.

It’s easy to get caught up in the tech, but at the end of the day, what we do is about people. People creating. People communicating. AI is just a tool that lets us do that better.

— Josh Baker-Mendoza

Key highlights from the session:

  • How AI avatars are "born": The meticulous process of casting, directing, and filming actors to create lifelike digital personas.

  • Technical deep dive: The role of 4K ProRes RAW capture, optical flow algorithms, and speech-to-expression mapping in building ultra-realistic avatars.

  • Performance tips: How to deliver a natural performance, avoid robotic expressions, and maximize emotional authenticity.

  • The future of AI avatars: Our new upcoming model, full-body motion tracking, and adaptive AI-driven gestures.

Helpful links & resources:


Stay tuned for one of our next Synthesia Behind the Scenes sessions, where we’ll explore post-production magic with the team responsible for finalizing these incredible digital beings! We’ll post that event as soon as our schedule is finalized 😊

What was your biggest takeaway from this session? Do you have any questions for Tosin and Josh? Drop them in the comments below! 👇