What is LivePortrait?
An open-source AI model for portrait animation. It generates natural head movements, facial expressions, and eye blinks from a single photo. Combined with Wav2Lip for lip sync, it forms the core of Puppetry's animation pipeline.
Related Terms
Wav2Lip
A neural network that generates accurate lip movements from audio input. It takes a face image and audio waveform, then produces video frames with perfectly synced mouth movements. Known for high accuracy across languages and accents.
AI Puppet
A still image (photo, illustration, or 3D render) that can be animated to speak using AI. Unlike traditional puppets, AI puppets require no physical manipulation — you upload a photo and the AI handles lip sync, head movement, and expressions.
Photo-to-Video
Converting a static photograph into an animated video. AI analyzes facial features in the photo and generates realistic motion including lip sync, head turns, and expressions. Works with real photos, illustrations, and 3D renders.
Lip Sync / Lip Syncing
The process of matching mouth movements to audio speech. In AI video, lip sync algorithms analyze audio waveforms and generate realistic mouth shapes frame-by-frame. Puppetry uses LivePortrait + Wav2Lip for production-quality lip sync across 65+ languages.