Developer Finds Chest-Level Cropping Improves AI Video Lip-Sync Quality

A developer, while using the InfiniteTalk AI model to generate talking portrait videos, encountered an issue where the model created unwanted hand gestures. To isolate only mouth movements, they initially froze the body and overlaid a lip-sync video cropped at the jawline. This method caused visible misalignment artifacts when the head moved slightly. The developer found that moving the cropping boundary lower, to a plain area of the chest, made these artifacts far less noticeable. They also modified the AI generation prompts to prevent hand-raising, ensuring hands stayed below the new crop line.
This is an AI-generated summary. ShortSingh links to the original source for the complete article.

Discussion (0)
Log in to join the discussion and vote.
Log in