looking for software that will analyse lip movement to sync audio/video

[jimdagys]

I use VirtualDubMod to adjust the audio to sync with the avi video, but I still have difficulty (other than a lot of trial and error) to the get the sync right on. Is there some kind of software that will analyse lip movement and then automatically sync the audio to the video?

[guns1inger]

No.

You might try SyncView instead of virtualdub. It won't do it for you, but it may make it easier. Personally I find it pretty flaky when I try to make it do any processing, but it is pretty good for getting the right delays for use in other software.

[AlanHK]

This is an interesting script to help finding sync:

http://avisynth.org/mediawiki/Shared_functions/FindAudioSyncScript

It slows a clip down and plays it with different delays.

The line that changes the speed is:
AssumeFPS(8000.0 * FrameRate() / AudioRate(), True)

This is 1/6 full speed. 48000 (instead of 8000) is full speed.
Just running at half speed (24000) helps.

A less sophisticated method uses DelayAudio

video=MPEG2Source("lom-101.d2v")
audio=DirectShowSource("lom-101.ac3")
AudioDub(video,audio)
DelayAudio(1.39)

Just run it and edit in VDub, gradually changing the delay.

Is there some kind of software that will analyse lip movement and then automatically sync the audio to the video?

Where's HAL9000 when we need him?

[deckard8]

http://yaai.sourceforge.net/

Nicest tool for the job, but can be a little flaky.

If you get an error loading your avi into it install >

http://www.koepi.org/XviD-Dec-1.0-Beta3.exe

or/as well as

http://sourceforge.net/projects/ffdshow