Image sequence to video. Out of sync problems due to FPS.

[e.korpse]

A month ago I split a video into single frames. I needed to work on all the frames individually and also increase the resolution to 1440x960 (before it was 720x480). Now I wanted to put the frames together to make into a video again. But every time I rendered the video they audio would be out of sync. I ripped the audio using VLC media player into .mp3 format. Now I've tried both Blender and FFMPEG and they both cannot get the FPS right. I have don't have a clue what I'm doing wrong since I'm a complete newbie to video editing!

So my question is how can I get the video to rendered at the right fps so the audio can sync?

I will give you all the info that may help figure this issue out.

ORIGINAL VIDEO INFO
Video Run Time: 00:16:49 (HRS/MINS/SECS)
Number of Frames: 28,385

FPS:
VLC Media Player: 28.135030
MediaInfo: 28.131

Here are pictures:
MediaInfo

VLC Media Player


Now I've tried putting 28.135030 FPS when I rendered with FFMPEG but I got a different FPS after I rendered the video.


Of course, the audio still did not sync.

Also note that 3,380 frames are not in 1440x960 since I did not bother doing anything to the Credits. I'm not sure if that may be conflicting with the fps. IIRC Blender automatically increase the resolution when change the render settings to output to 1440x960. I'm not sure FFMPEG did that though.

One last, thing I tried rendering the video into an MKV format and MP4 format and both had the same problems. I'm not sure if I'm supposed to rendered the video back to AVI format like the original video.

[poisondeathray]

That is an uncommon / and non standard frame rate

Did you say the original was "AVI" container ? Because that will rule out things like VFR (variable frame rate) immediately

In what way is it out of sync ? audio too early , audio too late, or progressively worsenening ?

With mediainfo, use view=>text, and copy/paste the text because that will show more information. Debug=>advanced mode will give even more information, including framecount . This type of information isn't always accurate, but it still can be helpful

I'm not sure I understand you comment about the credits, but did you account for the audio in the credits (ie. if you omitted the credits, did you omit the audio in the credits as well)?

[e.korpse]

That is an uncommon / and non standard frame rate

Did you say the original was "AVI" container ? Because that will rule out things like VFR (variable frame rate) immediately

Whoops! I just checked and its NOT AVI, its actually MP4. My bad. And yes its very uncommon FPS.

In what way is it out of sync ? audio too early , audio too late, or progressively worsenening ?General

Audio seems to always go to fast.

With mediainfo, use view=>text, and copy/paste the text because that will show more information. Debug=>advanced mode will give even more information, including framecount . This type of information isn't always accurate, but it still can be helpful

Text
General
Complete name : OMITTED FOR PRIVACY REASONS.
Format : MPEG-4
Format profile : Base Media / Version 2
Codec ID : mp42 (isom/mp42)
File size : 358 MiB
Duration : 16mn 49s
Overall bit rate mode : Variable
Overall bit rate : 2 973 Kbps
Encoded date : UTC 2015-12-11 10:05:14
Tagged date : UTC 2015-12-11 10:05:14

Video
ID : 1
Format : AVC
Format/Info : Advanced Video Codec
Format profile : High@L4
Format settings, CABAC : Yes
Format settings, ReFrames : 5 frames
Codec ID : avc1
Codec ID/Info : Advanced Video Coding
Duration : 16mn 49s
Bit rate : 2 779 Kbps
Maximum bit rate : 7 768 Kbps
Width : 720 pixels
Height : 480 pixels
Display aspect ratio : 16:9
Original display aspect ratio : 16:9
Frame rate mode : Variable
Frame rate : 28.131 fps
Minimum frame rate : 14.985 fps
Maximum frame rate : 119.880 fps
Original frame rate : 29.970 (30000/1001) fps
Color space : YUV
Chroma subsampling : 4:2:0
Bit depth : 8 bits
Scan type : Progressive
Bits/(Pixel*Frame) : 0.286
Stream size : 334 MiB (93%)
Writing library : x264 core 123 r2184+681M 5d72658
Encoding settings : cabac=1 / ref=5 / deblock=1:-2:-2 / analyse=0x3:0x113 / me=umh / subme=7 / psy=1 / fade_compensate=0.00 / psy_rd=1.00:0.00 / mixed_ref=1 / me_range=32 / chroma_me=1 / trellis=1 / 8x8dct=1 / cqm=0 / deadzone=21,11 / fast_pskip=1 / chroma_qp_offset=-2 / threads=7 / sliced_threads=1 / slices=7 / nr=0 / decimate=1 / interlaced=0 / bluray_compat=0 / constrained_intra=0 / fgo=0 / bframes=3 / b_pyramid=2 / b_adapt=2 / b_bias=0 / direct=3 / weightb=1 / open_gop=0 / weightp=2 / keyint=250 / keyint_min=25 / scenecut=40 / intra_refresh=0 / rc_lookahead=40 / rc=crf / mbtree=1 / crf=15.0000 / qcomp=0.60 / qpmin=0 / qpmax=69 / qpstep=4 / ip_ratio=1.40 / aq=1:1.00
Encoded date : UTC 2015-12-11 10:05:14
Tagged date : UTC 2015-12-11 10:06:33

Audio
ID : 2
Format : AAC
Format/Info : Advanced Audio Codec
Format profile : LC
Codec ID : 40
Duration : 16mn 49s
Bit rate mode : Variable
Bit rate : 192 Kbps
Maximum bit rate : 218 Kbps
Channel(s) : 2 channels
Channel positions : Front: L R
Sampling rate : 48.0 KHz
Frame rate : 46.875 fps (1024 spf)
Compression mode : Lossy
Stream size : 22.8 MiB (6%)
Encoded date : UTC 2015-12-11 10:06:32
Tagged date : UTC 2015-12-11 10:06:33

Debug => Advance Mode
General
Count : 322
Count of stream of this kind : 1
Kind of stream : General
Kind of stream : General
Stream identifier : 0
Inform : MPEG-4 (Base Media / Version 2): 358 MiB, 16mn 49s
Count of video streams : 1
Count of audio streams : 1
Video_Format_List : AVC
Video_Format_WithHint_List : AVC
Codecs Video : AVC
Audio_Format_List : AAC
Audio_Format_WithHint_List : AAC
Audio codecs : AAC LC
Complete name : D: OMMITTED FOR PRIVACY CONCERNS
Folder name : D: OMMITTED FOR PRIVACY CONCERNS
File name : OMMITTED FOR PRIVACY CONCERNS
File extension : mp4
Format : MPEG-4
Format : MPEG-4
Format/Extensions usually used : mp4 m4v m4a m4b m4p 3gpp 3gp 3gpp2 3g2 k3g jpm jpx mqv ismv isma f4v
Commercial name : MPEG-4
Format profile : Base Media / Version 2
Internet media type : video/mp4
Codec ID : mp42
Codec ID : mp42 (isom/mp42)
Codec ID/Url : http://www.apple.com/quicktime/download/standalone.html
CodecID_Compatible : isom/mp42
Codec : MPEG-4
Codec : MPEG-4
Codec/Extensions usually used : mp4 m4v m4a m4b m4p 3gpp 3gp 3gpp2 3g2 k3g jpm jpx mqv ismv isma f4v
File size : 375037866
File size : 358 MiB
File size : 358 MiB
File size : 358 MiB
File size : 358 MiB
File size : 357.7 MiB
Duration : 1009040
Duration : 16mn 49s
Duration : 16mn 49s 40ms
Duration : 16mn 49s
Duration : 00:16:49.040
Duration : 00:16:53:21
Duration : 00:16:49.040 (00:16:53:21)
Overall bit rate mode : VBR
Overall bit rate mode : Variable
Overall bit rate : 2973423
Overall bit rate : 2 973 Kbps
Frame rate : 28.131
Frame rate : 28.131 fps
Frame count : 28385
Stream size : 614075
Stream size : 600 KiB (0%)
Stream size : 600 KiB
Stream size : 600 KiB
Stream size : 600 KiB
Stream size : 599.7 KiB
Stream size : 600 KiB (0%)
Proportion of this stream : 0.00164
HeaderSize : 613998
DataSize : 374423799
FooterSize : 69
IsStreamable : Yes
Encoded date : UTC 2015-12-11 10:05:14
Tagged date : UTC 2015-12-11 10:05:14
File creation date : UTC 2015-12-12 01:26:12.675
File creation date (local) : 2015-12-11 20:26:12.675
File last modification date : UTC 2015-12-12 01:29:57.963
File last modification date (local) : 2015-12-11 20:29:57.963

Video
Count : 334
Count of stream of this kind : 1
Kind of stream : Video
Kind of stream : Video
Stream identifier : 0
StreamOrder : 0
Inform : 2 779 Kbps, 720*480 (16:9), at 28.131 fps, AVC (High@L4) (CABAC / 5 Ref Frames)
ID : 1
ID : 1
Format : AVC
Format/Info : Advanced Video Codec
Format/Url : http://developers.videolan.org/x264.html
Commercial name : AVC
Format profile : High@L4
Format settings : CABAC / 5 Ref Frames
Format settings, CABAC : Yes
Format settings, CABAC : Yes
Format settings, ReFrames : 5
Format settings, ReFrames : 5 frames
Internet media type : video/H264
Codec ID : avc1
Codec ID/Info : Advanced Video Coding
Codec ID/Url : http://www.apple.com/quicktime/download/standalone.html
Codec : AVC
Codec : AVC
Codec/Family : AVC
Codec/Info : Advanced Video Codec
Codec/Url : http://developers.videolan.org/x264.html
Codec/CC : avc1
Codec profile : High@L4
Codec settings : CABAC / 5 Ref Frames
Codec settings, CABAC : Yes
Codec_Settings_RefFrames : 5
Duration : 1009040
Duration : 16mn 49s
Duration : 16mn 49s 40ms
Duration : 16mn 49s
Duration : 00:16:49.040
Duration : 00:16:53:21
Duration : 00:16:49.040 (00:16:53:21)
Bit rate : 2778888
Bit rate : 2 779 Kbps
Maximum bit rate : 7768416
Maximum bit rate : 7 768 Kbps
Width : 720
Width : 720 pixels
Height : 480
Height : 480 pixels
Sampled_Width : 720
Sampled_Height : 480
Pixel aspect ratio : 1.185
Display aspect ratio : 1.777
Display aspect ratio : 16:9
Original display aspect ratio : 1.778
Original display aspect ratio : 16:9
Rotation : 0.000
Frame rate mode : VFR
Frame rate mode : Variable
Frame rate : 28.131
Frame rate : 28.131 fps
Minimum frame rate : 14.985
Minimum frame rate : 14.985 fps
Maximum frame rate : 119.880
Maximum frame rate : 119.880 fps
Original frame rate : 29.970
Original frame rate : 29.970 (30000/1001) fps
FrameRate_Original_Num : 30000
FrameRate_Original_Den : 1001
Frame count : 28385
Resolution : 8
Resolution : 8 bits
Colorimetry : 4:2:0
Color space : YUV
Chroma subsampling : 4:2:0
Chroma subsampling : 4:2:0
Bit depth : 8
Bit depth : 8 bits
Scan type : Progressive
Scan type : Progressive
Interlacement : PPF
Interlacement : Progressive
Bits/(Pixel*Frame) : 0.286
Stream size : 350497438
Stream size : 334 MiB (93%)
Stream size : 334 MiB
Stream size : 334 MiB
Stream size : 334 MiB
Stream size : 334.3 MiB
Stream size : 334 MiB (93%)
Proportion of this stream : 0.93457
Writing library : x264 - core 123 r2184+681M 5d72658
Writing library : x264 core 123 r2184+681M 5d72658
Encoded_Library_Name : x264
Encoded_Library_Version : core 123 r2184+681M 5d72658
Encoding settings : cabac=1 / ref=5 / deblock=1:-2:-2 / analyse=0x3:0x113 / me=umh / subme=7 / psy=1 / fade_compensate=0.00 / psy_rd=1.00:0.00 / mixed_ref=1 / me_range=32 / chroma_me=1 / trellis=1 / 8x8dct=1 / cqm=0 / deadzone=21,11 / fast_pskip=1 / chroma_qp_offset=-2 / threads=7 / sliced_threads=1 / slices=7 / nr=0 / decimate=1 / interlaced=0 / bluray_compat=0 / constrained_intra=0 / fgo=0 / bframes=3 / b_pyramid=2 / b_adapt=2 / b_bias=0 / direct=3 / weightb=1 / open_gop=0 / weightp=2 / keyint=250 / keyint_min=25 / scenecut=40 / intra_refresh=0 / rc_lookahead=40 / rc=crf / mbtree=1 / crf=15.0000 / qcomp=0.60 / qpmin=0 / qpmax=69 / qpstep=4 / ip_ratio=1.40 / aq=1:1.00
Encoded date : UTC 2015-12-11 10:05:14
Tagged date : UTC 2015-12-11 10:06:33

Audio
Count : 272
Count of stream of this kind : 1
Kind of stream : Audio
Kind of stream : Audio
Stream identifier : 0
StreamOrder : 1
Inform : 192 Kbps, 48.0 KHz, 2 channels, AAC (LC)
ID : 2
ID : 2
Format : AAC
Format/Info : Advanced Audio Codec
Commercial name : AAC
Format profile : LC
Format settings, SBR : No (Explicit)
Format settings, SBR : No (Explicit)
Codec ID : 40
Codec : AAC LC
Codec : AAC LC
Codec/Family : AAC
Codec/CC : 40
Duration : 1009023
Duration : 16mn 49s
Duration : 16mn 49s 23ms
Duration : 16mn 49s
Duration : 00:16:49.023
Duration : 00:16:46:16
Duration : 00:16:49.023 (00:16:46:16)
Bit rate mode : VBR
Bit rate mode : Variable
Bit rate : 192000
Bit rate : 192 Kbps
Maximum bit rate : 218120
Maximum bit rate : 218 Kbps
Channel(s) : 2
Channel(s) : 2 channels
Channel positions : Front: L R
Channel positions : 2/0/0
ChannelLayout : L R
Samples per frame : 1024
Sampling rate : 48000
Sampling rate : 48.0 KHz
Samples count : 48433104
Frame rate : 46.875
Frame rate : 46.875 fps (1024 spf)
Frame count : 47298
Compression mode : Lossy
Compression mode : Lossy
Stream size : 23926353
Stream size : 22.8 MiB (6%)
Stream size : 23 MiB
Stream size : 23 MiB
Stream size : 22.8 MiB
Stream size : 22.82 MiB
Stream size : 22.8 MiB (6%)
Proportion of this stream : 0.06380
Encoded date : UTC 2015-12-11 10:06:32
Tagged date : UTC 2015-12-11 10:06:33

I'm not sure I understand you comment about the credits, but did you account for the audio in the credits (ie. if you omitted the credits, did you omit the audio in the credits as well)?

Okay when I split the video into single frames from an anime show. I was doing some editing to the frames except the credits since I did not touch them at all.
The show's frames are now 1440x960 resolution while the frames of the credits in the end of the show are still 720x480 since I did not touch them at all.
Should I also increase the resolution? I remember Blender automatically increase the resolution for me for those frames that were not 1440x960.
Audio is not included in this because I'm just working with the frames. I added the audio after I rendered the video because in the past I still was getting out of sync problems even if I added the audio during the image sequence to video in Blender.
Pretty much I'm still working with 28,385 frames.

[mulvya]

Original container is MP4 and is VFR. Nominal frame rate is 28.131, minimum rate is 14.985 and max is 119.88!! Now, the original frame rate is 29.97. Your best bet is working with that original constant rate file if you have or can get it.

Now, FFmpeg does not generate VFR MP4s, but does MKVs. And by exporting as images, you have stripped the original timestamp info.

There may be a way to get around this. Try this using ffmpeg,

ffmpeg -i original.mp4 -i images%05d.png -filter_complex "[0]scale=1440x960,setsar=1[base];[1]scale=1440x960,setsar=1[img];[base][img]overlay=0:0[v]" -map "[v]" -map 0:a -vsync 0 -copyts -c:v libx264 -pix_fmt yuv420p -c:a copy output.mkv

[e.korpse]

Original container is MP4 and is VFR. Nominal frame rate is 28.131, minimum rate is 14.985 and max is 119.88!! Now, the original frame rate is 29.97. Your best bet is working with that original constant rate file if you have or can get it.

Now, FFmpeg does not generate VFR MP4s, but does MKVs. And by exporting as images, you have stripped the original timestamp info.

There may be a way to get around this. Try this using ffmpeg,

ffmpeg -i original.mp4 -i images%05d.png -filter_complex "[0]scale=1440x960,setsar=1[base];[1]scale=1440x960,setsar=1[img];[base][img]overlay=0:0[v]" -map "[v]" -map 0:a -vsync 0 -copyts -c:v libx264 -pix_fmt yuv420p -c:a copy output.mkv

I'm getting an error message when I put that code in when I use FFMPEG.

Could find no file with path 'images%05d.png' and index in the range 0-4 images%05.png: No such file or directory

Sorry, but I'm a complete noob at using ffmpeg, since this is my first time using it. Your gonna have to explain so a dummy like me can understand. Like do I have to have the original video in the same folder with the images?
By the way, I do know that the images have to named a certain way like for example;
image-0.png
or
image-000.png
My images start at image-0.png

Thanks for helping me out on this. I really appreciated.

[poisondeathray]

You would need to specify the full path

eg
If it was c:\folder , you would use -i "c:\folder\image-%03d.png"

However, your images need to be consistently named, the "placeholder" digits have to use the same convention

If you have 3 digits like image-000.png, image-001.png, image-003.png... it would be "c:\folder\image-%03d.png"

If you had 5 digits like image-00000.png, it would be "c:\folder\image-%05d.png"



Another way you could possibly do it is extract the timecodes from the original (it IS VFR, that' s the cause of your problem) , and insert them into the "final" version. But if you've done some editing like edit out credits, the timecodes might need to be adjusted. Editing VFR is very, very tricky. Usually you would convert to CFR before any manipulations. If you kept the same frames (same number), then the timecodes would work

[poisondeathray]

I think I misread what you were doing

Only a section was manipulated in blender, but now you have 1440x960 dimensions for that section. If that's the case, I would upscale everything to that (all the other frames) , if that was your desired final dimension. Or if you wanted to scale that back down to match, that would work too. Basically you need everything to match in dimensions

So you would have the same number of frames as the original. If that ffmepg command doesn't work (try it first), you could extract the timecodes from the original with mp4fpsmod then re-insert them into the "final" version, also with mp4fpsmod. If you were re-encoding the whole thing, x264 can also take a timecodes file to create VFR with --tcfile-in. Basically it's the timecodes that control the VFR (the display time per frame), and there are several ways of extracting and inserting them.

I would also "copy" the audio, instead of re-encoding it like you were with VLC. Not only will it be faster, the quality will be higher too. Mulvya's command reflects that with -c:a copy

[hello_hello]

Edit: looks like poisondeathray beat me to the timecodes idea with some alternative methods while I was writing this post.

I haven't read the thread too thoroughly but it seems you have the original video and it's MP4? I've no idea if you can extract the timecodes from MP4s but you can from MKV, so it might be easiest to remux the MP4 as MKV with MKVMergeGUI (don't specify a frame rate) then extract the video timecosed with MKVCleaver or gMKVExtractGUI. They should extract as a text file.

Open your encoded video with MKVMergeGUI. Make sure the video stream is selected, then add the timescodes. The place where they're added shouldn't be too hard to find. Add the audio. Remux as a new MKV. If the encoded video has exactly the same number of frames, the newly remuxed video should have the same variable frame rate as the source and the audio should sync. If it has less.... I can't remember to be honest. MKVMergeGUI will probably just remux the same way and stop when it runs out of video, or it might complain, but worse case scenario is you'll need to include the credits too so the frame count remains the same. I'm not really sure I understand what you're doing there to be honest. Does the output include the credits and are they the same resolution as everything else? If you want the credits they probably need to be re-encoded with the rest of the video.

Thinking about it, it might be an idea to open the encoded video with MKVMergeGUI and add the extracted timecodes as I described, then add the source MP4 rather than your converted audio. In the list of streams, de-select the original video stream (from the MP4) and leave the audio stream checked. Remux as a new MKV. If there's any delay being applied to the audio stream in the original file, which MediaInfo doesn't seem to report for MP4s, it should be applied by MKVMergeGUI so the audio video sync won't change. If you do need to re-encode the audio.. if you need MP3 rather than AAC etc... that might at least provide some insight if the audio sync does change after it's extracted/converted converted, but if you don't need to re-encode the audio, that's probably best way to go about it.

Your ffmpeg encode resulted in 4:4:4 YUV, which isn't something the average hardware player is likely to play. The usual format is 4:2:0. I'm not overly familiar with ffmpeg either, but specifying "-pix_fmt yuv420p" in the command line as mulvya suggested seems like a good idea.

[mulvya]

you could extract the timecodes from the original with mp4fpsmod then re-insert them into the "final" version, also with mp4fpsmod.

Hey, that's a neat tool. Is there a precompiled Win binary available? I have MinGW set up on another sys, but a ready EXE is hassle-free.

[poisondeathray]

you could extract the timecodes from the original with mp4fpsmod then re-insert them into the "final" version, also with mp4fpsmod.

Hey, that's a neat tool. Is there a precompiled Win binary available? I have MinGW set up on another sys, but a ready EXE is hassle-free.

For pages on github, there are typically several categories: commits, branch, releases, contributors, etc.. click on "releases"
https://github.com/nu774/mp4fpsmod
https://github.com/nu774/mp4fpsmod/releases

[mulvya]

Only see the source in those packages.

[poisondeathray]

Only see the source in those packages.

That's very odd; I don't recall compiling it myself

[poisondeathray]

right, the original compiled versions are on the author's "cabinet" page. There's where I got it from

The only difference in the one attached above, is I added a help.txt file

https://sites.google.com/site/qaacpage/cabinet

[e.korpse]

You would need to specify the full path

eg
If it was c:\folder , you would use -i "c:\folder\image-%03d.png"

However, your images need to be consistently named, the "placeholder" digits have to use the same convention

If you have 3 digits like image-000.png, image-001.png, image-003.png... it would be "c:\folder\image-%03d.png"

If you had 5 digits like image-00000.png, it would be "c:\folder\image-%05d.png"



Another way you could possibly do it is extract the timecodes from the original (it IS VFR, that' s the cause of your problem) , and insert them into the "final" version. But if you've done some editing like edit out credits, the timecodes might need to be adjusted. Editing VFR is very, very tricky. Usually you would convert to CFR before any manipulations. If you kept the same frames (same number), then the timecodes would work

That code is still not working. I'm getting the message "No such file or directory"
Okay I think you guys may misunderstood me when I said this is the first time I'm using ffmpeg. I have little to no experience with it.
The original file is not in the C drive its on another hard drive that I have.
Both the original mp4 video file and images are in the same folder at this very moment.
They are in:
D:\Movie\C frames
So how should the code go?

Edit: looks like poisondeathray beat me to the timecodes idea with some alternative methods while I was writing this post.

I haven't read the thread too thoroughly but it seems you have the original video and it's MP4? I've no idea if you can extract the timecodes from MP4s but you can from MKV, so it might be easiest to remux the MP4 as MKV with MKVMergeGUI (don't specify a frame rate) then extract the video timecosed with MKVCleaver or gMKVExtractGUI. They should extract as a text file.

Open your encoded video with MKVMergeGUI. Make sure the video stream is selected, then add the timescodes. The place where they're added shouldn't be too hard to find. Add the audio. Remux as a new MKV. If the encoded video has exactly the same number of frames, the newly remuxed video should have the same variable frame rate as the source and the audio should sync. If it has less.... I can't remember to be honest. MKVMergeGUI will probably just remux the same way and stop when it runs out of video, or it might complain, but worse case scenario is you'll need to include the credits too so the frame count remains the same. I'm not really sure I understand what you're doing there to be honest. Does the output include the credits and are they the same resolution as everything else? If you want the credits they probably need to be re-encoded with the rest of the video.

Thinking about it, it might be an idea to open the encoded video with MKVMergeGUI and add the extracted timecodes as I described, then add the source MP4 rather than your converted audio. In the list of streams, de-select the original video stream (from the MP4) and leave the audio stream checked. Remux as a new MKV. If there's any delay being applied to the audio stream in the original file, which MediaInfo doesn't seem to report for MP4s, it should be applied by MKVMergeGUI so the audio video sync won't change. If you do need to re-encode the audio.. if you need MP3 rather than AAC etc... that might at least provide some insight if the audio sync does change after it's extracted/converted converted, but if you don't need to re-encode the audio, that's probably best way to go about it.

Your ffmpeg encode resulted in 4:4:4 YUV, which isn't something the average hardware player is likely to play. The usual format is 4:2:0. I'm not overly familiar with ffmpeg either, but specifying "-pix_fmt yuv420p" in the command line as mulvya suggested seems like a good idea.

Well if you read the OP then it might help you understand what I'm doing . Image sequence to video.

Okay so I used some of the programs you mentioned. I remux the original file to mkv and I was able to extract the time codes using mkvcleaver. Thanks for the tips though and at least trying to help me. Strongly appreciated

[e.korpse]

Okay, I got the code to work now.
All I did was change all the images to image-%05.png format, so my images now started from image-00000.png, image-00001.png, image-00002.png....and so on. I renamed the original file to "original.mp4", so not much work there. Also I moved it to the same folder where the images/frames were at. From there I went to that folder, Press and hold shift and open command prompt from there. Now I copied the folder into Notepad because I noticed there was an error on there so I needed to edited. Instead of;

Images%05d.png

I changed it to

Image-%05d.png

I'm not sure if that may have been one of the problems why the code was not working in the first place.
I copied and paste the file on the command prompt and it worked.
Right now ffmpeg is rendering the file, I'll give an update when its done.

edit
FAILED!!
Video and audio were still out of sync.

[mulvya]

How did you originally generate the images?

[e.korpse]

I used Photoshop CS6

[poisondeathray]

Did you try any of the other timecode methods , such as mp4fpsmod or mkvtoolnix etc... ? There are other methods as well such as avisynth ffms2/ffindex but they all should give the same timecodes . If you have the same number of frames , it should work

The other possibility is a playback problem . It says APU Richland 4 core @4.3 in your profile , that should be enough for 1440x960 h.264 playback

[e.korpse]

I have not tried mp4smod just yet because I'm not sure how to install it. Is it the same way as ffmpeg? I did use mkvtoolnix after I converted the original file to mkv format and I was able to extract the time code. But I don't know what to do with it now.

I can play bluray's just fine on my desktop. So I'm pretty sure it can play video files like that just fine.

[poisondeathray]

If you already have the timecodes, easiest way is probably mkvtoolnix, because it's a GUI

Add the file , highlight the video track, add the timecode , push start muxing . Your done!

(There is a special place where you add the timecodes - it will say "timecode file" or something like that)

In fact you can add the original video, uncheckmark the original video stream, but keep the audio stream checkmarked, add the new video stream, with that still selected, add the timecodes. This way you use the original audio

If you want to use mp4fpsmod, you need to specify the paths and names , just like you did with ffmpeg

mp4fpsmod -t "timecodes.txt" "input.mp4" -o "output.mp4"

[poisondeathray]

Actually you extracted the timecodes after converting to MKV ? Was the MKV in sync ? if not, you should extract them from the original

mp4fpsmod -p "timecodes.txt" "input.mp4"

Then you take that timecodes.txt , and plug it into the new file with the command in the previous post

[e.korpse]

I think you forgot what the OP says; Image sequence to video. I still don't have the video!
Should I now use ffmpeg to render the video from the image sequence? Also should I put the FPS to 29.97?

Yes, the audio did sync together when I converted the ORGINAL video to mkv format.

[poisondeathray]

Take your out of sync video that you already encoded with the image sequence, mux in timecodes, and it will become in sync if the number of frames is the same as the original. The FPS doesn't matter, because the timecodes control the display time per frame

[e.korpse]

Take your out of sync video that you already encoded with the image sequence, mux in timecodes, and it will become in sync if the number of frames is the same as the original. The FPS doesn't matter, because the timecodes control the display time per frame

It worked!!!!!!!!!!!

mp4fpsmod was the answer! I ripped the timecodes and use mkvtoolnix GUI and added the time code and the video and audio are now in synced. Earlier when you said:

If you have the same number of frames , it should work

That was the key, the problem earlier is that I was converting the original file to mkv and extract the timecodes off of those which I shouldn't have because that might have changed the number of frames and/or timecodes. And every time I would mux the files they would de-sync after a minute and other times it would increase the FPS to 49!
The other day when you mentioned mp4fpsmod, I did not want to use it because I could not install it since I downloaded it from the github page when I google it. And when I downloaded that folder that had the .exe in it I open the command prompt from there and it worked!
Thanks poisondeathray for the help.

[Budman1]

FWIW... FFMPEG used to combine the first 2 images into some composite that would shorten your video and unsync it with any audio. I used to just start the images at images-001 and copy 001 to images-000 as a workaround. Haven't used it for this with the later levels but think it still does the same thing.

[poisondeathray]

@budman1 - I don't think that that bug exists anymore, or at least it's not present in ffmpeg builds over the last few years

The more common problem is when exporting image sequences with ffmpeg, they start with "one" instead of frame "zero" (e.g. img001.png instead of img000.png). Most software such as NLE's etc... "expect" to start at frame "zero". The "fix" for that is -start_number 0 .

[Budman1]

Great info poisondeathray, looks like I'll update my FFMpeg and adjust my program. Thanks Much.