converting a choppy file from 18fps to 24fps

[Akuma786]

Hi guy's,
I have a movie captured at roughly 18fps from screen recording and it is not smooth and can be choppy at fast action scenes. Seems to be missing frames and also has duplicate frames (sometimes 2 consecutive duplicate frames but majority of time 1 duplicate can be seen.

Is there a method to remove the duplicates frames and fill the gaps between missed frame parts to make it play smoother and convert it to 24fps.

I have added a link for a small sample file, if anyone could kindly look at it and let me know if it is possible.

https://easyupload.io/e5l6mr

Thanks

[JN-]

I converted to mp4, removed duplicates then conformed to 24fps, dropbox link here. Is it what you expected ? Other users here may well give better results.
https://www.dropbox.com/s/5zoizk4m3b83aem/SVL%20FULL%2018fps-%5BV2C%5D-%5BDFR%5D-%5BCFR%5D.zip?dl=0

[Akuma786]

Hi, thanks for giving it a go. Ive had a look at your attempt and the video speed seems to be too fast.

Can you explain me the steps you used to remove duplicates and converting to 24fps please.

[JN-]

"the video speed seems to be too fast"

I guess that's to be expected, it's an initial 18.58 fps clip now playing at 24 fps with dups removed.

Clip durations ...
01 Original file duration ... 44 seconds ... 18.58fps
02 Converted to mp4 ... 44 seconds ... 18.58fps
03 With dups removed .... 39 seconds ... 18.58fps
04 With frame rate change ... 30 seconds ... 24fps

I have used Topaz on the 03 item to return ... 03a ... 39 seconds ... 24fps.
Further on I used Topaz to convert item 02 to 02a ... 44 seconds ... 24fps. Topaz converts the duplicate frames to interpolated frames at the same time as converting to 24fps.

I've added clips 02, 03, 03a and 04 to the zip file. Let me know what the 03a clip is like.

As per above comment, I later added 02a ... .mp4.

[JN-]

"Can you explain me the steps you used to remove duplicates and converting to 24fps please."

I used my own home brew ffmpeg based batch file script utils.
03 ... I used DFR (duplicate frame remover) to remove the duplicate frames.
04 ... I used ConformFR to change the 18.58 frame rate to 24, raw file dump, no quality loss.

I had to initially convert to mp4 because "04 ConformFR" doesn't work with the original files codec.

Users here can probably give u a single ffmpeg or similar utils syntax to do everything all in one go. I'm lazy and just use my utils as needed.

[jagabo]

This replaces the first of a pair of duplicates with a motion interpolated frame using RIFE in AviSynth. On the left are the original frames, on the right the ones marked "RIFE" are the interpolated frames. RIFE is one of the best motion interpolators available now. It fails miserable on some frames though.

I didn't address the missing frames. They are at irregular intervals and sometimes several in a row were dropped. You should look for a better version of the movie.

[Akuma786]

[QUOTE=I've added clips 02, 03, 03a and 04 to the zip file. Let me know what the 03a clip is like.[/QUOTE]

Clip 03a is decent, more smoother than the other other clips. I would like to run this method for 03a on my computer. I have topaz but ffmpeg I'm struggling to get it running.
I've been trying to get it to work, but no luck so far. I've looked at YouTube guides but cant get it to run.

[Akuma786]

This replaces the first of a pair of duplicates with a motion interpolated frame using RIFE in AviSynth. On the left are the original frames, on the right the ones marked "RIFE" are the interpolated frames. RIFE is one of the best motion interpolators available now. It fails miserable on some frames though.

I didn't address the missing frames. They are at irregular intervals and sometimes several in a row were dropped. You should look for a better version of the movie.

This looks good too compared to original. Can this be converted to 24fps with the motion interpolated frames using RIFE IN Avisynth?

Unfortunately there is no better version of the movie. All previous versions were very low resolutions and poor overall in quality compared to this version.

[jagabo]

Can this be converted to 24fps with the motion interpolated frames using RIFE IN Avisynth?

In theory, yes. In reality, you can't just convert from 18 to 24 fps, you will have to spend a lot of time figuring out where, and how many, interpolated frames need to be inserted. It's very manually intensive and many of those high action shots won't interpolate well -- there will be lots of weird distortions. You will spend months at the computer analyzing the video frame by frame.

[JN-]

"but ffmpeg I'm struggling to get it running."

This is an extract from "Help" in my utils. See if u can get it to work.

"This util requires Windows 10 version 1909 or newer.

You need to download and install say a static version of ffmpeg and add it to the windows PATH.
Example ... https://www.gyan.dev/ffmpeg/builds/

Adding the ffmpeg "BIN" folder to the "PATH" ...

Search for "env" in Windows "search" ...
or Select "Settings" "System", then Search ...

Select "Edit the System enviornment variables" ... Not "Edit enviornment variables for your account"
With the "advanced" tab selected click the "Enviornment Variables" button at the bottom right ...
Select "Path" in the bottom "System variables" window pane.
Select "Edit" at the bottom.
Select "New" and then type in for example ... D:\ffmpeg\bin
Click "Ok" when done."



If u are using Windows 11 then these changes need to take place otherwise my utils don't look right, basically un-useable.

"Windows ...
-----------------------------------------------------------------------------------------------------------------------------
Windows 10 version 1909 or newer is required as ANSI colours are implimented by default from 1909 onwards.
-----------------------------------------------------------------------------------------------------------------------------



Terminal ...
-----------------------------------------------------------------------------------------------------------------------------
Windows 10 may also use "Terminal" if it was added/installed.
Windows 11. To display the utils correctly under Windows 11 it's essential to do the following.
"Terminals" default profile is Powershell which won't display the utils correctly ...

In terminal select the dropdown items, this icon is similar to a V.

Chose "Settings".

#1. Set "Default profile" to Command Prompt. Not Powershell. ... Press Ctrl + Shift + 2 while the Terminal window is in focus.
#2. Set "Default terminal application" to Windows Console Host. Not Windows Terminal.
A useful tutorial ... https://www.digitalcitizen.life/switch-cmd-powershell-terminal/
-----------------------------------------------------------------------------------------------------------------------------"

[JN-]

This is the basic syntax I use in my DFR util. If you can get ffmpeg to work using my previous posts then try it. In that case if you wish to use DFR let me know.

ffmpeg -y -i "%~n1%~x1" -vf mpdecimate,setpts=N/FRAME_RATE/TB -crf %_QUALITY% -x264-params bframes=2 -g 60 -preset slow -vsync vfr -an "%~n1-[DFR]%~x1"

The variable %_QUALITY% is set in util from 5 to 35, lower number is higher quality. I used 5, probably overkill.

[JN-]

I just realised that Topaz can also interpolate the duplicate frames. In Topaz the "Replace duplicate frames" item is checked by default.

So just taking the original avi file, converted to mp4, I used Topaz to output 02a ... .mp4.

So no DFR util step in this case, Topaz is doing it all, interpolating frames and converting duplicates to interpolated frames and outputting 24fps. Let me know what it looks like compared to others. This duration is now 44 seconds.

It's added to the zip file also.

[Akuma786]

I have tried to run ffmepg following instruction. I am getting error message. Please see screenshot.

[Attachment 73506 - Click to enlarge]

[jagabo]

Since your path/file name has spaces it it you need to put it in quotes: "C:\FFMPEG\bin\SAMPLE 2 VDUB 18FPS.AVI".

[JN-]

I was just about to say that! Anyway, since you appear to have ffmpeg working and added to the Windows PATH ? Here's a dropbox link to DFR.
https://www.dropbox.com/scl/fi/3f6ye5jcnqvsfou2e1j4y/DFR.zip?rlkey=ystqv8swdzu6qxq1tojywzz93&dl=0

Is it necessary now that Topaz appears to do it all? Is the 02a ... .mp4 file good enough ?

[Akuma786]

Thank you guys. Really appreaciate it. I've finally managed to get ffmpeg running now. Thought I never understand how to get it working.

This replaces the first of a pair of duplicates with a motion interpolated frame using RIFE in AviSynth. On the left are the original frames, on the right the ones marked "RIFE" are the interpolated frames. RIFE is one of the best motion interpolators available now

Now I will need to figure out how to get avisynth installed correctly and working and would like to try the rife interpolated frames added option you did. Any help how to setup avisynth with RIFE ?

Is it necessary now that Topaz appears to do it all? Is the 02a ... .mp4 file good enough ?

The Topaz version when checked on virtualdub frame by frame, I noticed it has added duplicate frames back into footage.

Here's a dropbox link to DFR.
https://www.dropbox.com/scl/fi/3f6ye5jcnqvsfou2e1j4y/DFR.zip?rlkey=ystqv8swdzu6qxq1tojywzz93&dl=0

Thanks for this I will try to intall this now too. Much appreciated.

1 more think so I've run ffmpeg with your command to remove the duplicates. How do i now convert it to 24fps using ffmpeg ?

[JN-]

Probably many ways, I use my ConforFR util. I'll add to Dropbox later, out getting groceries at the moment. Thanks for the feedback on Topaz 02a file.

[JN-]

This is a dropbox link to the ConformFR, DFR, Transcoder and VFR2CFR utils. https://www.dropbox.com/scl/fi/5nyjzdud9dolkgw2a3fq6/Akuma786.zip?rlkey=vjcm2cf37mgooz...7p1pdi391&dl=0

The Transcoder util basically replaces the VFR2CFR util, I added presets and AV1 encoding for Nvenc, AMD and Intel into the Transcoder util. However the Transcoder util is a little picky re: the 18.58 frame rate, so I had to use the no longer developed VFR2CFR util. As mentioned earlier, I needed to convert to mp4 using VFR2CFR (Handbrake etc of course can also be used) because ConformFR util doesn't handle the original source files codec.

It's imortant that you select "Video only" to YES, key 'V' in the ConformFR util, otherwise you will get an error, that's because there is no audio in the source file.

Just now realised that I had not initially added the ConformFR zip, is added now.

[Akuma786]

Thanks for the link. I will check it out tonight. Off to work now.
Appreciate all your help.

[JN-]

Your welcome.

[Akuma786]

Just a thought, after removing duplicates and changing it 24fps, can I then stretch the file on a NLE software (changing speed of clip) to match length of the 18fps file?

Is this possible or is there a better way to achieve getting the same length of file as the original (18fps file).

[manono]

Done properly, the length shouldn't change.

[poisondeathray]

Stretching on a NLE timeline adds back duplicate frames or blended frames

The proper way to do it as jagabo mentioned in post #9 is to interpolate the correct missing frames at the correct locations and timestamps. Use a "bad" version of the movie that does not have missing frames as a guide . It's a lot of manual work and back and forth

[JN-]

I overlooked yesterday that there are 3 Resample methods in Vegas Pro 20. The file originally uploaded here yesterday had Resample disabled. The other 2 methods are "Frame Blend" and "Optical Flow". All 3 are here now and also in the zip file ... https://www.dropbox.com/s/5zoizk4m3b83aem/SVL%20FULL%2018fps-%5BV2C%5D-%5BDFR%5D-%5BCFR%5D.zip?dl=0

[Akuma786]

Done properly, the length shouldn't change.

Can you explain how to do it properly please?

[Akuma786]

Stretching on a NLE timeline adds back duplicate frames or blended frames

The proper way to do it as jagabo mentioned in post #9 is to interpolate the correct missing frames at the correct locations and timestamps. Use a "bad" version of the movie that does not have missing frames as a guide . It's a lot of manual work and back and forth

Is there a guide on how to do it the way jagabo described please. I would like to attempt it on maybe one of the action scenes first.

[Akuma786]

I did that anyway, used velocity envelope, set at 70% in Vegas Pro 20. Stretched the 30 second 04 ... .mp4 file to 44 seconds 05 ... .mp4. I added it to the zip of all samples, 01 to 05. https://www.dropbox.com/s/5zoizk4m3b83aem/SVL%20FULL%2018fps-%5BV2C%5D-%5BDFR%5D-%5BCFR%5D.zip?dl=0

As usual having great difficulty adding/uploading here.

I'll check it out on my computer after work. Thanks

[manono]

Removing the duplicates lowers the framerate, keeping the length the same. Creating new frames through interpolation to get it up to 24fps, also keeps the length the same. It's done using AviSynth.

I didn't look at the sample, but both jagabo and pdr say it's a whole lot of work.

[Akuma786]

I've never used avisynth before due to not knowing how to install it correctly but l would like to try this method so i will try tonight to setup avisynth properly on my computer.

Does anyone have a guide on jagabo's way of doing this please.

[JN-]

I overlooked yesterday that there are 3 Resample methods in Vegas Pro. The file originally uploaded here had Resample disabled. The other 2 methods are "Frame Blend" and "Optical Flow". All 3 are now at post #24 and also in the zip file.