Advanced Frame Rate Conversion: After Effects AVISynth VideoEnhancer Plugin

[Tom4]

Hi,

What is the best video FPS Frame Rate Conversion Filter/Plugin or Software.

My layman's understanding would suggest most software would just repeat a previous frame as required to match your required FPS.
How does a high quality Frame Rate Conversion Software do anything other then create copies of existing Frames?

I have not got a particular format to edit.
Basically looking to increase low fps video x2 or x4.

Is there product available to address problem with intelligently rendered fill frames?
What is the best software product for high quality result.

Tom

[raffriff42]

>most software would just repeat a previous frame as required to match your required FPS
Not all! Some use motion interpolation.
Motion interpolation does not always work though. FrameRateConverter does very well at using motion interpolation where it works, and frame blending where it is likely to create artifacts.

https://github.com/mysteryx93/FrameRateConverter
https://forum.doom9.org/showthread.php?t=174793

FrameRateConverter(NewNum=60, NewDen=1, Preset="Fast")
    ## @ NewNum      - The new framerate numerator
    ## @ NewDen      - The new framerate denominator
    ## @ Presets  
    ##    Fast:    Basic interpolation  
    ##    Normal:  Fast + MRecalculate  
    ##    Slow:    Normal + DCT=4  
    ##    Slower:  Slow + calculate diff between DCT=4 and DCT=0 to take the best from both  
    ##    Slowest: Slower + use DCT=1 instead of 4

Alternatives are Interframe and SVP.

[Tom4]

I have downloaded AVISynth, not had any experience with using it.

Downloaded FrameRateConverter and see .avsi extension!

I will get my head around this with some google searches!
Can you catch me up on where and how the .asvi works.

I have Win7 64.

[Tom4]

I see .avsi extension is AVISynth plugin.
Excuse my learning as we go, this is all new to me at this stage.

Another question was the smeared or ghost image with movement on webcam recordings.
I read it can occur from parts of separate frames merging?
Not sure that is a good description of problem, but looking for a good plugin to address this in existing videos.

Perhaps a plugin that only acts on areas where the video is moving to preserve good quality frames?

[raffriff42]

I have downloaded AVISynth, not had any experience with using it.
Downloaded FrameRateConverter and see .avsi extension!
I will get my head around this with some google searches!

If you can work through these 2 pages, you should start feeling more comfortable with it:
http://avisynth.nl/index.php/First_script
http://avisynth.nl/index.php/Script_examples

To run FrameRateConverter, you need to understand plugins:
http://avisynth.nl/index.php/Plugins#Plugin_Autoload_and_Name_Precedence
https://forum.videohelp.com/threads/269320-How-to-install-plugins-for-Avisynth

Once you "get" plugins, using FRC is very easy.
You put FrameRateConverter.dll and FrameRateConverter.avsi in the avisynth plugins folder.
Then create a script like this:

DirectShowSource("<some video>")
FrameRateConverter(NewNum=60, NewDen=1)

which converts the video to 60 fps.

Highly recommended to view your script in VirtualDub (32-bit) to start, because other programs sometimes don't show the error messages when something goes wrong.

[raffriff42]

Another question was the smeared or ghost image with movement on webcam recordings.
I read it can occur from parts of separate frames merging?
Not sure that is a good description of problem, but looking for a good plugin to address this in existing videos.

That is probably caused by low light and/or bad compression. Frame rate conversion is not going to help, if that's the case.

[Tom4]

Thanks for all the info, helped a lot

The frame rate conversion was a separate subject, horses for courses.

I was reading about deinterlacing and thought it, and low bit rate,
might play a part in smeared image, associated with fast movements of subject and low quality webcam.

I suspect there is not a lot that can be done when the recording quality is bad.

Any plugin suggestions for attempting to improve such quality issues.

What about the order of tasks in AVISynth.
Is there cases where you should put in particular order,
such as Deinterlacing before frame rate conversion?

[raffriff42]

It's best to start a new thread with a proper subject line so the right people can see it. I wouldn't know about these issues really.

[Tom4]

Nor me.
I have found some information on Deinterlacing here http://www.100fps.com/

By the time I get through the downloaded pages I will have it covered.
I do not like reading so much because we have so much it is overload.

thanks

[_Al_]

if you want to increase frame rate of interlaced video you deinterlace it first, but there is a special plugin (or group of plugins) called QTGMC that does excellent job to deinterlace 25i/29.97i to 50p or 59.94p which might be what you are looking for, because it basically doubles frame rate. It takes interlaced half frame/fields and makes it a full frame considering vectors of movements. It involves some denoising as well.

That websites describes deinterlacing but it is very old, it does not mention QTGMC (think of it like sophisticated bob basically, described on that page). For SD footage it is almost necesarry today, because contents get blown up on big screens.
If you are dealing with HD interlaced video, yadif bob mode is suitable (avisynth plugin) it is quite alright,it doubles frame rate and it is much, much faster than QTGMC.

[Tom4]

is the denoising part of QTGMC settings or separate plugin.
Anything I need to know about denoise settings when deinterlacing.

Lot of de's in this filter stuff.

I downloaded QTGMC with the previous plugins.

The video with issues are done with a webcam, low bite rate/resolution and stability issues.
Should have enough plugins to play around.

[_Al_]

yes, but do not expect to restore footage or something, you'd need to try other denoisers to do that, QTGMC is more subtle but there is a certain range to set it up
https://forum.videohelp.com/threads/358043-A-comparison-of-AVIsynth-denoise-filters

[poisondeathray]

Not very many webcams record interlaced. I would verify this before you "start off on the wrong foot" or waste time going that route

[Tom4]

Yes, just looking to build a AVISynth tool kit to play around.
The main job is to change frame closer to 29/30.
My thinking is it best be even multiples so 15 might become 30fps.

See how FrameRateConverter goes

[_Al_]

again, short sample would help you'd be offered what to do

[Tom4]

Hi,
I have not got a particular format to edit.
Basically looking to increase low fps video x2 or x4.
Tom

At this stage I have not got a particular video needing advice!
Take folks up on the offer some time down the track.

Yes, just looking to build a AVISynth tool kit to play around.

I have followed up all the links offered, and downloaded all filters/dependencies listed.

Also inquired about purchase of Infognition Video Enhancer for AVISynth.
The biggest question is can or should I use any 64bit components in this "Video Kit".

I have downloaded 32bit AVISynth/Plugins and VirtualDub!
My thought being everything should work together,
and there would, presumably be less filter/plugin choices using 64bit components.

What's the experience been for users of 64bit OS?
Can you still manage to find 64bit versions of the Filters discussed in forum?
Or just stick to 32bit Synth and Dub Package?

[raffriff42]

I have downloaded 32bit AVISynth/Plugins and VirtualDub!
My thought being everything should work together,
and there would, presumably be less filter/plugin choices using 64bit components.

What's the experience been for users of 64bit OS?
Can you still manage to find 64bit versions of the Filters discussed in forum?
Or just stick to 32bit Synth and Dub Package?

Note, 32-bit AviSynth & Vdub can be used on a 64-bit OS. You can install 64-bit too -- they do not interfere with each other.
32-bit AVS must be used with 32-bit Vdub, and 64 with 64.

As for 64-bit filters, there is quite a good selection. Most support high bit depth too BTW.
http://avisynth.nl/index.php/AviSynth%2B_x64_plugins

[Bernix]

Hi,
Or you can use with avisynth http://www.compression.ru/video/frame_rate_conversion/index_en_msu.html
it is old but doesn't mean that is bad. There are some limitation, mentioned on page, like resolution has to be mod16 and video colorspace YV12, what is not big problem.
At least worth to try. It is for 2.5.7 avisynth, hope it is backward compatible.
AviSource("webcam.avi") ConvertToYV12().MSU_FRC(4, "slow")

Or there is also filter for FFMPEG called Minterpolate
But of course, higher input fps, and slower motion means better results.

Bernix

[Tom4]

Some video has large pixilation appearance like this image.

I used Virtual Dub filter: Smart Smoother High Quality
SmoothHiQ.vdf

Any suggestions for an alternative AVISynth version?

Found a AVISynth SmoothHiQ.dll in this list http://www.avisynth.nl/users/warpenterprises/

[Tom4]

Hi,
Or you can use with avisynth http://www.compression.ru/video/frame_rate_conversion/index_en_msu.html
it is old but doesn't mean that is bad. There are some limitation, mentioned on page, like resolution has to be mod16 and video colorspace YV12, what is not big problem.
At least worth to try. It is for 2.5.7 avisynth, hope it is backward compatible.
AviSource("webcam.avi") ConvertToYV12().MSU_FRC(4, "slow")
Bernix

I used http://www.compression.ru/video/frame_rate_conversion/index_en_msu.html before getting the dependencies for FrameRateConverter.

Seemed to work ok.
I have not put much time into the study and coding yet.

Thanks

[Tom4]

Note, 32-bit AviSynth & Vdub can be used on a 64-bit OS. You can install 64-bit too -- they do not interfere with each other.
32-bit AVS must be used with 32-bit Vdub, and 64 with 64.

As for 64-bit filters, there is quite a good selection. Most support high bit depth too BTW.
http://avisynth.nl/index.php/AviSynth%2B_x64_plugins

I downloaded the 64bit Virtualdub.

Sticking with 32bit until I get some results with the diversity of filters/plugins available.
AVISynth is a good video editor.

[Tom4]

if you want to increase frame rate of interlaced video you deinterlace it first, but there is a special plugin (or group of plugins) called QTGMC that does excellent job to deinterlace 25i/29.97i to 50p or 59.94p which might be what you are looking for, because it basically doubles frame rate. It takes interlaced half frame/fields and makes it a full frame considering vectors of movements. It involves some denoising as well.

That websites describes deinterlacing but it is very old, it does not mention QTGMC (think of it like sophisticated bob basically, described on that page). For SD footage it is almost necesarry today, because contents get blown up on big screens.
If you are dealing with HD interlaced video, yadif bob mode is suitable (avisynth plugin) it is quite alright,it doubles frame rate and it is much, much faster than QTGMC.

I believe QTGMC and dependencies are installed correctly, but get VirtualDub Error/ Avisynth open failure:
Script Error: There is no function named "Dither_Luma_Rebuid".

Does this offer any suggestion to what the problem might be?

[raffriff42]

http://avisynth.nl/index.php/QTGMC
# v3.33s (mod) 2016 12 06
# - Add TR2=4 and TR2=5
# - add TV_range bool and dither_luma_rebuild (from SMDegrain) Str and Amp
# - for avsplus now QTGMC_Bob is ready for any 420, not only yv12

So dither_luma_rebuild is part of SMDegrain, and the wiki lists the correct version: v3.1.2.93s. Better update all requirements mentioned on that page.

[Tom4]

Posting error

[Tom4]

http://avisynth.nl/index.php/QTGMC
# v3.33s (mod) 2016 12 06
# - Add TR2=4 and TR2=5
# - add TV_range bool and dither_luma_rebuild (from SMDegrain) Str and Amp
# - for avsplus now QTGMC_Bob is ready for any 420, not only yv12

So dither_luma_rebuild is part of SMDegrain, and the wiki lists the correct version: v3.1.2.93s. Better update all requirements mentioned on that page.

I took the easy way out and asked, after following hundreds of dead and outdated links to build plugin collection, it was doing my head in.
Found a link to SMDegrain+v.3.1.2d here if anyone needs: http://www.mediafire.com/file/9kd7d6ba2l0m6qd/SMDegrain+v.3.1.2d.zip


Here is the Avisynth Basic Tool Kit, should be enough to experiment with.
Going to leave it for now, feel free to contribute suggestions if you have a favorite.

Thanks for every-bodies input.

Added: Deblock_QED_MT2Mod.avsi