Hybrid Video Interpolation

[bradwiggo]

I have been suing Hybrid to interpolate videos, however I have an issue when I try and use the "FrameRateConverter" option. It speeds the video up. I don't know why it is doing this, is there a setting you have to change in order to stop it doing this? I have attached a picture of the setting it defaults to.

Also, there are a lot of options for interpolation.
- FrameRateConverter
- SalFPS3
- InterFrame
- MVToolsFPS Mod
- Interframe/SVP (with vapoursynth)
- MVToolsFPS (with vapoursynth)
and then - FFMPEG "speed change interpolate frame rate" option

Which one of these is the best, or is there no "best"?

For context I am trying to interpolate films, mainly DVD rips but also some 720p stuff, idk if that affects which one will be best.

[Selur]

I have an issue when I try and use the "FrameRateConverter" option. It speeds the video up.

sounds like a bug in which the frame rate isn't adjusted properly,... would need a debug output to know for sure.

Which one of these is the best, or is there no "best"?

There is no best, but FFMpegs "speed change interpolate frame rate" is usually the worst.
For the rest it usually depends on the source and the settings.

Cu Selur

[bradwiggo]

I have an issue when I try and use the "FrameRateConverter" option. It speeds the video up.

sounds like a bug in which the frame rate isn't adjusted properly,... would need a debug output to know for sure.

Which one of these is the best, or is there no "best"?

There is no best, but FFMpegs "speed change interpolate frame rate" is usually the worst.
For the rest it usually depends on the source and the settings.

Cu Selur

Is one of them best for action scenes? I find that they all seem to work pretty well when the movement is slow, but if there is loads of "action" stuff happening in a scene, you just get blur and duplicate ghosting of images? Is this just an inevitable thing, or can you fix it?

[Selur]

It's nothing I can fix.
Problem with action is that there is a lot of information missing between the frames so there are bound to be artifacts.
Can't really recommend any specific filter for action scenes. FrameRateConverter has probably the most options and might give the best results with tweaking.

Cu Selur

[jagabo]

Is one of them best for action scenes? I find that they all seem to work pretty well when the movement is slow, but if there is loads of "action" stuff happening in a scene, you just get blur and duplicate ghosting of images? Is this just an inevitable thing

Yes, they're all fine for simple panning shots but all suck when motions get complex.

[bradwiggo]

Is one of them best for action scenes? I find that they all seem to work pretty well when the movement is slow, but if there is loads of "action" stuff happening in a scene, you just get blur and duplicate ghosting of images? Is this just an inevitable thing

Yes, they're all fine for simple panning shots but all suck when motions get complex.

I found some AI ones, they seem to be way better in general and especially for action scenes. They do take longer though.

[Selur]

Yes,

• DAIN (Depth-Aware Video Frame Interpolation), https://github.com/nihui/dain-ncnn-vulkan + DAINApp (https://grisk.itch.io/dain-app, https://github.com/BurguerJohn/Dain-App)
• CAIN (Channel Attention Is All You Need for Video Frame Interpolation); https://github.com/nihui/cain-ncnn-vulkan
• RIFE (Real-Time Intermediate Flow Estimation for Video Frame Interpolation); https://github.com/nihui/rife-ncnn-vulkan + RIFEApp (https://nmkd.itch.io/flowframes)

based interpolation can really give good results,.. sadly no Avisynth or Vapoursynth filter which uses them atm. and at least DAIN and CAIN are are really slow without monstrous computation power.

Cu Selur

[bradwiggo]

Yes,

• DAIN (Depth-Aware Video Frame Interpolation), https://github.com/nihui/dain-ncnn-vulkan + DAINApp (https://grisk.itch.io/dain-app, https://github.com/BurguerJohn/Dain-App)
• CAIN (Channel Attention Is All You Need for Video Frame Interpolation); https://github.com/nihui/cain-ncnn-vulkan
• RIFE (Real-Time Intermediate Flow Estimation for Video Frame Interpolation); https://github.com/nihui/rife-ncnn-vulkan + RIFEApp (https://nmkd.itch.io/flowframes)

based interpolation can really give good results,.. sadly no Avisynth or Vapoursynth filter which uses them atm. and at least DAIN and CAIN are are really slow without monstrous computation power.

Cu Selur

Yep they are super slow. I have a 2070 and it takes about 3 minutes with most of the Avi or Vapour Synth fps filters for about a 3 minute clip, RIFE takes about 30 minutes for the same clip, and DAIN takes about 3 hours lol.