Issue Using Hybrid to Deinterlace (QTGMC/Bob)

[low-fat-al]

I am only recently getting back in this space of video restoration and archiving. So go easy on me.

I am working on converting captured footage to a ProRes 422 for next steps in restoration. It has been over twelve years since I originally captured this footage and can't remember all my steps. Some footage came from 8mm tapes captured using a professional Hi8 Deck. For the life of me, I can't remember if it was a digital firewire type of connection to the computer. I am pretty sure I used VirtualDub to capture it.

I also have MiniDV footage that was for sure captured by firewire as well.

The footage I seemed to have the most issue with at the moment, only because I am going in order in the processing of them, is the 8mm footage.


It has been a hit and miss when using Hybrid for deinterlacing. I am trying to use QTGMC and enabling Bob so I can get the full 59.94 fps as the final output. Problem is that randomly it jerks back and forth. Not a specific number of frames. If you go frame by frame you can see it going forward then suddenly going back a frame then jumping ahead a couple of frames. When watching in realtime it looks real bad.

I have tried so many different settings to utilize the QTGMC Bob and it still does it.
It has a tick box to override the input scan type. When left unchecked, the output is 29.976 fps. When checked off and selecting Bottom Field First (which the source is) it shows 59.94 fps as output.

I also have used other applications like Shutter Encoder and just did the X2 / YADIF. Not the best quality at all using Shutter Encoder. Surprisingly fast though. And the result is a smooth playing video with no back and forth issues.

I am on a MacBook Pro, so I can't use VirtualDub or any PC applications.
I have Hybrid, Shutter Encoder and ff-Works. I do have access to a PC laptop with VirtualDub2 and any PC app if it needed, but I am trying to just use my Mac.

I have heard that Hybrid is the better option as a GUI run application for converting. But I am sure I am wrong.


Here is a 30 cut off of the original AVI file:
https://files.videohelp.com/u/71642/8mm%20Tape03%20_Hi8Deck__SE_30SecCut.avi

Here is result export from Hybrid using QTMGC with Bob to get the 59.94 fps:
https://files.videohelp.com/u/71642/8mm%20Tape03%20_Hi8Deck__SE_30SecCut_Hybrid.mov


Here is the result export from Shutter Encoder using 2x yadif to get the 59.94 fps:
https://files.videohelp.com/u/71642/8mm%20Tape03%20_Hi8Deck__SE_x2_yadif.mov



Any ideas on what to do here?

[poisondeathray]

Forward/back is usually a wrong field order issue. Your source is bottom field first.

However, the problem is irregular and sporadic in your exported MOV file. A wrong fied order issue would have fwd/back for every frame pair, all of the time

So it's more likely problem is a source filter issue. Whatever you are currently using, try something else . E.g. if you are using FFVideoSource (ffms2), try LWLibavVideoSource (LSmash) instead or BSVideoSource ( BestSource)

[low-fat-al]

I know the source is bottom field first. I set up the deinterlace as bottom field first.

What I am using, I have used Hybrid, I like Hybrid with all the features. I have also used ff-Works and Shutter Encoder.

Been a minute since I have done any scripting. So, yeah I am guess I am lazy and relying on these GUI driven apps using all the open source tools.

[Selur]

source if bff, overwriting scan type to bff and using QTGMC+Bob I see no problem with the sample clip

[low-fat-al]

The sample clip being the source clip? My results keep giving me a jerky back and forth.
I did overwritting scan type QTGMC+Bob

Check the other result clip and see.
I also just had this issue on a MiniDV firewire captured file that is also having the same issue.

[Selur]

I used "Here is a 30 cut off of the original AVI file" with:

# Imports
import vapoursynth as vs
# getting Vapoursynth core
import ctypes
import sys
import os
core = vs.core
# Limit frame cache to 48473MB
core.max_cache_size = 48473
# Import scripts folder
scriptPath = 'F:/Hybrid/64bit/vsscripts'
sys.path.insert(0, os.path.abspath(scriptPath))
# Loading Support Files
Dllref = ctypes.windll.LoadLibrary("F:/Hybrid/64bit/vsfilters/Support/libfftw3f-3.dll")
# loading plugins
core.std.LoadPlugin(path="F:/Hybrid/64bit/vsfilters/DenoiseFilter/ZSmooth/zsmooth.dll")
core.std.LoadPlugin(path="F:/Hybrid/64bit/vsfilters/GrainFilter/AddGrain/AddGrain.dll")
core.std.LoadPlugin(path="F:/Hybrid/64bit/vsfilters/DenoiseFilter/NEO_FFT3DFilter/neo-fft3d.dll")
core.std.LoadPlugin(path="F:/Hybrid/64bit/vsfilters/DenoiseFilter/DFTTest/DFTTest.dll")
core.std.LoadPlugin(path="F:/Hybrid/64bit/vsfilters/Support/EEDI3m_opencl.dll")# vsQTGMC
core.std.LoadPlugin(path="F:/Hybrid/64bit/vsfilters/ResizeFilter/nnedi3/NNEDI3CL.dll")
core.std.LoadPlugin(path="F:/Hybrid/64bit/vsfilters/Support/libmvtools.dll")
core.std.LoadPlugin(path="F:/Hybrid/64bit/vsfilters/Support/fmtconv.dll")
core.std.LoadPlugin(path="F:/Hybrid/64bit/vsfilters/DeinterlaceFilter/Bwdif/Bwdif.dll")
core.std.LoadPlugin(path="F:/Hybrid/64bit/vsfilters/Support/akarin.dll")
core.std.LoadPlugin(path="F:/Hybrid/64bit/vsfilters/SourceFilter/BestSource/BestSource.dll")
# Import scripts
import qtgmc
import validate
# Source: 'C:\Users\Selur\Desktop\8mm Tape03 _Hi8Deck__SE_30SecCut.avi'
# Current color space: YUV411P8, bit depth: 8, resolution: 720x480, frame rate: 29.97fps, scanorder: bottom field first, yuv luminance scale: limited, matrix: 470bg, format: DV
# Loading C:\Users\Selur\Desktop\8mm Tape03 _Hi8Deck__SE_30SecCut.avi using BestSource)
clip = core.bs.VideoSource(source="C:/Users/Selur/Desktop/8mm Tape03 _Hi8Deck__SE_30SecCut.avi", cachepath="J:/tmp/8mm Tape03 _Hi8Deck__SE_30SecCut_bestSource", track=0, hwdevice="opencl")
frame = clip.get_frame(0)
# setting color matrix to 470bg.
clip = core.std.SetFrameProps(clip, _Matrix=vs.MATRIX_BT470_BG)
# setting color transfer (vs.TRANSFER_BT601), if it is not set.
if validate.transferIsInvalid(clip):
  clip = core.std.SetFrameProps(clip=clip, _Transfer=vs.TRANSFER_BT601)
# setting color primaries info (to vs.PRIMARIES_BT470_BG), if it is not set.
if validate.primariesIsInvalid(clip):
  clip = core.std.SetFrameProps(clip=clip, _Primaries=vs.PRIMARIES_BT470_BG)
# setting color range to TV (limited) range.
clip = core.std.SetFrameProps(clip=clip, _ColorRange=vs.RANGE_LIMITED)
# making sure frame rate is set to 29.97fps
clip = core.std.AssumeFPS(clip=clip, fpsnum=30000, fpsden=1001)
# making sure the detected scan type is set (detected: bottom field first)
clip = core.std.SetFrameProps(clip=clip, _FieldBased=vs.FIELD_BOTTOM) # bff
# adjusting color space from YUV411P8 to YUV444P16 for vsQTGMC
clip = core.resize.Bicubic(clip=clip, format=vs.YUV444P16, range_s="limited")
# Deinterlacing using QTGMC
clip = qtgmc.QTGMC(Input=clip, Preset="Fast", TFF=False, opencl=True) # new fps: 59.94
# Making sure content is preceived as frame based
clip = core.std.SetFrameProps(clip=clip, _FieldBased=vs.FIELD_PROGRESSIVE) # progressive
# adjusting output color from: YUV444P16 to YUV420P10 for NVEncModel
clip = core.resize.Bicubic(clip=clip, format=vs.YUV420P10, range_s="limited", dither_type="error_diffusion")
# set output frame rate to 59.94fps (progressive)
clip = core.std.AssumeFPS(clip=clip, fpsnum=60000, fpsden=1001)
# output
clip.set_output()

and got the attached file,... ah I just noticed I use BestSource as default ,... Hmm, using LWLibavSource I see no problem either.

Check the other result clip and see.

for what, those clips don't really document how they were created => useless too me

[low-fat-al]

Ok. In Hybrid, how do you change it to BestSource as default or even the LWLibavSource?

[Selur]

Filtering->Vapoursynth->Misc->Source has options to influence the source filter choice.
The Vapoursynth Script Preview allows you to see the generated script,...
(LWLibavSource should be chosen by default)

[low-fat-al]

[Attachment 88144 - Click to enlarge]

These are the settings I see under source.

I do not see how to do the script preview. And if the script preview comes up, can you change it there and add in the BestSource?

[Selur]

Bestsource wasn't available back in 2022.
With that version, on macos, your choices are:
a. use LWLibAVSource
or
b. use FFMPEGSource2
if both shot the problem for you, the issue probably was fixed in libav during the last three years,...

Cu Selur

[low-fat-al]

I am only on a Mac and love this application. Do you have an updated Mac version?

[Selur]

No.

[low-fat-al]

I truly appreciate what you have developed. The last Mac version works really well. I understand if you can't update it per resources, etc.

I could not get the AVI to work with all the different options on source settings. I did however find a way to make it work.
I used ff-Works, Shutter Encoder works for this as well, to rewrap the AVI to an MOV file. Imported in Hybrid and no issues whatsoever.

So if anyone is dealing with odd issues with AVI files, rewrap them as an MOV and try again. When you are rewrap them, you are not encoding or losing any of the valuable video quality. Just changing the container file is all. Codec remains the same, etc.