Harvey Birdman Attorney at Law - Cartoon

[stormy]

Hi -

I was hoping for some guidance on how to correct the aggressive rainbow effect seen in this clip? I noticed some ringing too but I can let that slide.

Based on the attached clip, is an IVTC the proper way to process the material?

FYI - I have been using Hybrid to work on this video.

Thanks in advance.

[Selur]

If BasicVSR++ is an option, using TIVTC, DotKill, RainbowSmooth and BasicVSR++ (script: https://pastebin.com/kzXd7DKf) seems to work fine. (I especially like the antialiasing BasicVSR++ does on this clip.)

Cu Selur

[stormy]

Wow that is a nice result!

I had to look up what BasicVSR++ is because I hadn't heard of it before. It appears I can install the dev version of Hybrid from your Google Drive and set it up though. I am having trouble finding the exact Nvidia GPU requirements, I only have an older GTX 980 ti, would that work?

[Sharc]

Certainly not as nice as Selur's, but perhaps a bit simpler, you may want to try something along the line

v=LWLibavVideoSource("Harvey Birdman.mpg")
chroma = v.checkmate(thr=12,max=25,tthr2=25)
luma   = v.checkmate(thr=12,max=25,tthr2=0)
luma.MergeChroma(chroma)
TFM().TDecimate()

[Selur]

I only have an older GTX 980 ti, would that work?

It might, but it will probably be too slow to be useful, but you can give it a try.
Worst case you downloaded a lot of stuff and it doesn't work.

Certainly not as nice as Selur's, but perhaps a bit simpler, you may want to try something along the line

I would add some dehalo (YAHR with 32) and some antialiasing (<- this will be the tricky part).

Cu Selur

Ps.: conventional: https://pastebin.com/ag9DTxbt, sadly no idea for good aa.

[stormy]

Thank you both for the additional thoughts and suggestions, I might need to go the more traditional route. I tried running the BasicVSR++ filter and got the following error message in the logs.

Hybrid seems to detect my GPU and shows those additional filters being available when I start the application. Wondering if perhaps I don't have a setting correct? I noticed I can't preview the video when I have BasicVSR++ enabled either.

[Selur]

That error says nothing, which shouldn't be surprising since it's from a log what starts with:

This log is only intended for user information. It should not be part of a bug/problem report!!

(read: https://www.selur.de/support)
Before trying to encode, best try the Vapoursynth Preview, if that fails encoding won't work either.
Also, since you only have 6GB VRAM (or less), while using "Filtering->Vapoursynth->Other->BasicVSR++" you will need to use tiling to even have a change to get it working.
(maybe: https://github.com/HolyWu/vs-basicvsrpp/issues/12 helps to understand tiling)

Cu Selur

[stormy]

Sorry about including that log screenshot, I saw that message at the beginning but didn't have any other error messages to work from. I appreciate you linking me the proper way to get a debug output though.

Ah that is very helpful, this AI filtering is all very new to me. I will read that information over and see if I am able to achieve a good result by using tiling on this old GPU. Worst case, you both gave me some traditional methods that improve upon the original pretty significantly. Thanks again!

[stormy]

Small update - Ended up getting a RTX 3060 for the AI filtering, price was right and I don't play computer games. Not super fast with the processing but good enough.

Wondering if there is any way to clean up the combing artifacts on the lip flaps after doing IVTC? Most lip flaps are fine but here is an example of what I mean, Jetson in the background behind the glass.

Bob QTGMC seems to work well as an alternative but I don't really think that's the proper way to handle this material? Just looking for some advice, thanks!