Cant get rid of aliasing

[killerteengohan]

I just learned how to rip stuff from Hulu and I checked the quality of Yu-Gi-Oh! GX episodes on there. They look like crap to me and I didnt think I would be able to improve them enough to make it worth my time. I downloaded one anyways and attempted to fix and it turned out pretty darn good. Almost as good as my DVDRips but not nearly as perfect. Still better quality than anything ive been able to find anywhere.

So far I have it looking like this.

http://img842.imageshack.us/img842/3088/season2sample.png


This is WAY better than the original source from Hulu, theres looks like total crap compared to this. While mine does look better I still couldnt get rid of all that aliasing and zig zaggy lines from the source.

This is what it looks like coming from Hulu before I fix it.

http://img806.imageshack.us/img806/8803/season2hulu.png


as you can see it looks great but theres a problem with it.

Im using avisynth to fix this up and have used an antialiasing filter. As you can see it did a great job at fixing the aliasing but thats when its still. When something is moving, the moving parts of the video look blurry and VERY aliased.

heres an example. This guy is talking and this is what happens to his lips the entire time he talks.

http://img163.imageshack.us/img163/651/problemj.png

http://img197.imageshack.us/img197/5519/problem2z.png

that happens to all of the moving things and only the moving stuff. its perfectly fine once its still.

Everything goes blurry and aliased when there doing a pullback or side moving like this.

http://img17.imageshack.us/img17/3575/problem3q.png

Heres the source vid if you need to see it.

http://www.hulu.com/watch/196969/yu-gi-oh-gx-back-to-duel

What can I do to the script to get rid of this aliasing while the video is moving?

want to see my encode so you can see wha Im talking about incase I didnt describe it well enough?

it can be found here http://www.demonoid.me/files/details/2849366/47412042/

Ive tried both Santiag and MAA antialiasing filters and I still get this issue. any suggestions? Am I stuck with this because the source had it and is terrible?

[poisondeathray]

Try QTGMC's progressive mode

e.g

QTGMC(preset="very slow" , inputtype=1, sharpness=0.6)

Or you can try dozens of other avisynth AA filters , or combinations of them sometimes work

If you still can't solve the motion aliasing issue despite playing with the other filters or QTGMC settings - I cannot access hulu in Canada, so maybe you can upload a sample

[killerteengohan]

Try QTGMC's progressive mode

e.g

QTGMC(preset="very slow" , inputtype=1, sharpness=0.6)

Or you can try dozens of other avisynth AA filters , or combinations of them sometimes work

If you still can't solve the motion aliasing issue despite playing with the other filters or QTGMC settings - I cannot access hulu in Canada, so maybe you can upload a sample

ok heres your sample. Its the original video I have to work with.

http://www.fileserve.com/file/5v8s6CU/GX201.264

[poisondeathray]

Ive tried both Santiag and MAA antialiasing filters and I still get this issue. any suggestions? Am I stuck with this because the source had it and is terrible?

Yes, the source is terrible, but you can still improve it. One major problem is even on duplicate frames, there is a change in aliasing pattern (cartoon doesn't move, but aliasing does)

Next time, just cut a section to demonstrate you don't need such a big sample

I don't have time to go over the whole thing detail, but if there is a different section that is giving a problem, then list the approximate frame# or time , but this looks ok

AwarpSharp2(depth=8)
Santiag(2,2)
Toon(0.6)
AwarpSharp2(depth=5)
Santiag(1,1)
Toon(0.4)
QTGMC(InputType=1, sharpness=0.8)

As usual fine tune to your tastes. For example you might get marginally better results using a "very slow" or "placebo" preset for QTGMC. There might be other stuff you can improve by stacking other filters, etc..

I cut a random sample where there is movement, and the filtered version

EDIT: there is some minor ghosting induced by qtgmc, not sure it might be cause by the duplicates

[killerteengohan]

Ive tried both Santiag and MAA antialiasing filters and I still get this issue. any suggestions? Am I stuck with this because the source had it and is terrible?

Yes, the source is terrible, but you can still improve it. One major problem is even on duplicate frames, there is a change in aliasing pattern (cartoon doesn't move, but aliasing does)

Next time, just cut a section to demonstrate you don't need such a big sample

I don't have time to go over the whole thing detail, but if there is a different section that is giving a problem, then list the approximate frame# or time , but this looks ok

AwarpSharp2(depth=8)
Santiag(2,2)
Toon(0.6)
AwarpSharp2(depth=5)
Santiag(1,1)
Toon(0.4)
QTGMC(InputType=1, sharpness=0.8)

As usual fine tune to your tastes. For example you might get marginally better results using a "very slow" or "placebo" preset for QTGMC. There might be other stuff you can improve by stacking other filters, etc..

I cut a random sample where there is movement, and the filtered version

EDIT: there is some minor ghosting induced by qtgmc, not sure it might be cause by the duplicates

That first cut file doesnt work at all. its only 600kb and shows no video at all.

looks ok, I dont even really notice ghosting in your sample, was it on other parts?
what made you decide to use the toon filter?
and should I use QTGMC before or after the antialiasing filter?

[poisondeathray]

looks ok, what made you decide to use the toon filter?
and should I use QTGMC before or after the antialiasing filter?

To darken lines, because awarpsharp2 will thin them out. You can use some other line darkener e.g. fastlinedarken . Or maybe you don't want to darken them. It's up to you

QTGMC should be used after - but it's causing some ghosting. Look frame by frame at the card shuffling hands. There might be some settings you can tweak, or maybe you can decimate the dupes before filtering and make it VFR encode

[killerteengohan]

looks ok, what made you decide to use the toon filter?
and should I use QTGMC before or after the antialiasing filter?

To darken lines, because awarpsharp2 will thin them out. You can use some other line darkener e.g. fastlinedarken . Or maybe you don't want to darken them. It's up to you

QTGMC should be used after - but it's causing some ghosting. Look frame by frame at the card shuffling hands. There might be some settings you can tweak, or maybe you can decimate the dupes before filtering and make it VFR encode

I didnt really see ghosting or dupes in your sample. wont SRestore(23.976) fix that?

[killerteengohan]

I think I actually got mine to look better than yours by picking and choosing my own choice of filters because they were a bit better. Thanks for the info though, if it wasnt for the QTGMC I would have never been able to get it. I got rid of the so called ghosting as well.