MeGUI Avisynth issue on DVD ripping after Deinterlacing

[Mastur]

Hello, I'm new on the ripping/encoding stuff. I am currently trying to rip an anime DVD, and am encountering some issues which I found difficulty on solving myself. Even after trying to search the web for troubleshooting, it proved futile since I am not even sure what terms are my difficulties called, and google won't be as friendly when I describe my problems on a very long sentence.



Since I'm not even sure if what I've done until now is the right thing, I'll just tell step-by-step what I have done so far:

1. I installed/extracted CCCP Player, MeGUI, avisynth, VLC, and VirtualDub. I'm only using the first 3 so far.

2. I made sure that everything works out fine. I tried playing various media on both CCCP Player/VLC Player, and updated all of them with the latest patches.

3. I used MeGUI's HD Streams Extractor and yielded 2 outputs (video stream in mkv container + AC3 file) from a single VOB which is the whole movie only (menu and specials are on seperated VOB files when I checked each one on media players) in my DVD.

4. I used MeGUI's File Indexer and did the idx job queue, yielding an *.ffindex file. After the job got done, the Avisynth Script Creator window appeared, and another window showing my indexed mkv which I got earlier. I tried seeking on the video sample window, and noticed that as I jumped from a frame and next, it has a pattern of interlacing

...smooth, smooth, smooth, interlaced, interlaced...

5. I went to Filters Tab of the Avisynth Script Creator, and on the Deinterlacing section and clicked on the Analyse button. After the process, I got the deinterlacing settings from the analysis and clicked on the Preview AVS Script button.

Please refer to the screenshots below, as they also show the issues/problems I wanted to do something about.



Screenshot#1 - Notice the distortions near the character's line art, and when I play it they're like moving color distortions too. Not sure what's the right term for it.





Screenshot#2 - Notice what looks like shadows but are combed interlacing leftovers, these supposed to be tentacles in the scene are present in two adjacent frames, one of them is supposed to be on the previous frame, while the other is in the following frame. Aside from this, there are also similar leftovers, of color on characters in motion present on other scenes.



Aside from these, I also encounter what I believe as Aliasing issue, where diagonal objects/lines in video seemed to be ladder which I also believe as a result of deinterlacing.



I'm not sure if these information will prove useful, but just in case:

- My source DVD which I am currently ripping is an Anime disc.
- Running MeGUI on Windows 7 (32bit) and tried running the same apps on Windows Vista (32bit)
- I never did on Avisynth Script Creator any Noise Reduction, Cropping or Resize.
- Never loaded any plugins. (IDK if Avisynth loads some default plugins, but I never touched the script tab yet)

Regarding the last info, as I've tried searching earlier and failed, I've read some threads here and over the net regarding marching ants, deinterlacing artifacts, and chroma ghosting, which might have been the same/similar case as mine. But I don't get the replies, since I'm just starting using MeGUI and Avisynth.

I tried to do my homework and have spent time reading guides/basics, but I really don't know about plugins, especially custom plugins. This is also the best I could explain my problems right now, but if there are questions and info needed, I'll try to answer them up to my current knowledge.

So if my problems are to be solved by custom plugins, I want to apologize for not knowing their basics and also would be glad to be guided if anyone would kindly do so. I'm still a newbie, so if in case this thread should be on the newbie section. I want to say sorry in advance for the mods for making this thread here. Thank you.


EDIT: Sample m2v from the source http://www.sendspace.com/file/362h0h

[manono]

A video is worth a thousand words. First, no automatic analysis is worth a damn with difficult sources, and often anime is among the most difficult of all. Provide DVD samples for the parts that didn't turn out the way you had hoped. Open a VOB in DGIndex, scroll to the part you want (preferably one with steady movement), use the [ and ] buttons to isolate a small section (10 seconds will be plenty), go File->Save Project and Demux Video, and upload the resulting M2V here or to some third party filesharing site such as Sendspace or MediaFire.

Often those difficult anime sources require manual scripting and encoding. So, if you're serious about your hobby be prepared to learn AviSynth.

[Mastur]

I just did what you said, and uploaded the m2v file yielded from DGIndex. I'll be willing to learn about using various avisynth scripts and plugins.

[poisondeathray]

Not sure from your description what #1 is, but it sounds like "dot crawl" . There is evidence if it from your sample as well, they look like buzzing dots on the door frame. You can use filters such as tcomb , checkmate

Have a look here
http://www.aquilinestudios.org/avsfilters/dotcrawl.html


#2 is chroma lag or chroma ghosting. This script (originally from the uber guru "didee") works well for that problem and on your sample
http://forum.doom9.org/showthread.php?p=1582950#post1582950

So you will likely have to combine several filters. Dotcrawl filters usually work better before IVTCing so I would apply those first . Note they are very damaging to fine details so you will have to adjust the settings

[Mastur]

Thanks for the advice, it's much appreciated. I'd take time and read about those plugins and try it as you've said. I'll be reporting back the results once I get done.

So, how should I apply the filters? They're called through script right? I mean, do I only have to use one avisynth script and call each filters in this order?

- dotcrawl filter
- interlacing
- didee's code

And also, can I ask which plugins are necessary to be downloaded. A link for each would be very very nice.

[manono]

I didn't really notice any dot crawl in the sample, but I'll take pdr's word for it that it's there. The only chroma ghosting I saw was on frame 64 after the IVTC. It can often be fixed by adding a 'Chroma=True' to TFM as is true in this case. All-in-all, I don't think it was such a great sample. Neither of the scenes from the 2 pics at the top were included. The script that looked fine to me was:

TFM(Chroma=True)
TDecimate(Mode=1)

The filters mentioned can be found here:

TIVTC:
http://bengal.missouri.edu/~kes25c/TIVTCv105.zip

TComb and Checkmate uploaded below. I couldn't find a doc for Checkmate.

[Mastur]

The seemed to be "dotcrawl" near the line art edge of characters are what's like marching ants that appeared after applying deinterlacing as suggested by MeGUI after analysis. Same goes for the said chroma lagging. They're like tiny diamond-shaped distortions which moves near the objects in the video (e.g. near the line art of the hair, face, etc.)

EDIT: How do I use checkmate? Any format for commands regarding it?

Also, on manono's post, I tried to use these:

TFM(Chroma=True)
TDecimate(Mode=1)

...inserted them this way with what MeGUI put on script after analysis:

tfm(order=-1, chroma=True)
tdecimate(mode=1,hybrid=1)

But the Chroma leftovers turned as "character ghosts" which is worse than before, having only a little leftover:



Before: TFM(mode=-1)




After: TFM(mode=-1, chroma=true)




Then, TFM(mode=1, chroma=true)


PS: Seems like imageshack reduces the actual quality of my screenshots. Any recommended image hosting sites for better viewing, or should I just attach the actual image files?

[Mastur]

I just tried doing what poisondeathray said regarding Issue # 2 (Chroma spills/ghosting) and I think it worked as I wanted it to be:


AVS Script

LoadPlugin("C:\fakepath\MeGUI_2050_x86\tools\avisy nth_plugin\TCombv2B2\TComb\TComb.dll")
LoadPlugin("C:\fakepath\MeGUI_2050_x86\tools\avisy nth_plugin\TIVTC\TIVTC.dll")
LoadPlugin("C:\fakepath\MeGUI_2050_x86\tools\avisy nth_plugin\vinverse\Release\vinverse.dll")
LoadPlugin("C:\fakepath\MeGUI_2050_x86\tools\avisy nth_plugin\RemoveGrain\RemoveGrain.dll")
LoadPlugin("C:\fakepath\MeGUI_2050_x86\tools\avisy nth_plugin\masktools-v2.0a48\mt_masktools-25.dll")
LoadPlugin("C:\fakepath\MeGUI_2050_x86\tools\avisy nth_plugin\Average_v11\src\Release\Average.dll")
LoadPlugin("C:\fakepath\MeGUI_2050_x86\tools\ffms\ ffms2.dll")
FFVideoSource("C:\fakepath\VTS_05.mkv", threads=1)
#deinterlace
#crop
#resize
#denoise

luma = tfm(pp=0, slow=2)
chroma = vinverse().Srestore(omode="PP3", cache=10)

# manual sync: figure out which frame (previous,current aka p,c) of 'chroma' clip is most similar to current frame of 'luma' clip

# 46*log(|x-y|+1) uses the full [0,255]-range and scales little differences better than |x-y|*2
diffp = mt_lutxy(luma,chroma.selectevery(1,-1),"x y - abs 1 + log 46 *")
diffc = mt_lutxy(luma,chroma, "x y - abs 1 + log 46 *")

# average difference between compared frames
mp = mt_lutf(diffp,diffp,"avg",expr="x")
mc = mt_lutf(diffc,diffc,"avg",expr="x")

# build conditional masks based on the caculated comparisons
maskp = mt_lutxy(mp,mc,"x y < 255 0 ?")

# finally merge the luma of the tfm with the chroma of the srestore clip accordingly to the binary mask
MergeChroma(luma,chroma).mt_merge(chroma.selecteve ry(1,-1),maskp,luma=true,Y=2,U=3,V=3)

tdecimate(mode=1)



# debug output. check calculations and decisions

#stackhorizontal(stackvertical(maskp,luma)\
#,stackvertical(chroma.selectevery(1,-1),chroma))

#stackhorizontal(stackvertical(diffp,diffc)\
#,stackvertical(mp,mc))

Script Output Screenshot:





Now I only have to remove those mirage-like distortions which I mentioned on Issue#1. The resulting stream now have 23.976 fps constant, which is also what I intend it to be.

29:13.042 x 23.976 fps = rounded up as 42031 (42030.934992)

[manono]

...inserted them this way with what MeGUI put on script after analysis

Nowhere do I see you using the script as I wrote it down. It worked fine in the sample. You're showing pictures of chroma ghosting, but with different scripts. If you messed up the field order, then of course it'll look worse. It proves nothing at all.