Consultation, Getting best Rip from anime source DVD

[zanzar]

so i opened many threads here and i can say i feel i came a long way learning.
i have some DVDISO files of anime that i need to make the best source possible out of them.
i want to know that i know what i am doing and i dont miss anything later re encoding again because of it
i also included a chapter sample.

i wanted my final result to look close to the original video + madVR maximized ,Nnedi3 + 256 neurons and octuple luma resolution.
of course it crashes if i play it so i can just get a 1 shot which is the one after i press "apply"
Screen shots:
1.Original
2.Original+madVR

these specific pictures are clear but there are some scenes that have more noise and other stuff

this is the script i used

SetMtMode(5,4)
Mpeg2Source("D:\PXY_10034\VIDEO_TS\VTS_01_1.d2v")
ColorMatrix(mode="Rec.601->Rec.709")
QTGMC( Preset="Placebo", SourceMatch=3, Lossless=2, EZDenoise=2.5, NoisePreset="Slow" )
nnedi3_rpow2(2, cshift="Spline64Resize", fwidth=1280, fheight=720)
Toon(0.35)


i know this script will be insanely slow but i only did it on a few frames in order to get "the best result"

i guess this one will be more practical

SetMtMode(5,4)
Mpeg2Source("D:\PXY_10034\VIDEO_TS\VTS_01_1.d2v")
ColorMatrix(mode="Rec.601->Rec.709")
QTGMC( Preset="Slow", SourceMatch=3, Lossless=2, EZDenoise=2.5, NoisePreset="Slow" )
nnedi3_rpow2(2, cshift="Spline36Resize", fwidth=1280, fheight=720)
Toon(0.35)

This is that i've got from it

also is Megui de interlaces by itself?
if so is he doing it 2 times because of the script?

also i need to know how to get 30 fps output and not 60 as in this script as i think 60 is not necessary
are there any other lines that i should know about before i start?

[manono]

Why not just IVTC it like normal people?

SetMtMode(5,4)
Mpeg2Source("D:\PXY_10034\VIDEO_TS\VTS_01_1.d2v")
ColorMatrix(mode="Rec.601->Rec.709")
TFM().TDecimate(Mode=1)
nnedi3_rpow2(2, cshift="Spline64Resize", fwidth=1280, fheight=720)

It'll return the correct framerate and be a helluva lot faster, too. You should also be able to use SetMTMode(2) in the script

If you want to denoise it or filter it in other ways, then put on a filter designed for what you want.

[jagabo]

Yes QTGMC is wrong for this video. It will create artifacts on thin horizontal lines and EZDenoise=2.5 will obliterate all the fine detail (like the intentional grain on the white wall in the background of the opening shot). If you want a sharper picture after upscaling with nnedi3 try a mild awarpsharp(depth=5) and sharpen(0.2). I wouldn't use toon to darken lines. It looks too artificial to me. Also consider using Mpeg2Source's deringing option. It's deblocking is too strong and the video doesn't have much in the way of DCT blocking artifacts.

[zanzar]

Yes QTGMC is wrong for this video. It will create artifacts on thin horizontal lines and EZDenoise=2.5 will obliterate all the file detail (like the intentional grain on the white wall in the background of the opening shot). If you want a sharper picture after upscaling with nnedi3 try a mild awarpsharp(depth=5) and sharpen(0.2). I wouldn't use toon to darken lines. It looks too artificial to me. Also consider using Mpeg2Source's deringing option. It's deblocking is too strong and the video doesn't have much in the way of DCT blocking artifacts.

so would you use the script suggested above?
so QTGMC is generally isnt recommended for anime ?
what does the script above does? (i am not familiar with it "

TFM().TDecimate(Mode=1)

can you please explain a bit about this script?
thanks

[jagabo]

TFM() pairs fields to restore the original progressive film frames. TDecimate() removes duplicate frames, in this case restoring the original 23.976 fps film frame rate. Mode=1 is explained in the docs for that filter. It's a special mode for animation.

<edit>

One thing to watch out for though: anime sometimes alternates between different frame rates, interlaced and progressive. In those cases you might want to use QTGMC or another bobber, then encode at 59.94 fps or variable frame rate.

</edit>

[zanzar]

TFM() pairs fields to restore the original progressive film frames. TDecimate() removes duplicate frames, in this case restoring the original 23.976 fps film frame rate. Mode=1 is explained in the docs for that filter. It's a special mode for animation.

<edit>

One thing to watch out for though: anime sometimes alternates between different frame rates, interlaced and progressive. In those cases you might want to use QTGMC or another bobber, then encode at 59.94 fps or variable frame rate.

</edit>

so "TFM().TDecimate(Mode=1) " is the way to go ?
should i use it on all my DVDs ? instead of the QTGMC?

so if i have a problems like noise how do i deal with it ?
is QTGMC is generally not recommended for anime?

[manono]

so "TFM().TDecimate(Mode=1) " is the way to go ?

For telecined NTSC anime DVDs, yes.

But you should check thoroughly as sometimes different parts might have some parts that are true 29.97fps, either progressive or interlaced. That's more likely to be true sometimes for the series rather than the movies.

so if i have a problems like noise how do i deal with it ?

With a denoiser.

Is QTGMC is generally not recommended for anime?

I wouldn't use it for any telecined content, anime or live-action. For field-blended anime I would use it followed by an unblender such as SRestore.

[zanzar]

so "TFM().TDecimate(Mode=1) " is the way to go ?

For telecined NTSC anime DVDs, yes.

But you should check thoroughly as sometimes different parts might have some parts that are true 29.97fps, either progressive or interlaced. That's more likely to be true sometimes for the series rather than the movies.

so if i have a problems like noise how do i deal with it ?

With a denoiser.

Is QTGMC is generally not recommended for anime?

I wouldn't use it for any telecined content, anime or live-action. For field-blended anime I would use it followed by an unblender such as SRestore.

if the vob files look like that in media info https://forum.videohelp.com/images/imgfiles/3wJzdeH.jpg

telling me 29.970 fps and NTSC is it safe to assume that "TFM().TDecimate(Mode=1)" would be the best approach ?

[manono]

if the vob files look like that in media info https://forum.videohelp.com/images/imgfiles/3wJzdeH.jpg

telling me 29.970 fps and NTSC is it safe to assume that "TFM().TDecimate(Mode=1)" would be the best approach ?

That tells no one anything remotely useful. The only way to tell how you should deal with a video is with your eyes. Make your script with MPEG2Source and no other filters and start looking around. Sometimes, to learn more, put on a fast bobber like Yadif(Mode=1) to examine the fields more closely. After you have a look at different parts, only then decide if it can and should be IVTC'd, unblended, bobbed, left alone, or what.

[zanzar]

TFM() pairs fields to restore the original progressive film frames. TDecimate() removes duplicate frames, in this case restoring the original 23.976 fps film frame rate. Mode=1 is explained in the docs for that filter. It's a special mode for animation.

<edit>

One thing to watch out for though: anime sometimes alternates between different frame rates, interlaced and progressive. In those cases you might want to use QTGMC or another bobber, then encode at 59.94 fps or variable frame rate.

</edit>

so "TFM().TDecimate(Mode=1) " is the way to go ?

For telecined NTSC anime DVDs, yes.

But you should check thoroughly as sometimes different parts might have some parts that are true 29.97fps, either progressive or interlaced. That's more likely to be true sometimes for the series rather than the movies.

so if i have a problems like noise how do i deal with it ?

With a denoiser.

Is QTGMC is generally not recommended for anime?

I wouldn't use it for any telecined content, anime or live-action. For field-blended anime I would use it followed by an unblender such as SRestore.

it seems to be that "TFM().TDecimate(Mode=1)" is very basic and just take the video and deinterlace it.
it doesnt fix any issues
if i see the problem i dont know what causing it and dont know what filter to use in order to fix it T_T

i included another sample of other DVDISO i have and the image there is not clear at all
QTGMC seems to help but "TFM().TDecimate(Mode=1)" does not.

i guess its because QTGMC have denoise in the script

how would you make the best of this video ? (with script please)

[davexnet]

TFM().TDecimate(Mode=1) matches the fields and deletes duplicate frames. It's really the first thing to do.
If you're not happy with the image quality, there could be some noise reduction or sharpening or other special items that it needs.

What are you talking about specifically ?

[zanzar]

TFM().TDecimate(Mode=1) matches the fields and deletes duplicate frames. It's really the first thing to do.
If you're not happy with the image quality, there could be some noise reduction or sharpening or other special items that it needs.

What are you talking about specifically ?

sorry took time to upload
i edited

[manono]

it seems to be that "TFM().TDecimate(Mode=1)" is very basic and just take the video and deinterlace it.
it doesnt fix any issues

It's not basic at all and it doesn't deinterlace as its main function. It field matches followed by removing dupes (as davexnet said), something very different.

If you want other filtering, then put on other filters. I already gave you the link for the denoisers. Or maybe use QTGMC in progressive mode if you want to make use of its denoising capabilities.

TFM().TDecimate(Mode=1)
QTGMC( Preset="Slower", InputType=1, EZDenoise=2.5)

[jagabo]

I'd try something like this with that video:

Mpeg2Source("D:\Downloads\VTS_01_1(1).d2v", CPU2="ooooxx", Info=3) # deringing
Crop(8,0,-8,-0) # crop black borders
TFM(d2v="D:\Downloads\VTS_01_1(1).d2v", cthresh=5, pp=0) # field match
TDecimate(mode=1) # decimate back to 23.976 fps, animation mode

ColorYUV(cont_y=30, cont_u=30, cont_v=30) # increase contrast and saturation
ColorMatrix(mode="rec.601->rec.709") # colors to rec.709 for HD
CheckMate(thr=10, max=20, tthr2=20) # reduce dot crawl artifacts
DeRainBow() # reduce comb filter rainbows
MergeChroma(last, aWarpSharp(depth=20)) # sharpen chroma
TemporalDegrain(SAD1=100, SAD2=75, Sigma=4) # temporal denoise
Dup(blend=true, threshold=1.5) # blend duplicate frames
nnedi3_rpow2(2, cshift="Spline36Resize", fwidth=1280, fheight=720) # upscale
ChromaShift(c=-2) # shift colors left by 2 pixels
aWarpSharp(depth=5) # sharpen
Sharpen(0.3, 0.2) # sharpen

[zanzar]

I'd try something like this with that video:

Mpeg2Source("D:\Downloads\VTS_01_1(1).d2v", CPU2="ooooxx", Info=3) # deringing
Crop(8,0,-8,-0) # crop black borders
TFM(d2v="D:\Downloads\VTS_01_1(1).d2v", cthresh=5, pp=0) # field match
TDecimate(mode=1) # decimate back to 23.976 fps, animation mode

ColorYUV(cont_y=30, cont_u=30, cont_v=30) # increase contrast and saturation
ColorMatrix(mode="rec.601->rec.709") # colors to rec.709 for HD
CheckMate(thr=10, max=20, tthr2=20) # reduce dot crawl artifacts
DeRainBow() # reduce comb filter rainbows
MergeChroma(last, aWarpSharp(depth=20)) # sharpen chroma
TemporalDegrain(SAD1=100, SAD2=75, Sigma=4) # temporal denoise
Dup(blend=true, threshold=1.5) # blend duplicate frames
nnedi3_rpow2(2, cshift="Spline36Resize", fwidth=1280, fheight=720) # upscale
ChromaShift(c=-2) # shift colors left by 2 pixels
aWarpSharp(depth=5) # sharpen
Sharpen(0.3, 0.2) # sharpen

Thanks for the script i learned new things
also this

i have a rip i downloaded called "name+ [Raw] (DVD 708x480 x264 Hi10p AAC)"
i dont know why but he didnt crop the black bars , maybe intentionally (also i removed ColorYUV and Crop from your script so it would be easier to compare)
his rip looks very natural and has a small size but with good quality despite low bit rate

Original
With Your Script
Other Rip

if you zoom a bit you can see that the last one has the finest detail
here is detail from Mediainfo

Format : MPEG-4
Format profile : Base Media
Codec ID : isom (isom/avc1)
File size : 113 MiB
Duration : 26mn 42s
Overall bit rate mode : Variable
Overall bit rate : 591 Kbps
Encoded date : UTC 2014-12-25 07:48:00
Tagged date : UTC 2014-12-25 07:48:00

Video
ID : 1
Format : AVC
Format/Info : Advanced Video Codec
Format profile : High 10@L4
Format settings, CABAC : Yes
Format settings, ReFrames : 16 frames
Codec ID : avc1
Codec ID/Info : Advanced Video Coding
Duration : 26mn 42s
Bit rate : 403 Kbps
Maximum bit rate : 2 445 Kbps
Width : 708 pixels
Height : 480 pixels
Display aspect ratio : 16:9
Frame rate mode : Constant
Frame rate : 23.976 (24000/1001) fps
Color space : YUV
Chroma subsampling : 4:2:0
Bit depth : 10 bits
Scan type : Progressive
Bits/(Pixel*Frame) : 0.049
Stream size : 76.9 MiB (68%)
Title : Road to Heaven
Writing library : x264 core 142 r2431 ac76440
Encoding settings : cabac=1 / ref=16 / deblock=1:1:1 / analyse=0x3:0x133 / me=tesa / subme=11 / psy=1 / psy_rd=0.40:0.00 / mixed_ref=1 / me_range=24 / chroma_me=1 / trellis=2 / 8x8dct=1 / cqm=0 / deadzone=21,11 / fast_pskip=0 / chroma_qp_offset=-2 / threads=6 / lookahead_threads=1 / sliced_threads=0 / nr=0 / decimate=1 / interlaced=0 / bluray_compat=0 / constrained_intra=0 / bframes=16 / b_pyramid=2 / b_adapt=2 / b_bias=0 / direct=3 / weightb=1 / open_gop=0 / weightp=2 / keyint=240 / keyint_min=23 / scenecut=40 / intra_refresh=0 / rc_lookahead=60 / rc=crf / mbtree=1 / crf=18.0 / qcomp=0.60 / qpmin=0 / qpmax=81 / qpstep=4 / ip_ratio=1.40 / aq=1:0.60
Encoded date : UTC 2014-12-25 07:48:00
Tagged date : UTC 2014-12-25 07:48:27

Audio
ID : 2
Format : AAC
Format/Info : Advanced Audio Codec
Format profile : LC
Codec ID : 40
Duration : 26mn 42s
Bit rate mode : Variable
Bit rate : 185 Kbps
Maximum bit rate : 215 Kbps
Channel(s) : 2 channels
Channel positions : Front: L R
Sampling rate : 48.0 KHz
Frame rate : 46.875 fps (1024 spf)
Compression mode : Lossy
Stream size : 35.3 MiB (31%)
Title : Original
Language : Japanese
Encoded date : UTC 2014-12-24 22:46:04
Tagged date : UTC 2014-12-25 07:48:27]

any idea how he managed to pull it off?

[hech54]

All this for cartoon warez.

[jagabo]

if you zoom a bit you can see that the last one has the finest detail

You and I have very different opinions on what constitutes detail.

Most people are looking for more sharpness when they upscale, that's why I sharpened a bit. If you want less sharpeness remove the aWarpSharp() and Sharpen() filters. And use a less sharp resize like BilinearResize(). If you want more noise reduction use higher settings in TemporalDegrain(). Or use QTGMC(InputType=1, EZDenoise=2.0) or something like that and blur away all the detail in the bushes, etc.

[zanzar]

if you zoom a bit you can see that the last one has the finest detail

You and I have very different opinions on what constitutes detail.

Most people are looking for more sharpness when they upscale, that's why I sharpened a bit. If you want less sharpeness remove the aWarpSharp() and Sharpen() filters. And use a less sharp resize like BilinearResize(). If you want more noise reduction use higher settings in TemporalDegrain(). Or use QTGMC(InputType=1, EZDenoise=2.0) or something like that and blur away all the detail in the bushes, etc.

so just play with the filters until i get the result i want?

[jagabo]

so just play with the filters until i get the result i want?

Well, duh!

[zanzar]

so just play with the filters until i get the result i want?

Well, duh!

what are those "Encoding settings" in the spread sheet i posted ? looks complicated ...

also any idea what filter will give me this "shadow around lines affect" ?
one with the noise is the original DVDISO and the other is an "480p,DVD,x264-Hi10P,AC3" version some one made

http://screenshotcomparison.com/comparison/181493

[jagabo]

what are those "Encoding settings" in the spread sheet i posted ? looks complicated ...

Spreadsheet? You mean the MediaInfo report? Those are the placebo preset plus the tuning for animation. The x264 command line would be:

x264 --preset=placebo --tune=animation --crf=18 --output output.mp4 input.ext

also any idea what filter will give me this "shadow around lines affect" ?
one with the noise is the original DVDISO and the other is an "480p,DVD,x264-Hi10P,AC3" version some one made

http://screenshotcomparison.com/comparison/181493

I'm not sure what you mean. Are you referring to the oversharpening halos around all the black lines and other high contrast edges? Those are from sharpening the video before scaling. Your source DVD was made from an analog tape recording. Analog tape players often apply a sharpening filter (because of the inherently low resolution of tape) that creates those halos. You usually want to avoid those, not create or accentuate them. They are not part of the original picture.

[zanzar]

what are those "Encoding settings" in the spread sheet i posted ? looks complicated ...

Spreadsheet? You mean the MediaInfo report? Those are the placebo preset plus the tuning for animation. The x264 command line would be:

x264 --preset=placebo --tune=animation --crf=18 --output output.mp4 input.ext

also any idea what filter will give me this "shadow around lines affect" ?
one with the noise is the original DVDISO and the other is an "480p,DVD,x264-Hi10P,AC3" version some one made

http://screenshotcomparison.com/comparison/181493

I'm not sure what you mean. Are you referring to the oversharpening halos around all the black lines and other high contrast edges? Those are from sharpening the video before scaling. Your source DVD was made from an analog tape recording. Analog tape players often apply a sharpening filter (because of the inherently low resolution of tape) that creates those halos. You usually want to avoid those, not create or accentuate them. They are not part of the original picture.

i just play the DVD with mpchc with lav filters and mild madVR settings so i dont think there are much sharpening
so its a comparison with the DVDISO played trough MPCHC and some MKV rip with some ones filter settings.
do i use DeHalo alpha to fix this over sharpness?
you can zoom out to see the bigger picture (its zoomed in on default)
i am sorry if i am not talking with you on the same level i just dont know some of the terms you are using some times
thanks