De-Interlacing properly and changing 29.97FPS of DVD to 24FPS

[jagabo]

I forgot that I had modified the script from which that file was made. It included some other noise reduction and sharpening. So you won't get exactly the same thing when you render the earlier script.

@Jagabo - Can i have this part of the script too please. I really like the quality of the picture on your sample.

 
a = LWlibavAudioSource("VTS_01_1.VOB", stream_index=2) # get audio (decompressed to PCM)
v = Mpeg2Source("VTS_01_1.d2v", Info=3) # get video
AudioDub(v,a) # join audio and video together
QTGMC() # to 59.94p
SRestore() #discard blended frames, to 25p
Crop(10,58,-6,-58) # after this cropping you have a 704x364 frame
dehalo_alpha(rx=2, ry=2, BrightStr=1.2, DarkStr=1.2) # reduce oversharpening halos (damages picture a bit too)
RemoveDirtMC(20, false) # remove spots (from dust, delamination)
MergeChroma(last, aWarpSharp2(depth=20)) # sharpen the chroma
Spline36Resize(856, 364) # 364 * 2.35 = 855.4, round up to 856 for a mod 8 width
AssumeFPS(24000, 1000, sync-audio=true) # audio sample rate reduced from 48000 to 46080 (lossless)
SSRC(48000) # convert audio to 48000 Hz samples

There are many variations of RemoveDirtMC floating around. The one I used is attached to this post:
https://forum.videohelp.com/threads/408211-How-to-find-the-tags-on-a-video#post2706809

[Akuma786]

Thanks Jagabo, your script worked nicely. Much appreciated. This script should be useful on at least 10 DVDs I have which are similar from same company.

[Akuma786]

I have another dvd, same issue here too. It's also 29.97fps and i want to deinterlace it properly and change it to 24fps please.

sample:
https://easyupload.io/t9g3uj

[Sharc]

It's not the same. Looks like a broken telecine pattern to me.

You may try something along the line

TFM()
TDecimate(Cycle=85,CycleR=17)   #returns 23.976fps progressive frames

[Akuma786]

ou may try something along the line
Code:
TFM()
TDecimate(Cycle=85,CycleR=17) #returns 23.976fps progressive frames

Okay i'll try it now. Thanks

[jagabo]

I added a little more processing:

Mpeg2Source("Akuma786\VTS_01_2.d2v", Info=3) 

Crop(4,96,-8,-92)
TFM()
TDecimate(Cycle=85, CycleR=17)

MergeChroma(RemoveDirtMC(15, false), RemoveDirtMC(30, false))
Stab(range=2, dxmax=2, dymax=2, mirror=15)
LSFMod(150)

prefetch(24)

Higher values for RemoveDirtMC() will remove more dirt but will damage the picture more. Try different values and see what you like. There's still lots of artifacts at most shot changes.

[Akuma786]

Higher values for RemoveDirtMC() will remove more dirt but will damage the picture more. Try different values and see what you like. There's still lots of artifacts at most shot changes.

Yeah i tried that last night, I increased the values slightly higher, mostly more noticeable at scene change as you mentioned but I'm still happy. It's a lot better than the original source now and main thing is Avisynth is finally running on my PC without any issues. I been trying to get Avisynth run for many years and couldn't figure it out on my own. I must thank you all here. I appreciate all the support and assistance you guys provide here.

[Akuma786]

Another dvd, similar issue, badly interlaced. It's also 29.97fps and i want to deinterlace it properly and change it to 24fps please and clean up the video too. I thought i could use the script above but it didn't work on this video smoothly.
https://easyupload.io/oikvrm

[jagabo]

TFM()
TDecimate(Cycle=6, CycleR=1)

By the way, if there are irregularities in the pulldown pattern multiplying the Cycle and CycleR values can help. For example, the Cycle=85, CycleR=17 (17 times Cycle=5, CycleR=1) in the previous video. So with the above you may find that Cycle=12, CycleR=2 (or some other multiplier) might work better.

[Akuma786]

TFM()
TDecimate(Cycle=6, CycleR=1)

By the way, if there are irregularities in the pulldown pattern multiplying the Cycle and CycleR values can help. For example, the Cycle=85, CycleR=17 (17 times Cycle=5, CycleR=1) in the previous video. So with the above you may find that Cycle=12, CycleR=2 (or some other multiplier) might work better.

I see, I will try it out and see how it turns out. Thank you so much.

[jagabo]

And some color correction:

ColorYUV(gain_y=30, off_y=-14)
ConvertToRGB().RGBAdjust(r=221.0/192.0, b=221.0/138.0, bb=-42).ConvertToYV12()

before/after:

[Attachment 74153 - Click to enlarge]

This works pretty well for some shots, not so good for others. Averages out to ok-ish.

[Akuma786]

Colour correction looks nice. I will add this to the script. Thanks Jagabo.

[Akuma786]

Im ending up with 24.975 fps with the script and not 24fps.

here is script, am i doing it correctly:

a = LWlibavAudioSource("D:\Videos\Fearless Dragon Project Files\New folder\Fearless Dragon T80 2_0ch 192Kbps DELAY -49ms.ac3") # get audio (decompressed to PCM)
v = Mpeg2Source("D:\Videos\Fearless Dragon Project Files\New folder\Fearless Dragon.d2v", Info=3) # get video
AudioDub(v,a) # join audio and video together
Crop(8,80,-4,-84)
import("C:\Users\akuma\AviSynth+\plugins64+\RemoveDirtMC.avs")
TFM()
TDecimate(Cycle=12, CycleR=2) #returns 23.976fps progressive frames
ColorMatrix(mode="rec.601->rec.709")
ColorYUV(gain_y=30, off_y=-14)
ConvertToRGB().RGBAdjust(r=221.0/192.0, b=221.0/138.0, bb=-42).ConvertToYV12()
MergeChroma(RemoveDirtMC(15, false), RemoveDirtMC(30, false))
Stab(range=2, dxmax=2, dymax=2, mirror=15)
LSFMod(150)
Spline36Resize(640, 316)
prefetch(24)

[Sharc]

TDecimate(Cycle=12,CycleR=2) won't give 23.976, but 24.975fps

It should be
TDecimate(Cycle=5,CycleR=1)
or
TDecimate(Cycle=10,CycleR=2)
or
TDecimate(Cycle=15,CycleR=3)
or ....
TDecimate(Cycle=85,CycleR=17)
..... etc ....

The reduction factor for the framerate is
1-CycleR/Cycle

In your script 1-2/12 = 0.833333 -> 29.97*0.83333=24.975

[jagabo]

If you decimate to 23.976 fps you will be missing film frames. If you want 23.976 after TDecimate(Cycle=6, CycleR=1) slow the video (and audio) with AssumeFPS(24000, 1001, sync-audio=true), like you did earlier in this thread.

[Akuma786]

Thanks Sharc & Jagabo.

so this is what i got now and new runtime has increased by roughly 3mins.

a = LWlibavAudioSource("D:\Videos\Fearless Dragon Project Files\New folder\Fearless Dragon T80 2_0ch 192Kbps DELAY -49ms.ac3") # get audio (decompressed to PCM)
v = Mpeg2Source("D:\Videos\Fearless Dragon Project Files\New folder\Fearless Dragon.d2v", Info=3) # get video
AudioDub(v,a) # join audio and video together
Crop(8,80,-4,-84) # after this cropping you have a 704x364 frame
import("C:\Users\akuma\AviSynth+\plugins64+\RemoveDirtMC.avs")
TFM()
TDecimate(Cycle=6, CycleR=1) #returns 23.976fps progressive frames
ColorMatrix(mode="rec.601->rec.709")
ColorYUV(gain_y=30, off_y=-14)
ConvertToRGB().RGBAdjust(r=221.0/192.0, b=221.0/138.0, bb=-42).ConvertToYV12()
MergeChroma(RemoveDirtMC(15, false), RemoveDirtMC(30, false))
Stab(range=2, dxmax=2, dymax=2, mirror=15)
LSFMod(150)
Spline36Resize(640, 316)
AssumeFPS(24000, 1001, sync_audio=true) # audio sample rate reduced from 48000 to 46080 (lossless)
SSRC(48000) # convert audio to 48000 Hz samples
prefetch(24)

[Sharc]

If you decimate to 23.976 fps you will be missing film frames. If you want 23.976 after TDecimate(Cycle=6, CycleR=1) slow the video (and audio) with AssumeFPS(24000, 1001, sync-audio=true), like you did earlier in this thread.

Ah yes. It's not standard 24->30 telecine with the usual 3-2 pulldown, but 25->30 telecine with the (2 combed - 4progressive) followed by (3 combed - 3progressive) pattern.

[Akuma786]

so runtime changes to 86mins but i believe the official Technical specifications for this movie is 83 minutes.

[ProWo]

If you decimate to 23.976 fps you will be missing film frames. If you want 23.976 after TDecimate(Cycle=6, CycleR=1) slow the video (and audio) with AssumeFPS(24000, 1001, sync-audio=true), like you did earlier in this thread.

Ah yes. It's not standard 24->30 telecine with the usual 3-2 pulldown, but 25->30 telecine with the (2 combed - 4progressive) followed by (3 combed - 3progressive) pattern.

Just out of curiosity.
How do you find out this pattern?

[jagabo]

How do you find out this pattern?

One way is to just TFM(), then step through the video frame by frame. You'll see there is a duplicate every 6 frames. You an also Bob(). You'll see a 3:2:3:2:2 repeat pattern.

[ProWo]

How do you find out this pattern?

One way is to just TFM(), then step through the video frame by frame. You'll see there is a duplicate every 6 frames. You an also Bob(). You'll see a 3:2:3:2:2 repeat pattern.

Thank you

[Sharc]

If you decimate to 23.976 fps you will be missing film frames. If you want 23.976 after TDecimate(Cycle=6, CycleR=1) slow the video (and audio) with AssumeFPS(24000, 1001, sync-audio=true), like you did earlier in this thread.

Ah yes. It's not standard 24->30 telecine with the usual 3-2 pulldown, but 25->30 telecine with the (2 combed - 4progressive) followed by (3 combed - 3progressive) pattern.

Just out of curiosity.
How do you find out this pattern?

Stepping through the frames you will find an alternating sequence of 99 frames with the repetitive pattern (3combed - 3clean) followed by 100 frames with the repetitive pattern (4clean - 2combed).
Stepping through the fields you will see the 3-2-3-2-2 pattern (or a cyclic shift of it like 2-3-2-2-3 or 3-2-2-3-2 or 2-2-3-2-3 or 2-3-2-3-2 depending where you start).

[Akuma786]

Hi, another DVD, also 29.97fps. I would like to deinterlace correctly, change to 24fps and cleanup and colour correct if possible.

https://easyupload.io/hbacua

[ProWo]

If you decimate to 23.976 fps you will be missing film frames. If you want 23.976 after TDecimate(Cycle=6, CycleR=1) slow the video (and audio) with AssumeFPS(24000, 1001, sync-audio=true), like you did earlier in this thread.

Ah yes. It's not standard 24->30 telecine with the usual 3-2 pulldown, but 25->30 telecine with the (2 combed - 4progressive) followed by (3 combed - 3progressive) pattern.

Just out of curiosity.
How do you find out this pattern?

Stepping through the frames you will find an alternating sequence of 99 frames with the repetitive pattern (3combed - 3clean) followed by 100 frames with the repetitive pattern (4clean - 2combed).
Stepping through the fields you will see the 3-2-3-2-2 pattern (or a cyclic shift of it like 2-3-2-2-3 or 3-2-2-3-2 or 2-2-3-2-3 or 2-3-2-3-2 depending where you start).

Thx, Sharc

[Akuma786]

Hi, another DVD, also 29.97fps. I would like to deinterlace correctly, change to 24fps and cleanup and colour correct if possible.

https://easyupload.io/hbacua

I cant figure out the where the repeat frame is.

[Sharc]

Hi, another DVD, also 29.97fps. I would like to deinterlace correctly, change to 24fps and cleanup and colour correct if possible.

https://easyupload.io/hbacua

I cant figure out the where the repeat frame is.

Same as before

TFM().TDecimate(Cycle=6,CycleR=1)   #gives 24.975fps
AssumeFPS(24000, 1001, sync_audio=true)  #if you want 23.976

To see the repeated frames just use

TFM()

and step frame by frame through the video.

[Akuma786]

Understood. Thank you Sharc.

[Akuma786]

Hi, another DVD, also 29.97fps. I would like to deinterlace correctly, change to 24fps and cleanup and colour correct if possible.

https://easyupload.io/hbacua

Is there a filter which can remove the flashing noise in this video?

[johnmeyer]

They are chroma flashes, so there may be some trick that can be done in that domain.

I would start by trying MDegrain2 with DCT=1 (instead of the default 0), and/or Deflicker. They work well for luma flicker, but may not get this.

You can also look at what I did to remove rainbow flashes by going to this post:

https://forum.videohelp.com/threads/398864-Need-help-on-Avisynth#post2595644

[Akuma786]

Thanks Johnmeyer. There is so much chroma flashes through out this movie. Its very distracting.

I will give this a try tonight and hopefully it be more easy to the eyes. Much appreciated.