How to remove noise in this video

[TeNSoR]

Hi!

I'd like to ask about how to remove or at least decrease this noise in the demuxed sample, Thanks!

[pandy]

I think you talking about film/cinema tape damages (cracks, drops, stains, scratches etc) - you may try to use http://compression.ru/video/image_restoration/index_en.html but i strongly advise to read first this: http://forum.doom9.org/showthread.php?t=144271

[TeNSoR]

I think you talking about film/cinema tape damages (cracks, drops, stains, scratches etc) - you may try to use http://compression.ru/video/image_restoration/index_en.html but i strongly advise to read first this: http://forum.doom9.org/showthread.php?t=144271

Thanks, Pandy😊 ' I wil

[johnmeyer]

There is another thread, also started by VideoFred, in that same forum. You will want to read that as well.

Be warned, however, that the clip you posted cannot be processed by this software until you remove the repeats and blends. It has been badly telecined, and VideoFred's software requires "frame accurate" film transfers which means no telecining, no repeats, no dropped frames, and no blends. Your clip has at least two of those things. The usual tfm/tdecimate may get you pretty close, but I don't think it will make it perfect.

You will also have to do quite a bit of work on the gamma and crushed blacks.

[TeNSoR]

There is another thread, also started by VideoFred, in that same forum. You will want to read that as well.

Be warned, however, that the clip you posted cannot be processed by this software until you remove the repeats and blends. It has been badly telecined, and VideoFred's software requires "frame accurate" film transfers which means no telecining, no repeats, no dropped frames, and no blends. Your clip has at least two of those things. The usual tfm/tdecimate may get you pretty close, but I don't think it will make it perfect.

You will also have to do quite a bit of work on the gamma and crushed blacks.

Thanks, Sir! for your reply but I checked it by DGIndex and showed "Film", I know some about Avisynth but I'm not familiar with gamma and crushed blacks, just I want to remove this dirt from the dvd, Thanks anyway!

[johnmeyer]

Thanks, Sir! for your reply but I checked it by DGIndex and showed "Film"

Showing "film" in DGindex really doesn't tell you anything at all about what is actually in the video itself. You have to bob() or separatefields() and then look at the cadence yourself. The "film" setting reported by DGIndex seldom tells the correct story.

The reason you cannot remove dirt until you understand what I wrote and follow my directions is that the dirt removal works by comparing adjacent frames. If there is a spot on one frame, but no spot on either of the adjacent frames, it removes the spot. However, if your video contains duplicated frames (as yours most definitely does) then the software will see the same spot on one of the adjacent frames (the duplicate) and will therefore not remove it.

Noise reduction, and many of the other aspects of VideoFred's script (and my own adaptation, which is posted in those two long threads) will also not work. This includes motion stabilization which, while not needed as much for commercial movies, can still be used to remove gate weave, something that is actually one of the more distracting elements of old film.

[manono]

Thanks, Sir! for your reply but I checked it by DGIndex and showed "Film",

Are we speaking of the same sample? Your demuxed.m2v is all progressive and reads as NTSC, not Film. Every sixth frame is a duplicate and many of the frames are blended. It's a mess, even by the low Indian standards. Or have you already 'deinterlaced' it? Rather than worrying about the noise, your first job should be to remove the dupe frames and the blends, and secondly to try and correct the greenish tint over everything. And it's kind of 'dark'.

[TeNSoR]

Thanks, Sir! for your reply but I checked it by DGIndex and showed "Film",

Are we speaking of the same sample? Your demuxed.m2v is all progressive and reads as NTSC, not Film. Every sixth frame is a duplicate and many of the frames are blended. It's a mess, even by the low Indian standards. Or have you already 'deinterlaced' it? Rather than worrying about the noise, your first job should be to remove the dupe frames and the blends, and secondly to try and correct the greenish tint over everything. And it's kind of 'dark'.

Yes, this is the same sample I meant, manono, this is the script I used it with the demuxed m2v

AssumeBFF()
tfm().TDecimate()
srestore(frate=25)
AssumeFPS(23.976)
ColorMatrix("Rec.601->Rec.709")
Trim(0,708).FadeOut(150)

[manono]

Yes, this is the same sample I meant, manono, this is the script I used it with the demuxed m2v

AssumeBFF()
tfm().TDecimate()
srestore(frate=25)
AssumeFPS(23.976)
ColorMatrix("Rec.601->Rec.709")
Trim(0,708).FadeOut(150)

That's what you did to create the sample? If so, you didn't upload the M2V straight from the DVD without messing it up any more? In any event, that script makes no sense at all, for a couple of reasons. So, is the sample untouched from the DVD, or not?

In the off chance it's untouched from the DVD, here's some quick stuff for the sample. Not all the specks are gone, and the colors should probably be adjusted differently for different scenes, but this is a start:

MPEG2Source("Test.d2v")
TDecimate(Mode=0,Cycle=6,CycleR=1)

YLevelsS(0,2.5,255,0,255).Tweak(Bright=0,Cont=0.95 ,Coring=False)

ConvertToRGB24(Matrix="PC.601")
#ChannelMixer(RR, RG, RB, GR, GG, GB, BR, BG, BB)
ChannelMixer(98,0,0,0, 90, 0,0,0,110)
ConvertToYV12(Matrix="PC.601")

RemoveDirtMC(last, 55, false)

FFB3(214)
FFA1(215)

Once the duplicate frames were removed, I left the remaining blends alone. Maybe others have some better ideas.

[TeNSoR]

Yes, this is the same sample I meant, manono, this is the script I used it with the demuxed m2v

AssumeBFF()
tfm().TDecimate()
srestore(frate=25)
AssumeFPS(23.976)
ColorMatrix("Rec.601->Rec.709")
Trim(0,708).FadeOut(150)

That's what you did to create the sample? If so, you didn't upload the M2V straight from the DVD without messing it up any more? In any event, that script makes no sense at all, for a couple of reasons. So, is the sample untouched from the DVD, or not?

In the off chance it's untouched from the DVD, here's some quick stuff for the sample. Not all the specks are gone, and the colors should probably be adjusted differently for different scenes, but this is a start:

MPEG2Source("Test.d2v")
TDecimate(Mode=0,Cycle=6,CycleR=1)

YLevelsS(0,2.5,255,0,255).Tweak(Bright=0,Cont=0.95 ,Coring=False)

ConvertToRGB24(Matrix="PC.601")
#ChannelMixer(RR, RG, RB, GR, GG, GB, BR, BG, BB)
ChannelMixer(98,0,0,0, 90, 0,0,0,110)
ConvertToYV12(Matrix="PC.601")

RemoveDirtMC(last, 55, false)

FFB3(214)
FFA1(215)

Once the duplicate frames were removed, I left the remaining blends alone. Maybe others have some better ideas.

Sorry , I applied this on other sample, It's fantastic to know how to do it, Thanks, manono! but I get this error in AvsPmod in RemoveDirtMC and ChannelMixer:

[jagabo]

Remove that line. It was only a comment in manono's script -- a reminder of the order of the parameters.

[TeNSoR]

Remove that line. It was only a comment in manono's script -- a reminder of the order of the parameters.

Of course, I removed it in the next script and working now just "RemoveDirtMC" giving me error?

[jagabo]

It's telling you exactly what the problem is. You need to get RemoveDirtMC and import it in your script.

[TeNSoR]

It's telling you exactly what the problem is. You need to get RemoveDirtMC and import it in your script.

I did, but still I can see error message, I will try to google it, Thanks, Jagabo!

[jagabo]

Where did you get RemoveDirtMC?

[manono]

I used ChannelMixer, but there are other color-adjusting filters. I'll enclose the two functions I used, if you like. Open the AVS's to find out the usage and what other filters are needed. I also enclosed what's needed to make RemoveDirtMC work.

[TeNSoR]

I used ChannelMixer, but there are other color-adjusting filters. I'll enclose the two functions I used, if you like. Open the AVS's to find out the usage and what other filters are needed. I also enclosed what's needed to make RemoveDirtMC work.

Thank you so much, dear manono!

[TeNSoR]

Where did you get RemoveDirtMC?

Doom9

[LMotlow]

I don't see the point behind RemoveDirtMC. I used RemoveSpotsMC2x.
Correct for green by subtracting green or by adding its opposite color. Green's opposite color is magenta, not blue.
It's a shame about the blended fields.

[manono]

I freely admit knowing nothing about color. All I work on is black and white and it's been years since I've done any color correction at all. However, if you're trying to help Tensor and not just being a dick, you might have included the script you used so he could learn from it.

[TeNSoR]

I don't see the point behind RemoveDirtMC. I used RemoveSpotsMC2x.
Correct for green by subtracting green or by adding its opposite color. Green's opposite color is magenta, not blue.
It's a shame about the blended fields.

Thank you! would you show me how you could remove the spots from the sample?

[TeNSoR]

I freely admit knowing nothing about color. All I work on is black and white and it's been years since I've done any color correction at all. However, if you're trying to help Tensor and not just being a dick, you might have included the script you used so he could learn from it.

No worries! I appreciate your help and all friends here manono, all the best!

[TeNSoR]

Sorry again, manono, I still getting error message because of "RemoveGrainTSSE2". I copied the script you've uploaded into AvsPmod
but I getting this error, any idea?

[jagabo]

Do you even need RemoveGrainTSSE2.dll? I don't have it and RemoveDirtMC runs fine.

One problem with RemoveDirt and RemoveGrain is that there are so many different versions. Getting the right combination can be difficult.

[TeNSoR]

Do you even need RemoveGrainTSSE2.dll? I don't have it and RemoveDirtMC runs fine.

One problem with RemoveDirt and RemoveGrain is that there are so many different versions. Getting the right combination can be difficult.

Thanks, Jagabo for reply. actually, I don't need just all I want to decrease this spots, will you upload the filters you use?

[TeNSoR]

Do you even need RemoveGrainTSSE2.dll? I don't have it and RemoveDirtMC runs fine.

One problem with RemoveDirt and RemoveGrain is that there are so many different versions. Getting the right combination can be difficult.

I removed RemoveGrainTSSE2 from Avisynth plugins and still the error :

[LMotlow]

I freely admit knowing nothing about color. All I work on is black and white and it's been years since I've done any color correction at all. However, if you're trying to help Tensor and not just being a dick, you might have included the script you used so he could learn from it.

I don't see the point behind RemoveDirtMC. I used RemoveSpotsMC2x.
Correct for green by subtracting green or by adding its opposite color. Green's opposite color is magenta, not blue.
It's a shame about the blended fields.

Thank you! would you show me how you could remove the spots from the sample?

My apologies to all. Had a little problem last night. A drunk driver hit a power pole on my block so I had to shut down early when my emergency battery started running down. Halloween week here, you know, I guess some dude wasn't sobered yet and put three folks in the hospital.

I had to remove the RemoveGrainSSE2 dll's. They made a mess of RemoveSpots. Instead I used the rgTools.dll already installed. I see TeNsoR has problems with FFB3/FFA1, so in my script below i used Avisynth's built-in FreezeFrame (they both worked for me with rgTools, and manono's looks better, but the old FreezeFrame still managed).

To correct green I had to stretch red and blue (magenta) as far as I could in Avisynth, but the blue in the original is distorted and crippled. So I used ColorYUV to do in Avisynth what I could with levels and color, then finished up with Virtualdub's gradation curves and ColorMill. You could correct red OK in YUV, but the blue spectrum is too lopsided and distorted for YUV, I think. RemoveSpotsMC2X is a function in the RemoveSpotsMC.avsi I posed earlier (thanx to jagabo). Below I'm attaching the two VirtualDub filters and a VirtualDub .vcf file that is used to load the filters and their settings. I gave up on YUV alone for fixing discreet color channels that get screwed up this way. You need a more liner blue and red that I couldn't get in YUV.

I stole the RemoveSpotsMC2x routine from another member a long time ago. Working even and odd fields apart made the spots look more random to the filter. Didn't get every spot, but it zonked most of them.

MPEG2Source("pat........\Demuxed.d2v")
TDecimate(Mode=0,Cycle=6,CycleR=1)
ColorYUV(Gain_y=45,off_y=-7,off_v=4,gain_u=80,off_u=-45)
Levels(6,1.1,255,20,245,dither=true,coring=false)

a=last
e=a.SelectEven().RemoveSpotsMC2x()
o=a.SelectOdd().RemoveSpotsMC2x()
Interleave(e,o)

FreezeFrame(213,214,212)
FreezeFrame(215,215,216)
#FFB3(214)
#FFA1(215)

LSFMod()
AddGrainC(1.5,1.5)
return last

[TeNSoR]

I freely admit knowing nothing about color. All I work on is black and white and it's been years since I've done any color correction at all. However, if you're trying to help Tensor and not just being a dick, you might have included the script you used so he could learn from it.

I don't see the point behind RemoveDirtMC. I used RemoveSpotsMC2x.
Correct for green by subtracting green or by adding its opposite color. Green's opposite color is magenta, not blue.
It's a shame about the blended fields.

Thank you! would you show me how you could remove the spots from the sample?

My apologies to all. Had a little problem last night. A drunk driver hit a power pole on my block so I had to shut down early when my emergency battery started running down. Halloween week here, you know, I guess some dude wasn't sobered yet and put three folks in the hospital.

I had to remove the RemoveGrainSSE2 dll's. They made a mess of RemoveSpots. Instead I used the rgTools.dll already installed. I see TeNsoR has problems with FFB3/FFA1, so in my script below i used Avisynth's built-in FreezeFrame (they both worked for me with rgTools, and manono's looks better, but the old FreezeFrame still managed).

To correct green I had to stretch red and blue (magenta) as far as I could in Avisynth, but the blue in the original is distorted and crippled. So I used ColorYUV to do in Avisynth what I could with levels and color, then finished up with Virtualdub's gradation curves and ColorMill. You could correct red OK in YUV, but the blue spectrum is too lopsided and distorted for YUV, I think. RemoveSpotsMC2X is a function in the RemoveSpotsMC.avsi I posed earlier (thanx to jagabo). Below I'm attaching the two VirtualDub filters and a VirtualDub .vcf file that is used to load the filters and their settings. I gave up on YUV alone for fixing discreet color channels that get screwed up this way. You need a more liner blue and red that I couldn't get in YUV.

I stole the RemoveSpotsMC2x routine from another member a long time ago. Working even and odd fields apart made the spots look more random to the filter. Didn't get every spot, but it zonked most of them.

MPEG2Source("pat........\Demuxed.d2v")
TDecimate(Mode=0,Cycle=6,CycleR=1)
ColorYUV(Gain_y=45,off_y=-7,off_v=4,gain_u=80,off_u=-45)
Levels(6,1.1,255,20,245,dither=true,coring=false)

a=last
e=a.SelectEven().RemoveSpotsMC2x()
o=a.SelectOdd().RemoveSpotsMC2x()
Interleave(e,o)

FreezeFrame(213,214,212)
FreezeFrame(215,215,216)
#FFB3(214)
#FFA1(215)

LSFMod()
AddGrainC(1.5,1.5)
return last

Thank you for your help LMotlow, just one thing if I want to encode the DVD into x264, is there's a way through Virtualdub?

[LMotlow]

Thank you for your help LMotlow, just one thing if I want to encode the DVD into x264, is there's a way through Virtualdub?

Sure, but I thank manono for teaching me a couple of new routines in this thread. I don't use VirtualDub for encoding, but I know it's done. I think an answer will show up here soon from those who've tried it.

If you still have a removegrain problem, try installing the newer rgTools. http://avisynth.nl/index.php/RgTools

[TeNSoR]

Thank you for your help LMotlow, just one thing if I want to encode the DVD into x264, is there's a way through Virtualdub?

Sure, but I thank manono for teaching me a couple of new routines in this thread. I don't use VirtualDub for encoding, but I know it's done. I think an answer will show up here soon from those who've tried it.

If you still have a removegrain problem, try installing the newer rgTools. http://avisynth.nl/index.php/RgTools

I don't use Virtualdub too just x264 CLI and no problem with RemoveGrain now, Thanks anyway for you and manono