Best Consumer Video Editing Software for $100

[budwzr]

Did anybody laugh at "shnizzled"?

[magillagorilla]

[Attachment 5936 - Click to enlarge]

no signal = no noise

For some reason the forum made Attachment 5936 a link. If you click on it you can see my reference. Maybe it was too big. Ireduced it............ here it is again.


See all the chroma noise in the green shirt on the left? The VDUB filter, I think it's called camcorder noise removal, gets rid of most of it. Is there and AVISynth filter for this type of noise? I don't think Vegas can do this.

[budwzr]

Which one is "repaired"?

[magillagorilla]

You really need to click on the Attachment 5936 link to see the big image. In the green shirt and on the man's arms you will see lots of blue and yellow "chroma noise" splotches on the left and their removal on the right.

[jagabo]

You really need to click on the Attachment 5936 link to see the big image.

I get this:

Invalid Attachment specified. If you followed a valid link, please notify the administrator

The image/link in post #62 works.

Is there and AVISynth filter for this type of noise?

Yes. CNR2() and others.

[magillagorilla]

You really need to click on the Attachment 5936 link to see the big image.

I get this:

Invalid Attachment specified. If you followed a valid link, please notify the administrator

The image/link in post #62 works.

Is there and AVISynth filter for this type of noise?

Yes. CNR2() and others.

Thanks Jagabo,
I don't know why my picture became a link, the forum did it. So you would recommend CNR2(), I'll try it. There is other noise I can't seem to get rid of in VDUB.


The hard chroma noise on that poll on the left, I think are dropouts and maybe can't be fixed. The pink haze at the top is still there and there are some hard black dots in the image I thought the median filter would lighten but didn't. I don't expect miracles from my footage because it's in really bad condition. When I see how well the chroma noise removal in VDUB works, I just wonder if I can push it a bit further and get even better results.


Keep in mind that this is one frame of hours of video chalk full of this kind of noise. I chose this frame to show because it runs about in the middle of my gambet of issues. I also prefer to keep noise upposed to smudging the footage and heavily blurring it, if that is the solution.

[jagabo]

If those pink and blue spots are transient (appear in those postions in only one frame) something like RemoveDirt() should help.

[magillagorilla]

That frame is also deinterlaced using yadiffmod. Should I deinterlace before denoise? That's my normal process anyway.

[poisondeathray]

It depends what your goals are, and what filters you're using

If your end goal was DVD I would keep it interlaced, unless some filter you're using doesn't have an interlaced mode, or there's no other workaround

It depends on the deinterlacer as well, some have denoising properties to combat shimmering - you may have to modify your denoisers if you use them

Some denoisers only have a progressive mode, so you could apply to even/odd fields and weave as a workaround

[budwzr]

I guess I'll have to be the only one to tell the OP the truth.

The whole video is hosed. It's over-saturated, pixelated, artifacted, fuzzy, and the "noise" is the least of the issues.

It's shnizzled!

[magillagorilla]

Budwzr,
All my footage is old family video. It is what it is. I have no choice but to work with it as it is. There is tons of video of this quality out there and people with experience restoring it. There are definately ways to improve the image. You have contributed nothing constructive.

[magillagorilla]

poisondeathray,
Thanks for the tip. I will likely not use DVD as the final format. Mostly direct viewing from PC or media player on an HD monitor. I may burn BR in the future but BR can do progressive. ulitmately, I think I will deinterlace all footage and denoise. I plan to keep all the original caps in huffyuv on a HDD on the shelf. Future technology may prove to be better than the tools we have now. I'm just trying to learn my options.

[budwzr]

FWIW, I did try to see if anything was doable, and I came up with not much as evidenced here, using Vegas.

http://www.youtube.com/watch?v=FcXe9bHYwkc

[jagabo]

Try Neat Video in VirtualDub. You need to find a area of flat color to train it on the noise.

[magillagorilla]

Jagabo,
What is a uniform area? Is that a frame with a flat field of one color? I would like to try Neat Video. I am having trouble picking up the AVISynth scripting language. I only understand SQL
*EDIT* I think your are on to something. Neat video may be the thing I was looking for. I can smooth out the chroma noise and luma noise independently. The smoothing is not too edge destructive.............. more advise on this filter please.


Thanks Budwzr for trying. I have no doubt that my video is too fragged to be repaired by an NLE. That's why I am asking about AVISynth and VDUB filters.

[poisondeathray]

Yes you want a uniform area of same luminance and color with no details . There's examples in the manual with pictures of "good" and "bad" places to sample

[budwzr]

Neat Video can be plugged in to Vegas, but your issue is related to missing pixels in one or more of the RGB channels, not noise.

This kind of thing is not my forte, but I'm intrigued by the "undoable", and it's kind of bugging me so maybe my brain will let me know something later.

I'm thinking along the line of building an HSL mask that targets the offending hues and then compositing the missing channel.

[magillagorilla]

Budwze, I had the same kind of idea. The dropouts are very specific bright pink/purple and should be easy for a selection parameter to identify. Unfortunately, I have no idea on how to approach such a thing. I ran another test last night:

AviSynth (Yadifmod)>VirtualDub(Camcorder noise removal>Neat Video)>Vegas(Black Mat>White Balance)>.MP4

It looks better than any previous attempt. The dropouts are smoothed out a bit. Lots of the bad chroma grain is gone. Still looking for other options. I literally have 20-25 hours of footage to process and I am exploring many options before dumping a huge ammount of time in to it.

[poisondeathray]

What is the distribution of the pink/purple "dropouts" ? Are they random and appear only on single frames ? If so then jagabo suggested removedirt - that should take care of it . There are related functions like removedirtmc, which are more selective

To narrow in on a specific color you can use secondary color correction in vegas. There are dozens of tutorials on youtube and related sites. This is the same idea like in photoshop, where you change the color of somebody's shirt. I'm sure you get the idea.... The problem is you have to replace it with "something" - like some other color. This will be a bit of manual work because presumably those artifacts aren't always over an orange pillar - and even on that single frame you have 2 different hues of "orange". So this will be quite a bit of tedious work . It doesn't "automatically fix" it or fill it with surrounding pixels or related information. RemoveDirt and related functions do fill the gap

[jagabo]

I've never seen a video with ping and blue spots like that. Can you post a sample of the source?

[magillagorilla]

I made most of these videos when I was a kid in the mid-80s. I always used SP. All of it was shot with a Quazar minicam hooked up to a portable GE VHS deck. My dad put the videos up for a while. I guess over time he consolidated the videos on to a few tapes. Tapes were expensive back then so I guess he wanted to free them up so he could record Dallas or Miami Vice or whatever. Anyhow, he dubbed them from deck to deck using crappy coax cables on to used tapes in SLP mode. To add to it, I'm positive one or both of the decks had bad heads.

Bad heads = dropouts and possibly those pink/purple streaks
Bad coax = ghosting
SLP on used tape = horrible resolution and chroma/luma noise

I really appreciate the help. These tapes mean a lot to me. Most people look at them and tell me to give up. I don't really think it's a hopeless cause. Every time I learn something new I am able to improve the quality a bit.

I'll post more samples tonight. Also I tried the RemoveDirt filter but I didn't understand the syntax I needed to use. Does anyone have a sample script? I am much better at reverse engineering code.

*edit* Also the pink/purple things are totally random. They appear in single frames in different spots. They don't streak across the frame like a comet (bad heads).

[poisondeathray]

To start with , use a low threshold value. The higher the number, the stronger the effect for detection (i.e. more "spots" are categorized as dirt) . Apply the filter before everything else (except deinterlace) . If you use too high a number, "good" parts start to get removed (e.g. maybe shoelaces get removed, or pupils etc...) . I find the MC variant less destructive (more selective) . You can read the documentation and play with the other parameters once you get started

RemoveDirt(10,false)

or

RemoveDirtMC(10,false)


It works on detecting differences between frames, so they have to be random spots. So if you had duplicate frames for example, it would not detect it as "dirt". So dupes have to be removed with other functions beforehand. By the same reasoning, persistent defects are not detected as "dirt", because they occur in adjacent frames. Also, scene changes aren't affected, for this same reasoning - there is too much variance between frames. The 1st and last frame of a scene will remain "dirty". There are workarounds, but that should get you started

[magillagorilla]

Hm, keeps telling me Script error: there is no function named "RemoveDirt"

I have RemoveDirt.dll in my plugins directory for AviSynth, what the hell?

Simple script

avisource("E:\video.avi")
ConvertToYUY2(interlaced=true)
yadifmod(order=1, mode=0, edeint=NNEDI2(field=1))
RemoveDirt(10,false)

[poisondeathray]

It depends what version of "removedirt" you're using

Most of them come as a script function now (so you can copy & paste at the bottom of your script, or place it as an .AVSI file in the plugins folder to autoload the function)


Here is the original function as per the original documentation. Note the syntax is slightly different for the original function for calling it (the examples above used the modified function) . Use only 1 or the other.

 
 
function RemoveDirt(clip input, bool "_grey", int "repmode") { _grey=default(_grey, false)    repmode=default(repmode, 16)    clmode=17    clensed=Clense(input, grey=_grey, cache=4)    sbegin = ForwardClense(input, grey=_grey, cache=-1)    send = BackwardClense(input, grey=_grey, cache=-1)    alt=Repair(SCSelect(input, sbegin, send, clensed, debug=true), input, mode=repmode, modeU = _grey ? -1 : repmode )     restore=Repair(clensed, input, mode=repmode, modeU = _grey ? -1 : repmode)    corrected=RestoreMotionBlocks(clensed, restore, neighbour=input, alternative=alt, gmthreshold=70, dist=1, dmode=2, debug=false, noise=10, noisy=12, grey=_grey)    return RemoveGrain(corrected, mode=clmode, modeU = _grey ? -1 : clmode )}

Here are some modified functions with MC variant (MC variant requires MVTools)

function RemoveDirt(clip input, int limit, bool _grey)
{
clensed=input.Clense(grey=_grey, cache=4)
alt=input.RemoveGrain(2)
return RestoreMotionBlocks(clensed,input,alternative=alt,pthreshold=6,cthreshold=8, gmthreshold=40,dist=3, dmode=2,debug=false,noise=limit,noisy=4, grey=_grey) 
 
# Alternative settings
# return RestoreMotionBlocks(clensed,input,alternative=alt,pthreshold=4,cthreshold=6, gmthreshold=40,dist=1,dmode=2,debug=false,noise=limit,noisy=12,grey=_grey,show=true)
# return RestoreMotionBlocks(clensed,input,alternative=alt,pthreshold=6,cthreshold=8, gmthreshold=40,dist=3,tolerance= 12,dmode=2,debug=false,noise=limit,noisy=12,grey=_grey,show=false)
}
 
 
function RemoveDirtMC(clip,int limit, bool "_grey")
{
_grey=default(_grey, false)
limit = default(limit,6)
i=MSuper(clip,pel=2)
bvec = MAnalyse(i,isb=false, blksize=8, delta=1, truemotion=true)
fvec = MAnalyse(i,isb=true, blksize=8, delta=1, truemotion=true)
backw = MFlow(clip,i,bvec)
forw = MFlow(clip,i,fvec)
clp=interleave(backw,clip,forw)
clp=clp.RemoveDirt(limit,_grey)
clp=clp.SelectEvery(3,1)
return clp
}

By the way, you're single rate deinterlacing with yadifmod - throwing out 1/2 the information

[magillagorilla]

would this be better for deinterlace

interp=nnedi2(field=1)
yadifmod(order=1, field=-1, mode=0, edeint=interp)

I think I got it off one of your posts.


Anyhow, that RemoveDirt won't work. AviSynth keeps telling me that the function does not exist. Maybe my DLL is bad. I'll try a fresh copy.

[poisondeathray]

1) get NNEDI3, it's faster

2) if you want to double rate (so gives you 480p59.94 instead of 480p29.97)

then use (I'm assuming it's TFF)

YadifMod(order=1 , mode=1 , edeint=NNEDI3(field=3))

3) did you copy the RemoveDirt function to the bottom of the script ? (Just copy & paste the contents of the last code box to the bottom of the script)


Can you post a video sample ? I don't think those colored streaks are really magnetic "drop outs"

[magillagorilla]

what format do you want a video sample in?

"2) if you want to double rate (so gives you 480p59.94 instead of 480p29.97)"

Does it double the lines in each field in a seperate frame then double the framerete?

[poisondeathray]

original, always

how did you capture this ?

[magillagorilla]

Panny 1980p>Happague 1250>VDUB (HUFFYUV)

To add, the VCR is in great condition. I do have tapes that are not fragged and the deck plays them beautifully and the card.... well it gets'er done. The problems with the images are not caused by the hardware or signal path for the cap, they are just crappy tapes.


UGGG! This is not my week for video. When I try to save a segment in HUFFYUV 2.2.0 the rendered segment is 2/3 chroma snow at the top and 1/3 image at the bottom. The resulting file crashes VDUB, VLC, and VMS.

[magillagorilla]

here you go. Thanks for any help.