Advice needed for colour depth in VDub captures

[SegaSonic91]

I have been getting banding on my captures when trying to apply light filtering to them and I am sure it is a colour space problem. I am not sure if I have been doing certain steps correctly or not.

I had colour depth set to YUY2 as default in VDub and always used "ConvertToYUY2" at the end of the scripts that needed them and I got the banding. I have been leaving it set to UYVY as for default for the last couple of captures and not using "ConvertToYUY2" which lessened the banding but it is still there. The only filtering I have been doing other than dot crawl, rainbows, shimmering etc is chroma smoothing with cnr2 and deen in a separate script. I always see these LD rips online that look all nice and smooth colour wise but I do not have that in my captures and if I try to smooth out the colour a bit, I get the banding! It is very frustrating seeing as I am annoyingly anal when it comes to quality.


I am using the ATI Diamond 750HD USB stick to capture and it will only capture in UYVY mode. I know that LD is YUY2. This is where the confusion starts with regard to setting the colour depth in VDub. I am using Huffy for compression so should I always have the colour depth set to YUY2 even though the capture device is using UYVY? The other thing I am uncertain of is what to do when using avisynth. Most of the plugins I am using need YV12 so I use "ConverttoYV12" at the beginning of the script. Should I use "ConverToYUY2" at the very end or leave it? It is anime LDs by the way.

[jagabo]

UYVY and YUY2 are the same thing except for the order of the Y, U, and V samples.

http://www.fourcc.org/yuv.php#UYVY
http://www.fourcc.org/yuv.php#YUY2

Be sure to use ConvertToYV12(interlaced=true) unless you've deinterlaced beforehand. Try using GradFun2db or GradFun2dbMod to reduce banding. If you're willing to accept playback only on a computer, 10 bit x264 will give less banding.

[poisondeathray]

I have been getting banding on my captures when trying to apply light filtering to them

and if I try to smooth out the colour a bit, I get the banding!

If there is no banding before you apply filters, and banding afterwards, that suggests it's from either your filtering or compression applied afterwards, not a color space issue. If you preview the script, is there banding ?