Help removing aliasing and weird looking lines in avisynth_mt?

[jagabo]

DVD has only two display aspect ratios: 4:3 and 16:9. For NTSC DVDs that corresponds to 8:9 and 32:27 SAR. No matter what you crop or add the SAR stays the same. Only when you resize does the SAR change.

There is a difference between the MPEG and ITU specs regarding aspect ratios. The DVD spec says the entire 720x480 frame contains the specified DAR. But the ITU spec for capturing analog video uses a 704x480 frame to hold the DAR with 8 pixels of padding added to the left and right. So the ITU spec has SARs of 10:11 and 40:33. The slight difference is usually ignored when mastering DVDs. If you're a real stickler for the correct SAR you'll have to decide for yourself which SAR is appropriate for each source.

<edit>

I just took a look at your VOB and realized it's PAL. PAL video has the same disparity. The UTU spec calls for a ~702x576 frame to contain the 4:3 or 16:9 picture. Padding is added to bring the size up to 720x576. The SARs for PAL:

4:3 DVD: 16:15
16:9 DVD: 64:55

4:3 ITU: 12:11 (assuming 704x576)
16:9 ITU: 16:11 (assuming 704x576)

[beav]

So I should resize to 702x576 and then make the Sar 16:15? No cropping or adding borders? The source is not ITU by the way.

[jagabo]

If you think the video is uses MPEG (DVD) sizing you can set the SAR to 16:15 whether you crop or not. Think of it like a piece of graph paper. Cutting off the edges doesn't change the shape of the grid (pixels) on the paper that's left.

Looking at the circles near the end of the sample, it looks to me like it follows the MPEG spec.