Issues with Xvid Core crashing VirtualDub.

[tjack360]

Every time I try to encode a video to XviD using VirtualDub, my encode crashes VDub. I have no idea what is going on. Here is my Crash Log, if anyone can help me. I am also having a XviD error using MeGUI as well.

VirtualDub crash report -- build 35491 (release)
--------------------------------------

Disassembly:
0f5353e0: de8d1c530f7f fimul word ptr [ebp+7f0f531c]
0f5353e6: 41 inc ecx
0f5353e7: 200f and [edi], cl
0f5353e9: 7f49 jg 0f535434
0f5353eb: 280f sub [edi], cl
0f5353ed: 7f51 jg 0f535440
0f5353ef: 300f xor [edi], cl
0f5353f1: 7f59 jg 0f53544c
0f5353f3: 380f cmp [edi], cl
0f5353f5: 6f outsd
0f5353f6: 000f add [edi], cl
0f5353f8: 6f outsd
0f5353f9: 1410 adc al, 10h
0f5353fb: 0f6fc8 movq mm1, mm0
0f5353fe: 0f6fda movq mm3, mm2
0f535401: 0f60c7 punpcklbw mm0, mm7
0f535404: 0f60d7 punpcklbw mm2, mm7
0f535407: 0f6f23 movq mm4, [ebx]
0f53540a: 0fe026 pavgb mm4, [esi]
0f53540d: 0f68cf punpckhbw mm1, mm7
0f535410: 0f68df punpckhbw mm3, mm7
0f535413: 0f6f2c13 movq mm5, [ebx+edx]
0f535417: 0fe02c16 pavgb mm5, [esi+edx]
0f53541b: 0f6ff4 movq mm6, mm4
0f53541e: 0f60e7 punpcklbw mm4, mm7
0f535421: 0f68f7 punpckhbw mm6, mm7
0f535424: 0fe9c4 psubsw mm0, mm4
0f535427: 0fe9ce psubsw mm1, mm6
0f53542a: 8d3456 lea esi, [esi+edx*2]
0f53542d: 0f6ff5 movq mm6, mm5
0f535430: 0f60ef punpcklbw mm5, mm7
0f535433: 0f68f7 punpckhbw mm6, mm7
0f535436: 0fe9d5 psubsw mm2, mm5
0f535439: 8d0450 lea eax, [eax+edx*2]
0f53543c: 0fe9de psubsw mm3, mm6
0f53543f: 8d1c53 lea ebx, [ebx+edx*2]
0f535442: 0f7f4140 movq [ecx+40h], mm0
0f535446: 0f7f4948 movq [ecx+48h], mm1
0f53544a: 0f7f5150 movq [ecx+50h], mm2
0f53544e: 0f7f5958 movq [ecx+58h], mm3
0f535452: 0f6f00 movq mm0, [eax]
0f535455: 0f6f1410 movq mm2, [eax+edx]
0f535459: 0f6fc8 movq mm1, mm0
0f53545c: 0f6fda movq mm3, mm2
0f53545f: 0f60c7 punpcklbw mm0, mm7
0f535462: 0f60d7 punpcklbw mm2, mm7
0f535465: 0f6f23 movq mm4, [ebx]
0f535468: 0fe026 pavgb mm4, [esi] <-- FAULT
0f53546b: 0f68cf punpckhbw mm1, mm7
0f53546e: 0f68df punpckhbw mm3, mm7
0f535471: 0f6f2c13 movq mm5, [ebx+edx]
0f535475: 0fe02c16 pavgb mm5, [esi+edx]
0f535479: 0f6ff4 movq mm6, mm4
0f53547c: 0f60e7 punpcklbw mm4, mm7
0f53547f: 0f68f7 punpckhbw mm6, mm7
0f535482: 0fe9c4 psubsw mm0, mm4
0f535485: 0fe9ce psubsw mm1, mm6
0f535488: 8d3456 lea esi, [esi+edx*2]
0f53548b: 0f6ff5 movq mm6, mm5
0f53548e: 0f60ef punpcklbw mm5, mm7
0f535491: 0f68f7 punpckhbw mm6, mm7
0f535494: 0fe9d5 psubsw mm2, mm5
0f535497: 8d0450 lea eax, [eax+edx*2]
0f53549a: 0fe9de psubsw mm3, mm6
0f53549d: 8d1c53 lea ebx, [ebx+edx*2]
0f5354a0: 0f7f4160 movq [ecx+60h], mm0
0f5354a4: 0f7f4968 movq [ecx+68h], mm1
0f5354a8: 0f7f5170 movq [ecx+70h], mm2
0f5354ac: 0f7f5978 movq [ecx+78h], mm3
0f5354b0: 5e pop esi
0f5354b1: 5b pop ebx
0f5354b2: c3 ret
0f5354b3: 90 nop
0f5354b4: 90 nop
0f5354b5: 90 nop
0f5354b6: 90 nop
0f5354b7: 90 nop
0f5354b8: 90 nop
0f5354b9: 90 nop
0f5354ba: 90 nop
0f5354bb: 90 nop
0f5354bc: 90 nop
0f5354bd: 90 nop
0f5354be: 90 nop
0f5354bf: 90 nop
0f5354c0: 8b4c2404 mov ecx, [esp+04h]
0f5354c4: 8b442408 mov eax, [esp+08h]
0f5354c8: 8b54240c mov edx, [esp+0ch]
0f5354cc: 0fefff pxor mm7, mm7
0f5354cf: 0f6f01 movq mm0, [ecx]
0f5354d2: 0f6f1411 movq mm2, [ecx+edx]
0f5354d6: 0f6fc8 movq mm1, mm0
0f5354d9: 0f6fda movq mm3, mm2
0f5354dc: 0f60c7 punpcklbw mm0, mm7
0f5354df: 0f db 0fh

Built on Althena on Sun Oct 27 15:59:07 2013 using compiler version 1400

Windows 6.1 (Windows 7 x64 build 7601) [Service Pack 1]
Memory status: virtual free 1512M/2048M, commit limit 8086M, physical total 4044M

EAX = 13d729b0
EBX = 186cfd82
ECX = 0328fdc0
EDX = 00000580
EBP = 0328f558
ESI = 15ba23d0
EDI = 0328f8c8
ESP = 0328f4f4
EIP = 0f535468
EFLAGS = 00010202
FPUCW = 027f
FPUTW = aaaa

Crash reason: Access Violation

Crash context:
An out-of-bounds memory access (access violation) occurred in module 'xvidcore'...

...reading address 15BA23D0.

Pointer dumps:

EAX 13d729b0: 18171717 18171818 18191818 18181819 18181819 18191818 19191918 1a19191a
EBX 186cfd82: 14131313 14141314 14141413 14141414 15151414 15151515 14141515 15151415
ECX 0328fdc0: fffcfffb fffbfffc fffbfffc fffbfffc fffbfffb fffcfffc fffcfffc fffbfffc
EDI 0328f8c8: 000001ff ffffff00 00000080 fffffe00 000003b9 00000000 00000000 00000000
ESP 0328f4f0: ffffffa4 ffffffa4 00000000 0f56a4d8 0328fdc0 13d708b0 186cdc82 15ba02d0
0328f510: 00000580 0328f8c8 0328f720 0328f8c8 0000001d 0328f914 15ba02d0 0328fe40
0328f530: 00000070 0328fa38 00000000 0328fdc0 fffffff0 00000040 000000b8 ffffffe0
0328f550: 186cdc82 00000350 0328f570 0f56a7e0 ffffff48 ffffffe0 0328f8c8 00000001
EBP 0328f558: 0328f570 0f56a7e0 ffffff48 ffffffe0 0328f8c8 00000001 0328f5fc 0f56ac48
0328f578: 00000003 0000001f 0f747d78 00000003 0328ff88 fffffe58 fffffb08 000001a8
0328f598: fffffcb0 00000003 00000004 0328f6c4 0328f6a4 0328fa54 0328f8c8 00000002
0328f5b8: 00000001 0328f8b0 00000001 0f747d78 0328fa70 0c540a00 00000003 00000198

Thread call stack:
0f535468: xvidcore!00025468
0f56a4d8: xvidcore!0005a4d8
0f56a7e0: xvidcore!0005a7e0
0f56ac48: xvidcore!0005ac48
0f560a9d: xvidcore!00050a9d
76941b66: KERNELBASE!GetModuleFileNameW [76930000+119bd+1a9]
76941bf1: KERNELBASE!GetModuleFileNameW [76930000+119bd+234]
74d6336a: kernel32!BaseThreadInitThunk [74d50000+13358+12]
74d6336a: kernel32!BaseThreadInitThunk [74d50000+13358+12]
77479902: ntdll!RtlInitializeExceptionChain [77440000+3989f+63]
774798d5: ntdll!RtlInitializeExceptionChain [77440000+3989f+36]

-- End of report

[tjack360]

I can't get XviD to work in MeGUI at all either. I even uninstalled XviD from my pc & used the one that comes with MeGUI. Still errored out around the 8 minute mark...EVERY TIME! I can encode with x264 or x265 with no problem but XviD is not working. PLEASE!!! Any help would be really appreciated. I am surprised no one has any input at this point.

[remanyao]

Try this versions

http://web.archive.org/web/20121002010032/http://jawormat.republika.pl/xvid.html

[tjack360]

Try this versions

http://web.archive.org/web/20121002010032/http://jawormat.republika.pl/xvid.html

XviD 1.3.2, Jawor's patched build seems to be working great in VDub. I still haven't figured out MeGui, however. But as long as I can encode XviD in VDub, I am happy with that. MeGui works great for x264 encoding. Thank you for your help. I had no idea about Jawor's custom XviD builds. I will definitely bookmark that page just in case I need it in the future. Cheers!

[tjack360]

I have confirmed that XviD 1.3.2, is working just fine. I was able to complete a whole BluRay Rip encode at 720p in VDub. Thanks again!

[remanyao]

OK.
Try the alpha (unstable) version without fear.
It works really really good.
Regards.