Cannot seem to get good quality conversions with Handbrake

[jsbenson]

I have tried many different apps and settled on Handbrake.

With Handbrake I have tried many different settings and my video quality still isn't nearly as good as the 700MB AVI movies I can download.

Here are some of the settings I've used...
MKV & AVI 62% - 90%
MKV & AVI 1000MB, 2000MB, 3000MB, 4000MB
MKV & AVI 1500kbs, 2000kbs, 2500kbs, 4000kbs
Also tried all the presets

I am streaming to my PS3 with TVersity. For some reason I cannot stream MP4 to my PS3. It says the data is corrupt. My PS3 also doesn't play AAC audio when I choose that audio output.

Another thing, when I play my converted files, fast forward and rewind hangs after just a couple seconds. With the AVIs I download it navigates fine. I just don't understand how people are creating a 700MB AVI that looks just like the original but even if I max out all the settings in Handbrake the quality isn't as good (and the files end up being quite large).

I will do whatever it takes to get the same results that I'm seeing in the movies I download. If it takes using different apps then that's what I'll do. I'm trying to get my DVD collection onto a media server.

Can someone please point me in the right direction?

[creamyhorror]

Are you following any guide to Handbrake? There are normally settings recommended for good quality. Post a Handbrake log for one of your encodes (an MKV one).

[jsbenson]

Yes, I have looked at the Handbarke guides and didn't have much luck.

Here's the log for a 2 minutes rip from X-Men 3

[10:38:44] hb_init: checking cpu count
[10:38:44] hb_init: starting libhb thread
HandBrake 0.9.3 (2008112300) - http://handbrake.fr/
4 CPUs detected
Opening Z:\VIDEO_TS...
[10:38:44] hb_scan: path=Z:\VIDEO_TS, title_index=11
[10:38:44] scan: trying to open with libdvdread
[10:38:44] scan: DVD has 31 title(s)
[10:38:44] scan: scanning title 11
[10:38:44] scan: opening IFO for VTS 7
[10:38:44] pgc_id: 8, pgn: 1: pgc: 0x1ea84c8
[10:38:44] scan: vts=7, ttn=8, cells=0->2, blocks=63392->173941, 29615 blocks
[10:38:44] scan: duration is 00:01:40 (100043 ms)
[10:38:44] scan: checking audio 1
[10:38:44] scan: id=80bd, lang=English (AC3), 3cc=eng ext=1
[10:38:44] scan: checking audio 2
[10:38:44] scan: id=81bd, lang=English (AC3), 3cc=eng ext=1
[10:38:44] scan: title 11 has 2 chapters
[10:38:44] scan: chap 1 c=0->1, b=63392->93001 (29610), 99865 ms
[10:38:44] scan: chap 2 c=2->2, b=173937->173941 (5), 177 ms
[10:38:44] scan: aspect = 0
[10:38:44] scan: decoding previews for title 11
[10:38:44] scan: audio 0x80bd: AC-3, rate=48000Hz, bitrate=448000 English (AC3) (5.1 ch)
[10:38:44] scan: audio 0x81bd: AC-3, rate=48000Hz, bitrate=192000 English (AC3) (2.0 ch)
Scanning title 11...
[10:38:44] scan: 10 previews, 720x480, 29.970 fps, autocrop = 60/60/0/2, aspect 16:9, PAR 32:27
[10:38:44] scan: title (0) job->width:720, job->height:304
[10:38:44] libhb: scan thread found 1 valid title(s)
+ title 11:
+ vts 7, ttn 8, cells 0->2 (29615 blocks)
+ duration: 00:01:40
+ size: 720x480, aspect: 1.78, 29.970 fps
+ autocrop: 60/60/0/2
+ chapters:
+ 1: cells 0->1, 29610 blocks, duration 00:01:40
+ 2: cells 2->2, 5 blocks, duration 00:00:00
+ audio tracks:
+ 1, English (AC3) (5.1 ch), 48000Hz, 448000bps
+ 2, English (AC3) (2.0 ch), 48000Hz, 192000bps
+ subtitle tracks:
Invalid sample rate 0, using input rate 48000
Calculated bitrate: 57687 kbps
Modified x264 options for pass 1 to append turbo options: ref=6:mixed-refs=1:bframes=6:weightb=1:direct=auto:b-pyramid=1:me=umh:analyse=all:8x8dct=1:trellis=2:no-fast-pskip=1sy-rd=1,1:deblock=-1,0:merange=64:no-dct-decimate=1:cabac=0:ref=1ubme=1:me=dia:analyse=none:trellis=0:no-fast-pskip=0:8x8dct=0:weightb=0
[10:38:44] 2 job(s) to process
[10:38:44] starting job
[10:38:44] job configuration:
[10:38:44] * source
[10:38:44] + Z:\VIDEO_TS
[10:38:44] + title 11, chapter(s) 1 to 2
[10:38:44] * destination
[10:38:44] + G:\Movies\X-Men Test.mkv
[10:38:44] + container: Matroska (.mkv)
[10:38:44] * video track
[10:38:44] + decoder: mpeg2
[10:38:44] + bitrate 9800 kbps
[10:38:44] + frame rate: 29.970 fps -> variable fps
[10:38:44] + strict anamorphic
[10:38:44] + storage dimensions: 720 * 480 -> 718 * 360, crop 60/60/0/2
[10:38:44] + pixel aspect ratio: 32 / 27
[10:38:44] + display dimensions: 850 * 360
[10:38:44] + filters
[10:38:44] + Detelecine (pullup) (default settings)
[10:38:44] + Deinterlaces selectively with yadif/mcdeint and lowpass5 blending (default settings)
[10:38:44] + Deblock (pp7) (10)
[10:38:44] + Denoise (hqdn3d) (3:2:2:3)
[10:38:44] + encoder: x264
[10:38:44] + options: ref=6:mixed-refs=1:bframes=6:weightb=1:direct=auto:b-pyramid=1:me=umh:analyse=all:8x8dct=1:trellis=2:no-fast-pskip=1sy-rd=1,1:deblock=-1,0:merange=64:no-dct-decimate=1:cabac=0:ref=1ubme=1:me=dia:analyse=none:trellis=0:no-fast-pskip=0:8x8dct=0:weightb=0
[10:38:44] + bitrate: 57687 kbps, pass: 1
[10:38:44] * audio track 0
[10:38:44] + decoder: English (AC3) (5.1 ch) (track 1, id 80bd)
[10:38:44] + bitrate: 448 kbps, samplerate: 48000 Hz
[10:38:44] + AC3 passthrough
[10:38:44] yadif thread started for segment 0
[10:38:44] yadif thread started for segment 1
[10:38:44] yadif thread started for segment 2
[10:38:44] yadif thread started for segment 3
[10:38:44] decomb thread started for segment 0
[10:38:44] decomb thread started for segment 1
[10:38:44] decomb thread started for segment 2
[10:38:44] decomb thread started for segment 3
[10:38:44] encx264: keyint-min: 30, keyint-max: 300
[10:38:44] encx264: encoding with stored aspect 32/27
x264 [warning]: width or height not divisible by 16 (718x360), compression will suffer.
x264 [info]: using SAR=32/27
x264 [info]: using cpu capabilities: MMX2 SSE2Fast SSSE3 Cache64
x264 [info]: profile Main, level 5.0
No accelerated IMDCT transform found
[10:38:44] sync: expecting 3028 video frames
[10:38:44] reader: first SCR 19217189
[10:38:44] a52_syncinfo failed
[10:38:44] a52_syncinfo ok
[10:38:44] mpeg2: "" (1) at frame 0 time 3003
[10:38:44] sync: first pts is 3003

[creamyhorror]

That looks like the first pass of a 2-pass encode (someone correct me if I'm wrong, I've not actually used Handbrake.). Is there job info for the 2nd pass?

[jsbenson]

Here's the entire log...

### Windows GUI 0.9.3 2008112300
### Running: Microsoft Windows NT 6.0.6002 Service Pack 2
###
### CPU: Intel(R) Core(TM)2 Quad CPU Q6600 @ 2.40GHz
### Ram: 4094 MB
### Screen: 1680x1050
### Temp Dir: C:\Users\jsbenson\AppData\Local\Temp\
### Install Dir: C:\Program Files (x86)\Handbrake
### Data Dir: C:\Users\jsbenson\AppData\Roaming\HandBrake\HandBr ake\0.9.3.0
#########################################

### CLI Query: -i "Z:\VIDEO_TS" -t 11 -c 1-2 -o "G:\Movies\X-Men Test.mkv" -f mkv --decomb -p --deblock=10 --detelecine -e x264 -S 700 -2 -T --denoise="medium" -a 1 -E ac3 -B 320 -R 0 -6 dpl2 -D 1 -x ref=6:mixed-refs=1:bframes=6:weightb=1:direct=auto:b-pyramid=1:me=umh:analyse=all:8x8dct=1:trellis=2:no-fast-pskip=1sy-rd=1,1:deblock=-1,0:merange=64:no-dct-decimate=1:cabac=0 -v
#########################################
[10:38:44] hb_init: checking cpu count
[10:38:44] hb_init: starting libhb thread
HandBrake 0.9.3 (2008112300) - http://handbrake.fr/
4 CPUs detected
Opening Z:\VIDEO_TS...
[10:38:44] hb_scan: path=Z:\VIDEO_TS, title_index=11
[10:38:44] scan: trying to open with libdvdread
[10:38:44] scan: DVD has 31 title(s)
[10:38:44] scan: scanning title 11
[10:38:44] scan: opening IFO for VTS 7
[10:38:44] pgc_id: 8, pgn: 1: pgc: 0x1ea84c8
[10:38:44] scan: vts=7, ttn=8, cells=0->2, blocks=63392->173941, 29615 blocks
[10:38:44] scan: duration is 00:01:40 (100043 ms)
[10:38:44] scan: checking audio 1
[10:38:44] scan: id=80bd, lang=English (AC3), 3cc=eng ext=1
[10:38:44] scan: checking audio 2
[10:38:44] scan: id=81bd, lang=English (AC3), 3cc=eng ext=1
[10:38:44] scan: title 11 has 2 chapters
[10:38:44] scan: chap 1 c=0->1, b=63392->93001 (29610), 99865 ms
[10:38:44] scan: chap 2 c=2->2, b=173937->173941 (5), 177 ms
[10:38:44] scan: aspect = 0
[10:38:44] scan: decoding previews for title 11
[10:38:44] scan: audio 0x80bd: AC-3, rate=48000Hz, bitrate=448000 English (AC3) (5.1 ch)
[10:38:44] scan: audio 0x81bd: AC-3, rate=48000Hz, bitrate=192000 English (AC3) (2.0 ch)
Scanning title 11...
[10:38:44] scan: 10 previews, 720x480, 29.970 fps, autocrop = 60/60/0/2, aspect 16:9, PAR 32:27
[10:38:44] scan: title (0) job->width:720, job->height:304
[10:38:44] libhb: scan thread found 1 valid title(s)
+ title 11:
+ vts 7, ttn 8, cells 0->2 (29615 blocks)
+ duration: 00:01:40
+ size: 720x480, aspect: 1.78, 29.970 fps
+ autocrop: 60/60/0/2
+ chapters:
+ 1: cells 0->1, 29610 blocks, duration 00:01:40
+ 2: cells 2->2, 5 blocks, duration 00:00:00
+ audio tracks:
+ 1, English (AC3) (5.1 ch), 48000Hz, 448000bps
+ 2, English (AC3) (2.0 ch), 48000Hz, 192000bps
+ subtitle tracks:
Invalid sample rate 0, using input rate 48000
Calculated bitrate: 57687 kbps
Modified x264 options for pass 1 to append turbo options: ref=6:mixed-refs=1:bframes=6:weightb=1:direct=auto:b-pyramid=1:me=umh:analyse=all:8x8dct=1:trellis=2:no-fast-pskip=1sy-rd=1,1:deblock=-1,0:merange=64:no-dct-decimate=1:cabac=0:ref=1ubme=1:me=dia:analyse=none:trellis=0:no-fast-pskip=0:8x8dct=0:weightb=0
[10:38:44] 2 job(s) to process
[10:38:44] starting job
[10:38:44] job configuration:
[10:38:44] * source
[10:38:44] + Z:\VIDEO_TS
[10:38:44] + title 11, chapter(s) 1 to 2
[10:38:44] * destination
[10:38:44] + G:\Movies\X-Men Test.mkv
[10:38:44] + container: Matroska (.mkv)
[10:38:44] * video track
[10:38:44] + decoder: mpeg2
[10:38:44] + bitrate 9800 kbps
[10:38:44] + frame rate: 29.970 fps -> variable fps
[10:38:44] + strict anamorphic
[10:38:44] + storage dimensions: 720 * 480 -> 718 * 360, crop 60/60/0/2
[10:38:44] + pixel aspect ratio: 32 / 27
[10:38:44] + display dimensions: 850 * 360
[10:38:44] + filters
[10:38:44] + Detelecine (pullup) (default settings)
[10:38:44] + Deinterlaces selectively with yadif/mcdeint and lowpass5 blending (default settings)
[10:38:44] + Deblock (pp7) (10)
[10:38:44] + Denoise (hqdn3d) (3:2:2:3)
[10:38:44] + encoder: x264
[10:38:44] + options: ref=6:mixed-refs=1:bframes=6:weightb=1:direct=auto:b-pyramid=1:me=umh:analyse=all:8x8dct=1:trellis=2:no-fast-pskip=1sy-rd=1,1:deblock=-1,0:merange=64:no-dct-decimate=1:cabac=0:ref=1ubme=1:me=dia:analyse=none:trellis=0:no-fast-pskip=0:8x8dct=0:weightb=0
[10:38:44] + bitrate: 57687 kbps, pass: 1
[10:38:44] * audio track 0
[10:38:44] + decoder: English (AC3) (5.1 ch) (track 1, id 80bd)
[10:38:44] + bitrate: 448 kbps, samplerate: 48000 Hz
[10:38:44] + AC3 passthrough
[10:38:44] yadif thread started for segment 0
[10:38:44] yadif thread started for segment 1
[10:38:44] yadif thread started for segment 2
[10:38:44] yadif thread started for segment 3
[10:38:44] decomb thread started for segment 0
[10:38:44] decomb thread started for segment 1
[10:38:44] decomb thread started for segment 2
[10:38:44] decomb thread started for segment 3
[10:38:44] encx264: keyint-min: 30, keyint-max: 300
[10:38:44] encx264: encoding with stored aspect 32/27
x264 [warning]: width or height not divisible by 16 (718x360), compression will suffer.
x264 [info]: using SAR=32/27
x264 [info]: using cpu capabilities: MMX2 SSE2Fast SSSE3 Cache64
x264 [info]: profile Main, level 5.0
No accelerated IMDCT transform found
[10:38:44] sync: expecting 3028 video frames
[10:38:44] reader: first SCR 19217189
[10:38:44] a52_syncinfo failed
[10:38:44] a52_syncinfo ok
[10:38:44] mpeg2: "" (1) at frame 0 time 3003
[10:38:44] sync: first pts is 3003
[10:41:02] dvd: end of cell 2 at block 173937
[10:41:02] reader: done. 2 scr changes
[10:41:03] mpeg2: "" (2) at frame 2996 time 8999991
[10:41:03] 99.999900s: Video -> Film
[10:41:05] sync: got 2996 frames, 3028 expected
[10:41:05] work: average encoding speed for job is 21.293900 fps
[10:41:07] mpeg2 done: 2997 frames
[10:41:07] render: lost time: 1765764 (588 frames)
[10:41:07] render: gained time: 1765764 (2351 frames) (0 not accounted for)
[10:41:07] render: average dropped frame duration: 3003
x264 [info]: slice I:41 Avg QP:10.72 size: 33315 PSNR Mean Y:56.24 U:56.67 V:56.78 Avg:55.52 Global:53.77
x264 [info]: slice P:1679 Avg QP:10.76 size: 33945 PSNR Mean Y:51.66 U:53.91 V:54.03 Avg:52.24 Global:51.94
x264 [info]: slice B:684 Avg QP:12.03 size: 17266 PSNR Mean Y:52.16 U:54.03 V:54.07 Avg:52.00 Global:50.41
x264 [info]: consecutive B-frames: 55.9% 19.3% 4.1% 6.6% 6.6% 5.8% 1.8%
x264 [info]: mb I I16..4: 25.5% 0.0% 74.5%
x264 [info]: mb P I16..4: 38.7% 0.0% 0.0% P16..4: 59.4% 0.0% 0.0% 0.0% 0.0% skip: 1.9%
x264 [info]: mb B I16..4: 3.0% 0.0% 0.0% B16..8: 56.2% 0.0% 0.0% direct:29.7% skip:11.1% L0:27.8% L1:40.3% BI:31.9%
x264 [info]: final ratefactor: -8.30
x264 [info]: direct mvs spatial:98.7% temporal:1.3%
x264 [info]: SSIM Mean Y:0.9959463
x264 [info]: PSNR Mean Y:51.883 U:53.989 V:54.089 Avg:52.231 Global:51.467 kb/s:6998.26
[10:41:07] decomb: yadif deinterlaced 2 | blend deinterlaced 10 | unfiltered 2395 | total 2407
[10:41:07] starting job
[10:41:07] job configuration:
[10:41:07] * source
[10:41:07] + Z:\VIDEO_TS
[10:41:07] + title 11, chapter(s) 1 to 2
[10:41:07] * destination
[10:41:07] + G:\Movies\X-Men Test.mkv
[10:41:07] + container: Matroska (.mkv)
[10:41:07] * video track
[10:41:07] + decoder: mpeg2
[10:41:07] + bitrate 9800 kbps
[10:41:07] + frame rate: 29.970 fps -> variable fps
[10:41:07] + strict anamorphic
[10:41:07] + storage dimensions: 720 * 480 -> 718 * 360, crop 60/60/0/2
[10:41:07] + pixel aspect ratio: 32 / 27
[10:41:07] + display dimensions: 850 * 360
[10:41:07] + filters
[10:41:07] + Detelecine (pullup) (default settings)
[10:41:07] + Deinterlaces selectively with yadif/mcdeint and lowpass5 blending (default settings)
[10:41:07] + Deblock (pp7) (10)
[10:41:07] + Denoise (hqdn3d) (3:2:2:3)
[10:41:07] + encoder: x264
[10:41:07] + options: ref=6:mixed-refs=1:bframes=6:weightb=1:direct=auto:b-pyramid=1:me=umh:analyse=all:8x8dct=1:trellis=2:no-fast-pskip=1sy-rd=1,1:deblock=-1,0:merange=64:no-dct-decimate=1:cabac=0
[10:41:07] + bitrate: 57687 kbps, pass: 2
[10:41:07] * audio track 0
[10:41:07] + decoder: English (AC3) (5.1 ch) (track 1, id 80bd)
[10:41:07] + bitrate: 448 kbps, samplerate: 48000 Hz
[10:41:07] + AC3 passthrough
[10:41:07] yadif thread started for segment 0
[10:41:07] yadif thread started for segment 1
[10:41:07] yadif thread started for segment 2
[10:41:07] yadif thread started for segment 3
[10:41:07] decomb thread started for segment 0
[10:41:07] decomb thread started for segment 1
[10:41:07] decomb thread started for segment 2
[10:41:07] decomb thread started for segment 3
[10:41:07] encx264: keyint-min: 30, keyint-max: 300
[10:41:07] encx264: encoding with stored aspect 32/27
x264 [warning]: width or height not divisible by 16 (718x360), compression will suffer.
x264 [info]: using SAR=32/27
x264 [info]: using cpu capabilities: MMX2 SSE2Fast SSSE3 Cache64
[10:41:07] reader: first SCR 19217189
[10:41:07] mpeg2: "" (1) at frame 0 time 3003
[10:41:07] 0.066733s: Film -> Video
x264 [warning]: Error: 2pass curve failed to converge
x264 [warning]: target: 57687.00 kbit/s, expected: 7305.76 kbit/s, avg QP: 10.0005
x264 [warning]: try reducing target bitrate or reducing qp_min (currently 10)
x264 [info]: profile High, level 5.0
No accelerated IMDCT transform found
[10:41:07] a52_syncinfo failed
[10:41:07] a52_syncinfo ok
[10:41:07] sync: expecting 3028 video frames
[10:41:07] sync: first pts is 3003
[10:44:56] dvd: end of cell 2 at block 173937
[10:44:56] mpeg2: "" (2) at frame 2996 time 8999991
[10:44:56] 99.999900s: Video -> Film
[10:44:57] reader: done. 2 scr changes
[10:45:01] sync: got 2996 frames, 3028 expected
[10:45:01] work: average encoding speed for job is 12.966231 fps
[10:45:04] mpeg2 done: 2997 frames
[10:45:04] render: lost time: 1765764 (588 frames)
[10:45:04] render: gained time: 1765764 (2351 frames) (0 not accounted for)
[10:45:04] render: average dropped frame duration: 3003
x264 [info]: slice I:40 Avg QP:10.73 size: 35333 PSNR Mean Y:55.77 U:57.75 V:57.85 Avg:55.71 Global:54.08
x264 [info]: slice P:1684 Avg QP:10.76 size: 29761 PSNR Mean Y:52.84 U:55.96 V:56.12 Avg:53.63 Global:53.14
x264 [info]: slice B:680 Avg QP:12.05 size: 16050 PSNR Mean Y:52.43 U:55.81 V:55.84 Avg:53.14 Global:50.97
x264 [info]: consecutive B-frames: 56.1% 19.2% 4.1% 6.4% 6.6% 5.8% 1.8%
x264 [info]: mb I I16..4: 15.4% 41.2% 43.4%
x264 [info]: mb P I16..4: 5.1% 27.4% 22.7% P16..4: 15.9% 14.8% 8.5% 1.8% 1.7% skip: 2.1%
x264 [info]: mb B I16..4: 2.5% 0.0% 0.0% B16..8: 36.6% 11.1% 15.5% direct:18.5% skip:15.9% L0:36.6% L1:35.0% BI:28.4%
x264 [info]: 8x8 transform intra:48.4% inter:25.5%
x264 [info]: direct mvs spatial:87.9% temporal:12.1%
x264 [info]: ref P L0 74.6% 11.9% 5.9% 3.2% 2.5% 2.1%
x264 [info]: ref B L0 80.4% 10.4% 4.5% 2.7% 2.0%
x264 [info]: ref B L1 96.2% 3.8%
x264 [info]: SSIM Mean Y:0.9968265
x264 [info]: PSNR Mean Y:52.771 U:55.946 V:56.067 Avg:53.525 Global:52.425 kb/s:6227.77
[10:45:04] decomb: yadif deinterlaced 2 | blend deinterlaced 10 | unfiltered 2395 | total 2407
[10:45:04] libhb: work result = 0
Rip done!

############ End of Log ##############

[creamyhorror]

Handbrake seems to be both deinterlacing and detelecining. This should not be the case. Did you specifically select deinterlace, or was it automatically selected? Deinterlacing a telecined source (like almost every movie) is going to muck it up badly. You should only be detelecining.

Also, your (2nd-pass) encoder settings have the following issues:

- CABAC should be on (it's off)
- subme should be specified - 7-9 for high quality
- merange is far too high at 64 - go for 16 or 20 at maximum on SD material
- b-adapt is not specified - use b-adapt 2 if you can set it