muxing audio and video from hevc encode to final video container

[vhelp]

x265.exe encoding settings used to create hevc video-only file:

x265 --q 20 --keyint 24 --frames all --input "h:\video.yuv" --width 720 --height 480 --rate 23.976 --rect --max-merge 1 --hash 0 --no-rdo --no-rdoq --tu-intra-depth 1 --tu-inter-depth 2 --no-tskip --no-tskip-fast --no-wpp --output "h:\video.hm10"

ffmpeg encoding settings used to create video.avs.wav->audio.aac (audio-only) file:

ffmpeg1 -i "h:\audio.wav" -acodec libvo_aacenc -y "h:\audio.aac"

.

ffmpeg version N-50025-gb8bb661 Copyright (c) 2000-2013 the FFmpeg developers
  built on Feb 17 2013 02:37:45 with gcc 4.7.2 (GCC)
  configuration: --enable-gpl --enable-version3 --disable-w32threads --enable-avisynth 
  --enable-bzlib --enable-fontconfig --enable-frei0r --enable-gnutls --enable-libass 
  --enable-libbluray --enable-libcaca --enable-libfreetype --enable-libgsm --enable-libmp3lame
  --enable-libopencore-amrnb --enable-libopencore-amrwb --enable-libopenjpeg --enable-libopus 
  --enable-librtmp --enable-libschroedinger --enable-libsoxr --enable-libspeex --enable-libtheora
  --enable-libtwolame --enable-libvo-aacenc --enable-libvo-amrwbenc --enable-libvorbis --enable-libvpx
  --enable-libx264 --enable-libxavs --enable-libxvid --enable-zlib
  libavutil      52. 17.101 / 52. 17.101
  libavcodec     54. 91.103 / 54. 91.103
  libavformat    54. 63.100 / 54. 63.100
  libavdevice    54.  3.103 / 54.  3.103
  libavfilter     3. 38.100 /  3. 38.100
  libswscale      2.  2.100 /  2.  2.100
  libswresample   0. 17.102 /  0. 17.102
  libpostproc    52.  2.100 / 52.  2.100
Hyper fast Audio and Video encoder
usage: ffmpeg [options] [[infile options] -i infile]... {[outfile options] outfile}...

and finally, mp4box used to do the muxing of audio and video into new video container.

mp4box -version

.

MP4Box - GPAC version 0.5.1-DEV-rev4663
GPAC Copyright (c) Telecom ParisTech 2000-2012
GPAC Configuration: (static configuration file)
Features: GPAC_HAS_SSL GPAC_HAS_SPIDERMONKEY GPAC_HAS_JPEG GPAC_HAS_PNG

in order to work correctly for mp4box, we need to rename video.hm10 to video.h265, then..

p1: mp4box -add h:\hevc.x265.music.video.hm10.h265:fmt=hevc:fps=23.976 -add h:\audio.aac -new h:\video.mp4
p2: mp4box -add h:\video.h265 -fps 23.976 -add h:\audio.aac h:\video.mp4

but it only plays audio. mediainfo reports 1video/2audios

p1: mp4box -add h:\hevc.x265.music.video.h265:FMT=HEVC:fps=23.976 -new h:\video.mp4
p2: mp4box -add h:\video.h265 -fps 23.976 -add h:\audio.aac h:\video.mp4

and also this only plays audio. mediainfo reports 1video/1audio

p1: mp4box -add h:\hevc.x265.music.video.h265:FMT=HEVC:fps=23.976 -new h:\video.mp4
p2: mp4box -add h:\audio.aac h:\video.mp4

and this only plays audio. mediainfo reports 1video/1audio

none of the methods/routines above work in creating an audio/video playable file.

what am i doing wrong, using old sofware, etc ?
help me figure this problem out, thank you.

[Trepack]

I had the same problem and solved it by disabling LAV Splitter

[vhelp]

i don't have that utility you are showing. also, am running windows xp home sp2

[Trepack]

Codec Tweak Tool Codec Tweak Tool on codecguide

Codec Tweak Tool

This is a stand-alone version of the tool that is included in the K-Lite Codec Pack.
With this tool you can do things like:

• Scan the registry to detect and remove broken references to codecs and filters.
• Generate a detailed log of all installed codecs and filters.
• Enable/disable more than 250 popular codecs and filters (if they are installed).
• Manage preferred source filters (a.k.a. splitters).
• Reset settings.
• Backup and restore settings.
• Adjust preferred decoders on Windows 7/8.
• Various tweaks for disabling MS codecs on Windows 7/8.

XP/2003/Vista/7/8


I will upload a video showing that this is the problem

[El Heggunte]

@ vhelp:

https://forum.videohelp.com/threads/357754-%5BHEVC%5D-x265-EXE-mingw-builds?p=2259754&v...=1#post2259754

You can also configure // set the merit of the DS filters from inside Graphstudio itself,
just press Control + F.

[El Heggunte]

Yet another option:

[vhelp]

i fell asleep from all these testings. anyway. i tried codec tweak tool but not successful in mux a/v playback. i've been using ffplay since its instantanious for playback of anything. it puts a spiral graph on the screen as it plays until there is video. mplayer, kmplayer and my homdade player only play the audio.

i'm not sure if it is the version of the tools that created the final video, that's why i posted those specs.

if it is a codec (decoder) issue, then perhaps i have more than one of the same codec installed, removing one may not have resolved the sofware player decoder playback problem, assuming that that is the case. if so, then i need a nother type of sofware the identifies *all* codecs, singles and multiples of the same since i may have installed them more than once w/out removing any of them first when trying others.

[vhelp]

don't underestimate the power of the osmo! ..the player, that is

i forgot i had installed yet another player. and when i thought of playing the troubled .mp4 video, to my surprise, it played it, a/v perfectly!



so, my question is, is it a decoder issue with the other players (the osmo player playes it fine w/out tweaking or chaning anything) or is it a software player (and maybe codec/decoder referencing) thing ?

..and, how can i fix ?

[Selur]

OSMO Player uses it's own decoders&splitters.
If other players don't support the file it's a splitter and/or decoder problem.

[vhelp]

ok, thanks for the info.

[El Heggunte]

.......

so, my question is, is it a decoder issue with the other players (the osmo player playes it fine w/out tweaking or chaning anything) or is it a software player (and maybe codec/decoder referencing) thing ?

..and, how can i fix ?

You could have started by giving an answer to this question:

https://forum.videohelp.com/threads/357367-HEVC-Encoder-by-Strongene-Lentoid?p=2259767&...=1#post2259767

[vhelp]

sorry, i thought i did. from memory of that post..

the graph would come up (sometimes, two items in a listbox) but would not connect, it would crash if i tried to connnect.

[DarrellS]

To play MP4+MP3 in MPC-HC, make sure you have the latest Lentoid decoder and...

[El Heggunte]

...

the graph would come up (sometimes, two items in a listbox) but would not connect, it would crash if i tried to connnect.

Man, I hate to say this, but your machine will need to go through a fresh system re-install very soon.

[vhelp]

i agree. a fresh install of xp would do it, long story short, i have no energy to deal all the steps envolved with that.

[DarrellS]

i agree. a fresh install of xp would do it, long story short, i have no energy to deal all the steps envolved with that.

A little late to tell you this now but making system backups makes it real easy to get you back to good working order. A fresh install with all your essential drivers and software followed by a backup. Add a few more programs and make another backup and so on. I like to format a spare drive to install my backed up OS on and use the old drive in an external HDD enclosure or in my case, my case has an external connection on the top to use in case their is something on their I need that I didn't get backed up. I also keep a lot of downloaded programs on other drives. I have six drives connected at the moment.

I just installed a system backup last week because I thought all this x265 and vp9 stuff had boinked my system. Come to find out it hadn't but it's better safe than sorry.


EDIT: Oh, and every once in a while I still like to do a clean install of XP just so that I don't forget how

[vhelp]

eventually i will fix xp, thanks for the tips.

[DarrellS]

Hey, at least you don't have to do a factory recovery of Windows 98SE every six months or so because Windows kept corrupting itself. I never owned ME but I heard that was a nightmare. Windows 2000 was actually pretty good to me, it just didn't support all my new hardware. I could put it on two or three PCs without worrying about MS killing them off.

[vhelp]

- solved - muxing w/out eating up c: drive hdd space using muxer from l-smash.

up to now, i've been encoding short clips, but with the upgrades to x265 with stdin/piping, i started encoding a little bit longer clips and never thinking problems would occur. however, something just surfaced and now i have to deal with it. muxing. and that's the problem. i didn't realize that muxing creates a temporary file as it rebuilds a new file and then writes the new file. because of this, it is eating a lot of my c: drive hdd space fast.

i encode all my videos on a mem stick, g:\ drive and write them to an external usb 1tb hdd. but mp4box is using the c: drive to write temporary files. example,

mp4box -add "g:\video.hm10":FMT=HEVC -fps 23.976 -new "h:\video.mp4"

what are other methods of muxing raw hevc videos ? i thought there was a newer method though slow but can't recall the name. i usually write these things down somewhere but didn't that time.

edit: i did write it down, horray! use this method (l-smash) if you want to save hdd space on your root c: drive.

muxer.exe -i g:\video.hm10 -o h:\video.mp4

[vhelp]

- new problem - it is audio delay issues. am not sure where in the chain of events it is happening.

chain of events:

1. when i play the original .ts source the audio is in sync
2. but, when i open and play the audio inside virtualdub via script (below) audio deley.
3. it takes aprox "-600" to adjust the delay in virtualdub
4. save out to a wav file {using step 3 adjustments} to audio.wav
5. convert to audio.aac
6. convert video to hevc
7. mux hevc video and audio.aac to finalvideo.hevc.mp4
8. video playback in mpc-be is still having audio delay issues

step 2, the avs script to open and playback inside virtualdub

  v = "h:\0560.video.hdpvr.ch239AUD.GuitarCenterSessions.Lisse.9Mbps.ts"
  LoadPlugin( "C:\PLUGINS\LSMASHSource.dll" )
  LWLibavVideoSource(v, cache=true , seek_mode=0 ).selectevery(2,0)  # <-- or else we have 59.94 fps
  AudioDub(last, directshowsource(v))
  trim( 06885,000000).separateFields().selectevery( 5, 0,1,2,3).weave( )  .trim( 0000, 0) .trim(0, 860).fadeOUT(30)

step 3 through 5, convert to aac audio

ffmpeg -i audio.wav -acodec aac -ab 128k -strict experimental audio.m4a

step 7

tipical muxing video/audio 

mp4box -add "g:\video.hm10":FMT=HEVC -fps 23.976 -add g:\audio.m4a -new "h:\finalvideo.hevc.mp4"

but then i learned you can adjust audio delay in mp4box this way, but there is still the same audio delay

mp4box -add "g:\video.hm10":FMT=HEVC -fps 23.976 -add g:\audio.m4a -fps 23.976 -delay 1=-600 -new "h:\finalvideo.hevc.mp4"

maybe i am doing something wrong in the events above. maybe directshow is not good for this. i don't know of any other way to flexibly extract the audio as a wav when i am "trimming" inside the original video while inside the timeline.

[El Heggunte]

Some things to consider...

--- VirtualDub is not a player, and neither FFMS2 nor LSmashSource are optimized for playback performance;

--- the Lentoid decoder still is much faster than the internal HEVC decoder of MPC-BE;

--- not all AAC encoders are equal, regarding the initial audio delay --- IIRC, and FWIW, NeroAACEnc is the worst offender, whereas enc_aacplus is "the least bad" one;

--- both Haali Media Splitter and the internal MP4 splitter of MPC-BE ignore the audio delay metadata,
so you should prefer LAV Splitter instead;

[vhelp]

excuse my ignorance, but i do not now how to utilize LAVfilters inside an avs script.

the origin of the video processing starts inside an avs script -> virtualdub, for two reasons:

a) i can navigate to any section and extract the begin/end frame pos and adjust the script to encode that segment
b) after {a} then i can extract the audio from it.

i do not know of any other flexible way of doing the two, let alone obtain just the audio portion from a segment. both have to be obtained through some video timeline. so it must have something to do with the seeking and decoding those parts (.ts avc video) for their audio parts. i will have to be more ingenious and figure out another way then, thank you.

[El Heggunte]

excuse my ignorance, but i do not now how to utilize LAVfilters inside an avs script.

I didn't say a word about using LAV Filters in an Avisynth script.
I said you are going to have sync issues if you insist on using MPC-BE's built-in MP4 Splitter.

Next time I will use Ancient Greek instead of modern English, then hopefully you'll start to understand what I write

[vhelp]

ok, thanks. i will try and figure alternative method. maybe mp4box is not good for this. am now trying muxer, but having problems getting it to include audio: muxer.exe -i g:\video.hm10 -i g:\audio.aac?1 -o h:\video.mp4 won't work. arrg. still searching.........finally got the audio to mux, but now i have to re-encode the video again bc i over-wrote it.

[Selur]

btw. iirc using lavf filters decoder should be possible by:
a. making sure it's the default decoder
b. using DirectShowSource
c. setting Hardware Decoder to use to "DXVA (copy-back)"