De-muxed playback of high quality content?

[EternalStudent07]

I know normally people mux audio + video together into a single MKV or MP4. Interleaving the data needed for a point in time. But is it possible to have separate video, sound, and subtitle files...then have a player integrate them on the fly for playback?

Seeking would be harder. You'd almost have to index files ahead of time with all the variable rate compression we use. Figure out where each file location would be for a rough spot in playback time.

I'm picturing people being able to customize what they view. If you want super high quality audio with a 720p image...you can do that easily. As of today I tend to see either huge files with 4K HDR video + high quality audio, or 720p video compressed heavily + lower quality audio (sometimes 2 channel).

And if the particular file you grabbed has an issue (say a visual artifact they missed), then you'll be downloading part of the file again (the audio in the example)...even if it hasn't changed.

[jagabo]

Some players can automatically load separate video, audio, and sub files with the same base name. MPCHC and MPCBE for example.

But mixing and matching downloads will be a pain in the ass. For example, movies released in different countries often have different distributor logos and other stuff at the start. And they are often even different cuts of the movie, different frame rates, etc. So you can't count on the video from a USA Blu-ray and AC3 audio from a French DVD syncing properly. It's the same problem you have with subs now. It may be fine if you stick to your own stuff but it will be a nightmare with downloads.