FFmpeg does not add query string parameter to subsequent request URL

[eternal]

When processing HLS/Dash playlist (where query-param used for auth) - ffmpeg doesn't add those query-params in data chunk requests, which results in 403 forbidden error form the server.

Example:

ffmpeg -i "http://example.com/playlist.m3u8?auth=foo" -c copy out.mp4

chunk request is like:

http://example.com/chunk1.ts

instead of (should be):

http://example.com/chunk1.ts?auth=foo

Is there any option to circumvent that or is it not supported, or a bug?

[codehound]

When processing HLS/Dash playlist (where query-param used for auth) - ffmpeg doesn't add those query-params in data chunk requests, which results in 403 forbidden error form the server.

Example:

ffmpeg -i "http://example.com/playlist.m3u8?auth=foo" out.mp4

This is wrong in the first place ^^

ffmpeg -i "http://example.com/playlist.m3u8?auth=foo" -c copy out.mp4

And a 403 forbidden means you need to add headers - usually referer being the most important.

Example:

ffmpeg -headers "Referer: www.yoursite.com" -i "http://example.com/playlist.m3u8?auth=foo" -c copy out.mp4

[eternal]

This is wrong in the first place ^^

Ah, missed that in the post. Updated.

And a 403 forbidden means you need to add headers - usually referer being the most important.

Yea, I know but that's not the case always. Here's a test case (Dash): https://www.loom.com/share/0d13570c64fc46dabfc06b4a1f20f158
(referer, user-string nothing matters, but query-strings)

@codehound

[codehound]

Right there is a manifest.mpd but its base64 encoded


[Attachment 62650 - Click to enlarge]

When decoded gives the mpd:

<?xml version="1.0" encoding="UTF-8"?>
<!--Generated by Loom-->
<MPD xmlns="urn:mpeg:dash:schema:mpd:2011" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:schemaLocation="urn:mpeg:dash:schema:mpd:2011 DASH-MPD.xsd" profiles="urn:mpeg:dash:profile:isoff-live:2011" minBufferTime="PT2S" type="static" mediaPresentationDuration="PT337.546S">
<Period id="0">
    <AdaptationSet id="0" contentType="audio" lang="en" segmentAlignment="true">
    <Representation id="0" bandwidth="129660" codecs="opus" mimeType="audio/webm" audioSamplingRate="48000">
        <AudioChannelConfiguration schemeIdUri="urn:mpeg:dash:23003:3:audio_channel_configuration:2011" value="1"/>
        <SegmentTemplate timescale="1000000" initialization="0d13570c64fc46dabfc06b4a1f20f158-audio-init.webm" media="0d13570c64fc46dabfc06b4a1f20f158-audio-$Number$.webm" startNumber="0">
            <SegmentTimeline>
                <S t="0" d="3419000"/>
<S t="3403000" d="3359000"/>
<S t="6779000" d="3419000"/>
<S t="10189000" d="3359000"/>
<S t="13559000" d="3419000"/>
<S t="16979000" d="3419000"/>
<S t="20392000" d="3359000"/>
<S t="23759000" d="3419000"/>
<S t="27179000" d="3419000"/>
<S t="30590000" d="3359000"/>
<S t="33959000" d="3419000"/>
<S t="37379000" d="3359000"/>
<S t="40739000" d="3419000"/>
<S t="44159000" d="3419000"/>
<S t="47562000" d="3359000"/>
<S t="50939000" d="3419000"/>
<S t="54359000" d="3419000"/>
<S t="57760000" d="3359000"/>
<S t="61139000" d="3419000"/>
<S t="64551000" d="3359000"/>
<S t="67919000" d="3419000"/>
<S t="71339000" d="3419000"/>
<S t="74747000" d="3359000"/>
<S t="78119000" d="3419000"/>
<S t="81539000" d="3419000"/>
<S t="84945000" d="3359000"/>
<S t="88319000" d="3419000"/>
<S t="91739000" d="3419000"/>
<S t="95140000" d="3359000"/>
<S t="98519000" d="3419000"/>
<S t="101928000" d="3359000"/>
<S t="105299000" d="3419000"/>
<S t="108719000" d="3419000"/>
<S t="112123000" d="3359000"/>
<S t="115499000" d="3419000"/>
<S t="118908000" d="3359000"/>
<S t="122279000" d="3419000"/>
<S t="125699000" d="3419000"/>
<S t="129098000" d="3359000"/>
<S t="132479000" d="3419000"/>
<S t="135895000" d="3419000"/>
<S t="139295000" d="3359000"/>
<S t="142679000" d="3419000"/>
<S t="146092000" d="3419000"/>
<S t="149495000" d="3359000"/>
<S t="152879000" d="3419000"/>
<S t="156281000" d="3419000"/>
<S t="159697000" d="3358000"/>
<S t="163078000" d="3418000"/>
<S t="166481000" d="3359000"/>
<S t="169859000" d="3418000"/>
<S t="173269000" d="3358000"/>
<S t="176638000" d="3418000"/>
<S t="180058000" d="3418000"/>
<S t="183470000" d="3358000"/>
<S t="186838000" d="3418000"/>
<S t="190258000" d="3418000"/>
<S t="193667000" d="3358000"/>
<S t="197038000" d="3418000"/>
<S t="200458000" d="3418000"/>
<S t="203866000" d="3358000"/>
<S t="207238000" d="3418000"/>
<S t="210658000" d="3418000"/>
<S t="214061000" d="3358000"/>
<S t="217438000" d="3418000"/>
<S t="220847000" d="3358000"/>
<S t="224218000" d="3418000"/>
<S t="227638000" d="3418000"/>
<S t="231043000" d="3358000"/>
<S t="234418000" d="3418000"/>
<S t="237824000" d="3358000"/>
<S t="241198000" d="3418000"/>
<S t="244618000" d="3418000"/>
<S t="248022000" d="3358000"/>
<S t="251398000" d="3418000"/>
<S t="254818000" d="3418000"/>
<S t="258221000" d="3358000"/>
<S t="261598000" d="3418000"/>
<S t="264999000" d="3358000"/>
<S t="268378000" d="3418000"/>
<S t="271791000" d="3358000"/>
<S t="275158000" d="3418000"/>
<S t="278578000" d="3118000"/>
<S t="281679000" d="298000"/>
<S t="281978000" d="3358000"/>
<S t="285358000" d="1198000"/>
<S t="286558000" d="2218000"/>
<S t="288778000" d="3418000"/>
<S t="292196000" d="3418000"/>
<S t="295597000" d="3358000"/>
<S t="298978000" d="3418000"/>
<S t="302395000" d="3418000"/>
<S t="305790000" d="3358000"/>
<S t="309178000" d="3418000"/>
<S t="312585000" d="3358000"/>
<S t="315958000" d="3418000"/>
<S t="319378000" d="3418000"/>
<S t="322784000" d="3357000"/>
<S t="326157000" d="3417000"/>
<S t="329577000" d="3417000"/>
<S t="332978000" d="3358000"/>
<S t="336358000" d="1200000"/>
            </SegmentTimeline>
        </SegmentTemplate>
    </Representation>
</AdaptationSet><AdaptationSet id="1" contentType="video" width="1280" height="720" segmentAlignment="true">
    <Representation id="1" bandwidth="507099" codecs="vp9" mimeType="video/webm" sar="1:1">
        <SegmentTemplate timescale="1000000" initialization="0d13570c64fc46dabfc06b4a1f20f158-video-init.webm" media="0d13570c64fc46dabfc06b4a1f20f158-video-$Number$.webm" startNumber="0">
            <SegmentTimeline>
                <S t="0" d="3403000"/>
<S t="3403000" d="3401000"/>
<S t="6779000" d="3385000"/>
<S t="10189000" d="3400000"/>
<S t="13559000" d="3397000"/>
<S t="16979000" d="3406000"/>
<S t="20392000" d="3402000"/>
<S t="23759000" d="3396000"/>
<S t="27179000" d="3400000"/>
<S t="30590000" d="3393000"/>
<S t="33959000" d="3396000"/>
<S t="37379000" d="3394000"/>
<S t="40739000" d="3397000"/>
<S t="44159000" d="3392000"/>
<S t="47562000" d="3403000"/>
<S t="50939000" d="3397000"/>
<S t="54359000" d="3398000"/>
<S t="57760000" d="3394000"/>
<S t="61139000" d="3397000"/>
<S t="64551000" d="3395000"/>
<S t="67919000" d="3405000"/>
<S t="71339000" d="3396000"/>
<S t="74747000" d="3396000"/>
<S t="78119000" d="3400000"/>
<S t="81539000" d="3402000"/>
<S t="84945000" d="3398000"/>
<S t="88319000" d="3397000"/>
<S t="91739000" d="3400000"/>
<S t="95140000" d="3390000"/>
<S t="98519000" d="3398000"/>
<S t="101928000" d="3399000"/>
<S t="105299000" d="3398000"/>
<S t="108719000" d="3398000"/>
<S t="112123000" d="3389000"/>
<S t="115499000" d="3396000"/>
<S t="118908000" d="3394000"/>
<S t="122279000" d="3397000"/>
<S t="125699000" d="3399000"/>
<S t="129098000" d="3398000"/>
<S t="132479000" d="3399000"/>
<S t="135895000" d="3400000"/>
<S t="139295000" d="3397000"/>
<S t="142679000" d="3400000"/>
<S t="146092000" d="3403000"/>
<S t="149495000" d="3395000"/>
<S t="152879000" d="3391000"/>
<S t="156281000" d="3416000"/>
<S t="159697000" d="3394000"/>
<S t="163078000" d="3390000"/>
<S t="166481000" d="3396000"/>
<S t="169859000" d="3392000"/>
<S t="173269000" d="3401000"/>
<S t="176638000" d="3399000"/>
<S t="180058000" d="3401000"/>
<S t="183470000" d="3401000"/>
<S t="186838000" d="3389000"/>
<S t="190258000" d="3407000"/>
<S t="193667000" d="3400000"/>
<S t="197038000" d="3394000"/>
<S t="200458000" d="3405000"/>
<S t="203866000" d="3401000"/>
<S t="207238000" d="3392000"/>
<S t="210658000" d="3402000"/>
<S t="214061000" d="3398000"/>
<S t="217438000" d="3388000"/>
<S t="220847000" d="3399000"/>
<S t="224218000" d="3399000"/>
<S t="227638000" d="3398000"/>
<S t="231043000" d="3394000"/>
<S t="234418000" d="3387000"/>
<S t="237824000" d="3398000"/>
<S t="241198000" d="3406000"/>
<S t="244618000" d="3394000"/>
<S t="248022000" d="3406000"/>
<S t="251398000" d="3393000"/>
<S t="254818000" d="3400000"/>
<S t="258221000" d="3394000"/>
<S t="261598000" d="3384000"/>
<S t="264999000" d="3396000"/>
<S t="268378000" d="3396000"/>
<S t="271791000" d="3394000"/>
<S t="275158000" d="3396000"/>
<S t="278578000" d="3098000"/>
<S t="281679000" d="299000"/>
<S t="281978000" d="3392000"/>
<S t="285358000" d="1196000"/>
<S t="286558000" d="2237000"/>
<S t="288778000" d="3393000"/>
<S t="292196000" d="3401000"/>
<S t="295597000" d="3397000"/>
<S t="298978000" d="3401000"/>
<S t="302395000" d="3395000"/>
<S t="305790000" d="3401000"/>
<S t="309178000" d="3394000"/>
<S t="312585000" d="3400000"/>
<S t="315958000" d="3407000"/>
<S t="319378000" d="3392000"/>
<S t="322784000" d="3401000"/>
<S t="326157000" d="3395000"/>
<S t="329577000" d="3398000"/>
<S t="332978000" d="3396000"/>
<S t="336358000" d="1188000"/>
            </SegmentTimeline>
        </SegmentTemplate>
    </Representation>
</AdaptationSet>
</Period>
</MPD>

[[ss]vegeta]

When decoded gives the mpd:

And then the MPD needs editing to download.
@OP search /r/piracy this was asked few days ago and someone answered.

[codehound]

Thanks vegeta, got some other shit to do.

[eternal]

When decoded gives the mpd:

And then the MPD needs editing to download.
@OP search /r/piracy this was asked few days ago and someone answered.

Yes, saw that already. That's what inspired me to ask this. Why does ffmpeg not support this yet? or if already supported, what's the option to turn on this behavior?

[eternal]

@codehound Thanks for your effort on the image I know all of this already. Yon can workaround by editing the manifest or proxy-ing the request (I should've mentioned this on the post). But my question is why ffmpeg doesn't support this natively (or if I'm missing something)

[codehound]

ffmpeg is probably the worst of about 6 tools to download this with.

[eternal]

about 6 tools to download this with

As in?