Troulbe with m3u8 file on cnbc

[sufr3ak]

I'm not sure if there is a way to do this on my linux server.

I am trying to capture the stream here, https://www.cnbc.com/live-tv/the-profit/full-episode/mo-honey-mo-problems/1931240515516 (no paywall/login needed)

I used my Windows Firefox network inspector to (painfully) find the m3u8. It seemed to be session tied, so i keep getting this error.

[https @ 0x7c5f780] Cannot reuse HTTP connection for different host: vod-lf-oneapp-prd.akamaized.net:-1 != redirect.manifest.theplatform.com:-1
[hls @ 0x7544040] keepalive request failed for 'https://redirect.manifest.theplatform.com/r/HNK2IC/tZref27rBHtV,neFYKrEsFVPO,zjc3pKNPMXIv,xk8YixrfZ_sj,l7axxkSPRvf8,0r_G4jp7_7r3/aHR0cHM6Ly92b2QtbGYtb25lYXBwLXByZC5ha2FtYWl6ZWQubmV0L3Byb2QvdmlkZW8vaEFOLzNqby85MDAwMTE2NTE3L29Oalp1b01Nd3NwNWY1WjJyMFVtRy8xODUwa181NDBfaGxzL18xODU1MDM3MjM0LTBfMDA0MTAudHM?sid=daf7bfb2-46b0-4163-8cf3-204d1264ee2a&policy=174233584&date=1628992257037&ip=<IP>&schema=1.0&cid=39ffc7ce-f486-4a20-8fc6-52e1f0075b52&aid=2304981409&dur=2599021&sig=d08d7a2867dc2b81e9600e64e6ed20fbf5574649a24ab10bf4668633adfe4a37' with error: 'Invalid argument' when opening url, retrying with new connection

I tried passing my useragent/referrer string as well, with the same error.

Wondering how I can capture this stream. I prefer using my linux server, but I have a Windows host I can use. (pull from the FF cache somehow?)

[lfer94]

are you using ffmpeg?

[jagabo]

This worked fine for me with Win10:

youtube-dl "https://player.theplatform.com/p/gZWlPC/_fSoW8mNx_5w/select/media/guid/2304981409/9000116517?mute=false&autoPlay=false&playbackStartPosition=0&policy=174233584&MVPDid=undefined&params=policy%3D174233584%26fallbackSiteSectionId%3D7006049%26siteSectionId%3Dcnbc_inline_vod%26manifest%3Dm3u%26switch%3DHLSServiceSecure%26_fw_ae%3Dundefined%26_fw_vcid2%3D264bc22f-8131-4ced-aa0b-25f79cae46da%26_fw_h_referer%3Dwww.cnbc.com%26schema%3D2.0%26csid%3Dcnbc_tveverywhere_vod_hub%26afid%3D137705375"

[sufr3ak]

This worked fine for me with Win10:

youtube-dl "https://player.theplatform.com/p/gZWlPC/_fSoW8mNx_5w/select/media/guid/2304981409/9000116517?mute=false&autoPlay=false&playbackStartPosition=0&policy=174233584&MVPDid=undefined&params=policy%3D174233584%26fallbackSiteSectionId%3D7006049%26siteSectionId%3Dcnbc_inline_vod%26manifest%3Dm3u%26switch%3DHLSServiceSecure%26_fw_ae%3Dundefined%26_fw_vcid2%3D264bc22f-8131-4ced-aa0b-25f79cae46da%26_fw_h_referer%3Dwww.cnbc.com%26schema%3D2.0%26csid%3Dcnbc_tveverywhere_vod_hub%26afid%3D137705375"

I'm on mobile but I'll check when I get home. Did you use my url or derive your own?

[jagabo]

I used your link to the web page in FireFox. Then Developer Tools to get the manifest.m3u link for youtube-dl.

[sufr3ak]

I used your link to the web page in FireFox. Then Developer Tools to get the manifest.m3u link for youtube-dl.

I was getting the url from dev tools in Windows and using the Linux version to download. I'll install the Win version a shot.

[sufr3ak]

I used your link to the web page in FireFox. Then Developer Tools to get the manifest.m3u link for youtube-dl.

I did the same thing and got the same result. I got a file, but the audio drops every other second or so.

[https @ 000001d487ca5d40] Cannot reuse HTTP connection for different host: vod-lf-oneapp-prd.akamaized.net:-1 != redirect.manifest.theplatform.com:-1
[hls @ 000001d48764ed80] keepalive request failed for 'https://redirect.manifest.theplatform.com/r/HNK2IC/tZref27rBHtV,neFYKrEsFVPO,zjc3pKNPMXIv,xk8YixrfZ_s j,l7axxkSPRvf8,0r_G4jp7_7r3/aHR0cHM6Ly92b2QtbGYtb25lYXBwLXByZC5ha2FtYWl6ZWQubm V0L3Byb2QvdmlkZW8vaEFOLzNqby85MDAwMTE2NTE3L29Oalp1 b01Nd3NwNWY1WjJyMFVtRy83ODMwa18xMDgwX2hscy9fMTg1NT AzNzIzNC0xXzAwNDMzLnRz?sid=0047a931-4b99-4c85-8d43-61b520a5e60a&policy=174233584&date=1629077164372&i p=<IP>&schema=1.0&cid=cb3caaee-f85a-4448-a3eb-54cdf23b7a4b&aid=2304981409&dur=2599021&sig=108cde 09b9c176a467c0347d564de65eeee05bda4120eb8bf9b9fb9e 6b6b6de6' with error: 'Invalid argument' when opening url, retrying with new connection

[jagabo]

I saw lots of non-linear DTS warnings while downloading but the resulting mp4 file plays without problems.

[sufr3ak]

I'm not sure what I'm doing different to get the same result.

Firefox, dev tools. Filtered to find the m3u8 links. There were 3.

Grabbed the link, opened cmd browsed to my ytdl directory.

YouTube-dl.exe --ffmpeg-location <PATH> "m3u8 url".

The only thing I think I have that could play a factor is my PiHole.

I can give it another shot disabling it.

[jagabo]

The "Mo Honey, Mo Problems-9000116517.mp4" file I got was about 2.5 GB, 1920x1080 AVC video, AAC audio. I didn't watch the entire video, just a few minutes here and there. But there were no problems with the audio or video I saw.

[sufr3ak]

The "Mo Honey, Mo Problems-9000116517.mp4" file I got was about 2.5 GB, 1920x1080 AVC video, AAC audio. I didn't watch the entire video, just a few minutes here and there. But there were no problems with the audio or video I saw.

So the first couple seconds, with an ad, work perfectly fine. Then the show starts and there are audio drops almost every other second.

I tried to handbrake it, and the audio didnt even play on the new version. I tried downloading from Windows and Linux, same result. Trying on a different device, off network.

[sufr3ak]

I tried with a different workstation.

1. Playing existing file, same audio drop out issue.
2. Attempted to download. Took many tries to find the right url. Kept getting the pre roll ad.
3. Tried it on my current network, resulted in a 1 GB file, which was still having the same issues.
4. Tried off network, got a 1 GB file, and same audio issue.
5. Had a friend try it, had the same file issues.

Not sure how to explain it, but the a/v during the brief ad beforehand are fine. Then it cuts black, VLC resizes and it starts the show with messed up audio

[jagabo]

I watched more of yesterday's download and there are some problems. Occasionally a few seconds of audio repeats, then the audio and video are out of sync for a while, eventually the video locks up for a few seconds and when it starts again the audio and video are in sync. I didn't hear any audio drop outs in the 10 or 15 minutes I watched.

I downloaded the video again with the exact same batch file I used yesterday. The new download is cleaner. In 10 minutes of viewing I didn't see any audio or video problems. I was probably using a VPN yesterday. That may have contributed to the problems in that download. Today I wasn't using a VPN when I downloaded and I saw no "non-linear DTS" warnings.

I don't get an ad at the start of the download, just a 5 second "You're watching NBC on demand" promo/logo. That might be because I have 10,000+ ad severs and tracking servers blocked in my hosts file.

[sufr3ak]

I watched more of yesterday's download and there are some problems. Occasionally a few seconds of audio repeats, then the audio and video are out of sync for a while, eventually the video locks up for a few seconds and when it starts again the audio and video are in sync. I didn't hear any audio drop outs in the 10 or 15 minutes I watched.

I downloaded the video again with the exact same batch file I used yesterday. The new download is cleaner. In 10 minutes of viewing I didn't see any audio or video problems. I was probably using a VPN yesterday. That may have contributed to the problems in that download. Today I wasn't using a VPN when I downloaded and I saw no "non-linear DTS" warnings.

I don't get an ad at the start of the download, just a 5 second "You're watching NBC on demand" promo/logo. That might be because I have 10,000+ ad severs and tracking servers blocked in my hosts file.

I thought that ad may be part of the video stream, but maybe it's part of the manifest. Any chance you can share how you picked the right url?

[jagabo]

Here's the first three minutes of the file I downloaded today. Trimmed with ffmpeg:

ffmpeg -i input.mp4 -t 180 -c copy start.mp4

[sufr3ak]

It plays perfectly. Any chance you can help me with how you picked the right stream url. Maybe that's my issue.

[october262]

try this - youtube-dl "https://player.theplatform.com/p/gZWlPC/_fSoW8mNx_5w/select/media/guid/2304981409/9000116517?mute=false&autoPlay=false&playbackStart Position=0&policy=174233584&MVPDid=undefined&param s=policy%3D174233584%26fallbackSiteSectionId%3D700 6049%26siteSectionId%3Dcnbc_inline_vod%26manifest% 3Dm3u%26switch%3DHLSServiceSecure%26_fw_ae%3Dundef ined%26_fw_vcid2%3Dda9d0cbf-0d6b-4ea0-9174-33850639567d%26_fw_h_referer%3Dwww.cnbc.com%26sche ma%3D2.0%26csid%3Dcnbc_tveverywhere_vod_hub%26afid %3D137705375"

[sufr3ak]

No dice

[ThePlatform] 9000116517: Downloading webpage
ERROR: Unable to download webpage: HTTP Error 500: Server Error (caused by HTTPError()); please report this issue on https://yt-dl.org/bug . Make sure you are using the latest version; type youtube-dl -U to update. Be sure to call youtube-dl with the --verbose flag and include its complete output.

[Whochain]

No dice

[ThePlatform] 9000116517: Downloading webpage
ERROR: Unable to download webpage: HTTP Error 500: Server Error (caused by HTTPError()); please report this issue on https://yt-dl.org/bug . Make sure you are using the latest version; type youtube-dl -U to update. Be sure to call youtube-dl with the --verbose flag and include its complete output.

did you remove the spaces in the link?

[october262]

No dice

[ThePlatform] 9000116517: Downloading webpage
ERROR: Unable to download webpage: HTTP Error 500: Server Error (caused by HTTPError()); please report this issue on https://yt-dl.org/bug . Make sure you are using the latest version; type youtube-dl -U to update. Be sure to call youtube-dl with the --verbose flag and include its complete output.

do you have ffmpeg installed ??

[jagabo]

Any chance you can help me with how you picked the right stream url. Maybe that's my issue.

I used a FireFox addon called HTTP Header Live. It lets you enter a list of strings to search for -- you'll only see URLs with those strings (manifest, master, m3u, hls, mp4, etc.). But you can use Developer Tools and its filter to do the same thing, one string at a time. Just search for "manifest" or "m3u" in this case. I only saw three entries. I used the first one.

Note that I also use Ublock Origin to block a lot of advertising, tracking, and malware web sites in FireFox. That may be why I only see 3 manifests.

[sufr3ak]

I downloaded with Linux and Windows. (Fixed the space issue)

Still the same sound issue

https://files.videohelp.com/u/300258/sample.mp4

[lfer94]

I downloaded with Linux and Windows. (Fixed the space issue)

Still the same sound issue

https://files.videohelp.com/u/300258/sample.mp4

add --hls-prefer-native

youtube-dl --hls-prefer-native "https://manifest.theplatform.com/xxx/etc" --no-part -o cbs.ts

I used IDM to get the direct link for 1080p and it worked, with no audio issue.

[sufr3ak]

I added the --hls-prefer-native and had the same result. I also tried '--no-part' with the same result.
I do see this error - [ffmpeg] Fixing malformed AAC bitstream in "Mo Honey, Mo Problems-9000116517.mp4" when using native

I tried saving directly to TS, same damn result.

I'm absolutely stumped. I don't think its related to my computer. I've tried 3 different computers. 2 Windows, 1 linux. I took a Windows one off network as well. Same result.

I've done it with and without pihole, ublock origin. Same url as others. Even had someone else check my file to confirm the same result. I presume the same has the same issue too.

[Namekuseijin]

try adding '--fixup warn'

[sufr3ak]

Same result. Just these errors, also like before

[https @ 0x67165c0] Cannot reuse HTTP connection for different host: vod-lf-oneapp-prd.akamaized.net:-1 != redirect.manifest.theplatform.com:-1
[hls @ 0x65b1e00] keepalive request failed for 'https://redirect.manifest.theplatform.com/r/HNK2IC/tZref27rBHtV,neFYKrEsFVPO,zjc3pKNPMXIv,xk8YixrfZ_s j,l7axxkSPRvf8,0r_G4jp7_7r3/aHR0cHM6Ly92b2QtbGYtb25lYXBwLXByZC5ha2FtYWl6ZWQubm V0L3Byb2QvdmlkZW8vaEFOLzNqby85MDAwMTE2NTE3L29Oalp1 b01Nd3NwNWY1WjJyMFVtRy83ODMwa18xMDgwX2hscy9fMTg1NT AzNzIzNC0xXzAwNDMyLnRz?sid=181dd141-3803-4c8a-b432-40de6bd3c17a&policy=174233584&date=1629210240068&i p=<IP>&schema=1.0&cid=91727bc3-6762-4953-b89b-c10bda95d134&aid=2304981409&dur=2599021&sig=93fff6 47fcf4083b6e56af6610a2a1aef19268df9949e5ec4a999cec d8fc6896' with error: 'Invalid argument' when opening url, retrying with new connection

[lfer94]

I added the --hls-prefer-native and had the same result. I also tried '--no-part' with the same result..

The --no-part option is only to avoid file corruption in case you want to interrupt a download, it shouldn't make a difference in this case.

Another thing you can do is run youtube-dl --rm-cache-dir, close the command prompt window and then try again, or move the youtube-dl.exe file to another directory.

[sufr3ak]

I just tried the next episode. Between the Network Inspector and The Stream Detector plugin, I had 11 different urls. 2 ended up being nothing (ads). The other 9 were all versions of the show, with glitchy audio.

They all start with a brief ad, then black screen, then VLC does a resize, and then the On Demand logo comes on. Audio either doesn't play or is glitchy, dropping every couple seconds.

I'm looking into my VPN options, as I don't use one to see if this is somehow region based. Almost all the URLs start with "https://east.manifest.na.theplatform...."

This is incredibly frustrating.

[jagabo]

I downloaded the video a third time (using the same batch file again, the m3u url still works) and ran a binary compare of the second and third downloads. They were byte-for-byte identical.

[sufr3ak]

I'm not disagreeing with your results. I just can't figure out why my download is botched. I've used the same url. i can't help but wonder if it is geo related