Downloading videos from sites that require login

[aruwin]

Hi guys!

I am trying to get the files from a website that requires login using youtube-dl.
I have access to that site.
I have been googling and found something about cookies but I don't understand how to get the extract the cookies string.
I opened the inspect element and clicked network to see if there were mp4 files where I can just directly download from.
So I found both the audio track and video track but unfortunately they're separated into two MP4 files.
I could get the both files to download but they are not playable as one is an MP4 with no audio (I can't even get the video itself to play) and even the audio was downloaded as an MP4 which I can't get it to play either.
So how can I get the correct command to download the video+audio as 1 complete file?


[Attachment 56638 - Click to enlarge]


[Attachment 56637 - Click to enlarge]

[notaghost]

https://i.stack.imgur.com/dAUAx.png

youtube-dl "https://cdn.dimsum.my/content/2020-05/45424-5eafd6fae89fb/manifest.mpd"

[aruwin]

https://i.stack.imgur.com/dAUAx.png

youtube-dl "https://cdn.dimsum.my/content/2020-05/45424-5eafd6fae89fb/manifest.mpd"

I tried using the URL here as shown in the Headers but I only copied up to "45469-5eb04a2bcd275", without including the "ACEIF01HM_MZ_07546ec9_identifier-6_video_track_0.mp4"

[Attachment 56642 - Click to enlarge]
And here's the error result I got.

[Attachment 56641 - Click to enlarge]

[aruwin]

I tries using the cookies workaround too.
It worked when I used the command line for the trailer which is accessible to the public but I got an error for the private videos.

I used this command line:
youtube-dl --cookies dimsum.my_cookies.txt "https://cdn.dimsum.my/content/2020-05/45469-5eb04a2bcd275/manifest.mpd"
pause
:end

And this is the result

[Attachment 56647 - Click to enlarge]

[jagabo]

Cookie contents are passed in the HTTP request header. You can get the text with Developer Tools are a header viewer like HTTP Header Live for FireFox.


[Attachment 56648 - Click to enlarge]

You can then use that cookie data with youtube-dl with the add-header switch:

youtube-dl --add-header "Cookie: bb_lastvisit..." "url"

[aruwin]

Cookie contents are passed in the HTTP request header. You can get the text with Developer Tools are a header viewer like HTTP Header Live for FireFox.


[Attachment 56648 - Click to enlarge]

You can then use that cookie data with youtube-dl with the add-header switch:

youtube-dl --add-header "Cookie: bb_lastvisit..." "url"

I tried the add header method but I got errors.

[Attachment 56653 - Click to enlarge]

[jagabo]

But there's no cookie data appearing?

That HTTP request appears to be for an ad, not the video you want to download.

But assuming the video you want is similar... did you try passing the referer?

youtube-dl --referer "https://www.dimsim.my/" "url"

[aruwin]

But there's no cookie data appearing?

That HTTP request appears to be for an ad, not the video you want to download.

But assuming the video you want is similar... did you try passing the referer?

youtube-dl --referer "https://www.dimsim.my/" "url"

No. So which one do I write first? The referer?

[aruwin]

Ok, I forgot to erase the -f before adding the referer , so that's why I got a URL error.
So I have corrected that and I still got an error.


[Attachment 56654 - Click to enlarge]

I think there's something wrong with the URL "https://cdn.dimsum.my/content/2020-05/45469-5eb04a2bcd275/manifest.mpd"
It's weird, though, because if I put the trailer URL instead, it would work totally fine. "https://cdn.dimsum.my/content/2020-05/45424-5eafd6fae89fb/manifest.mpd"
Maybe because the URL is a public video.
I used cookie.txt to get the cookie data in Netscape format and tried both the Trailer and the Full episodes, I got the same results: Trailer worked fine but not the public videos.
So I really think there's something missing in the URLs of the public videos.
Actually, the public video doesn't even need cookies.
I can also download the full episode video without cookies but I would only get a corrupted video without a sound like I mentioned in my first post.

[jagabo]

Youtube doesn't work with all mpd links. Streamlink got a little farther but didn't work either:

G:\Program Files\Streamlink>streamlink --http-header "Referer=https://www.dimsum/my/drama/thailand/series-1601?lang=en" "https://cdn.dimsum.my/content/2020-05/45469-5eb04a2bcd275/manifest.mpd" best -o output.ts
[Streamlink for Windows v1.4.1 - Git W/5f8f0]
[cli][info] Found matching plugin dash for URL https://cdn.dimsum.my/content/2020-05/45469-5eb04a2bcd275/manifest.mpd
[cli][info] Available streams: 234p+a68k (worst), 234p+a100k, 234p+a132k, 360p+a68k, 360p+a100k, 360p+a132k, 540p+a68k, 540p+a100k, 576p+a68k, 540p+a132k, 576p+a100k, 576p+a132k, 720p+a68k, 720p+a100k, 720p+a132k, 1080p+a68k, 1080p+a100k, 1080p+a132k (best)
[cli][info] Opening stream: 1080p+a132k (dash)
[cli][error] Try 1/1: Could not open stream <Stream()> (Could not open stream: cannot use FFMPEG)
error: Could not open stream <Stream()>, tried 1 times, exiting

You might check for other header elements that need to be passed. Some sites require more than just the referer. Sometimes they require the user-agent field and/or other data. --user-agent is used for the user agent. Custom elements require the form --add-header "field: data".

[notaghost]

...