Any Help with error "Download first segment failed!"

[khaledgamil]

[Attachment 81349 - Click to enlarge]

I try to download this Video with N_m3u8DL-RE with link from python.
I have downloaded some files successfully before but they are not working now.

[SaLTy]

Try adding

--check-segments-count false

to your command? That's what I did when this happened to me.

[LZAA]

Url?

[2nHxWW6GkN1l916N3ayz8HQoi]

I try to download this Video with N_m3u8DL-RE with link from python.
I have downloaded some files successfully before but they are not working now.

The script isn't currently working because their servers are probably down. Try playing this link in your browser and see if it even loads. I get 403 in my end.
https://www.fifa.com/en/watch/2PPgztGTe9gXubqGkHaDoT

Unless you need an account?

Edit: seems like not even a free account helps

[khaledgamil]

https://www.fifa.com/en/watch/2PPgztGTe9gXubqGkHaDoT

Your Link is not working, but the link i tried to download is working.

https://www.fifa.com/en/watch/Uh0FqJlqKEIQqUBvJ97d3

[2nHxWW6GkN1l916N3ayz8HQoi]

Your Link is not working, but the link i tried to download is working.

Of course your link can be played since it uses another site (plus.fifa.com =/= fifa.com). I purposely picked a URL that fails at redirecting to other site since you don't want the version DRM from plus.fifa.com, but instead the DRM-free version from fifa.com

If you can't play in your browser something straight from fifa.com, how do you expect to be able to download something else from them?

[khaledgamil]

Url?

https://www.fifa.com/en/watch/Uh0FqJlqKEIQqUBvJ97d3

but this video have 2 files, 1 public and 1 hidden, the hidden version without logo i get it link with python.

N_m3u8DL-RE "https://content-aaps1.uplynk.com/preplay2/9a497a6ee69441c69371499105effbcc,7733a841e5ba45ffb 48b225aad4975e9,8cf14e3d244245f4addd5bbed48a343d/83bd9968abf999997f7ffc482d845b28/4yHZYbPvVvUM2TLDLiuegc3sONg2eV7jZIX3aaioxhVg.m3u8? pbs=3ae58aea88304a9894cc462289f1f136&mbtracks=1" --save-dir "fifa_com" --save-name "Italy_v_Brazil_Second_Round_1982_FIFA_World_Cup_S paintm_Full_Match_Replay"

[khaledgamil]

Of course your link can be played since it uses another site (plus.fifa.com =/= fifa.com). I purposely picked a URL that fails at redirecting to other site since you don't want the version DRM from plus.fifa.com, but instead the DRM-free version from fifa.com

If you can't play in your browser something straight from fifa.com, how do you expect to be able to download something else from them?

Does this mean that the problem is temporary from the FIFA website servers.

Ok i will try later.

[2nHxWW6GkN1l916N3ayz8HQoi]

Does this mean that the problem is temporary from the FIFA website servers.

Beats me. Maybe it's permanent and they're trying to migrate all content from fifa.com to plus.fifa.com . Who knows. Find multiple fifa.com links that don't redirect and regularly check them to see if they can be played. All I know is that if a site can't play any of its videos, then you can't download any of them.

[LZAA]

https://www.fifa.com/en/watch/2PPgztGTe9gXubqGkHaDoT

https://mega.nz/file/IbwUCAwL#sc3_iK2GQ4GKQstX3T1qZHIvfS9m9occQaq0x5eAfA0

The 'uplynk' server does not provide 'HLS' stream, but it does provide 'MPEG-DASH' stream (DRM).

[2nHxWW6GkN1l916N3ayz8HQoi]

The 'uplynk' server does not provide 'HLS' stream, but it does provide 'MPEG-DASH' stream (DRM).

You're right. By editing the ".m3u8" to ".mpd" you get a mpd file. That file contains everything DRM related: pssh and license with no headers needed. Apparently you need to edit out the logo intro manually. And even after that you need to do multiple license requests to get all the keys you need. I wonder if you could get multiple keys at once by editing the PSSH (?). Thanks for finding this @LZAA. It's gonna be interesting coding a solution for this.

A nice work-around until they fix their m3u8 content. And if this mpd fails now too, then most likely a dev of theirs is lurking around.

[khaledgamil]

The 'uplynk' server does not provide 'HLS' stream, but it does provide 'MPEG-DASH' stream (DRM).

You're right. By editing the ".m3u8" to ".mpd" you get a mpd file. That file contains everything DRM related: pssh and license with no headers needed. Apparently you need to edit out the logo intro manually. And even after that you need to do multiple license requests to get all the keys you need. I wonder if you could get multiple keys at once by editing the PSSH (?). Thanks for finding this @LZAA. It's gonna be interesting coding a solution for this.

A nice work-around until they fix their m3u8 content. And if this mpd fails now too, then most likely a dev of theirs is lurking around.

Just change .m3u8 to .mpd in the link exctrated from payton?!

[2nHxWW6GkN1l916N3ayz8HQoi]

Just change .m3u8 to .mpd in the link exctrated from payton?!

No, but it is one of the necessary steps. Just wait some days and I'm gonna write a script. Or if someone has free time, he can help you.

[LZAA]

You can get all the keys at once. For example:

'SUCCESS

License:https://content-aeui1.uplynk.com/wv?b=9a497a6ee69441c69371499105effbcc&v=9a497a6ee6944...8351621f64cf50

PSSH:AAAArXBzc2gAAAAA7e+LqXnWSs6jyCfc1R0h7QAAAI0SI DljMTlmOWFiODIzOTQzZjBhYzMyNmVlZjdjYTM4ZDZkEiAwNDU zZjVhMDA5MTY0ZGY4OGQzYWJhMzM1OTIzMDllMyJHOWE0OTdhN mVlNjk0NDFjNjkzNzE0OTkxMDVlZmZiY2NfYWV1aTFfNTQ3YTZ jYTAzMTQ3NDk0YThlODM1MTYyMWY2NGNmNTA=

Headers:{'user-agent': 'Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (Ktesttemp, like Gecko) Chrome/90.0.4430.85 Safari/537.36'}

Time:Sat Aug 10 04:44:27 2024

1.0453f5a009164df88d3aba33592309e3:d7e5065fa0e03c1 a6c03dab93ab86834
2.9c19f9ab823943f0ac326eef7ca38d6d:b63f9a404d1fbde 1b47abb5380c6a068'

But I don't see the point in this.

[khaledgamil]

Just change .m3u8 to .mpd in the link exctrated from payton?!

No, but it is one of the necessary steps. Just wait some days and I'm gonna write a script. Or if someone has free time, he can help you.

Ok, thx.

[2nHxWW6GkN1l916N3ayz8HQoi]

You can get all the keys at once. For example:

Hmm. Interesting. All of the PSSHs I tried just gave me 1 key. Gonna have to read more carefully the content of that mpd. Thanks for the tip.

But I don't see the point in this.

The point is that if you know how to download the content of a fifa.com link that doesn't redirect, you can do it in the same way for those links that do redirect to plus.fifa.com

For example, you found out how you can download from
https://www.fifa.com/en/watch/2PPgztGTe9gXubqGkHaDoT

by using the mpd trick.

Try to download now from
https://www.fifa.com/en/watch/Uh0FqJlqKEIQqUBvJ97d3

Problem is that it redirects you to plus.fifa.com. What is the difference between the videos? Not that much, except that one has the burnt in logo and the other doesn't. @khaled doesn't want the one from plus.fifa.com with the burnt logo in the corner. And fifa.com offers a hidden version that doesn't have that. Before, you could get that with the m3u8, but apparently you can only get it with the mpd which uses DRM. But the content is still different (no logo) which is a good thing, even if it uses DRM from that mpd.

[LZAA]

In 'Manifest.mpd' there is 'pssh' only for each stream separately.
For all stream at once 'pssh' will have to be created 'manually'.

[2nHxWW6GkN1l916N3ayz8HQoi]

I just decoded your pssh using the box decoder and I got multiple key ids. I have no idea how you managed to generate one. Well done. Even @angela's hell pack generates a pssh only from a single default kid. This problem gets even more interesting.

[ddll]

Try to download now from
https://www.fifa.com/en/watch/Uh0FqJlqKEIQqUBvJ97d3

--key 0180974b56c1d51f911a32add5d0e827:766601f890cea819bd5a4860b5380bea

[larley]

I'm not home, but I can say that you might want to look at PSSH.new() from pywidevine. You can specify a list of key ids there.
If there's more data, for example a quality level, then you're gonna have to use Protobuf with the in pywidevine included license_protocol file, specifically the WidevinePsshData message, which, after building can be dumped to bytes and passed into the init data field in PSSH.new()

[LZAA]

2nHxWW6GkN1l916N3ayz8HQoi

If you need it, I'll write how to do it.
But, I repeat, it's much faster to get the keys for the necessary streams, download and decrypt 'manually'.

[2nHxWW6GkN1l916N3ayz8HQoi]

I can say that you might want to look at PSSH.new() from pywidevine

There's definitely more needed than a simple kid. Whatever I generate with their kid, just gives 500. This is how one of their PSSH looks:

AAAAk3Bzc2gAAAAA7e+LqXnWSs6jyCfc1R0h7QAAAHMIARIgYzA3OGIyOWEyNGY1NDdjZWIyMTBkNTU1MTMxYTY5MTQaBHZkbXMiRzYzYTg3MTZkMDkxMTQ5YmFiZGU5YTg1NWVjMzcyM2VlX2FldWkxXzZiNGQ4MzBkOGU3ZDQ5NjZiNDk1ZGU3NDE1ZWU4YTk0

But is good to know about PSSH.new()

If you need it, I'll write how to do it.
But, I repeat, it's much faster to get the keys for the necessary streams, download and decrypt 'manually'.

If you don't mind, sure. I'd appreciate it. I could always just spam 5-6 license requests and call it a day. But it's always nice to see smarter solutions. Edit: I misread your comment. Yeah, I suppose it would be faster by doing that.

[larley]

I put your PSSH into the axinom decoder and it seems like it only contains one key id. Is that intended?

[2nHxWW6GkN1l916N3ayz8HQoi]

I put your PSSH into the axinom decoder and it seems like it only contains one key id. Is that intended?

Yep. As @LZAA mentioned

In 'Manifest.mpd' there is 'pssh' only for each stream separately.

I just put one to showcase what else it contained besides the key id. I think I found a possible solution though.

https://github.com/shaka-project/shaka-packager/blob/main/packager/tools/pssh/pssh-box.py

I use that neat piece of code, decode the pssh box, ignore everything that is key id, copy and paste it to your Pssh.new() suggestion and try it. The issue with .new() was that a key id wasn't the only piece of information necessary that is accepted by their license server. Look what else a pssh of theirs has:

  PSSH Data (size: 115):
    Widevine Data:
      Key IDs (1):
        63303738-6232-3961-3234-66353437636562323130643535353133316136393134
      Provider: vdms
      Content ID: 36336138373136643039313134396261626465396138353565633337323365655F61657569315F3662346438333064386537643439363662343935646537343135656538613934

[larley]

Oh, I misread your post. I thought the PSSH you posted was the one you generated.
But that's the original one, so the single key id is indeed intentional.
LZAA's PSSH also doesn't contain an Algorithm or Provider field, so you can leave that out

[2nHxWW6GkN1l916N3ayz8HQoi]

Huh. Even with the pssh_box script, you still need to make multiple requests. True, you could cut from 9 requests to only 3 license requests, but it's still not just 1. A shame. That PSSH needs to have the content_id, and that is unique according to the group (video/audio/logo). Fun fact @larley, even if you get all the keys for any possible track, N_m3u8DL-RE is still gonna fail decrypting if you don't manually cut out the logo from the manifest. Because the logo and video use 2 different sets of keys. It's similar to the crackle advert issue. Only now they're both encrypted but with different keys.

[larley]

So the logo is a different period, encrypted with different keys, and is then overlayed onto the video?
Is this 'logo' just an image?

[2nHxWW6GkN1l916N3ayz8HQoi]

You could check for yourself. Go to this
https://www.fifa.com/en/watch/2PPgztGTe9gXubqGkHaDoT

Filter for m3u8. Pick the first one. Copy url. Replace m3u8 with mpd, download and play with it. But yeah, it's on a different period. And it's a video.

[larley]

I'm just asking so much because I'm not home and can't check for myself. But, yes, I will when I do get home

[2nHxWW6GkN1l916N3ayz8HQoi]

Gotcha. Thanks for taking a look. The issue isn't getting the keys. It's just finding the most optimal way to do it. You could cut another request from the 3 ones offered by pssh_box if you'd just ignore the logo entirely. So you get to 2. The benefit to this is that if you let a script run wild for 1000+ videos from them, the fewer requests you do, the higher the chance it won't get stopped by some defence mechanism.

Edit: For example, for the previous link here are the 9 keys

0453f5a009164df88d3aba33592309e3:d7e5065fa0e03c1a6c03dab93ab86834
e8c4ffffee2140c8b58f89864c3d614a:3036c0ed27af8f70e5697f5fef1f046e
9c19f9ab823943f0ac326eef7ca38d6d:b63f9a404d1fbde1b47abb5380c6a068
e8e1f3172092441bb2f45650e6fdf81a:4dc2b4a90eb920bd8198e9484d2a0833
52335abbc1b0484f9288d305bd01ba86:badabc2110b7a05f8ff35764f084bbcf
c078b29a24f547ceb210d555131a6914:9f8f7c0c1db2b03344a47404e3fa7683
8a5dcb51f7264166857855f14c22cc12:0d649b35f5095bdce15eceb460b81d4c
c37e664ff7f04b42a499906c12db53ac:5f2412746308819b5acff0e33d0df820
8cdf9ed5304a4d4082ddb6aafb5b4cbb:a5c4b84e405e8ed0c940381440ad2c58

Obtained only with 3 license requests with the merged psshs:

AAAA1XBzc2gAAAAA7e+LqXnWSs6jyCfc1R0h7QAAALUSIDljMTlmOWFiODIzOTQzZjBhYzMyNmVlZjdjYTM4ZDZkEiAwNDUzZjVhMDA5MTY0ZGY4OGQzYWJhMzM1OTIzMDllMxIgZThjNGZmZmZlZTIxNDBjOGI1OGY4OTg2NGMzZDYxNGEaBHZkbXMiRzlhNDk3YTZlZTY5NDQxYzY5MzcxNDk5MTA1ZWZmYmNjX2FldWkxX2QxNGUxMTI2NzM4MjQxOTBiNzFlNWVhYzJkNzVhNmMy
AAAA1XBzc2gAAAAA7e+LqXnWSs6jyCfc1R0h7QAAALUSIGMwNzhiMjlhMjRmNTQ3Y2ViMjEwZDU1NTEzMWE2OTE0EiBlOGUxZjMxNzIwOTI0NDFiYjJmNDU2NTBlNmZkZjgxYRIgNTIzMzVhYmJjMWIwNDg0ZjkyODhkMzA1YmQwMWJhODYaBHZkbXMiRzYzYTg3MTZkMDkxMTQ5YmFiZGU5YTg1NWVjMzcyM2VlX2FldWkxX2QxNGUxMTI2NzM4MjQxOTBiNzFlNWVhYzJkNzVhNmMy
AAAA1XBzc2gAAAAA7e+LqXnWSs6jyCfc1R0h7QAAALUSIDhjZGY5ZWQ1MzA0YTRkNDA4MmRkYjZhYWZiNWI0Y2JiEiA4YTVkY2I1MWY3MjY0MTY2ODU3ODU1ZjE0YzIyY2MxMhIgYzM3ZTY2NGZmN2YwNGI0MmE0OTk5MDZjMTJkYjUzYWMaBHZkbXMiRzhjZjE0ZTNkMjQ0MjQ1ZjRhZGRkNWJiZWQ0OGEzNDNkX2FldWkxX2QxNGUxMTI2NzM4MjQxOTBiNzFlNWVhYzJkNzVhNmMy

All that remains is skipping the logo intro

Edit 2: Apparently 2 period nodes are tied to the logo. So only 3 keys are relevant. That's nice.