Devine - Modular Movie, TV, and Music Archival Software

[elektro]

ConnectionError: Failed to request the M3U(8) document.

It doesn't get the M3U(8) file. I used this command:

devine dl iP https://www.bbc.co.uk/iplayer/episode/m0020sq7/glastonbury-orbital

VPN/proxy issue. The higher quality streams can be pretty restricted on iPlayer, so you need to find a proxy that works.

Damn, such a bad luck. Do you know other programs that can rip videos from BBC iPlayer with VPNs like Windscribe?

[keep_it_breezy]

ConnectionError: Failed to request the M3U(8) document.

It doesn't get the M3U(8) file. I used this command:

devine dl iP https://www.bbc.co.uk/iplayer/episode/m0020sq7/glastonbury-orbital

VPN/proxy issue. The higher quality streams can be pretty restricted on iPlayer, so you need to find a proxy that works.

Damn, such a bad luck. Do you know other programs that can rip videos from BBC iPlayer with VPNs like Windscribe?

Well if you have Windscribe, just try a different UK server until one works?

[SB47x]

Damn, such a bad luck. Do you know other programs that can rip videos from BBC iPlayer with VPNs like Windscribe?

The problem is that iPlayer is blocking you because it knows you're on a VPN. get_iplayer and yt-dlp will have the same problem.

Try different VPN servers, or a different VPN provider altogether.

[elektro]

ConnectionError: Failed to request the M3U(8) document.

It doesn't get the M3U(8) file. I used this command:

devine dl iP https://www.bbc.co.uk/iplayer/episode/m0020sq7/glastonbury-orbital

VPN/proxy issue. The higher quality streams can be pretty restricted on iPlayer, so you need to find a proxy that works.

Damn, such a bad luck. Do you know other programs that can rip videos from BBC iPlayer with VPNs like Windscribe?

Well if you have Windscribe, just try a different UK server until one works?

I tried and tried and I finally managed to make Devine work on my PC except one issue: it downloads both audio and video streams but it's stuck at the subtitles. Thankfully I managed to mux the A/V from the temp folder into an MKV file. I get this error:

Cannot extract Closed Captions as the ccextractor executable was not
     found...

and previously this error:

OSError: C:\Users\user\AppData\Local\Temp\devine\Subtitle_70cbc1_stripped.vtt is
not valid subtitle file: .vtt

I already installed ccextractor. How to make Devine detect it? Should I add ccextractor path to Windows's PATH Environment Variable? Also is there a parameter to skip downloading subtitles?

[keep_it_breezy]

ConnectionError: Failed to request the M3U(8) document.

It doesn't get the M3U(8) file. I used this command:

devine dl iP https://www.bbc.co.uk/iplayer/episode/m0020sq7/glastonbury-orbital

VPN/proxy issue. The higher quality streams can be pretty restricted on iPlayer, so you need to find a proxy that works.

Damn, such a bad luck. Do you know other programs that can rip videos from BBC iPlayer with VPNs like Windscribe?

Well if you have Windscribe, just try a different UK server until one works?

I tried and tried and I finally managed to make Devine work on my PC except one issue: it downloads both audio and video streams but it's stuck at the subtitles. Thankfully I managed to mux the A/V from the temp folder into an MKV file. I get this error:

Cannot extract Closed Captions as the ccextractor executable was not
     found...

and previously this error:

OSError: C:\Users\user\AppData\Local\Temp\devine\Subtitle_70cbc1_stripped.vtt is
not valid subtitle file: .vtt

I already installed ccextractor. How to make Devine detect it? Also is there a parameter to skip downloading subtitles?

Is ccextractor in your path? Devine looks on your path for the necessary files. Yes you can tell it to strip them no problem - if you just run "devine dl" it gives you all the command line switches you can use. To download just audio and video it will be -V -A.

e.g.

`devine dl -V -A iP https://www.bbc.co.uk/iplayer/episode/m0020sq7/glastonbury-orbital`

[elektro]

ConnectionError: Failed to request the M3U(8) document.

It doesn't get the M3U(8) file. I used this command:

devine dl iP https://www.bbc.co.uk/iplayer/episode/m0020sq7/glastonbury-orbital

VPN/proxy issue. The higher quality streams can be pretty restricted on iPlayer, so you need to find a proxy that works.

Damn, such a bad luck. Do you know other programs that can rip videos from BBC iPlayer with VPNs like Windscribe?

Well if you have Windscribe, just try a different UK server until one works?

I tried and tried and I finally managed to make Devine work on my PC except one issue: it downloads both audio and video streams but it's stuck at the subtitles. Thankfully I managed to mux the A/V from the temp folder into an MKV file. I get this error:

Cannot extract Closed Captions as the ccextractor executable was not
     found...

and previously this error:

OSError: C:\Users\user\AppData\Local\Temp\devine\Subtitle_70cbc1_stripped.vtt is
not valid subtitle file: .vtt

I already installed ccextractor. How to make Devine detect it? Also is there a parameter to skip downloading subtitles?

Is ccextractor in your path? Devine looks on your path for the necessary files. Yes you can tell it to strip them no problem - if you just run "devine dl" it gives you all the command line switches you can use. to download just audio and video it will be -V -A

No, it's not on my path. Thanks for help. And to everyone else who guided me.

[keep_it_breezy]

ConnectionError: Failed to request the M3U(8) document.

It doesn't get the M3U(8) file. I used this command:

devine dl iP https://www.bbc.co.uk/iplayer/episode/m0020sq7/glastonbury-orbital

VPN/proxy issue. The higher quality streams can be pretty restricted on iPlayer, so you need to find a proxy that works.

Damn, such a bad luck. Do you know other programs that can rip videos from BBC iPlayer with VPNs like Windscribe?

Well if you have Windscribe, just try a different UK server until one works?

I tried and tried and I finally managed to make Devine work on my PC except one issue: it downloads both audio and video streams but it's stuck at the subtitles. Thankfully I managed to mux the A/V from the temp folder into an MKV file. I get this error:

Cannot extract Closed Captions as the ccextractor executable was not
     found...

and previously this error:

OSError: C:\Users\user\AppData\Local\Temp\devine\Subtitle_70cbc1_stripped.vtt is
not valid subtitle file: .vtt

I already installed ccextractor. How to make Devine detect it? Also is there a parameter to skip downloading subtitles?

Is ccextractor in your path? Devine looks on your path for the necessary files. Yes you can tell it to strip them no problem - if you just run "devine dl" it gives you all the command line switches you can use. to download just audio and video it will be -V -A

No, it's not on my path. Thanks for help. And to everyone else who guided me.

No problem - hope you got it to work!

[pssh]

Trying to get the HDR-HLG versions of the Glasto 2024 Pyramid Stage that
the Beeb is now showing should be available,
but no luck for the HLG......

Did any got any luck?

devine dl --list-titles iP https://www.bbc.co.uk/iplayer/episode/p0j4x4tr/glastonbury-coldplay

  ─────────────────────────────── Service: iP ────────────────────────────────

     Service is not Geoblocked in your region

  ─────────────────────────── Series: Glastonbury ────────────────────────────

     1 Season, 1 Episode
     └── Season 0: 1 episodes
         └── 0. Coldplay

devine dl --list -v H.264 iP https://www.bbc.co.uk/iplayer/episode/p0j4x4tr/glastonbury-coldplay

  ─────────────────────── Glastonbury S00E00 Coldplay ────────────────────────

     ╭───────────────────────── Available Tracks ─────────────────────────╮
     │ 12 Videos                                                          │
     │ ├── [H.264, SDR] | en | 1920x1080 @ 12000 kb/s, 50.000 FPS         │
     │ ├── [H.264, SDR] | en | 1280x720 @ 5070 kb/s, 50.000 FPS           │
     │ ├── [H.264, SDR] | en | 960x540 @ 2812 kb/s, 50.000 FPS            │
     │ ├── [H.264, SDR] | en | 960x540 @ 1604 kb/s, 50.000 FPS            │
     │ ├── [H.264, SDR] | en | 704x396 @ 1570 kb/s, 50.000 FPS            │
     │ ├── [H.264, SDR] | en | 704x396 @ 827 kb/s, 25.000 FPS             │
     │ ├── [H.264, SDR] | en | 640x360 @ 688 kb/s, 25.000 FPS             │
     │ ├── [H.264, SDR] | en | 512x288 @ 437 kb/s, 25.000 FPS             │
     │ ├── [H.264, SDR] | en | 448x252 @ 436 kb/s, 25.000 FPS             │
     │ ├── [H.264, SDR] | en | 384x216 @ 281 kb/s, 25.000 FPS             │
     │ ├── [H.264, SDR] | en | 256x144 @ 156 kb/s, 25.000 FPS             │
     │ └── [H.264, SDR] | en | 192x108 @ 86 kb/s, 25.000 FPS              │
     │ 3 Audio                                                            │
     │ ├── [AAC] | en | 2.0 | 128 kb/s                                    │
     │ ├── [AAC] | en | 2.0 | 96 kb/s                                     │
     │ └── [AAC] | en | 2.0 | 48 kb/s                                     │
     ╰────────────────────────────────────────────────────────────────────╯
     Processed all titles in 0m1s

devine dl --list -v H.265 iP https://www.bbc.co.uk/iplayer/episode/p0j4x4tr/glastonbury-coldplay

No media found. If you're behind a VPN/proxy, you might be blocked

[keep_it_breezy]

Trying to get the HDR-HLG versions of the Glasto 2024 Pyramid Stage that
the Beeb is now showing should be available,
but no luck for the HLG......

Did any got any luck?

devine dl --list-titles iP https://www.bbc.co.uk/iplayer/episode/p0j4x4tr/glastonbury-coldplay

  ─────────────────────────────── Service: iP ────────────────────────────────

     Service is not Geoblocked in your region

  ─────────────────────────── Series: Glastonbury ────────────────────────────

     1 Season, 1 Episode
     └── Season 0: 1 episodes
         └── 0. Coldplay

devine dl --list -v H.264 iP https://www.bbc.co.uk/iplayer/episode/p0j4x4tr/glastonbury-coldplay

  ─────────────────────── Glastonbury S00E00 Coldplay ────────────────────────

     ╭───────────────────────── Available Tracks ─────────────────────────╮
     │ 12 Videos                                                          │
     │ ├── [H.264, SDR] | en | 1920x1080 @ 12000 kb/s, 50.000 FPS         │
     │ ├── [H.264, SDR] | en | 1280x720 @ 5070 kb/s, 50.000 FPS           │
     │ ├── [H.264, SDR] | en | 960x540 @ 2812 kb/s, 50.000 FPS            │
     │ ├── [H.264, SDR] | en | 960x540 @ 1604 kb/s, 50.000 FPS            │
     │ ├── [H.264, SDR] | en | 704x396 @ 1570 kb/s, 50.000 FPS            │
     │ ├── [H.264, SDR] | en | 704x396 @ 827 kb/s, 25.000 FPS             │
     │ ├── [H.264, SDR] | en | 640x360 @ 688 kb/s, 25.000 FPS             │
     │ ├── [H.264, SDR] | en | 512x288 @ 437 kb/s, 25.000 FPS             │
     │ ├── [H.264, SDR] | en | 448x252 @ 436 kb/s, 25.000 FPS             │
     │ ├── [H.264, SDR] | en | 384x216 @ 281 kb/s, 25.000 FPS             │
     │ ├── [H.264, SDR] | en | 256x144 @ 156 kb/s, 25.000 FPS             │
     │ └── [H.264, SDR] | en | 192x108 @ 86 kb/s, 25.000 FPS              │
     │ 3 Audio                                                            │
     │ ├── [AAC] | en | 2.0 | 128 kb/s                                    │
     │ ├── [AAC] | en | 2.0 | 96 kb/s                                     │
     │ └── [AAC] | en | 2.0 | 48 kb/s                                     │
     ╰────────────────────────────────────────────────────────────────────╯
     Processed all titles in 0m1s

devine dl --list -v H.265 iP https://www.bbc.co.uk/iplayer/episode/p0j4x4tr/glastonbury-coldplay

No media found. If you're behind a VPN/proxy, you might be blocked

I suspect it's a weird BBC quirk - as far as I'm aware they're constantly meddling round with formatting and such...

[pssh]

@keep_it_breezy:

Like all the big corp, they must have some sort of "working practice"

Cyndi does not even require sign in to watch ....
https://www.bbc.co.uk/events/e35wxj/play/ab43q9/p0j2wnx5

But .....

Cyndi Lauper at Glastonbury 2024
Full set: Watch on iPlayer
58:40
but unless it has been edited, video is only 37min ....
and the quality on Full set is 720p
(get_iplayer will source 1080p)



Anyone knows if the Beeb has used/uses 8K equipment and then downscale to 4K/FHD ....?

Well protected camera ....
https://www.bbc.co.uk/news/articles/cgxq84j5zwwo

[stabbedbybrick]

Trying to get the HDR-HLG versions of the Glasto 2024 Pyramid Stage that
the Beeb is now showing should be available,
but no luck for the HLG......

Did any got any luck?

devine dl --list -v H.265 iP https://www.bbc.co.uk/iplayer/episode/p0j4x4tr/glastonbury-coldplay

No media found. If you're behind a VPN/proxy, you might be blocked

The current endpoint for UHD doesn't return any results, unfortunately. I have seen UHD releases of Glastonbury 2024 out in the wild, but the originals are in .ts format, which might suggest they were grabbed from the actual live session. I can't seem to find any concrete confirmation that the catch-up streams are available in 4k.

[pssh]

Strange as Beeb claims in
Full list of Ultra HD programmes:
https://www.bbc.co.uk/iplayer/help/questions/programme-availability/uhd-content
that "Glastonbury 2024 - Select performances from the Pyramid Stage"
https://www.bbc.co.uk/iplayer/episodes/b007r6vx/glastonbury
is available (for 30 days)....


Can perhaps the iPlayer APP (Android or other) be emulated in VM to check if it offers UHD content/streams from Glasto?

[stabbedbybrick]

Can perhaps the iPlayer APP (Android or other) be emulated in VM to check if it offers UHD content/streams from Glasto?

Only selected devices support UHD, and the mobile apps aren't one of those as far as I know. You'd most likely need to inspect the traffic from an actual device. If anyone here have the setup and is willing to do the dirty work and look into it, I'd be happy to adjust the service if possible.

The current endpoint is pretty damn old at this point, and I have been wondering for how long it'll last. There might be other, newer alternatives I'm just not aware of and this one is being phased out. But considering not even the top private trackers have any proper 2160p WEB-DL's yet, I suspect it's just not available as on-demand/catch-up.

[PSXman_uk]

Can perhaps the iPlayer APP (Android or other) be emulated in VM to check if it offers UHD content/streams from Glasto?

Only selected devices support UHD, and the mobile apps aren't one of those as far as I know. You'd most likely need to inspect the traffic from an actual device. If anyone here have the setup and is willing to do the dirty work and look into it, I'd be happy to adjust the service if possible.

The current endpoint is pretty damn old at this point, and I have been wondering for how long it'll last. There might be other, newer alternatives I'm just not aware of and this one is being phased out. But considering not even the top private trackers have any proper 2160p WEB-DL's yet, I suspect it's just not available as on-demand/catch-up.

https://sharemania.us/threads/dua-lipa-live-glastonbury-2024-web-dl-uhd-hdr-hlg-h265-2.../#post-5760971

[stabbedbybrick]

https://sharemania.us/threads/dua-lipa-live-glastonbury-2024-web-dl-uhd-hdr-hlg-h265-2.../#post-5760971

Yeah, that's the .ts I was referring to earlier. I'm 90% sure it's from a livestream and not sourced from on-demand. I'd be happy to be proven wrong, though.

[pssh]

Can perhaps the iPlayer APP (Android or other) be emulated in VM to check if it offers UHD content/streams from Glasto?

Only selected devices support UHD, and the mobile apps aren't one of those as far as I know. You'd most likely need to inspect the traffic from an actual device. If anyone here have the setup and is willing to do the dirty work and look into it, I'd be happy to adjust the service if possible.

How about the "supported TV" iPlayer APPs
https://www.bbc.co.uk/iplayer/help/questions/supported-devices/certified-tv-check
is it possible to emulate them in VM or Android Studio, etc.?

[stabbedbybrick]

How about the "supported TV" iPlayer APPs
https://www.bbc.co.uk/iplayer/help/questions/supported-devices/certified-tv-check
is it possible to emulate them in VM or Android Studio, etc.?

I'm not gonna say no for certain, but probably not. If you can find an .apk meant for a supported device, it might be possible? Unless they perform some device checks. You could always give it a try.

[pssh]

Wimbledon cameras look to have quite large camera lens

(+) Video --vid=1 (*) (hevc 3840x2160 200.000fps) (24000 kbps)
Video --vid=2 (*) (hevc 2560x1440 200.000fps) (14000 kbps)
Video --vid=3 (*) (hevc 1920x1080 200.000fps) (10000 kbps)
Video --vid=4 (*) (hevc 1280x720 200.000fps) (7000 kbps)
Video --vid=5 (*) (hevc 960x540 200.000fps) (5500 kbps)
Video --vid=6 (*) (hevc 960x540 200.000fps) (2810 kbps)
Video --vid=7 (*) (hevc 960x540) (1600 kbps)
(+) Audio --aid=1 --alang=en (*) (aac 2ch 48000Hz) (192 kbps)

[Attachment 80378 - Click to enlarge]
200 FPS


then the ones showing at Glastonbury ....
https://www.bbc.co.uk/news/articles/cgxq84j5zwwo

[Attachment 80380 - Click to enlarge]

[keep_it_breezy]

@keep_it_breezy:

Like all the big corp, they must have some sort of "working practice"

Cyndi does not even require sign in to watch ....
https://www.bbc.co.uk/events/e35wxj/play/ab43q9/p0j2wnx5

But .....

Cyndi Lauper at Glastonbury 2024
Full set: Watch on iPlayer
58:40
but unless it has been edited, video is only 37min ....
and the quality on Full set is 720p
(get_iplayer will source 1080p)



Anyone knows if the Beeb has used/uses 8K equipment and then downscale to 4K/FHD ....?

Well protected camera ....
https://www.bbc.co.uk/news/articles/cgxq84j5zwwo

No idea r.e. what BBC is doing on their endpoints, but I do know that yes they film in 8K often - many places do and their raw files are probably enormous. That being said I don't know what they use for what shows - obviously it wll differ.

[pssh]

So it's the Beeb at fault that the prices of storage are so high and not the AI
Where are the days when you could pick up storage device for £14.44/TB

[keep_it_breezy]

So it's the Beeb at fault that the prices of storage are so high and not the AI
Where are the days when you could pick up storage device for £14.44/TB

Na it's not really the storage that they're bothered about price wise - it's the bandwidth costs .

Woops sorry misread you there. I'd look more at Youtube for using up all the storage hardware really!

[T33V33]

https://sharemania.us/threads/dua-lipa-live-glastonbury-2024-web-dl-uhd-hdr-hlg-h265-2.../#post-5760971

Yeah, that's the .ts I was referring to earlier. I'm 90% sure it's from a livestream and not sourced from on-demand. I'd be happy to be proven wrong, though.

You are certainly correct that the .ts is a recording of the live stream (you can tell from the screen shots as it has her name in the top right corner and no BBC logo top left)

However, it does look like there is a 2160p stream available on-demand too

2024-07-02 18:33:01 [I] iP: Episode: Glastonbury - S01E03 - Dua Lipa [p0j4wqsy]
2024-07-02 18:33:02 [I] iP: > All Tracks (S01E03):
2024-07-02 18:33:02 [I] Tracks: Videos (13):
2024-07-02 18:33:02 [I] Tracks: ├─ VID | MPD | [H.265, HLG, 2160p] | 3840x2160 @ 21309 kb/s, 25.000 FPS | 14.34 GiB | Unencrypted
2024-07-02 18:33:02 [I] Tracks: ├─ VID | MPD | [H.265, HLG, 1440p] | 3200x1800 @ 15565 kb/s, 25.000 FPS | 10.48 GiB | Unencrypted
2024-07-02 18:33:02 [I] Tracks: ├─ VID | MPD | [H.265, HLG, 1440p] | 2560x1440 @ 9989 kb/s, 25.000 FPS | 6.72 GiB | Unencrypted
2024-07-02 18:33:02 [I] Tracks: ├─ VID | MPD | [H.265, HLG, 1080p] | 1920x1080 @ 7860 kb/s, 25.000 FPS | 5.29 GiB | Unencrypted

Can perhaps the iPlayer APP (Android or other) be emulated in VM to check if it offers UHD content/streams from Glasto?

Having checked I found only a handful avaliable in 2160p

[stabbedbybrick]

However, it does look like there is a 2160p stream available on-demand too

2024-07-02 18:33:01 [I] iP: Episode: Glastonbury - S01E03 - Dua Lipa [p0j4wqsy]
2024-07-02 18:33:02 [I] iP: > All Tracks (S01E03):
2024-07-02 18:33:02 [I] Tracks: Videos (13):
2024-07-02 18:33:02 [I] Tracks: ├─ VID | MPD | [H.265, HLG, 2160p] | 3840x2160 @ 21309 kb/s, 25.000 FPS | 14.34 GiB | Unencrypted
2024-07-02 18:33:02 [I] Tracks: ├─ VID | MPD | [H.265, HLG, 1440p] | 3200x1800 @ 15565 kb/s, 25.000 FPS | 10.48 GiB | Unencrypted
2024-07-02 18:33:02 [I] Tracks: ├─ VID | MPD | [H.265, HLG, 1440p] | 2560x1440 @ 9989 kb/s, 25.000 FPS | 6.72 GiB | Unencrypted
2024-07-02 18:33:02 [I] Tracks: ├─ VID | MPD | [H.265, HLG, 1080p] | 1920x1080 @ 7860 kb/s, 25.000 FPS | 5.29 GiB | Unencrypted

Interesting. So it does seem like the current service I have for it is pretty outdated then. Which kind of makes sense given how old the source code is.

Thanks for the info! At least now we know it's not a wasted effort to try and update this thing.

[pssh]

Can perhaps the iPlayer APP (Android or other) be emulated in VM to check if it offers UHD content/streams from Glasto?

Having checked I found only a handful avaliable in 2160p

What tool is it that you are using?

[LastResort]

Hi Chaps,

Quick question, Does anyone know if Turner Classic is supported please....

[keep_it_breezy]

Hi Chaps,

Quick question, Does anyone know if Turner Classic is supported please....

Not that I've seen - though you can certainly write a service for it, if you fancy getting your python on

[stabbedbybrick]

All right, I figured out the missing UHD:


[Attachment 80387 - Click to enlarge]

Now I just got to figure out how to properly name things for iPlayer. Devine requires episode and season numbers for everything that isn't a movie, which really messes things up when there aren't any. And I just can't seem to find a consistent way to deal with the horrific listings on iPlayer. If anyone has any ideas, I'm all ears.

I'll make an effort to rewrite and improve the service code when I get some time.

[2nHxWW6GkN1l916N3ayz8HQoi]

Now I just got to figure out how to properly name things for iPlayer. Devine requires episode and season numbers for everything that isn't a movie, which really messes things up when there aren't any.

I may be talking nonsense here but what happens if you declare that dua lipa concert as a movie? Bad naming?

[stabbedbybrick]

Now I just got to figure out how to properly name things for iPlayer. Devine requires episode and season numbers for everything that isn't a movie, which really messes things up when there aren't any.

I may be talking nonsense here but what happens if you declare that dua lipa concert as a movie? Bad naming?

Not nonsense at all, you can technically return episodes as movies. The main problem is that Devine is using Series and Movies objects to list titles. When listing series, you request the proper data from the API and create Episode objects and feed it to Series, which will then list everything nicely formatted and make it possible to request specific episodes like "S01E01" etc. If the user is accessing an episode by its URL directly, it's easy to make it a Movie object and return it as such. But if they're accessing the episode through the series URL, it needs to be an Episode with proper labels. And you really want that to work properly so users can request multiple seasons/episodes at once.

I don't know if I'm making any sense. But in short, you want episodes to have proper numbers in order to be requested with the "-w" flag.

[2nHxWW6GkN1l916N3ayz8HQoi]

I don't know if I'm making any sense. But in short, you want episodes to have proper numbers in order to be requested with the "-w" flag.

I think I understand. I was under the assumption that concert was from a simple video URL, not from a series URL. So the issue is that the series isn't properly structured with episode indexes in their backend data structures, right?