Devine - Modular Movie, TV, and Music Archival Software

[Kaba]

Is possible, somebody can help me with xxxx. I tried to understand the example service, but no luck so far.
Will be fine, if somebody has an example or hints.

[LastResort]

How far have you already got--??










.

[Kaba]

ALL4 is working, so general understand the function.

I edit the devine.yaml, cookies and change service to de.

*deleted*

[peterb999]

Isn't Amazon a paid for service and therefore shouldn't be discussed on this forum?

[LastResort]

.









.

[Baldrick]

Please don't discuss amazon here. They will shutdown my site.

[Kaba]

Please don't discuss amazon here. They will shutdown my site.

I have delete my post to respect your wish.
It works, with only a little modification.

[PSXman_uk]

Please don't discuss amazon here. They will shutdown my site.

I have delete my post to respect your wish.
It works, with only a little modification.

Excellent

[grzech67]

C:\Users\grzech67\AppData\Local\devine>devine dl -w S01E01 ALL4 helsinki-crimes

/ __ \/ ____/ | / / _/ | / / ____/
/ / / / __/ | | / // // |/ / __/
/ /_/ / /___ | |/ // // /| / /___
/_____/_____/ |___/___/_/ |_/_____/
⠀
v3.3.2 Copyright © 2019-2024 rlaphoenix
https://github.com/devine-dl/devine

Service Config loaded
Loaded Cdm Widevine CDM: 4464 (L3)
Loaded 1 Vaults

────────────────────────────── Service: ALL4 ───────────────────────────────

Service is Geoblocked in your region, getting a Proxy to gb
┌───────────────────── Traceback (most recent call last) ──────────────────────┐
│ in _run_module_as_main:198 │
│ in _run_code:88 │
│ │
│ in <module>:7 │
│ │
│ C:\Users\grzech67\AppData\Local\Packages\PythonSof twareFoundation.Python.3.1 │
│ 2_qbz5n2kfra8p0\LocalCache\local-packages\Python312\site-packages\click\core │
│ .py:1157 in __call__ │
│ │
│ C:\Users\grzech67\AppData\Local\Packages\PythonSof twareFoundation.Python.3.1 │
│ 2_qbz5n2kfra8p0\LocalCache\local-packages\Python312\site-packages\click\core │
│ .py:1078 in main │
│ │
│ C:\Users\grzech67\AppData\Local\Packages\PythonSof twareFoundation.Python.3.1 │
│ 2_qbz5n2kfra8p0\LocalCache\local-packages\Python312\site-packages\click\core │
│ .py:1688 in invoke │
│ │
│ C:\Users\grzech67\AppData\Local\Packages\PythonSof twareFoundation.Python.3.1 │
│ 2_qbz5n2kfra8p0\LocalCache\local-packages\Python312\site-packages\click\core │
│ .py:1688 in invoke │
│ │
│ C:\Users\grzech67\AppData\Local\Packages\PythonSof twareFoundation.Python.3.1 │
│ 2_qbz5n2kfra8p0\LocalCache\local-packages\Python312\site-packages\click\core │
│ .py:1657 in _process_result │
│ │
│ C:\Users\grzech67\AppData\Local\Packages\PythonSof twareFoundation.Python.3.1 │
│ 2_qbz5n2kfra8p0\LocalCache\local-packages\Python312\site-packages\click\core │
│ .py:783 in invoke │
│ │
│ C:\Users\grzech67\AppData\Local\Packages\PythonSof twareFoundation.Python.3.1 │
│ 2_qbz5n2kfra8p0\LocalCache\local-packages\Python312\site-packages\devine\com │
│ mands\dl.py:295 in result │
│ │
│ 292 │ │ with console.status("Authenticating with Service...", spinner= │
│ 293 │ │ │ cookies = self.get_cookie_jar(self.service, self.profile) │
│ 294 │ │ │ credential = self.get_credentials(self.service, self.profi │
│ > 295 │ │ │ service.authenticate(cookies, credential) │
│ 296 │ │ │ if cookies or credential: │
│ 297 │ │ │ │ self.log.info("Authenticated with Service") │
│ 298 │
│ │
│ C:\Users\grzech67\AppData\Local\devine\services\AL L4\__init__.py:79 in │
│ authenticate │
│ │
│ 76 │ def authenticate(self, cookies: Optional[MozillaCookieJar] = None, │
│ 77 │ │ super().authenticate(cookies, credential) │
│ 78 │ │ if not credential: │
│ > 79 │ │ │ raise EnvironmentError("Service requires Credentials for A │
│ 80 │ │ │
│ 81 │ │ cache = self.cache.get(f"tokens_{credential.sha1}") │
│ 82 │
└───────────────────────────────────────────────── ─────────────────────────────┘
OSError: Service requires Credentials for Authentication.

C:\Users\grzech67\AppData\Local\devine>

How to make "Credentials for Authentication"
I have login details for ALL4 entered in the yaml file like "Credentials:
ALL4: xxxx@gmail.comassword

[stabbedbybrick]

C:\Users\grzech67\AppData\Local\devine>devine dl -w S01E01 ALL4 helsinki-crimes

OSError: Service requires Credentials for Authentication.

C:\Users\grzech67\AppData\Local\devine>

How to make "Credentials for Authentication"
I have login details for ALL4 entered in the yaml file like "Credentials:
ALL4: xxxx@gmail.comassword

User lowercase for "credentials":

credentials:
  ALL4: username:password

If it still doesn't work, then your config is badly formatted. Use a proper code editor like vscode or similar and make sure everything is indented properly. Don't use a regular text editor.

[billybanana]

I can't get the BBC certificate to work for 4K. I have the file saved and referenced in my devine.yaml as below:

services:
    iP:
        cert: D:\Downloads\Devine\certs\bbciplayer.pem

Receive the below error with or without proxy and/or VPN, so not sure what I'm doing wrong.

SSLError: HTTPSConnectionPool(host='securegate.iplayer.bbc.co.uk', port=443):
Max retries exceeded with url:
/mediaselector/6/select/version/2.0/vpid/m001yssk/format/json/mediaset/iptv-all/
proto/https (Caused by SSLError(SSLError(524297, '[SSL] PEM lib
(_ssl.c:3896)')))

[stabbedbybrick]

I can't get the BBC certificate to work for 4K. I have the file saved and referenced in my devine.yaml as below:

services:
    iP:
        cert: D:\Downloads\Devine\certs\bbciplayer.pem

Receive the below error with or without proxy and/or VPN, so not sure what I'm doing wrong.

SSLError: HTTPSConnectionPool(host='securegate.iplayer.bbc.co.uk', port=443):
Max retries exceeded with url:
/mediaselector/6/select/version/2.0/vpid/m001yssk/format/json/mediaset/iptv-all/
proto/https (Caused by SSLError(SSLError(524297, '[SSL] PEM lib
(_ssl.c:3896)')))

Did it work at one point and then stopped working, or did it never work at all? Can you provide the episode/series URL?

SSL errors can be confusing, but the "[SSL] PEM lib" message could indicate an invalid cert file, but it's hard to say.

[billybanana]

Did it work at one point and then stopped working, or did it never work at all? Can you provide the episode/series URL?

Never worked for me at all. Was using this series as an example:
https://www.bbc.co.uk/iplayer/episodes/m001xxn5/mammals

The cert I grabbed from the vinetrimmer github as has been linked a few times in recent months, so should be ok.

[iamghost]

work fine on my side

[Attachment 78820 - Click to enlarge]
make sure pem file like that

-----BEGIN CERTIFICATE-----
bla.bla...
-----END CERTIFICATE-----
-----BEGIN PRIVATE KEY-----
bla..bla...
-----END PRIVATE KEY-----

[billybanana]

work fine on my side

[Attachment 78820 - Click to enlarge]
make sure pem file like that

-----BEGIN CERTIFICATE-----
bla.bla...
-----END CERTIFICATE-----
-----BEGIN PRIVATE KEY-----
bla..bla...
-----END PRIVATE KEY-----

Mmm interesting there is no private key in this file.
https://github.com/sdhtele/VT/blob/main/vinetrimmer/certs/bbciplayer.pem

I assume this is the missing bit. Anyone care to share the full cert with my via PM ?

[stabbedbybrick]

Mmm interesting there is no private key in this file.
https://github.com/sdhtele/VT/blob/main/vinetrimmer/certs/bbciplayer.pem

I assume this is the missing bit. Anyone care to share the full cert with my via PM ?

Looks like he removed the private key from the cert: https://github.com/sdhtele/VT/commit/917ab971afa5a4477fe522dbba79dc7a790146f1

[billybanana]

Ah thanks Detective stabby ! I've updated the cert but I still get the same error, so I dunno.

[iamghost]

work fine on my side

[Attachment 78820 - Click to enlarge]
make sure pem file like that

-----BEGIN CERTIFICATE-----
bla.bla...
-----END CERTIFICATE-----
-----BEGIN PRIVATE KEY-----
bla..bla...
-----END PRIVATE KEY-----

Mmm interesting there is no private key in this file.
https://github.com/sdhtele/VT/blob/main/vinetrimmer/certs/bbciplayer.pem

I assume this is the missing bit. Anyone care to share the full cert with my via PM ?

Pem file in your pm

[pssh]

The correct cert is in the commit 18f0e65 3 years ago, and has been in the commit 917ab97 2 months ago made unusable (part of it deleted) .......

Also:
"If" I was "in" politics ........ has a complete guide ..... Devine + YAML ....



(All the command are executed in Power Shell (WinKey+x + i)
#Mammals - Series - with using the series PID (m001xxn5) or URL
------------------
https://www.bbc.co.uk/programmes/m001xxn5
https://www.bbc.co.uk/iplayer/episodes/m001xxn5/mammals

#List the Titles
devine dl --list-titles iP m001xxn5

#List Trailer - FHD
devine dl -v H.264 --list -w s00e00 iP m001xxn5

#List Trailer - UHD (Comes up with error ... no UHD version)
devine dl -v H.265 --list -w s00e00 iP m001xxn5
devine dl -v H.265 iP https://www.bbc.co.uk/iplayer/episode/p0hgjxtb/mammals-trailer-mammals

#S00E00

devine dl --list -w S00E00 iP m001xxn5

#1080p h.264@50fps - MP4 - Change TTML to SRT for MKV Mux
devine dl -q 1080 -v H.264 --no-folder --sub-format TTML -w s00e00 iP m001xxn5

#396p h.264@50fps - MKV
devine dl  -q 396 -v H.264 -w S00E00 --no-folder --sub-format SRT iP m001xxn5

#S01E01
https://www.bbc.co.uk/iplayer/episode/m001xxn3/mammals-series-1-1-dark

devine dl --list -w S01E01 iP m001xxn5
devine dl --list -v H.265 -w S01E01 iP m001xxn5
devine dl -v H.265 -w S01E01 --no-folder --sub-format TTML iP m001xxn5
#or
devine dl -v H.265 iP https://www.bbc.co.uk/iplayer/episode/m001xxn3/mammals-series-1-1-dark

#S01E02
https://www.bbc.co.uk/iplayer/episode/m001y4f2/mammals-series-1-2-the-new-wild

devine dl --list -w S01E02 iP m001xxn5
devine dl --list -v H.265 -w S01E02 iP m001xxn5
devine dl -v H.265 -w S01E02 --no-folder --sub-format TTML iP m001xxn5

#or

devine dl -v H.265 iP https://www.bbc.co.uk/iplayer/episode/m001y4f2/mammals-series-1-2-the-new-wild

#S01E03
https://www.bbc.co.uk/iplayer/episode/m001ybq9/mammals-series-1-3-water

devine dl --list -w S01E03 iP m001xxn5
devine dl --list -v H.265 -w S01E0 iP m001xxn5
devine dl -v H.265 -w S01E03 --no-folder iP m001xxn5
#or, so it muxes into a MKV container
devine dl -v H.265 -w S01E03 --no-folder --sub-format SRT iP m001xxn5

#S01E04
https://www.bbc.co.uk/iplayer/episode/m001ykh8/mammals-series-1-4-cold
py -3.10 -m poetry run devine dl --list-titles iP m001xxn5
py -3.10 -m poetry run devine dl --list -w S01E04 iP m001xxn5
py -3.10 -m poetry run devine dl --list -v H.265 -w S01E04 iP m001xxn5
#To make sure it does not MUX to MKV (SUB=TTML)
py -3.10 -m poetry run devine dl -v H.265 -w S01E04 --no-folder --sub-format TTML iP m001xxn5

#S01E05 UHD
https://www.bbc.co.uk/iplayer/episode/m001yssm/mammals-series-1-5-heat
devine dl --list -v H.265 -w S01E05 iP m001xxn5
devine dl -v H.265 -w S01E05 --no-folder --sub-format TTML iP m001xxn5

If you have the cert in PATH and in devine.YAML and still does not work,
I have also noticed when copy/pasting the config,
that sometimes there is a "white space" after the end of the word/command
so just check that there is "NOT" spaces at the end of "ALL" the words/commands
in the "devine.yaml" config.


Also, if you try Dynasties PID (p06mvmmr)

There are two Specials in each Season,
this is how i manged to get them
(there may be a different way, but it worked for me)

#Check SERIES

devine dl --list-titles iP p06mvmmr

# Check SPECIALS are available in UHD

devine dl --list -v H.265 -w S00E00 iP p06mvmmr

#Download SPECIALS
devine dl -v H.265 --downloads 3 --no-folder --sub-format TTML iP https://www.bbc.co.uk/iplayer/episode/m000qqv5/dynasties-meerkat-a-dynasties-special
devine dl -v H.265 --downloads 3 --no-folder --sub-format TTML iP https://www.bbc.co.uk/iplayer/episode/m001gp02/dynasties-macaque-monkeys-in-the-mountains-a-dynasties-special

#Download the Season 1
devine dl -v H.265 -w S01E01 --downloads 3 --no-folder --sub-format TTML iP p06mvmmr
devine dl -v H.265 -w S01E02 --downloads 3 --no-folder --sub-format TTML iP p06mvmmr
devine dl -v H.265 -w S01E03 --downloads 3 --no-folder --sub-format TTML iP p06mvmmr
devine dl -v H.265 -w S01E04 --downloads 3 --no-folder --sub-format TTML iP p06mvmmr
devine dl -v H.265 -w S01E05 --downloads 3 --no-folder --sub-format TTML iP p06mvmmr


#Download the Season 2
devine dl -v H.265 -w S02E01 --downloads 3 --no-folder --sub-format TTML iP p06mvmmr
devine dl -v H.265 -w S02E02 --downloads 3 --no-folder --sub-format TTML iP p06mvmmr
devine dl -v H.265 -w S02E03 --downloads 3 --no-folder --sub-format TTML iP p06mvmmr
devine dl -v H.265 -w S02E04 --downloads 3 --no-folder --sub-format TTML iP p06mvmmr

And here to convert TTML to SRT and join all together in PS "`", for CMD you need to end each line with "^"

#List the files
ls $home\AppData\Local\Temp\devine\

#SUBS converting:
tt convert -i $home\AppData\Local\Temp\devine\Subtitle_31f0fd.ttml -o $home\AppData\Local\Temp\devine\Subtitle_31f0fd.srt

#PS Command:
ffmpeg -hide_banner `
-i $home\AppData\Local\Temp\devine\Video_c20e72d1.mp4 `
-i $home\AppData\Local\Temp\devine\Audio_31934796.mp4 `
-i $home\AppData\Local\Temp\devine\Subtitle_31f0fd.srt `
-strict experimental `
-map 0 -map 1 -map 2 `
-c:v copy `
-c:a copy `
-c:s mov_text `
-c:d copy `
-map_metadata 0 `
-metadata title="Dynasties Series 2: 4. Hyena" `
-metadata description="A spotted hyena queen, raising her family on the unforgiving grasslands of Zambia’s Liuwa Plain, struggles to keep her grip on power as a young rival emerges." `
-metadata comment="https://www.bbc.co.uk/iplayer/episode/m0016ckz/dynasties-series-2-4-hyena" `
-metadata year="2022" `
-metadata:s:v:0 language=und -metadata:s:v:0 handler_name=Und -metadata:s:v:0 title="2160p | h265 - HDR HLG | 25FPS" `
-metadata:s:a:0 language=eng -metadata:s:a:0 handler_name=English -metadata:s:a:0 title="eng | English AAC LC 2.0 (Stereo) fltp, 189 kb/s (default)" `
-metadata:s:s:0 language=eng -metadata:s:s:0 handler_name=English -metadata:s:s:0 title="eng | English SRT" `
-f mp4 -movflags use_metadata_tags `
-ignore_unknown -copy_unknown `
$home\AppData\Local\Temp\devine\Dynasties.S02E04.Hyena.2022.2160p.iPl.WEB-DL.AAC.LC.2.0.HDR.HLG.H.265.mp4 -v verbose

[grzech67]

I'm trying to download


devine dl -w S01E01 ALL4 helsinki-crimes

and :

│ 137 │ │ │ │ help="Amount of tracks to download concurrently.") │
│ 138 │ @click.pass_context │
│ 139 │ def cli(ctx: click.Context, **kwargs: Any) -> dl: │
│ > 140 │ │ return dl(ctx, **kwargs) │
│ 141 │ │
│ 142 │ DRM_TABLE_LOCK = Lock() │
│ 143 │
│ │
│ C:\Users\grzech67\AppData\Local\Packages\PythonSof twareFoundation.Python.3.1 │
│ 2_qbz5n2kfra8p0\LocalCache\local-packages\Python312\site-packages\devine\com │
│ mands\dl.py:187 in __init__ │
│ │
│ 184 │ │ with console.status("Loading Key Vaults...", spinner="dots"): │
│ 185 │ │ │ self.vaults = Vaults(self.service) │
│ 186 │ │ │ for vault in config.key_vaults: │
│ > 187 │ │ │ │ vault_type = vault["type"] │
│ 188 │ │ │ │ del vault["type"] │
│ 189 │ │ │ │ self.vaults.load(vault_type, **vault) │
│ 190 │ │ │ self.log.info(f"Loaded {len(self.vaults)} Vaults") │
└───────────────────────────────────────────────── ─────────────────────────────┘
TypeError: string indices must be integers, not 'str'

[SB47x]

Works here.

Processed all titles in 1m29s

All4 are pretty strict on you hammering it, maybe you're on a cooldown? Are you in the UK? If not, it could be that your proxy/VPN is blocked.

[stabbedbybrick]

I'm trying to download


devine dl -w S01E01 ALL4 helsinki-crimes

and :

│   184 │   │   with console.status("Loading Key Vaults...", spinner="dots"):  │
│   185 │   │   │   self.vaults = Vaults(self.service)                         │
│   186 │   │   │   for vault in config.key_vaults:                            │
│ > 187 │   │   │   │   vault_type = vault["type"]                             │
│   188 │   │   │   │   del vault["type"]                                      │
│   189 │   │   │   │   self.vaults.load(vault_type, **vault)                  │
│   190 │   │   │   self.log.info(f"Loaded {len(self.vaults)} Vaults")         │
└──────────────────────────────────────────────────────────────────────────────┘
TypeError: string indices must be integers, not 'str'

Look at what the error message is telling you. You've most likely messed up the config for your vault.

[keep_it_breezy]

I'm trying to download


devine dl -w S01E01 ALL4 helsinki-crimes

and :

│ 137 │ │ │ │ help="Amount of tracks to download concurrently.") │
│ 138 │ @click.pass_context │
│ 139 │ def cli(ctx: click.Context, **kwargs: Any) -> dl: │
│ > 140 │ │ return dl(ctx, **kwargs) │
│ 141 │ │
│ 142 │ DRM_TABLE_LOCK = Lock() │
│ 143 │
│ │
│ C:\Users\grzech67\AppData\Local\Packages\PythonSof twareFoundation.Python.3.1 │
│ 2_qbz5n2kfra8p0\LocalCache\local-packages\Python312\site-packages\devine\com │
│ mands\dl.py:187 in __init__ │
│ │
│ 184 │ │ with console.status("Loading Key Vaults...", spinner="dots"): │
│ 185 │ │ │ self.vaults = Vaults(self.service) │
│ 186 │ │ │ for vault in config.key_vaults: │
│ > 187 │ │ │ │ vault_type = vault["type"] │
│ 188 │ │ │ │ del vault["type"] │
│ 189 │ │ │ │ self.vaults.load(vault_type, **vault) │
│ 190 │ │ │ self.log.info(f"Loaded {len(self.vaults)} Vaults") │
└───────────────────────────────────────────────── ─────────────────────────────┘
TypeError: string indices must be integers, not 'str'

Come on man at least google the error before you ask

[achilles]

If you specify a vault location and there isn't one, devine will create one for you.

However, if the directory that you specify the vault location for doesn't exist, the creation of the file will fail. I think most OS file creation functions won't allow you to create a file if the directory doesn't exist (I could be wrong on that though).

I'm not saying this is the error, but it's one possible reason the vault loading is failing because most people don't mess with their vault and let devine do all the work.

[eday_2010]

This all seems insanely complicated compared to freevine. I have ben fighting with this for a while. I finally go to a point where I don't get any script errors but now I am missing the wvd files.

Failed to load Widevine CDM, A CDM to use wasn't listed in the config

I have no idea how to go about making/obtaining this file for the specific service I am looking to download from (CTV). Has anyone successfully downloaded from the site and would be willing to help me out? I feel like I am very close to getting it to work at this point...

[PSXman_uk]

This all seems insanely complicated compared to freevine. I have ben fighting with this for a while. I finally go to a point where I don't get any script errors but now I am missing the wvd files.

Failed to load Widevine CDM, A CDM to use wasn't listed in the config

I have no idea how to go about making/obtaining this file for the specific service I am looking to download from (CTV). Has anyone successfully downloaded from the site and would be willing to help me out? I feel like I am very close to getting it to work at this point...

Pmed you instructions

[cyberschlumpf]

@stabbedbybrick I asked for this FR of batch downloading on the Devine Github https://github.com/devine-dl/devine/issues/108 which was rejected saying, it is something which needs to be implemented in the service, i.e. in the part you provided for devine for BBC iPlayer. Could you maybe have a look please?

If I am missing something and it should already be possible, kindly guide me how to specify multiple episodes at once. When I last checked I always had to specify the full URL to the iPlayer episode, just using the short identifier didn't work for me?

[A_n_g_e_l_a]

If I am missing something and it should already be possible, kindly guide me how to specify multiple episodes at once. When I last checked I always had to specify the full URL to the iPlayer episode, just using the short identifier didn't work for me?

Use the tool for the job. Either use get_iplayer directly or use UK-FTA for BBC batch downloads

[cyberschlumpf]

Thanks Angela, trying those

[stabbedbybrick]

@stabbedbybrick I asked for this FR of batch downloading on the Devine Github https://github.com/devine-dl/devine/issues/108 which was rejected saying, it is something which needs to be implemented in the service, i.e. in the part you provided for devine for BBC iPlayer. Could you maybe have a look please?

If I am missing something and it should already be possible, kindly guide me how to specify multiple episodes at once. When I last checked I always had to specify the full URL to the iPlayer episode, just using the short identifier didn't work for me?

If you want to download multiple episodes or seasons from a show, you simply use the -w option to specify range of episodes or seasons to download.

If you mean that you want to batch download single episode URLs, then that's not currently possible. Should be pretty easy to implement, though. Having it accept multiple entries or .txt paths is a pretty cool feature I hadn't considered before. Especially for iPlayer where everything is a mess and episode titles aren't always easily selectable through with the -w option.

I'll look into it.