Devine - Modular Movie, TV, and Music Archival Software

[stabbedbybrick]

Trying to download something from ITV and i keep getting

KeyError: 'seriesType'

However using the exact same commands on different ITV shows works absolutely fine

any suggestions ?

This has now been fixed. Update the service and it should work.

Reality/entertainment shows always create problems. I suspect this won't be the last.

[achilles]

Interesting, I was looking at this series a few weeks ago and freevine didn't like it either. But I used UK-FTA and it worked with that.

Edit: Oh, looks like this was fixed as I was typing. LOL. Thanks!

[mickmars]

Trying to download something from ITV and i keep getting

KeyError: 'seriesType'

However using the exact same commands on different ITV shows works absolutely fine

any suggestions ?

This has now been fixed. Update the service and it should work.

Reality/entertainment shows always create problems. I suspect this won't be the last.

Thanks Stabby

[mickmars]

I had a different ITV issue, but it was solved
Thank you keep_it_breezy

https://forum.videohelp.com/threads/414762-For-those-who-are-new-inexperienced

[qruetry]

are there any downside to changing the default download to

downloader: curl_impersonate

[Danker1990]

Is there a proper guide from scratch to getting devine up and running on windows using the latest python 3.12. As I am at breaking point at this moment to trying to get this working.

[keep_it_breezy]

are there any downside to changing the default download to

downloader: curl_impersonate

I have, when downloading multiple episodes using curl_impersonate, had some malloc issues which have caused a crash - other than that I have not seen any downsides. Upsides are that curl_impersonate looks, to the receiving server, like a browser - so you're less likely to receive weird blocking issues such as you sometimes see with aria2c etc.

[A_n_g_e_l_a]

Is there a proper guide from scratch to getting devine up and running on windows using the latest python 3.12. As I am at breaking point at this moment to trying to get this working.

Deep breath. Close your computer and go for a walk. Come back tomorrow and re-try. Repeat as necessary

[mj23]

is anyone able to get this? https://www.channel4.com/programmes/24-hours-in-police-custody/on-demand/68464-008

it doesnt seem show up in the titles available ...

 ──────────────────── Series: 24 Hours in Police Custody ────────────────────

     5 Seasons, 17 Episodes
     ├── Season 1: 1 episodes
     │   └── 1. The Conspiracy to Murder
     ├── Season 2: 4 episodes
     │   ├── 4. One Punch
     │   ├── 10. A Moment of Madness
     │   ├── 11. Their Time Will Come
     │   └── 15. The Detective and the Surgeon
     ├── Season 3: 5 episodes
     │   ├── 6. Two Wrongs
     │   ├── 12. The Home County Cartel - Part One
     │   ├── 13. The Home County Cartel - Part Two
     │   ├── 22. The No Body Murder
     │   └── 25. Murder in the Woods (Feature-Length Version)
     ├── Season 4: 5 episodes
     │   ├── 1. The Murder of Rikki Neave (Part 1/2)
     │   ├── 2. The Murder of Rikki Neave (Part 2/2)
     │   ├── 7. The Siege
     │   ├── 9. Murder on Camera (Part 1/2)
     │   └── 10. Murder on Camera (Part 2/2)
     └── Season 6: 2 episodes
         ├── 1. Sex and Corruption
         └── 3. Left for Dead

[billybanana]

it doesnt seem show up in the titles available ...

All4 do weird stuff with their naming and availability. I could get it with Freevine or use this command directly

N_m3u8DL-RE.exe "https://cf.jos.c4assets.com/CH4_08_02_900_68464008001002_001/CH4_08_02_900_68464008001002_001_J01.ism/stream.mpd?c3.ri=13624626957850069950&mpd_segment_template=time&filter=%28type%3D%3D%22video%22%26%26%28%28DisplayHeight%3E%3D288%29%26%26%28systemBitrate%3C4800000%29%29%29%7C%7Ctype%21%3D%22video%22&ts=1717658207&e=600&st=-dvPbHJLjNBYwlbjgiydPHybGvcolGdz1CnXgYBv0jo" --key 00000000000000000000000005676741:4712a376de9b06b5abe94c252a696c1c -M format=mkv:muxer=mkvmerge -mt

[stabbedbybrick]

is anyone able to get this? https://www.channel4.com/programmes/24-hours-in-police-custody/on-demand/68464-008

it doesnt seem show up in the titles available ...

For whatever reason, this episode isn't listed on their API but can be found through the HTML source code (which is why it works with freevine). I've seen this on other UK services as well, like iP and ITV. I tend to avoid parsing HTML as much as possible, but maybe I can add it as a fallback or something.

I also just remembered a few people reporting that all4 sometimes add empty subtitles, causing the download to break. If anyone has a particular episode in mind where this happens, that'd be great. Might as well fix multiple issues at once while I'm at it.

[mj23]

i did try Freevine as well with no success... that command also gets 401 Unauthorised so i suspect the various VPNs are an issue as well

ok so freevine works with earlier episodes using -c but errors on that episode still

20:22:04.553 WARN : 24.Hours.in.Police.Custody.S03E06.Two.Wrongs.1080p.ALL4.WEB-DL.AAC2.0.H.264.srt
20:22:04.553 WARN : Muxing to 24.Hours.in.Police.Custody.S03E06.Two.Wrongs.1080p.ALL4.WEB-DL.AAC2.0.H.264.MUX.mkv
20:22:40.479 WARN : Cleaning files...
20:22:40.860 WARN : Rename to 24.Hours.in.Police.Custody.S03E06.Two.Wrongs.1080p.ALL4.WEB-DL.AAC2.0.H.264.mkv
20:22:40.877 INFO : Done

20:22:40.908 INFO : Requesting ANDROID assets...
20:22:41.719 WARNING : Request for Android endpoint returned <Response [404]>, attempting proxy request...
20:22:41.720 INFO : + Adding Hola proxy location: UK
Traceback (most recent call last):
  File "C:\Users\mark\AppData\Roaming\Python\Python312\site-packages\urllib3\connectionpool.py", line 779, in urlopen
    self._prepare_proxy(conn)
  File "C:\Users\mark\AppData\Roaming\Python\Python312\site-packages\urllib3\connectionpool.py", line 1048, in _prepare_proxy
    conn.connect()
  File "C:\Users\mark\AppData\Roaming\Python\Python312\site-packages\urllib3\connection.py", line 633, in connect
    self._tunnel()  # type: ignore[attr-defined]
    ^^^^^^^^^^^^^^
  File "C:\Program Files\Python312\Lib\http\client.py", line 973, in _tunnel
    raise OSError(f"Tunnel connection failed: {code} {message.strip()}")
OSError: Tunnel connection failed: 403 Auth Failed

The above exception was the direct cause of the following exception:

urllib3.exceptions.ProxyError: ('Unable to connect to proxy', OSError('Tunnel connection failed: 403 Auth Failed'))

[mickmars]

Hi all
Im trying to download something from the BBC iplayer and I keep getting this

SSLError: HTTPSConnectionPool(host='vod-hls-uk-live.akamaized.net', port=443):
Max retries exceeded with url:
/usp/auth/vod/piff_abr_full_hd/230948-m001zy6y/vf_m001zy6y_dff7d60b-560e-48ee-82
bf-28e90dbb7c3a.ism/hls/master.m3u8 (Caused by SSLError(SSLEOFError(8, '[SSL:
UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol
(_ssl.c:1000)')))

Any suggestions ?

[PSXman_uk]

Hi all
Im trying to download something from the BBC iplayer and I keep getting this

SSLError: HTTPSConnectionPool(host='vod-hls-uk-live.akamaized.net', port=443):
Max retries exceeded with url:
/usp/auth/vod/piff_abr_full_hd/230948-m001zy6y/vf_m001zy6y_dff7d60b-560e-48ee-82
bf-28e90dbb7c3a.ism/hls/master.m3u8 (Caused by SSLError(SSLEOFError(8, '[SSL:
UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol
(_ssl.c:1000)')))

Any suggestions ?

looks like a vpn error whats the url

[Danker1990]

what am i doing wrong.
[Attachment 79690 - Click to enlarge]

[TPD94]

what am i doing wrong.
[Attachment 79690 - Click to enlarge]

Looks like your database config in Devine.yaml is formatted incorrectly.

[Danker1990]

is anyone able to send a copy of their working devine.yaml (private info omitted) as i'm so close to getting this up and running however i keep hitting error after error. and really scratching my head to what i'm doing wrong.

[Danker1990]

[Attachment 79725 - Click to enlarge]

This is what i'm getting when trying to use it on the all4 service core.

[grzech67]

[Attachment 79727 - Click to enlarge]


I have the same error with the same link



[Attachment 79730 - Click to enlarge]

Fixed in config.yaml, works

[achilles]

Works fine for me for that episode on ALL4.

If you ever have problems like this, try playing around with the number of workers and/or switching downloaders. It worked for me with workers =2 and downloader = requests.

[Danker1990]

Works fine for me for that episode on ALL4.

If you ever have problems like this, try playing around with the number of workers and/or switching downloaders. It worked for me with workers =2 and downloader = requests.

thank you actually working now. just need to get the iplayer one working now then everything else should work. Your one single comment has fixed everything i have been pulling out hair for all week.

I'm honestly thankful.

[Danker1990]

[Attachment 79729 - Click to enlarge]

Is this setup yaml file ok? if this is should the ip portion work?

[Danker1990]

[Attachment 79731 - Click to enlarge]

This is what i'm getting when i try the iplayer code. no downloading is initialising

[PSXman_uk]

[Attachment 79731 - Click to enlarge]

This is what i'm getting when i try the iplayer code. no downloading is initialising

Pmed you real cdm and devine.yaml

[Danker1990]

[Attachment 79731 - Click to enlarge]

This is what i'm getting when i try the iplayer code. no downloading is initialising

Pmed you real cdm and devine.yaml

thank you. i have the iplayer version code working although its having a hard time with a few shows.

[bmfexp]

can someone help me with the yaml config for nordvpn, i have my own credentials

[pssh]

can someone help me with the yaml config for nordvpn, i have my own credentials

nordvpn (dict)
https://github.com/devine-dl/devine/blob/master/CONFIG.md#nordvpn-dict



Set your NordVPN Service credentials with username and password keys to automate the use of NordVPN as a Proxy system where required.

You can also specify specific servers to use per-region with the servers key.
Sometimes a specific server works best for a service than others, so hard-coding one for a day or two helps.

For example,

username: zxqsR7C5CyGwmGb6KSvk8qsZ # example of the login format
password: wXVHmht22hhRKUEQ32PQVjCZ
servers:
- us: 12 # force US server #12 for US proxies

The username and password should NOT be your normal NordVPN Account Credentials.
They should be the Service credentials which can be found on your Nord Account Dashboard.

Once set, you can also specifically opt in to use a NordVPN proxy by specifying --proxy=gb or such.
You can even set a specific server number this way, e.g., --proxy=gb2366.

Note that gb is used instead of uk to be more consistent across regional systems.


#Would this work [CORRECTED]

devine cfg proxy_providers.nordvpn.username zxqsR7C5CyGwmGb6KSvk8qsZ
devine cfg proxy_providers.nordvpn.password wXVHmht22hhRKUEQ32PQVjCZ
devine cfg proxy_providers.nordvpn.servers."- us" 12

The above commands do not work ...

I guess that it should look like this (may have to edit out the quotes):

proxy_providers:
  nordvpn: 
    username: zxqsR7C5CyGwmGb6KSvk8qsZ
    password: wXVHmht22hhRKUEQ32PQVjCZ
    servers:
        - us: 12

(There should be a SPACE
between semicolon and zxqsR7C5CyGwmGb6KSvk8qsZ
and
between semicolon and wXVHmht22hhRKUEQ32PQVjCZ)

#EDIT 8th Jul 2024
- Corrected the command

[Tom Saurus]

When it comes to cookies how long are they suppose to last for? Is it normal to have to redo the cookies txt. every few days? Though I don't really mind it doesn't take much effort; I am just curious.

It varies between services, but in most cases you shouldn't have to replace it every few days unless you're regularly logging out of your account.

Which service are you referring to?

Thank you for your post on behalf of myself and others that are learning along with me.

TUBI is the only service I use with Devine for now anyway. I just log into my account to get the cookie and then I use the extension program to get the cookie and put in it my cookies folder. Then I log out and delete my browser history on the way out. I also deactivate the extension that gets the cookies until I need it again. I also have started to do that with the latest version of video downloadhelper deactivate until it is needed. I know it sounds silly but the permissions just make me uneasy.

On a related note I remember last year the Linus Tech Tips YouTube Channel was hacked and I remember Linus discussing it with his colleague on a video and he said part of it was due to a permanent cookie where he had logged in and told the browser to remember him. Somehow someone was able to get that cookie and hacked into the account and chaos ensued. I make it a practice to never save passwords and such on the computer just write them down and commit to memory.

Ah, so - that will likely be your problem. When you log out, you tell Tubi to "burn" your cookie set. This will be what is causing you to have to probably refresh them more frequently than expected. There's nothing wrong with leaving the browser logged in, and the extensions enabled.

As for your passwords, I would actually advise the opposite. Get a password manager that looks after them for you! You can also use a password manager to generate and store much more secure passwords than you could ever remember in your head. Keepass is a great start.

As for the Linus Tech Tips incident. There's actually a little bit more to it than that. An attacker was able to get malware to run on one of their employees machines that then harvested cookies out of browser storage - so the attack vector you really need to worry about here is somehow getting malware on your machine. Albeit you (unless you're secretly famous) a) likely aren't worth targeting and b) it's a cookie for Tubi anyway so likely not even something anyone would bother stealing as Tubi is free .

Thank you for your post. I was logged in for around three days last week to TUBI TV and the cookie worked the entire time.

[PSXman_uk]

Can somebody please see if this fails for them thanks

https://www.bbc.co.uk/iplayer/episode/m00204dk/doctor-who-season-1-6-rogue

devine dl -V -A --range  HLG  iP https://www.bbc.co.uk/iplayer/episode/m00204dk/doctor-who-season-1-6-rogue

   ❌ Download Failed...
        403 Client Error: Forbidden for url:
     https://vod-uhd-uk-live.akamaized.net/g5wpsp9r-pips-pid-m0020c7q/scmaf
     _abr_full_uhd/rd/2904e7fb-973c-af66-3111-ac488477e8bf/video=18160000/d
     ur=3840/000702.m4s?__gda__=1717850321_92b3c1004b5e226fe1f71f3aead82c5e

[iamghost]

Can somebody please see if this fails for them thanks

https://www.bbc.co.uk/iplayer/episode/m00204dk/doctor-who-season-1-6-rogue

devine dl -V -A --range  HLG  iP https://www.bbc.co.uk/iplayer/episode/m00204dk/doctor-who-season-1-6-rogue

   ❌ Download Failed...
        403 Client Error: Forbidden for url:
     https://vod-uhd-uk-live.akamaized.net/g5wpsp9r-pips-pid-m0020c7q/scmaf
     _abr_full_uhd/rd/2904e7fb-973c-af66-3111-ac488477e8bf/video=18160000/d
     ur=3840/000702.m4s?__gda__=1717850321_92b3c1004b5e226fe1f71f3aead82c5e

no problem with same your cmd line

[Attachment 79753 - Click to enlarge]