UK Free to Air Downloader

[pteque]

Running this :

https://github.com/shaka-project/shaka-packager/releases/download/v3.0.3/mpd_generator-win-x64.exe
Cheers

That's the wrong component of Shaka packager. Download the file named packager-win-x64.exe instead.

[stevepen1974]

Running this :

https://github.com/shaka-project/shaka-packager/releases/download/v3.0.3/mpd_generator-win-x64.exe
Cheers

That's the wrong component of Shaka packager. Download the file named packager-win-x64.exe instead.

All good now, many thanks pteque/Angela for resolving.

[A_n_g_e_l_a]

That's the wrong component of Shaka packager. Download the file named packager-win-x64.exe instead.

Well spotted!

[BenDWire]

I seem to have stumbled upon another bug, although I'm prepared to accept that this could be unique to my setup (Debian 12) as it involves **ing Unicode characters.

If you try to download "The Naked Gun 2½ - The Smell Of Fear" from Channel 4 everything works as expected until the decryption phase. Oddly enough VLC / Mediainfo display the resulting file as a Quicktime video, which has echos of the previous poster's problem. This is a red herring, as it's simply not decrypting properly.

By now you will have guessed that shaka-packager is choking on the "½" character, and it all works if I rename the files and decode manually. Obviously "not your problem" per se, but you might like to sanitise your inputs to mask the issue. (FYI I'm running shaka-packager v2.6.1)

https://www.channel4.com/programmes/the-naked-gun-2-the-smell-of-fear/on-demand/39398-001

Thanks again.

[white_snake]

By now you will have guessed that shaka-packager is choking on the "½" character, and it all works if I rename the files and decode manually. Obviously "not your problem" per se, but you might like to sanitise your inputs to mask the issue. (FYI I'm running shaka-packager v2.6.1)

This seems to have been fixed in 3.0.0 (3.0.4 is the latest), so you might want to update: https://github.com/shaka-project/shaka-packager/releases

[BenDWire]

Thanks for that. I wondered if that might be the case, but I didn't see any mention of the issue in the release notes. Of course now I've just re-read them properly I see UTF-8 characters specifically mentioned.

Channel 4 are showing Naked Gun 33⅓ tomorrow, so I can check that it's fixed then.

[A_n_g_e_l_a]

There has been an update to one of the modules that UK-FTA uses. Beaupy manages the checkbox listing to enable selection for download.

The choice to pre-select all or none from titles to download has been a little contentious with some users, but happily the new beaupy update gives the option for the user to select all or none of the check-boxes ticked. Just toggle the selection by clicking 'a' on your keyboard. There are some reports it is only a one way toggle for some Windows users.

Unfortunately any beaupy upgrades after 3.6.2 removes some colour highlighting. I think it was a bug but proved quite useful.

Install the new beaupy by

pip install beaupy --upgrade

[sipho]

Thank you A_n_g_e_l_a

[stevepen1974]

There has been an update to one of the modules that UK-FTA uses. Beaupy manages the checkbox listing to enable selection for download.

The choice to pre-select all or none from titles to download has been a little contentious with some users, but happily the new beaupy update gives the option for the user to select all or none of the check-boxes ticked. Just toggle the selection by clicking 'a' on your keyboard. There are some reports it is only a one way toggle for some Windows users.

Unfortunately any beaupy upgrades after 3.6.2 removes some colour highlighting. I think it was a bug but proved quite useful.

Install the new beaupy by

pip install beaupy --upgrade

Cheers

[A_n_g_e_l_a]

And I find Vadapav isn't working. They have changed the back-end to no longer deliver json responses. The code will need a rewrite sometime....

[A_n_g_e_l_a]

Vadapav now working https://forum.videohelp.com/threads/413280-Vadapav#post2732516

should make a drop in replacement for the existing vadapav.py in UK-FTA/ukfta/vadapav/

[Akirainblack]

I'm afraid I can't follow that link A_n_g_e_l_a
That said the rest appears to be working perfectly on Noble Numbat beta anyway.

[A_n_g_e_l_a]

I'm afraid I can't follow that link A_n_g_e_l_a
That said the rest appears to be working perfectly on Noble Numbat beta anyway.

No, me neither. Don't know what happened. New vadapav.py here https://files.videohelp.com/u/301890/vadapav.py . It is configured as a standalone. You'll need to comment out a section and uncomment another bit near the top and put it as a replacement for vadapav.py in UK-FTA/ukfta/vadapav/ It is a bit quick and ready and I'll finesse it to remove errors on search not finding any results. And release a whole new UK-FTA ... eventually

(where the heck does Ubuntu get its names from?? Noble Numbat? I ask you!)

[LastResort]

Hi Angela,
A quick question for you... I did a download from stv,.. all downloaded fine, including the subs,... everything muxed fine. But one curious thing happed, it placed the finished file in this directory: C:\home\angela\Programming\WKS-KEYS\output\STV I'm just curious why this has happened, up until a few weeks ago all files were being placed in the correct folder which was : C:\UK-FTA\output\STV
After the file had muxed and said Done,... there was these two items at the end:
Invalid parameter(s)
RESET { SESSION }

Using v 13.4

Thankyou for any advice...

[A_n_g_e_l_a]

Hi Angela,
A quick question for you... I did a download from stv,.. all downloaded fine, including the subs,... everything muxed fine. But one curious thing happed, it placed the finished file in this directory: C:\home\angela\Programming\WKS-KEYS\output\STV I'm just curious why this has happened, up until a few weeks ago all files were being placed in the correct folder which was : C:\UK-FTA\output\STV
After the file had muxed and said Done,... there was these two items at the end:
Invalid parameter(s)
RESET { SESSION }

Using v 13.4

Thankyou for any advice...

The update overwrites the old config files and the 'example' save location was the one used. Just run config from the menu again and reset it. You'll also need to update the wvd location again too .Lucklily stv doesn't need widevine decryption most times.

The Reset Session issue is something I have noticed on Windows too. It is harmless. Normally I test for whether the operating system is Linux and if so reset the terminal. It seems that test doesn't happen with stv so the system tries to reset and it cannot.

[LastResort]

Thank you for the info Angela... I'll get on to it now.

Thank you for putting the reminder of windows "/", That forward slash always catches me out.

Created a new WVD location, C:\UK-FTA\ukfta\WVD and changed the download location back to where it was. A quick test, and it's hunky dory.

Does menu.py unpack the wvd, (I just have a vague memory from months ago that it unpacked the wvd into two separate files). I checked my one after using it to decrypt but it's not changed. Well it worked, So maybe I'm just being to OTT.

Thanks again Angela.

[kev043]

Hi A_n_g_e_l_a thanks for the work on this, I've just discovered it and would like some help geting it going

I've unpacked it and ran the pip install -r requirements.txt but I'm a bit confused about these

## Requirements
* Python 3.10 - 3.12
* pip
* ffmpeg (https://github.com/FFmpeg/FFmpeg) https://www.videohelp.com/software/ffmpeg or Linux distro
* mp4decrypt (https://github.com/axiomatic-systems/Bento4)
* N-m3u8DL-RE https://github.com/nilaoda/N_m3u8DL-RE/releases
* MKVMerge from MKVToolNix https://mkvtoolnix.download/downloads.html https://www.videohelp.com/software/MKVToolNix
* Shaka-packager https://github.com/shaka-project/shaka-packager/releases rename the binary to shaka-packager
* A CDM (device_private_key and device_client_blob) pointed to by a wvd file https://forum.videohelp.com/threads/411862-Beyond-WKS-KEYS
* get_iplayer see https://github.com/get-iplayer/get_iplayer/releases

Do I have to put these apps into the UK-FTA folder?

Thank you very much for the work and the help too.

[A_n_g_e_l_a]

I have an update to the ITV downloader.

There has been a redesign of the interface based on how I was using the old one. I've tweaked the menu to no longer offer single downloads - the feature exists anyway in the Series downloader and ITV is altered to make a direct download if needed. I'll likely update the other channels after I've experienced using this for a while. There has been a large rework of the ITV code to cope with new download features and better programme naming.

Browsing ITV content is now possible - it corrects the dilemma of not knowing a keyword with which to search. There are a number of browsing categories pre-selected but you can also add your own. So now you can download from ITV without using a browser at all or ever having to copy & paste.

[Attachment 78760 - Click to enlarge]

[Attachment 78752 - Click to enlarge]
Most ITV Programme Categories have a 'view all' link - for example, in the image, 'DOCUMENTARIES AND LIFESTYLE', there is a sub-category of 'Celebs, Travel & Leisure'. If that floats your boat you will need to add the url to the media_dict(ionary) on a new line with the key: value pair within itv_loader.py using an editor.

[Attachment 78753 - Click to enlarge]
Where the key for our example would be 'Celebs Travel Leisure' and the value would be "h t t p s://www.itv.com/watch/collections/celebs-travel-and-leisure/qkdzhARNwbnQahcpYZ12W' Note the form of the URL (but ignore h t t p s and make it normal) - other forms without a jumbled alpha-numeric at the end will not work. Each key:value pair must have quoted parts , be on a line of its own and with a comma to end the line. Just follow the pattern of the provided key:value pairs precisely.


[Attachment 78754 - Click to enlarge]
Menu has been revised

[Attachment 78755 - Click to enlarge]

[Attachment 78756 - Click to enlarge]
More colours are now set from within the script. I recommend you use Terminal App on Windows and set the background to black and the foreground to bright yellow as those are not set by the script.

[Attachment 78757 - Click to enlarge]

[Attachment 78758 - Click to enlarge]

[Attachment 78759 - Click to enlarge]

A zip of three files is here https://files.videohelp.com/u/301890/UK-FTA_itv_update.zip unzip and manually replace the existing menu.py in UK-FTA with this one and replace itv_loader.py and ITVX.py in UK-FTA/ukfta/itv_dl/

[A_n_g_e_l_a]

Hi A_n_g_e_l_a thanks for the work on this, I've just discovered it and would like some help geting it going

I've unpacked it and ran the pip install -r requirements.txt but I'm a bit confused about these

## Requirements
* Python 3.10 - 3.12
* pip
* ffmpeg (https://github.com/FFmpeg/FFmpeg) https://www.videohelp.com/software/ffmpeg or Linux distro
* mp4decrypt (https://github.com/axiomatic-systems/Bento4)
* N-m3u8DL-RE https://github.com/nilaoda/N_m3u8DL-RE/releases
* MKVMerge from MKVToolNix https://mkvtoolnix.download/downloads.html https://www.videohelp.com/software/MKVToolNix
* Shaka-packager https://github.com/shaka-project/shaka-packager/releases rename the binary to shaka-packager
* A CDM (device_private_key and device_client_blob) pointed to by a wvd file https://forum.videohelp.com/threads/411862-Beyond-WKS-KEYS
* get_iplayer see https://github.com/get-iplayer/get_iplayer/releases

Do I have to put these apps into the UK-FTA folder?

Thank you very much for the work and the help too.

The expectation is that everyone will have done some hand decrypting of websites before the use of any scripts. So all those ancillary programs will already be on most user's systems. To answer your question: No. But they do need to be in a folder on the operating system's Path. A quick and dirty fix for Windows users is to put them in system32/

[A_n_g_e_l_a]

Another update to ITV and also to the menu.

ITV browsing was throwing an error. If dobrowse(url) found a link which wasn't an endpoint to a video but instead a collection of more video links one level down, the system failed. Next level searching has now been added. It shouldn't throw a wobbly there again.

My5
The server that was providing HMAC and AES-KEYs for My5 has been, or will shortly be, taken down.
My5 will need to periodically update said HMAC and AES-KEY. The function has been returned to the menu to update My5 manually. It will take 10 -15 seconds to do the update so it is not something I'll add to be run every time you start a My5 download. You will need to run the updater yourself when you remember. Or better - if you have Cron on your system (or ScheduleTask) it would be a good idea to run the updater by calling "python </full Path to>/hmac-aes-update.py" directly once every three days.

update at
https://files.videohelp.com/u/301890/ITV_update.zip

[peterb999]

Thanks Angela

[A_n_g_e_l_a]

Sorry to say that the greater ancient download alternatives provided by the new browse function produces some file names with characters that caused errors with ffmpeg parsing them to create subtitles..

Now corrected with https://files.videohelp.com/u/301890/ITV_update_2_2.zip

Sorry to be a pain. But this is work in progress...

[stabbedbybrick]

My5
The server that was providing HMAC and AES-KEYs for My5 has been, or will shortly be, taken down.

Sorry about that, didn't realize you were using it. I figured out that you can avoid dealing with hmac altogether by extracting the certification and private key from the keystore and use it with the android API. Let me know if you're interested in implementing it to your downloader and I'll DM the cert and some API info.

[A_n_g_e_l_a]

Let me know if you're interested in implementing it to your downloader and I'll DM the cert and some API info.

Thanks. Currently I'm doing it with a headless browser running a local file. But that take time to load and run. So now I'm looking to try and run the javascript to get HMAC etc from within python directly. There are python modules that will run js. I'm not sure they are up to the complexity of my5 JavaScript. No joy so far. But I may take you up on your offer if I cannot get anywhere with it.

[A_n_g_e_l_a]

My5 has been throwing errors with "Under the Dome", notably.

A new (to me) variant of the mpd file ending was not catered for in an extensive ' if.... elif' construct. A quick fix is here just replace your existing my5getter.py with this new one. https://files.videohelp.com/u/301890/my5getter.py

I plan on giving my5 a makeover along with some of the other channels and will release an updated UK-FTA to include these recent changes when completed.

[coltseavers]

Thanks so much for your hard work, MY5 is working great with the manual update method.

I may have missed something but is there an option to specify alternative resolutions? (to opt for 720p instead of 1080p et)

[A_n_g_e_l_a]

I may have missed something but is there an option to specify alternative resolutions? (to opt for 720p instead of 1080p et)

No what you see is what you get. If you **really** must have 720p then ffmpeg can probably do the conversion for you. Others here will know the commands for that.

[A_n_g_e_l_a]

Thanks so much for your hard work, MY5 is working great with the manual update method.

I may have missed something but is there an option to specify alternative resolutions? (to opt for 720p instead of 1080p et)

Actually you can - by changing the script of my5getter.py very slightly.

Find line 311

[Attachment 78926 - Click to enlarge]
and comment it out

[Attachment 78927 - Click to enlarge]

Now when you run my5, N_m3u8DL-RE will stop for you to select resolution. Remove it for batch downloading or add your own video resolution selector switch to the N_m3u8DL-RE line. Instead of auto-select you could select a 720p resolution permanently. I'd have to look in the help, but so can you.

[coltseavers]

Now when you run my5, N_m3u8DL-RE will stop for you to select resolution. Remove it for batch downloading or add your own video resolution selector switch to the N_m3u8DL-RE line. Instead of auto-select you could select a 720p resolution permanently. I'd have to look in the help, but so can you.

This is perfect, thank you (some of their content, I only really need at 720p). I always grabbed these manually previously so the automation is a big help.

[PhilipG]

Hi, since Freevine not working any more for me with C5, I'm trying this. Updated the config and the C5 keys, but the error I get is this:

Extra data: line 1 column 4 (char 3)

...right after I select My5 from the menu.

Help much appreciated.