UK Free to Air Downloader

[A_n_g_e_l_a]

]
[Attachment 74246 - Click to enlarge]
A single starting point for 5 UK Channels. Each script use the familiar search select and download format.


[Attachment 79847 - Click to enlarge]

Uses an graphical menu that stays on screen to run each of the channel downloaders


[Attachment 74248 - Click to enlarge]
Zip contents.


The whole suite of scripts defaults to Pywidevine and not WKS-KEYS. The folder may be unzipped anywhere on your system.

You will first need to configure the path to your wvd so... on first run, either use the menu item 'config' to edit the config file (beta)
or see the README for config advice.

If you still need to create a pywidevine wvd CDM locator then see here -> https://forum.videohelp.com/threads/411862-Beyond-WKS-KEYS.

There is a README file. Please attend to that before posting.

For new users python runonce.py may install everything python you need. You will still need to read README for installation of the binaries.

Use

python gui.py

to start.

[edit]
One potential gotcha for Windows users; when setting the config SAVE_PATH in Notepad, DO NOT USE a trailing slash. so make it like this:-
SAVE_PATH=r"C:\Users\some_name\Brit_TV\Downloads"
Advice to reflect this in release 3

New 06/07/2024 Batch download added
https://files.videohelp.com/u/301890/uk-fta_15_1.zip

[sipho]

Thank you kindly. I'll give this a test. Much appreciated.

[A_n_g_e_l_a]

Small big fix at #1 now at 4th release.

[Jawz22]

Thank you A_n_g_e_l_a for your hard work. Sorry to be a pain in the backside again , I'm not sure if it's the code in the script or just the videos themselves but I found when downloading the TV show Lego Masters, 2 out of 10 episodes fail to mux. Gives the following error:

:30:26.876 INFO : Start downloading...Vid 1920x1080 | 5001 Kbps | video=4977102 | avc1.640029
23:30:26.941 INFO : Start downloading...Sub textstream=0
23:30:27.071 INFO : Start downloading...Aud audio_eng=128000 | 133 Kbps | mp4a.40.2 | en | 2CH
23:30:27.084 WARN : Reading media info...
23:30:27.127 INFO : Start downloading...Aud audio_eng_1=128000 | 133 Kbps | mp4a.40.2 | en | 2CH
23:30:27.170 INFO : NaN: Subtitle, webvtt
23:30:27.177 WARN : Extracting VTT(raw) subtitle...
23:30:27.184 INFO : Binary merging...
23:30:27.525 WARN : Type: cenc
23:30:27.528 WARN : PSSH(WV): CAESEISWsGs2WXyAPfpFz3dHOE4aCHJibWNoNHR2Igc0NTM5NTAwMgA=
23:30:27.530 WARN : KID: 8496b06b36597c803dfa45cf7747384e
23:30:27.534 WARN : Reading media info...
23:30:27.647 INFO : [0x1]: Video, h264 (High) (avc1), 1920x1080, 25 fps, 30 kb/s
23:30:28.191 WARN : Type: cenc
23:30:28.195 WARN : PSSH(WV): CAESEISWsGs2WXyAPfpFz3dHOE4aCHJibWNoNHR2Igc0NTM5NTAwMgA=
23:30:28.199 WARN : KID: 8496b06b36597c803dfa45cf7747384e
23:30:28.202 WARN : Reading media info...
23:30:28.339 INFO : [0x1]: Audio, aac (LC) (mp4a), 28 kb/s
23:30:32.569 WARN : Type: cenc
23:30:32.579 WARN : PSSH(WV): CAESEISWsGs2WXyAPfpFz3dHOE4aCHJibWNoNHR2Igc0NTM5NTAwMgA=
23:30:32.586 WARN : KID: 8496b06b36597c803dfa45cf7747384e
23:30:32.588 WARN : Reading media info...
23:30:32.765 INFO : [0x1]: Audio, aac (LC) (mp4a), 28 kb/s
23:30:35.048 INFO : Binary merging...
23:30:35.107 INFO : Decrypting...
23:30:36.913 WARN : Lego_Masters_S01E01_Brick_Banquet.en.m4a => Lego_Masters_S01E01_Brick_Banquet.en.copy.m4a
23:30:36.916 INFO : Binary merging...
23:30:37.026 INFO : Decrypting...
23:31:18.133 INFO : Binary merging...
23:31:22.475 INFO : Decrypting...
23:31:40.305 WARN : Lego_Masters_S01E01_Brick_Banquet.mp4
23:31:40.306 WARN : Lego_Masters_S01E01_Brick_Banquet.en.m4a
23:31:40.307 WARN : Lego_Masters_S01E01_Brick_Banquet.en.copy.m4a
23:31:40.308 WARN : Lego_Masters_S01E01_Brick_Banquet.srt
23:31:40.308 WARN : Muxing to Lego_Masters_S01E01_Brick_Banquet.MUX.mkv
23:31:40.486 ERROR: Mux failed
23:31:40.487 ERROR: Failed

The strange thing is all the other 8 episodes mux fine.

Another very small issue. I set the download path in the config file: SAVEPATH = r"C:\Users\####\FTA-UK\Downloads" for ITVX, My5, STV and UKTVplay they all save in the path I set, but with All4 it gets saved in C:\Users\####\FTA-UK\DownloadsC4. see attached pics.


[Attachment 74279 - Click to enlarge]
[Attachment 74280 - Click to enlarge]

thanks

[A_n_g_e_l_a]

Thank you A_n_g_e_l_a for your hard work. Sorry to be a pain in the backside again , I'm not sure if it's the code in the script or just the videos themselves but I found when downloading the TV show Lego Masters, 2 out of 10 episodes fail to mux. Gives the following error:

thanks

I came across a couple of those type of fails when testing. There both were fairly ancient videos. Yt-dlp downloaded fine, the results were decoded and muxed by hand with mp4decrypt and fmpeg; the video was playable. Going back to N_m3u8DL-RE I tried shaka-packager as the decrypt and mux agent but that made no difference, So I concluded it was a N_m3u8DL-RE issue and resolved to notify the developer. I stlll have that resolve. :

[A_n_g_e_l_a]

Lego_Masters_S01E01

https://gofile.io/d/e6UsiZ

[Jawz22]

Lego_Masters_S01E01

https://gofile.io/d/e6UsiZ

Thank you, I was able to mux the files manually alright but was just letting you know in case it was a bug or something

[phantom84]

Thanks finally got there! Is it limited to 720p?

[A_n_g_e_l_a]

Thanks finally got there! Is it limited to 720p?

1080p for most services. But singularly ITVX limits to 720p; however, STV carries many of the same programmes at 1080p. Glad you got there!

[A_n_g_e_l_a]

https://files.videohelp.com/u/301890/uk-fta_5.zip
New release is a bug-fix for Channel 4 not MUXing with N_m3u8DL-RE on rare occasions. Yt-dlp is now an optional C4 downloader and its use may be set in config.

Sometimes very large search results spilled off the screen and remained selectable but not viewable. - now corrected by adding pagination to results if too large for the screen.

A feature for downloading single urls was always there, either by ploughing through the menu system to reach a single download or by running the downloader by hand.

It makes sense to bring that feature to the menu.

[Attachment 74316 - Click to enlarge]

[peterb999]

Thanks Angela.

[Spectrumhsm]

What am I doing wrong?
Thanks in advance.

     ___     __     __     ____
    / _ |   / /    / /    / / /
   / __ |  / /__  / /__  /_  _/
  /_/ |_| /____/ /____/   /_/


An All4 Video Search, Selector and Downloader.


Enter any All4 url for the series-title to download
https://www.channel4.com/programmes/scotland-my-life-in-the-wild/on-demand/71611-001

Use up/down keys + spacebar to de-select or re-select videos to download

Traceback (most recent call last):
  File "C:\UK-FTV\c4-dl\chan4_loader.py", line 284, in <module>
    myAll4 = C4.main(url)
             ^^^^^^^^^^^^
  File "C:\UK-FTV\c4-dl\C4.py", line 445, in main
    device = Device.load(wvd)
             ^^^^^^^^^^^^^^^^
  File "C:\Users\XXX\AppData\Local\Packages\PythonSoftwareFoundation.Python.3.11_qbz5n2kfra8p0\LocalCache\local-packages\Python311\site-packages\pywidevine\device.py", line 164, in load
    with Path(path).open(mode="rb") as f:
         ^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\Program Files\WindowsApps\PythonSoftwareFoundation.Python.3.11_3.11.1776.0_x64__qbz5n2kfra8p0\Lib\pathlib.py", line 1044, in open
    return io.open(self, mode, buffering, encoding, errors, newline)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
FileNotFoundError: [Errno 2] No such file or directory: '\\home\\angela\\android_sdk.wvd'
⡿ Loading...
PS C:\UK-FTV>

[A_n_g_e_l_a]

What am I doing wrong?
Thanks in advance.

What are you doing wrong? Not reading the instructions would be my guess.

You will first need to configure the path to your wvd so... on first run, either use the menu item 'config' to edit the config file (beta)
or see the README for config advice.

There is a separate config for My5 in the my-5-dl folder see the config.py and README in that folder.

If you still need to create a pywidevine wvd CDM locator then see here -> https://forum.videohelp.com/threads/411862-Beyond-WKS-KEYS.

As mentioned, there are two README files. Please attend to those before posting.

[Spectrumhsm]

What am I doing wrong?
Thanks in advance.

What are you doing wrong? Not reading the instructions would be my guess.

You will first need to configure the path to your wvd so... on first run, either use the menu item 'config' to edit the config file (beta)
or see the README for config advice.

There is a separate config for My5 in the my-5-dl folder see the config.py and README in that folder.

If you still need to create a pywidevine wvd CDM locator then see here -> https://forum.videohelp.com/threads/411862-Beyond-WKS-KEYS.

As mentioned, there are two README files. Please attend to those before posting.

Apologies from an ignorant newbie.
Will read README files carefully and follow instructions.
Thanks.

[peterb999]

I downloaded The Good Ship Murder last night, unfortunately it downloaded the Audio Description track instead of the normal track. I can see in the script it uses ba for best audio but for some reason it selected the audio description one. I changed it to wa and it worked, but obviously it was the lowest quality audio, but fine for me to watch. Just thought I'd mention it.

[sipho]

I downloaded The Good Ship Murder last night, unfortunately it downloaded the Audio Description track instead of the normal track. I can see in the script it uses ba for best audio but for some reason it selected the audio description one. I changed it to wa and it worked, but obviously it was the lowest quality audio, but fine for me to watch. Just thought I'd mention it.

Channel 5 only has shitty audio. Both AD and normal audio are 96k.

The problem with making a hard coded change like you did is that for most of the time the normal audio track is downloaded by using 'ba'. If you are going to hard code it, rather use the audio ID of '10' or use 'all' if the script allows and then fix in post if necessary.

[A_n_g_e_l_a]

In my5-dl/my5getter.py change the 'bv,ba', line to 'bv+10', that should fix the codec order issue.

I'll release this change eventually.

[peterb999]

Thanks Angela. That worked. Oddly, the output folder has the .vtt subtitle file as well as the .mp4 file.

[A_n_g_e_l_a]

Oddly, the output folder has the .vtt subtitle file .

Which version are you using? I thought I had released a fix for that with v5

[peterb999]

Hi Angela, yes, I am using version 5 of your script.

[Spectrumhsm]

Hi Back asking for help after much progress as I am still learning.
The error I am getting:

An All4 Video Search, Selector and Downloader.


Search word(s)?    Irish Journey
[info] getting data for https://www.channel4.com/programmes/julia-bradburys-irish-journey

Use up/down keys + spacebar to de-select or re-select videos to download

******************************************************************************************************************************************************************************************************
[  URL  ] https://www.channel4.com/programmes/julia-bradburys-irish-journey/on-demand/74774-001
[ KEY ] dc5285711065f2ba1c6a204d6dd325c1:37f7dc4fdff57c1716fd59d10b154174
[ KEY ] dc5285711065f2ba1c6a204d6dd325c1:37f7dc4fdff57c1716fd59d10b154174
[ KEY ] dc5285711065f2ba1c6a204d6dd325c1:37f7dc4fdff57c1716fd59d10b154174
[  MPD  ] http://ak.dash01.stream.c4assets.com/wvmod-stream/CH4_33_05_42_74774001001001_004_HD.mpd?c3.ri=13503853113333849153
******************************************************************************************************************************************************************************************************
Julia_Bradburys_Irish_Journey_S01E01 South
Traceback (most recent call last):
  File "C:\UK-FTA\c4-dl\chan4_loader.py", line 284, in <module>
    myAll4 = C4.main(url)
             ^^^^^^^^^^^^
  File "C:\UK-FTA\c4-dl\C4.py", line 488, in main
    get_streams(config.drm_today.video.url, decryption_key, videoname, encrypted_vod_stream.brand_title)
  File "C:\UK-FTA\c4-dl\C4.py", line 353, in get_streams
    subprocess.run(command)
  File "C:\Program Files\WindowsApps\PythonSoftwareFoundation.Python.3.11_3.11.1776.0_x64__qbz5n2kfra8p0\Lib\subprocess.py", line 548, in run
    with Popen(*popenargs, **kwargs) as process:
         ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\Program Files\WindowsApps\PythonSoftwareFoundation.Python.3.11_3.11.1776.0_x64__qbz5n2kfra8p0\Lib\subprocess.py", line 1026, in __init__
    self._execute_child(args, executable, preexec_fn, close_fds,
  File "C:\Program Files\WindowsApps\PythonSoftwareFoundation.Python.3.11_3.11.1776.0_x64__qbz5n2kfra8p0\Lib\subprocess.py", line 1538, in _execute_child
    hp, ht, pid, tid = _winapi.CreateProcess(executable, args,
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
FileNotFoundError: [WinError 2] The system cannot find the file specified

I am trying to download the first file:

Search word(s)?    Irish Journey
[info] getting data for https://www.channel4.com/programmes/julia-bradburys-irish-journey

Use up/down keys + spacebar to de-select or re-select videos to download

[?] 1  1 https://www.channel4.com/programmes/julia-bradburys-irish-journey/on-demand/74774-001
[?] 1  2 https://www.channel4.com/programmes/julia-bradburys-irish-journey/on-demand/74774-002
[?] 1  3 https://www.channel4.com/programmes/julia-bradburys-irish-journey/on-demand/74774-003
[?] 1  4 https://www.channel4.com/programmes/julia-bradburys-irish-journey/on-demand/74774-004

I am running the script from a windows machine.

Any feedback appreciated.
Thanks.

[A_n_g_e_l_a]

Hi Back asking for help after much progress as I am still learning.
The error I am getting:

FileNotFoundError: [WinError 2] The system cannot find the file specified

Sorry not to have picked this up sooner. Perhaps you've already solved it yourself?

The process is N_m3u8DL-RE trying to run and file not found suggests you are missing some of the necessary binaries, either N-m itself or what it uses to decrypt and merge.
Check from a command window by typing the names of the binaries in the README file in the top level UK-FTA folder.
eg
N_m3u8DL-RE followed by Return. Each binary thus called will respond with its helpfile - the lack of meaningful response should highlight what is missing.

[Spectrumhsm]

Thanks Angela for the suggestion. It was N-m issue as you suspected. It worked.

Curious what is the need for Firefox GeckoDriver?

Thanks a lot.

[A_n_g_e_l_a]

Curious what is the need for Firefox GeckoDriver?

Channel5 encrypts some of the details we need to read before getting keys. It uses a HMAC secret and an AES key. Only, Channel5 change the HMAC and AES data around every 8 days. Diazole - who found a way to decrypt the data - also gave us a javascript routine to find the HMAC and AES from Channel5. It means running a local file in your browser. You can do that to get the H and A data. The html file is in the keys folder of my5-dl.

As I said you can do that every 7 or 8 days and take the result and update the config file within the my5-dl folder if you wish. Another way is to have the html file on a server somewhere so you can just call that and parse the page delivered to get your H and A data. Since I don't have a remote server tucked away, I use a local browser, on your machine, to run the local html file and parse the contents. The html file needs access to a javascript engine within the browser. So GeckoDriver provides all the binary code needed to run a browser from python. It is 'headless' in the sense you do not see it run and web pages load etc. It does all that behind the scenes. So unseen to you, the H and A appear on a web-page, gets parsed (read) and then saved into the the config file in my5-dl.

I think, but I am not sure, if you have your own install of Firefox as a legitimate browser on your system, then the code finds a geckoDriver there already. Otherwise you will need to provide one.

If you wish to look over the code to make sure the browser isn't enrolling you in all sort of subscriptions or clicking billions of adverts look at hmac-aes-update.py

To use it you need to make two edits within the file to a couple of lines.

[peterb999]

Hi Angela. Thanks for your great work. Just to confirm, I have firefox installed on my PC and I didn't have to download the geckodriver. It updated fine so as you say it must be able to use the installed firefox instead of the driver.

[A_n_g_e_l_a]

Just to confirm, I have firefox installed on my PC and I didn't have to download the geckodriver.

Thanks for the confirmation, Peter.

[edit] removed as no longer relevant[/edit]

[Spectrumhsm]

Hi Angela. Thanks for your great work. Just to confirm, I have firefox installed on my PC and I didn't have to download the geckodriver. It updated fine so as you say it must be able to use the installed firefox instead of the driver.

Oh lovely. One less requirement!

Angela, are you planning to add bbc iPlayer?

Thanks for the great work.

[A_n_g_e_l_a]

Angela, are you planning to add bbc iPlayer?

That was never the plan. The BBC's output is unencrypted so is not difficult to get. Since the BBC's output plays though a Smart-TV on demand, without adverts, I personally don't feel the need to grab very much - my aim of downloading being to avoid advertising breaks! But there already exists some good software that will get get what you need.

There is get_iplayer at the top of the heap . It has been around forever. You can set-up a 'personal video-recorder' in software and use it to download each program in a series automatically, as soon as it becomes available. I cannot better that and wouldn't want to try. There is a graphic interface via a web-page from a locally hosted server or you can just use the command line tool to search and download programmes directly. See https://github.com/get-iplayer/get_iplayer. Get_iplayer works both for TV and Radio broadcasts. If you use Linux your distribution will have it already to download. Get_iplayer will download 1080p if available by setting '--quality=uhd'

Or there is yt-dlp that will grab stuff readily from the BBC address-bar url. You already have yt-dlp - from the command line yt-dlp <bbc-url> is the most basic of commands, but yt-dlp --help will show others - or search the forum. yt-dlp will download at 720p. But 4k downloads are available to some and will hit mainstream at sometime.

Or Stabbies emporium has a BBC tool I understand.

[sipho]

I uploaded a mod to the yt-dlp extractor that gives 1080p.

[A_n_g_e_l_a]

I uploaded a mod to the yt-dlp extractor that gives 1080p.

Good to know.
Is that the one that uses a certificate?