drm free content batch downloader, widefrog

[diesel]

hello

how to update it
there is no update command why?
is this possible in future versions

do you plan to integrate arte.tv into a French channel

good job

[2nHxWW6GkN1l916N3ayz8HQoi]

There's no update command because you're supposed to do it manually and I won't change that. To update, first delete entirely the tool folder with all and then:
- if you use the python version, download the latest python zip, do the installation from scratch by using the latest requirements.txt file like I told you in post #116
- if you use the executable version (windows, linux, macos), download the latest zip and that's it

I don't add sites by request. Either way, arte.tv won't be added ever because it's been already solved a long time ago. Use yt-dlp for individual videos and if you want multiple at once just use
https://addons.mozilla.org/en-US/firefox/addon/link-gopher/
with a custom launch yt-dlp script.

[Lostion]

So i did some digging on the live streams on plus.rtl.de

Very interesting!
https://plus.rtl.de/video-tv/live-tv/rtl-1

Here you get 1280x720 with 50 fps (with premium acc)

But all the "theme" stations (https://plus.rtl.de/video-tv/live-tv) like:
https://plus.rtl.de/video-tv/live-tv/alarm-fuer-cobra-11-balko-60

give you 960x576 with 25 fps.

Well i did some digging

If you make a request (like widefrog is doing)
You end with something like this:

"type": "dashhd",
                    "sources": [
                        {
                            "url": "https://csm-e-cbcd-eb.tls1.yospace.com/csm/extlive/rtlcbcprd01,drm-fast01-dash.mpd{tokenstuff}

Well if you edit the url to https://csm-e-cbcd-eb.tls1.yospace.com/csm/extlive/rtlcbcprd01,drm-rlthd-dash.mpd

You will get the 1280x720 with 50 fps manifest

Still trying to find out if there is a 1920x1080 manifest (live events have 1080p like euro league football).

But so far no luck seams like the normal live streams and theme stations are capped at 1280x720.

Edit: I think 1280x720 cap has a reason because its the original broadcast signal with advertising which airs in 1080i over satellite it could be that the 1280x720 is just the 1080i signal deinterlaced and thats why its capped to 1280x720.

Also the theme stations are actually paytv stations thats why they officially capped at 960x576 seems like some license bullshit because you must pay extra to get the satellite feed so well now we have the 720p stream of it

Edit2: It works on all 8 "theme" stations.

[2nHxWW6GkN1l916N3ayz8HQoi]

So, basically, for all "/live-tv/" URLs, I just replace in their manifests -fast<digits>- with -rlthd- ?

[Lostion]

No seems not so easy

https://plus.rtl.de/video-tv/live-tv/rtl-1

Gives you one the "main" stations

https://plus.rtl.de/video-tv/live-tv

gives you the theme ones. Seems like there is no way to filter that out.

The problem is:

Main:
https://plus.rtl.de/video-tv/live-tv/rtl-1
https://plus.rtl.de/video-tv/live-tv/vox-4

Theme:
https://plus.rtl.de/video-tv/live-tv/hundkatzemaus-66
https://plus.rtl.de/video-tv/live-tv/alles-was-zaehlt-classics-64

I don't see a way to filter that out. The problem is that the manifest urls are different for the main channels. Its not all -rtlhd- sometimes its -nitrohd-, -voxhd- and so on.

hm good question how to solv that.

[2nHxWW6GkN1l916N3ayz8HQoi]

When for a livestream, the answer is not rtlhd, but nitrohd or whatever else. What happens if you still try with rtlhd? Do you get 404 not found manifest, or you get something but of inferior quality?

[Lostion]

Edit:

Ignore my posts i tested it if i replace it with -rtlhd- it actually gives me the RTL main feed but thats interesting seems like they are hardcoded but only accessible with a premium account.

[2nHxWW6GkN1l916N3ayz8HQoi]

Alright, so replace fast with rtlhd always for any live-tv URL. Got it. Thanks for the information, will add it in the next version.

[Lostion]

Btw. seems like RTL changed something in there podcast format

https://plus.rtl.de/podcast/dick-doof-wy9qhi0v5jf5k/neue-folge

"neue-folge" is now the newest episode?

https://plus.rtl.de/podcast/dick-doof-wy9qhi0v5jf5k <-- Page with all the episodes.

https://plus.rtl.de/podcast/dick-doof-wy9qhi0v5jf5k/neue-folge
https://plus.rtl.de/podcast/dick-doof-wy9qhi0v5jf5k/kacken-fuer-die-umwelt-16snrhxy9zfix

Seems like the newest episode has no ID at all?

[Lostion]

Alright, so replace fast with rtlhd always for any live-tv URL. Got it. Thanks for the information, will add it in the next version.

No its not working if you replace -fast- with -rtlhd- you actually and up with the mainfeed and not the "theme" station. Don't change anything, seems like there is no way to get 1280x720 for the theme stations. I only checked the resolutions now i checked the whole .mpd itself and it goes back to the main rtlhd channel and not the station one so yeah you will always have the same wrong channel.

[2nHxWW6GkN1l916N3ayz8HQoi]

Ok. Got it No changes. Thanks anyway for trying to find a consistent/working trick

Seems like the newest episode has no ID at all?

Probably temporary since the ID exists, only not in the URL.

python widefrog.py "https://plus.rtl.de/podcast/dick-doof-wy9qhi0v5jf5k/neue-folge"

Doesn't work naturally. While

python widefrog.py "https://plus.rtl.de/podcast/dick-doof-wy9qhi0v5jf5k" --query=:1::1

Works and can get it without any problems. If more of these appear (that aren't just the latest episode), I'll take a closer look at how to obtain the resource ID.

[Lostion]

Oh thanks for the tipp! That works

[monk87]

Hi pepe.

thanks for a great tool.

i wanted to use this for cda.pl but some videos are on premium plan and that would need an additional method for loading cookies exported from browser and merging them with cf_clearance

for my own purposes i added few lines to cda.py

def load_cookies_from_json(file_path):
    with open(file_path, 'r') as file:
        cookies = json.load(file)
    return {cookie['name']: cookie['value'] for cookie in cookies}

...

def get_video_data(source_url):
    all_cookies = {'cf_clearance': CLOUDFLARE['cf_clearance']}
    # Check if cookies.json exists and load it
    cookies_file = 'cookies.json'
    if os.path.exists(cookies_file):
        additional_cookies = load_cookies_from_json(cookies_file)
        all_cookies.update(additional_cookies)

    response = requests.get(
        source_url, cookies=all_cookies,

and it works but it would be nice to have a method in the program itself to load the cookies if provided

also does it support series on cda.pl?

[2nHxWW6GkN1l916N3ayz8HQoi]

Hello @monk. Thanks for the nice words.

For cookies I prefer https://github.com/borisbabic/browser_cookie3 which allows me to load existing cookies straight from the browser without the user needing to manually export them. I'll take a look and add always cookies if they exist in the next tool version.

For cda.pl you can download pages of content either from a folder or from a specific category. You can take a look at the first page (search for cda.pl) and you'll see all the command examples. They should still work if nothing was changed yet.

However, if by series you mean the classic URL structured in seasons/episodes, I don't think I found one like that in cda pl.

[grzech67]

Hello, after running the script I have an error, how can I fix it?



[Attachment 82516 - Click to enlarge]


When I run the script:

pip install virtualenv
virtualenv venv
venv\Scripts\activate

not all services are available


[Attachment 82529 - Click to enlarge]
and if I run normally, I have all of them available

[2nHxWW6GkN1l916N3ayz8HQoi]

Hello. Do a fresh installation from scratch like it was explained here.
https://forum.videohelp.com/threads/414548-drm-free-content-batch-downloader-widefrog/...e5#post2750863

If the services* that have warnings aren't relevant for you, you can just delete them from the services folder if you aren't willing to properly install all of the requirements.

[grzech67]

Hello, after running the script I have an error, how can I fix it?



[Attachment 82516 - Click to enlarge]


When I run the script:

pip install virtualenv
virtualenv venv
venv\Scripts\activate

Can someone tell me where I'm making a mistake?


not all services are available


[Attachment 82529 - Click to enlarge]
and if I run normally, I have all of them available

Can someone tell me where I'm making a mistake?

[Obo]

You don't have a clean installation. Do as recommended in #136.

[2nHxWW6GkN1l916N3ayz8HQoi]

Can someone tell me where I'm making a mistake?

In addition to what @obo said, make sure you installed all of the packages from the requirements.txt file. You can't create an env, activate it, and expect all packages to be already installed there. The point of a env is to separate a project. After the project is separated, the relevant packages have to be installed in a fresh env. And the proper command is explained in the first post. Don't install wrong

The zip has the requirements.txt file included. If you want to install the packages using virtualenv, then run (it may vary for your OS):

pip install virtualenv
virtualenv venv
venv\Scripts\activate

After doing it correctly, you should see the (venv) prefix in your terminal. DO NOT attempt to install the Python dependencies using the command: pip install -r requirements.txt

It will fail because there are version conflicts among some packages. Luckily this can be ignored if you install manually all packages. Or if you want to speed things up, you can just run in the terminal:

#windows
FOR /F %k in (requirements.txt) DO ( if NOT # == %k ( pip install %k ) )
#linux
grep -v '^#' requirements.txt | xargs -n 1 pip install
#macos
grep -v '^#' requirements.txt | xargs -n 1 pip3 install

Edit: and after that env is created, all you have to do is activate it each time you want to use the tool, don't create it each time since it's stored there in the folder

[grzech67]

I had a clean installation but I made the mistake of using the command:

pip install -r requirements.txt

when I used the recommended command:

FOR /F %k in (requirements.txt) DO ( if NOT # == %k ( pip install %k ) )

everything is ok


[Attachment 82532 - Click to enlarge]

Number of available services: 47


Thank you for your help

[2nHxWW6GkN1l916N3ayz8HQoi]

No problem. Glad you figured it out.

For veeps I think someone else had this problem too. For that package used by veeeps, you need vc++ 14
https://stackoverflow.com/questions/44951456/pip-error-microsoft-visual-c-14-0-is-required

However if you don't need it, just delete the service veep if the warning is annoying

Edit: the problem package is this.

pip install chompjs

I didn't mention this issue since I always had VC++ installed when setting up an OS

[EV Downloads]

I don't know if it goes here or not ....but same question : can widefrog/N_m3u8DL-RE auto download in mp4? It just saves time individually changing the command to download in mp4.

[2nHxWW6GkN1l916N3ayz8HQoi]

Nope. As I mentioned in the first post

The output is always MKV, regardless if someone wants to download only video, only audio, or even only subtitles.

You can play with the generated commands and obtain mp4 but the tool is designed for mkv. It's what I use for everything and didn't bother with other format since it's not relevant for me. You can just use a txt file where you drop all of your URLs at once (doesn't matter the number, could be even >100) and then you do

python widefrog.py "urls.txt"

And you can edit all the generated commands at once in notepad with a simple find/replace all

[EV Downloads]

Nope. As I mentioned in the first post

The output is always MKV, regardless if someone wants to download only video, only audio, or even only subtitles.

You can play with the generated commands and obtain mp4 but the tool is designed for mkv. It's what I use for everything and didn't bother with other format since it's not relevant for me. You can just use a txt file where you drop all of your URLs at once (doesn't matter the number, could be even >100) and then you do

python widefrog.py "urls.txt"

And you can edit all the generated commands at once in notepad with a simple find/replace all

Thanks. Sorry for not reading properly, I thought probably there is a way to automate the process.

[grzech67]

command

python widefrog.py "urls.txt"

[Attachment 82552 - Click to enlarge]