drm free content batch downloader, widefrog

[cedric8528]

app_files/config.json

[DogancanYr]

How can I assign N_m3u8DL-RE to a system environment variable?

[cedric8528]

https://www.eukhost.com/kb/how-to-add-to-the-path-on-windows-10-and-windows-11/

[DogancanYr]

https://www.eukhost.com/kb/how-to-add-to-the-path-on-windows-10-and-windows-11/

Thank you.
I finally understood.
It should be written like this C:\Users\ %User name% \Desktop\N_m3u8DL-RE_v0.3.0-beta_win-x64_20241203 not like this C:\Users\%User name% \Desktop\N_m3u8DL-RE_v0.3.0-beta_win-x64_20241203\N_m3u8DL-RE.exe

You also need to go to the folder with the cd command and run it in that location. Otherwise it gives the error “terminal is missing”.

[Data2006]

Hello everyone,

I've recently been getting this error on plus.rtl.de:
heiko@Worf:~/Downloads/Widefrog v3.2.0$ python3 widefrog.py https://plus.rtl.de/video-tv/serien/unter-uns-41137/2025-3-1023007/episode-7591-streit...-preis-1002250
[INFO] Linux detected. Chosen terminal: gnome-terminal. Chosen shell: bash.
[WARNING] Terminal script can't be executed: terminal/mkvmerge.sh. Insufficient privileges. Download commands won't be launched properly.
[INFO] Current app version: 3.2.0
[INFO] Running on: linux/64bit/python 3.10.12
[INFO] Starting the service initialization stage.
[INFO] Current progress: [1/1]
[INFO] Starting the collections extraction stage.
[INFO] Current progress: [1/1]
[INFO] Starting the media data extraction stage.
[USER_ERROR]/[APP_ERROR] Failed to download: https://plus.rtl.de/video-tv/serien/unter-uns-41137/2025-3-1023007/episode-7591-streit...-preis-1002250. Reason: Failed to extract content data. Solution: Make sure you can play the content. If you can, then debug the plus_rtl_de service.
[INFO] Finished generating the download commands.
[WARNING] Saved the failed URLs to app_files/cmds_failed.txt
[WARNING] No download commands have been generated.
heiko@Worf:~/Downloads/Widefrog v3.2.0$

What can I do?

Best regards
Heiko

[Lostion]

RTL changed the API to a new one.

[Data2006]

Hello everyone,

I've recently been getting this error on plus.rtl.de:
heiko@Worf:~/Downloads/Widefrog v3.2.0$ python3 widefrog.py https://plus.rtl.de/video-tv/serien/unter-uns-41137/2025-3-1023007/episode-7591-streit...-preis-1002250
[INFO] Linux detected. Chosen terminal: gnome-terminal. Chosen shell: bash.
[WARNING] Terminal script can't be executed: terminal/mkvmerge.sh. Insufficient privileges. Download commands won't be launched properly.
[INFO] Current app version: 3.2.0
[INFO] Running on: linux/64bit/python 3.10.12
[INFO] Starting the service initialization stage.
[INFO] Current progress: [1/1]
[INFO] Starting the collections extraction stage.
[INFO] Current progress: [1/1]
[INFO] Starting the media data extraction stage.
[USER_ERROR]/[APP_ERROR] Failed to download: https://plus.rtl.de/video-tv/serien/unter-uns-41137/2025-3-1023007/episode-7591-streit...-preis-1002250. Reason: Failed to extract content data. Solution: Make sure you can play the content. If you can, then debug the plus_rtl_de service.
[INFO] Finished generating the download commands.
[WARNING] Saved the failed URLs to app_files/cmds_failed.txt
[WARNING] No download commands have been generated.
heiko@Worf:~/Downloads/Widefrog v3.2.0$

What can I do?

Best regards
Heiko

[Obo]

Wait until @2nHxWW6GkN1l916N3ayz8HQoi can fix the issue. It's a simple change on RTL's side - they changed the URL from where they serve mpd and license urls.

[Lostion]

They also changed the API Answer itself it now has no "data" part anymore but should be a quick fix.

Also now its a lot simpler to make the API request because no hash anymore.

[Obo]

Jep. However, I think it's better not to remove the old graphql query yet, since the browser uses both requests. Overall a simple fix, but @2nHxWW6GkN1l916N3ayz8HQoi has to refactor part of the service script.

[issamrehabi]

Guys i can't download from shahid vip contanant only free contanant , netflix too doesn't work !! anymore

[khaledgamil]

I have a direct link from the FIFA+ website

https://www.plus.fifa.com/en/player/8ff49a0b-1ba1-4ab1-965e-c37da2602c15?catalogId=690679f3-08c5-4d5b-a138-5aabc3caea6e

and when I put it this in (Widefrog) to convert it to command it will be like this

N_m3u8DL-RE "http://d33tkx2907c8gi.cloudfront.net/s/vod/main_102/FIM102241-M00_v05.1c824598_SDR_20230630-1708/FIM102241-M00_v05.1c824598_SDR.eng_mul.h264_SDHDP.cenc_subs.mpd" --key 794ec4ff1c27797c83ab0d9ee5d95e81:e08aa648a8d021299ff28731ca52a4c4 --tmp-dir "media\tmp\NgIokiz" --save-dir "media\plus_fifa_com\Brazil_v_Netherlands_Semi-finals_1998_FIFA_World_Cup_Francetm_Highlights" --save-name "content" -sv best -sa best -da id=audio_div -ss all -mt --check-segments-count false --no-log -M format=mkv:muxer=mkvmerge & "terminal\mkvmerge.bat" "media\plus_fifa_com\Brazil_v_Netherlands_Semi-finals_1998_FIFA_World_Cup_Francetm_Highlights.mkv" "media\plus_fifa_com\Brazil_v_Netherlands_Semi-finals_1998_FIFA_World_Cup_Francetm_Highlights" true & rd /s /q "media\tmp\NgIokiz"

Thus, when I download the command through (N_m3u8DL-RE), it create a folder and inside the video file, and what I want is that the video file is outside the folder, and It does not create folder.

[Attachment 86534 - Click to enlarge]
Can anyone give me the correct config.json code to do that?

** and this is the code what I used in (Widefrog)

FOR /F %A in (text.txt) DO widefrog.exe %A

[Lostion]

If you use .bat or .cmd

FOR /F %%A in (text.txt) DO widefrog.exe %%A

Double %

[khaledgamil]

If you use .bat or .cmd
FOR /F %%A in (text.txt) DO widefrog.exe %%A
Double %

It didn't work for me


[Attachment 86540 - Click to enlarge]

[Lostion]

In a .bat/.cmd file not directly in command line.

What are you even want to try?

[khaledgamil]

test

[ErikDB]

I would like to run the program on my headless Debian NAS, but that raises a challenge with cookies of course. I located Firefox's "cookies.sqlite" file on my Windows machine, but I can't figure out where to put it, so "browser_cookie3" finds it on the Debian machine... Any advice is welcome

[ErikDB]

I'd thought I'd try emulating the Firefox profile folder, but I didn't get there yet:

(venv) erik@piholeNASLXC:~/schrapen/widefrog$ sudo apt-get install firefox
Reading package lists... Done
Building dependency tree... Done
Reading state information... Done
firefox is already the newest version (137.0.1~build1).
0 upgraded, 0 newly installed, 0 to remove and 0 not upgraded.
(venv) erik@piholeNASLXC:~/schrapen/widefrog$ python widefrog.py
[WARNING] Firefox browser is not installed. Services that require browser cookies won't work as intended.

Firefox is installed, no?

At first, I thought it could have something to do with this:

(venv) erik@piholeNASLXC:~/schrapen/widefrog$ playwright install
Playwright Host validation warning:
╔══════════════════════════════════════════════════════╗
║ Host system is missing dependencies to run browsers. ║
║ Missing libraries:                                   ║
║     libgtk-4.so.1                                    ║
║     libwoff2dec.so.1.0.2                             ║
║     libgstcodecparsers-1.0.so.0                      ║
║     libwebpdemux.so.2                                ║
║     libharfbuzz-icu.so.0                             ║
║     libenchant-2.so.2                                ║
║     libsecret-1.so.0                                 ║
║     libhyphen.so.0                                   ║
║     libmanette-0.2.so.0                              ║
║     libGLESv2.so.2                                   ║
╚══════════════════════════════════════════════════════╝
    at validateDependenciesLinux (/home/erik/schrapen/widefrog/venv/lib/python3.11/site-packages/playwright/driver/package/lib/server/registry/dependencies.js:216:9)
    at process.processTicksAndRejections (node:internal/process/task_queues:105:5)
    at async Registry._validateHostRequirements (/home/erik/schrapen/widefrog/venv/lib/python3.11/site-packages/playwright/driver/package/lib/server/registry/index.js:859:52)
    at async Registry._validateHostRequirementsForExecutableIfNeeded (/home/erik/schrapen/widefrog/venv/lib/python3.11/site-packages/playwright/driver/package/lib/server/registry/index.js:957:7)
    at async Registry.validateHostRequirementsForExecutablesIfNeeded (/home/erik/schrapen/widefrog/venv/lib/python3.11/site-packages/playwright/driver/package/lib/server/registry/index.js:946:43)
    at async t.<anonymous> (/home/erik/schrapen/widefrog/venv/lib/python3.11/site-packages/playwright/driver/package/lib/cli/program.js:122:7)

But then I ran `playwright install-deps`, after some googling, and now that problem is gone, but the earlier isn't:

(venv) erik@piholeNASLXC:~/schrapen/widefrog$ playwright install
(venv) erik@piholeNASLXC:~/schrapen/widefrog$ python widefrog.py
[WARNING] Firefox browser is not installed. Services that require browser cookies won't work as intended.

[khaledgamil]

Test

[diesel]

Hello,

How to download the 15 episodes of the 2025 season from the RTLPlay website: https://www.rtlplay.be/rtlplay/enquetes~2ab5e679-ca29-4474-ae8c-433bf9995915

best regards

[A_n_g_e_l_a]

@2nHxWW6GkN1l916N3ayz8HQoi Your software suite has been around a good while now. I'd seen it earlier, of course, but never had occasion to use it. Now I have; salutations for an excellent job. No other downloader has so many services. Widefrog must be regarded as supreme!

[ErikDB]

[Something about complaints because allegedly, Firefox was not installed.]

I went ahead and tried downloading anyway (using this URL: https://www.goplay.be/video/callboys/callboys-s2/callboys-s2-de-muur-als-symbool-van-wat-dan-is). It worked.

BUT I had to fix `[venv]/lib/python3.11/site-packages/browser_cookie3/__init__.py`, as described here: https://github.com/borisbabic/browser_cookie3/issues/211.

[ErikDB]

If I try to download https://www.vtmgo.be/vtmgo/afspelen/9ba7e6ce-a77b-46fb-ad3b-719881c603ec on my headless Debian (which succeeded in downloading from Go Play), I see this:

(venv) erik@piholeNASLXC:~/schrapen/widefrog$ python widefrog.py --debug "https://www.vtmgo.be/vtmgo/afspelen/9ba7e6ce-a77b-46fb-ad3b-719881c603ec"
[INFO] Current app version: 3.2.0
[INFO] Running on: linux/64bit/python 3.11.2
[INFO] Starting the service initialization stage.
[INFO] Current progress: [1/1]
[INFO] Starting the collections extraction stage.
[INFO] Current progress: [1/1]
[INFO] Starting the media data extraction stage.
Traceback (most recent call last):
  File "/home/erik/schrapen/widefrog/widefrog.py", line 124, in <module>
    main_service.run_service(response)
  File "/home/erik/schrapen/widefrog/utils/main_service.py", line 442, in run_service
    dwn_cmds, failed_cmds, proc_cmds = main_service.get_download_commands_parallel(demo_urls)
                                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/erik/schrapen/widefrog/utils/main_service.py", line 395, in get_download_commands_parallel
    success, fail, proc = future.result()
                          ^^^^^^^^^^^^^^^
  File "/usr/lib/python3.11/concurrent/futures/_base.py", line 449, in result
    return self.__get_result()
           ^^^^^^^^^^^^^^^^^^^
  File "/usr/lib/python3.11/concurrent/futures/_base.py", line 401, in __get_result
    raise self._exception
  File "/usr/lib/python3.11/concurrent/futures/thread.py", line 58, in run
    result = self.fn(*self.args, **self.kwargs)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/erik/schrapen/widefrog/utils/main_service.py", line 281, in get_download_commands
    raise e
  File "/home/erik/schrapen/widefrog/utils/main_service.py", line 266, in get_download_commands
    dl_cmds, pr_cmds = main_service.get_download_command(service, source_element)
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/erik/schrapen/widefrog/utils/main_service.py", line 84, in get_download_command
    raise e
  File "/home/erik/schrapen/widefrog/utils/main_service.py", line 63, in get_download_command
    manifest, pssh, additional = service.get_video_data(source_element)
                                 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/erik/schrapen/widefrog/services/vtmgo_be.py", line 125, in get_video_data
    raise CustomException(ERR_MSG.format(
utils.structs.CustomException: [USER_ERROR]/[APP_ERROR] Failed to download: https://www.vtmgo.be/vtmgo/afspelen/9ba7e6ce-a77b-46fb-ad3b-719881c603ec. Reason: This content is no longer available or refresh the site cookies or VPN issues (Belgium). Solution: Do not attempt to download it or sign into your account using Firefox and play a random video or fix your VPN. If it persists then debug the service.

I didn't alter anything to `app_files/config.json`:

(venv) erik@piholeNASLXC:~/schrapen/widefrog$ cat app_files/config.json
{
    "CDM_WVD_FILE_PATH": "gift_from_karoolus.wvd",
    "USER_AGENT": "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36 Edg/123.0.0.0",
    "NUMBER_OF_THREADS": {
        "DATA_SCRAPER": 5,
        "MEDIA_DOWNLOADER": 1
    },
    "DOWNLOAD_COMMANDS": {
        "OUTPUT_MEDIA_PATH": "media",
        "WAIT_BEFORE_DOWNLOADING": true,
        "ADDITIONAL_SUBS": true,
        "TOOL_PARAMETERS": {
            "VOD": "-sv best -sa best -da id=audio_div -ss all -mt --check-segments-count false --no-log",
            "LIVESTREAM": "--live-pipe-mux --live-record-limit 00:02:00"
        }
    },
    "SERVICE_CREDENTIALS": {
        [omitted]
    },
    "WARN_EXTERNAL_TOOLS": false
}

It also fails on my "head having" Ubuntu machine... I played a video on vtmgo.be on the Ubuntu machine and before copying the cookie file to the Debian machine, as I had done with the goplay.be download.

Any idea what might cause this?

[Data2006]

Good evening.

When will a new version be available when RTL+ is back on?

Best regards
Heiko

[Obo]

@Data2006: here is a patch that should work:

diff  a/services/plus_rtl_de.py b/services/plus_rtl_de.py
--- a/services/plus_rtl_de.py
+++ b/services/plus_rtl_de.py
@@ -487,6 +487,34 @@ class plus_rtl_de(BaseService):
             quality = variant["type"].lower().replace("dash", "")
             video_contents.append((manifest, license_url, quality))
 
+        if len(video_contents) == 0:
+            response = json.loads(requests.get(
+                f'https://stus.player.streamingtech.de/watch-playout-variants/{graphql_id}?platform=web',
+                headers={'x-auth-token': plus_rtl_de.AUTH_TOKEN}).content.decode())
+            for variant in response:
+                license_url = None
+                for licence in variant["licenses"]:
+                    if "widevine" not in licence["type"].lower():
+                        continue
+                    license_url = licence["uri"]["href"]
+                    break
+                if license_url is None:
+                    continue
+
+                manifest = None
+                for source in variant["sources"]:
+                    if "main" not in source["priority"].lower():
+                        continue
+                    if ".mpd" not in source["url"]:
+                        continue
+                    manifest = source["url"]
+                    break
+                if manifest is None:
+                    continue
+
+                quality = variant["name"].lower().replace("dash", "")
+                video_contents.append((manifest, license_url, quality))
+
         video_contents = sorted(
             video_contents, key=lambda vc: plus_rtl_de.RES_PRIORITY[vc[2]], reverse=True
         )[0]

The patched service file is attached as well

[Data2006]

Hello.

Thanks, the new plus_rtl_de.py works again.

Best regards
Heiko

[khaledgamil]

"Is there a way to do this automatically instead of typing 'yes' every time?"


[Attachment 86664 - Click to enlarge]

[Obo]

Edit "app_files/config.json", set "WAIT_BEFORE_DOWNLOADING" to "false"

[khaledgamil]

Edit "app_files/config.json", set "WAIT_BEFORE_DOWNLOADING" to "false"

Thank you.

[Dafalgan]

Hi,

When i try to download from VRT i keep getting the cookies error.
Any possible fix?