need help with py script

[whs912km]

hi there,
i have a lots of video links series like this one https://streamingcommunity.buzz/watch/9949?e=76977
the video link changes for each episode with a consecutive number after '?e=' like 76978 (but this isn't fixed rules: sometimes the number is not consecutive, so i need to add the video link with the correct number)

well, what i would is a py script that add video link and print the playlist url like this one:

https://vixcloud.co/playlist/262090?token=b531e4f58bxxxxxx95a3&expires=17xxxxx87&h=1

i've try to ask help on AI, but AI can't test from a specific site, so the information give is generic ... the plist above is generated by js script so only with manually testing the site can you create a right py script, otherwise the information remains generic and does not work for this site.
i see that in this forum there are many good users with python. maybe some of you can give me a hand for this py script

[2nHxWW6GkN1l916N3ayz8HQoi]

Judging by the fact that you can watch Netflix content on it, and even the "Penguin" series for free, that site is warez

[whs912km]

oh yes, maybe yu're right
and then? the link not required login and is free to watch. I don't think this is against the rules of this forum ...

[aqzs]

Season 1 :

Enter the page URL: https://streamingcommunity.buzz/titles/9949-midnight-diner-tokyo-stories
N_m3u8DL-RE "https://vixcloud.co/playlist/262090?token=0556ba860e7c4daa13a9d78a4c81104d&expires=1732102151&h=1" --save-name Midnight.Diner.Tokyo.Stories.S1E1.Tan.Men -sv best -sa all -ss all -mt -M format=mkv  --log-level OFF
N_m3u8DL-RE "https://vixcloud.co/playlist/262091?token=dc3102cdb42603730f8b6bc4b2746045&expires=1732102152&h=1" --save-name Midnight.Diner.Tokyo.Stories.S1E2.Corn.Dog -sv best -sa all -ss all -mt -M format=mkv  --log-level OFF
N_m3u8DL-RE "https://vixcloud.co/playlist/262092?token=c445214db09517dd6aadf131cac34145&expires=1732102152&h=1" --save-name Midnight.Diner.Tokyo.Stories.S1E3.Tonteki -sv best -sa all -ss all -mt -M format=mkv  --log-level OFF
N_m3u8DL-RE "https://vixcloud.co/playlist/262093?token=cee068440719bf8cb9b125b44381d28c&expires=1732102153&h=1" --save-name Midnight.Diner.Tokyo.Stories.S1E4.Frittata.di.riso -sv best -sa all -ss all -mt -M format=mkv  --log-level OFF
N_m3u8DL-RE "https://vixcloud.co/playlist/262094?token=b862a6d435cd10980dd67f37e3a5208e&expires=1732102153&h=1" --save-name Midnight.Diner.Tokyo.Stories.S1E5.Tofu.all.uovo -sv best -sa all -ss all -mt -M format=mkv  --log-level OFF
N_m3u8DL-RE "https://vixcloud.co/playlist/262095?token=7c2242cc03663e06dadc05778e14aa1d&expires=1732102154&h=1" --save-name Midnight.Diner.Tokyo.Stories.S1E6.Prugna.amara.e.vino.di.prugne -sv best -sa all -ss all -mt -M format=mkv  --log-level OFF
N_m3u8DL-RE "https://vixcloud.co/playlist/262096?token=d4ccb7a04f2927871c959a2d6d6b7a29&expires=1732102154&h=1" --save-name Midnight.Diner.Tokyo.Stories.S1E7.Stufato.per.uno -sv best -sa all -ss all -mt -M format=mkv  --log-level OFF
N_m3u8DL-RE "https://vixcloud.co/playlist/262097?token=add141e4cb9e4796c051ff9a4c7bd6e9&expires=1732102155&h=1" --save-name Midnight.Diner.Tokyo.Stories.S1E8.Patate.dolci.saltate.in.padella -sv best -sa all -ss all -mt -M format=mkv  --log-level OFF
N_m3u8DL-RE "https://vixcloud.co/playlist/262098?token=6ef7dbeffd81e5018da17876548cb0fb&expires=1732102155&h=1" --save-name Midnight.Diner.Tokyo.Stories.S1E9.Cotoletta.di.prosciutto -sv best -sa all -ss all -mt -M format=mkv  --log-level OFF
N_m3u8DL-RE "https://vixcloud.co/playlist/262099?token=460b5c98b6ba50d435fdded20ce41eb2&expires=1732102156&h=1" --save-name Midnight.Diner.Tokyo.Stories.S1E10.Spaghetti.di.Capodanno.di.nuovo -sv best -sa all -ss all -mt -M format=mkv  --log-level OFF

Season 2 :

Enter the page URL: https://streamingcommunity.buzz/titles/9949-midnight-diner-tokyo-stories/stagione-2
N_m3u8DL-RE "https://vixcloud.co/playlist/262100?token=f6d1f64ca34875e16518b5b660b82a09&expires=1732102165&h=1" --save-name Midnight.Diner.Tokyo.Stories.S2E1.Pollo.e.riso.fritto -sv best -sa all -ss all -mt -M format=mkv  --log-level OFF
N_m3u8DL-RE "https://vixcloud.co/playlist/262101?token=9f4152024894e6ba319bbce90b1acd3f&expires=1732102166&h=1" --save-name Midnight.Diner.Tokyo.Stories.S2E2.Petto.di.pollo.fritto.con.formaggio -sv best -sa all -ss all -mt -M format=mkv  --log-level OFF
N_m3u8DL-RE "https://vixcloud.co/playlist/262102?token=129a257228e7cf9143d8b4734090c89c&expires=1732102166&h=1" --save-name Midnight.Diner.Tokyo.Stories.S2E3.Onigiri.con.prugna -sv best -sa all -ss all -mt -M format=mkv  --log-level OFF
N_m3u8DL-RE "https://vixcloud.co/playlist/262103?token=6b10bbcfc1a5ddcab2647d72e77461de&expires=1732102167&h=1" --save-name Midnight.Diner.Tokyo.Stories.S2E4.Ali.di.pollo.fritte -sv best -sa all -ss all -mt -M format=mkv  --log-level OFF
N_m3u8DL-RE "https://vixcloud.co/playlist/262104?token=6936e98ea926351f09cd6b054ffd0eb9&expires=1732102167&h=1" --save-name Midnight.Diner.Tokyo.Stories.S2E5.Panino.yakisoba -sv best -sa all -ss all -mt -M format=mkv  --log-level OFF
N_m3u8DL-RE "https://vixcloud.co/playlist/262105?token=52626ace7686cca35ebf4d9b0334fd96&expires=1732102168&h=1" --save-name Midnight.Diner.Tokyo.Stories.S2E6.Salmone.e.funghi -sv best -sa all -ss all -mt -M format=mkv  --log-level OFF
N_m3u8DL-RE "https://vixcloud.co/playlist/262106?token=d2df9e136efe1a773cc12946b35f05d3&expires=1732102168&h=1" --save-name Midnight.Diner.Tokyo.Stories.S2E7.Kitsune.udon -sv best -sa all -ss all -mt -M format=mkv  --log-level OFF
N_m3u8DL-RE "https://vixcloud.co/playlist/262107?token=64f9ad4096ab2848ad3abc6cb86275b1&expires=1732102169&h=1" --save-name Midnight.Diner.Tokyo.Stories.S2E8.Ramen.al.curry -sv best -sa all -ss all -mt -M format=mkv  --log-level OFF
N_m3u8DL-RE "https://vixcloud.co/playlist/262108?token=27a7938f5bbcb457a89172e950b689cd&expires=1732102169&h=1" --save-name Midnight.Diner.Tokyo.Stories.S2E9.Omelette.dolce.arrotolata -sv best -sa all -ss all -mt -M format=mkv  --log-level OFF
N_m3u8DL-RE "https://vixcloud.co/playlist/262109?token=8805cf376f5bc3411b1a4bbe6fe331e3&expires=1732102170&h=1" --save-name Midnight.Diner.Tokyo.Stories.S2E10.Granchio.e.toshikoshi.soba -sv best -sa all -ss all -mt -M format=mkv  --log-level OFF

[whs912km]

thank you @aqzs but i know how to find plist url trough browser. also i know how to use N_m3u8DL-RE for download (also yt-dlp can work fine)

but my goal is have py script to avoid going through the browser. It looks like you have a script that automates the process with just add the video link and that's what i would like. It would be appreciated if you could share this script or if you don't want at least some suggestions on how to get the plist link. thank you

PS: if you don't want to share the script publicly i can understand, but you could do it with PM

[2nHxWW6GkN1l916N3ayz8HQoi]

the link not required login and is free to watch. I don't think this is against the rules of this forum ...

Of course pirated content is free to watch

Read https://forum.videohelp.com/threads/72386-Forum-rules-Acceptable-Use-Policy-(AUP)?

[whs912km]

ok understand. CLOSED

PS @aqzs: just an hint. --log-level OFF for me does not work. the Log folder is created anyway. better use --no-log

[aqzs]

PS @aqzs: just an hint. --log-level OFF for me does not work. the Log folder is created anyway. better use --no-log

--log-level OFF is to remove logs during download, --no-log is to prevent N_m3u8DL-RE from writing the logs.
My log folder is 82MB with 7k files though

[whs912km]

i have delete Log folder, and with --no-log no log is created, neither during download, nor at the end. for me --no-log is better

[aqzs]

Since @whs912km asked me about this script and @lomero was interested, I'm publishing it

from slugify import slugify
import requests
from bs4 import BeautifulSoup
import re
import json
from pprint import pprint

def getep(playerid, episodeId=None):
    headers = {'Referer': 'https://streamingcommunity.buzz/watch/9949?e=76977','Upgrade-Insecure-Requests': '1','User-Agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/128.0.0.0 Safari/537.36','sec-ch-ua': '"Chromium";v="128", "Not;A=Brand";v="24", "Brave";v="128"','sec-ch-ua-mobile': '?0','sec-ch-ua-platform': '"macOS"',}
    if episodeId:
        params = (('episode_id', episodeId),)
        response = requests.get(f'https://streamingcommunity.buzz/iframe/{playerid}', headers=headers, params=params)
    else:
        response = requests.get(f'https://streamingcommunity.buzz/iframe/{playerid}', headers=headers)
    soup = BeautifulSoup(response.text, 'html.parser')
    iframe_tag = soup.find('iframe', {'ref': 'iframe'})
    if iframe_tag:
        iframe_src = iframe_tag.get('src')
        headers = {'accept': 'text/html,application/xhtml+xml,application/xml;q=0.9,image/avif,image/webp,image/apng,*/*;q=0.8','accept-language': 'fr-FR,fr;q=0.7','cache-control': 'no-cache','pragma': 'no-cache','priority': 'u=0, i','referer': 'https://streamingcommunity.buzz/','sec-ch-ua': '"Chromium";v="128", "Not;A=Brand";v="24", "Brave";v="128"','sec-ch-ua-mobile': '?0','sec-ch-ua-platform': '"macOS"','sec-fetch-dest': 'iframe','sec-fetch-mode': 'navigate','sec-fetch-site': 'cross-site','sec-fetch-user': '?1','sec-gpc': '1','upgrade-insecure-requests': '1','user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/128.0.0.0 Safari/537.36',}
        response = requests.get(iframe_src, headers=headers)
        matchs = {'url': r"url: '([^']+)'", 'token': r"'token': '([^']+)'", 'expires': r"'expires': '([^']+)'"}
        m = {}
        for match in matchs:
            mm = re.search(matchs[match], response.text)
            if mm:
                m[match] = mm.group(1)
            else:
                print(f"{match} not found")
        m3u8_url = f"{m['url']}?token={m['token']}&expires={m['expires']}&h=1"
        return m3u8_url
    else:
        print("No iframe tag found")

def getseason(pageurl):
    headers = {'Upgrade-Insecure-Requests': '1','User-Agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/128.0.0.0 Safari/537.36','sec-ch-ua': '"Chromium";v="128", "Not;A=Brand";v="24", "Brave";v="128"','sec-ch-ua-mobile': '?0','sec-ch-ua-platform': '"macOS"',}
    response = requests.get(pageurl, headers=headers)
    soup = BeautifulSoup(response.text, 'html.parser')
    app_div = soup.find('div', {'id': 'app'})
    if app_div and 'data-page' in app_div.attrs:
        data_page = app_div['data-page']
        data_page_json = json.loads(data_page)
        title = data_page_json['props']['title']['name']
        playerid = data_page_json['props']['title']['id']
        type = data_page_json['props']['title']['type']
        if type == 'movie':
            name = slugify(f"{title}", lowercase=False, separator='.')
            m3u8_url = getep(playerid)
            print(f"""N_m3u8DL-RE "{m3u8_url}" --save-name {name} -sv best -sa all -ss all -mt -M format=mkv  --log-level OFF""")
        else:
            season = data_page_json['props']['loadedSeason']
            if season:
                snumber = season['number']
                for episode in season['episodes']:
                    enumber = episode['number']
                    name = episode['name']
                    episodeId = episode['id']
                    m3u8_url = getep(playerid, episodeId)
                    name = slugify(f"{title} S{str(snumber).zfill(2)}E{str(enumber).zfill(2)} {name}", lowercase=False, separator='.')
                    print(f"""N_m3u8DL-RE "{m3u8_url}" --save-name "{name}" -sv best -sa all -ss all -mt -M format=mkv  --log-level OFF""")
    else:
        print("No data-page attribute found in the div with id 'app'")

urls = """
https://streamingcommunity.buzz/titles/147-mr-robot
"""
for url in urls.strip().splitlines():
    getseason(url)

[whs912km]

thank you so much for your script, really appreciated. I'm glad there are still people like you in this world

your script it's amazing! a BIG thank you

[lomero]

thanks for share @aqzs

I'll take a look at your script so can understand how this damn site works...!

[aqzs]

Thanks @whs912km and @lomero ! I appreciate your feedback as well

[maxprs]

Hello,
I'm trying the script and works really well in extracting all the urls.
So a big thanks to @aqzs
But for some reason if I put an extracted url in the player it doesn't work.
I've tried the script with:

https://streamingcommunity.buzz/titles/9949-midnight-diner-tokyo-stories

like the example above, but the urls I get are slightly different from the urls you posted. The new extracted urls don't work, the example urls above work fine.
I don't know if I'm doing something wrong, or if something has changed on that website.

Max

[lomero]

But for some reason if I put an extracted url in the player it doesn't work

explain better what you mean.
aqzs script works great i just tested it on the links you posted and it works. obviously you have to run the download with N_m3u8DL-RE from links generated from the script, but i think this is obvious ... so explain better your issue because the script works fine

[maxprs]

But for some reason if I put an extracted url in the player it doesn't work

explain better what you mean.
aqzs script works great i just tested it on the links you posted and it works. obviously you have to run the download with N_m3u8DL-RE from links generated from the script, but i think this is obvious ... so explain better your issue because the script works fine

Sure it works great, I've only said that I'm probably doing something wrong.
My target is not to download with N_m3u8DL-RE, I'm not using it at all.
I was looking for something that could extract the direct urls from Streaming Community, so I could put them in my own list and use them with the player on PC, or android TV (with Kodi).
I tested the original links posted above:

Enter the page URL: https://streamingcommunity.buzz/titles/9949-midnight-diner-tokyo-stories
N_m3u8DL-RE "https://vixcloud.co/playlist/262090?token=0556ba860e7c4daa13a9d78a4c81104d&expires=1732102151&h=1" --save-name Midnight.Diner.Tokyo.Stories.S1E1.Tan.Men -sv best -sa all -ss all -mt -M format=mkv  --log-level OFF
N_m3u8DL-RE "https://vixcloud.co/playlist/262091?token=dc3102cdb42603730f8b6bc4b2746045&expires=1732102152&h=1" --save-name Midnight.Diner.Tokyo.Stories.S1E2.Corn.Dog -sv best -sa all -ss all -mt -M format=mkv  --log-level OFF
N_m3u8DL-RE "https://vixcloud.co/playlist/262092?token=c445214db09517dd6aadf131cac34145&expires=1732102152&h=1" --save-name Midnight.Diner.Tokyo.Stories.S1E3.Tonteki -sv best -sa all -ss all -mt -M format=mkv  --log-level OFF
N_m3u8DL-RE "https://vixcloud.co/playlist/262093?token=cee068440719bf8cb9b125b44381d28c&expires=1732102153&h=1" --save-name Midnight.Diner.Tokyo.Stories.S1E4.Frittata.di.riso -sv best -sa all -ss all -mt -M format=mkv  --log-level OFF
N_m3u8DL-RE "https://vixcloud.co/playlist/262094?token=b862a6d435cd10980dd67f37e3a5208e&expires=1732102153&h=1" --save-name Midnight.Diner.Tokyo.Stories.S1E5.Tofu.all.uovo -sv best -sa all -ss all -mt -M format=mkv  --log-level OFF
N_m3u8DL-RE "https://vixcloud.co/playlist/262095?token=7c2242cc03663e06dadc05778e14aa1d&expires=1732102154&h=1" --save-name Midnight.Diner.Tokyo.Stories.S1E6.Prugna.amara.e.vino.di.prugne -sv best -sa all -ss all -mt -M format=mkv  --log-level OFF
N_m3u8DL-RE "https://vixcloud.co/playlist/262096?token=d4ccb7a04f2927871c959a2d6d6b7a29&expires=1732102154&h=1" --save-name Midnight.Diner.Tokyo.Stories.S1E7.Stufato.per.uno -sv best -sa all -ss all -mt -M format=mkv  --log-level OFF
N_m3u8DL-RE "https://vixcloud.co/playlist/262097?token=add141e4cb9e4796c051ff9a4c7bd6e9&expires=1732102155&h=1" --save-name Midnight.Diner.Tokyo.Stories.S1E8.Patate.dolci.saltate.in.padella -sv best -sa all -ss all -mt -M format=mkv  --log-level OFF
N_m3u8DL-RE "https://vixcloud.co/playlist/262098?token=6ef7dbeffd81e5018da17876548cb0fb&expires=1732102155&h=1" --save-name Midnight.Diner.Tokyo.Stories.S1E9.Cotoletta.di.prosciutto -sv best -sa all -ss all -mt -M format=mkv  --log-level OFF
N_m3u8DL-RE "https://vixcloud.co/playlist/262099?token=460b5c98b6ba50d435fdded20ce41eb2&expires=1732102156&h=1" --save-name Midnight.Diner.Tokyo.Stories.S1E10.Spaghetti.di.Capodanno.di.nuovo -sv best -sa all -ss all -mt -M format=mkv  --log-level OFF

If you copy one of those url and paste it for example into the Windows player, you see the stream working fine.

If I run ths script now, same entry, I get this:

N_m3u8DL-RE "https://vixcloud.co/playlist/262090?token=e043fcfc6ea7ad35f134c66f24d99ad9&expires=1733127072&h=1" --save-name "Midnight.Diner.Tokyo.Stories.S01E01.Tan.Men" -sv best -sa all -ss all -mt -M format=mkv  --log-level OFF
N_m3u8DL-RE "https://vixcloud.co/playlist/262091?token=6a59feaf8954553066a73427c6cfffe9&expires=1733127072&h=1" --save-name "Midnight.Diner.Tokyo.Stories.S01E02.Corn.Dog" -sv best -sa all -ss all -mt -M format=mkv  --log-level OFF
N_m3u8DL-RE "https://vixcloud.co/playlist/262092?token=d861aced9f986a6edfb2c4ceeb1e10f0&expires=1733127073&h=1" --save-name "Midnight.Diner.Tokyo.Stories.S01E03.Tonteki" -sv best -sa all -ss all -mt -M format=mkv  --log-level OFF
N_m3u8DL-RE "https://vixcloud.co/playlist/262093?token=3dedd6385112356c79f3c2dc1a224e81&expires=1733127073&h=1" --save-name "Midnight.Diner.Tokyo.Stories.S01E04.Frittata.di.riso" -sv best -sa all -ss all -mt -M format=mkv  --log-level OFF
N_m3u8DL-RE "https://vixcloud.co/playlist/262094?token=abb916f373fa2bfc41b213a44f217add&expires=1733127074&h=1" --save-name "Midnight.Diner.Tokyo.Stories.S01E05.Tofu.all.uovo" -sv best -sa all -ss all -mt -M format=mkv  --log-level OFF
N_m3u8DL-RE "https://vixcloud.co/playlist/262095?token=8ae1ea5c1d6421b7fe92877c7112033d&expires=1733127074&h=1" --save-name "Midnight.Diner.Tokyo.Stories.S01E06.Prugna.amara.e.vino.di.prugne" -sv best -sa all -ss all -mt -M format=mkv  --log-level OFF
N_m3u8DL-RE "https://vixcloud.co/playlist/262096?token=dbf4e60e93ff441f7936eaed6fe243f1&expires=1733127075&h=1" --save-name "Midnight.Diner.Tokyo.Stories.S01E07.Stufato.per.uno" -sv best -sa all -ss all -mt -M format=mkv  --log-level OFF
N_m3u8DL-RE "https://vixcloud.co/playlist/262097?token=ca611f0a1a21f698da45962f1bb90356&expires=1733127076&h=1" --save-name "Midnight.Diner.Tokyo.Stories.S01E08.Patate.dolci.saltate.in.padella" -sv best -sa all -ss all -mt -M format=mkv  --log-level OFF
N_m3u8DL-RE "https://vixcloud.co/playlist/262098?token=6eb40e6f9a4b817227f944bd9831824c&expires=1733127076&h=1" --save-name "Midnight.Diner.Tokyo.Stories.S01E09.Cotoletta.di.prosciutto" -sv best -sa all -ss all -mt -M format=mkv  --log-level OFF
N_m3u8DL-RE "https://vixcloud.co/playlist/262099?token=b4fc291378ae057c042e625aa8cadac7&expires=1733127077&h=1" --save-name "Midnight.Diner.Tokyo.Stories.S01E10.Spaghetti.di.Capodanno.di.nuovo" -sv best -sa all -ss all -mt -M format=mkv  --log-level OFF

As you can see the links are different.
Funny thing is that last night, when I wrote my previous post, they were different and they didn't work.
Now they are different, but they work. I don't know if they are the same as last night, I deleted them.
So I believe that this has something to do with how that website manage the urls, and for some reason last night there was a problem.
The only thing I'm sure of is that the script works great, and again many thanks for that.