M3u8 automatic download with ffmpeg

[RKJ]

Hi, i need to download the streams from +30 different websites, currently i do as follows:

1)Open cmd
2)Run ffmpeg.exe -i "https://cdn.jmvstream.com/w/LVW-8403/ngrp:LVW8403_bIBvekk9QA_all/chunklist_b2097152.m3u8" -c copy TVCultura.mkv

and when it crashes it have to manually search for a new m3u8 link

The problem is, the m3u8 links expires every X amount of time, so i've to be at the computer 24-7 monitoring when a download crash, search again in the website (in this case https://tvcultura.com.br/aovivo/) for a new m3u8 link (I get the link with the stream video downloader addon from chrome), and restart the download.

I would like to make this automatic, this is, the process to be as following:
1)"ffmpeg.exe -i "http://v3fbs247hls-i.akamaihd.net/hls/live/219079/v3fbs247hls/v3fbs247hls_1_1.m3u8" -c copy TV5France.mkv
IF m3u8 does not longer yield results---->Go to link of streaming video and retrieve a new m3u8-->restart the download (in the same folder as before, with a new name so it doesn't overwrite).

Does anyone know a program, script or any way to solve this? I've been told it could be automated using pyhton and selenium (decompiling the stream video downloader addon or something like that to add it into the selenium bot), and also with java script, do you think it's worth the try? If anyone is looking for a solution for the same issue we could maybe join forces -?-. I hear your suggestions!

PD: i uploaded a .xlsx with the links of the streams i've to download.
It doesn't allow me to upload so:
Canal Link
Fox Business https://www.livenewsnow.com/business/fox-business-network-fbn.html
Fox News https://2ndrun.tv/fox-news/
MSNBC https://2ndrun.tv/msnbc/
CNN live https://2ndrun.tv/cnn/
CBSNews https://www.cbsnews.com/live/
ABCNews https://abcnews.go.com/Live

CNBC https://planetnews.com/live/stocks.html?mepr-unauth-page=40&redirect_to=%2Famerican%2F...c-america.html
Bloomberg USA https://www.livenewsnow.com/american/bloomberg-television-business.html
tv cultura https://tvcultura.com.br/aovivo/
ElTrece https://www.tv-arg.net/2014/06/canal-13-trece-en-vivo-online.html
Telefe https://telefe.com/vivo/
NetTv https://www.canalnet.tv/page/en-vivo
ABC Forense https://www.tvazteca.com/amastv/abc-forense/envivo
ADN40 https://live.adn40.mx/
ElTreceAzteca https://www.tvazteca.com/aztecauno/el-trece/envivo
El7TvAzteca https://www.tvazteca.com/azteca7/azteca-7-especiales/envivo
BFM https://www.bfmtv.com/mediaplayer/live-video/
BFM Business https://bfmbusiness.bfmtv.com/mediaplayer/live-video/
CNNews https://www.cnews.fr/le-direct
FranceInfo https://www.francetvinfo.fr/en-direct/tv.html
TV5 http://live.tv5monde.com/fbs.html?
Das Erste https://live.daserste.de/
Welt World Live https://www.welt.de/tv-programm-live-stream/

C5N https://www.youtube.com/watch?v=SITqezHXSHA
TN https://www.youtube.com/watch?v=wHn1_QVoXGM
Cronica TV https://www.youtube.com/watch?v=K9X2WcIk_Ws
Canal26 https://www.youtube.com/watch?v=3Q5IPa88woI
A24 https://www.youtube.com/watch?v=MdJsCt1ThIQ
FranceInfo https://www.youtube.com/watch?v=wwNZKfBLAsc
France24 https://www.youtube.com/watch?v=D610HYkYk0s
SkyNews https://www.youtube.com/watch?v=9Auq9mYxFEE
Euronews es https://www.youtube.com/watch?v=6DB_p2sMJTE
Euronews fr https://www.youtube.com/watch?v=vllpR2-nAo8
Euronews en https://www.youtube.com/watch?v=6xrJy-1_qS4
Euronews deutch https://www.youtube.com/watch?v=9XFz8WGF3dc
Milenio https://www.youtube.com/watch?v=PkWWo6fjc-c

Radio Link
Radio10 https://radioarg.com/#radio-10
LaRed https://radioarg.com/#la-red
Am750 https://radioarg.com/#radio-am-750-buenos-aires
Continental https://radioarg.com/#continental
FutuRock https://radioarg.com/futurock/
ElDestape https://radioarg.com/el-destape/
RadioConVos https://radioarg.com/fm-89-9/

[godai]

im fully ignorant about this.
but i usually i do this for add those to my iptv box.

expired links are hard so i give up with those.
also you have some with geoblock im wondering if its possible use a proxy in the iptv link , channel with geoblock.

[RKJ]

I've 10 pc's working on these (look at mi desc), one with a VPN in each country: germany, USA, Brazil, UK, etcétera so geolocalization isn't a problem

[godai]

I've 10 pc's working on these (look at mi desc), one with a VPN in each country: germany, USA, Brazil, UK, etcétera so geolocalization isn't a problem

thats sound that you sell services. because its a lot resources and probably lot of energy cost.

[RKJ]

not at all, the pc's i've have this config:
Sentey G28 500W
Gygabyte GA-H310M-H
Pentium G5400
DDR4 8gb Kingston
Each one cost me around usd200, and the energy cost is extremely low in my country; i don't sell services, actually i'm studyng international relationships (degree) and want to begin gather information for my thesis about how local politics intermingle with international politics

The only expensive part is the storage from now on, i use about 500gb a day, that's about 15tb a month, 10tb wd red=usd500, so about 750usd by month (even tho i only need 2-3 months of storage then it's deleted)

[downloadgemist]

Hi,

I've done automated python/ffmpeg captures before. The key here is that you have to monitor the ffmpeg process either by redirecting the stats to a txt file (with the flag -stats and STDERR redirect to STDOUT), or by reading the filesize every x seconds. Another process has to do this. Python is easiest to implement. Python can also do the webscraping to get the m3u8 files, but since you are talking about +30 websites, that is some programming work because every site has its own way to present the m3u8 files.

Do you do your own programming?