How to download stream with expiring tokens (url changes every 30 minutes)

[Gwar]

hello,
did anyone ever succeed in downloading a stream which changes it's token in the url ?
Is there a stream recorder which is able to recognise that and switches to the new url so that there isn't a cut in the recording ?

http://vod.graspop.be/nl/38997

I tried vlc and ffmpeg so far. Both shut down after 20-30 minutes.

thanks in advance for your help
regards

[Sviests]

have you tried adding "keep-connection-alive" to FFMPEG in console? (it's possible that you'll need to add a referer to embeded video too)

ffmpeg -multiple_requests 1 -reconnect 1 -reconnect_at_eof 1 -reconnect_streamed 1 -reconnect_delay_max 2 -i http://url.m3u8 ....

[Gwar]

have you tried adding "keep-connection-alive" to FFMPEG in console? (it's possible that you'll need to add a referer to embeded video too)

ffmpeg -multiple_requests 1 -reconnect 1 -reconnect_at_eof 1 -reconnect_streamed 1 -reconnect_delay_max 2 -i http://url.m3u8 ....

I can't thank you enough for giving me this command. I searched for something like that for years and never found someone who knew it.
This worked great !! I sucessfully grabbed everything . Thanks so much !

[swimgoggles]

have you tried adding "keep-connection-alive" to FFMPEG in console? (it's possible that you'll need to add a referer to embeded video too)

ffmpeg -multiple_requests 1 -reconnect 1 -reconnect_at_eof 1 -reconnect_streamed 1 -reconnect_delay_max 2 -i http://url.m3u8 ....

Hey Sviests, I tried using your solution for tango.me streams, but it doesn't work, since m3u8 link which has the token value at the end of its link, which changes every few seconds is not possible to be downloaded with ffmpeg at all. It keeps returning the error:

Server returned 4XX Client Error, but not one of 40(0,1,3,4)

Everything worked until few days ago. I guess somethign is changed at the streaming site itself.

Here is the link if someone wants to try and grab any stream and see if it can work:

https://www.tango.me/live/creators

Thanks!

[snoopyraw]

I'm having the same issue with tango.me live streams since like a week ago.. the streams keeps getting expired and new tokens in the link occur every 15 seconds or so, for example:

cinema-eu.tango.me/v1/1a7ff6fc0bf88c5f352a86d2454fac27/live.m3u8?accountId=bTeI4Hr88ncarXRRmGXL-A&username=7d1ca4938059418d9f58884bc7b49b93&expire _at=1622936782&token=NTBiNDJiNzQ1YjBmODk1NWIwNDllZ DU0MDEyNTEyMmMzZjYwMjRmN2E4NTExOTVhYTA0YmI2Mzk0YjE zZjdhOA&tech=lhls

and then 15 sec later:

cinema-eu.tango.me/v1/1a7ff6fc0bf88c5f352a86d2454fac27/live.m3u8?accountId=bTeI4Hr88ncarXRRmGXL-A&username=7d1ca4938059418d9f58884bc7b49b93&expire_at=1622936789&token=ZWIwYjljZjVkNDQ5NjMzNz k3Njk0OWVkNjJhNGY4MDYwZjk5NmY2MDljZjdlNWExYTUwNzk4 YmQwM2Q0NjA4MA&tech=lhls


another 15 sec later:

cinema-eu.tango.me/v1/1a7ff6fc0bf88c5f352a86d2454fac27/live.m3u8?accountId=bTeI4Hr88ncarXRRmGXL-A&username=7d1ca4938059418d9f58884bc7b49b93&expire_at=1622936794&token=ODc5MWRjOTY1ZjBhNDk0NDR iNTQ4MmMxZDY0ZTdmYWZkNzg2NjQ5NDYxYzU3N2UwOTcxMzYxZ Dk2YTNmYTMzNw&tech=lhls


As you can see the first part stays the same (wich used to be enough to download the whole stream): cinema-eu.tango.me/v1/1a7ff6fc0bf88c5f352a86d2454fac27/live.m3u8

But now they added ''expire_at=(+some number)' and a token at the end that keeps changing...


is there even any way to fix that so it keeps downloading the whole stream in one single file?

[LZAA]

TubeDigger.

[snoopyraw]

TubeDigger.

Thanks! have installed it and tried it out.

It seems it can recognize the changing streams on a webpage and keeps downloading them BUT there are some isues:

1. The video is cut in files of each seperate stream token.

2. The cutted video files are NOT simultaneously, it seems that each tango stream of around 15 seconds has some of the same footage of the previous video. So glueing them together will result in a very choppy video.

3. You will need to stay at the page for downloading, going of the page will stop the recording (it will not recognize the changing urls).

It would be awesome if 1 and 2 can be fixed and 3 would be a bonus.

[october262]

TubeDigger.

Thanks! have installed it and tried it out.

It seems it can recognize the changing streams on a webpage and keeps downloading them BUT there are some isues:

1. The video is cut in files of each seperate stream token.

2. The cutted video files are NOT simultaneously, it seems that each tango stream of around 15 seconds has some of the same footage of the previous video. So glueing them together will result in a very choppy video.

3. You will need to stay at the page for downloading, going of the page will stop the recording (it will not recognize the changing urls).

It would be awesome if 1 and 2 can be fixed and 3 would be a bonus.

i was able to download this video - https://www.proximus.be/pickx/nl/muziek/festivals/graspop/vod/40140
with youtube-dl like this - youtube-dl --no-check-certificate "https://ottvod.cdi.streaming.proximustv.be/shares/export/mounthttp/festivals/gmm19-repo-punch/index.m3u8?token=b60ce98c1e57e1d988bbdc280fefa911& expires=1623039874"

[LZAA]

snoopyraw

1&2 - Think, try.
3 - Will not work.

[snoopyraw]

snoopyraw

1&2 - Think, try.
3 - Will not work.

Ok thanks! I buy the programm immediately if it can fix 1 and 2.
Keep us updated!

[snoopyraw]

TubeDigger.

Thanks! have installed it and tried it out.

It seems it can recognize the changing streams on a webpage and keeps downloading them BUT there are some isues:

1. The video is cut in files of each seperate stream token.

2. The cutted video files are NOT simultaneously, it seems that each tango stream of around 15 seconds has some of the same footage of the previous video. So glueing them together will result in a very choppy video.

3. You will need to stay at the page for downloading, going of the page will stop the recording (it will not recognize the changing urls).

It would be awesome if 1 and 2 can be fixed and 3 would be a bonus.

i was able to download this video - https://www.proximus.be/pickx/nl/muziek/festivals/graspop/vod/40140
with youtube-dl like this - youtube-dl --no-check-certificate "https://ottvod.cdi.streaming.proximustv.be/shares/export/mounthttp/festivals/gmm19-repo-punch/index.m3u8?token=b60ce98c1e57e1d988bbdc280fefa911& expires=1623039874"

Tango live streams are quit different... have tried youtube-dl with no succes.

I was able to download your video with this google chrome add on very easily: https://chrome.google.com/webstore/detail/stream-recorder-download/iogidnfllpdhagebkbl...jkbkjdmm?hl=en

Just install the add on, open the webpage and press the red dot in upper right.

(Btw this add on can also capture tango streams the same way tubedigger does in the browser but with the same issues of 15 seconds parts and not simultaneously.)

[notaghost]

You just need to make a python script (or any other programming language) to continue downloading with a new token .

[swimgoggles]

You just need to make a python script (or any other programming language) to continue downloading with a new token .

Yea, 'just' that. Not all of us are programmers.

[snoopyraw]

You just need to make a python script (or any other programming language) to continue downloading with a new token .

There are applications (tubedigger)/chrome addons (HLS stream downloader) that can recognize the changing token and keep downloading if the page is still open, but like I said before tango stream are cut in 15 sec pieces and not simultaneously (if you glue them afterwards).

The only way to capture tango streams as 1 video right now is using the very old and/embarrassing way of screen record uugh , not to mention the lower quality.

[swimgoggles]

I'm thinking... maybe wireshark could do it... somehow?

[blimey]

the tango ts segments don't seem to need any auth or token. only the m3u8 playlists seem to need it.

if this is correct, since the ts segment urls are sequentially numbered, rather than bothering with getting a new playlist every x number of seconds, just get one playlist and then use the ts segment url as a baseline to increment the ts segment number. this could be done in a batch file.

some care would have to be taken to not download the ts segments so fast before the subsequent ones are generated, at least for live streams.

just an idea, it may not work.

[[ss]vegeta]

the tango ts segments don't seem to need any auth or token. only the m3u8 playlists seem to need it.

if this is correct, since the ts segment urls are sequentially numbered, rather than bothering with getting a new playlist every x number of seconds, just get one playlist and then use the ts segment url as a baseline to increment the ts segment number. this could be done in a batch file.

some care would have to be taken to not download the ts segments so fast before the subsequent ones are generated, at least for live streams.

just an idea, it may not work.

Exactly what I was thinking about now, lol.
Ts files seem to increment by 1, and the they are easily accessible.
It baffles me that, for now, no one provided an easy "fix" for this.

[snoopyraw]

the tango ts segments don't seem to need any auth or token. only the m3u8 playlists seem to need it.

if this is correct, since the ts segment urls are sequentially numbered, rather than bothering with getting a new playlist every x number of seconds, just get one playlist and then use the ts segment url as a baseline to increment the ts segment number. this could be done in a batch file.

some care would have to be taken to not download the ts segments so fast before the subsequent ones are generated, at least for live streams.

just an idea, it may not work.

Exactly what I was thinking about now, lol.
Ts files seem to increment by 1, and the they are easily accessible.
It baffles me that, for now, no one provided an easy "fix" for this.

Hahaha omg didn't looked at .ts at all so inspecting elements on chrome and found indeed this of a stream:

#EXTM3U
#EXT-X-VERSION:7
#EXT-X-MEDIA-SEQUENCE:223
#EXT-X-TARGETDURATION:2
#EXTINF:1.999,
https://cinema-us-east.tango.me/v1/7b252e302e632d6f06216faa34112be2/223.ts
#EXTINF:1.998,
https://cinema-us-east.tango.me/v1/7b252e302e632d6f06216faa34112be2/224.ts
#EXTINF:1.999,
https://cinema-us-east.tango.me/v1/7b252e302e632d6f06216faa34112be2/225.ts
#EXTINF:1.999,
https://cinema-us-east.tango.me/v1/7b252e302e632d6f06216faa34112be2/226.ts
#EXTINF:1.999,
https://cinema-us-east.tango.me/v1/7b252e302e632d6f06216faa34112be2/227.ts
#EXTINF:1.999,
https://cinema-us-east.tango.me/v1/7b252e302e632d6f06216faa34112be2/228.ts
#EXTINF:1.000,
https://cinema-us-east.tango.me/v1/7b252e302e632d6f06216faa34112be2/229.ts
#EXTINF:1.000,
https://cinema-us-east.tango.me/v1/7b252e302e632d6f06216faa34112be2/230.ts

it seems the numbers keep getting add up chronicley with no tokens wich is a plus, but I wasnt able to download them quickly each by one before they dissapread so cannot say if the .ts (unlike .m3u8) are simultaneously with no extra footage of the previous one maybe not wich would be good news.. atleast we are now rid of the token part.

[swimgoggles]

Hahaha omg didn't looked at .ts at all so inspecting elements on chrome and found indeed this of a stream:

#EXTM3U
#EXT-X-VERSION:7
#EXT-X-MEDIA-SEQUENCE:223
#EXT-X-TARGETDURATION:2
#EXTINF:1.999,
https://cinema-us-east.tango.me/v1/7b252e302e632d6f06216faa34112be2/223.ts
#EXTINF:1.998,
https://cinema-us-east.tango.me/v1/7b252e302e632d6f06216faa34112be2/224.ts
#EXTINF:1.999,
https://cinema-us-east.tango.me/v1/7b252e302e632d6f06216faa34112be2/225.ts
#EXTINF:1.999,
https://cinema-us-east.tango.me/v1/7b252e302e632d6f06216faa34112be2/226.ts
#EXTINF:1.999,
https://cinema-us-east.tango.me/v1/7b252e302e632d6f06216faa34112be2/227.ts
#EXTINF:1.999,
https://cinema-us-east.tango.me/v1/7b252e302e632d6f06216faa34112be2/228.ts
#EXTINF:1.000,
https://cinema-us-east.tango.me/v1/7b252e302e632d6f06216faa34112be2/229.ts
#EXTINF:1.000,
https://cinema-us-east.tango.me/v1/7b252e302e632d6f06216faa34112be2/230.ts

it seems the numbers keep getting add up chronicley with no tokens wich is a plus, but I wasnt able to download them quickly each by one before they dissapread so cannot say if the .ts (unlike .m3u8) are simultaneously with no extra footage of the previous one maybe not wich would be good news.. atleast we are now rid of the token part.

I already mantioned that here: tango stream m3u8 ffmpeg download doesn't work

But that doesn't seam like a good solution. Becauese it happend that my downloader finish downloading one ts file and went for next one, but it found it doesn't exist so it kept trying next one and so on...ending up with not all ts files downloaded.

The 2nd issue is that you don't know when the stream will end so you have to feed your downloader with very big list of *.ts links.

As I said...some expert might managed to cap the stream through wireshark and then probably 'filter out' the specific content from it. But... I'm not sure how that can be done in practice....