Need assistance with ddl HLS encrypted from a local TV broadcaster

[asiniv]

Hi,
I'm using a locally based Israeli TV operator named NEXTTV.co.il (NOT the Chinese based NextTV streaming service).
I would like to save a local copy of my intended program to watch offline on my laptop, since my resources are somewhat limited for streaming - old A8 smart phone, no TV / smartTV, so can't watch live TV - only VOD with my laptop and ONLY when home network is free

HLS streaming is encrypted [not sure about method of encryption though] so regular browser extensions (downloadhelper/ HLS downloader/ etc) wouldn't do the trick.

I understand that forum rules forbid subscription materials, but in my case I really believe I do not violate the rules;
Web based client does require login details (based on Israeli ID details and phone number) but this is a local TV operator (which only operates in Israel) that also aires public broadcast local programs which is only what I'm trying to save for personal viewing (programs that aired on the regular TV channel which I couldn't watch OTA/FTA as I don't have a TV, just the laptop).

I've tried simple ffmpeg commands such as:
ffmpeg -i 'url' -c copy video.ts

but I get HTTP error 403 Forbidden, I'm not sure if i'ts because I need to add HTTP headers, or provide some other type of authentication method (login details, cookie...)

As I'm quite a novice, I would really appreciate it if someone can help me with step by step trial and error command guide that I can try till I to get it right.


Below is an example hit details for a sample program via video download helper (I understand session expires so I need to recheck every time I try again).

[Thx in advance!]

actions
[...]
bitrate
2410335
chunked
hls
descrPrefix
HLS streaming
duration
3822
durationFloat
3822
extension
mp4
frameId
0
fromCache
true
group
grp-2724be9d
headers
[...]
hls
{...}
id
hls:46809c58
isPrivate
false
length
null
masterManifest
https://pta1-cdn-edge-vod01.cdnhot.co.il/vodnexttv.cdnhot.co.il/sid=6717-1597391287-21...bf6e0b2bbaf25f
mediaManifest
https://pta1-cdn-edge-vod01.cdnhot.co.il/vodnexttv.cdnhot.co.il/sid=6717-1597391287-21.../Level(2410335)
originalId
network-probe:2724be9d
pageUrl
https://watch.nexttv.co.il/?typ=S&cat=LYS000602688&_ga=2.146089725.816173358.159737239...424.1597372392
referrer
https://watch.nexttv.co.il/?typ=S&cat=LYS000602688&_ga=2.146089725.816173358.159737239...424.1597372392
running
0
size
768x432
status
active
tabId
56
title
סדרות לצפייה ישירה | Next TV
topUrl
https://watch.nexttv.co.il/?typ=S&cat=LYS000602688&_ga=2.146089725.816173358.159737239...424.1597372392
url
https://pta1-cdn-edge-vod01.cdnhot.co.il/vodnexttv.cdnhot.co.il/sid=6717-1597391287-21.../Level(2410335)
urlFilename
10

[LZAA]

Are there any cookies in the request?

[asiniv]

errr.... what should I use to capture full log of a session?
[ffmpeg just says 403 forbidden nothing else]

[LZAA]

Developer Tools.

[asiniv]

hmm...
I'm not a developer so I don't have any experience with chrome dev tools.
from what I can see all kinds of cookies are being called for.
I've attached a photo of the console panel with a cookie query wherein what I think the relevant cookie might be are expanded.
[portal.mk-sense.com and hotjar.com].
I hope this is what you were referring to and is the in the right context, please forgive me if I'm not correctly contextualizing it.
If something more specific is required, may you please direct me with a step by step where to pinpoint and focus on.
I should also mention that as part of the first viewing process it required me to install a chrome extension called "Player for NextTV content".
Below is also the ffmpeg output:

C:\Users\ASSAF\Downloads\Temp\ffmpeg-4.3.1-win64-static\bin>ffmpeg -i https://pta1-cdn-edge-vod01.cdnhot.co.il/vodnexttv.cdnhot.co.il/sid=19950-1597402239-2...044161/10.m3u8 -c copy video.ts
ffmpeg version 4.3.1 Copyright (c) 2000-2020 the FFmpeg developers
built with gcc 10.2.1 (GCC) 20200726
configuration: --enable-gpl --enable-version3 --enable-sdl2 --enable-fontconfig --enable-gnutls --enable-iconv --enable-libass --enable-libdav1d --enable-libbluray --enable-libfreetype --enable-libmp3lame --enable-libopencore-amrnb --enable-libopencore-amrwb --enable-libopenjpeg --enable-libopus --enable-libshine --enable-libsnappy --enable-libsoxr --enable-libsrt --enable-libtheora --enable-libtwolame --enable-libvpx --enable-libwavpack --enable-libwebp --enable-libx264 --enable-libx265 --enable-libxml2 --enable-libzimg --enable-lzma --enable-zlib --enable-gmp --enable-libvidstab --enable-libvmaf --enable-libvorbis --enable-libvo-amrwbenc --enable-libmysofa --enable-libspeex --enable-libxvid --enable-libaom --enable-libgsm --disable-w32threads --enable-libmfx --enable-ffnvcodec --enable-cuda-llvm --enable-cuvid --enable-d3d11va --enable-nvenc --enable-nvdec --enable-dxva2 --enable-avisynth --enable-libopenmpt --enable-amf
libavutil 56. 51.100 / 56. 51.100
libavcodec 58. 91.100 / 58. 91.100
libavformat 58. 45.100 / 58. 45.100
libavdevice 58. 10.100 / 58. 10.100
libavfilter 7. 85.100 / 7. 85.100
libswscale 5. 7.100 / 5. 7.100
libswresample 3. 7.100 / 3. 7.100
libpostproc 55. 7.100 / 55. 7.100
[https @ 000002ae0f32e680] HTTP error 403 Forbidden
https://pta1-cdn-edge-vod01.cdnhot.co.il/vodnexttv.cdnhot.co.il/sid=19950-1597402239-2...44161/10.m3u8: Server returned 403 Forbidden (access denied)



[Attachment 54525 - Click to enlarge]

[LZAA]

Developer Tools -> Network-> https://pta1-cdn-edge-vod01.cdnhot.co.il/vodnexttv.cdnhot.co.il/sid=6717-1597391287-21...bf6e0b2bbaf25f -> Cookies

[asiniv]

ok, PSB what I actually filtered on screen (sorry if it's no exactly as mentioned as I filtered by url beginnig since i couldn't locate a cookies tab).
And PSA captured HRA log, which I hope will be of better use.
(thx for your understanding and support so far)
watch-nexttv-co-il-har.txt

[asiniv]

Hey,
By any chance were you able to look at the last log I sent?

Thank you for all the help.

Assaf

[asiniv]

So I'm sure that I need to provide some cookie for authentication, since I can still watch video even after 24hr or re-opening the browser, without logging in again.
So all I need is for someone to help identify the coookie and how to set it via ffmpeg.

By any chance can someone take a look I provided in the thread (it's still the same session), and help out?

Thanks in advance.

[LZAA]

Save your Fiddler session. Give the file.

[asiniv]

Hi,
Sorry for the delay (time differences).
In order to simplify things and keep size to a minimum I preformed the following scenario:
1.Open chrome browser (where initial login was performed and nexttv app is installed)
2. Start fiddler capture
3. enter main portal https://www.nexttv.co.il/ --> portal displays not logged in (in hebrew)
4. click on any new video --> portal displays connected, no login required again (this is were credentials where fetched in some way)
5. start playing video
6.stop capture

fiddler session doesn't detect any cookie sent/set under request/response in accordance (I've tried this scenario a couple of times).
So I'm a little confused, perhaps an external server is used to manage credentials and this was performed only when I was prompted to login initially at the beginning.
[I'm a little reluctant to play around and clear chrome cache to see what happens;
as this is working at the moment and I'm not prompted to re-login, wherein all the attached logs in this thread pertains to it]

Is there a way around this??
I'm not entirely sure how to analyze and interpret this simple scenario log, hope you might lend a hand and see what is missing in order to make some progress...

Thanks in advance!

[LZAA]

Configure HTTPS in Fiddler. Save your Fiddler session. Give the file.

[asiniv]

OK, exact same scenario with capture https enabled in fiddler, obviously much bigger in size...
(sorry about that, wasn't aware it's not on by default, I haven't worked with fiddler before, just a little wireshark).
PSA

Thx!

[asiniv]

Hi,
By any chance have you been able to look at the log?

Thanks in advance

[LZAA]

I looked at the log. This is not an easy task. There is no solution yet. I'll write if I can decide.

[asiniv]

I see, so it's not just a one liner ffmpeg command with a few more variables which I thought I just needed a little help to identify and integrate correctly.
If you com to realize that this will require a lot more extensive analysis and to and fro, then perhaps it's not worth the effort (it might even be easier to acquire an actual complaint TV set).
Please just let me know when you come to a decision as you noted.

Thanks for the effort regardless of the final outcome...