[Release] - Ozivine - Australian & NZ FTA Downloader

[billybanana]

Ah might have known 1st Sept was going to bring some changes. Back to drawing board then. I'm reluctant to revert back to the web 720p endpoint just yet. Will see what I can figure out when I have a chance.

[readerr0r]

Hope it goes alright, a 10play sourced 1080 was posted online last night so it’s def still possible by the looks.

[billybanana]

I've rewritten the 10play script but it only grabs 540p. Even though I can see 720p in the browser, it's proving difficult to get the right manifest. Will keep trying and see what develops over the coming days/weeks. I see yt-dlp has an open issue as well.

[SocietyBox]

I've rewritten the 10play script but it only grabs 540p. Even though I can see 720p in the browser, it's proving difficult to get the right manifest. Will keep trying and see what develops over the coming days/weeks. I see yt-dlp has an open issue as well.

Did you include the tp-acceptfeature: v1/fw;v1/drm header?

[SocietyBox]

Here's the fix ported from matthuisman/slyguy.addons:

diff --git a/services/10play/10play.py b/services/10play/10play.py
index f7b3e90..ec45996 100644
--- a/services/10play/10play.py
+++ b/services/10play/10play.py
@@ -104,7 +104,7 @@ def get_manifest(video_id):
     content = requests.get(url, headers=manifest_headers).json()
     if content and 'items' in content and content['items']:
         items = content['items'][0]
-        hls_url = requests.head(items.get("HLSURL"), allow_redirects=True, headers=manifest_headers).url # Follow redirects to get real URL
+        hls_url = requests.head(items.get("dashManifestUrl").replace("manifest=mpeg-dash", "manifest=m3u"), allow_redirects=True, headers=manifest_headers).url # Follow redirects to get real URL
         real_url = hls_url.replace(",150,", ",500,300,150,") # Replace bitrate for higher resolution
         return (real_url, manifest_headers)
     else:

[billybanana]

Here's the fix ported from matthuisman/slyguy.addons:

Thanks mate. I did notice Matt had posted a fix yesterday and was getting round to looking at it today. Simple one line update to the original script in the end. Having said that I dunno how he manages to identify these things so quickly. Will ask him next time I message him

Any way new release v1.8 has been posted on GitHub.

Release 1.8
1. Updated ABC iView download command to "res=1080" instead of "best"
2. Updated 9Now to cater for "special" episodes and "clips"
3. Updated 10Play to fix broken Android endpoint (and restore 1080p)

Enjoy !

[billybanana]

I've pushed out another update to the master and also replaced the 1.8 release to include this new fix.

7Plus was broken completely this morning. They updated their show/episode API version that now requires a token to access it. Also added some debug control to make it easier to identify issues in future.

[Tom Saurus]

What is the best way to update Ozivine? Does one have to move the .yaml so it doesn't get overwritten?

[billybanana]

What is the best way to update Ozivine? Does one have to move the .yaml so it doesn't get overwritten?

You can either download the release and place all files in the same folder overwriting them (take a backup copy of your config.yaml to put back again) or

git clone https://github.com/billybanana80/ozivine.git ozivine

[Tom Saurus]

What is the best way to update Ozivine? Does one have to move the .yaml so it doesn't get overwritten?

You can either download the release and place all files in the same folder overwriting them (take a backup copy of your config.yaml to put back again) or

git clone https://github.com/billybanana80/ozivine.git ozivine

Thank you for this information and thank you for all the work you put into making and maintaining Ozivine.

[Dravonvico]

Looks like 10play isn't serving up any urls now.

[billybanana]

The api is not returning any metadata, so no manifest to manipulate. I do have another method up my sleeve but it is quite a bit more complicated. Won't rush into a fix right away. Not in the next couple of days anyway.

[SocietyBox]

Unless it's a way to get 1080p, I would just use the web endpoint. There are ways to have it not return any ads.

[billybanana]

If I can get the 720p manifest using the DAI web endpoint (which is proving tricky script wise, there are more parameters required than for the 540p), then I have a way to produce an add-less 1080p version.

[SocietyBox]

I had no problems with the DAI endpoint.

1. Get bearer token
2. Call playbackApiEndpoint with authorization header and 'tp-acceptfeature: v1/fw;v1/drm' header and get contentSourceId and videoId from the body and the auth token from the x-dai-auth response header
3. Call DAI streams endpoint with contentSourceId, videoId and auth-token=XXX POST body

[billybanana]

If I use this episode as an example
https://10play.com.au/everyday-gourmet/episodes/season-15/episode-51/tpv250828yhwfs

My script fetches me
540p
https://pubads.g.doubleclick.net/ondemand/hls/content/2489270/vid/7486380000020271/GRQ...b8/master.m3u8

versus this one manually via web
720p
https://pubads.g.doubleclick.net/ondemand/hls/content/2690006/vid/7486380000020271/GRQ...29/master.m3u8

So you get the 720p one ok with your method ?

[SocietyBox]

Yep. 540p and 720p: master.m3u8

[SocietyBox]

Once you get 2489270 instead of 2690006, you've got it wrong, before you even get to DAI. It's the tp-acceptfeature header that makes the difference but you seem convinced you're including it correctly. Can you use https://requestcatcher.com or something to double check you're calling https://10play.com.au/api/v1/videos/playback/tpv250828yhwfs correctly?

EDIT

Alternatively, run this and tell me if it passes:

import requests
resp = requests.get('https://10play.com.au/api/v1/videos/playback/tpv250828yhwfs?platform=web', headers={'tp-acceptfeature': 'v1/fw;v1/drm', 'authorization': 'Bearer XXXX'})
assert(resp.json()['dai']['contentSourceId'] == '2690006')

[Dravonvico]

might be easier to just use the 10-selector url that used to be served up by brightcove. Nvm, already getting unsupportedv2 on that one.

Could use the dai endpoint with nm3u8dl --ad-keyword google as a backup that strips the ads, but still is only 720p max.

[billybanana]

Alternatively, run this and tell me if it passes:

import requests
resp = requests.get('https://10play.com.au/api/v1/videos/playback/tpv250828yhwfs?platform=web', headers={'tp-acceptfeature': 'v1/fw;v1/drm', 'authorization': 'Bearer XXXX'})
assert(resp.json()['dai']['contentSourceId'] == '2690006')

yep that gives me what I need. I'll be able to work with that.

HTTP: 200
Content-Type: application/json; charset=utf-8
{'isLive': False, 'isPreRollDisabled': False, 'isMemberGated': False, 'dai': {'enabled': True, 'videoId': '7486380000020271', 'contentSourceId': '2690006'}, 'drm': {'enabled': False}, 'cuePoints': {'videoAds': [], 'richAds': []}, 'source': 'https://', 'isShoppableEnabled': False}
OK: contentSourceId matched

[z1269925944]

I saw a post on a private channel that 10 started to use DRM
I don't know if it's true

 
{
  "isLive": false,
  "isPreRollDisabled": false,
  "isMemberGated": false,
  "dai": {
    "enabled": true,
    "videoId": "7563110000020754",
    "contentSourceId": "2690356",
    "packageId": "851b644b-dc9e-4416-a359-c933c9ad308c"
  },
  "drm": {
    "enabled": true,
    "laType": {
      "playready": {
        "laUrl": "https://aus10.live.ott.irdeto.com/licenseServer/playready/v1/aus10/license?contentId=82396"
      },
      "widevine": {
        "laUrl": "https://aus10.live.ott.irdeto.com/licenseServer/widevine/v1/aus10/license?contentId=82396"
      },
      "fairplay": {
        "cert": "https://aus10.live.ott.irdeto.com/licenseServer/streaming/v1/aus10/getcertificate?applicationId=aus10",
        "ckc": "https://aus10.live.ott.irdeto.com/licenseServer/streaming/v1/aus10/getckc?contentId=82396&keyId=6ef7224a-4480-4893-a4cc-4e3f5ed0d774"
      }
    }
  },
  "cuePoints": {
    "videoAds": [
      
    ],
    "richAds": [
      
    ]
  },
  "source": "https://",
  "isShoppableEnabled": false
}

[billybanana]

I saw a post on a private channel that 10 started to use DRM

Well that is interesting. One to keep an eye on for sure.

[billybanana]

Ok I've now got a working 10play script again, all the way up to 1080p using the web endpoint. It was a little complicated to work through the scenarios but essentially what the script does now:

• identify the max 720p manifest - thanks @SocietyBox for the tips on that front
• locally save the 540p variant from the manifest
• replace the segment names in the variant and probe some to see if 1080p exists
• if it does happy days, if not it reverts back to the best available resolution (to cater for older 720p and even older 540p)
• and using the option --ad-keyword redirector.googlevideo.com in all cases to remove the ads

[Attachment 88653 - Click to enlarge]

This solution "should" be more resilient that the last couple of cases, however we shall see what happens if DRM is introduced.

Anyone want to do some testing ? Send me a DM and I will give you the updated 10play.py

[SocietyBox]

I saw a post on a private channel that 10 started to use DRM
I don't know if it's true

That video's The Amazing Race Australia - S6 Ep. 2. It is DRM protected and only available in 540p for me on the webpage.

[z1269925944]

I saw a post on a private channel that 10 started to use DRM
I don't know if it's true

That video's The Amazing Race Australia - S6 Ep. 2. It is DRM protected and only available in 540p for me on the webpage.

Weirdly I get none DRM on webpage

 https://dai.google.com/ondemand/hls/content/2489270/vid/7563110000020754/

[SocietyBox]

Maybe it's your browser, location or account. Not worth exploring because it's the 2489270 version. I was going to add that if all DRM-protected videos only give up to 540p, we can just all use that 2489270 version which doesn't have DRM and gives 540p without needing to log in anyway.

[billybanana]

Yup DRM manifest via web is only doing up to 540p. Hopefully there's another contentID and/or stream id for mobile/smart TV devices to be able to get higher quality.

Edit: happy days are here again I figured out how to get 1080p for the DRM'd shows.

The clue is in this very thread some pages back.

[billybanana]

I've pushed out a new release v1.9 to 10play to cater for the latest changes.

https://github.com/billybanana80/ozivine/releases

Download the release or use git to update

git clone https://github.com/billybanana80/ozivine.git ozivine

[bossanova808]

https://github.com/billybanana80/ozivine is 404ing...hmmm....

[SlowLoris]

Indeed!

Yesterday was going to look at a making a change (I hate MKV!) but saw the repo had gone - as well as any indication of activity from billybanana.

Not sure what happened, but glad I made a mirror.... untill stuff breaks!

Hopefully it's just moved and not gone