[Release] - Ozivine - Australian & NZ FTA Downloader

[billybanana]

Have an example of some of the 1080p content? would be cool to test.

here you go
https://www.tvnz.co.nz/shows/liam-lawson-in-the-wings/episodes/s1-e1

I suspect as the content will have been provided by Red Bull that's why it's 1080.

[keep_it_breezy]

I must admit I have been tired - for the last day or so I was thinking "Where the hell is the name Ozivine coming from", but now I've had some sleep I realise and I like it at a lot haha.

[achilles]

A missed opportunity to call the tool, "YouLittleRipper".

[billybanana]

A missed opportunity to call the tool, "YouLittleRipper".

Touche !

[billybanana]

https://www.tvnz.co.nz/sport/basketball/fiba/italy-v-usa-final-u17-mens-world-cup

I had quite a look at this today. It looks like the full sports replays are provided by for TVNZ by a new company MediaKind. The result is they make those files available in a totally different construct (diferent api, mpd, licence server the lot) and from what I could figure out appear to be PlayReady protected - so they're a no go at this stage until I do more research on how that works.

Haven't had a chance to poke around at your other incorrect shows yet. It's on my to-do list.

In some good news though, I do have ThreeNow working quite well, so will look to release that in the next few days.

[coltseavers]

https://www.tvnz.co.nz/sport/basketball/fiba/italy-v-usa-final-u17-mens-world-cup

I had quite a look at this today. It looks like the full sports replays are provided by for TVNZ by a new company MediaKind. The result is they make those files available in a totally different construct (diferent api, mpd, licence server the lot) and from what I could figure out appear to be PlayReady protected - so they're a no go at this stage until I do more research on how that works.

Haven't had a chance to poke around at your other incorrect shows yet. It's on my to-do list.

In some good news though, I do have ThreeNow working quite well, so will look to release that in the next few days.

Thanks for all of your hard work, it is appreciated.

[billybanana]

I've pushed out v1.3 which adds a new service ThreeNow and also caters for 1080p content in TVNZ (which for now is only full Sport replays).

The TVNZ updates were the most tricky I have had to deal with so far, in that the 1080p content is hosted in a different construct and also required obtaining a secondary token to access it. Added to my learning curve in a big way.

ThreeNow does not require login or cookies to use Ozivine but their site does require a login to navigate your way around it. So free account required to perform that.

New release can be downloaded here https://github.com/billybanana80/ozivine/releases/tag/Ozivine_v1.3 or you can do the git update thing for those that do that.

Happy downloading

[billybanana]

https://www.tvnz.co.nz/sport/basketball/fiba/italy-v-usa-final-u17-mens-world-cup

You can get this with the new update to v1.3. Some of those replays are massive file sizes, especially Wimbledon.

[ringy9]

Thanks @billybanana that file worked well.

[coltseavers]

This may be a cheeky request.. but, would it be possible so that the command line works in a similar way to Freevine, so you type ozvine <url>. This way it would be easy to use the command in a batch file for multiple eps (I do this with Freevine when I want multiple eps of a show but not the entire season, so I can add URLs to a txt file, then just run the batch file I created and it grabs each episode from the txt file).

I've altered the script slightly already so that it doesn't ask for the yes/no prompt after entering the URL but anything more is over my head. (no major drama if not, it's great just being able to automate from Au/NZ sites so thanks again)

[billybanana]

Deleted

[billybanana]

I've pushed out some major changes to the logic behind video identification for TVNZ. Master and the v1.3 release have been updated on GitHub.

Another thing I found was a movie Shrek Forever actually downloaded A Smurf movie and the tv show Heavy metal downloaded a Star Trek episode

This problem will be solved now. I was able to grab Shrek Forever and others correctly.

[Danker1990]

Can these service scripts work with your freevine GUI tool as i recall there were Australian spots there previous but the scripts weren't present/improved upon before?

[billybanana]

Can these service scripts work with your freevine GUI tool as i recall there were Australian spots there previous but the scripts weren't present/improved upon before?

Nah totally separate thing. I may end up doing something with Devine or a newer GUI. Dunno I have to think about it for a while yet.

[SaLTy]

Thanks, this looks great!

I just tried cloning and get an error with:

git clone https://github.com/billybanana/ozivine.git ozivine

but changing it to the below, worked.

git clone https://github.com/billybanana80/ozivine.git ozivine

[billybanana]

Ah cool I've updated the README.md now. Bit sad I don't know my own username

[SaLTy]

Just tried downloading something from Threenow and get the following error:

Enter the video URL: https://www.threenow.co.nz/shows/dane-simpson%253A-didgeridoozy/dane-simpson---digerid...659/M70452-010
Ozivine..........initiating ThreeNow
Error importing or running the service module: Could not find the video ID in the API response.

The URL for this is - https://www.threenow.co.nz/shows/dane-simpson%253A-didgeridoozy/S4558-659

Tried it with a few other comedy shows and they didn't work either e.g.

https://www.threenow.co.nz/shows/luke-heggie%253A-i-already-told-you/S4553-588
https://www.threenow.co.nz/shows/harley-breen%253A-flat-out/S4557-009

[billybanana]

Laid up crook at the moment and not in the mood to investigate comedy ! Will have a look in a few days when I'm up to it.

[ehurdler]

billybanana - Great program/script! Works great. I am having an issue with TVNZ - I do have creds in the config file, cookies, etc. I can DL from SBS and a few others, but TVNZ, nd yes on NZ VPN, I cannot. Keep gettings:

(venv) C:\oz>python ozivine.py

                              _       _
                      ___ ___(_)_   _(_)_ __   ___
                     / _ \_  / \ \ / / | '_ \ / _ \
                    | (_) / /| |\ V /| | | | |  __/
                     \___/___|_| \_/ |_|_| |_|\___|

                    Version 1.3 Copyright © 2024 billybanana
                    https://github.com/billybanana80/ozivine

←[94mEnter the video URL: ←[0mhttps://www.tvnz.co.nz/shows/my-life-is-murder/episodes/s1-e2
←[94mOzivine..........initiating TVNZ←[0m
←[92mLogin successful, token obtained←[0m
←[91mNo 'sources' found in the response←[0m

(venv) C:\oz>

Where does this "←[91mNo 'sources' found in the response←[0m" Come from?

Cookie file is set.

Where is I take the found keys from Freevine, I can download with N_m3u8DL-RE

(venv) C:\freevine>N_m3u8DL-RE --key 71790276e17d484f8a0efb9fd6a3fcae:fc50d1414a0f8836c41602977418d4d7 "http://manifest.prod.boltdns.net/manifest/v1/dash/live-baseurl/bccenc/963482467001/6615ff99-5c10-4203-a04b-ce8be0856116/6s/manifest.mpd?fastly_token=NjZiZDBmY2VfNzE3NWI3ODg0M2E5OWRjNjE5M2JiMDhlMmM4ZmZiMmFlMjQ3YTk4ZTg0YWMwNDYzODUyMDcyZDJmYzVhYTNhNg%3D%3D" --save-name "My Life Is Murder - s01e02" -M format=mkv
15:13:27.468 INFO : N_m3u8DL-RE (Beta version) 20231113
15:13:27.493 INFO : Loading URL: http://manifest.prod.boltdns.net/manifest/v1/dash/live-baseurl/bccenc/963482467001/6615ff99-5c10-4203-a04b-ce8be0856116/6s/manifest.mpd?fastly_token=NjZiZDBmY2VfNzE3NWI3ODg0M2E5OWRjNjE5M2JiMDhlMmM4ZmZiMmFlMjQ3YTk4ZTg0YWMwNDYzODUyMDcyZDJmYzVhYTNhNg%3D%3D
15:13:28.256 INFO : Content Matched: Dynamic Adaptive Streaming over HTTP
15:13:28.258 INFO : Parsing streams...
15:13:28.352 WARN : Writing meta json
15:13:28.369 INFO : Extracted, there are 8 streams, with 4 basic streams, 3 audio streams, 1 subtitle streams
15:13:28.371 INFO : Vid *CENC 1280x720 | 2464 Kbps | de600d58-5173-46c0-884c-829e744a27e9 | 25 | avc1.4d001f | 429
Segments | Main | ~42m54s
15:13:28.372 INFO : Vid *CENC 1024x576 | 1296 Kbps | 35f64d31-d135-47ae-a1a5-d626cb8ce3a5 | 25 | avc1.4d001f | 429
Segments | Main | ~42m54s
15:13:28.373 INFO : Vid *CENC 640x360 | 682 Kbps | 0e910540-22e2-4738-955a-8c4b2d9797b6 | 25 | avc1.4d001e | 429
Segments | Main | ~42m54s
15:13:28.374 INFO : Vid *CENC 512x288 | 398 Kbps | d9d9b7b9-8bc9-4d7f-a8f1-35d33756281e | 25 | avc1.420015 | 429
Segments | Main | ~42m54s
15:13:28.376 INFO : Aud *CENC a71f69ff-7184-4b10-8ad1-b63b4568b230 | 192 Kbps | mp4a.40.2 | en | 433 Segments | Main |
~42m57s
15:13:28.377 INFO : Aud *CENC 2f1bbbf1-e0c8-4945-9e7d-3303ba8dd03e | 128 Kbps | mp4a.40.2 | en | 433 Segments | Main |
~42m57s
15:13:28.378 INFO : Aud *CENC b0a48066-8d7a-4897-b17f-461d8cf862a0 | 64 Kbps | mp4a.40.2 | en | 433 Segments | Main |
~42m57s
15:13:28.380 INFO : Sub 5ba639d3-fb81-49d2-ae10-846a000c0b23 | en-NZ | 1 Segment | ~42m52s
15:13:31.614 INFO : Parsing streams...
15:13:31.621 INFO : Selected streams:
15:13:31.622 INFO : Vid *CENC 1280x720 | 2464 Kbps | de600d58-5173-46c0-884c-829e744a27e9 | 25 | avc1.4d001f | 429
Segments | Main | ~42m54s
15:13:31.623 INFO : Aud *CENC a71f69ff-7184-4b10-8ad1-b63b4568b230 | 192 Kbps | mp4a.40.2 | en | 433 Segments | Main |
~42m57s
15:13:31.624 INFO : Sub 5ba639d3-fb81-49d2-ae10-846a000c0b23 | en-NZ | 1 Segment | ~42m52s
15:13:31.625 WARN : Writing meta json
15:13:31.635 INFO : Save Name: My Life Is Murder - s01e02
15:13:31.636 WARN : MuxAfterDone is detected, binary merging is automatically enabled
15:13:31.639 INFO : Start downloading...Vid 1280x720 | 2464 Kbps | de600d58-5173-46c0-884c-829e744a27e9 | 25 |
avc1.4d001f | Main
15:13:32.181 WARN : Type: cenc
15:13:32.186 WARN : PSSH(WV): CAESEHF5AnbhfUhPig77n9aj/K4aDXdpZGV2aW5lX3Rlc3QiCDEyMzQ1Njc4MgdkZWZhdWx0
15:13:32.190 WARN : KID: 71790276e17d484f8a0efb9fd6a3fcae
15:13:32.192 WARN : Reading media info...
15:13:32.245 INFO : [0x1]: Video, h264 (avc1), 1280x720

Vid 1280x720 | 2464 Kbps | 25 | Main ------------------------------ 342/430 79.53% 606.88MB/772.06MB 6.07MBps 00:00:18 \
Aud 192 Kbps | en | Main             ------------------------------    0/100 0.00%                 -    -     --:--:--
Sub en-NZ                            ------------------------------    0/100 0.00%                 -    -     --:--:--

Any ideas? Is my connection on VPN too slow? I have no issue DL directly, just not in ozivine from TVNZ

[ehurdler]

good job.
btw tenplay does do 720p, you just need to modify the m3u8 url

what modification needs to be done one the url/m3u8 file to get 720p?

[billybanana]

Any ideas? Is my connection on VPN too slow? I have no issue DL directly, just not in ozivine from TVNZ

Yep it's your VPN. I have found TVNZ to be quite picky and problematic in what it accepts and what it doesn't.

The show itself is fine.

                              _       _
                      ___ ___(_)_   _(_)_ __   ___
                     / _ \_  / \ \ / / | '_ \ / _ \
                    | (_) / /| |\ V /| | | | |  __/
                     \___/___|_| \_/ |_|_| |_|\___|

                    Version 1.3 Copyright © 2024 billybanana
                    https://github.com/billybanana80/ozivine

Enter the video URL: https://www.tvnz.co.nz/shows/my-life-is-murder/episodes/s1-e2
Ozivine..........initiating TVNZ
Login successful, token obtained
MPD URL: http://manifest.prod.boltdns.net/manifest/v1/dash/live-baseurl/bccenc/963482467001/6615ff99-5c10-4203-a04b-ce8be0856116/6s/manifest.mpd?fastly_token=NjZiZDZkNWRfMzY3ZTNiYjA1OTVhODE4ODhiZmE2NzhhYzIxMDJjOWVmY2Y3NTMyZTJlNmZhNDgwZDRhYzVlN2JlMzExYzU5MA%3D%3D
License URL: https://manifest.prod.boltdns.net/license/v1/cenc/widevine/963482467001/6615ff99-5c10-4203-a04b-ce8be0856116/71790276-e17d-484f-8a0e-fb9fd6a3fcae?fastly_token=NjZiZDZkNWRfMmU1NDUwZTliY2Y0YmIzYWYxZjUwNDg4MThmYzg3YTJmNDcxYTg0ZGIyNTA2Y2MwMGRkZTFiZjFkOTIyMmNhOA%3D%3D
PSSH: AAAAVnBzc2gAAAAA7e+LqXnWSs6jyCfc1R0h7QAAADYIARIQcXkCduF9SE+KDvuf1qP8rhoNd2lkZXZpbmVfdGVzdCIIMTIzNDU2NzgyB2RlZmF1bHQ=
KEYS: --key 71790276e17d484f8a0efb9fd6a3fcae:fc50d1414a0f8836c41602977418d4d7
DOWNLOAD COMMAND:
N_m3u8DL-RE "http://manifest.prod.boltdns.net/manifest/v1/dash/live-baseurl/bccenc/963482467001/6615ff99-5c10-4203-a04b-ce8be0856116/6s/manifest.mpd?fastly_token=NjZiZDZkNWRfMzY3ZTNiYjA1OTVhODE4ODhiZmE2NzhhYzIxMDJjOWVmY2Y3NTMyZTJlNmZhNDgwZDRhYzVlN2JlMzExYzU5MA%3D%3D" --select-video best --select-audio best --select-subtitle all -mt -M format=mkv --save-dir "D:/Downloads/" --save-name "My.Life.Is.Murder.S01E02.720p.TVNZ.WEB-DL.AAC2.0.H.264" --key 71790276e17d484f8a0efb9fd6a3fcae:fc50d1414a0f8836c41602977418d4d7
Do you wish to download? Y or N: y
09:47:21.779 INFO : N_m3u8DL-RE (Beta version) 20231113
09:47:21.797 INFO : Loading URL: http://manifest.prod.boltdns.net/manifest/v1/dash/live-baseurl/bccenc/963482467001/6615ff99-5c10-4203-a04b-ce8be0856116/6s/manifest.mpd?fastly_token=NjZiZDZkNWRfMzY3ZTNiYjA1OTVhODE4ODhiZmE2NzhhYzIxMDJjOWVmY2Y3NTMyZTJlNmZhNDgwZDRhYzVlN2JlMzExYzU5MA%3D%3D
09:47:21.987 INFO : Content Matched: Dynamic Adaptive Streaming over HTTP
09:47:21.988 INFO : Parsing streams...
09:47:22.026 WARN : Writing meta json
09:47:22.036 INFO : Extracted, there are 8 streams, with 4 basic streams, 3 audio streams, 1 subtitle streams
09:47:22.036 INFO : Vid *CENC 1280x720 | 2464 Kbps | de600d58-5173-46c0-884c-829e744a27e9 | 25 | avc1.4d001f | 429
Segments | Main | ~42m54s
09:47:22.037 INFO : Vid *CENC 1024x576 | 1296 Kbps | 35f64d31-d135-47ae-a1a5-d626cb8ce3a5 | 25 | avc1.4d001f | 429
Segments | Main | ~42m54s
09:47:22.037 INFO : Vid *CENC 640x360 | 682 Kbps | 0e910540-22e2-4738-955a-8c4b2d9797b6 | 25 | avc1.4d001e | 429
Segments | Main | ~42m54s
09:47:22.038 INFO : Vid *CENC 512x288 | 398 Kbps | d9d9b7b9-8bc9-4d7f-a8f1-35d33756281e | 25 | avc1.420015 | 429
Segments | Main | ~42m54s
09:47:22.038 INFO : Aud *CENC a71f69ff-7184-4b10-8ad1-b63b4568b230 | 192 Kbps | mp4a.40.2 | en | 433 Segments | Main |
~42m57s
09:47:22.039 INFO : Aud *CENC 2f1bbbf1-e0c8-4945-9e7d-3303ba8dd03e | 128 Kbps | mp4a.40.2 | en | 433 Segments | Main |
~42m57s
09:47:22.039 INFO : Aud *CENC b0a48066-8d7a-4897-b17f-461d8cf862a0 | 64 Kbps | mp4a.40.2 | en | 433 Segments | Main |
~42m57s
09:47:22.039 INFO : Sub 5ba639d3-fb81-49d2-ae10-846a000c0b23 | en-NZ | 1 Segment | ~42m52s
09:47:22.040 INFO : Parsing streams...
09:47:22.042 INFO : Selected streams:
09:47:22.042 INFO : Vid *CENC 1280x720 | 2464 Kbps | de600d58-5173-46c0-884c-829e744a27e9 | 25 | avc1.4d001f | 429
Segments | Main | ~42m54s
09:47:22.043 INFO : Aud *CENC a71f69ff-7184-4b10-8ad1-b63b4568b230 | 192 Kbps | mp4a.40.2 | en | 433 Segments | Main |
~42m57s
09:47:22.043 INFO : Sub 5ba639d3-fb81-49d2-ae10-846a000c0b23 | en-NZ | 1 Segment | ~42m52s
09:47:22.043 WARN : Writing meta json
09:47:22.047 INFO : Save Name: My.Life.Is.Murder.S01E02.720p.TVNZ.WEB-DL.AAC2.0.H.264
09:47:22.047 WARN : MuxAfterDone is detected, binary merging is automatically enabled
09:47:22.048 INFO : Start downloading...Vid 1280x720 | 2464 Kbps | de600d58-5173-46c0-884c-829e744a27e9 | 25 |
avc1.4d001f | Main
09:47:22.048 INFO : Start downloading...Aud a71f69ff-7184-4b10-8ad1-b63b4568b230 | 192 Kbps | mp4a.40.2 | en | Main
09:47:22.289 WARN : Type: cenc
09:47:22.289 WARN : Type: cenc
09:47:22.289 WARN : PSSH(WV): CAESEHF5AnbhfUhPig77n9aj/K4aDXdpZGV2aW5lX3Rlc3QiCDEyMzQ1Njc4MgdkZWZhdWx0
09:47:22.290 WARN : PSSH(WV): CAESEHF5AnbhfUhPig77n9aj/K4aDXdpZGV2aW5lX3Rlc3QiCDEyMzQ1Njc4MgdkZWZhdWx0
09:47:22.290 WARN : KID: 71790276e17d484f8a0efb9fd6a3fcae
09:47:22.291 WARN : KID: 71790276e17d484f8a0efb9fd6a3fcae
09:47:22.292 WARN : Reading media info...
09:47:22.292 WARN : Reading media info...
09:47:22.359 WARN : The entire file has been cut into small segments to accelerate
09:47:22.361 INFO : Start downloading...Sub 5ba639d3-fb81-49d2-ae10-846a000c0b23 | en-NZ
09:47:22.526 WARN : Reading media info...
09:47:22.801 INFO : NaN: Subtitle, webvtt
09:47:22.802 INFO : [0x1]: Audio, aac (mp4a), 192 kb/s
09:47:22.802 INFO : [0x1]: Video, h264 (avc1), 1280x720
09:47:22.802 WARN : Extracting VTT(raw) subtitle...
09:47:22.811 INFO : Binary merging...
09:47:28.231 INFO : Binary merging...
09:47:28.461 INFO : Decrypting...
09:48:07.123 INFO : Binary merging...
09:48:27.024 INFO : Decrypting...
09:48:36.410 WARN : My.Life.Is.Murder.S01E02.720p.TVNZ.WEB-DL.AAC2.0.H.264.mp4
09:48:36.411 WARN : My.Life.Is.Murder.S01E02.720p.TVNZ.WEB-DL.AAC2.0.H.264.en.m4a
09:48:36.411 WARN : My.Life.Is.Murder.S01E02.720p.TVNZ.WEB-DL.AAC2.0.H.264.en-NZ.srt
09:48:36.411 WARN : Muxing to My.Life.Is.Murder.S01E02.720p.TVNZ.WEB-DL.AAC2.0.H.264.MUX.mkv
09:48:40.170 WARN : Cleaning files...
09:48:40.236 WARN : Rename to My.Life.Is.Murder.S01E02.720p.TVNZ.WEB-DL.AAC2.0.H.264.mkv
09:48:40.500 INFO : Done

D:\Downloads\Ozivine>

[achilles]

I get the no sources found in response problem too with TVNZ. Same error as post 49.

Using a VPN, but freevine works for TVNZ no problem. I can watch the show in my browser. I can get an MPD link with stream detector. But ozivine does not want to find anything. I am pretty sure my credentials are ok because it tells me that login was successful and token was obtained.

I know you can't really diagnose a problem you can't reproduce, but that's at least 2 people who can't seem to get TVNZ working.

[billybanana]

I get the no sources found in response problem too with TVNZ.

Do you have a full colon ":" in your username or password by any chance ? That can give you the same error message as the login will get confused by it.

[achilles]

I get the no sources found in response problem too with TVNZ.

Do you have a full colon ":" in your username or password by any chance ? That can give you the same error message as the login will get confused by it.

Nope. The password has an ampersand, comma and exclamation mark, but no colon.

The credentials work in freevine and I can log in using it, so they are valid.

[billybanana]

You've got your credentials added to the config.yaml in this exact format and spacing etc ?

credentials:
  10play: username:password
  tvnz: username:password

I know it's a stupid question but it could be as simple as that.

[achilles]

You've got your credentials added to the config.yaml in this exact format and spacing etc ?

credentials:
  10play: username:password
  tvnz: username:password

I know it's a stupid question but it could be as simple as that.

With the exception that I still have the default 10play line above it with the comment '# Replace with your own credentials', yes, exactly as above. I tried removing the 10play line and the result is the same.

I do get "Login successful, token obtained" but "No 'sources' found in the response". Exactly as it appears in post 49.

[billybanana]

Is this for any show ? What's a URL that you have tried ?

[billybanana]

Just tried downloading something from Threenow and get the following error:

Enter the video URL: https://www.threenow.co.nz/shows/dane-simpson%253A-didgeridoozy/dane-simpson---digerid...659/M70452-010
Ozivine..........initiating ThreeNow
Error importing or running the service module: Could not find the video ID in the API response.

The URL for this is - https://www.threenow.co.nz/shows/dane-simpson%253A-didgeridoozy/S4558-659

Tried it with a few other comedy shows and they didn't work either e.g.

https://www.threenow.co.nz/shows/luke-heggie%253A-i-already-told-you/S4553-588
https://www.threenow.co.nz/shows/harley-breen%253A-flat-out/S4557-009

I've pushed out a fix to the master which resolves this issue for all those shows you listed above.
I also found some Comedy content is unencrypted. This fix will also grab that content now too.

[SaLTy]

Just tried downloading something from Threenow and get the following error:

Enter the video URL: https://www.threenow.co.nz/shows/dane-simpson%253A-didgeridoozy/dane-simpson---digerid...659/M70452-010
Ozivine..........initiating ThreeNow
Error importing or running the service module: Could not find the video ID in the API response.

The URL for this is - https://www.threenow.co.nz/shows/dane-simpson%253A-didgeridoozy/S4558-659

Tried it with a few other comedy shows and they didn't work either e.g.

https://www.threenow.co.nz/shows/luke-heggie%253A-i-already-told-you/S4553-588
https://www.threenow.co.nz/shows/harley-breen%253A-flat-out/S4557-009

I've pushed out a fix to the master which resolves this issue for all those shows you listed above.
I also found some Comedy content is unencrypted. This fix will also grab that content now too.

Legend, thank you

[achilles]

Is this for any show ? What's a URL that you have tried ?

It seems to be for any show. I tried the My Life is Murder episode as posted, and it failed. I just tried some other at random episodes:
https://www.tvnz.co.nz/shows/colin-from-accounts/episodes/s1-e1
https://www.tvnz.co.nz/shows/mary-and-george/episodes/s1-e1

The no sources message comes back pretty fast so it's not like something is timing out. Looks like something is just downright being rejected but I can watch the episodes in my browser no problem.

Perhaps you could add some sort of --debug mode printing out all sorts of info to see what's gong on.