capturing BBC Olympic catch-up videos?

[spiderMan007]

I linked you to use get_iplayer which works via rtmpdump! Post #73!

Bahman can you tell me advantages of using get_iplayer over rtmpdump ? can we get old iplayer shows list that are not in iplayer website which recently removed from site?

Furthermore, for rtmpdump how i can specify to save the output of rtmpdump in another drive? does saving output to external or usb drive affect the speed of download?

[quackeroats]

RTMPDump v2.4-35-ge0056c5
(c) 2010 Andrej Stepanchuk, Howard Chu, The Flvstreamer Team; license: GPL
Connecting ...
INFO: Connected...
Starting download at: 0.000 kB
INFO: Metadata:
INFO:   duration              12191.89
INFO:   moovPosition          36.00
INFO:   width                 640.00
INFO:   height                360.00
INFO:   videocodecid          avc1
INFO:   audiocodecid          mp4a
INFO:   avcprofile            77.00
INFO:   avclevel              30.00
INFO:   aacaot                2.00
INFO:   videoframerate        25.00
INFO:   audiosamplerate       44100.00
INFO:   audiochannels         2.00
INFO: trackinfo:
INFO:   length                12188001.00
INFO:   timescale             1000.00
INFO:   language              eng
INFO: sampledescription:
INFO:   sampletype            amf0
INFO:   length                12191881.00
INFO:   timescale             1000.00
INFO:   language              eng
INFO: sampledescription:
INFO:   sampletype            avc1
INFO:   length                12191894.00
INFO:   timescale             1000.00
INFO:   language              eng
INFO: sampledescription:
INFO:   sampletype            mp4a
1145416.323 kB / 11780.44 sec (96.6%)
ERROR: RTMP_ReadPacket, failed to read RTMP packet body. len: 68977
1145437.553 kB / 11780.44 sec (96.6%)
INFO: Connection timed out, trying to resume.


Resuming download at: 1145437.553 kB
WARNING: HandleInvoke, Sanity failed. no string method in invoke packet
WARNING: HandleInvoke, Sanity failed. no string method in invoke packet

RTMPDump v2.4-35-ge0056c5
(c) 2010 Andrej Stepanchuk, Howard Chu, The Flvstreamer Team; license: GPL
ERROR: Last tag size must be greater/equal zero (prevTagSize=2012410200) and sma
ller then filesize, corrupt file!
INFO: Command exit code 1 (raw code = 256)
WARNING: Retry recording for 'Olympic Taekwondo - London 2012: Semi-finals (p00w
32b5)'
INFO: File name prefix = Olympic_Taekwondo_-_London_2012_Semi-finals_p00w32b5_de
fault

so much for overnight downloading. ><"""""""""""""""

[spiderMan007]

quackeroats did you succeed in resuming from 1145437.553 kB / 11780.44 sec (96.6%)?(resume in same incomplete file)?could you let me know how as i have same problem with some files?

[quackeroats]

quackeroats did you succeed in resuming from 1145437.553 kB / 11780.44 sec (96.6%)?(resume in same incomplete file)?could you let me know how as i have same problem with some files?

no, at 96% the match was over and the rest was just the camera staring at an empty mat. so i am not very bothered to get the remaining 4 %

sorry

[Bahman]

can you tell me advantages of using get_iplayer over rtmpdump ?

By using get_iplayer you don't need to track packets so as to find stream links. Get_iplayer do all of these works it self and then tries to download stream via rtmpdump at the end.

can we get old iplayer shows list that are not in iplayer website which recently removed from site?

if they have removed from site, they have removed that from the server too. So, you can't.

Furthermore, for rtmpdump how i can specify to save the output of rtmpdump in another drive? does saving output to external or usb drive affect the speed of download?

just give it a path, like this: -o "D:/folder1/folder2/folder3/Olympic.flv"
and if you want to save on a USB drive, it depends on your internet speed, if you are downloading streams with over 16MB/s, yes it will effect!

[karlinhosmg]

A get_iplayer download can exceed 4GB?

[mikethetv]

A get_iplayer download can exceed 4GB?

If you are asking whether get_iplayer can download streams in excess of 4Gb then no it can't. The limitation is rtmpdump which get_iplayer uses to download the rtmp stream.

The limitation may be as a result of how rtmpdump is coded as it may use file pointers which are only 32bits in size, I.e. 4Gb. rtmpdump might use OS dependent file pointers which will be limited by the word size of the OS, for example 32bit Windows. A 64bit build of rtmpdump May not have this restriction, I have not looked at the source code so cannot say for sure.

This is not a major issue however as you can split the downloads, see previous posts in this thread for details.

[tluxon]

I've never used get_iplayer before, but I've got it installed. Since the url I'm trying to get is so long, I set up the command in a batch file and set a stop for 60 seconds.

get_iplayer --raw URL --mode flashhd --stop 60

I put the batch file at the root of my system drive and double-clicked on it (Windows), and now my command window just has a bunch of text scrolling by at really high speed. After several minutes, I interrupted it with a Ctrl-C, because obviously something was wrong.

I opened the Recordings Folder and it was empty.

I guess I don't know what URL to use. I used Coojah to try the one that ended in mpeg.ts and the one that ended in .m3u8.

Perhaps ffmpeg is the better option for me, but I wanted to start and stop at specific points in the program and I don't know how to do this with ffmpeg.

Any hints would be welcome

Edit: I just realized I'm posting in the BBC Olympics thread and I'm trying to download from the NBCOlympics site - - Silly me! Let me guess - the guidelines for using get_iplayer won't work for me?

[quackeroats]

If you are asking whether get_iplayer can download streams in excess of 4Gb then no it can't. The limitation is rtmpdump which get_iplayer uses to download the rtmp stream.

when i use RMC to "Fix FLV" iget a duration of 7680.52, i resumed get_iplayer to --start=7680.
do you have methods to join the 2 files? what about miising frames, not sure if it has that big an impact
on the video.

i am thinking convert to mkv, and use mkvmerge

[mikethetv]

If you are asking whether get_iplayer can download streams in excess of 4Gb then no it can't. The limitation is rtmpdump which get_iplayer uses to download the rtmp stream.

when i use RMC to "Fix FLV" iget a duration of 7680.52, i resumed get_iplayer to --start=7680.
do you have methods to join the 2 files? what about miising frames, not sure if it has that big an impact
on the video.

i am thinking convert to mkv, and use mkvmerge

I have not bothered joining the files back together, quite happy with 2 or 3 separate parts, so can't help there.
You will most likely have missing frames of data between the two parts, though you can probably limit this by recording the first part with a stop time like 7200, then restart from there. Personally I have found that subsequent parts have the audio stream shifted by 4 seconds which I need to correct with ffmpeg. I have not bothered to see how seamlessly it all fits together as I am not going to keep this beyond finding the time to watch it.

[spiderMan007]

does any one else get this error trying to view video in bbc sport website ?

This content doesn't seem to be working .try again later.

any solution?

[Chug a Bug]

You guys are awesome. Thanks for the information.

    

[flv @ 0234d420] Broken FLV file, which says no streams present, this might fail

.....................

[mp4 @ 0420fba0] Application provided invalid, non monotonically increasing dts

to muxer in stream 0: 40 >= 40

av_interleaved_write_frame(): Invalid argument

I'm having the same problem, try FLV extract and MP4box/Yamb instead?

It's for December of 2011:

ffmpeg version N-35709-g7d531e8, Copyright (c) 2000-2011 the FFmpeg developers

  built on Dec 12 2011 13:50:00 with gcc 4.6.2

I don't suppose you don't happen to have a link for that build do you? I can't seem to find it anywhere.

edit: Thanks Bahman!

Hi. I have tried to follow the process but Wireshark don´t capture the "open.live.bbc.co.uk"

A screenshot

https://forum.videohelp.com/images/imgfiles/DC2ng.png

Thanks

I found an easier solution in Firefox by opening Tools>Web Developer>Web Console to monitor all traffic and set filter for "open.live.bbc".

does any one else get this error trying to view video in bbc sport website ?

This content doesn't seem to be working .try again later.

any solution?

There are a number of things that can cause that in my experiance from being temporarily unavailable on the server to AdBlock or similar software blocking referral links or some such and even Firewall issues. Also if your internet speed is very slow the servers seem to refuse the connection. I'd start by trying a different browser .

[quackeroats]

someone just pointed out to me somewhere else that the geo-blocking for the youtube olympics videos are no longer being geo blocked.

hence everyone one in the world can get it (i think)
, it might be more "stable" to get a m3u8 link from youtube.com/olympics then from BBC itself using ffmpeg

[Bahman]

I don't suppose you don't happen to have a link for that build do you? I can't seem to find it anywhere.

Here you are!

[Bookworm1632]

Fantastic thread.

I tried rtmpdump first, and got that working, but then switched to Get_iPlayer as it's simpler.

Managed to download several videos including the Rhythmic Gymnastics and the Men's Road Race.

I'm stuck however on the Men's Single Final:

The link is http://www.bbc.co.uk/sport/olympics/2012/live-video/p00w314t

I have now tried four times to download this using the following command:

get_iplayer http://www.bbc.co.uk/sport/olympics/2012/live-video/p00w314t --raw --modes flashhd --force --start 7565 --stop 16830

On each occasion the dl stops between 1.9Gb and 2.1 Gb with the Error:

FLV file contains neither video nor audio, aborting!

Does anyone know what's going wrong here?

[quackeroats]

is it possible that --modes=best does not give you 720p ?

[jimbo2012]

Hi. Sorry but I am new to this and do not understand a word of any of it.

Please can you tell me how to download AdobeHDS and what I am supposed to do? I want a programme that will capture the fragments and join them together to make an flv that will play.

All this code means nothing to me and bTW, Coojah does not work on my computer - running it stops ANY web page from loading.

So how do I get the application that will download each fragment? It tells you here:

http://ingvar.blog.redpill-linpro.com/2012/05/31/downloading-hd-content-from-tv-nrk-no/

what do do but when you click on it you get a text file on screen of the script, not the application. And the term "put it in "~/bin" again - I do not understand this.

So for example, Archery session 1 on 28 July is on the video on this page

http://www.bbc.co.uk/sport/olympics/2012/live-video/p00w2r8y

So what do I do to capture it? Thanks.

[Chug a Bug]

I'll give Bahman a break, it's

get_iplayer --pid= p00w2r8y --modes=flashhd,flashvhigh,flashhigh,flashstd

you can cut edit the --modes= option to give the resolution you want i.e. 1280x720,832x468,640x360 to suit if you wish

if you're outside the UK you'll need a proxy/VPN. Good luck.

is it possible that --modes=best does not give you 720p ?

Sometimes, not sure why, it could be the recording modes is not set as default. You can force it as per above.

[fhcyip]

Can anybody tell me how to download this in HD http://195.188.87.10/iplayer/episode/p00w33bq/hd/Olympic_Gymnastics_Rhythmic_London_20...lAround_final/
Please help !!!!

[Chug a Bug]

get_iplayer --pid=p00w33bq --modes=flashhd

N.B. for anyone else with a similar question just replace the PID in the above line. The PID can be found in the URL it begins with "b" or "p" i.e.

.../iplayer/episode/p00w33bq/....

[fhcyip]

Dear Chug a Bug,
Thx for your help but I can not get it right
Can you guide me step to step how to do it
Thank you Very Much for your help

[LanceBehind]

BBC is GEO-blocked.

But I managed to record everything in 1080HD via YouTube.

It's a very simpel process so if you are interested just reply and I will explain you how I have done it.

Lance

[fhcyip]

Dear LanceBehind,
I am very anxious to find out how to do it, Please guide me through
THX

[DB83]

BBC is GEO-blocked.

But I managed to record everything in 1080HD via YouTube.

It's a very simpel process so if you are interested just reply and I will explain you how I have done it.

Lance

BBC may be blocked but that still does not validate hi-jacking this topic and especially when there is already one about capturing from Youtube.

[Chug a Bug]

@fhcyip try a VPN such as ExpatShield for iPlayer - http://www.expatshield.com/

N.B. for those looking to download BBC videos larger than 4GB try KSV's Adobe HDS Downloader it works great for me: http://stream-recorder.com/forum/adobe-hds-downloader-t12074.html

Grab the Akamai HDS server URL from the Firefox web developer console, (set filters for "akamai" and "&hdcore")

[LanceBehind]

Dear LanceBehind,
I am very anxious to find out how to do it, Please guide me through
THX

Start Firefox :

Go to www.youtube.com/olympic
Pick your sport and the video you want to download
Open web console (CTRL-SHIFT-K)
Optional - Unselect CSS, JS, & Logging on the menu bar
Type in "m3u8" in the filter on top right
Start the video you want to see
Click the gear icon on bottom right of video and select the quality you want (typically 1080) and you'll see a new m3u8 file appear
Copy this link to CTLR-C
Use this URL for the "-i" option of ffmpeg

Goto Start Type CMD

Move to your FFMEG directory : (for example C: and CD FFMPEG/bin)
Type in : ffmpeg -i (YOUR URL WITH m3u8 at the END (* CTLR V won't work so use right mouse button) -c copy output.ts

Hope this helps

Lance

[fhcyip]

Dear LanceBehine,
Thx for your reply' it really works

[jimbo2012]

@fhcyip try a VPN such as ExpatShield for iPlayer - http://www.expatshield.com/

N.B. for those looking to download BBC videos larger than 4GB try KSV's Adobe HDS Downloader it works great for me: http://stream-recorder.com/forum/adobe-hds-downloader-t12074.html

Grab the Akamai HDS server URL from the Firefox web developer console, (set filters for "akamai" and "&hdcore")

Hi. I still do not understand this. I cannot download the Adobe HDS downloader php file. I just get a script of data as it if was a web page but in raw code - not in a format that can be saved.

So what I want is a program that will download the fragments and be able to join them all together as an flv or whatever it is menat to be. Please can you tell me where I can get the actual application file for this HDS Downloader?

Then what am I meant to do? Thanks.

[jimbo2012]

@fhcyip try a VPN such as ExpatShield for iPlayer - http://www.expatshield.com/

N.B. for those looking to download BBC videos larger than 4GB try KSV's Adobe HDS Downloader it works great for me: http://stream-recorder.com/forum/adobe-hds-downloader-t12074.html

Grab the Akamai HDS server URL from the Firefox web developer console, (set filters for "akamai" and "&hdcore")

Hi. I still do not understand this. I cannot download the Adobe HDS downloader php file. I just get a script of data as it if was a web page but in raw code - not in a format that can be saved.

So what I want is a program that will download the fragments and be able to join them all together as an flv or whatever it is menat to be. Please can you tell me where I can get the actual application file for this HDS Downloader?

Then what am I meant to do? Thanks.

Just to let you know I have fot the file but 9 segments are missing. How do I search for the names of missing segments?

Thanks.

[jimbo2012]

Problem solved. BTW if you want to conver to AVI instead of MP4 how would you chagne the instruction? Thanks.