VideoHelp Forum
+ Reply to Thread
Page 1 of 7
1 2 3 ... LastLast
Results 1 to 30 of 194
Thread
  1. I am attempting to capture the following http://www.bbc.co.uk/sport/olympics/2012/schedule-results/fencing/20120728 using wm recoder, which is normally great for capturing stuff from the BBC iplayer. however, i am struggling to capture any of the Olympics catch-up videos and getting the following, see attached.

    Any ideas on how i can capture this data or what tools to use?

    thanks!!
    Attached Thumbnails Click image for larger version

Name:	1.jpg
Views:	786
Size:	472.7 KB
ID:	13265  

    Quote Quote  
  2. Member DB83's Avatar
    Join Date: Jul 2007
    Location: United Kingdom
    Search Comp PM
    try get_iplayer
    Quote Quote  
  3. Originally Posted by DB83 View Post
    try get_iplayer
    I have tried running http://www.infradead.org/get_iplayer_win/get_iplayer_setup_latest.exe and all I get is the following error message "windows cannot access the specified device, path, or file. you may not have the appropriate permissions to access teh item" any ideas? I'm not a techie, just want to find a way of capturing the Olympics any set by step instructions would be most appreciated.
    Last edited by blackhawk01; 29th Jul 2012 at 08:44.
    Quote Quote  
  4. Member DB83's Avatar
    Join Date: Jul 2007
    Location: United Kingdom
    Search Comp PM
    That message is (AFAIK) received if you try to install a program when you are not logged in as an administrator.

    The get_iplayer module only captures items which can be received from the BBC iplayer website ie the main tv feed. The catchup programs are a different web feed and are not on the iplayer.

    To record these you would probably have to use screen capture software - check the tools for suggestions.
    Quote Quote  
  5. Stream recording expert Bahman's Avatar
    Join Date: Dec 2011
    Location: Tehran, Iran
    Search Comp PM
    Use rtmpdump!
    Semi-finals and final of the Women's Individual Foil
    Track the packets you will find:
    http://open.live.bbc.co.uk/mediaselector/5/select/format/xml/version/2.0/vpid/p00w33t6.../?backend=pips
    then find 2800 bitrate and try to write rtmpdump script:
    Code:
    rtmpdump -r "rtmp://cp41752.edgefcs.net:1935/ondemand" -a "ondemand?auth=daEbkcPd1aMb6dCdwbKdBcWdCbNambcbxc4-bqfv49-bWG-BpmGDnEoNEvHpxI&aifp=v001&slist=secure/800kbps/MP/events/p00w33t6_1343504659864.mp4;secure/1500kbps/MP/events/p00w33t6_1343504659881.mp4;secure/480kbps/MP/events/p00w33t6_1343504659851.mp4;secure/3200kbps/events/p00w33t6_1343504659897.mp4" -W "http://www.bbc.co.uk/emp/releases/iplayer/revisions/617463_618125_4/617463_618125_4_emp.swf" -C O:1 -C O:0 -y "mp4:secure/3200kbps/events/p00w33t6_1343504659897.mp4" -o "Semi-finals and final of the Women's Individual Foil.flv"
    Code:
    RTMPDump v2.4 GIT-2012-07-26 (Compiled by KSV)
    (c) 2010 Andrej Stepanchuk, Howard Chu, The Flvstreamer Team; license: GPL
    Connecting ...
    INFO: Connected...
    Starting download at: 0.000 kB
    INFO: Metadata:
    INFO:   duration                10037.76
    INFO:   moovPosition            36.00
    INFO:   width                   1280.00
    INFO:   height                  720.00
    INFO:   videocodecid            avc1
    INFO:   audiocodecid            mp4a
    INFO:   avcprofile              77.00
    INFO:   avclevel                31.00
    INFO:   aacaot                  2.00
    INFO:   videoframerate          25.00
    INFO:   audiosamplerate         44100.00
    INFO:   audiochannels           2.00
    INFO: trackinfo:
    INFO:   length                  10036001.00
    INFO:   timescale               1000.00
    INFO:   language                eng
    INFO: sampledescription:
    INFO:   sampletype              amf0
    INFO:   length                  10037761.00
    INFO:   timescale               1000.00
    INFO:   language                eng
    INFO: sampledescription:
    INFO:   sampletype              avc1
    INFO:   length                  10037778.00
    INFO:   timescale               1000.00
    INFO:   language                eng
    INFO: sampledescription:
    INFO:   sampletype              mp4a
    64.682 kB / 0.00 sec (0.0%)
    There is an auth string which I have red highlighted it! get the fresh one and replace in the your new script! my script may not work for you, because auth string is valid only for few minutes!

    It's same for The quarter-final stages of the Women's Foil Fencing competition
    http://open.live.bbc.co.uk/mediaselector/5/select/format/xml/version/2.0/vpid/p00w33kj...tmpdumpscript:
    Code:
    rtmpdump -r "rtmp://cp41752.edgefcs.net:1935/ondemand" -a "ondemand?auth=daEbWbwawbodGcXdOc4cDbXbfbwd0dab7au-bqfv3.-bWG-JonDCoAqHDwHnyI&aifp=v001&slist=secure/800kbps/MP/events/p00w33kj_1343488293429.mp4;secure/1500kbps/MP/events/p00w33kj_1343488294732.mp4;secure/480kbps/MP/events/p00w33kj_1343488294698.mp4;secure/3200kbps/events/p00w33kj_1343488293466.mp4"  -W  "http://www.bbc.co.uk/emp/releases/iplayer/revisions/617463_618125_4/617463_618125_4_emp.swf"  -C O:1 -C O:0 -y  "mp4:secure/3200kbps/events/p00w33kj_1343488293466.mp4" -o "The quarter-final stages of the Women's Foil Fencing competition.flv"
    Code:
    RTMPDump v2.4 GIT-2012-07-26 (Compiled by KSV)
    (c) 2010 Andrej Stepanchuk, Howard Chu, The Flvstreamer Team; license: GPL
    Connecting ...
    INFO: Connected...
    Starting download at: 0.000 kB
    INFO: Metadata:
    INFO:   duration                20670.20
    INFO:   moovPosition            36.00
    INFO:   width                   1280.00
    INFO:   height                  720.00
    INFO:   videocodecid            avc1
    INFO:   audiocodecid            mp4a
    INFO:   avcprofile              77.00
    INFO:   avclevel                31.00
    INFO:   aacaot                  2.00
    INFO:   videoframerate          24.87
    INFO:   audiosamplerate         44100.00
    INFO:   audiochannels           2.00
    INFO: trackinfo:
    INFO:   length                  20668001.00
    INFO:   timescale               1000.00
    INFO:   language                eng
    INFO: sampledescription:
    INFO:   sampletype              amf0
    INFO:   length                  20670201.00
    INFO:   timescale               1000.00
    INFO:   language                eng
    INFO: sampledescription:
    INFO:   sampletype              avc1
    INFO:   length                  20670196.00
    INFO:   timescale               1000.00
    INFO:   language                eng
    INFO: sampledescription:
    INFO:   sampletype              mp4a
    0.682 kB / 0.00 sec (0.0%)
    Good Luck!
    Quote Quote  
  6. I too am trying to download catch up videos from the BBC website. Specifically this video (and all of the next ones): http://www.bbc.co.uk/sport/olympics/2012/live-video/p00w2vjs

    I've tried URLSnooper, get_iplayer, WM Recorder. Will try RTMPExplorer in a sec and update. Would really appreciate some help!
    Quote Quote  
  7. Member olyteddy's Avatar
    Join Date: Dec 2005
    Location: United States
    Search Comp PM
    Mirillis Action is a good screen recorder. Needs Aero to work though (no XP or prior support).
    Quote Quote  
  8. Originally Posted by Bahman View Post
    Use rtmpdump!
    Semi-finals and final of the Women's Individual Foil
    Track the packets you will find:
    http://open.live.bbc.co.uk/mediaselector/5/select/format/xml/version/2.0/vpid/p00w33t6.../?backend=pips
    then find 2800 bitrate and try to write rtmpdump script:
    Code:
    rtmpdump -r "rtmp://cp41752.edgefcs.net:1935/ondemand" -a "ondemand?auth=daEbkcPd1aMb6dCdwbKdBcWdCbNambcbxc4-bqfv49-bWG-BpmGDnEoNEvHpxI&aifp=v001&slist=secure/800kbps/MP/events/p00w33t6_1343504659864.mp4;secure/1500kbps/MP/events/p00w33t6_1343504659881.mp4;secure/480kbps/MP/events/p00w33t6_1343504659851.mp4;secure/3200kbps/events/p00w33t6_1343504659897.mp4" -W "http://www.bbc.co.uk/emp/releases/iplayer/revisions/617463_618125_4/617463_618125_4_emp.swf" -C O:1 -C O:0 -y "mp4:secure/3200kbps/events/p00w33t6_1343504659897.mp4" -o "Semi-finals and final of the Women's Individual Foil.flv"
    ...

    Good Luck!
    How did you extract track the information you need to pass to rtmpdump? I have tried Wiresharking the connection but failed to find strings that look similar to those you have given here. Which player did you capture the data from?

    Any assistance very welcome.
    Quote Quote  
  9. Stream recording expert Bahman's Avatar
    Join Date: Dec 2011
    Location: Tehran, Iran
    Search Comp PM
    tracking packets by Coojah!
    You don't need to track packets to find auth string! You should track packets to find this url:
    http://open.live.bbc.co.uk/mediaselector/5/select/format/xml/version/2.0/vpid/p00w33t6.../?backend=pips

    When you find this, if you go to this url, there will be a lot of stream URL and Auth string! Use each one you wanT!
    Quote Quote  
  10. Originally Posted by Bahman View Post
    tracking packets by Coojah!
    You don't need to track packets to find auth string! You should track packets to find this url:
    http://open.live.bbc.co.uk/mediaselector/5/select/format/xml/version/2.0/vpid/p00w33t6.../?backend=pips

    When you find this, if you go to this url, there will be a lot of stream URL and Auth string! Use each one you wanT!
    Thanks Bahman that got me going. I did not quite understand initially where all the information came from. The Olympic streams seem to be done quite different to the standard iPlayer streams.

    Anyway for anyone elses benefit this is how I grabbed the stream data:

    • Find Wireshark to do packet sniffing. I did try Coojah! and the newer MediaBox from the same developer but could not get either to work under Win 7 64 bit. Whether that was Win 7 64bit to blame or my incompetance or other not sure.
    • Get the URL to the catch up stream you want, for example this is the mens team archery final from Saturday 28th:
    Code:
    http://www.bbc.co.uk/sport/olympics/2012/live-video/p00w2srx
    • Set Wireshark capturing on your internet connected interface. I set up the following capture filter to remove all local network traffic as I have a lot on our network, you may find that this is unnecessary (w.x.y.z is the network address of my computer, for example 192.168.1.0):
    Code:
    not ((src net w.x.y.z/24) and (dst net w.x.y.z/24)) and not broadcast
    • Start playing the stream in the web browser. Only needs a few seconds of play time.
    • Stop Wireshark, type Ctrl-F to search the packets, then type "open.live.bbc.co.uk" into the find field and select "String" for the search "Find By" option and "Packet bytes" for the "Search In" option. This should find a packet with this address, if you right click on this packet in the packet view and select "Follow TCP Stream" you get an easier view of the data, requests and responses.
    • In this view look for a "GET" request method as below, we are interested in the "mediaselector" part highlighted in red (this is only a small fraction of the data):
    Code:
    ...
    .<allow-access-from domain="extdev.bbc.co.uk" />
    .<allow-access-from domain="*.bbci.co.uk" />
    </cross-domain-policy>
    GET /mediaselector/5/select/format/xml/version/2.0/vpid/p00w33kj/mediaset/pc/atk/997c7ae8bc27c4743583cb6f0f7ca34fa538c79a/asn/1/?backend=pips HTTP/1.1
    Host: open.live.bbc.co.uk
    User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64; rv:14.0) Gecko/20100101 Firefox/14.0.1
    Accept: text/html,application/xhtml+xml,application/xml;q=0.9,*/*;q=0.8
    ...
    • Now in a browser goto the following address, the red highlighted part is from the step above:
    Code:
    http://open.live.bbc.co.uk/mediaselector/5/select/format/xml/version/2.0/vpid/p00w33kj/mediaset/pc/atk/997c7ae8bc27c4743583cb6f0f7ca34fa538c79a/asn/1/?backend=pips
    • This will open an XML link similar to the following (this is only part of the output):
    Code:
    <media bitrate="480" encoding="h264" expires="2013-01-12T23:59:59+00:00" height="360" kind="video" media_file_size="1338829452" service="iplayer_streaming_h264_flv_lo" type="video/mp4" width="640"><connection application="ondemand" authExpires="2012-08-02T16:36:52+00:00" authExpiresOffset="6625" authString="auth=daEcxb9acacdpdRcCdpdwc.dwdcbUbgdrbf-bqgPld-bWG-EomDCnyqKEqGvzH&aifp=v001&slist=secure/480kbps/MP/events/p00w33kj_1343488294698.mp4;secure/800kbps/MP/events/p00w33kj_1343488293429.mp4;secure/1500kbps/MP/events/p00w33kj_1343488294732.mp4;secure/3200kbps/events/p00w33kj_1343488293466.mp4" dpw="65" identifier="mp4:secure/480kbps/MP/events/p00w33kj_1343488294698.mp4" priority="5" protocol="rtmp" server="cp41752.edgefcs.net" supplier="akamai"/><connection application="a1414/e3" authExpires="2012-08-02T16:26:31+00:00" authExpiresOffset="6004" authString="as=adobe-hmac-sha256&av=1&te=connect&mp=iplayerstream/secure_auth/480kbps/MP/events/p00w33kj_1343488294698.mp4,iplayerstream/secure_auth/800kbps/MP/events/p00w33kj_1343488293429.mp4,iplayerstream/secure_auth/1500kbps/MP/events/p00w33kj_1343488294732.mp4&et=1343925987&fmta-token=3e21e0ba68daa27914cd41c0e96a54df6c92a4e5f35873ee1380b3d2379bd976" identifier="mp4:iplayerstream/secure_auth/480kbps/MP/events/p00w33kj_1343488294698.mp4" priority="10" protocol="rtmp" server="bbcmedia.fcod.llnwd.net" supplier="limelight"/><connection href="http://bbchdsodsecure-f.akamaihd.net/z/iplayerstream/secure_auth/,480kbps/MP/events/p00w33kj_1343488294698,800kbps/MP/events/p00w33kj_1343488293429,1500kbps/MP/events/p00w33kj_1343488294732,3200kbps/events/p00w33kj_1343488293466,.mp4.csmil/manifest.f4m?hdnea=st=1343918787~exp=1343940387~acl=/*480kbps/MP/events/p00w33kj_1343488294698,800kbps/MP/events/p00w33kj_1343488293429,1500kbps/MP/events/p00w33kj_1343488294732,3200kbps/events/p00w33kj_1343488293466*~hmac=89710f1ebd46c172f4d43265b6c16ee571160a2560874477c304c36cff95ba1d&hdcore" priority="95" protocol="http" supplier="akamai_hds_vod" transferFormat="hds"/></media>
    <media bitrate="796" encoding="h264" expires="2013-01-12T23:59:59+00:00" height="360" kind="video" media_file_size="2102220057" service="iplayer_streaming_h264_flv" type="video/mp4" width="640"><connection authExpires="2012-08-02T16:36:52+00:00" authExpiresOffset="6625" authString="auth=daEcxb9acacdpdRcCdpdwc.dwdcbUbgdrbf-bqgPld-bWG-EomDCnyqKEqGvzH&aifp=v001&slist=secure/480kbps/MP/events/p00w33kj_1343488294698.mp4;secure/800kbps/MP/events/p00w33kj_1343488293429.mp4;secure/1500kbps/MP/events/p00w33kj_1343488294732.mp4;secure/3200kbps/events/p00w33kj_1343488293466.mp4" dpw="65" identifier="mp4:secure/800kbps/MP/events/p00w33kj_1343488293429.mp4" priority="5" protocol="rtmp" server="cp41752.edgefcs.net" supplier="akamai"/><connection application="a1414/e3" authExpires="2012-08-02T16:26:31+00:00" authExpiresOffset="6004" authString="as=adobe-hmac-sha256&av=1&te=connect&mp=iplayerstream/secure_auth/480kbps/MP/events/p00w33kj_1343488294698.mp4,iplayerstream/secure_auth/800kbps/MP/events/p00w33kj_1343488293429.mp4,iplayerstream/secure_auth/1500kbps/MP/events/p00w33kj_1343488294732.mp4&et=1343925987&fmta-token=3e21e0ba68daa27914cd41c0e96a54df6c92a4e5f35873ee1380b3d2379bd976" identifier="mp4:iplayerstream/secure_auth/800kbps/MP/events/p00w33kj_1343488293429.mp4" priority="10" protocol="rtmp" server="bbcmedia.fcod.llnwd.net" supplier="limelight"/><connection href="http://bbchdsodsecure-f.akamaihd.net/z/iplayerstream/secure_auth/,480kbps/MP/events/p00w33kj_1343488294698,800kbps/MP/events/p00w33kj_1343488293429,1500kbps/MP/events/p00w33kj_1343488294732,3200kbps/events/p00w33kj_1343488293466,.mp4.csmil/manifest.f4m?hdnea=st=1343918787~exp=1343940387~acl=/*480kbps/MP/events/p00w33kj_1343488294698,800kbps/MP/events/p00w33kj_1343488293429,1500kbps/MP/events/p00w33kj_1343488294732,3200kbps/events/p00w33kj_1343488293466*~hmac=89710f1ebd46c172f4d43265b6c16ee571160a2560874477c304c36cff95ba1d&hdcore" priority="95" protocol="http" supplier="akamai_hds_vod" transferFormat="hds"/></media>
    • Next pick the bitrate of the stream you want, for example above I want the 796 rate (highlighted in green). Each rate is a separate <media></media> XML element.
    • The next bit is probably most easily acheived in a text editor to create a batch or script file. You need to look in the <media></media> element for the bitrate you want and extract the XML attribute named "authString" and "identifier", highlighted blue and purple. These need to be pasted into the rtmpdump command below in the similarly highlighted sections (change the output filename appropriately):
    Code:
    rtmpdump -r "rtmp://cp41752.edgefcs.net:1935/ondemand" -a "ondemand?auth=daEcxb9acacdpdRcCdpdwc.dwdcbUbgdrbf-bqgPld-bWG-EomDCnyqKEqGvzH&aifp=v001&slist=secure/480kbps/MP/events/p00w33kj_1343488294698.mp4;secure/800kbps/MP/events/p00w33kj_1343488293429.mp4;secure/1500kbps/MP/events/p00w33kj_1343488294732.mp4;secure/3200kbps/events/p00w33kj_1343488293466.mp4" -W "http://www.bbc.co.uk/emp/releases/iplayer/revisions/617463_618125_4/617463_618125_4_emp.swf" -C O:1 -C O:0 -y "mp4:secure/800kbps/MP/events/p00w33kj_1343488293429.mp4" -o "Archery.flv"
    This has worked well for me and now I am quite adept at finding the strings to construct the rtmpdump command with. I have had a few failures where the running rtmpdump has aborted part way through. It suggests you could try resuming but this never seemed to work. I think you can specify start and stop times to rtmpdump so yu could try that to resume from where you left of, or ther abouts.

    Good luck.
    Last edited by mikethetv; 8th Aug 2012 at 03:51. Reason: Missed out search in field selection for Wireshark find. Also output of rtmpdump is an flv not mp4.
    Quote Quote  
  11. I know why some of my captures have failed, the streams all stopped after the output file reached 4GB. HD streams, even mp4, are still quite large when the coverage stretches to 3-4 hrs.
    Quote Quote  
  12. Stream recording expert Bahman's Avatar
    Join Date: Dec 2011
    Location: Tehran, Iran
    Search Comp PM
    ^ yes, I would want to say that!
    Quote Quote  
  13. Originally Posted by mikethetv View Post
    I know why some of my captures have failed, the streams all stopped after the output file reached 4GB. HD streams, even mp4, are still quite large when the coverage stretches to 3-4 hrs.
    OK a solution to the file size issue is the "--start" and "--stop" options to rtmpdump. You can either chop the stream up guestimating the length of time, or wait for it to fail at 4GB and then repeat the command specifying "--start <secs>" with a number of seconds to skip, when rtmpdump aborts it prints the number of seconds up to that point so I have rounded that down by a few and started it again.

    Another thing I have noticed with the rtmpdump example above is that although it names the file mp4, it is still an flv container, this is fine with VLC but Windows Media Player does not like it. I therefore suggest for Windows to output to flv and use the ffmpeg command below to recontainerise it:
    Code:
    ffmpeg -i "input.flv" -acodec copy -vcodec copy -y "output.mp4"
    If you are splitting the files with "--start" then ffmpeg does not like the subsequent parts as it sees non-monitonically increasing dts. I found I could work around this by adding "-ss 1" to the ffmpeg line before the "-i" parameter. This skips a number of seconds at the start of the file. There may be a better solution.
    Quote Quote  
  14. Hi. I have tried to follow the process but Wireshark donīt capture the "open.live.bbc.co.uk"

    A screenshot

    http://i.imgur.com/DC2ng.png

    Thanks
    Quote Quote  
  15. Originally Posted by mikethetv View Post

    OK a solution to the file size issue is the "--start" and "--stop" options to rtmpdump. You can either chop the stream up guestimating the length of time, or wait for it to fail at 4GB and then repeat the command specifying "--start <secs>" with a number of seconds to skip, when rtmpdump aborts it prints the number of seconds up to that point so I have rounded that down by a few and started it again.
    hi mike, after i set --start in the line, the duration of the output video is not correct in VLC which makes the video unseekable

    for example, i recorded 10s clip starting 00:05:00, but the video shows 00:05:10 in VLC which should be only 10s

    i was able to use replay media catcher to fix the duration when the video recording is abruptly ended, but it doesn't seem to be able of fix the video with a different starting point

    any suggestions? thanks in advance
    Quote Quote  
  16. Stream recording expert Bahman's Avatar
    Join Date: Dec 2011
    Location: Tehran, Iran
    Search Comp PM
    ^Use "FlvFixer" PHP Script if you don't want to re-encode video! ffmpeg, is another option!

    Originally Posted by karlinhosmg View Post
    Hi. I have tried to follow the process but Wireshark donīt capture the "open.live.bbc.co.uk"

    A screenshot

    http://i.imgur.com/DC2ng.png

    Thanks
    Seems you have find Adobe HDS links to the video! Also with those links, you can download videos via "Adobe HDS" PHP script!
    Quote Quote  
  17. Thanks for answer, but i don't know what is "Adobe HDS" PHP script. I have searched but i have three options to download:

    "Download free development server"
    "Download file Packager HTTP DS"
    "Download Original Module for HTTP DS"
    Quote Quote  
  18. Stream recording expert Bahman's Avatar
    Join Date: Dec 2011
    Location: Tehran, Iran
    Search Comp PM
    Here!
    Quote Quote  
  19. Has anyone succeeded in doing this using RTMPExplorer? I don't think I'd be able to work out how to use RTMPdump, I'm no good at command line applications.
    Last edited by Aussiemarco; 6th Aug 2012 at 03:32.
    Quote Quote  
  20. Hi Bahman

    If i'm not wronG, the AdobeHDS.php serves to join .f4f files into .flv, but how I download the .f4f files? I have these links

    Code:
    GET http://bbchdsodsecure-f.akamaihd.net/z/iplayerstream/secure_auth/,480kbps/MP/events/p00w3c5t_1344162975160,800kbps/MP/events/p00w3c5t_1344162975174,1500kbps/MP/events/p00w3c5t_1344162975195,3200kbps/events/p00w3c5t_1344162975209,.mp4.csmil/0_6c82c50a47155d93_Seg1-Frag32 HTTP/1.1
    
    Host: bbchdsodsecure-f.akamaihd.net
    
    Proxy-Connection: keep-alive
    
    User-Agent: Mozilla/5.0 (Windows NT 5.1) AppleWebKit/537.1 (KHTML, like Gecko) Chrome/21.0.1180.60 Safari/537.1
    
    Accept: */*
    
    Referer: http://www.bbc.co.uk/sport/olympics/2012/live-video/p00w315g
    
    Accept-Encoding: gzip,deflate,sdch
    
    Accept-Language: es-ES,es;q=0.8
    
    Accept-Charset: ISO-8859-1,utf-8;q=0.7,*;q=0.3
    
    DNT: 1
    
    
    
    GET http://bbchdsodsecure-f.akamaihd.net/z/iplayerstream/secure_auth/,480kbps/MP/events/p00w3c5t_1344162975160,800kbps/MP/events/p00w3c5t_1344162975174,1500kbps/MP/events/p00w3c5t_1344162975195,3200kbps/events/p00w3c5t_1344162975209,.mp4.csmil/0_6c82c50a47155d93_Seg1-Frag33 HTTP/1.1
    
    Host: bbchdsodsecure-f.akamaihd.net
    
    Proxy-Connection: keep-alive
    
    User-Agent: Mozilla/5.0 (Windows NT 5.1) AppleWebKit/537.1 (KHTML, like Gecko) Chrome/21.0.1180.60 Safari/537.1
    
    Accept: */*
    
    Referer: http://www.bbc.co.uk/sport/olympics/2012/live-video/p00w315g
    
    Accept-Encoding: gzip,deflate,sdch
    
    Accept-Language: es-ES,es;q=0.8
    
    Accept-Charset: ISO-8859-1,utf-8;q=0.7,*;q=0.3
    
    DNT: 1
    
    
    
    GET http://bbchdsodsecure-f.akamaihd.net/z/iplayerstream/secure_auth/,480kbps/MP/events/p00w3c5t_1344162975160,800kbps/MP/events/p00w3c5t_1344162975174,1500kbps/MP/events/p00w3c5t_1344162975195,3200kbps/events/p00w3c5t_1344162975209,.mp4.csmil/0_6c82c50a47155d93_Seg1-Frag34 HTTP/1.1
    
    Host: bbchdsodsecure-f.akamaihd.net
    
    Proxy-Connection: keep-alive
    
    User-Agent: Mozilla/5.0 (Windows NT 5.1) AppleWebKit/537.1 (KHTML, like Gecko) Chrome/21.0.1180.60 Safari/537.1
    
    Accept: */*
    
    Referer: http://www.bbc.co.uk/sport/olympics/2012/live-video/p00w315g
    
    Accept-Encoding: gzip,deflate,sdch
    
    Accept-Language: es-ES,es;q=0.8
    
    Accept-Charset: ISO-8859-1,utf-8;q=0.7,*;q=0.3
    
    DNT: 1
    
    
    
    GET http://bbchdsodsecure-f.akamaihd.net/z/iplayerstream/secure_auth/,480kbps/MP/events/p00w3c5t_1344162975160,800kbps/MP/events/p00w3c5t_1344162975174,1500kbps/MP/events/p00w3c5t_1344162975195,3200kbps/events/p00w3c5t_1344162975209,.mp4.csmil/0_6c82c50a47155d93_Seg1-Frag35 HTTP/1.1
    
    Host: bbchdsodsecure-f.akamaihd.net
    
    Proxy-Connection: keep-alive
    
    User-Agent: Mozilla/5.0 (Windows NT 5.1) AppleWebKit/537.1 (KHTML, like Gecko) Chrome/21.0.1180.60 Safari/537.1
    
    Accept: */*
    
    Referer: http://www.bbc.co.uk/sport/olympics/2012/live-video/p00w315g
    
    Accept-Encoding: gzip,deflate,sdch
    
    Accept-Language: es-ES,es;q=0.8
    
    Accept-Charset: ISO-8859-1,utf-8;q=0.7,*;q=0.3
    
    DNT: 1
    
    
    
    GET http://bbchdsodsecure-f.akamaihd.net/z/iplayerstream/secure_auth/,480kbps/MP/events/p00w3c5t_1344162975160,800kbps/MP/events/p00w3c5t_1344162975174,1500kbps/MP/events/p00w3c5t_1344162975195,3200kbps/events/p00w3c5t_1344162975209,.mp4.csmil/0_6c82c50a47155d93_Seg1-Frag36 HTTP/1.1
    
    Host: bbchdsodsecure-f.akamaihd.net
    
    Proxy-Connection: keep-alive
    
    User-Agent: Mozilla/5.0 (Windows NT 5.1) AppleWebKit/537.1 (KHTML, like Gecko) Chrome/21.0.1180.60 Safari/537.1
    
    Accept: */*
    
    Referer: http://www.bbc.co.uk/sport/olympics/2012/live-video/p00w315g
    
    Accept-Encoding: gzip,deflate,sdch
    
    Accept-Language: es-ES,es;q=0.8
    
    Accept-Charset: ISO-8859-1,utf-8;q=0.7,*;q=0.3
    
    DNT: 1
    
    
    
    GET http://bbchdsodsecure-f.akamaihd.net/z/iplayerstream/secure_auth/,480kbps/MP/events/p00w3c5t_1344162975160,800kbps/MP/events/p00w3c5t_1344162975174,1500kbps/MP/events/p00w3c5t_1344162975195,3200kbps/events/p00w3c5t_1344162975209,.mp4.csmil/0_6c82c50a47155d93_Seg1-Frag37 HTTP/1.1
    
    Host: bbchdsodsecure-f.akamaihd.net
    
    Proxy-Connection: keep-alive
    
    User-Agent: Mozilla/5.0 (Windows NT 5.1) AppleWebKit/537.1 (KHTML, like Gecko) Chrome/21.0.1180.60 Safari/537.1
    
    Accept: */*
    
    Referer: http://www.bbc.co.uk/sport/olympics/2012/live-video/p00w315g
    
    Accept-Encoding: gzip,deflate,sdch
    
    Accept-Language: es-ES,es;q=0.8
    
    Accept-Charset: ISO-8859-1,utf-8;q=0.7,*;q=0.3
    
    DNT: 1
    
    
    
    GET http://bbchdsodsecure-f.akamaihd.net/z/iplayerstream/secure_auth/,480kbps/MP/events/p00w3c5t_1344162975160,800kbps/MP/events/p00w3c5t_1344162975174,1500kbps/MP/events/p00w3c5t_1344162975195,3200kbps/events/p00w3c5t_1344162975209,.mp4.csmil/0_6c82c50a47155d93_Seg1-Frag38 HTTP/1.1
    
    Host: bbchdsodsecure-f.akamaihd.net
    
    Proxy-Connection: keep-alive
    
    User-Agent: Mozilla/5.0 (Windows NT 5.1) AppleWebKit/537.1 (KHTML, like Gecko) Chrome/21.0.1180.60 Safari/537.1
    
    Accept: */*
    
    Referer: http://www.bbc.co.uk/sport/olympics/2012/live-video/p00w315g
    
    Accept-Encoding: gzip,deflate,sdch
    
    Accept-Language: es-ES,es;q=0.8
    
    Accept-Charset: ISO-8859-1,utf-8;q=0.7,*;q=0.3
    
    DNT: 1
    
    
    
    GET http://bbchdsodsecure-f.akamaihd.net/z/iplayerstream/secure_auth/,480kbps/MP/events/p00w3c5t_1344162975160,800kbps/MP/events/p00w3c5t_1344162975174,1500kbps/MP/events/p00w3c5t_1344162975195,3200kbps/events/p00w3c5t_1344162975209,.mp4.csmil/0_6c82c50a47155d93_Seg1-Frag39 HTTP/1.1
    
    Host: bbchdsodsecure-f.akamaihd.net
    
    Proxy-Connection: keep-alive
    
    User-Agent: Mozilla/5.0 (Windows NT 5.1) AppleWebKit/537.1 (KHTML, like Gecko) Chrome/21.0.1180.60 Safari/537.1
    
    Accept: */*
    
    Referer: http://www.bbc.co.uk/sport/olympics/2012/live-video/p00w315g
    
    Accept-Encoding: gzip,deflate,sdch
    
    Accept-Language: es-ES,es;q=0.8
    
    Accept-Charset: ISO-8859-1,utf-8;q=0.7,*;q=0.3
    
    DNT: 1
    Thanks
    Quote Quote  
  21. Originally Posted by timeywimey View Post
    Originally Posted by mikethetv View Post

    OK a solution to the file size issue is the "--start" and "--stop" options to rtmpdump. You can either chop the stream up guestimating the length of time, or wait for it to fail at 4GB and then repeat the command specifying "--start <secs>" with a number of seconds to skip, when rtmpdump aborts it prints the number of seconds up to that point so I have rounded that down by a few and started it again.
    hi mike, after i set --start in the line, the duration of the output video is not correct in VLC which makes the video unseekable

    for example, i recorded 10s clip starting 00:05:00, but the video shows 00:05:10 in VLC which should be only 10s

    i was able to use replay media catcher to fix the duration when the video recording is abruptly ended, but it doesn't seem to be able of fix the video with a different starting point

    any suggestions? thanks in advance
    Hi timeywimey. Until I re-containerised the files so WMP was happy with them I did preview them in VLC but did not see this issue, but then again I probably was not looking out for it. The files I passed through ffmpeg play fine in WMP and VLC with not obvious timeline problems.

    Perhaps try Flvfixer as suggested by Bahman or the ffmpeg line I quoted. This does not re-encode, just re-containerises and probably fixes the timeline as it initially barfed on the part 2, 3, etc files until I added the -ss option.
    Quote Quote  
  22. Originally Posted by Bahman View Post
    ^Use "FlvFixer" PHP Script if you don't want to re-encode video! ffmpeg, is another option!

    Originally Posted by karlinhosmg View Post
    Hi. I have tried to follow the process but Wireshark donīt capture the "open.live.bbc.co.uk"

    A screenshot

    http://i.imgur.com/DC2ng.png

    Thanks
    Seems you have find Adobe HDS links to the video! Also with those links, you can download videos via "Adobe HDS" PHP script!
    Looks like the BBC are making the coverage available by at least two methods, RTMP and HDS. All the catch-up I was interested in has so far fallen into the RTMP streams so the method I details (credit to Bahman for pointing me in the right direction) seems to have worked. The babmington you found does not seem to be distributed in this way. Not sure why some feeds are done this way and other not. Adobe HDS seems to be bit-rate variable so perhaps more active sports are being encoded this way.

    Suggest you try Bahmans php method on these as I don't have any other suggestions, sorry.
    Quote Quote  
  23. Originally Posted by Aussiemarco View Post
    Has anyone succeeded in doing this using RTMPExplorer? I don't think I'd be able to work out how to use RTMPdump, I'm no good at command line applications. Would love to capture some Olympic events before they disappear.
    I failed to get RTMPexplorer or RTMPexplorerX to find the streams, though I did eventually manager to use then to catch an ITVplayer stream some months ago.

    I also tried various other media catching programs, URLSnooper and some others I can't remember the names of, again without success. GetFlv looked promising, displaying several RTMP URLs, but it sadly failed to download any.

    The method I detail above using Wireshark and rtmpdump command line does work (except on the Adobe HDS streams). The rtmpdump line is mostly fixed, just requiring the authstring and identifier from the XML page pointed to in the Wireshark capture.
    Quote Quote  
  24. Member
    Join Date: Aug 2012
    Location: UK
    Search PM
    Very useful thread.
    I followed your protocol mikethetv but in Wireshark after sniffing and Ctrl-F I cannot find any "open.live.bbc.co.uk" string.

    If I save the capture file and do Ctrl-F in notepad I find one occurence of the open.live string. I attach a bit of the pcapng capture file.

    Any idea?

    These are the link I am interested in:

    http://www.bbc.co.uk/sport/olympics/2012/live-video/p00w2vy7

    http://www.bbc.co.uk/sport/olympics/2012/live-video/p00w386x
    Attached Files
    Quote Quote  
  25. Originally Posted by saptecai View Post
    Very useful thread.
    I followed your protocol mikethetv but in Wireshark after sniffing and Ctrl-F I cannot find any "open.live.bbc.co.uk" string.

    If I save the capture file and do Ctrl-F in notepad I find one occurence of the open.live string. I attach a bit of the pcapng capture file.

    Any idea?

    These are the link I am interested in:

    http://www.bbc.co.uk/sport/olympics/2012/live-video/p00w2vy7

    http://www.bbc.co.uk/sport/olympics/2012/live-video/p00w386x
    Hi saptecai.

    Make sure when you do the initial wireshark find that you select "Packet bytes" for the "Search In" selection radio buttons. Perhaps I did not make that clear, probably forgot. If you leave it with the default "Packet List" all you get is a DNS query for "open.live.bbc.co.uk".

    For the first link you provided I found the mediaselector page link no problem, so you should be able to download this one with rtmpdump. I had wondered whether this was another Adobe HDS stream.
    Quote Quote  
  26. Originally Posted by ;2177942
    Hi. I have tried to follow the process but Wireshark donīt capture the "open.live.bbc.co.uk"

    A screenshot

    http://i.imgur.com/DC2ng.png

    Thanks
    Hi karlinhosmg

    Sorry I missed a search option from the Wireshark find for "open.live.bbc.co.uk" which I only just noticed when saptecai failed to find it also. See my revised post or the reply to saptecai. This should now work as I managed to find the mediaselector page for the link you show in the screenshot.
    Last edited by mikethetv; 6th Aug 2012 at 11:58. Reason: Typo, not for now
    Quote Quote  
  27. Sreen record would be a good idea, video quality could be the only problem.
    Try Camtasia studio, that's a pretty good one. However, the one could encode video format, you need get another video converter for encode.
    Quote Quote  
  28. I already did so but doesn't work. With the first saptecai's link i capture the hds stream
    Quote Quote  
  29. Originally Posted by karlinhosmg View Post
    I already did so but doesn't work. With the first saptecai's link i capture the hds stream
    Is this a reply to my reply about the incorrect find option?

    I just tried taking your link for the babmington singles semi and paste it into Firefox, then before hitting the play button set Wireshark to capture. Ctrl-F and look for "open.live" and bingo there is a packet with the mediaselector line:

    Code:
    /mediaselector/5/select/format/xml/version/2.0/vpid/p00w3b47/mediaset/pc/atk/21f903e9f7aa59ac1469338a866677c99b8c6cad/asn/1/?backend=pips
    Just to make sure I tried it again and did not find the packet. Tried IE instead and also failed. Tried it on my other computer, which is not currently pulling an RTMP stream, and found it no problem with both IE and Firefox. Tried again and no packet. Maybe the packet is cached and so if you visit the page and then revisit with Wireshark running, the mediaselector XML link is not requested again. Just guessing, but there is definitely the open.live.bbc.co.uk packet for that stream.

    Try leaving it for a bit or clearing the browser cache and trying again. Not had a chance to experiment with that myself.
    Quote Quote  
  30. Can someone explain this to me in the most basic way? I am a noob here, and I don't care if your reply will be long, I'm willing to learn this. I appreciate any help I can get.
    Quote Quote  



Similar Threads