Deciphering strange H264 fragments

[Kryzon]

Hello.
I'm trying to download a video which is played online with a flash-based player. The content being displayed seems to be cached in fragments with apparently more than just video data.
I'm looking for information on what is the unnecessary data so that I can remove it and join the fragments with FFMpeg into a standard video file.

I can download the individual fragments of the video using my browser cache, but I can't play them as they are -- the fragments have some sort of strange data before the x264 header, VLC player doesn't recognize them.
I tried "cleaning" the file by passing it through FFMpeg, but it couldn't read the file and had this error:

[mov,mp4,m4a,3gp,3g2,mj2 @ 028fa6a0] could not find corresponding trex
[mov,mp4,m4a,3gp,3g2,mj2 @ 028fa6a0] error reading header: -1094995529
PIRATEFAIRY_BNS_Pixels__Pirates__Pixies_PROHQ_1080 P23_185_ENGENG_DMA_P91_4Seg1-Frag1: Invalid data found when processing input.

The beginning of the first fragment of the video is this:

5afra À è sÏ z m< jabst è ô asrt %afrt è Ü s moof mfhd Ütraf tfhd ¾~ $trun h ) © S $trun ¤ * Q } $trun ‚ * 1 ) $trun @ ) ± } $trun ~ * ) $trun * Á ¦ $trun Z ) q S $trun X * q $trun "V * ‘ S $trun 't * 1 S $trun -2 ) q S $trun 30 * á S $trun :ž * Ñ S $trun CÌ ) ñ S $trun O: * ± S $trun Y8 * Ñ S $trun e6 * A S $trun rÄ ) A S $trun �¢ *
q S $trun Ž* * S $trun ¡® )
± S $trun ±ü * ‘ S $trun Á * Á } $trun Ñ? * ± ) $trun Ú
) Q ¦ $trun íË * S $trun øY * Á $trun · ) Q ¦ $trun u * a S $trun 3 * ! $trun ñ ) } $trun 1_ * ñ ) $trun 9í * ¡ } $trun I+ * ¡ ) $trun Q ) á Ð $trun b— * � S $trun m• * Ñ $trun vÓ ) Ñ ) $trun ~ñ * Ñ ¦ $trun – * � S $trun ¡� * $trun ªË ) Á ¦ $trun ·Y * � S $trun ½' * $trun Äå ) ¡ ¦ $trun Ïš * ± S $trun Ö * ñ $trun Ýv * ñ ¦ $trun è” ) Q S $trun î¢ * ± $trun õÐ *
Ð $trun ^ ) A S $trun ü * ! $trun Š * ! ) $trun ) ‘ Ð $trun "V * Á S $trun )” * $trun 02 * a ) $trun 7 ) 1 ¦ $trun @¾ * ! S $trun Hl * ‘ $trun NZ ) ‘ ¦ $trun Zx * ‘ S $trun `f * a $trun eÔ *
Ñ Ð $trun rò ) ñ S $trun x * q $trun {• * ñ ) $trun ó ) Ñ Ð $trun ˆ1 * ! S $trun Œ¯ * q $trun �] * a ) $trun “ë ) ! Ð $trun ›I * ± S $trun Ÿ· * A $trun £ ) ! ) $trun ¦c * Ñ Ð $trun * * � S $trun °¯ ) 1 $trun ´* * ) $trun ·» * ! Ð $trun ¾Y * � S $trun Âg ) 1 $trun ÅÕ * ) $trun ɳ * Ð $trun Ïñ ) Á S $trun Ô� * 1 $trun Ø
* ) $trun Û; * Ð $trun áÉ ) Á S $trun ä¾ * A $trun è< * ! ) $trun ì ) A ¦ $trun ñ˜ * a S $trun ö& * ! $trun ùÕ * !1 S $trun c ) á Ð $trun "‘ * q S $trun &_ * ! $trun *} ) ñ ) $trun -« * 1 Ð $trun 3É * Q S $trun 7G ) $trun :¥ * á ) $trun =ã * Á Ð $trun Cñ * q S $trun Ho ) ñ $trun KÍ * ) $trun O; *
á Ð $trun \i ) Ñ S $trun `— * $trun d% * ‘ ) $trun fú * � Ð $trun tø ) q S $trun } * á $trun ƒT * A ) $trun ˆ ) Q Ð $trun –Ð * q S $trun ¡® * $trun ©L * ) $trun *ª ) q } $trun À¨ * ! ) $trun Ê6 * 1 ¦ $trun ÜÔ )
á S $trun ê" * � $trun ó * Ñ S $trun N )
� S $trun < * ñ S $trun º *
¡ S $trun ,Ø * q S $trun :¶ ) a S $trun E” *
Ñ S $trun RÒ * ‘ S $trun ]Ð ) ± S $trun cÅ * q ¦ $trun gà * S $trun kq * Q $trun oO ) ‘ Ð $trun r] * � S $trun u{ * ‘ $trun xy ) 1 ) $trun { * 1 ¦ $trun }µ * 1 S $trun €ƒ * 1 $trun ƒ! ) a S $trun žß * Q Ð $trun ¡Ý * � S $trun ¤Û ) Q $trun §ù * 1 ) $trun ª— * A Ð $trun *E ) � S $trun °S * 1 $trun ³A * 1 ) $trun µï * A Ð $trun ¹� ) q S $trun ½; * 1 $trun ¾À * 1 ) $trun ÁŽ ) A } $trun Ä| * q ) $trun Çz * A S $trun æx * � ¦ $trun öæ ) Ñ S $trun 4 * Ñ $trun B * a S $trun ð )
� S $trun #Î *
1 } $trun 3L * a ) $trun ;ú * � S $trun PØ ) � ¦ $trun nÆ * ‘ S $trun y´ * á $trun † )
Á S $trun –p * Ñ S $trun ©ž *
S $trun ¹ ) Ñ S $trun ÇZ * S $trun Ý * A S $trun ÷¶ * ‘ ¦ $trun ´ ) a S $trun $¹ *
Á $trun 1÷ * q S $trun DÕ ) ‘ } $trun ]Ó * ± ) $trun sÑ * � } $trun ‘ß * Ñ ) $trun ¡ ) ñ } $trun ¸{ * q ) $trun Çy * ± } $trun âÇ ) ± ) $trun öå * ñ S 4ttraf tfhd ¾~ $trun < $trun h ! $trun
! $trun F ! $trun Ë ! $trun ! $trun ! $trun B ! $trun — ! $trun Ð ! $trun å ! $trun ! $trun ã ! $trun ! $trun á ! $trun ! ! $trun $ÿ ! $trun &8 ! $trun *½ ! $trun +ö ! $trun 0» ! $trun 1ô ! $trun 8) ! $trun 9b ! $trun @‡ Q $trun Að Á $trun KÕ ¡ $trun MŽ ‘ $trun V � $trun Wœ � $trun b! ‘ $trun cÊ Q $trun p� $trun q¸ ñ $trun  a $trun €– ñ $trun Œ+ $trun �T 1 $trun ž¹ 1 $trun * ‘ $trun ¯w A $trun °Ð $trun ¾¥ $trun ¿Î 1 $trun Ïó 1 $trun × q $trun Ø‘ a $trun ëv $trun ìŸ $trun õä ! $trun ÷ ! $trun ÿ2 ! $trun k 1 $trun ! $trun Y $trun î ! $trun ' ñ $trun l $trun • A $trun / ! $trun 0S ñ $trun 7h ! $trun 8¡ 1 $trun F¦ 1 $trun Gï ! $trun Nä á $trun OÝ $trun ` A $trun a[ ! $trun k0 á $trun l) Q $trun t~ $trun u§ $trun |¼ ! $trun }õ á $trun “Ú $trun ”ó q $trun Ÿ ! $trun *Q ! $trun ¨¦ $trun ©Ï á $trun ´¤ $trun µ½ � $trun ºò $trun ¼ ñ $trun ÂP A $trun é ! $trun Ξ á $trun Óc a $trun ÔÜ $trun Û $trun Ü: ! $trun æ Ñ $trun çh $trun ëý A $trun íV 1 $trun ók á $trun ôd Q $trun ÿù ! $trun 2 $trun · $trun à $trun
5 Ñ $trun Q $trun à 1 $trun á $trun ± a $trun !* $trun '/ ñ $trun (8 A $trun -½ ! $trun .ö ! $trun 4« $trun 5Ä 1 $trun >Y $trun ?r 1 $trun E÷ $trun G 1 $trun L $trun M> $trun X $trun Y A $trun ^! $trun _J $trun cß ñ $trun dè Ñ $trun p½ $trun qæ ñ $trun uû ñ $trun w á $trun z‰ ñ $trun }ž $trun ~Ç $trun …Ü $trun ‡ $trun Šj $trun ‹“ $trun Ž8 $trun �Q ñ $trun ‘Ö ñ $trun ’ß ñ $trun ™$ ñ $trun š- $trun � $trun ž+ q $trun ¡ ñ $trun ¢ á $trun ¤N ñ $trun ¥W ñ $trun ªL ‘ $trun «õ ñ $trun ®š ñ $trun ¯£ ñ $trun ±ø ñ $trun ³ ‘ $trun µÆ $trun ¶ß Á $trun »ô ñ $trun ¼ý A $trun ¿ò � $trun Á‹ Á $trun ð $trun ÄÉ ñ $trun Æî ¡ $trun ȧ ñ $trun ÍÜ ñ $trun Îå ñ $trun ÑÊ $trun Òã ‘ $trun ÕØ $trun Öñ $trun Ù& ñ $trun Ú/ ñ $trun ßd ! $trun à� $trun 㢠$trun æ ñ $trun ç $trun éu q $trun êþ $trun ïs $trun ðŒ ñ $trun ó Q $trun ôz ‘ $trun ÷_ ñ $trun øh $trun $trun 7 $trun \ $trun !u $trun $ $trun %3 $trun '˜ ± $trun )a $trun +† ñ $trun ,� $trun 0ô $trun 2 ‘ $trun 52 á $trun 6+ $trun 8` $trun 9‰ $trun ;ž ! $trun <× ñ $trun A¼ $trun BÕ $trun Ez $trun F£ ± $trun Ix $trun J¡ $trun Lö $trun N $trun Z4 ! $trun [m á $trun ^R $trun _{ $trun aÀ $trun bé ! $trun eÎ $trun r“ ! $trun sÌ $trun z� q $trun |
ñ $trun � $trun ‚( $trun …* $trun †Æ 1 $trun ”{ $trun •¤ $trun ŸY $trun *‚ $trun ¦Ç A $trun ¨ $trun «e $trun ¬Ž $trun ¾3 $trun ¿\ 1 $trun Çá $trun É
$trun Ú $trun Û¨ $trun çÍ ! $trun é $trun ð» $trun ñä $trun ù $trun " $trun ç $trun $trun E $trun n 1 $trun *s ! $trun +¬ $trun 8a $trun 9Š $trun C/ ! $trun Dh $trun P} $trun Q¦ $trun [{ $trun \¤ $trun b™ $trun eN $trun fw 1 $trun hì A $trun jE $trun lÚ $trun n 1 $trun oø ! $trun q1 $trun rö A $trun tO $trun v$ $trun wM $trun x $trun yë $trun {` $trun |‰ $trun }þ $trun ' A $trun €Ì $trun �õ $trun œš $trun �³ $trun ŸH a $trun *Á $trun ¢v ! $trun £¯ $trun ¥D a $trun ¦½ ! $trun ¨B $trun ©k $trun ªð $trun ¬ $trun *Þ ! $trun ¯ ! $trun °œ ! $trun ±Õ Q $trun ³Š $trun ´³ ! $trun ¶H � $trun ·á ¡ $trun º& ¡ $trun »ß A $trun ½„ ! $trun ¿ 1 $trun ÀR ! $trun Áç 1 $trun Ã0 1 $trun Å ! $trun Æ> ! $trun äÓ ! $trun æ Q $trun õ ! $trun õJ � $trun þÏ ! $trun $trun ñ $trun & $trun » $trun Ô $trun !‰ $trun "² $trun 1 $trun 20 $trun 9Å $trun :Þ $trun N“ $trun O¬ $trun lq $trun mš $trun wo $trun xˆ $trun ƒ* ! $trun „æ $trun “ë $trun • A $trun §Y $trun ¨r $trun ¶Ç $trun ·ð $trun Å $trun Æ. $trun Ús ! $trun Û¬ A $trun õa $trun öŠ $trun _ $trun ˆ $trun #- q $trun /’ $trun 0» ! $trun B€ $trun C© $trun [~ $trun \§ $trun qœ $trun rµ $trun �j 1 $trun �³ $trun žÈ $trun Ÿñ $trun ¶& $trun ·O $trun Å ! $trun Æ= ! $trun àB 1 $trun á‹ ! $trun ô� $trun õ¹ $trun
î ! $trun ' #¸traf tfhd ¾~ #”trun 8 > Ä S 9 l } 9 9 L ) 9 9 Ì } 9 9 ) 9 9 Ü ¦ 9 9 Œ S 9 9 Œ 9
9 ¬ S 9
9 L S 9 9 ΠS 9
9 ü S 9
9 ì S i Ù S ¹ © Ì S ™ ™ ì S © i \ S ) \ S y
Œ S ) I S I ©
Ì S Y ) ¬ S ) I Ü } I Ì ) ‰ y l ¦ ) ) S 9 9 Ü 9 I l ¦ 9 | S 9 < ) Y , } 9 ) 9 I
¼ } I 9
¼ ) ù
) ü Ð Y 9
œ S ù i
ì ) ) ì ) 9 ù ì ¦ ‰ œ S 9 9 ) ù Ü ¦ ™ œ S ) , Y 9 ¼ ¦ ù Ì S y ) ) 9 ¦ é ) l S Y I Ì ù i
, Ð 9 ) \ S ) < é
i < ) I ù ¬ Ð y ) Ü S
Y , 9 9 | ) I
L ¦ I < S ) I ¬ ) ¬ ¦ Y ¬ S ) | é
ì Ð ) S ù Œ ) ) ) ì Ð ) ) < S ) Œ | ) < Ð Ì S ‰ \ ù < ) ì Ð ©
œ S L © ) Ù
< Ð Y œ S ™ Ù L ) ¹ , Ð Ü S © L ) , Ð 9 ) Ü S \ < ) ‰ \ ¦ | S i © < > !L S ) ü Ð
ΠS
) < É )
L Ð )
© l S ù ) ü ) 9 Ü Ð Œ S ) É ) ) , ) )
ü Ð 9 ù ì S ) , ) 9 ¬ ) ) œ Ð 9 ) Œ S ‰ ü ) \ ) I l Ð ) ) Œ S ) ) Y ) ) )
Π} ) I
< ) ) )
L ¦ )
)
ü S 9
œ ) )
ì S ) )
œ S ) ) S ) I
¼ S 9 ) Œ S ) ) | S 9 )
ì S ) ) ¬ S ) ) Ì S ) Œ ¦ ) I , S Y ) l ) I ¬ Ð 9 ) œ S Y ) ¬ ) ) L ) ) ) L ¦ )
) L S ) Y L ) )
| S
) l Ð y œ S 9 )
l y 9 L ) ) ) \ Ð ) ) œ S 9 9 L 9 i L ) ) 9 \ Ð ™ ¹ Œ S ¹ Y L 9 L ) I 9 \ } I I Œ ) 9 9 \ S 9 i œ ¦ 9 ™ ì S 9 ) ì | S
œ S )
L }
| ) œ S
) œ ¦ ) )
¬ S ) ü 9 )
Ü S ) Y ì S )
, S ) ) ì S ) ) S 9 Y \ S ) ) ¬ ¦ ) ) | S ‰
Ü ) 9 Œ S ) ) ¬ } ) ) Ì ) œ } I ) ì ) ) ) } )
) Π) 9
9 Ì } I 9 Ì ) )
) S 9
) mdat
L / M@ÿá gM@«Áï?€ˆ è »TxÁŒL hèŽ<€ : ¯ � ) µ SSE ÿÿÿÜEé½æÙH·–,Ø Ù#îïx264 - core 130 r2 c832fe9 - H.264/MPEG-4 AVC codec - Copyleft 2003-2013 - http://www.videolan.org/x264.html - options: cabac=1 ref=8 deblock=1:1:1 analyse=0x1:0x131 me=umh subme=9 psy=1 psy_rd=1.00:0.15 mixed_ref=1 me_range=16 chroma_me=1 trellis=2 8x8dct=0 cqm=0 deadzone=21,11 fast_pskip=1 chroma_qp_offset=-3 threads=48 lookahead_threads=3 sliced_threads=0 nr=0 decimate=1 interlaced=0 bluray_compat=0 constrained_intra=0 bframes=3 b_pyramid=2 b_adapt=2 b_bias=0 direct=3 weightb=1 open_gop=0 weightp=2 keyint=96 keyint_min=9 scenecut=40 intra_refresh=0 rc_lookahead=60 rc=2pass mbtree=0 bitrate=336 ratetol=1.0 qcomp=0.60 qpmin=5 qpmax=35 qpstep=4 cplxblur=20.0 qblur=0.5 vbv_maxrate=800 vbv_bufsize=336 nal_hrd=none ip_ratio=1.40 pb_ratio=1.30 aq=1:1.00 € hèŽ<€ ‡eˆ‚ >—þÀw�KD�ãã›%+NL�€÷@ &¢V¬6@ L V·ð¢Ñ §î ýÌf ˆ|à¦<:µZÐÀcª�
xñÀô$ Œd 7€Œ€˜�Ÿ0<È ~‰ /΀ù€
|Àj`¿0g˜ ¿: _á À ¯ � (
¯SE !@}+”d*šé\£%¿~–––––––––––––––––––––––––––––––––––– –––––––––––––––––––––––––––––––––––––––––––––––––– –––––––––––––––––––––––––––––––––––––––––––––––––– –––––––––––––––––––––––––––––––––––––––––––––––––– –––––––––––––––––––––––––––––––––––––––––––––––––– —€ ¯ � ( * ¯SE €Öò†ùfOûò”YúpžàžûljۼjõìV�
¾Ê´Ï:ñ®
dÛbøEá~G~á
˜°f2Q<[kqn1F–û0±o¼1tÄ#>—‘ýºóÊBJ–ÈóÈ›Gñœô¤?äÛWì+×Ü�m·²¬ÈõÎ ïÇ®4¿…·8öÉqW< ˆ•imÒ=2á¦Ça¬A„½5_¿?´ë
X®‘¸rù�’„Š{ô‚ÉNÎ� ƒšS"Œ šÐ
ä—"7En¬GQp“9W³³³©ˆÞµì+
;þ÷O0UÍÙkµÙ\EÞô(‰µß÷·ÄYÇ]_zŠÒ‹Þá†dm!›÷ªv§†pÄITµ!‹�®³šR
Rm5¢úï† 5) ] ) ' }SE €3Æè8ÜìÏ“ozåÈí³oø~‹wŸQ mô±Tç±½®µÀ59}ë«}"ÀûÑt�¶
ð]S™ŠÕHÄé1Ä{샢JðŠÀ{+4ÔŒ×ÚY«�³ h( * * ¯SE €7J:êTø�{›]ô�Á
¼†¬üÌýY.ºgë¼�^$q•q´,ăHžÁäo�EE,´?TAE®Ü^kämk)&Ôƒ¹í ¨íæ`Ùq 0wz˜“뵎ïÐ¥I½-'}<Ó{©xW©„ñˉµ©CY¥y/=§x_Ãø-õÙÛ‰FY¼P|¯Õ¸–3{’¼ÀþÚ¶TÈØ{*#í¥Rå¬U˜«ŸáÛö©<¥ à9*„¦¥.&µúï™uš¸£bX`W(±ëÅÆžc_‰NæÚz"
"qT|è6ìŠ*û—Jç˜1GV´ˆ·Ì§hU¦ix5s É>—è�û3ök…ýÉÇK¯2Ùûæ´Á"†á©öŽ =¹&Ô±õ`óŠ„<:ÊÈ 5( * @ ¯SE €zï˜êJ¼×Ê 2ŠÇÅË‚+tú”¾xi=pKw¢_d(±ücEüÏs*�‰Ó$f_†î‡„äÄ°ÔŒ²²J&è \¬¸•E¹$Ç$‹š+ÚéÆ`<¡7´‹ÏpÓûµ§k[™ïôÿ ¯)Qðp@£ò´2ôîVû-îÕÒôA—èX*žZ(MÃ�Qg�ìj¼Â‹{§’á¨æƒÌ§ÜD‡º8à¼Ð–±‚ pÕNUP+³)ùƒè8"Ï<!5»¦ï¼^Ç5)Η€O”Yÿ7¶s¤=½®HÖ×�yí«|qø� ¸V¢õ”�=
...
[THE DATA CONTINUES]

Attached is the first, second and last (the 71st) fragments. The names are original but I changed the extension from nothing to "txt."

• PIRATEFAIRY_BNS_Pixels__Pirates__Pixies_PROHQ_1080P23_185_ENGENG_DMA_POST_400k4891_4Seg1-Frag1.txt
• PIRATEFAIRY_BNS_Pixels__Pirates__Pixies_PROHQ_1080P23_185_ENGENG_DMA_POST_400k4891_4Seg1-Frag2.txt
• PIRATEFAIRY_BNS_Pixels__Pirates__Pixies_PROHQ_1080P23_185_ENGENG_DMA_POST_400k4891_4Seg1-Frag71.txt

[Kryzon]

Hello. Can anyone please help?
Do you need more information on the problem?

[ponens]

Those fragments are in adobe hds format, but they also have adobe access drm, so you probably won't be able to do much with them. Check if the provider also sends by any other transport methods for other platforms.

[Kryzon]

How interesting, thank you for the reply.

I understand now why the fragments are named that way.
I'll try to download them with Firefox and the "HDS link detector" script.

[ponens]

How interesting, thank you for the reply.

I understand now why the fragments are named that way.
I'll try to download them with Firefox and the "HDS link detector" script.

Like I said, they have adobe access drm, aka "flash access" - which is encryption. So, that won't work.

[Kryzon]

It was worth a shot anyway, but of course you're right. I found the .f4m "manifest" file and set up the script:

KSV Adobe HDS Downloader

Processing manifest info....
Quality Selection:
Available: 1396 1199 997 625 596
Selected : 1396
Fragments Total: 71, First: 1, Start: 1, Parallel: 8
This stream is encrypted with FlashAccess DRM. Decryption of such streams isn't
currently possible with this script.

I'll have to think of some other way to capture that video.

[aazerty]

Hi Kryzon ,
What is the main link of the video ?
Cheers .

[Kryzon]

Hello aazerty,
the video is from DisneyMoviesAnywhere, but it's from the free video section.
http://www.disneymoviesanywhere.com/discover#bonusModal-209860675760

Alternatively, you can find it at http://www.disneymoviesanywhere.com/discover and click on the video with name "Pixels, Pirates and Pixie Dust."

To play it, you need a Disney account. It's free to create an account there, but when you create an account or log in with one, your IP address needs to be from the United States (I have been using a US proxy from xroxy.com in my browser settings to access it).
Once you are logged in through the US proxy, you can turn the proxy off and navigate with your original IP, and watch the video, inspect the source code etc.

[aazerty]

Hi Kryzon ,
Too much job to do .
Cheers .

[Kryzon]

I understand.
Since I already have an account there etc., if you want more information (cache logs, page source code etc.) then I can post here.

Regards.