Remove duplicates from pal conversion to get back to 23.976

[embis2003]

VEVO videos are converted to 25fps. The film masters that UMG provides to VEVO are 23.976fps, that's important, because it is not 24fps. I often see conversion scripts saying to use tdecimate(cycler=1, cycle=25). But that decimates down to 24fps, not 23.976fps, so there is a duplicate every 1000 frames or so. So I thought perhaps this would work:

tdecimate(cycler=1, cycle=25
tdecimate(cycler=1, cycle=1000)

Which does work (I think), but it's so incredibly slow, I'm talking 2 fps or so.

So I thought what if I used mode 2 with metrics for extra accuracy. It works too, but it drops frames that it is not supposed to, and adds frames later to compensate.

I'm out of ideas.

Is there any more efficient way of doing this?

[davexnet]

I just downloaded a vevo video at random and it's 23.976
https://www.youtube.com/watch?v=fLFvbwrWLQY

[embis2003]

I just downloaded a vevo video at random and it's 23.976
https://www.youtube.com/watch?v=fLFvbwrWLQY

Yeah, for some reason, the masters that VEVO receive are uploaded untouched to YouTube, but on their site (which was "shut down", but there's a trick to access the videos using embeds) the older videos are converted to 25fps from film rate. The newer videos (2018 and newer) actually are the original rate, even on VEVO, so I'm glad they got out of their ways.

If you wondering why I prefer to rip from the site instead of YouTube, its because the versions from VEVOs site, while being PAL converted for some unknown reason, are of a dramatically higher bitrate, somewhere in the ballpark of 6mb/s, as opposed to YouTube's <1mb/s.

[davexnet]

Can you provide the 25 frame video as well as a link to the corresponding Youtube/Vevo version

[embis2003]

Can you provide the 25 frame video as well as a link to the corresponding Youtube/Vevo version

Sure.

YouTube: https://www.youtube.com/watch?v=gOMhN-hfMtY
VEVO: https://embed.vevo.com/?video=USIV20400362

You can get the M3U8 from the embed link, but I'll just link directly to it: https://hls-fas.vevo.com/v3/hls/2015/10/USIV20400362/2cde2679-3e13-4a3d-8a26-e75865f02...0_aac_128.m3u8

[jagabo]

TDecimate(mode=2, rate=23.976)

or

TDecimate(Cycle=25, CycleR=1) # 24 fps

[embis2003]

TDecimate(mode=2, rate=23.976)

or

TDecimate(Cycle=25, CycleR=1) # 24 fps

Is one more accurate than the other?

[davexnet]

TDecimate(mode=2, rate=23.976)

or

TDecimate(Cycle=25, CycleR=1) # 24 fps

Is one more accurate than the other?

mode 2 allows an arbitrary rate, while the other decimates CycleR out Cycle frames.
They both give different results in this case.

I noticed the Vevo 25fps version does look much better that the Youtube version,
with much more loss of detail that I would have thought likely.
Poor Youtube encoding or something else?

[jagabo]

TDecimate(mode=2, rate=23.976)

or

TDecimate(Cycle=25, CycleR=1) # 24 fps

Is one more accurate than the other?

Yes. One delivers 23.976 fps, the other 24 fps. Which is more accurate depends on your source.

[embis2003]

TDecimate(mode=2, rate=23.976)

or

TDecimate(Cycle=25, CycleR=1) # 24 fps

Is one more accurate than the other?

mode 2 allows an arbitrary rate, while the other decimates CycleR out Cycle frames.
They both give different results in this case.

I noticed the Vevo 25fps version does look much better that the Youtube version,
with much more loss of detail that I would have thought likely.
Poor Youtube encoding or something else?

UMG's "remasters", where they oversmoothen the video and add copious amounts of DNR, oversharpen it to compensate, then upscale. They care more about perceptual quality than mathematical, but I prefer to strike a good balance. Who'd have thought an 18 year old from Texas could do it better than a multibillion dollar company, eh?

https://imgur.com/a/HJNIS3b

[embis2003]

TDecimate(mode=2, rate=23.976)

or

TDecimate(Cycle=25, CycleR=1) # 24 fps

Is one more accurate than the other?

Yes. One delivers 23.976 fps, the other 24 fps. Which is more accurate depends on your source.

Hmm, so since my source was 23.976, the mode 2 method would probably be more accurate?

[poisondeathray]

You have to go through it - rarely do you have completely clean (cadence wise) videos from that era, because there were derived from mixed sources and almost always have various bad edits for broadcast, framerate conversions

Both approaches have issues, because of that source - If you look at the undecimated version - there are frame drops, jumps in motion even before decimation, blended frame conversions in various sections. Also some combed interlaced scaling artifacts (similar to other videos from that era)

It depends on how much time you want to put into it - You can interpolate/insert missing frames in their proper missing spots, interpolate over some bad frames. If you haven't tried it, DAIN/RIFE can fix many of the common mvtools2 interpolation problems in many situations. RIFE is available in vapoursynth, and there are some GUI's for it. I'm in the middle of writing some helper interpolations functions for it. Often you can get a "solve" by other models or prior transforms such as rotating

[rrats]

Can you provide the 25 frame video as well as a link to the corresponding Youtube/Vevo version

Sure.

YouTube: https://www.youtube.com/watch?v=gOMhN-hfMtY
VEVO: https://embed.vevo.com/?video=USIV20400362

You can get the M3U8 from the embed link, but I'll just link directly to it: https://hls-fas.vevo.com/v3/hls/2015/10/USIV20400362/2cde2679-3e13-4a3d-8a26-e75865f02...0_aac_128.m3u8

how do you find these?

[embis2003]

Can you provide the 25 frame video as well as a link to the corresponding Youtube/Vevo version

Sure.

YouTube: https://www.youtube.com/watch?v=gOMhN-hfMtY
VEVO: https://embed.vevo.com/?video=USIV20400362

You can get the M3U8 from the embed link, but I'll just link directly to it: https://hls-fas.vevo.com/v3/hls/2015/10/USIV20400362/2cde2679-3e13-4a3d-8a26-e75865f02...0_aac_128.m3u8

how do you find these?

its pretty easy...

first you need this: https://jdownloader.org/download/index

first, search google with "(artist) (song) site:vevo.com". If you see your song, copy the link. And extract the ISRC code from the URL. If you don't see it, then you have to try alt method: Go to https://isrc.soundexchange.com/#!/search and enter artist in the artist field and the song name in the track title field. Don't worry about release name. Then press search. You should get a long list of releases with their corresponding ISRC code. You will just have to try each one. They are often called "Edited" or "Close Captioned" but you just have try every ISRC for the song. Once you get your ISRC, put it into the following link: embed.vevo.com/?video= <--- enter ISRC there. Once you get the video to pop up, on chrome, right click, click Inspect. Then click on the network tab. Then play the video and wait for at least 10 seconds. You should see a little search box near the top of the network tab, just type ".m3u" in the box, You should see a few results come up below. Right click the one that has 5200 and 1080 in the name, then click copy link address. Now open jdownloader and go to the linkgraber tab. right click the white space and click paste. It might ask you download ffmpeg or whatever, so do so. You should have 100mb+ file in the linkgrabber. now, right click it, and click start download. it should begin downloading.

If you can't find the ISRC code in those ways, message me, there's another method, but its private and I don't want it public on this forum.

[rrats]

Can you provide the 25 frame video as well as a link to the corresponding Youtube/Vevo version

Sure.

YouTube: https://www.youtube.com/watch?v=gOMhN-hfMtY
VEVO: https://embed.vevo.com/?video=USIV20400362

You can get the M3U8 from the embed link, but I'll just link directly to it: https://hls-fas.vevo.com/v3/hls/2015/10/USIV20400362/2cde2679-3e13-4a3d-8a26-e75865f02...0_aac_128.m3u8

how do you find these?

its pretty easy...

first you need this: https://jdownloader.org/download/index

first, search google with "(artist) (song) site:vevo.com". If you see your song, copy the link. And extract the ISRC code from the URL. If you don't see it, then you have to try alt method: Go to https://isrc.soundexchange.com/#!/search and enter artist in the artist field and the song name in the track title field. Don't worry about release name. Then press search. You should get a long list of releases with their corresponding ISRC code. You will just have to try each one. They are often called "Edited" or "Close Captioned" but you just have try every ISRC for the song. Once you get your ISRC, put it into the following link: embed.vevo.com/?video= <--- enter ISRC there. Once you get the video to pop up, on chrome, right click, click Inspect. Then click on the network tab. Then play the video and wait for at least 10 seconds. You should see a little search box near the top of the network tab, just type ".m3u" in the box, You should see a few results come up below. Right click the one that has 5200 and 1080 in the name, then click copy link address. Now open jdownloader and go to the linkgraber tab. right click the white space and click paste. It might ask you download ffmpeg or whatever, so do so. You should have 100mb+ file in the linkgrabber. now, right click it, and click start download. it should begin downloading.

If you can't find the ISRC code in those ways, message me, there's another method, but its private and I don't want it public on this forum.

thank you. i found a crappy solution for the first part with it being browsing wayback machine archives