How to improve chances of SRestore blend detection?

[jagabo]

TDecimate() removes one of every five frames by default because it's basic design is for NTSC telecined film. Of course, there are other options with it, but you don't want to use it for this type of conversion because it is more likely to leave blended frames in the video.

If your source was originally 25p then you probably want to SRestore() to 25p. But if your source was originally 25i (likely with live TV shows: sports, news...) you probably won't ever get a smooth, fully deblended result.

[Adamcarter]

The show is called five mile creek. I have an NTSC dvd, but the show was filmed in australia in the 80s. I am a mac user, and have no way of figuring out if it was 25p or 50i. It doesn’t have any special effects, like start trek where they had film and added special effects in video. So i am hoping its 25p. I am running qtgmc bob placebo srestore omode=3 fps =50, womdering if i should use some of the advanced omodes like pp3

If It was recorded At 25p, will i just have double frames? Or will that mean srestore won’t remove enough blended frames. (if not i will re-encode at 25fps, just to see what it looks like anyway)
And if its 50i, leaving it at 50fps should be ok, right?

I will say that just doing qtgmc placebo bob looks good, but i def think getting rid of blended frames would make it look even better.

[jagabo]

According to IMDB Five Mile Creek was shot on film (24p) so the PAL video release was probably just sped up to 25p. If you're not getting decent results with QTGMC().SRestore() upload a sample of the MPEG2 video. Use a program like DgIndex or Mpg2cut2 to trim out a short segment from the body of the TV show, not the intro which is often different from the body (sped up, slowed down, titles as 25i over 25p, etc). Include a 2+ second medium speed panning shot (easiest to detect the source frame rate) along with some other moderate motion. You might want to start your own thread for this.

Note that SRestore() generally takes a while to sync after a seek. So don't expect to seek to some random spot in the video and get nice clean results. Single step through the video for several seconds to verify you're getting good results after a second or two (worth of frames). Stepping through the video backwards will not give clean results.

[jagabo]

Adamcater, Here's a short segment of your source cleanly restored to 25 fps with QTGMC().SRestore().

[Adamcarter]

It looks great!!!!

[Attachment 54327 - Click to enlarge]

Wht settings on srestore should i do?
Thanks

[jagabo]

I used the default SRestore settings (the AviSynth version):

frate = not set (defaults to 25 fps in this case)
omode = 6
speed = 9
mode = 2
thresh = 22

Default QTGMC() settings too (preset="slower").

I don't know if these transfer directly the Vapoursynth versions.

[Adamcarter]

Ok thanks.

You said the opening video with titles still had some combing. (they looked great with deinterlacing alone in qtgmc bob at 59.94). Womdering if i should make a mixed video cut the intro out and deinterlace it then run the rest of the video thru srestore and remove blends. Will see how ‘bad’ they are, would decreasing the threshold improve that comb removal of the Titles I womder?

What will i need to do to the audio for sync? I use audacity.

[jagabo]

The opening titles didn't have any combing after QTGMC() but there was some residual blending after SRestore(). It's very common for opening titles to be sped up or slowed down so that the video matches the theme music, or whatever. The original PAL video probably had blending in the title sequence from that so you can't expect QTGMC().SRestore() to produce perfectly non-blended frames. I would just use QTGMC().SRestore() for the whole video -- I hate VFR!

[Adamcarter]

Me too good call. Blending isnt too too bad, it’s combing i cant stand.

And audio you think it will sync? Or do i need to audacity it.
Thanks.

[manono]

If the video length doesn't change, the audio remains in synch. When using QTGMC().SRestore() the length doesn't change.

[Adamcarter]

Nice, ok,
Thank you both to manono and jagabo.

Stay tuned next week when i ask about what setting to use to bring PAL cartoon dvds back to original NTSC dvds.
Am i still using srestore omode 6?

[Adamcarter]

I’ve been ripping this dvd series. And i have to say, it looks 100x better with the removed blended frames. Thank you jagabo. Seriously. You have my deepest thanks.

[Adamcarter]

Sorry to bug you guys again.
I am trying to use qtgmc on this file but it seems to crash. The tag says progressive, but it is 29.97 looks to me bottom field first. Its a small 120 meg 22 min tv show
[Attachment 54577 - Click to enlarge]

[jagabo]

That video has already been deinterlaced.

[Adamcarter]

First time i have ever had a deinterlaced movie at 29.97.
Thanks for the help.

[jagabo]

It's very common. People of often deinterlace a film source rather than inverse telecine. The result is a 29.97 fps video with a duplicate frame every 5th frame instead of a 23.976 fps. The duplicate frames makes the video jerky, especially obvious in panning shots.

[Adamcarter]

Is there a way to remove those frames to remove the jerkiness?

[manono]

Is there a way to remove those frames to remove the jerkiness?

TDecimate()###Part of TIVTC

That'll remove the dupe frames but nothing can undo the damage caused by the deinterlacer.

Did you really enclose a picture of your link, thus making the link itself unclickable?

[Adamcarter]

Sorry i uploaded the file from a headless computer i access with my ipad. I would have just copy and pasted the link, but i dont have the website password to this forum on that computer was being lazy. Next time, i will include the regular link lol.

[Adamcarter]

Ok
I have another conundrum i would love to show you guys.

The file has combing all over the place. It’s in 29.97 fps. It was filmed in australia, so i’m was thinking 25 fps. I did Qtgmc bob + srestore omode 6, like my previous tv show i mentioned here. And it got rid of maybe 99% combing, but every few seconds or so, there is like a like a stutter. So then i tried deteelcine from 29.97 to 23.976, i’m able to get rid of most of the combing as well, but there are a few areas like in long john silvers face With auick movements that remained.

I think i am missing something. Footage is pretty bad, believe it comes from a poorly encoded dvd of an unremastered Film. My plan was to get it in the best progressive possible and then run it thru topaz video enhancer ai bring it up to 4k or 8k, maybe do further color correcting in resolve, maybe add back in some film grain, and then downscale it via spline to 720p or 1080p.

https://archive.org/download/ReturnToTreasureIsland-QualityWidescreen/ReturnToTreasureIsland.mkv

[jagabo]

That video is basically telecined film. But interlaced frames were encoded progressive so the chroma of the two fields was blended together. The basic fix is TFM().TDecimate() to get back to the original film frames at 23.976 fps.

After that you'll see the blended chroma as horizontal color stripes when colored objects are moving. There might be a way of using the chroma of the previous or next field/frame when the stripes are detected but the easiest thing to do is blur away the choroma stripes, MergeChroma(last, last.Blur(0.0, 1.0).Sharpen(0.0, 0.7). But some ghosting of the colors will remain.

Beyond that there are occasional dropped and duplicate frames. There's not much you can do for that except manually insert of remove frames. Not worth the trouble in my opinion.

LWLibavVideoSource("ReturnToTreasureIsland.mkv") 
AssumeTFF()
TFM()
TDecimate()
MergeChroma(last, Blur(0.0, 1.0).Sharpen(0.7))

Maybe the DVDs are in better shape.

[Adamcarter]

I was going to look at getting the actual dvd. Hoping that perhaps it was just All telecined. Problem is the video is public domain now. So like 4 or 5 different dvd companies have released their own dvd. Nome of which specify if they have the Cinescope version, which would be ideal.

May do some digging.

Now i need to figure out from your script how to do that using vapoursynth using hybrid app. Will show your suggestion to die hard vapoursynth peeps they should be able to steer me in the right direction.

[oberonz]

SRestore isn't the appropriate plugin for He-Man and the Masters of the Universe. I once did all episodes of She-Ra season 1. You can use RePal() as that is the method that the ... at BCI Eclipse used to convert from 25fps to 29.97. RePal will still produce artifacts. The best was is to do it manually. Here is a script for the episode "The Christmas Special" BCI version:

oper1=source.selectevery(12,2,4,7,9,11).assumefps(25)
chk1a=source.selectevery(12,1,2,6,7)
chk1b=source.selectevery(12,6,7,11,12)
chk1c=source.selectevery(12,4,5,11,12)

oper2=source.selectevery(12,3,5,8,10,12).assumefps(25)
chk2a=source.selectevery(12,2,3,7,8)
chk2b=source.selectevery(12,1,7,8,12)
chk2c=source.selectevery(12,1,5,7,12)

oper3=source.selectevery(12,1,4,6,9,11).assumefps(25)
chk3a=source.selectevery(12,3,4,8,9)
chk3b=source.selectevery(12,1,2,8,9)
#oper3=trim(oper3a,1,40000)

oper4=source.selectevery(12,2,5,7,10,12).assumefps(25)
chk4a=source.selectevery(12,4,5,9,10)
chk4b=source.selectevery(12,2,3,9,10)

oper5=source.selectevery(12,1,3,6,8,11).assumefps(25)
chk5a=source.selectevery(12,5,6,10,11)
chk5b=source.selectevery(12,3,4,10,11)
#oper5=trim(oper5a,1,40000)

#return trim(source,2428,3110)
#return oper1#.assumefps(24.97).changefps(25)
#return chk1a
#return chk1b
#return chk1c
#return oper2
#return chk2a
#return chk2b
#return chk2c
#return oper3
#return chk3a
#return chk3b
#return oper4
#return chk4a
#return chk4b
#return oper5
#return chk5a
#return chk5b

p01=trim(oper5,0,163)
p02=trim(oper2,163,363)
p03=trim(oper4,364,563)
p04=trim(oper1,564,763)
p05=trim(oper3,764,963)
p06=trim(oper5,964,1163)
p07=trim(oper2,1163,1363)
p08=trim(oper4,1364,1563)
p09=trim(oper1,1564,1763)
p10=trim(oper3,1764,1963)
p11=trim(oper5,1964,2163)
p12=trim(oper2,2163,2363)
p13=trim(oper4,2364,2563)
p14=trim(oper1,2564,2763)
p15=trim(oper3,2764,2963)
p16=trim(oper5,2964,3163)
p17=trim(oper2,3163,3363)
p18=trim(oper4,3364,3563)
p19=trim(oper1,3564,3763)
p20=trim(oper3,3764,3963)
p21=trim(oper5,3964,4163)
p22=trim(oper2,4163,4363)
p23=trim(oper4,4364,4563)
p24=trim(oper1,4564,4763)
p25=trim(oper3,4764,4963)
p26=trim(oper5,4964,5163)
p27=trim(oper2,5163,5363)
p28=trim(oper4,5364,5563)
p29=trim(oper1,5564,5763)
p30=trim(oper3,5764,5963)
p31=trim(oper5,5964,6163)
p32=trim(oper2,6163,6363)
p33=trim(oper4,6364,6563)
p34=trim(oper1,6564,6763)
p35=trim(oper3,6764,6963)
p36=trim(oper5,6964,7163)
p37=trim(oper2,7163,7363)
p38=trim(oper4,7364,7563)
p39=trim(oper1,7564,7763)
p40=trim(oper3,7764,7963)
p41=trim(oper5,7964,8163)
p42=trim(oper2,8163,8363)
p43=trim(oper4,8364,8563)
p44=trim(oper1,8564,8763)
p45=trim(oper3,8764,8963)
p46=trim(oper5,8964,9163)
p47=trim(oper2,9163,9363)
p48=trim(oper4,9364,9563)
p49=trim(oper1,9564,9763)
p50=trim(oper3,9764,9963)
p51=trim(oper5,9964,10163)
p52=trim(oper2,10164,10363)
p53=trim(oper4,10364,10563)
p54=trim(oper1,10564,10763)
p55=trim(oper3,10764,10963)
p56=trim(oper5,10964,11163)
p57=trim(oper2,11163,11363)
p58=trim(oper4,11364,11563)
p59=trim(oper1,11564,11763)
p60=trim(oper3,11764,11963)
p61=trim(oper5,11964,12163)
p62=trim(oper2,12163,12363)
p63=trim(oper4,12364,12563)
p64=trim(oper1,12564,12763)
p65=trim(oper3,12764,12963)
p66=trim(oper5,12964,13163)
p67=trim(oper2,13163,13363)
p68=trim(oper4,13364,13563)
p69=trim(oper1,13564,13763)
p70=trim(oper3,13764,13963)
p71=trim(oper5,13964,14163)
p72=trim(oper2,14163,14363)
p73=trim(oper4,14364,14563)
p74=trim(oper1,14564,14763)
p75=trim(oper3,14764,14963)
p76=trim(oper5,14964,15163)
p77=trim(oper2,15163,15363)
p78=trim(oper4,15364,15563)
p79=trim(oper1,15564,15763)
p80=trim(oper3,15764,15963)
p81=trim(oper5,15964,16163)
p82=trim(oper2,16163,16363)
p83=trim(oper4,16364,16563)
p84=trim(oper1,16564,16763)
p85=trim(oper3,16764,16963)
p86=trim(oper5,16964,17163)
p87=trim(oper2,17163,17363)
p88=trim(oper4,17364,17563)
p89=trim(oper1,17564,17763)
p90=trim(oper3,17764,17963)
p91=trim(oper5,17964,18163)
p92=trim(oper2,18163,18363)
p93=trim(oper4,18364,18563)
p94=trim(oper1,18564,18763)
p95=trim(oper3,18764,18963)
p96=trim(oper5,18964,19163)
p97=trim(oper2,19163,19363)
p98=trim(oper4,19364,19563)
p99=trim(oper1,19564,19763)
p100=trim(oper3,19764,19963)
p101=trim(oper5,19964,20163)
p102=trim(oper2,20164,20363)
p103=trim(oper4,20364,20563)
p104=trim(oper1,20564,20763)
p105=trim(oper3,20764,20963)
p106=trim(oper5,20964,21163)
p107=trim(oper2,21163,21363)
p108=trim(oper4,21364,21563)
p109=trim(oper1,21564,21763)
p110=trim(oper3,21764,21963)
p111=trim(oper5,21964,22163)
p112=trim(oper2,22163,22363)
p113=trim(oper4,22364,22563)
p114=trim(oper1,22564,22763)
p115=trim(oper3,22764,22963)
p116=trim(oper5,22964,23163)
p117=trim(oper2,23163,23363)
p118=trim(oper4,23364,23563)
p119=trim(oper1,23564,23763)
p120=trim(oper3,23764,23963)
p121=trim(oper5,23964,24163)
p122=trim(oper2,24163,24363)
p123=trim(oper4,24364,24563)
p124=trim(oper1,24564,24763)
p125=trim(oper3,24764,24963)
p126=trim(oper5,24964,25163)
p127=trim(oper2,25163,25363)
p128=trim(oper4,25364,25563)
p129=trim(oper1,25564,25763)
p130=trim(oper3,25764,25963)
p131=trim(oper5,25964,26163)
p132=trim(oper2,26163,26363)
p133=trim(oper4,26364,26563)
p134=trim(oper1,26564,26763)
p135=trim(oper3,26764,26963)
p136=trim(oper5,26964,27163)
p137=trim(oper2,27163,27363)
p138=trim(oper4,27364,27563)
p139=trim(oper1,27564,27763)
p140=trim(oper3,27764,27963)
p141=trim(oper5,27964,28163)
p142=trim(oper2,28163,28363)
p143=trim(oper4,28364,28563)
p144=trim(oper1,28564,28763)
p145=trim(oper3,28764,28963)
p146=trim(oper5,28964,29163)
p147=trim(oper2,29163,29363)
p148=trim(oper4,29364,29563)
p149=trim(oper1,29564,29763)
p150=trim(oper3,29764,29963)
p151=trim(oper5,29964,30163)
p152=trim(oper2,30164,30363)
p153=trim(oper4,30364,30563)
p154=trim(oper1,30564,30763)
p155=trim(oper3,30764,30963)
p156=trim(oper5,30964,31163)
p157=trim(oper2,31163,31363)
p158=trim(oper4,31364,31563)
p159=trim(oper1,31564,31763)
p160=trim(oper3,31764,31963)
p161=trim(oper5,31964,32163)
p162=trim(oper2,32163,32363)
p163=trim(oper4,32364,32563)
p164=trim(oper1,32564,32763)
p165=trim(oper3,32763,32963)
p166=trim(oper5,32963,33183)
p167=trim(oper2,33183,33383)
p168=trim(oper4,33384,33583)
p169=trim(oper1,33584,33783)
p170=trim(oper3,33784,33983)
p171=trim(oper5,33984,34183)
p172=trim(oper2,34183,34383)
p173=trim(oper4,34384,34583)
p174=trim(oper1,34584,34783)
p175=trim(oper3,34784,34983)
p176=trim(oper5,34984,35183)
p177=trim(oper2,35183,35383)
p178=trim(oper4,35384,35583)
p179=trim(oper1,35584,35783)
p180=trim(oper3,35784,35983)
p181=trim(oper5,35984,36183)
p182=trim(oper2,36183,36383)
p183=trim(oper4,36384,36583)
p184=trim(oper1,36584,36783)
p185=trim(oper3,36784,36983)
p186=trim(oper5,36984,37183)
p187=trim(oper2,37183,37383)
p188=trim(oper4,37384,37583)
p189=trim(oper1,37584,37783)
p190=trim(oper3,37784,37983)
p191=trim(oper5,37984,38183)
p192=trim(oper2,38183,38383)
p193=trim(oper4,38384,38583)
p194=trim(oper1,38584,38783)
p195=trim(oper3,38784,38983)
p196=trim(oper5,38984,39183)
p197=trim(oper2,39183,39383)
p198=trim(oper4,39384,39583)
p199=trim(oper1,39584,39783)
p200=trim(oper3,39784,39983)
p201=trim(oper5,39984,40183)
p202=trim(oper2,40184,40383)
p203=trim(oper4,40384,40583)
p204=trim(oper1,40584,40783)
p205=trim(oper3,40784,40983)
p206=trim(oper5,40984,41183)
p207=trim(oper2,41183,41383)
p208=trim(oper4,41384,41583)
p209=trim(oper1,41584,41783)
p210=trim(oper3,41784,41983)
p211=trim(oper5,41984,42183)
p212=trim(oper2,42183,42383)
p213=trim(oper4,42384,42583)
p214=trim(oper1,42584,42783)
p215=trim(oper3,42784,42983)
p216=trim(oper5,42984,43183)
p217=trim(oper2,43183,43383)
p218=trim(oper4,43384,43583)
p219=trim(oper1,43584,43783)
p220=trim(oper3,43784,43983)
p221=trim(oper5,43984,44183)
p222=trim(oper2,44183,44383)
p223=trim(oper4,44384,44583)
p224=trim(oper1,44584,44783)
p225=trim(oper3,44784,44983)
p226=trim(oper5,44984,45183)
p227=trim(oper2,45183,45383)
p228=trim(oper4,45384,45583)
p229=trim(oper1,45584,45783)
p230=trim(oper3,45784,45983)
p231=trim(oper5,45984,46183)
p232=trim(oper2,46183,46383)
p233=trim(oper4,46384,46583)
p234=trim(oper1,46584,46783)
p235=trim(oper3,46784,46983)
p236=trim(oper5,46984,47183)
p237=trim(oper2,47183,47383)
p238=trim(oper4,47384,47583)
p239=trim(oper1,47584,47783)
p240=trim(oper3,47784,47983)
p241=trim(oper5,47984,48183)
p242=trim(oper2,48183,48383)
p243=trim(oper4,48384,48583)
p244=trim(oper1,48584,48783)
p245=trim(oper3,48784,48983)
p246=trim(oper5,48984,49183)
p247=trim(oper2,49183,49383)
p248=trim(oper4,49384,49583)
p249=trim(oper1,49584,49783)
p250=trim(oper3,49784,49983)
p251=trim(oper5,49984,50183)
p252=trim(oper2,50184,50383)
p253=trim(oper4,50384,50583)
p254=trim(oper1,50584,50783)
p255=trim(oper3,50784,50983)
p256=trim(oper5,50984,51183)
p257=trim(oper2,51183,51383)
p258=trim(oper4,51384,51583)
p259=trim(oper1,51584,51783)
p260=trim(oper3,51784,51983)
p261=trim(oper5,51984,52183)
p262=trim(oper2,52183,52383)
p263=trim(oper4,52384,52583)
p264=trim(oper1,52584,52783)
p265=trim(oper3,52784,52983)
p266=trim(oper5,52984,53183)
p267=trim(oper2,53183,53383)
p268=trim(oper4,53384,53583)
p269=trim(oper1,53584,53783)
p270=trim(oper3,53784,53983)
p271=trim(oper5,53984,54183)
p272=trim(oper2,54183,54383)
p273=trim(oper4,54384,54583)
p274=trim(oper1,54584,54783)
p275=trim(oper3,54784,54983)
p276=trim(oper5,54984,55183)
p277=trim(oper2,55183,55383)
p278=trim(oper4,55384,55583)
p279=trim(oper1,55584,55783)
p280=trim(oper3,55784,55983)
p281=trim(oper5,55984,56183)
p282=trim(oper2,56183,56383)
p283=trim(oper4,56384,56583)
p284=trim(oper1,56584,56783)
p285=trim(oper3,56784,56983)
p286=trim(oper5,56984,57183)
p287=trim(oper2,57183,57383)
p288=trim(oper4,57384,57583)
p289=trim(oper1,57584,57783)
p290=trim(oper3,57784,57983)
p291=trim(oper5,57984,58183)
p292=trim(oper2,58183,58383)
p293=trim(oper4,58384,58583)
p294=trim(oper1,58584,58783)
p295=trim(oper3,58784,58983)
p296=trim(oper5,58984,59183)
p297=trim(oper2,59183,59383)
p298=trim(oper4,59384,59583)
p299=trim(oper1,59584,59783)
p300=trim(oper3,59784,59983)
p301=trim(oper5,59984,60183)
p302=trim(oper2,60183,60383)
p303=trim(oper4,60385,60583)
p304=trim(oper1,60584,60783)
p305=trim(oper3,60784,60983)
p306=trim(oper5,60984,61183)
p307=trim(oper2,61183,61383)
p308=trim(oper4,61384,61583)
p309=trim(oper1,61584,61783)
p310=trim(oper3,61784,61983)
p311=trim(oper5,61984,62183)
p312=trim(oper2,62183,62383)
p313=trim(oper4,62384,62583)
p314=trim(oper1,62584,62783)
p315=trim(oper3,62784,62983)
p316=trim(oper5,62984,63183)
p317=trim(oper2,63183,63383)
p318=trim(oper4,63384,63583)
p319=trim(oper1,63584,63783)
p320=trim(oper3,63784,63983)
p321=trim(oper5,63984,64183)
p322=trim(oper2,64183,64383)
p323=trim(oper4,64384,64583)
p324=trim(oper1,64584,64783)
p325=trim(oper3,64784,64983)
p326=trim(oper5,64984,65183)
p327=trim(oper2,65183,65383)
p328=trim(oper4,65384,65583)
p329=trim(oper1,65584,65783)
p330=trim(oper3,65784,65983)
p331=trim(oper5,65984,66183)
p332=trim(oper2,66183,66383)
p333=trim(oper4,66384,66583)
p334=trim(oper1,66584,66783)
p335=trim(oper3,66784,66983)
p336=trim(oper5,66984,67183)
p337=trim(oper2,67183,67383)
p338=trim(oper4,67384,67583)

It looks like a lot of work but I generate these with Excel and the result is PERFECT. These only work for He-Man and She-Ra. Nothing else. It takes 15 minutes to generate the code for one episode. Read the documentation for RePal and examine the above script to figure out how it works. It's pretty simple actually. You need to Bob first, of course.

You need to reverse the terrible conversion process from BCI Eclipse. The pattern changes every 200 frames hence why each pXXX trims exactly 200 frames. The list can be generated automatically in Excel. First create five movies, oper1, oper2 .... oper5. These cover all possible locations of the starting frame according to encoding as explained in the RePal documentation. The chkX files are used to determine which of the 5 movies has the correct pattern. You need to test ALL chk movies. The one that has a pair of duplicates that last for 200 frames is the correct one. Use that to set the p002. Once you have figured that one out, the others can be set automatically. If there are issues test p003 and p004. You shouldn't need to test any others. Remember to add one frame every 1000 because it's 29.97 not 30fps.