Looking for a program that scan Video file to remove Dupes

[Lobo89]

Hi,

I'm looking for a program that scan video file to find dupes ... really compare frame, sorta like if there is more then 50% of the frame are the same then its a dupe ! . All files are .wtv and i dont mind converting them if needed. The problem is that there is No Metadata with those .wtv file because there isnt any to be recorded. Sometime the 'good portion' of the video will start at the beginning of the video and sometime it will be 2-3mins after the beginning of the video. I have over 1400 videos +- 1TB and i know that there is 30% of dupe in there at least.

Does anyone know of such a software or know a way to do this ?

[deadrats]

http://www.scootersoftware.com/

[Lobo89]

Thanks for the Quick reply... i tried it and it doesnt work it says compare done and doesnt find anything. Im testing with a sample folder which has 3 time the same video in it.

Anyone has other ideas ?

[ANK]

https://forum.videohelp.com/threads/333167-New-software-for-finding-duplicate-video-files-by-content

http://duplicatevideosearch.com/

[Lobo89]

http://duplicatevideosearch.com/ doesnt work with .wtv file it just ignores them but works pretty good on Mkv / mp4.

Anyone else got any other tools ?

[manono]

Anyone else got any other tools ?

AviSynth's Multidecimate or DeDup:

http://neuron2.net/multidecimate/multidecimate.html

http://avisynth.org/warpenterprises/

[Lobo89]

Both MultiDecimate and Dedup are used (if im not mistaken from what i read) to remove frame in a specific video. I dont see how i could use them to compare multiple video files with each other to see if they are dupes are not.

Any more ideas ? or should i start the massive conversion task from .wtv to .mkv and use http://duplicatevideosearch.com/ after.

[manono]

What you asked for was:

I'm looking for a program that scan video file to find dupes ... really compare frame, sorta like if there is more then 50% of the frame are the same then its a dupe

And that's what MultiDecimate can do - you can set a threshold below which a frame is considered a dupe of the one before. Compare multiple video files, I guess not, but I don't see anything mentioning that before your most recent post. Or perhaps I misunderstood what you wanted, or maybe you weren't very clear about what you wanted.

But I have no idea what WTV is, or if any AviSynth source filter can open one.