On a trip to the South Pacific in 2002 I had a DV-camcorder that had a problem with really high humidity and because of this a lot of my videos from the trip have missing pixels (see screenshoots). Any chance theres is any software that would be able to repair this? Perhaps with help of AI?
[Attachment 56933 - Click to enlarge]
[Attachment 56934 - Click to enlarge]
The video is filmed in PAL 576i.
Would be really great to finally be able to repair these. Thanks for any suggestion and help!
+ Reply to Thread
Results 1 to 15 of 15
It is possible that the tape is still mostly OK, but has stretched because of the heat/humidity on your trip. I have seen this sort of thing clear up when you do these two things:
1. Use a DV cleaning tape. Sony makes them, so I'm pretty sure they are safe. Just make sure not to exceed the recommended cleaning time (about 10 seconds, I think).
2. Fast forward the tape to the end and then rewind.
After doing these two things, try capturing the problem sections again.
As for repairing the pixels, the problem is not the repair (which can be done), but the identification. These bad pixels will come and go, and won't appear in the same place. Therefore, you can't just create a mask and apply a repair, as I did here:
Last edited by johnmeyer; 23rd Jan 2021 at 21:08.
One thing that might also help: these kinds of errors are often random and exist in different spots from one frame to the next, so it should be possible to use temporal denoisers that borrow from succeeding/preceding frames in those same spots to fill in the errors (and little else). Use of pixel differencing thresholds can narrow the region of interest.
For single frame problems, you can replace the entire frame with a motion interpolated frame, as I did in this fix:
I've seen both. And, why replace an entire frame?
Thanks all for your suggestions!
@DB83 I've attached a short clip here to show what it looks like, and if someone wants to try out something.
@johnmeyer I've tried similar actions numerous times with forward/rewind and cleaning and I've not been able to get better results unfortunately.
@johnmeyer & @Cornucopia You're right about the lost pixels come and go and in various places of the frame. See the attached.
I was kind of hoping some kind of smart AI software could look a few frames back and forward and based on that calculate/guess what should be in the missing pixels. But I do understand it's quite a challenging task and perhaps there's no software doing this.
Last edited by TravelRock; 24th Jan 2021 at 09:24.
Last edited by johnmeyer; 1st Feb 2021 at 11:14.
@Cornucopia - How would I go about trying out the suggestion of "temporal denoisers that borrow from succeeding/preceding frames" and "Use of pixel differencing thresholds can narrow the region of interest"? And do you still think it would be able to fix the problem if looking at the vid clip I attached above?
I'm on Mac and got FFMPEG running as well as Adobe software. But perhaps some other software would be needed?
What I was thinking was more AVISynth, aka script-based. ffmpeg doesn't have that level of manipulation (neither does Adobe stuff). Not sure how much option you've got on a Mac.
Noise is noise, and there are a whole palette of tools to work with denoising, depending on the character of the the noise. That particular noise has some definite characteristics: Certain horizontal macroblocks appear to be delayed in time compared to other macroblocks, within those macroblocks there are other blocks that are further delayed, there is very little of the image that is WITHOUT signal (it is there, just at the wrong place/time), and it is (obviously) blocky. These characteristics should guide you toward your choice of method.
johnmeyer may have a simpler solution, as doing WHOLE frame replacement is much easier than doing segments of frames. It all depends on whether you end up getting a smoother, more natural (restored?) version as a result, and depends on how much effort you are willing to put into getting there.
Also, if the issue is persistent enough, you may not have enough surrounding "clean" frames with which to borrow from, making it almost mandatory to do more region/segment-based manipulation.
Thread moved to the mac forum where you can get more help.I think,therefore i am a hamster.
@johnmeyer How would I go about trying out your suggestion of "replace the entire frame with a motion interpolated frame"? What software or what kind of actions/process would I need to use?
Here is a script I developed several years ago that does exactly what I described: it automatically detects a single bad frame and then automatically replaces it with a frame synthesized from the adjacent frames. For some clips, it can work perfectly.
The discussion of the script begins here:
Finding individual "bad" frames in video; save frame number; or repair
and here is a link directly to the script:
If you have multiple frames in a row which are bad, this script will not work automatically.