Automatic video editing

[Mat_LCFC]

Hi,

Bit of a longshot but thought I'd try anyway!

Is there any software that can edit a video clip automatically based on colour recognition.
eg. you select a bright yellow from a scene. I want software to then analyse the whole video file & cut all frames that don't have that colour.

Difficult to explain & probably not possible but worth asking.

If not possible. Is there any software that has any smart editing features to detect camera angles or common features (eg background) & edit scenes automatically?

Cheers
M

[Cornucopia]

There are scripts that can cut based on color, brightness, motion, probably even shape, but no software is currently smart enough to read your mind. And I say that because unless you have very simplistic, artificial images to start with, there is much more going on, much more random color & brightness variations in everyday, real-world images that the software would likely give you such an edited mess that it would take much more work to correct it than to just edit from scratch.

Scott

[TreeTops]

Don't the movie studios have something to colorize black and white movies automatically? I know that's not exactly what the op asked but it's a start. Although I suspect it would be very expensive to do and probably time consuming also even for software that could do it automatically.

[Mat_LCFC]

There are scripts that can cut based on color, brightness, motion, probably even shape, but no software is currently smart enough to read your mind. And I say that because unless you have very simplistic, artificial images to start with, there is much more going on, much more random color & brightness variations in everyday, real-world images that the software would likely give you such an edited mess that it would take much more work to correct it than to just edit from scratch.

Scott

I do hear where you are coming from... I understand this is experimental & results may be quite poor.
Even so, I like to give it a try. Are there any scripts in particular you know of?

I tend to use TMPGEnc MPEG Smart Renderer to edit .ts files.
Which does have a scene detection & is actually pretty good. It's not automated though.

I found this site which looked promising. Although I know nothing about Adobe After Effects.

http://aescripts.com/automated-video-editing/#/discussion/embed

Any pointers would be much appreciated.

Cheers
M

[raffriff42]

Cut up your footage at random, to the beat of the music
is really neat, but to a programmer, it's a completely different problem from

select a bright yellow from a scene, analyze the whole video file & cut all frames that don't have that color
or
detect camera angles or common features.

Those two concepts would be much more difficult to implement. Obligatory XKCD...

[Cornucopia]

Don't the movie studios have something to colorize black and white movies automatically? I know that's not exactly what the op asked but it's a start. Although I suspect it would be very expensive to do and probably time consuming also even for software that could do it automatically.

No, they have tools that optimize & speed up the MANUAL job of colorization, just like they have tools to improve the manual 2D-to-3D workflow, etc.
Try to imagine someone attempting to auto-trace a complex, real-world picture into a vector graphic with many multiple layers of smoothed, elementary objects (with background cutouts/occlusions somehow restored). Might be possible in 25+ years, but not today.

............................................

Scripts that would be necessary to attempt this are not ever going to be "cookie-cutter", you're going to have to build them yourself.

Scott

[jagabo]

You could use an AviSynth script to do what you want. But you'll have to learn how to use AviSynth. And the script will be moderately complex. And you'll manually have to get the RGB values of the color in question and modify the script to deal with it. Here are a few threads that uses AviSynth and GScript to do something like you want (not by color but by other properties of the video):

https://forum.videohelp.com/threads/358891-Automate-Frame-Grabbing-based-on-screen-events
https://forum.videohelp.com/threads/344888-Automatically-Delete-Select-Frames?highlight...t+deleteframes

But once you have the basic script working you'll just have to modify it for the particular color -- and probably some tolerance values.