ffmpeg mp4 to bitmap to Prores

[_Al_]

Additionally, while doing a simple matrix conversion of a single pixel is trivial, doing that for an entire image at 24+ fps is super hard.

This is what Vapoursynth, Avisynth, openCV does and it handles it live. For example even using Python and opencv, which is not fast like C, it handles pretty well.