Remove/lessen color blocking in dark areas

[tester44]

I have an animation im cleaning up, and I have it looking good, but there are a few scenes with dark areas where there are some colored compression artifacts.
I can remove the blocking easy enough, but I havent been able to remove the color.

I adjusted the colors so its easier to see where I am talking about since its pretty subtle.
Along the bench there is some green/yellow mixed in, its wrecking havoc once I clean everything up, gives the backboard a green hue.

[Attachment 71989 - Click to enlarge]

I have attached an example clip as well, im not sure if its possible to remove that, or lessen it?

Edit: I should note, im using vapoursynth

[jagabo]

I use AviSynth but you can probably translate this to vapoursynth. Try something like vsTTempSmooth(maxr=5, ythresh=5, uthresh=5, vthresh=5, strength=3). You can apply that only to dark areas (to limit possible damage to bright areas) with an alpha mask based on the luma:

Mpeg2Source("turtle (1).d2v", CPU2="xxxxxx", Info=3) 
TFM(d2v="turtle (1).d2v") # IVTC
TDecimate() # back to 23.976 fps

ConvertBits(10)
bmask = ColorYUV(off_y=-32).ColorYUV(gain_y=10000).Invert().Blur(1.0).GreyScale()
vsTTempSmooth(maxr=5, ythresh=5, uthresh=5, vthresh=5, strength=3)
Overlay(src, last, mask=bmask)
ConvertBits(8, dither=0)

But you'll have to encode with enough bitrate to keep the problem from coming back.

[Selur]

vsTTempSmooth does not really do the job for me.
(checked by applying Retinex after the filtering)
A masked CCD or DPIR, SCUNet, BasicVSR++, RealESRGAN and a bunch of other approaches work fine here: https://imgsli.com/MTg4MTIy

Cu Selur

[themaster1]

vsTTempSmooth does not really do the job for me.
(checked by applying Retinex after the filtering)
A masked CCD or DPIR, SCUNet, BasicVSR++, RealESRGAN and a bunch of other approaches work fine here: https://imgsli.com/MTg4MTIy

Cu Selur

That's too dark

[Selur]

Original = What I see when I load the file you posted.
Retinex = What I see when I load the file you posted and apply Retinex. (to see the artifacts)
XXXX = What I see when I load the file you posted and apply XXXX and then Retinex. (to see what XXXXX did)
https://imgsli.com/MTg4MTIz/1/7
-> no clue what you want to say with "That's too dark", since you didn't ask for color grading suggestions, but on how to remove these artifacts.

Cu Selur