Hybrid(Windows/Linux/Mac): Input -> x264/x265/Xvid/VP8/VP9

[Selur]

Any details? Debug output does not show any errors. It only shows you loading a source and running auto crop detection.
Not sure what to look for, or what the problem is.

[locotus]

Not much more to show, targeting file size 1950 MB, variable bitrate goes to 966. Then, changing bitrate to 2350-240 file size goes to almost 3GB.

[Selur]

Remember that the target size includes the expected audio size, container overhead, etc. it's not just the video size.
The bit rate of the audio is 1605kBit/s and the audio size is ~1.19 GiB. (audio is passed through according to the debug output)
=> Unless I overlook something, this seems about right.
(Haven't really changed anything major about the bit rate and file size calculation for years, so I would be surprised if there is a bug.)

Cu Selur

[locotus]

Just made a complete uninstall with BC-Installer that cleans-up all registry entries and re-install Hybrid last version and
it seems to solve the issue. If something goes wrong I'll comeback later. Thanks fpr your time.

[woke123]

how to use descale in hybrid ?

i already copy descale.py from vsfilter to vsscript and write impor descale on manual configuration.

clip = descale.debilinear(clip,1280,720) always get error.

[Selur]

Not sharing what error you get in the Vapoursynth preview and where that descale.py came from I assumine you are referring to descale.py from https://github.com/Irrational-Encoding-Wizardry/descale and you do not want to share details and thus do not need detailed help.

In case you want to descale before deinterlacing, Hybrid supports this already through 'Filtering->Vapoursynth->Misc->Script->Lower res. before deinterlace'.

To use the descale.py from the link above in a custom section, one would normally use:

core.std.LoadPlugin(path="%FILTERPATH%/Support/libdescale.dll") # or path to wherever the dll is you want to use.
import descale
clip = descale.Debilinear(clip,1280,720)
# width 1280
# height 720

haven't tried this, so there might still be a bug in Hybrid, assuming the script works with the dll Hybrid uses.

=> properly share details if that does not solve your problem.
I suspect unless other Crop/Resize is also used, Hybrid will adjust the resolution to the input resolution since it sees that the current resolution and the target output resolution does not match.

Did a blind test:

# Imports
import vapoursynth as vs
# getting Vapoursynth core
import sys
import os
core = vs.core
# Import scripts folder
scriptPath = 'F:/Hybrid/64bit/vsscripts'
sys.path.insert(0, os.path.abspath(scriptPath))
# loading plugins
core.std.LoadPlugin(path="F:/Hybrid/64bit/vsfilters/Support/fmtconv.dll")
core.std.LoadPlugin(path="F:/Hybrid/64bit/vsfilters/SourceFilter/DGDecNV/DGDecodeNV.dll")
# defining beforeDeCross-function - START
def beforeDeCross(clip):
  # width 1280
  # height 720
  core.std.LoadPlugin(path="F:/Hybrid/64bit/vsfilters/Support/libdescale.dll")
  import descale
  clip = descale.Debilinear(clip,1280,676)
  return clip
# defining beforeDeCross-function - END

# Import scripts
import validate
# Source: 'G:\TestClips&Co\files\MPEG-4 H.264\4k\4k_sample_4096x2160.mp4'
# Current color space: YUV420P8, bit depth: 8, resolution: 4096x2160, frame rate: 25fps, scanorder: progressive, yuv luminance scale: limited, matrix: 2020ncl, format: AVC
# Loading G:\TestClips&Co\files\MPEG-4 H.264\4k\4k_sample_4096x2160.mp4 using DGSource
clip = core.dgdecodenv.DGSource("J:/tmp/mp4_b30946f06bbf6d3e0309b51cccf4cf0c_853323747.dgi")# 25 fps, scanorder: progressive
frame = clip.get_frame(0)
# setting color matrix to 2020ncl.
clip = core.std.SetFrameProps(clip, _Matrix=vs.MATRIX_BT2020_NCL)
# setting color transfer (vs.TRANSFER_BT2020_10), if it is not set.
if validate.transferIsInvalid(clip):
  clip = core.std.SetFrameProps(clip=clip, _Transfer=vs.TRANSFER_BT2020_10)
# setting color primaries info (to vs.PRIMARIES_BT2020), if it is not set.
if validate.primariesIsInvalid(clip):
  clip = core.std.SetFrameProps(clip=clip, _Primaries=vs.PRIMARIES_BT2020)
# setting color range to TV (limited) range.
clip = core.std.SetFrameProps(clip=clip, _ColorRange=vs.RANGE_LIMITED)
# making sure frame rate is set to 25fps
clip = core.std.AssumeFPS(clip=clip, fpsnum=25, fpsden=1)
# making sure the detected scan type is set (detected: progressive)
clip = core.std.SetFrameProps(clip=clip, _FieldBased=vs.FIELD_PROGRESSIVE) # progressive
clip = beforeDeCross(clip)
# current meta; color space: YUV420P8, bit depth: 8, resolution: 1280x720, fps: 25, color matrix: 2020ncl, yuv luminance scale: limited, scanorder: progressive
# Resizing using 10 - bicubic spline
clip = core.fmtc.resample(clip=clip, kernel="spline16", w=1280, h=676, interlaced=False, interlacedd=False) # resolution 1280x676 before YUV420P8 after YUV420P16
# letterboxing 1280x676 to 1280x720
clip = core.std.AddBorders(clip=clip, left=0, right=0, top=22, bottom=22)
# adjusting output color from: YUV420P16 to YUV420P10 for NVEncModel
clip = core.resize.Bicubic(clip=clip, format=vs.YUV420P10, range_s="limited", dither_type="error_diffusion")
# set output frame rate to 25fps (progressive)
clip = core.std.AssumeFPS(clip=clip, fpsnum=25, fpsden=1)
# output
clip.set_output()

and I get:

Failed to evaluate the script:
Python exception: Descale: Function does not take argument(s) named border_handling

Traceback (most recent call last):
File "src\\cython\\vapoursynth.pyx", line 3387, in vapoursynth._vpy_evaluate
File "src\\cython\\vapoursynth.pyx", line 3388, in vapoursynth._vpy_evaluate
File "J:\tmp\tempPreviewVapoursynthFile10_57_20_512.vpy", line 44, in 
clip = beforeDeCross(clip)
^^^^^^^^^^^^^^^^^^^
File "J:\tmp\tempPreviewVapoursynthFile10_57_20_512.vpy", line 19, in beforeDeCross
clip = descale.Debilinear(clip,1280,676)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "F:\Hybrid\64bit\vsscripts\descale.py", line 18, in Debilinear
return Descale(src, width, height, kernel='bilinear', border_handling=border_handling, yuv444=yuv444, gray=gray, chromaloc=chromaloc)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "F:\Hybrid\64bit\vsscripts\descale.py", line 51, in Descale
y = to_grays(src).descale.Descale(width, height, kernel, custom_kernel, taps, b, c, border_handling=border_handling)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "src\\cython\\vapoursynth.pyx", line 3091, in vapoursynth.Function.__call__
vapoursynth.Error: Descale: Function does not take argument(s) named border_handling

which is due to the fact that Hybrid comes with the latest released libdescale.dll, but the current descale.py requires a newer build.
So unless you also update the dll using the current descale.py will not work and the old descale.py does not work since it's writting for an old Vapoursynth release.

Created an issue entry over at github, asking for a new release: https://github.com/Irrational-Encoding-Wizardry/descale/issues/13

Cu Selur

[woke123]

Not sharing what error you get in the Vapoursynth preview and where that descale.py came from I assumine you are referring to descale.py from https://github.com/Irrational-Encoding-Wizardry/descale and you do not want to share details and thus do not need detailed help.

In case you want to descale before deinterlacing, Hybrid supports this already through 'Filtering->Vapoursynth->Misc->Script->Lower res. before deinterlace'.

To use the descale.py from the link above in a custom section, one would normally use:

core.std.LoadPlugin(path="%FILTERPATH%/Support/libdescale.dll") # or path to wherever the dll is you want to use.
import descale
clip = descale.Debilinear(clip,1280,720)
# width 1280
# height 720

haven't tried this, so there might still be a bug in Hybrid, assuming the script works with the dll Hybrid uses.

=> properly share details if that does not solve your problem.
I suspect unless other Crop/Resize is also used, Hybrid will adjust the resolution to the input resolution since it sees that the current resolution and the target output resolution does not match.

Did a blind test:

# Imports
import vapoursynth as vs
# getting Vapoursynth core
import sys
import os
core = vs.core
# Import scripts folder
scriptPath = 'F:/Hybrid/64bit/vsscripts'
sys.path.insert(0, os.path.abspath(scriptPath))
# loading plugins
core.std.LoadPlugin(path="F:/Hybrid/64bit/vsfilters/Support/fmtconv.dll")
core.std.LoadPlugin(path="F:/Hybrid/64bit/vsfilters/SourceFilter/DGDecNV/DGDecodeNV.dll")
# defining beforeDeCross-function - START
def beforeDeCross(clip):
  # width 1280
  # height 720
  core.std.LoadPlugin(path="F:/Hybrid/64bit/vsfilters/Support/libdescale.dll")
  import descale
  clip = descale.Debilinear(clip,1280,676)
  return clip
# defining beforeDeCross-function - END

# Import scripts
import validate
# Source: 'G:\TestClips&Co\files\MPEG-4 H.264\4k\4k_sample_4096x2160.mp4'
# Current color space: YUV420P8, bit depth: 8, resolution: 4096x2160, frame rate: 25fps, scanorder: progressive, yuv luminance scale: limited, matrix: 2020ncl, format: AVC
# Loading G:\TestClips&Co\files\MPEG-4 H.264\4k\4k_sample_4096x2160.mp4 using DGSource
clip = core.dgdecodenv.DGSource("J:/tmp/mp4_b30946f06bbf6d3e0309b51cccf4cf0c_853323747.dgi")# 25 fps, scanorder: progressive
frame = clip.get_frame(0)
# setting color matrix to 2020ncl.
clip = core.std.SetFrameProps(clip, _Matrix=vs.MATRIX_BT2020_NCL)
# setting color transfer (vs.TRANSFER_BT2020_10), if it is not set.
if validate.transferIsInvalid(clip):
  clip = core.std.SetFrameProps(clip=clip, _Transfer=vs.TRANSFER_BT2020_10)
# setting color primaries info (to vs.PRIMARIES_BT2020), if it is not set.
if validate.primariesIsInvalid(clip):
  clip = core.std.SetFrameProps(clip=clip, _Primaries=vs.PRIMARIES_BT2020)
# setting color range to TV (limited) range.
clip = core.std.SetFrameProps(clip=clip, _ColorRange=vs.RANGE_LIMITED)
# making sure frame rate is set to 25fps
clip = core.std.AssumeFPS(clip=clip, fpsnum=25, fpsden=1)
# making sure the detected scan type is set (detected: progressive)
clip = core.std.SetFrameProps(clip=clip, _FieldBased=vs.FIELD_PROGRESSIVE) # progressive
clip = beforeDeCross(clip)
# current meta; color space: YUV420P8, bit depth: 8, resolution: 1280x720, fps: 25, color matrix: 2020ncl, yuv luminance scale: limited, scanorder: progressive
# Resizing using 10 - bicubic spline
clip = core.fmtc.resample(clip=clip, kernel="spline16", w=1280, h=676, interlaced=False, interlacedd=False) # resolution 1280x676 before YUV420P8 after YUV420P16
# letterboxing 1280x676 to 1280x720
clip = core.std.AddBorders(clip=clip, left=0, right=0, top=22, bottom=22)
# adjusting output color from: YUV420P16 to YUV420P10 for NVEncModel
clip = core.resize.Bicubic(clip=clip, format=vs.YUV420P10, range_s="limited", dither_type="error_diffusion")
# set output frame rate to 25fps (progressive)
clip = core.std.AssumeFPS(clip=clip, fpsnum=25, fpsden=1)
# output
clip.set_output()

and I get:

Failed to evaluate the script:
Python exception: Descale: Function does not take argument(s) named border_handling

Traceback (most recent call last):
File "src\\cython\\vapoursynth.pyx", line 3387, in vapoursynth._vpy_evaluate
File "src\\cython\\vapoursynth.pyx", line 3388, in vapoursynth._vpy_evaluate
File "J:\tmp\tempPreviewVapoursynthFile10_57_20_512.vpy", line 44, in 
clip = beforeDeCross(clip)
^^^^^^^^^^^^^^^^^^^
File "J:\tmp\tempPreviewVapoursynthFile10_57_20_512.vpy", line 19, in beforeDeCross
clip = descale.Debilinear(clip,1280,676)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "F:\Hybrid\64bit\vsscripts\descale.py", line 18, in Debilinear
return Descale(src, width, height, kernel='bilinear', border_handling=border_handling, yuv444=yuv444, gray=gray, chromaloc=chromaloc)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "F:\Hybrid\64bit\vsscripts\descale.py", line 51, in Descale
y = to_grays(src).descale.Descale(width, height, kernel, custom_kernel, taps, b, c, border_handling=border_handling)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "src\\cython\\vapoursynth.pyx", line 3091, in vapoursynth.Function.__call__
vapoursynth.Error: Descale: Function does not take argument(s) named border_handling

which is due to the fact that Hybrid comes with the latest released libdescale.dll, but the current descale.py requires a newer build.
So unless you also update the dll using the current descale.py will not work and the old descale.py does not work since it's writting for an old Vapoursynth release.

Created an issue entry over at github, asking for a new release: https://github.com/Irrational-Encoding-Wizardry/descale/issues/13

Cu Selur

Thank you very much. Sorry for not posting the error log.

I have same error. I found the descale.py from hybrid /64bit/ vsfilter folder. So i can't use descale.py because old version doesnot work.

[Selur]

So i can't use descale.py because old version doesnot work.

Like Hybrid, you could use it, by using the dll directly. You simply can't use the descale.py wrapper script.

[Platos]

Hi, i tried to use Hybrid, but i got an error (crash). I Have Uploaded a file.

Has someone an idea what is going wrong? I did only apply one filter.

[Selur]

Does the Vapoursynth Preview work or does it show an error?

[Selur]

I suspect it's a bug I introduced when I split SMDegrain into a separate file.
try replacing sharpen.py and smdegrain.py with:
https://raw.githubusercontent.com/Selur/VapoursynthScriptsInHybrid/refs/heads/master/sharpen.py
and
https://raw.githubusercontent.com/Selur/VapoursynthScriptsInHybrid/refs/heads/master/smdegrain.py
that should fix the problem.

Cu Selur

[Platos]

I suspect it's a bug I introduced when I split SMDegrain into a separate file.
try replacing sharpen.py and smdegrain.py with:
https://raw.githubusercontent.com/Selur/VapoursynthScriptsInHybrid/refs/heads/master/sharpen.py
and
https://raw.githubusercontent.com/Selur/VapoursynthScriptsInHybrid/refs/heads/master/smdegrain.py
that should fix the problem.

Cu Selur

Sry, was on work.

I did open these two files with notepad and replaced the text with the one from the two links (first for sharpen.py and second for smdegrain.py) and it works now. No error.

Thanks!

[Selur]

Thanks for reporting, will probably release another release next weekend to fix this and some other small bugs.
(rearranging scripts&co to get rid of nearly abandoned old scripts and thus having more freedom in adding some tweaks)

Cu Selur

[Platos]

Thanks, will use it then!

[Platos]

Hi, is it possible, that some similair bug is existing for avisynth SMDegrain? Because i got an error and avisynth-preview is not possible. debugfile is uploaded.

Btw: Why is vapoursynth-SMDegrain so limited ? Because i have a source which have heavy grain and Temporal Radius =3 is way to weak. Is there meanwhile a newer version of smdegrain for vapoursynth? Because SMDegrain is best DeGrain-filter for me, but limited in vapoursynth. Is there any chance that vapoursynth-version of smdgrain got similair option like on avi?

[Selur]

Nobody, adjusted SMDegrain for Vapoursynth to support more than radius=3, let me know when you do.

Looking at the DebugOutput I see:

SMDegrain(tr=6,contrasharp=true,interlaced=false,subpixel=3)

strange thing is that contrasharp should not be a boolean, when using it here I only get:

SMDegrain(tr=6,contrasharp=1,interlaced=false,subpixel=3)

Also I see:

Avisynth preview error: -> setRessource: Script error: LSFmod does not have a named argument "defaults" (F:\Hybrid\64bit\Avisynth\avisynthPlugins\SMDegrain.avsi, line 551) (J:\tmp\tempPreviewAvisynthFile18_16_54_459.avs, line 21)

seems like there's a bug in the SMDegrain.avsi or the LSFMod version that Hybrid is using.
Using the attached LSFmod.avsi fixes the problem for me.

[Selur]

Okay, I found where 'contrashap=true' comes from seems like that is no longer possible
=> adjusted SMDegrain,..
So using the above LSFMod and the attached SMDegrain should fix the problem.

Cu Selur

[Platos]

Ok, thanks. It works now for me on avi without contrastsharp, thanks.

So that means contrastsharp=true is not working anymore on avi SMDgrain and not fixable i guess?

And yes, i will tell you, when i adjusted SMDgrain for Vapoursynth. But with my knowledge it will take 100 years

[Selur]

So that means contrastsharp=true is not working anymore on avi SMDgrain and not fixable i guess?

No, that should be fixed too with the two scripts adjustments.

Cu Selur

Ps.: also uploaded a new dev which comes with the fixed files.
btw. the dev version also has a SMDegrain version which supports tr > 3, but not sure how good it is.

[Platos]

Hmm, it did not work bith both replaced files for me. I also tried Dev-Edition and same error. Preview does not work. Dont know it debug helps, but i uploaded one.

As soon as i stop using contrastsharp=-1 it works.

[Selur]

"SMDegrain(contrasharp=true,interlaced=false)"
That debug output doesn't help at all since it does not show you calling the Avisynth Preview.
=> no clue what error message Avisynth reports, so nothing I can do

[Platos]

Ah ok, sorry. I tried again:

If it is not in the debug i also copy paste error message from the preview:

Avisynth preview error: -> MAnalyse: super clip does not contain needed color data (C:\Program Files\Hybrid\64bit\Avisynth\avisynthPlugins\Zs_RF_Shared.avsi, line 588) (C:\Program Files\Hybrid\64bit\Avisynth\avisynthPlugins\SMDegrain.avsi, line 551) (C:\Users\Gaming-Tower\AppData\Local\Temp\tempPreviewAvisynthFile22_22_30_147.avs, line 19)

[Selur]

Avisynth preview error: -> MAnalyse: super clip does not contain needed color data (C:\Program Files\Hybrid\64bit\Avisynth\avisynthPlugins\Zs_RF_Shared.avsi, line 588) (C:\Program Files\Hybrid\64bit\Avisynth\avisynthPlugins\SMDegrain.avsi, line 551) (C:\Users\Gaming-Tower\AppData\Local\Temp\tempPreviewAvisynthFile22_22_30_147.avs, line 19)

Seems to be thrown by this line:

HD ? eval("""
Super=defined(Super) ? Super : original.MSuper(chroma=false, planar=planar)
cb1=defined(cb1) ? cb1 : Super.MAnalyse(isb = true,  delta = 1, overlap= 4)
cf1=defined(cf1) ? cf1 : Super.MAnalyse(isb = false, delta = 1, overlap= 4)
cb1=original.MCompensate(Super, cb1, planar=planar)
cf1=original.MCompensate(Super, cf1, planar=planar)
pmax = !yuy26 ? original.mt_logic(cb1, "max").mt_logic(cf1, "max") : original.Planar2Interleaved().ConvertToYV16().mt_logic(cb1.Planar2Interleaved().ConvertToYV16(), "max").mt_logic(cf1.Planar2Interleaved().ConvertToYV16(), "max")
pmin = !yuy26 ? original.mt_logic(cb1, "min").mt_logic(cf1, "min") : original.Planar2Interleaved().ConvertToYV16().mt_logic(cb1.Planar2Interleaved().ConvertToYV16(), "min").mt_logic(cf1.Planar2Interleaved().ConvertToYV16(), "min")
          """) : nop()

(yes, that is one line to Avisynth)

Can't reproduce this here with my sources.
Tried it with a source that also reports '# color sampling YV12@10, matrix: bt709, scantyp: progressive, luminance scale: limited' as does yours, but here no error occurs.
=> does the problem only happen with this source?

Cu Selur

[Platos]

Hmm strange. For me it gives the exact same error when using 3 other sources (so the same line 588, 551 and 19 as above).

I also tried it with x264.

I used for example this video (12sec from a movie): https://uploadnow.io/f/JSmP8sj

[Selur]

With your source, I can reproduce the problem too.
No clue why it is happening.

[Platos]

Ok, strange. But thanks for your help. But i think i can live with the Settings in Vapoursynth with Radius 3, Contrastsharp=-1 and Prefilter = KNLmeansCL. This does Reduce already a lot of grain and looks ~ as sharp as original.

So i will use that

[Selur]

As a follow up:
Had a further look at it, and the latest SMDegrain version from Dogway does fix the problem, but since it also changes tons of dependencies, parameters, defaults it would:
a. break any older Avisynth profile that uses SMDegrain
b. require a nearly new rewrite of SMDegrain in Hybrid
If I knew why only some sources cause the problem (no clue, other than it's resolution dependent), I might be able to patch the older SMDegrain Hybrid uses.
=> I leave it as it is.

Cu Selur

[Selur]

Replacing Zs_RF_Sharped.avsi with the attached version should fix the problem and hopefully not break anything else.

Cu Selur

[Platos]

Nice, this works. Thank you very much!

[Platos]

I tried to use a filter queue with SMDegrain, but it does not work (Error in preview). If i disable filter queue it works again. I found out, that the filter queue works, if i disable "KNLmeansCL" prefilter. If i enable (any) prefilter from SMDegrain, i get this error:

Failed to evaluate the script:
Python exception: name 'KNLmeansCL' is not defined

Traceback (most recent call last):
File "src\\cython\\vapoursynth.pyx", line 3387, in vapoursynth._vpy_evaluate
File "src\\cython\\vapoursynth.pyx", line 3388, in vapoursynth._vpy_evaluate
File "C:\Users\Gaming-Tower\AppData\Local\Temp\tempPreviewVapoursynthFile15_50_52_420.vpy", line 41, in 
clip = smdegrain.SMDegrain(input=clip, tr=3, contrasharp=True, interlaced=False, prefilter=KNLmeansCL (spatio-temporal))
^^^^^^^^^^
NameError: name 'KNLmeansCL' is not defined

If a debug is helpfull:

Do you know, if this is fixable?