FFMPEG + ffvhuff no more yuv444ple?

[sparktank]

Windows 7 (x64)

using: ffmpeg-20151205-git-a16243a-win64-static
http://ffmpeg.zeranoe.com/builds/

I tried to convert a DCP/4K video of the open-source project "Tears of Steel" (because I didn't want to download all the lossless pictures).
https://mango.blender.org/download/
https://mango.blender.org/production/watch-the-film-in-4k/
https://media.xiph.org/tearsofsteel/
They don't really say how big the 4K TIF archive is, but I imagine much more than 16GB for the DCP.

But using this (which worked before):

ffmpeg -i "G:\Import\Video_OpenSource\Tears of Steel\Tears of Steel [4K] [DCP]\tos_picture.mxf" -vcodec ffvhuff  -pix_fmt yuv444p16le "tos_picture.avi"

gives me this in the window:

[mxf @ 02008740] "OPAtom" with 2 ECs - assuming OP1a
Input #0, mxf, from 'G:\Import\Video_OpenSource\Tears of Steel\Tears of Steel [4K] [DCP]\tos_picture.mxf':
Metadata:
timecode : 00:00:00:00
Duration: 00:12:14.00, start: 0.000000, bitrate: 146830 kb/s
Stream #0:0: Video: jpeg2000, rgb48le (12 bpc), 4096x1714, 24 tbr, 24 tbn, 24 tbc
Incompatible pixel format 'yuv444p16le' for codec 'ffvhuff', auto-selecting format 'yuv420p'
Output #0, avi, to 'tos_picture.avi':
Metadata:
ISMP : 00:00:00:00
ISFT : Lavf55.0.100
Stream #0:0: Video: ffvhuff (FFVH / 0x48564646), yuv420p, 4096x1714, q=2-31, 200 kb/s, 24 tbn, 24 tbc
Stream mapping:
Stream #0:0 -> #0:0 (libopenjpeg -> ffvhuff)
Press [q] to stop, [?] for help
frame= 1 fps=0.1 q=0.0 Lsize= 4023kB time=00:00:00.04 bitrate=790931.9kbits/s
video:4017kB audio:0kB subtitle:0 global headers:0kB muxing overhead 0.139192%

Incompatible pixel format 'yuv444p16le' for codec 'ffvhuff', auto-selecting format 'yuv420p'

I was going to use ffmpeg to convert from 12bit/XYZ /444 to 16bit/YUV/444 and use Dither_tools in avisynth to resize to 1080p over their internal 1080p encode.
I was also going to play with it in SVP (Smooth Video Project)/InterFrame (svpflow libraries).

This used to work before, but in recent editions, I'm not sure where, something changed so it's not letting me convert to anything but yuv420p.
I tried ffmpeg's git repository, mailing list, bug tracker, source code, and Zeranoe's forums.
But I just see the same thing everywhere.


This thread lists pix_fmt for ffvhuff:
https://forum.videohelp.com/threads/375561-Info-Pixel-Formats-per-Video-Encoder-%28FFMpeg%29
yuv444p16le is listed there.

Using specialized help function to limit help for ffvhuff I see:

ffmpeg -h encoder=ffvhuff

ffmpeg -h encoder=ffvhuff >>Encoder_ffvhuff.txt

Encoder ffvhuff [Huffyuv FFmpeg variant]:
Threading capabilities: no
Supported pixel formats: yuv420p yuv422p rgb24 bgra

The supported pixel formats dropped drastically recently.

Yet none of the code or logs show anything about the pix_fmt change, related to ffvhuff. Most of it is related to other codecs.
https://github.com/FFmpeg/FFmpeg/blob/b9cd3e1add3a3db86aaeba8680ad5a4ee57d519b/libavco...c/huffyuvenc.c
http://git.videolan.org/?p=ffmpeg.git&a=search&h=HEAD&st=commit&s=pixel+format

I could break it down to TIF images and then use imagemagick to batch everything.

also, I don't think it's converting from XYZ (internally updated to rgb48le for more precision) to anything you tell it to anymore.
I read somewhere that ffmpeg now reads it as rgb48le to allow more precision for decoding.

FFMPEG says it's straight up rgb48le.

[mxf @ 021f8620] "OPAtom" with 2 ECs - assuming OP1a
Input #0, mxf, from 'G:\Import\Video_OpenSource\Tears of Steel\Tears of Steel [4K] [DCP]\tos_picture.mxf':
Metadata:
timecode : 00:00:00:00
Duration: 00:12:14.00, start: 0.000000, bitrate: 146830 kb/s
Stream #0:0: Video: jpeg2000, rgb48le (12 bpc), 4096x1714, 24 tbr, 24 tbn, 24 tbc
At least one output file must be specified

ffprobe say it's xyz12le.

[mxf @ 0000000000346280] "OPAtom" with 2 ECs - assuming OP1a
Input #0, mxf, from 'G:\Import\Video_OpenSource\Tears of Steel\Tears of Steel [4K] [DCP]\tos_picture.mxf':
Metadata:
uid : e2c6f645-b8c7-4f79-a45f-ba34e9959592
generation_uid : bcd54e36-5843-486c-b973-d9a1a78e839a
company_name : OpenDCP
product_name : OpenDCP
product_version : 0.27.1
product_uid : 43059a1d-0432-4101-b83f-736815acf31d
modification_date: 2013-05-14 11:49:51
application_platform: unix
material_package_umid: 0x060A2B340101010501010F20130000006B90EF244C8A439D 938F7808426E5520
material_package_name: AS-DCP Material Package
timecode : 00:00:00:00
Duration: 00:12:14.00, start: 0.000000, bitrate: 146830 kb/s
Stream #0:0: Video: jpeg2000 (JPEG 2000 digital cinema 4K), xyz12le, 4096x1714, SAR 1:1 DAR 2048:857, 24 tbr, 24 tbn, 24 tbc
Metadata:
file_package_umid: 0x060A2B340101010501010F201300000064FE189527CA44F3 A3FF2288AA2D0A08
file_package_name: File Package: SMPTE 429-4 frame wrapping of JPEG 2000 codestreams

But MediaInfo ( v0.7.80 ) says it's:

General
Complete name : G:\Import\Video_OpenSource\Tears of Steel\Tears of Steel [4K] [DCP]\tos_picture.mxf
Format : MXF
Format version : 1.2
Format profile : OP-Atom
Format settings : Closed / Complete
File size : 12.5 GiB
Duration : 12mn 14s
Overall bit rate : 147 Mbps
Package name : AS-DCP Material Package / File Package: SMPTE 429-4 frame wrapping of JPEG 2000 codestreams
Encoded date : 2013-05-14 11:49:51.000
Writing application : OpenDCP OpenDCP 0.27.1
Writing library : unix 1.8.44.27240.1

Video
ID : 2
Format : JPEG 2000
Format profile : D-Cinema 4k
Format settings, wrapping m : Frame
Codec ID : 0D010301020C0100-0401020203010104
Duration : 12mn 14s
Bit rate : 147 Mbps
Width : 4 096 pixels
Height : 1 714 pixels
Display aspect ratio : 2.40:1
Frame rate : 24.000 fps
Color space : XYZ
Chroma subsampling : 4:4:4
Bit depth : 12 bits
Scan type : Progressive
Bits/(Pixel*Frame) : 0.871
Stream size : 12.5 GiB (100%)
Title : Picture Track

Converting from MXF/XYZ to ffvhuff or even with ffv1 in any colorspace (yv12, yuy2/yv16, rgb), it comes out green.

I searched about the 5 sites using different keywords to see any changes made and what I should do now with new changes.
It seems docs are all outdated?

I don't think anyone uses ffvhuff much to merit immediate notice.

Any insight on what's going on and what I should change would be great.
I'm going to be back tracking to previous versions where this wasn't an issue for an idea when things changed.

[sparktank]

Update:

ffmpeg-20151101-git-dee7440-win64-static
works like good ol' times. Even xyz2rgb conversion.

Did a 2 second conversion on Tears of Steel and it wasn't Matrix-green.
So, I don't have to back track too far to see what changed.

/*
E:\Temp\tos>"E:\Downloads\Compressed\ffmpeg-20151101-git-dee7440-win64-static\bin\ffmpeg.exe" -ss 00:00:20.000 -i "G:\Import\Video_OpenSource\Tears of Stee
l\Tears of Steel [4K] [DCP]\tos_picture.mxf" -y -t 00:00:02.000 -vcodec ffvhuff -pix_fmt yuv444p16le -pred plane "tos_picture.avi"
ffmpeg version N-76419-gdee7440 Copyright (c) 2000-2015 the FFmpeg developers
built with gcc 5.2.0 (GCC)
configuration: --enable-gpl --enable-version3 --disable-w32threads --enable-avisynth --enable-bzlib --enable-fontconfig --enable-frei0r --enable-gnutls -
-enable-iconv --enable-libass --enable-libbluray --enable-libbs2b --enable-libcaca --enable-libdcadec --enable-libfreetype --enable-libgme --enable-libgsm
--enable-libilbc --enable-libmodplug --enable-libmp3lame --enable-libopencore-amrnb --enable-libopencore-amrwb --enable-libopenjpeg --enable-libopus --enab
le-librtmp --enable-libschroedinger --enable-libsoxr --enable-libspeex --enable-libtheora --enable-libtwolame --enable-libvidstab --enable-libvo-aacenc --e
nable-libvo-amrwbenc --enable-libvorbis --enable-libvpx --enable-libwavpack --enable-libwebp --enable-libx264 --enable-libx265 --enable-libxavs --enable-li
bxvid --enable-lzma --enable-decklink --enable-zlib
libavutil 55. 5.100 / 55. 5.100
libavcodec 57. 13.102 / 57. 13.102
libavformat 57. 13.100 / 57. 13.100
libavdevice 57. 0.100 / 57. 0.100
libavfilter 6. 14.101 / 6. 14.101
libswscale 4. 0.100 / 4. 0.100
libswresample 2. 0.100 / 2. 0.100
libpostproc 54. 0.100 / 54. 0.100
[mxf @ 00000000003e4580] "OPAtom" with 2 ECs - assuming OP1a
Input #0, mxf, from 'G:\Import\Video_OpenSource\Tears of Steel\Tears of Steel [4K] [DCP]\tos_picture.mxf':
Metadata:
uid : e2c6f645-b8c7-4f79-a45f-ba34e9959592
generation_uid : bcd54e36-5843-486c-b973-d9a1a78e839a
company_name : OpenDCP
product_name : OpenDCP
product_version : 0.27.1
product_uid : 43059a1d-0432-4101-b83f-736815acf31d
modification_date: 2013-05-14 11:49:51
application_platform: unix
material_package_umid: 0x060A2B340101010501010F20130000006B90EF244C8A439D 938F7808426E5520
material_package_name: AS-DCP Material Package
timecode : 00:00:00:00
Duration: 00:12:14.00, start: 0.000000, bitrate: 146830 kb/s
Stream #0:0: Video: jpeg2000 (JPEG 2000 digital cinema 4K), xyz12le, 4096x1714, SAR 1:1 DAR 2048:857, 24 tbr, 24 tbn, 24 tbc
Metadata:
file_package_umid: 0x060A2B340101010501010F201300000064FE189527CA44F3 A3FF2288AA2D0A08
file_package_name: File Package: SMPTE 429-4 frame wrapping of JPEG 2000 codestreams
Output #0, avi, to 'tos_picture.avi':
Metadata:
uid : e2c6f645-b8c7-4f79-a45f-ba34e9959592
generation_uid : bcd54e36-5843-486c-b973-d9a1a78e839a
company_name : OpenDCP
product_name : OpenDCP
product_version : 0.27.1
product_uid : 43059a1d-0432-4101-b83f-736815acf31d
modification_date: 2013-05-14 11:49:51
application_platform: unix
material_package_umid: 0x060A2B340101010501010F20130000006B90EF244C8A439D 938F7808426E5520
material_package_name: AS-DCP Material Package
ISMP : 00:00:00:00
ISFT : Lavf57.13.100
Stream #0:0: Video: ffvhuff (FFVH / 0x48564646), yuv444p16le, 4096x1714 [SAR 1:1 DAR 2048:857], q=2-31, 200 kb/s, 24 fps, 24 tbn, 24 tbc
Metadata:
file_package_umid: 0x060A2B340101010501010F201300000064FE189527CA44F3 A3FF2288AA2D0A08
file_package_name: File Package: SMPTE 429-4 frame wrapping of JPEG 2000 codestreams
encoder : Lavc57.13.102 ffvhuff
Stream mapping:
Stream #0:0 -> #0:0 (jpeg2000 (native) -> ffvhuff (native))
Press [q] to stop, [?] for help
frame= 48 fps=1.7 q=-0.0 Lsize= 1241555kB time=00:00:02.00 bitrate=5085409.6kbits/s
video:1241547kB audio:0kB subtitle:0kB other streams:0kB global headers:1kB muxing overhead: 0.000621%
*/

[pandy]

Seem that something must be wrong:
https://github.com/FFmpeg/FFmpeg/blob/b9cd3e1add3a3db86aaeba8680ad5a4ee57d519b/libavco...c/huffyuvenc.c
Looks like lot of format supported - i would advise to contact directly with Michael Niedermayer.
Last commit was done on 21 October.

[sparktank]

I did tests with all versions and they all worked out.
I only did a tiniest sample ever to see how it starts operations.

I didn't even read the full read out for the console window.
But, apparently, it's using FFMPEG from somewhere else in one of the PATHs.
version: N-76419-gdee7440 from 2013.

I thought I checked all the user/system paths.
But doing a check on ffmpeg.exe, I see a lot of installed versions from somewheres.

I started using a direct call to ffmpeg with quotations.
I used to have a solid folder just for updated nightlies of ffmpeg in the system path.
But, I guess something I installed recently added a new ffmpeg with a new path.

Looks like it might not be a real issue.

With latest "20151205-git-a16243a" instead of "N-76419-gdee7440" and no loss of yuv444p16le.

Checking through ProcessLasso log, it came from ImageMagick.
I only installed because I was too lazy to keep updating the portable folder for that, too. I use it less than ffmpeg. lol

Sorry for false alarm, everyone.

Lesson learned? Never install everything under the sun.