Video Quality Measurement Tool (version 1.2 with plugins support)

[DmitriyV]

MSU Video Quality Measurement Tool!

Last news: 20 June - version 1.2 released! (bugfixes + plugins interface(!)).

Metric supports different input formats (AVI, AVS, YUV, BMP) and metrics (PSNR, Delta, VQM, SSIM, MSU Blurring/Blocking Measure). Main features: results are saved in *.CSV (can be opened everywhere), all metrics are visualized, comparative analysis (comparison of three files: original, and two other, for example processed by different codecs).

Program allow to answer on questions:
1) One codec has more bluring than another. On what frames? Average mark?
2) One codec has more blocking than another. On what frames? Average mark?
3) One codec has more lower quality than another. On what frames? Average mark in PSNR, VQM, SSIM?

Correspondent "bad frames" are saved automatically into BMP files.

Direct links: Metric home page, link to program.

ChangeLog:

1.2
(+) Now it is possible to compress visualization
(+) Plugin mechanism released
(!) Problem with some DV codecs is known now

1.0
(+) More YUV filetypes are supported, including YV12, YUY2, YUV
(+) Supports unicode
(+) Visualization dialog was extensively reworked
(*) Interface is more user-friendly

0.81
(+) New AVI Reading system (support large AVI Files, VP 70)
(*) Bugfixing in final dialog

0.8
(+) New dialog with visualisation of the comparison and for comparison of the selected frames added.

0.75
(+) Improved codecs support (x264)
(+) Now data from YUV-AVI files is extracted without convertion
(*) Bugfixing: #NAN in VQM calculation, calculation of RGB-metrics for YUV-files
(*) MSU Blocking Measure changed

Ver 0.74
(+) MSE, MSAD metrics added
(+) Saving of averange value of the metric added
(+) Improved codecs support (DivX3, WMV, mjpeg2000)
(*) Delta metric was changed
(*) Bugfixing with AviSynth

Ver 0.73
(+) All colorspaces from AVISynth are supported
(+) I420 (IYUV) support added
(+) XviD and B-frames support added
(*) Bugfixing (YUV-files, SSIM)

Ver 0.72
(+) AviSynth support added!

Any comment and ideas about future metric development are welcome!

[DmitriyV]

We are prepare now version with plugins support (and many other fixes), so anybody will be able to write his own metric - for example with GPU optimization or with measurement of some specific issues.

If you want to take part in metric pre-release testing - please let us know on e-mail video-measure(*)compression.ru or here.

[DmitriyV]

Last news: 20 June - version 1.2 released! (bugfixes + plugins interface(!)).

Now it's easy to add new metric to the tool.

For example:
* Faster metrics (using MMX-SSE2, HW acceleration, DirectShow
* New special blurring (blocking, interlacing, etc) measures
* New perfect formal metrics (again better than PSNR )

Any ideas about future metric development are welcome!

[Sergey Grishin]

The tool was updated recently. Version 2.7 released.
VQMT Home Page
Video Casts

Changes in v2.7:

• MSSSIM (fast and precise) metric implemented
• 3SSIM metric implemented
• Fixed bug in calculation of VQM metric under Windows 7
• Fixed bug during program launch on some machines

Changelog

Examples of VQMT metric visualizations:

Description

Professional program for video quality assessment:

• supports more than 30 formats (AVI, YUV, AVS, BMP, MOV, VOB, WMV, MP4, MPG, MKV, FLV and others via AviSynth);
• 20 objective metrics are implemented (PSNR, Delta, VQM, SSIM, 3SSIM, MS-SSIM, MSU Blurring/Blocking, MSE, MSAD and others);
• any metirc can be implemented via open plug-in interface.

Examples of graphs builts based on data calculated using VQMT:

Main features:

• The tool provides functionality for calculating:
  • metric values for each frame,
  • average value for sequence,
  • metric values for specific color component.
• Metric values are stored into CSV (Comma-Separated Values) files, which can be opened everywhere.
• Visualization video can be generated additionally to CSV files for each metric. Visualization illustrates the amplitude of the given metric in each pixel of each video frame.
• Professional color depth (10-, 14- and 16-bit) is supported for raw data (YUV).
• ROI (Region of Interest) support is also implemented, it is possible to calculate any metric for specific part of the frame which is defined by provided mask.
• VQMT provides GUI and command-line (CL) interfaces. It is possible using CL-tool to calculate several metrics for a given set of color components simultaneously (in parallel), thus achieveing significant speed advantage comparing to case of using GUI tool.
• Detailed documentation is provided along with the tool.

[MSU G&M Lab Videogroup]

Hello everybody!

We have just released new VQMT version 3.0!

Whats new in the version 3.0?

1) Accelerated SSIM-based metrics calculation using NVIDIA hardware.
Now it works up to 13 times faster on GPU!
2) Added stSSIM metric, which uses temporal information and shows good
subjective quality correlation result
3) Added 64-bit version with up to 10% speedup
4) Added *.y4m internal support

For those who interested in metrics difference we made a subjective
quality comparison for some of them:
http://www.compression.ru/video/quality_measure/subj_metric_comparison_en.html

MSU VQMT 3.0 Free version can be downloaded here:
http://www.compression.ru/video/quality_measure/vqmt_download_en.html#free

As always, additional information you can read on the MSU VQMT Webpage:
http://www.compression.ru/video/quality_measure/video_measurement_tool_en.html

Feel free to ask questions!

[Mephesto]

Esteemed comrades, Your new version 3.0 that supports multicore is actually way slower than 2.6 that runs on a single core. I brought this to your attention about a year ago, has it been remedied yet?