We release MSU Human Perceptual Video Quality tool!
http://compression.ru/video/quality_measure/perceptual_video_quality_tool_en.html

Main idea:
Freely available tool for near professional visual comparison tests execution.

Metric software contains two programs:
* Task manager (planner and statistics calculation tool)
* Player - tool for experts, that plays test sequences:
  • with 3 seconds rewind (if allowed in task)
  • with pause (if allowed in task)
  • showing one pair several times (for expert stability evaluation)
  • with final mark
see more options in documentation.

Tool implements blind testing schema - experts won't know, which codec was used for particular video.
Testing of several (3-6) codecs simultaneously is highly recommended (more pairs will produce more qualitative comparison).

Please note: number of experts has essential influence on final results.

ITU-R BT.500 or MSU procedures can be used for final result calculation.

Link to metric page

Enjoy!