This folder contains the new dataset for benchmarking of image quality metrics (SIGGRAPH Asia'12), as well as the results of the perceptual experiment. Please refer to the paper (and supplementary material) entitled "New Measurements Reveal Weaknesses of Image Quality Metrics in Evaluating Graphics Artifacts" for additional information (http://www.mpi-inf.mpg.de/resources/hdr/iqm-evaluation/). You can also contact Martin Cadik via an email (mcadik@mpi-inf.mpg.de). 


Directory structure:

stimuli 
  this folder contains 2 subfolders: 
  -reference images (subfolder 'ref') 
  -distorted images, i.e. images exhibiting rendering artifacts (subfolder 'dst')
  both the reference and distorted images should be presented at a calibrated LDR display at the resolution of 60 pixels per visual degree

metrics
  this folder contains the responses of the tested full-reference image quality metrics: absolute difference AD (suffix 'AD'), HDR-VDP-2 (suffix 'HDR-VDP-2'), MS-SSIM (suffix 'MS-SSIM'), sCIE-Lab (suffix 'sCIE-Lab'), sCorrel (suffix 'sCorrel'), SSIM (suffix 'SSIM'). 
  
subjects
  this folder contains average subjective responses (suffix '_avg') and false-color visualizations (suffix '_vis') for 'no-reference' and 'with-reference' experiments
  additionally, there are 28 subfolders for each experiment containing the responses of a particular subject