The images below show results of Kruskal-Wallis significance test calculated on per-pixel basis separately for each scene.
Left column: hover the mouse over the test image to see the reference image.
Right colums: the images show p-values for a particular test, p-values smaller than 0.05 (i.e. statistically significant differences) are visualized in green (when experts average is higher than non-experts) and red (when experts average is lower than non-experts), hover the mouse over the result to see the visualization of p-values smaller than 0.01. The number S shows the overall significance (per scene) and was obtained as the fraction of the number of statistically significant pixels (i.e. p-values<0.05) over the number of pixels in regions marked by at least 5% of observers (i.e. the number of pixels with probabilities of detection >0.05).
![]() appartment_II - test image | ![]() Effect of experimental setup (with-ref vs. no-ref): P=0.70612, Kruskal-Wallis p<0.05 | ![]() Mean observer in with-reference experiment |
![]() atrium - test image | ![]() Effect of experimental setup (with-ref vs. no-ref): P=0.44421, Kruskal-Wallis p<0.05 | ![]() Mean observer in with-reference experiment |
![]() bathroom - test image | ![]() Effect of experimental setup (with-ref vs. no-ref): P=0.56904, Kruskal-Wallis p<0.05 | ![]() Mean observer in with-reference experiment |
![]() buddha - test image | ![]() Effect of experimental setup (with-ref vs. no-ref): P=0.70893, Kruskal-Wallis p<0.05 | ![]() Mean observer in with-reference experiment |
![]() chairs - test image | ![]() Effect of experimental setup (with-ref vs. no-ref): P=0.51854, Kruskal-Wallis p<0.05 | ![]() Mean observer in with-reference experiment |
![]() city-d - test image | ![]() Effect of experimental setup (with-ref vs. no-ref): P=0.19008, Kruskal-Wallis p<0.05 | ![]() Mean observer in with-reference experiment |
![]() city-u - test image | ![]() Effect of experimental setup (with-ref vs. no-ref): P=0.022955, Kruskal-Wallis p<0.05 | ![]() Mean observer in with-reference experiment |
![]() cornell - test image | ![]() Effect of experimental setup (with-ref vs. no-ref): P=0.61268, Kruskal-Wallis p<0.05 | ![]() Mean observer in with-reference experiment |
![]() dragons - test image | ![]() Effect of experimental setup (with-ref vs. no-ref): P=0.24417, Kruskal-Wallis p<0.05 | ![]() Mean observer in with-reference experiment |
![]() hall - test image | ![]() Effect of experimental setup (with-ref vs. no-ref): P=0.66926, Kruskal-Wallis p<0.05 | ![]() Mean observer in with-reference experiment |
![]() icido - test image | ![]() Effect of experimental setup (with-ref vs. no-ref): P=0.19437, Kruskal-Wallis p<0.05 | ![]() Mean observer in with-reference experiment |
![]() kitchen_II - test image | ![]() Effect of experimental setup (with-ref vs. no-ref): P=0.35726, Kruskal-Wallis p<0.05 | ![]() Mean observer in with-reference experiment |
![]() livingroom - test image | ![]() Effect of experimental setup (with-ref vs. no-ref): P=0.55858, Kruskal-Wallis p<0.05 | ![]() Mean observer in with-reference experiment |
![]() mpii - test image | ![]() Effect of experimental setup (with-ref vs. no-ref): P=0.24852, Kruskal-Wallis p<0.05 | ![]() Mean observer in with-reference experiment |
![]() plants-d - test image | ![]() Effect of experimental setup (with-ref vs. no-ref): P=0.31346, Kruskal-Wallis p<0.05 | ![]() Mean observer in with-reference experiment |
![]() plants-u - test image | ![]() Effect of experimental setup (with-ref vs. no-ref): P=0.26835, Kruskal-Wallis p<0.05 | ![]() Mean observer in with-reference experiment |
![]() room - test image | ![]() Effect of experimental setup (with-ref vs. no-ref): P=0.44913, Kruskal-Wallis p<0.05 | ![]() Mean observer in with-reference experiment |
![]() sala - test image | ![]() Effect of experimental setup (with-ref vs. no-ref): P=0.60941, Kruskal-Wallis p<0.05 | ![]() Mean observer in with-reference experiment |
![]() sanmiguel - test image | ![]() Effect of experimental setup (with-ref vs. no-ref): P=0.079227, Kruskal-Wallis p<0.05 | ![]() Mean observer in with-reference experiment |
![]() sanmiguel_cam3 - test image | ![]() Effect of experimental setup (with-ref vs. no-ref): P=0.50726, Kruskal-Wallis p<0.05 | ![]() Mean observer in with-reference experiment |
![]() sanmiguel_cam4 - test image | ![]() Effect of experimental setup (with-ref vs. no-ref): P=0.27668, Kruskal-Wallis p<0.05 | ![]() Mean observer in with-reference experiment |
![]() sibenik - test image | ![]() Effect of experimental setup (with-ref vs. no-ref): P=0.22621, Kruskal-Wallis p<0.05 | ![]() Mean observer in with-reference experiment |
![]() sponza - test image | ![]() Effect of experimental setup (with-ref vs. no-ref): P=0.29651, Kruskal-Wallis p<0.05 | ![]() Mean observer in with-reference experiment |
![]() tt - test image | ![]() Effect of experimental setup (with-ref vs. no-ref): P=0.12018, Kruskal-Wallis p<0.05 | ![]() Mean observer in with-reference experiment |
![]() villa_cam1 - test image | ![]() Effect of experimental setup (with-ref vs. no-ref): P=0.36357, Kruskal-Wallis p<0.05 | ![]() Mean observer in with-reference experiment |
![]() villa_cam2 - test image | ![]() Effect of experimental setup (with-ref vs. no-ref): P=0.38803, Kruskal-Wallis p<0.05 | ![]() Mean observer in with-reference experiment |
![]() villa_cam3 - test image | ![]() Effect of experimental setup (with-ref vs. no-ref): P=0.3998, Kruskal-Wallis p<0.05 | ![]() Mean observer in with-reference experiment |