Inferential Statistics - the Effect of Experiment

The images below show results of Kruskal-Wallis significance test calculated on per-pixel basis separately for each scene.

Left column: hover the mouse over the test image to see the reference image.

Right colums: the images show p-values for a particular test, p-values smaller than 0.05 (i.e. statistically significant differences) are visualized in green (when experts average is higher than non-experts) and red (when experts average is lower than non-experts), hover the mouse over the result to see the visualization of p-values smaller than 0.01. The number S shows the overall significance (per scene) and was obtained as the fraction of the number of statistically significant pixels (i.e. p-values<0.05) over the number of pixels in regions marked by at least 5% of observers (i.e. the number of pixels with probabilities of detection >0.05).

appartment_II - test image	Effect of experimental setup (with-ref vs. no-ref): P=0.70612, Kruskal-Wallis p<0.05	Mean observer in with-reference experiment
atrium - test image	Effect of experimental setup (with-ref vs. no-ref): P=0.44421, Kruskal-Wallis p<0.05	Mean observer in with-reference experiment
bathroom - test image	Effect of experimental setup (with-ref vs. no-ref): P=0.56904, Kruskal-Wallis p<0.05	Mean observer in with-reference experiment
buddha - test image	Effect of experimental setup (with-ref vs. no-ref): P=0.70893, Kruskal-Wallis p<0.05	Mean observer in with-reference experiment
chairs - test image	Effect of experimental setup (with-ref vs. no-ref): P=0.51854, Kruskal-Wallis p<0.05	Mean observer in with-reference experiment
city-d - test image	Effect of experimental setup (with-ref vs. no-ref): P=0.19008, Kruskal-Wallis p<0.05	Mean observer in with-reference experiment
city-u - test image	Effect of experimental setup (with-ref vs. no-ref): P=0.022955, Kruskal-Wallis p<0.05	Mean observer in with-reference experiment
cornell - test image	Effect of experimental setup (with-ref vs. no-ref): P=0.61268, Kruskal-Wallis p<0.05	Mean observer in with-reference experiment
dragons - test image	Effect of experimental setup (with-ref vs. no-ref): P=0.24417, Kruskal-Wallis p<0.05	Mean observer in with-reference experiment
hall - test image	Effect of experimental setup (with-ref vs. no-ref): P=0.66926, Kruskal-Wallis p<0.05	Mean observer in with-reference experiment
icido - test image	Effect of experimental setup (with-ref vs. no-ref): P=0.19437, Kruskal-Wallis p<0.05	Mean observer in with-reference experiment
kitchen_II - test image	Effect of experimental setup (with-ref vs. no-ref): P=0.35726, Kruskal-Wallis p<0.05	Mean observer in with-reference experiment
livingroom - test image	Effect of experimental setup (with-ref vs. no-ref): P=0.55858, Kruskal-Wallis p<0.05	Mean observer in with-reference experiment
mpii - test image	Effect of experimental setup (with-ref vs. no-ref): P=0.24852, Kruskal-Wallis p<0.05	Mean observer in with-reference experiment
plants-d - test image	Effect of experimental setup (with-ref vs. no-ref): P=0.31346, Kruskal-Wallis p<0.05	Mean observer in with-reference experiment
plants-u - test image	Effect of experimental setup (with-ref vs. no-ref): P=0.26835, Kruskal-Wallis p<0.05	Mean observer in with-reference experiment
room - test image	Effect of experimental setup (with-ref vs. no-ref): P=0.44913, Kruskal-Wallis p<0.05	Mean observer in with-reference experiment
sala - test image	Effect of experimental setup (with-ref vs. no-ref): P=0.60941, Kruskal-Wallis p<0.05	Mean observer in with-reference experiment
sanmiguel - test image	Effect of experimental setup (with-ref vs. no-ref): P=0.079227, Kruskal-Wallis p<0.05	Mean observer in with-reference experiment
sanmiguel_cam3 - test image	Effect of experimental setup (with-ref vs. no-ref): P=0.50726, Kruskal-Wallis p<0.05	Mean observer in with-reference experiment
sanmiguel_cam4 - test image	Effect of experimental setup (with-ref vs. no-ref): P=0.27668, Kruskal-Wallis p<0.05	Mean observer in with-reference experiment
sibenik - test image	Effect of experimental setup (with-ref vs. no-ref): P=0.22621, Kruskal-Wallis p<0.05	Mean observer in with-reference experiment
sponza - test image	Effect of experimental setup (with-ref vs. no-ref): P=0.29651, Kruskal-Wallis p<0.05	Mean observer in with-reference experiment
tt - test image	Effect of experimental setup (with-ref vs. no-ref): P=0.12018, Kruskal-Wallis p<0.05	Mean observer in with-reference experiment
villa_cam1 - test image	Effect of experimental setup (with-ref vs. no-ref): P=0.36357, Kruskal-Wallis p<0.05	Mean observer in with-reference experiment
villa_cam2 - test image	Effect of experimental setup (with-ref vs. no-ref): P=0.38803, Kruskal-Wallis p<0.05	Mean observer in with-reference experiment
villa_cam3 - test image	Effect of experimental setup (with-ref vs. no-ref): P=0.3998, Kruskal-Wallis p<0.05	Mean observer in with-reference experiment