Class: 289 (Snow Leopard), Feature: 853

MTurk Worker Annotations

We now show the responses from five crowdworkers used to annotate this class-feature pair as core or spurious. Workers first denote if the focus of the image is on the main object (core), or a separate or background object (spurious). They also mark their confidence on a scale of 1 to 5, and provide written explanations for their annotation.



Main Focus	Confidence	Explanation
Main Object	3	Body of the tiger is on red focus.
Main Object	3	While all images focus in the part of the head above the eye, some of them get other parts of the animal too.
Main Object	5	Focus is on the main object's ( leopard,) forehead . all images are on same focus.
Main Object	5	The red region in the highlighted visual attributes focuses on the snow leopard.
Main Object	5	The main object is a snow leopard, ounce or panthera uncia. the focus is on some part of the main object. red region in the highlighted visual attributes is on ounce's face, showing its main parts, what is relevant.


Votes for core: 5, Votes for spurious: 0. Feature is thus annotated as core for the class.