Class: 339 (Common Sorrel Horse), Feature: 230

MTurk Worker Annotations

We now show the responses from five crowdworkers used to annotate this class-feature pair as core or spurious. Workers first denote if the focus of the image is on the main object (core), or a separate or background object (spurious). They also mark their confidence on a scale of 1 to 5, and provide written explanations for their annotation.



Main Focus	Confidence	Explanation
Background	4	The red region in the highlighted visual attributes focuses on the background of a sorrel.
Main Object	5	The red region in the highlighted visual attributes means the focus is on the main object. as per the instructions, when the heated image is provided, the main focus of the image is shown in red color.
Background	4	Green field in the background of horse
Background	5	The main object is an sorrel. the focus of the red region in the highlighted visual attributes is on the background of these images, showing something not relevant for the visual attributes (main object is an sorrel). because of that, i choose focus is on the background of the main object.
Background	4	Highlighted visual attributes is on surrounding the sorrel


Votes for core: 1, Votes for spurious: 4. Feature is thus annotated as spurious for the class.