Class: 354 (Arabian Camel), Feature: 150

MTurk Worker Annotations

We now show the responses from five crowdworkers used to annotate this class-feature pair as core or spurious. Workers first denote if the focus of the image is on the main object (core), or a separate or background object (spurious). They also mark their confidence on a scale of 1 to 5, and provide written explanations for their annotation.



Main Focus	Confidence	Explanation
Background	4	The red region in the highlighted visual attributes focuses on the background of an arabian camel.
Background	5	Focus is on the background of the main object.
Background	4	Desert in the background of camel
Background	5	The main object is an arabian camel, dromedary, camelus dromedarius. the focus of the red region in the highlighted visual attributes is on the background of these images, what is not relevant for the visual attributes. because of that, i choose focus is on the background of the main object.
Background	4	The highlighted visual attribute seems to be missing the camel in every image weather it is trying to hit above or below i cannot say with confidence that it knows it is supposed to focus on the camel.


Votes for core: 0, Votes for spurious: 5. Feature is thus annotated as spurious for the class.