Class: 832 (Stupa), Feature: 36

MTurk Worker Annotations

We now show the responses from five crowdworkers used to annotate this class-feature pair as core or spurious. Workers first denote if the focus of the image is on the main object (core), or a separate or background object (spurious). They also mark their confidence on a scale of 1 to 5, and provide written explanations for their annotation.



Main Focus	Confidence	Explanation
Background	5	The focus of the red region in the highlighted visual attributes is on the cloud on the background of the stupa.
Separate Object	4	Focus is not on the main part of the object, its some other object.
Background	4	The red region in the highlighted visual attributes focuses on the background of a stupa.
Background	5	Focus is highlighting the sky around the central object
Separate Object	5	The main object is an stupa, tope. the focus of the red region in the highlighted visual attributes is on other object, showing an other thing and disrupting the artificial intelligence. because of that, i choose focus is on some other object (not a part of the main object).


Votes for core: 0, Votes for spurious: 5. Feature is thus annotated as spurious for the class.