Class: 445 (Bikini), Feature: 989

MTurk Worker Annotations

We now show the responses from five crowdworkers used to annotate this class-feature pair as core or spurious. Workers first denote if the focus of the image is on the main object (core), or a separate or background object (spurious). They also mark their confidence on a scale of 1 to 5, and provide written explanations for their annotation.



Main Focus	Confidence	Explanation
Separate Object	4	Hands are not a part of bikini
Separate Object	5	The main object is an bikini, two-piece. the focus of the red region on the highlighted visual attributes is on the kid's, showing something that's not relevant for the visual attributes since the main object is an bikini, two-piece, that's clothes. because of that, i choose to focus is on some other object (not a part of the main object).
Main Object	4	Focus is on the tops and bottoms of the bikini.
Main Object	5	I am extremely confident that the highlighted area that is focused on is limbs of the people wearing the bathing suits at the beach and parts of their bodies
Main Object	5	Focus is on the main object.


Votes for core: 3, Votes for spurious: 2. Feature is thus annotated as core for the class.