Class: 639 (One-Piece Bathing Suit), Feature: 1535

MTurk Worker Annotations

We now show the responses from five crowdworkers used to annotate this class-feature pair as core or spurious. Workers first denote if the focus of the image is on the main object (core), or a separate or background object (spurious). They also mark their confidence on a scale of 1 to 5, and provide written explanations for their annotation.



Main Focus	Confidence	Explanation
Separate Object	4	Focus is on the limbs of the model wearing the maillot.
Separate Object	5	Highlighted area is more focused around the skin of the tank suit, but not the tank suit itself.
Background	2	The red region in the highlighted visual attributes focuses on the background of a maillot.
Separate Object	4	Legs are not a part of maillot, (tank suit)
Separate Object	5	The main object is an maillot, tank suit (clothes). the focus of the red region on the highlighted visual attributes is on the woman's body, showing something that's not relevant for the visual attributes since the main object is an maillot or tank suit. because of that, i choose to focus is on some other object (not a part of the main object).


Votes for core: 0, Votes for spurious: 5. Feature is thus annotated as spurious for the class.