Class: 785 (Seat Belt), Feature: 50

MTurk Worker Annotations

We now show the responses from five crowdworkers used to annotate this class-feature pair as core or spurious. Workers first denote if the focus of the image is on the main object (core), or a separate or background object (spurious). They also mark their confidence on a scale of 1 to 5, and provide written explanations for their annotation.



Main Focus	Confidence	Explanation
Background	3	Focus is on the window
Background	5	The focus is never on the seatbelt in all 5 pictures.
Background	2	Focus on the back
Separate Object	4	Car window is not a part of seat belt
Background	4	The red is on the background behind the seatbelt.


Votes for core: 0, Votes for spurious: 5. Feature is thus annotated as spurious for the class.