Class: 785 (Seat Belt), Feature: 1493

MTurk Worker Annotations

We now show the responses from five crowdworkers used to annotate this class-feature pair as core or spurious. Workers first denote if the focus of the image is on the main object (core), or a separate or background object (spurious). They also mark their confidence on a scale of 1 to 5, and provide written explanations for their annotation.



Main Focus	Confidence	Explanation
Background	5	Focus is on car in the background of seatbelt
Main Object	2	Focus is on one end of the seatbelt in several photos, but on the window in other photos.
Background	4	The red parts are focus on the back of the car
Background	5	The main object is a seat belt, a safety belt used in a car or plane to hold you in your seat in case of an accident. the focus of the red region on the highlighted visual attributes is on the background of these images, showing something that's not relevant for the visual attributes since the main object is a seat belt. because of that, i choose to focus is on the background of the main object.
Separate Object	4	Red focus is not on the sheet belt.


Votes for core: 1, Votes for spurious: 4. Feature is thus annotated as spurious for the class.