Class: 923 (Plate), Feature: 2025

MTurk Worker Annotations

We now show the responses from five crowdworkers used to annotate this class-feature pair as core or spurious. Workers first denote if the focus of the image is on the main object (core), or a separate or background object (spurious). They also mark their confidence on a scale of 1 to 5, and provide written explanations for their annotation.



Main Focus	Confidence	Explanation
Separate Object	4	In most of the images the focus in not only focused on main object or background or some part of the main object, it is mostly focused on other object of the image.
Separate Object	4	The focus is not the food/main course.
Main Object	3	The red region in the highlighted visual attributes focuses on the part of a plate.
Separate Object	4	In most of the images the red highlighted regions are on the food on the plate and not the plate itself.
Main Object	5	The red is in the middle of the plate.


Votes for core: 2, Votes for spurious: 3. Feature is thus annotated as spurious for the class.