Class: 415 (Bakery), Feature: 1990

MTurk Worker Annotations

We now show the responses from five crowdworkers used to annotate this class-feature pair as core or spurious. Workers first denote if the focus of the image is on the main object (core), or a separate or background object (spurious). They also mark their confidence on a scale of 1 to 5, and provide written explanations for their annotation.



Main Focus	Confidence	Explanation
Separate Object	5	The focus is highlighting the store's facade and windows
Main Object	5	The main focus of the red areas is on the display cases of the bakery.
Main Object	5	The red region completely focuses on the predicted object but doesn't cover it fully.
Main Object	5	The main object is an bakery, bakeshop or bakehouse. the focus of the red region on the highlighted visual attributes is on the bakeshop's structure, showing its main parts. because of that, i choose that focus is on some part of the main object.
Main Object	5	The focus of the red region in the highlighted visual attributes is on the bakeshop.


Votes for core: 4, Votes for spurious: 1. Feature is thus annotated as core for the class.