Class: 542 (Drumstick), Feature: 1260

MTurk Worker Annotations

We now show the responses from five crowdworkers used to annotate this class-feature pair as core or spurious. Workers first denote if the focus of the image is on the main object (core), or a separate or background object (spurious). They also mark their confidence on a scale of 1 to 5, and provide written explanations for their annotation.



Main Focus	Confidence	Explanation
Main Object	4	Highlighted visual attributes is on drumstick
Main Object	5	Focus is on either the top or bottom portion of the drumstick, or where they connect when they are crossed into an x
Main Object	5	All the images are mainly focused on main object's body parts.
Main Object	5	Focus is on the center of the drumsticks.
Background	4	The focus in the first, second and third image is the background of the drumstick. in fourth image the focus is background of the drumstick, i.e. the beard of the man. in the fifth image the focus is on the stomach of the man.


Votes for core: 4, Votes for spurious: 1. Feature is thus annotated as core for the class.