Class: 144 (Pelican), Feature: 613

MTurk Worker Annotations

We now show the responses from five crowdworkers used to annotate this class-feature pair as core or spurious. Workers first denote if the focus of the image is on the main object (core), or a separate or background object (spurious). They also mark their confidence on a scale of 1 to 5, and provide written explanations for their annotation.



Main Focus	Confidence	Explanation
Main Object	5	I am absolutely 100% sure that the highlighted area is focused on some part of the main object which is a pelican in this case it seems to be focusing on the pelican beak and pouch
Main Object	4	The main object is pelican bird whose some part got focus.
Main Object	5	The main object is an pelican. the focus of the red region on the highlighted visual attributes is on the bird's head and body, showing its main parts. because of that, i choose that focus is on some part of the main object.
Main Object	4	Focus is on the neck and beak of the pelican.
Main Object	2	Pelican bird is focused.


Votes for core: 5, Votes for spurious: 0. Feature is thus annotated as core for the class.