Class: 136 (Common Gallinule), Feature: 523

MTurk Worker Annotations

We now show the responses from five crowdworkers used to annotate this class-feature pair as core or spurious. Workers first denote if the focus of the image is on the main object (core), or a separate or background object (spurious). They also mark their confidence on a scale of 1 to 5, and provide written explanations for their annotation.



Main Focus	Confidence	Explanation
Main Object	3	Focus is on the animal
Main Object	4	Heat map suggest the focus is on bird
Main Object	3	The body of the bird is focused on.
Main Object	5	Images are fully focused on main object's body parts.
Main Object	5	The instruction at the beginning clearly says the significance of the red region in contrast to blue region. the purpose of the red region is very clear. it should highlight the object of interest and get focus of the viewer. the other two options contradicts with the purpose of the red hotspot that is described in the instruction.


Votes for core: 5, Votes for spurious: 0. Feature is thus annotated as core for the class.