Class: 594 (Harp), Feature: 657

MTurk Worker Annotations

We now show the responses from five crowdworkers used to annotate this class-feature pair as core or spurious. Workers first denote if the focus of the image is on the main object (core), or a separate or background object (spurious). They also mark their confidence on a scale of 1 to 5, and provide written explanations for their annotation.



Main Focus	Confidence	Explanation
Main Object	5	The main focus is on the middle strings of the harp which is part of the main object
Main Object	2	Focus is on the harp
Main Object	5	Red regions are clearly focusing on parts of the main object (strings of the harp) in all 5 images. there is some overlap with the background on the first four images, and with another object on the fifth one, but, in my opinion, the focus of the red regions is always on parts of the main object.
Main Object	5	Images are mainly focused on main object's body parts.
Main Object	3	Harp musical instruments are focused.


Votes for core: 5, Votes for spurious: 0. Feature is thus annotated as core for the class.