Class: 875 (Trombone), Feature: 640

MTurk Worker Annotations

We now show the responses from five crowdworkers used to annotate this class-feature pair as core or spurious. Workers first denote if the focus of the image is on the main object (core), or a separate or background object (spurious). They also mark their confidence on a scale of 1 to 5, and provide written explanations for their annotation.



Main Focus	Confidence	Explanation
Main Object	4	In the first, second images the focus is on the bell open part of the trumpet. in the third image the focus is on the valves. in the fourth image the focus is on the side of the bell of the trumpet. and in the fifth image the focus is on the fingers of the trumpet player.
Main Object	5	All five images have focus omn some part of main object trombone, but last one is not a good example.
Main Object	5	All the images are mainly focused on main object's body parts.
Main Object	4	The focus is bell which is a part of trumpet
Main Object	5	Highlighted visual attributes is on the main object - trombone


Votes for core: 5, Votes for spurious: 0. Feature is thus annotated as core for the class.