Class: 116 (Chiton), Feature: 1431

MTurk Worker Annotations

We now show the responses from five crowdworkers used to annotate this class-feature pair as core or spurious. Workers first denote if the focus of the image is on the main object (core), or a separate or background object (spurious). They also mark their confidence on a scale of 1 to 5, and provide written explanations for their annotation.



Main Focus	Confidence	Explanation
Background	4	Mainly focus on back round of the main object chiton, coat-of-mail shell, sea cradle, polyplacophore
Separate Object	4	Focus is ground around the coat-of-mail shell.
Main Object	5	Focus is on the shell of the chiton which is a part of the main object.
Main Object	3	I market "somewhat confident" because honestly the red zones seem quite random to me, with reference to the main object. for example, in the last image it only covers the background, in the first some of the creature. it looks not so well done to me.
Background	3	Focus is on the background of the main object given.


Votes for core: 2, Votes for spurious: 3. Feature is thus annotated as spurious for the class.