Class: 175 (Otterhound), Feature: 1059

MTurk Worker Annotations

We now show the responses from five crowdworkers used to annotate this class-feature pair as core or spurious. Workers first denote if the focus of the image is on the main object (core), or a separate or background object (spurious). They also mark their confidence on a scale of 1 to 5, and provide written explanations for their annotation.



Main Focus	Confidence	Explanation
Main Object	5	Focus is on focus is on the nose, eyes, body, and head which are part of the otterhound
Main Object	5	Focus is on face of the otterhound
Main Object	4	Focus is on the nose and body, which are part of the dog
Main Object	5	Focus is on the nose, face, and body of the dog breed called otterhound.
Main Object	4	Focus is on the area around the nose in the first and third images.in the second image the focus is on the back part of the body and on the face of the otterhound.in fourth the focus is on the center part of the body and in the fifth the focus is on the nose.


Votes for core: 5, Votes for spurious: 0. Feature is thus annotated as core for the class.