Class: 265 (Toy Poodle), Feature: 1059

MTurk Worker Annotations

We now show the responses from five crowdworkers used to annotate this class-feature pair as core or spurious. Workers first denote if the focus of the image is on the main object (core), or a separate or background object (spurious). They also mark their confidence on a scale of 1 to 5, and provide written explanations for their annotation.



Main Focus	Confidence	Explanation
Main Object	4	In 4 out of 5 pictures, the focus of the red region is on the dog's nose or snout. on the picture where it's not on the nose or snout, the focus is kind of on the legs, but kind of also between them as well.
Main Object	4	The red region mainly focuses on the predicted object but spreads a little to the background on the edges.
Separate Object	4	The focus seems focused on a poodle and not a toy poodle which is not the main object
Main Object	5	The red region is on the face of the toy poodle.
Main Object	4	Focus is on the features of a poodle.


Votes for core: 4, Votes for spurious: 1. Feature is thus annotated as core for the class.