Class: 202 (Soft-Coated Wheaten Terrier), Feature: 267

MTurk Worker Annotations

We now show the responses from five crowdworkers used to annotate this class-feature pair as core or spurious. Workers first denote if the focus of the image is on the main object (core), or a separate or background object (spurious). They also mark their confidence on a scale of 1 to 5, and provide written explanations for their annotation.



Main Focus	Confidence	Explanation
Main Object	4	Focus is on the face and legs of the terrier.
Main Object	5	Highlighted area is focused on the dog's nose.
Main Object	4	Based on images 1-5.
Main Object	5	Focus is on the nose and face of the dog.
Main Object	4	All but 1nof the photow focuaed on nose but the last focused on fur or legs. but inthinknfur on legs is main focused on last photo, so it has to be fur is the focus which makes the most sense to me.


Votes for core: 5, Votes for spurious: 0. Feature is thus annotated as core for the class.