Class: 968 (Tea Cup), Feature: 98

MTurk Worker Annotations

We now show the responses from five crowdworkers used to annotate this class-feature pair as core or spurious. Workers first denote if the focus of the image is on the main object (core), or a separate or background object (spurious). They also mark their confidence on a scale of 1 to 5, and provide written explanations for their annotation.



Main Focus	Confidence	Explanation
Main Object	5	Coffee cup is focused here.
Main Object	4	In one of the picture , the red zone focus on the portion of the cup as well as the drink in cup(may be tea/coffee). but in all the image, the focus is on the portion of cup. so i am choosing focus is on some part of the main object. at the same time i am not completely confident, since in one of the image, the focus also fall in drink(tea). so chose fairly confident
Main Object	4	Q1 response based on images 1-5.
Main Object	5	The red region in the highlighted visual attributes focuses on the part of the cup that is the main object.
Main Object	3	Focus on glass


Votes for core: 5, Votes for spurious: 0. Feature is thus annotated as core for the class.