Class: 93 (Hornbill), Feature: 1082

MTurk Worker Annotations

We now show the responses from five crowdworkers used to annotate this class-feature pair as core or spurious. Workers first denote if the focus of the image is on the main object (core), or a separate or background object (spurious). They also mark their confidence on a scale of 1 to 5, and provide written explanations for their annotation.



Main Focus	Confidence	Explanation
Main Object	3	Focus is on beak which is a part hornbill
Main Object	5	The red regions on all 5 pictures are focusing on parts of the main object (beak, and body of the hornbill). in my opinion the overlap in between the red regions and the background are not significant enough for me to say the focus is there. there are no other objects highlighted in red in any of the images.
Main Object	5	Focus is on beak which is a part of hornbill
Main Object	5	The focus of the red region in the highlighted visual attributes is on beak of the hornbill.
Main Object	4	Focus is on the neck and the beak of the hornbill.


Votes for core: 5, Votes for spurious: 0. Feature is thus annotated as core for the class.