Class: 325 (Sulphur Butterfly), Feature: 1582

MTurk Worker Annotations

We now show the responses from five crowdworkers used to annotate this class-feature pair as core or spurious. Workers first denote if the focus of the image is on the main object (core), or a separate or background object (spurious). They also mark their confidence on a scale of 1 to 5, and provide written explanations for their annotation.



Main Focus	Confidence	Explanation
Main Object	4	Focus is on wings of butterfly
Main Object	4	The red region in the highlighted visual attributes focuses on the wings of a sulphur butterfly.
Main Object	5	The highlighted visual attribute is on the butterfly in every image mainly targeting the colored wings of the insect.
Main Object	5	The focus of the red region in the highlighted visual attributes is on the wings of the butterfly.
Main Object	5	The main object is an sulphur butterfly. the focus of the red region in the highlighted visual attributes is on the butterfly's body and wings, showing their main parts. because of that, i choose focus is on some part of the main object.


Votes for core: 5, Votes for spurious: 0. Feature is thus annotated as core for the class.