Class: 547 (Electric Locomotive), Feature: 1134

MTurk Worker Annotations

We now show the responses from five crowdworkers used to annotate this class-feature pair as core or spurious. Workers first denote if the focus of the image is on the main object (core), or a separate or background object (spurious). They also mark their confidence on a scale of 1 to 5, and provide written explanations for their annotation.



Main Focus	Confidence	Explanation
Main Object	3	Red focus is on the train.
Main Object	5	Because the focus of the red color was at least somewhat on the main object in the highlighted visual attributes, in this case the front and visible side of the train.
Main Object	5	The main object is an electric locomotive. the focus of the red region in the highlighted visual attributes is on the vehicle, showing its main parts. because of that, i choose focus is on some part of the main object.
Main Object	4	Above images are focusing on some part of the main object.
Main Object	4	The red region in the highlighted visual attributes focuses on the part of an electric locomotive.


Votes for core: 5, Votes for spurious: 0. Feature is thus annotated as core for the class.