Class: 820 (Steam Locomotive), Feature: 1939

MTurk Worker Annotations

We now show the responses from five crowdworkers used to annotate this class-feature pair as core or spurious. Workers first denote if the focus of the image is on the main object (core), or a separate or background object (spurious). They also mark their confidence on a scale of 1 to 5, and provide written explanations for their annotation.



Main Focus	Confidence	Explanation
Main Object	5	Focus is on one part of the locomotive.
Main Object	3	Red focus is on the steam locomotive.
Main Object	5	The main object is an steam locomotive. the focus of the red region in the highlighted visual attributes is on the vehicle's body, showing their main parts of the steam locomotive. because of that, i choose focus is on some part of the main object.
Main Object	5	The focus of the red region in the highlighted visual attributes is on the engine of the steam locomotive.
Main Object	5	The more red an area is, the more intensity is on that object. because the main object in a photo is the focus of the photo, then the main object should be red, not the background or another object.


Votes for core: 5, Votes for spurious: 0. Feature is thus annotated as core for the class.