Class: 146 (Albatross), Feature: 1661

MTurk Worker Annotations

We now show the responses from five crowdworkers used to annotate this class-feature pair as core or spurious. Workers first denote if the focus of the image is on the main object (core), or a separate or background object (spurious). They also mark their confidence on a scale of 1 to 5, and provide written explanations for their annotation.



Main Focus	Confidence	Explanation
Main Object	5	All the images are mainly focused on main object's body parts.
Main Object	4	The main object is bird mollymawk whose some part got focus.
Main Object	4	Focus is on the body and wings of the albatross.
Main Object	4	Focus is on the bird
Main Object	4	The deeper red shades are at the center or near the center of the bird. it's obvious that the ai models are taking the background water into account, but that they're main focus is on the bird and attempting to recreate it. there appears to even be an attempt to recreate its feathers in the one image.


Votes for core: 5, Votes for spurious: 0. Feature is thus annotated as core for the class.