Class: 489 (Chain-Link Fence), Feature: 1251

MTurk Worker Annotations

We now show the responses from five crowdworkers used to annotate this class-feature pair as core or spurious. Workers first denote if the focus of the image is on the main object (core), or a separate or background object (spurious). They also mark their confidence on a scale of 1 to 5, and provide written explanations for their annotation.



Main Focus	Confidence	Explanation
Background	2	Since the fence covers the entire picture in all five photos theoretically they should all be red. but instead it appears the focus is blotchy and on objects in the background, like the dark spaces in photo three and four
Main Object	5	Focus is on the center of the chainlink fence.
Main Object	4	The main object is chainlink fence whose some part got focus.
Main Object	3	Focus is on fabric of a chainlink fence
Background	4	Focus is on the scene in the background of the chainlink fence.


Votes for core: 3, Votes for spurious: 2. Feature is thus annotated as core for the class.