Class: 874 (Trolleybus), Feature: 585

MTurk Worker Annotations

We now show the responses from five crowdworkers used to annotate this class-feature pair as core or spurious. Workers first denote if the focus of the image is on the main object (core), or a separate or background object (spurious). They also mark their confidence on a scale of 1 to 5, and provide written explanations for their annotation.



Main Focus	Confidence	Explanation
Main Object	2	The focus is on the headlight which is part of the trolleybus
Main Object	4	The focus in the first, second and the third images is on the glass of the front part of the trolleybus,i.e., where the driver is driving.in the fourth and the fifth image the focus is below the windows,i.e. the lower part of the bus.
Main Object	4	Focus is on windshield which is part of trolley bus
Main Object	4	Focus is on headlight of a bus, focus is on side of a bus
Main Object	4	Focus is on some part of the main object trolleybus


Votes for core: 5, Votes for spurious: 0. Feature is thus annotated as core for the class.