Class: 675 (Moving Van), Feature: 1211

MTurk Worker Annotations

We now show the responses from five crowdworkers used to annotate this class-feature pair as core or spurious. Workers first denote if the focus of the image is on the main object (core), or a separate or background object (spurious). They also mark their confidence on a scale of 1 to 5, and provide written explanations for their annotation.



Main Focus	Confidence	Explanation
Main Object	4	The focus is on the door handle which is part of the moving van
Main Object	5	Focus is on the cab and front of the body of the moving truck
Main Object	4	In the first and second image the focus is on the windshield and lower part of the windshield. in the third image the focus is on the front glass and on the windowshield. in fourth image the focus is on the lower part of the window of moving van and the back part of the moving van. the fifth image is focused on the front , lower corner of the trolley.
Main Object	5	Highlighted visual attributes is on main object vehicles
Main Object	5	The focus is on the main body of the truck which is the main object.


Votes for core: 5, Votes for spurious: 0. Feature is thus annotated as core for the class.