Class: 612 (Rickshaw), Feature: 1705

MTurk Worker Annotations

We now show the responses from five crowdworkers used to annotate this class-feature pair as core or spurious. Workers first denote if the focus of the image is on the main object (core), or a separate or background object (spurious). They also mark their confidence on a scale of 1 to 5, and provide written explanations for their annotation.



Main Focus	Confidence	Explanation
Separate Object	5	Focus is on the passengers seating in the hand-pull rickshaw.
Main Object	3	Focus is on the structure of the rickshaw
Main Object	4	In the first image the focus is on the spokes of the wheel of the jinrikisha. in the second image the focus is on the children sitting in the jinrikisha. in the third image the focus is overlapped on the backside of the jinrikisha and the lady's back side. in the fourth and fifth image the focus is on the roadside shop.
Main Object	2	The focus is on canopy which is a part of rickshaw
Main Object	4	Highlighted visual attributes is on rickshaw


Votes for core: 4, Votes for spurious: 1. Feature is thus annotated as core for the class.