Class: 926 (Hot Pot), Feature: 1296

MTurk Worker Annotations

We now show the responses from five crowdworkers used to annotate this class-feature pair as core or spurious. Workers first denote if the focus of the image is on the main object (core), or a separate or background object (spurious). They also mark their confidence on a scale of 1 to 5, and provide written explanations for their annotation.



Main Focus	Confidence	Explanation
Main Object	3	Highlighted areas are focused on the stew and the components of the stew. i'm only somewhat confident because "hot pot" can mean many things, and possibly the highlighted area is more focused on specific ingredients rather than the entire stew itself.
Main Object	5	Is focused on food
Main Object	4	Focus is on the contents of the hot pot.
Main Object	4	Focus is on some part of the main object.
Main Object	5	The main object is a hot pot, hotpot, a stew of meat and potatoes cooked in a tightly covered pot. the focus of the red region on the highlighted visual attributes is on the hotpot's meat, showing its main parts. because of that, i choose that focus is on some part of the main object.


Votes for core: 5, Votes for spurious: 0. Feature is thus annotated as core for the class.