Class: 628 (Ocean Liner), Feature: 647

MTurk Worker Annotations

We now show the responses from five crowdworkers used to annotate this class-feature pair as core or spurious. Workers first denote if the focus of the image is on the main object (core), or a separate or background object (spurious). They also mark their confidence on a scale of 1 to 5, and provide written explanations for their annotation.



Main Focus	Confidence	Explanation
Main Object	4	Focus is on the windows of the rooms on the ocean liner.
Main Object	5	Focus is on the side of the ship, where the cabin rooms are located
Main Object	5	The focus was on the passenger nsection of the boat, the main object.
Main Object	4	In the first image the focus is on the side of the ocean liner. in the second and the third images the focus is on the front side and the last part of one of the sides of the ocean liner. in fourth and fifth images the front and one of the sides of the ocean liner.
Main Object	5	Focus is on ship floors


Votes for core: 5, Votes for spurious: 0. Feature is thus annotated as core for the class.