Action similarity test

Instructions

Dear participant,
first of all, we would like to thank you for your help with this evaluation campaign.
The sentences you are going to evaluate have been generated automatically, and we need to verify if their meaning is coherent with the video they have been associated to by an unsupervised algorithm.

Before to start the evaluation, we are going to briefly explain you what is the task about and how to proceed with the judgment.

We are taking into consideration discrete action concepts, as they are depicted by the videos we are proposing you. We are asking you to read a sentence and watch a video, and express your judgement about the similarity of the action described by the sentence and the one showed in the video.
In particular you should (1) imagine the action described by the sentence, (2) watch the proposed video, and (3) evaluate if it is the same action performed with (or applied to) a different object, or if it is a different action.

Example

Consider the following video-sentence pair:

The truck turns left at the traffic light

In this case the action described by the sentence is the same of the one depicted in the video, even though the involved objects are different (human vs. truck, wall vs. traffic light).
Conversely, if the sentence was Mary turns the key, the action would have been different from the one showed in the video.

This was an obvious example, just for training purposes: the following evaluations can appear complex, weird or even meaningless (that's why we need you!). Please judge anyway, any pair, following your perception and remember that there are no right or wrong answers. Have fun!

Let's go!

Your sex: Male Female

Your age:

Video	Sentence	Similarity
	Mary puts the sheet down	Does the sentence describe the same action performed with (or applied to) different object(s)? The action is the same The action is different

Video	Sentence	Similarity
	Mary combines the sugar and flour together	Does the sentence describe the same action performed with (or applied to) different object(s)? The action is the same The action is different

Video	Sentence	Similarity
	John removes the stain away	Does the sentence describe the same action performed with (or applied to) different object(s)? The action is the same The action is different

Video	Sentence	Similarity
	John drops the oil on the desk	Does the sentence describe the same action performed with (or applied to) different object(s)? The action is the same The action is different

Video	Sentence	Similarity
	John places the bowl on the brackets	Does the sentence describe the same action performed with (or applied to) different object(s)? The action is the same The action is different

Video	Sentence	Similarity
	John takes the child into the garage	Does the sentence describe the same action performed with (or applied to) different object(s)? The action is the same The action is different

Video	Sentence	Similarity
	John brings Mary the medication	Does the sentence describe the same action performed with (or applied to) different object(s)? The action is the same The action is different

Video	Sentence	Similarity
	Mary swivels the alternator	Does the sentence describe the same action performed with (or applied to) different object(s)? The action is the same The action is different

Video	Sentence	Similarity
	Mary mashes the banana down	Does the sentence describe the same action performed with (or applied to) different object(s)? The action is the same The action is different

Video	Sentence	Similarity
	Mary hits the ball with the book	Does the sentence describe the same action performed with (or applied to) different object(s)? The action is the same The action is different

Video	Sentence	Similarity
	Mary rotates her hips	Does the sentence describe the same action performed with (or applied to) different object(s)? The action is the same The action is different

Video	Sentence	Similarity
	John puts the foot into the hole	Does the sentence describe the same action performed with (or applied to) different object(s)? The action is the same The action is different

Video	Sentence	Similarity
	John captures the rabbit	Does the sentence describe the same action performed with (or applied to) different object(s)? The action is the same The action is different

Video	Sentence	Similarity
	Mary strikes the opponent with the book	Does the sentence describe the same action performed with (or applied to) different object(s)? The action is the same The action is different

Video	Sentence	Similarity
	Mary sets the board upright	Does the sentence describe the same action performed with (or applied to) different object(s)? The action is the same The action is different

Video	Sentence	Similarity
	Mary lengthens the leg along the ground	Does the sentence describe the same action performed with (or applied to) different object(s)? The action is the same The action is different

Video	Sentence	Similarity
	John brings the water into the garage	Does the sentence describe the same action performed with (or applied to) different object(s)? The action is the same The action is different

Video	Sentence	Similarity
	Mary blends the ingredient and cheese together	Does the sentence describe the same action performed with (or applied to) different object(s)? The action is the same The action is different

Video	Sentence	Similarity
	Mary blends the powder and flour together	Does the sentence describe the same action performed with (or applied to) different object(s)? The action is the same The action is different

Video	Sentence	Similarity
	John catches fire	Does the sentence describe the same action performed with (or applied to) different object(s)? The action is the same The action is different

Video	Sentence	Similarity
	John puts the sheet on the brackets	Does the sentence describe the same action performed with (or applied to) different object(s)? The action is the same The action is different

Video	Sentence	Similarity
	Mary sticks a head to the door	Does the sentence describe the same action performed with (or applied to) different object(s)? The action is the same The action is different

Video	Sentence	Similarity
	Mary places her finger near her head	Does the sentence describe the same action performed with (or applied to) different object(s)? The action is the same The action is different

Video	Sentence	Similarity
	Mary sticks a toothpick to the door	Does the sentence describe the same action performed with (or applied to) different object(s)? The action is the same The action is different

Video	Sentence	Similarity
	John puts the needle into the hole	Does the sentence describe the same action performed with (or applied to) different object(s)? The action is the same The action is different

Video	Sentence	Similarity
	Mary applies layer to her nails	Does the sentence describe the same action performed with (or applied to) different object(s)? The action is the same The action is different

Video	Sentence	Similarity
	Mary whips the cream	Does the sentence describe the same action performed with (or applied to) different object(s)? The action is the same The action is different

Video	Sentence	Similarity
	Mary wipes the dirt on the table	Does the sentence describe the same action performed with (or applied to) different object(s)? The action is the same The action is different

Video	Sentence	Similarity
	Mary stretches the arm along the ground	Does the sentence describe the same action performed with (or applied to) different object(s)? The action is the same The action is different

Video	Sentence	Similarity
	Mary combines the butter and cheese	Does the sentence describe the same action performed with (or applied to) different object(s)? The action is the same The action is different

Video	Sentence	Similarity
	Mary puts the foot upright	Does the sentence describe the same action performed with (or applied to) different object(s)? The action is the same The action is different

Video	Sentence	Similarity
	John pushes the needle into the hole	Does the sentence describe the same action performed with (or applied to) different object(s)? The action is the same The action is different

Video	Sentence	Similarity
	Mary puts her finger near her head	Does the sentence describe the same action performed with (or applied to) different object(s)? The action is the same The action is different

Video	Sentence	Similarity
	John moves the item away	Does the sentence describe the same action performed with (or applied to) different object(s)? The action is the same The action is different

Video	Sentence	Similarity
	Mary cleans her cage on the table	Does the sentence describe the same action performed with (or applied to) different object(s)? The action is the same The action is different

Video	Sentence	Similarity
	John removes the foot away	Does the sentence describe the same action performed with (or applied to) different object(s)? The action is the same The action is different

Video	Sentence	Similarity
	Mary spreads oil on her nails	Does the sentence describe the same action performed with (or applied to) different object(s)? The action is the same The action is different

Video	Sentence	Similarity
	John moves the cursor away	Does the sentence describe the same action performed with (or applied to) different object(s)? The action is the same The action is different

Video	Sentence	Similarity
	John puts the ice on the desk	Does the sentence describe the same action performed with (or applied to) different object(s)? The action is the same The action is different

Video	Sentence	Similarity
	John traps the moisture	Does the sentence describe the same action performed with (or applied to) different object(s)? The action is the same The action is different

Video	Sentence	Similarity
	Mary sticks a finger to the door	Does the sentence describe the same action performed with (or applied to) different object(s)? The action is the same The action is different

Video	Sentence	Similarity
	Mary crushes the bean down	Does the sentence describe the same action performed with (or applied to) different object(s)? The action is the same The action is different

Video	Sentence	Similarity
	Mary attaches a tape to the door	Does the sentence describe the same action performed with (or applied to) different object(s)? The action is the same The action is different

Video	Sentence	Similarity
	Mary unfolds the flap down	Does the sentence describe the same action performed with (or applied to) different object(s)? The action is the same The action is different

Video	Sentence	Similarity
	Mary beats the butter	Does the sentence describe the same action performed with (or applied to) different object(s)? The action is the same The action is different

Video	Sentence	Similarity
	John takes Mary the note	Does the sentence describe the same action performed with (or applied to) different object(s)? The action is the same The action is different

Video	Sentence	Similarity
	John traps the animal	Does the sentence describe the same action performed with (or applied to) different object(s)? The action is the same The action is different

Video	Sentence	Similarity
	John inserts the hook into the hole	Does the sentence describe the same action performed with (or applied to) different object(s)? The action is the same The action is different