Semantically Equivalence

Background

  • This is the training phase of annotation task to ensure you fully understand the tasks.
  • If you pass the training, we will add you to the qualification list. Then You will be able to work on the main annotation project, where the reward will be double!.

Task Discription

  • You will be given 20 pairs of questions ("question 1" and "question 2").
  • Your job is to figure out if these two questions are equivalent and are asking the same thing:
    • Choose same if both questions would answered in the same way. For example,
      • Example 1:
        • Question 1: How do I lose weight fast?
        • Question 2: What is the best way to reduce weight fast?
      • Example 2:
        • Sentence 1: What are the best tips for outlining/planning a novel?
        • Sentence 2: How do I best outline my novel?
      • Example 3:
        • Sentence 1: Is it possible to choose your dreams?
        • Sentence 2: How can I manipulate my dreams?
    • Choose not same if answers to the two questions could differ in any substantial way. Examples:
      • Example 1:
        • Question 1: How is air traffic controlled?
        • Question 2: How do you become an air traffic controller?
      • Example 2:
        • Sentence 1: Who is your favorite Prison Break character?
        • Sentence 2: Who is the best looking actor in Prison Break?
      • Example 3:
        • Sentence 1: If you're 15 years old and have an IQ of 136 is that normal?
        • Sentence 2: What is the normal IQ of a 15 year old?
  • You do not have to worry about whether the writing style is maintained across the two prompts.
  • Thank you for your help!
  • If you have more questions, please refer to FAQ here.
  • Feel free to contact us via email boxinw2@illinois.edu if you have further questions.
    • For each text, you have 120 seconds to view the sentences, then unlimited time to make the decision.
    (Click to expand)

    Good luck!

    0/20

    The sentence pair will disappear after 120 seconds


    Question 1: ${adv_premise_0}
    Question 2: ${adv_hypothesis_0}

    The sentence pair will disappear after 300 seconds


    Question 1: ${adv_premise_0}
    Question 2: ${adv_hypothesis_0}

    The correct answer is: abc
    Your answer is: abc

    You are Correct!

    Sorry, it is not correct. Please read more carefully.

    The sentence pair will disappear after 120 seconds


    Question 1: ${adv_premise_1}
    Question 2: ${adv_hypothesis_1}

    The sentence pair will disappear after 300 seconds


    Question 1: ${adv_premise_1}
    Question 2: ${adv_hypothesis_1}

    The correct answer is: abc
    Your answer is: abc

    You are Correct!

    Sorry, it is not correct. Please read more carefully.

    The sentence pair will disappear after 120 seconds


    Question 1: ${adv_premise_2}
    Question 2: ${adv_hypothesis_2}

    The sentence pair will disappear after 300 seconds


    Question 1: ${adv_premise_2}
    Question 2: ${adv_hypothesis_2}

    The correct answer is: abc
    Your answer is: abc

    You are Correct!

    Sorry, it is not correct. Please read more carefully.

    The sentence pair will disappear after 120 seconds


    Question 1: ${adv_premise_3}
    Question 2: ${adv_hypothesis_3}

    The sentence pair will disappear after 300 seconds


    Question 1: ${adv_premise_3}
    Question 2: ${adv_hypothesis_3}

    The correct answer is: abc
    Your answer is: abc

    You are Correct!

    Sorry, it is not correct. Please read more carefully.

    The sentence pair will disappear after 120 seconds


    Question 1: ${adv_premise_4}
    Question 2: ${adv_hypothesis_4}

    The sentence pair will disappear after 300 seconds


    Question 1: ${adv_premise_4}
    Question 2: ${adv_hypothesis_4}

    The correct answer is: abc
    Your answer is: abc

    You are Correct!

    Sorry, it is not correct. Please read more carefully.

    The sentence pair will disappear after 120 seconds


    Question 1: ${adv_premise_5}
    Question 2: ${adv_hypothesis_5}

    The sentence pair will disappear after 300 seconds


    Question 1: ${adv_premise_5}
    Question 2: ${adv_hypothesis_5}

    The correct answer is: abc
    Your answer is: abc

    You are Correct!

    Sorry, it is not correct. Please read more carefully.

    The sentence pair will disappear after 120 seconds


    Question 1: ${adv_premise_6}
    Question 2: ${adv_hypothesis_6}

    The sentence pair will disappear after 300 seconds


    Question 1: ${adv_premise_6}
    Question 2: ${adv_hypothesis_6}

    The correct answer is: abc
    Your answer is: abc

    You are Correct!

    Sorry, it is not correct. Please read more carefully.

    The sentence pair will disappear after 120 seconds


    Question 1: ${adv_premise_7}
    Question 2: ${adv_hypothesis_7}

    The sentence pair will disappear after 300 seconds


    Question 1: ${adv_premise_7}
    Question 2: ${adv_hypothesis_7}

    The correct answer is: abc
    Your answer is: abc

    You are Correct!

    Sorry, it is not correct. Please read more carefully.

    The sentence pair will disappear after 120 seconds


    Question 1: ${adv_premise_8}
    Question 2: ${adv_hypothesis_8}

    The sentence pair will disappear after 300 seconds


    Question 1: ${adv_premise_8}
    Question 2: ${adv_hypothesis_8}

    The correct answer is: abc
    Your answer is: abc

    You are Correct!

    Sorry, it is not correct. Please read more carefully.

    The sentence pair will disappear after 120 seconds


    Question 1: ${adv_premise_9}
    Question 2: ${adv_hypothesis_9}

    The sentence pair will disappear after 300 seconds


    Question 1: ${adv_premise_9}
    Question 2: ${adv_hypothesis_9}

    The correct answer is: abc
    Your answer is: abc

    You are Correct!

    Sorry, it is not correct. Please read more carefully.

    The sentence pair will disappear after 120 seconds


    Question 1: ${adv_premise_10}
    Question 2: ${adv_hypothesis_10}

    The sentence pair will disappear after 300 seconds


    Question 1: ${adv_premise_10}
    Question 2: ${adv_hypothesis_10}

    The correct answer is: abc
    Your answer is: abc

    You are Correct!

    Sorry, it is not correct. Please read more carefully.

    The sentence pair will disappear after 120 seconds


    Question 1: ${adv_premise_11}
    Question 2: ${adv_hypothesis_11}

    The sentence pair will disappear after 300 seconds


    Question 1: ${adv_premise_11}
    Question 2: ${adv_hypothesis_11}

    The correct answer is: abc
    Your answer is: abc

    You are Correct!

    Sorry, it is not correct. Please read more carefully.

    The sentence pair will disappear after 120 seconds


    Question 1: ${adv_premise_12}
    Question 2: ${adv_hypothesis_12}

    The sentence pair will disappear after 300 seconds


    Question 1: ${adv_premise_12}
    Question 2: ${adv_hypothesis_12}

    The correct answer is: abc
    Your answer is: abc

    You are Correct!

    Sorry, it is not correct. Please read more carefully.

    The sentence pair will disappear after 120 seconds


    Question 1: ${adv_premise_13}
    Question 2: ${adv_hypothesis_13}

    The sentence pair will disappear after 300 seconds


    Question 1: ${adv_premise_13}
    Question 2: ${adv_hypothesis_13}

    The correct answer is: abc
    Your answer is: abc

    You are Correct!

    Sorry, it is not correct. Please read more carefully.

    The sentence pair will disappear after 120 seconds


    Question 1: ${adv_premise_14}
    Question 2: ${adv_hypothesis_14}

    The sentence pair will disappear after 300 seconds


    Question 1: ${adv_premise_14}
    Question 2: ${adv_hypothesis_14}

    The correct answer is: abc
    Your answer is: abc

    You are Correct!

    Sorry, it is not correct. Please read more carefully.

    The sentence pair will disappear after 120 seconds


    Question 1: ${adv_premise_15}
    Question 2: ${adv_hypothesis_15}

    The sentence pair will disappear after 300 seconds


    Question 1: ${adv_premise_15}
    Question 2: ${adv_hypothesis_15}

    The correct answer is: abc
    Your answer is: abc

    You are Correct!

    Sorry, it is not correct. Please read more carefully.

    The sentence pair will disappear after 120 seconds


    Question 1: ${adv_premise_16}
    Question 2: ${adv_hypothesis_16}

    The sentence pair will disappear after 300 seconds


    Question 1: ${adv_premise_16}
    Question 2: ${adv_hypothesis_16}

    The correct answer is: abc
    Your answer is: abc

    You are Correct!

    Sorry, it is not correct. Please read more carefully.

    The sentence pair will disappear after 120 seconds


    Question 1: ${adv_premise_17}
    Question 2: ${adv_hypothesis_17}

    The sentence pair will disappear after 300 seconds


    Question 1: ${adv_premise_17}
    Question 2: ${adv_hypothesis_17}

    The correct answer is: abc
    Your answer is: abc

    You are Correct!

    Sorry, it is not correct. Please read more carefully.

    The sentence pair will disappear after 120 seconds


    Question 1: ${adv_premise_18}
    Question 2: ${adv_hypothesis_18}

    The sentence pair will disappear after 300 seconds


    Question 1: ${adv_premise_18}
    Question 2: ${adv_hypothesis_18}

    The correct answer is: abc
    Your answer is: abc

    You are Correct!

    Sorry, it is not correct. Please read more carefully.

    The sentence pair will disappear after 120 seconds


    Question 1: ${adv_premise_19}
    Question 2: ${adv_hypothesis_19}

    The sentence pair will disappear after 300 seconds


    Question 1: ${adv_premise_19}
    Question 2: ${adv_hypothesis_19}

    The correct answer is: abc
    Your answer is: abc

    You are Correct!

    Sorry, it is not correct. Please read more carefully.


    When you are ready, click Start to start. Remember the sentence will only show up for 120 seconds.