Textual Entailment

Given a Context, a statement can be either
  • Definitely Correct (Context entails Statement), e.g.,:
    • Context: If you help the needy, God will reward you.
    • Statement: Giving money to a poor man has good consequences.
  • Definitely Incorrect (Context contradicts Statement), e.g.,:
    • Context: If you help the needy, God will reward you.
    • Statement: Giving money to a poor man has no consequences.
  • Neither (Context does not entail nor contradict Statement), e.g.,:
    • Context: If you help the needy, God will reward you.
    • Statement: Giving money to a poor man will make you better person.

Task Discription

  • This is the training phase of annotation task to ensure you fully understand the tasks.
  • If you pass the training, we will add you to the qualification list. Then You will be able to work on the main annotation project, where the reward will be double!.
  • You will be given 20 pairs of text fragments ("Context" and "Statement").
  • Your job is to figure out, based on this correct Context (the first prompt, on top), if the Statement (the second prompt, on bottom) is also correct.
    • You should mark Definitely Correct, if any event or situation that can be described by the Context on top would also fit the Statement on the bottom.
    • Example 1
      • Context: If you help the needy, God will reward you.
      • Statement: Giving money to a poor man has good consequences.
    • Example 2
      • Context: The legislation was widely hailed as a model for the country.
      • Statement: Many people thought the legislation was a model for the country.
    • You should mark Definitely Incorrect, if any event or situation that could possibly be described with the Context on top would not fit the Statement on the bottom.
    • Example 1
      • Context: If you help the needy, God will reward you.
      • Statement: Giving money to a poor man has no consequences.
    • Example 2
      • Context: The program has helped victims in 90 court cases, and 150 legal counseling sessions have been held there.
      • Statement: Victims from 90 grand jury court cases were helped by the program.
    • You should mark Neither, if the prompt on the bottom (Statement) could describe an event or situation that fit the first prompt (Context), but could also describe situations that don't fit the first prompt (Context).
    • Example 1
      • Context: If you help the needy, God will reward you.
      • Statement: Giving money to a poor man will make you better person.
    • Example 2
      • Context: As a result, Chris Schneider, executive director of Central California Legal Services, is building a lawsuit against Alpaugh Irrigation.
      • Statement: Central California Legal Services' executive director decided not to pursue a lawsuit against Alpaugh Irrigation.
  • You do not have to worry about whether the writing style is maintained across the two prompts.
  • Thank you for your help!
  • If you have more questions, please refer to FAQ here.
For each text, you have 5 minutes to view the sentences, then unlimited time to make the decision.
(Click to expand)

Good luck!

0/20

The sentence pair will disappear after 300 seconds


Context: ${adv_premise_0}
Statement: ${adv_hypothesis_0}

The sentence pair will disappear after 300 seconds


Context: ${adv_premise_0}
Statement: ${adv_hypothesis_0}

The correct answer is: abc
Your answer is: abc

You are Correct!

Sorry, it is not correct. Please check your answer and read it more carefully :)

The sentence pair will disappear after 300 seconds


Context: ${adv_premise_1}
Statement: ${adv_hypothesis_1}

The sentence pair will disappear after 300 seconds


Context: ${adv_premise_1}
Statement: ${adv_hypothesis_1}

The correct answer is: abc
Your answer is: abc

You are Correct!

Sorry, it is not correct. Please check your answer and read it more carefully :)

The sentence pair will disappear after 300 seconds


Context: ${adv_premise_2}
Statement: ${adv_hypothesis_2}

The sentence pair will disappear after 300 seconds


Context: ${adv_premise_2}
Statement: ${adv_hypothesis_2}

The correct answer is: abc
Your answer is: abc

You are Correct!

Sorry, it is not correct. Please check your answer and read it more carefully :)

The sentence pair will disappear after 300 seconds


Context: ${adv_premise_3}
Statement: ${adv_hypothesis_3}

The sentence pair will disappear after 300 seconds


Context: ${adv_premise_3}
Statement: ${adv_hypothesis_3}

The correct answer is: abc
Your answer is: abc

You are Correct!

Sorry, it is not correct. Please check your answer and read it more carefully :)

The sentence pair will disappear after 300 seconds


Context: ${adv_premise_4}
Statement: ${adv_hypothesis_4}

The sentence pair will disappear after 300 seconds


Context: ${adv_premise_4}
Statement: ${adv_hypothesis_4}

The correct answer is: abc
Your answer is: abc

You are Correct!

Sorry, it is not correct. Please check your answer and read it more carefully :)

The sentence pair will disappear after 300 seconds


Context: ${adv_premise_5}
Statement: ${adv_hypothesis_5}

The sentence pair will disappear after 300 seconds


Context: ${adv_premise_5}
Statement: ${adv_hypothesis_5}

The correct answer is: abc
Your answer is: abc

You are Correct!

Sorry, it is not correct. Please check your answer and read it more carefully :)

The sentence pair will disappear after 300 seconds


Context: ${adv_premise_6}
Statement: ${adv_hypothesis_6}

The sentence pair will disappear after 300 seconds


Context: ${adv_premise_6}
Statement: ${adv_hypothesis_6}

The correct answer is: abc
Your answer is: abc

You are Correct!

Sorry, it is not correct. Please check your answer and read it more carefully :)

The sentence pair will disappear after 300 seconds


Context: ${adv_premise_7}
Statement: ${adv_hypothesis_7}

The sentence pair will disappear after 300 seconds


Context: ${adv_premise_7}
Statement: ${adv_hypothesis_7}

The correct answer is: abc
Your answer is: abc

You are Correct!

Sorry, it is not correct. Please check your answer and read it more carefully :)

The sentence pair will disappear after 300 seconds


Context: ${adv_premise_8}
Statement: ${adv_hypothesis_8}

The sentence pair will disappear after 300 seconds


Context: ${adv_premise_8}
Statement: ${adv_hypothesis_8}

The correct answer is: abc
Your answer is: abc

You are Correct!

Sorry, it is not correct. Please check your answer and read it more carefully :)

The sentence pair will disappear after 300 seconds


Context: ${adv_premise_9}
Statement: ${adv_hypothesis_9}

The sentence pair will disappear after 300 seconds


Context: ${adv_premise_9}
Statement: ${adv_hypothesis_9}

The correct answer is: abc
Your answer is: abc

You are Correct!

Sorry, it is not correct. Please check your answer and read it more carefully :)

The sentence pair will disappear after 300 seconds


Context: ${adv_premise_10}
Statement: ${adv_hypothesis_10}

The sentence pair will disappear after 300 seconds


Context: ${adv_premise_10}
Statement: ${adv_hypothesis_10}

The correct answer is: abc
Your answer is: abc

You are Correct!

Sorry, it is not correct. Please check your answer and read it more carefully :)

The sentence pair will disappear after 300 seconds


Context: ${adv_premise_11}
Statement: ${adv_hypothesis_11}

The sentence pair will disappear after 300 seconds


Context: ${adv_premise_11}
Statement: ${adv_hypothesis_11}

The correct answer is: abc
Your answer is: abc

You are Correct!

Sorry, it is not correct. Please check your answer and read it more carefully :)

The sentence pair will disappear after 300 seconds


Context: ${adv_premise_12}
Statement: ${adv_hypothesis_12}

The sentence pair will disappear after 300 seconds


Context: ${adv_premise_12}
Statement: ${adv_hypothesis_12}

The correct answer is: abc
Your answer is: abc

You are Correct!

Sorry, it is not correct. Please check your answer and read it more carefully :)

The sentence pair will disappear after 300 seconds


Context: ${adv_premise_13}
Statement: ${adv_hypothesis_13}

The sentence pair will disappear after 300 seconds


Context: ${adv_premise_13}
Statement: ${adv_hypothesis_13}

The correct answer is: abc
Your answer is: abc

You are Correct!

Sorry, it is not correct. Please check your answer and read it more carefully :)

The sentence pair will disappear after 300 seconds


Context: ${adv_premise_14}
Statement: ${adv_hypothesis_14}

The sentence pair will disappear after 300 seconds


Context: ${adv_premise_14}
Statement: ${adv_hypothesis_14}

The correct answer is: abc
Your answer is: abc

You are Correct!

Sorry, it is not correct. Please check your answer and read it more carefully :)

The sentence pair will disappear after 300 seconds


Context: ${adv_premise_15}
Statement: ${adv_hypothesis_15}

The sentence pair will disappear after 300 seconds


Context: ${adv_premise_15}
Statement: ${adv_hypothesis_15}

The correct answer is: abc
Your answer is: abc

You are Correct!

Sorry, it is not correct. Please check your answer and read it more carefully :)

The sentence pair will disappear after 300 seconds


Context: ${adv_premise_16}
Statement: ${adv_hypothesis_16}

The sentence pair will disappear after 300 seconds


Context: ${adv_premise_16}
Statement: ${adv_hypothesis_16}

The correct answer is: abc
Your answer is: abc

You are Correct!

Sorry, it is not correct. Please check your answer and read it more carefully :)

The sentence pair will disappear after 300 seconds


Context: ${adv_premise_17}
Statement: ${adv_hypothesis_17}

The sentence pair will disappear after 300 seconds


Context: ${adv_premise_17}
Statement: ${adv_hypothesis_17}

The correct answer is: abc
Your answer is: abc

You are Correct!

Sorry, it is not correct. Please check your answer and read it more carefully :)

The sentence pair will disappear after 300 seconds


Context: ${adv_premise_18}
Statement: ${adv_hypothesis_18}

The sentence pair will disappear after 300 seconds


Context: ${adv_premise_18}
Statement: ${adv_hypothesis_18}

The correct answer is: abc
Your answer is: abc

You are Correct!

Sorry, it is not correct. Please check your answer and read it more carefully :)

The sentence pair will disappear after 300 seconds


Context: ${adv_premise_19}
Statement: ${adv_hypothesis_19}

The sentence pair will disappear after 300 seconds


Context: ${adv_premise_19}
Statement: ${adv_hypothesis_19}

The correct answer is: abc
Your answer is: abc

You are Correct!

Sorry, it is not correct. Please check your answer and read it more carefully :)


When you are ready, click Start to start. Remember the sentence will only show up for 300 seconds.