Textual Entailment

Given a Context, a statement can be either
  • Correct (Context clearly supports Statement). e.g.,
    • Context: If you help the needy, God will reward you.
    • Statement: Giving money to a poor man has good consequences.
  • Incorrect (Context does not clearly support Statement), e.g.,:
    • Context: If you help the needy, God will reward you.
    • Statement: Giving money to a poor man has no consequences.

Background

  • This is the training phase of annotation task to ensure you fully understand the tasks.
  • If you pass the training, we will add you to the qualification list. Then You will be able to work on the main annotation project, where the reward will be double!.

Task Discription

  • You will be given a pair of text fragments ("Context" and "Statement").
  • Your job is to figure out, based on this correct Context (the first sentence, on top), if the Statement (the second sentence, on bottom) is also true:
    • You should mark "Correct", if any event or situation that can be described by the Context on top would also fit the Statement on the bottom. For example,
      • Example 1:
        • Context: If you help the needy, God will reward you.
        • Statement: Giving money to a poor man has good consequences.
      • Example 2:
        • Context: Russian cosmonaut Valery Polyakov set the record for the longest continuous amount of time spent in space, a staggering 438 days, between 1994 and 1995.
        • Statement: Russians hold record for longest stay in space.
    • You should mark "Incorrect", if the event or situation described with the Context on top does not clearly fit the Statement on the bottom. For example,
      • Example 1:
        • Context: If you help the needy, God will reward you.
        • Statement: Giving money to a poor man has no consequences.
      • Example 2:
        • Context: If you help the needy, God will reward you.
        • Statement: Giving money to a poor man will make you better person.
      • Example 3:
        • Context: Hours earlier, Yasser Arafat called for an end to attacks against Israeli civilians in the two weeks before Israeli elections.
        • Statement: Arafat condemned suicide bomb attacks inside Israel.
  • You do not have to worry about whether the writing style is maintained across the two prompts.
  • Thank you for your help!
  • If you have more questions, please refer to FAQ here.
  • Feel free to contact us via email boxinw2@illinois.edu if you have further questions.
For each text, you have 5 minutes to view the sentences, then unlimited time to make the decision.
(Click to expand)

0/20


When you are ready, click Start to start. Remember the sentence will only show up for 300 seconds.