Changes between Version 8 and Version 9 of AnnotationManual/CZSNLI

Timestamp:

Mar 1, 2024, 1:15:19 PM (3 months ago)

Author:

Zuzana Nevěřilová

Comment:

--

AnnotationManual/CZSNLI

@@ -1 +1 @@
 = Natural Language Inference =
 == Annotation manual ==
-[[Image(annotation.png,width=50%,right)]]
+[[Image(annotation.png,width=50%)]]
+
+The following sentences are descriptions of photographs. You cannot see the photos, however, you can imagine their content.
 
 The aim is to decide for each pair of sentences (premise, hypothesis) if:
@@ -9 +11 @@
  * the hypothesis cannot follow from the premise (**contradiction**)
 
- * the hypothesis neither follow nor does not follow from the premise (**neutral**)
+ * the hypothesis neither follows nor does not follow from the premise (**neutral**)
 
  * one or both sentences from the pair do not make sense (**bad translation**)
@@ -17 +19 @@
 === How to annotate one sample ===
 
-Read the premise and hypothesis and decide whether they make sense. If not, select bad translation and continue.
+Read the premise and hypothesis and decide whether they make sense. If not, select bad translation and continue. You can check your understanding by revealing the **original texts**.
+
 If the sentences make sense, decide whether the relation between them is entailment, contradiction, or neutral.
 
-Next, support your selection by selecting the relevant part in the premise, hypothesis or both.
+Please assume the hypothesis and premise are connected. E.g., if the premise says something about a man, and the hypothesis mentions a human, assume they are the same entity in the picture.
+
+Also, use common sense when judging the impossibility of following. E.g., if the premise says a man rides a bicycle, and the hypothesis says the man is washing his hands, annotate it as false, even though you can imagine someone washing his hands while riding a bike.
+
+Next, support your selection by selecting the relevant part in the premise, hypothesis, or both.
 
 ==== Select relevant part ====