Changes between Version 5 and Version 6 of AnnotationManual/CZSNLI


Ignore:
Timestamp:
Mar 1, 2024, 1:03:57 PM (3 months ago)
Author:
Zuzana Nevěřilová
Comment:

--

Legend:

Unmodified
Added
Removed
Modified
  • AnnotationManual/CZSNLI

    v5 v6  
    2222Next, support your selection by selecting the relevant part in the premise, hypothesis or both.
    2323
     24==== Select relevant part ====
     25
     26Click on the **relevant** button under the premise or hypothesis.
     27
     28Mark one or more words (the tool selects whole words and removes trailing spaces from the selection).
     29
     30In case of *neutral*, there is often some new information in the hypothesis. Mark this information with no relation to the premise.
     31
     32==== Create relation ====
     33
     34In case of *entailment*, mark the elements that are the same thing but are described with different words. In case of *contradiction*, mark the elements that are mutually exclusive (e.g., man-woman) in the premise and hypothesis. In case of *neutral*, there may be a more specific term (e.g., woman-human) or some independent term; the relation would be orange.
     35
     36[[Image(entailment1.png,width=50%)]]
     37
     38(It can happen, there are no such elements.)
     39
     40[[Image(entailment2.png,width=50%)]]
     41
     42Set up relation between the elements in premise and hypothesis. Click the relevant element in premise (1) and click the *Create relation* button a chain icon (2). Next, click the relevant part in the hypothesis (3).
     43
     44[[Image(entailment3.png,width=50%)]]
     45
     46Select the relation type: click on the Relations tab, select the relation by clicking the triple dot button. Next, click into the *Select labels* box and select a relation.
     47
     48In case of *entailment*, the relation would be green, i.e., generalization or similar. In case of *contradiction*, the relation would be red, i.e. exclusion.
     49
     50[[Image(entailment4.png,width=50%)]]
     51
     52
     53=== Submit ===
     54
    2455Finally, **Submit** your annotation.
    2556
    2657[[Image(annotation_submit.png,width=50%)]]
     58
     59=== Further information ===
    2760
    2861You can check the instructions by using the **Instructions** button on the top every time you need it.