Changes between Version 20 and Version 21 of AnnotationManual/CZSNLI


Ignore:
Timestamp:
Mar 4, 2024, 10:07:12 AM (2 months ago)
Author:
Zuzana Nevěřilová
Comment:

--

Legend:

Unmodified
Added
Removed
Modified

  • AnnotationManual/CZSNLI

    v20 v21  
    1111 * the hypothesis **cannot follow** from the premise (**contradiction**)
    1212
    13  * the hypothesis **neither follows nor does not follow** from the premise (**neutral**)
     13 * the hypothesis **may or may not follow** from the premise (**neutral**)
    1414
    1515 * one or both sentences from the pair **do not make sense** (**bad translation**)
    … …  
    2323=== How to annotate one sample ===
    2424
    25 !LabelStudio limitation: Please **do not open** one labeling task in two tabs simultaneously.
     25!LabelStudio limitation: Do not simultaneously open one labeling task in two tabs.
    2626
    2727More details about the labeling process: https://labelstud.io/guide/labeling.html
    … …  
    4848[[Image(entailment1.png,width=50%,right)]]
    4949
    50 
    5150After deciding the sentence relationship, support your selection by selecting the relevant part in the premise, hypothesis, or both.
    5251
    … …  
    5554Mark one or more words (the tool selects whole words and removes trailing spaces from the selection).
    5655
    57 In case of **entailment**, mark the elements that are the same thing but are described with different words.
     56In the case of **entailment**, mark the elements that are the same thing but are described with different words.
    5857
    59 In case of **contradiction**, mark the elements that are mutually exclusive (e.g., man-woman) in the premise and hypothesis.
     58In the case of **contradiction**, mark the elements that are mutually exclusive (e.g., man-woman) in the premise and hypothesis.
    6059
    61 In case of **neutral**, there is often some new information in the hypothesis, for instance a more specific term (woman-human) or some independent term.
    62 
    63 It can happen that there are no such elements.
    64 
     60In the case of **neutral**, there is often some new information in the hypothesis, for instance, a more specific term (woman-human) or some independent term. In the neutral pair, the hypothesis may have one element with no relation to the premise.
    6561
    6662==== 4. Create a supporting relation ====
    … …  
    7672
    7773In the case of **entailment**, the relation would be green, i.e., generalization or similar. In the case of **contradiction**, the relation would be red, i.e., exclusion.
    78 In case of **neutral**, the relation would be orange.
     74In the case of **neutral**, the relation would be orange.
    7975
    8076It does not matter if you mark prepositional phrases (e.g., "v obýváku") or noun phrases (e.g., "obýváku").
    … …  
    132128**Hypothesis:** Je tam víc než jeden kůň.
    133129
    134 From the premise, it follows that there are more horses. Mark the relation as **entailment** and mark "Kůň vlevo" (the left horse) without any relation to the hypothesis.
     130From the premise, it follows that there are more horses. Mark the relation as **entailment** and connect "Kůň vlevo" (the left horse) and "víc než jeden kůň" (more than one horse) with the **generalization** relation.
    135131
    136132