| | 1 | = Natural Language Inference = |
| | 2 | == Annotation manual == |
| | 3 | [[Image(ehr-image.png,width=35%,right)]] [[Image(bratann.png,width=20%,right)]] |
| | 4 | |
| | 5 | The aim is to decide for each pair of sentences (premise, hypothesis) if: |
| | 6 | |
| | 7 | * the hypothesis follows from the premise (**entailment**) |
| | 8 | |
| | 9 | * the hypothesis cannot follow from the premise (**contradiction**) |
| | 10 | |
| | 11 | * the hypothesis neither follow nor does not follow from the premise (**neutral**) |
| | 12 | |
| | 13 | * one or both sentences from the pair do not make sense (**bad translation**) |
| | 14 | |
| | 15 | The annotation is made via the tool [https://nlp.fi.muni.cz/projekty/labelstudio/projects LabelStudio]. You log into one of the packages using your NLP credentials. |
| | 16 | |
| | 17 | === How to annotate one sample === |
| | 18 | |
| | 19 | Read the premise and hypothesis and decide whether they make sense. If not, select bad translation and continue. |
| | 20 | If the sentences make sense, decide whether the relation between them is entailment, contradiction, or neutral. |
| | 21 | |
| | 22 | Next, support your selection by selecting the relevant part in the premise, hypothesis or both. |
| | 23 | |
| | 24 | |
| | 25 | |
| | 26 | |
