Changes between Version 15 and Version 16 of private/NlpInPracticeCourse/NamedEntityRecognition

Timestamp:

Oct 9, 2017, 11:37:57 AM (7 years ago)

Author:

Ales Horak

Comment:

--

private/NlpInPracticeCourse/NamedEntityRecognition

@@ -48 +48 @@
 1. convert the train data to the Stanford NER format: 
 {{{
-python convert_cnec_stanford.py cnec2.0/data/xml/named_ent_train.xml > named_ent_train.tsv
+python convert_cnec_stanford.py cnec2.0/data/xml/named_ent_train.xml \
+  > named_ent_train.tsv
 }}}
 
@@ -55 +56 @@
 1. train the model using the default settings (cnec.prop), N.B. that the `convert_cnec_stanford.py` only recognizes PERSON, LOCATION and ORGANIZATION, you can extend the markup conversion later: 
 {{{
-java -cp stanford-ner.jar edu.stanford.nlp.ie.crf.CRFClassifier -prop cnec.prop
+java -cp stanford-ner.jar edu.stanford.nlp.ie.crf.CRFClassifier \
+  -prop cnec.prop
 }}}
 1. convert the test data to the Stanford NER format: 
  {{{
- python convert_cnec_stanford.py named_ent_dtest.xml > named_ent_dtest.tsv
+python convert_cnec_stanford.py named_ent_dtest.xml \
+  > named_ent_dtest.tsv
 }}}
 1. evaluate the model on `dtest`: 
 {{{
 java -cp stanford-ner.jar edu.stanford.nlp.ie.crf.CRFClassifier \
-  -loadClassifier cnec-3class-model.ser.gz -testFile named_ent_dtest.tsv
+  -loadClassifier cnec-3class-model.ser.gz \
+  -testFile named_ent_dtest.tsv
 }}}
 
@@ -80 +84 @@
  {{{
 java -cp stanford-ner.jar edu.stanford.nlp.ie.crf.CRFClassifier \
-   -loadClassifier cnec-3class-model.ser.gz -testFile named_ent_dtest_unknown.tsv
+  -loadClassifier cnec-3class-model.ser.gz \
+  -testFile named_ent_dtest_unknown.tsv
 }}}