Changes between Version 5 and Version 6 of private/NlpInPracticeCourse/ParsingCzech

Timestamp:

Oct 26, 2015, 2:42:12 PM (9 years ago)

Author:

Ales Horak

Comment:

--

private/NlpInPracticeCourse/ParsingCzech

@@ -15 +15 @@
 == Practical Session ==
 
- 1. Go to http://ske.fi.muni.cz, login and create a shadow copy of the Czech Wikipedia corpus by clicking on "Create grammar development corpus".
+ 1. Go to http://ske.fi.muni.cz, login and create a shadow copy of the Czech Wikipedia corpus by clicking on "Create grammar development corpus" (if you do not have such link at the bottom of the main page, ask for it).
  1. Develop your own sketch grammar that will capture the following semantic relations in this corpus: hypernymy/hyponymy, meronymy/holonymy (hint: use {{{DUAL}}} directive), optionally you can develop more relations (e.g. "is-defined-as").
     Read related [https://www.sketchengine.co.uk/writing-sketch-grammars/ documentation]. Start with a couple of simple CQL queries that you pretest in the interface.
  1. You can iteratively expand the grammar, upload it into the system, have the system compute word sketches and review the results
- 1. When you are happy with the grammar, logon to the {{{alba.fi.muni.cz}}} server and use the {{{dumpws}}} command to export the content of the word sketch database:
-
-    {{{dumpws /corpora/ca/user_data/<YOUR_USERNAME_IN_SKETCH_ENGINE>/registry/<YOUR_CORPUS_ID>}}}
+ 1. When you are happy with the grammar, process the raw WordSketch data (output of `dumpws` command) of your corpus. The data can be obtained in two ways:
+  1. smaller data (up to 100,000 relations) can be downloaded from web: [[BR]]
+   `https://ske.fi.muni.cz/bonito/r.cgi/dumpws?corpname=user/<YOUR_USERNAME_IN_SKETCH_ENGINE>/gramdev_czechwiki` [[BR]]
+   e.g. [[BR]]
+   https://ske.fi.muni.cz/bonito/r.cgi/dumpws?corpname=user/novakjan/gramdev_czechwiki [[BR]]
+   [[BR]]
+   `gramdev_czechwiki` is the `<corpus_id>` of the Czech Wikipedia corpus.
+   Or, if you need more than 100,000 relations, you can use the other way
+  1. logon to the {{{alba.fi.muni.cz}}} server and use the {{{dumpws}}} command to export the content of the word sketch database: [[BR]]
+   {{{dumpws /corpora/ca/user_data/<YOUR_USERNAME_IN_SKETCH_ENGINE>/registry/gramdev_czechwiki}}}
  5. Process the output of {{{dumpws}}} with a simple Bash or Python script to select first 100 most salient headword-collocation pairs for each relation. Upload the resulting list into the IS vault.