Changes between Initial Version and Version 1 of en/AdvancedNlpCourse2018/ParsingCzech

Sep 12, 2019, 11:11:35 AM (3 years ago)
Ales Horak

copied from private/AdvancedNlpCourse/ParsingCzech


  • en/AdvancedNlpCourse2018/ParsingCzech

    v1 v1  
     1= Parsing of Czech: Between Rules and Stats =
     3[[|IA161]] [[en/AdvancedNlpCourse|Advanced NLP Course]], Course Guarantee: Aleš Horák
     5Prepared by: Miloš Jakubíček
     7== State of the Art ==
     9=== References ===
     11 1. PEI, Wenzhe; GE, Tao; CHANG, Baobao. An effective neural network model for graph-based dependency parsing. In: Proc. of ACL. 2015.
     12 1. CHOI, Jinho D.; TETREAULT, Joel; STENT, Amanda. It Depends: Dependency Parser Comparison Using A Web-based Evaluation Tool. In: Proc. of ACL. 2015.
     13 1. DURRETT, Greg; KLEIN, Dan. Neural CRF Parsing. In: Proc. of ACL. 2015.
     15== Practical Session ==
     17 1. Go to, login and create a shadow copy of the Czech Wikipedia corpus by clicking on [[Image(add.png,valign=middle,nolink,class=intext)]]''Create grammar development corpus'' (if you do not have such link at the bottom of the main page, ask for it).
     18 1. Develop your own sketch grammar that will capture the following semantic relations in this corpus: hypernymy/hyponymy, meronymy/holonymy (hint: use {{{DUAL}}} directive), optionally you can develop more relations (e.g. "is-defined-as").
     19    Read related [ documentation]. Start with a couple of simple CQL queries that you pretest in the interface.
     20 1. You can iteratively expand the grammar, upload it into the system, have the system compute word sketches and review the results
     21 1. When you are happy with the grammar, process the raw !WordSketch data (output of `dumpws` command) of your corpus. The data can be obtained in two ways:
     22  1. smaller data (up to 100,000 relations) can be downloaded from web: [[BR]]
     23   `<YOUR_USERNAME_IN_SKETCH_ENGINE>/gramdev_czechwiki` [[BR]]
     24   e.g. [[BR]]
     25 [[BR]]
     26   [[BR]]
     27   First, you have to be authenticated at
     28   `gramdev_czechwiki` is the ''corpus_id'' of the Czech Wikipedia corpus. [[BR]]
     29   Or, if you need more than 100,000 relations, you can use the other way
     30  1. logon to the {{{}}} server and use the {{{dumpws}}} command to export the content of the word sketch database: [[BR]]
     31   {{{dumpws /corpora/ca/user_data/<YOUR_USERNAME_IN_SKETCH_ENGINE>/registry/gramdev_czechwiki}}} [[BR]]
     32   For this you may need to ask for extra permission to registry directories.
     33 5. Process the output of {{{dumpws}}} with a simple Bash or Python script to select first 100 most salient headword-collocation pairs for each relation. Upload the resulting list into the IS vault.