= Indexing and Searching Very Large Texts =

[[https://is.muni.cz/auth/predmet/fi/ia161|IA161]] [[en/AdvancedNlpCourse|Advanced NLP Course]], Course Guarantee: Aleš Horák

Prepared by: Miloš Jakubíček

== State of the Art ==

=== References ===

 1. RYCHLÝ, Pavel, et al. Korpusové manažery a~ jejich efektivní implementace. 2000.
 1. JAKUBÍCEK, Miloš; KILGARRIFF, Adam; RYCHLÝ, Pavel. Effective Corpus Virtualization. In: Challenges in the Management of Large Corpora (CMLC-2) Workshop Programme. p. 7.
 1. JAKUBICEK, Milos, et al. Fast Syntactic Searching in Very Large Corpora for Many Languages. In: PACLIC. 2010. p. 741-747.

== Practical Session ==

 1. (optionally) login to aurora
 1. write a program or script that will find all occurrences of a given word form including a small context (at least 5 preceding and succeeding words) in the [[htdocs:bigdata/bnc.vert.xz|vertical file]]
 1. the script will take two arguments: path to the vertical file and word to be searched [[br]]
 If you have logged to aurora, you may use fixed path to the vertical file as 
 {{{
/nlp/trac/research/htdocs/bigdata/bnc.vert
}}}
 without the need to copy it.
 1. submit the script into the IS vault