Changes between Version 5 and Version 6 of private/NlpInPracticeCourse/CorpusIndexing

Timestamp:

Nov 5, 2020, 11:33:18 AM (3 years ago)

Author:

Miloš Jakubíček

Comment:

--

private/NlpInPracticeCourse/CorpusIndexing

@@ -15 +15 @@
 == Practical Session ==
 
- 1. login to alba
- 1. inspect command-line tools that are part of manatee (rpm -ql manatee)
- 1. inspect index files of BNC using less, od, lsclex, dumpdrev, dumpdtext
- 1. inspect the Python API of Manatee using the provided overview
+Compare search through (A) plain text using grep, (B) an indexed corpus using Manatee, (C) a corpus indexed in an arbitrary SQL database
+Use vertical text for BNC available at aurora:/corpora/vert/bnc/bnc.vert.xz.
+
+Search for the phrase "test case", display context of 10 words before and after each occurrence of the search phrase.
+
+(A) plain
+
+Hint: use grep -C to display context
+
+(B)
+
+Corpus is already indexed on Manatee, try:
+
+time corpquery bnc '[word="test"] [word="case"]'
+
+(C)
+
+Use your favourite SQL database, on aurora you can use sqlite3.
+Hint how to import vertical text:
+
+https://stackoverflow.com/questions/26065872/how-to-import-a-tsv-file-with-sqlite3
+
+For (A), (B) and (C), submit the commands you used and how long the search took to evaluate.