Changes between Initial Version and Version 1 of en/MainTopics

May 12, 2014, 11:24:42 AM (8 years ago)



  • en/MainTopics

    v1 v1  
     1= What do we work on in the NLP Lab? = #What_do_we_work_on_in_the_NLP_Lab.3F
     2Try some of our language tools:
     3 * [ The Online Language Handbook]
     4 * [ CZ accent][[BR]]''for adding diacritics''
     5 * [ X-Plain][[BR]]''the Activity game with a computer''
     6 * [ Ajka][[BR]]''morphological analyzer''
     7 * [ Synt] and [ SET][[BR]]''syntactic analyzers''
     9The [ Natural Language Processing Centre] focuses on obtaining practical results in the field of information technologies and linguistics. Results of the projects are frequently published at various conferences, the NLP Centre also cooperates with similarly oriented institutes in Czech Republic and abroad, and offers students the possibility to participate in student exchange with partner universities abroad.
     11More detailed information follows below, grouped into chapters according to their topic:
     13|| [ Corpora] ||
     14|| [ Dictionaries] ||
     15|| [ Morphology] ||
     16|| [ Syntactic Analysis] ||
     17|| [ Semantics] ||
     20== Corpora == #Corpora
     21Corpus is a collection of text data in electronic form. As a significant source of linguistic data, corpora make it possible to investigate many frequency-related phenomena in language, and nowadays they are an indispensable tool in NLP. In addition to corpora containing general texts, corpora for specific purposes are also produced, such as annotated, domain-specific, spoken or error corpora.
     23Corpora are used for investigation and development of natural language grammars. They are further helpful when developing a grammar checker, choosing entries for a dictionary or as a data source for automatic text categorization based on machine learning. Parallel corpora comprise of identical texts in various languages. They are used especially in word sense disambiguation and machine translation.
     25Nowadays the main source of corpus texts is the World Wide Web. To obtain quality data on a larger scale, pre-processing tools for filtering undesired content need to be used: notably the '''jusText''' tool for removing boilerplate, the'''onion''' tool for removing duplicate text parts, or the '''chared''' utility for detecting text encoding. Very useful is also the popular '''gensim''' framework for extracting semantic topics from documents.
     27The NLP Centre has produced a complete set of tools for creating and managing corpora, the '''Corpus Architect'''. It can store and manage corpora containing 100+ billion word tokens.
     29''Related projects:''
     31 * [ Bonito]
     34 * [ Corpus Architect]
     37 * [ Word Sketch Engine]
     40 * [ CPA]
     43 * [ jusText]
     46 * [ onion]
     49 * [ chared]
     52 * [ Gensim]
     56([ back to the list of topics]) [[BR]]
     59== Dictionaries == #Dictionaries
     60Dictionaries have always been a fundamental part of every linguist's basic equipment. However, handling paper dictionaries is rather inconvenient. Therefore, one of the first projects of the NLP Centre was to digitize classic dictionaries of Czech and develop a set of advanced tools for processing lexicographic data, a so-called lexicographer's workbench. This term refers to a system that enables each expert user to easily access various linguistic resources and provides them with an application interface for searching and editing data.
     62One of our projects related to dictionaries is the development of '''the DEB platform''', offering all the above mentioned features, thanks to its client-server architecture. One of the client applications is the '''DEBDict''' dictionary viewer, which contains apart from digitized dictionaries also several encyclopediae, and an onomastic and phraseological dictionary. Applications for DEB are developed in the XUL language and are available as extensions for the Firefox web browser. 
     64''Related projects:''
     66 * [ DEB II]
     69   * [ DEBDict]
     72   * [ DEBVisDic]
     75 * [ Verbalex]
     78 * [ MetaTrans]
     81 * [ CPA]
     85([ back to the list of topics]) [[BR]]
     88== Morphology == #Morphology
     89Morphological analysis gives a basic insight into natural language by studying how to distinguish and generate grammatical forms of words arising through inflection (ie. declension and conjugation). This involves considering a set of tags describing the grammatical categories of the word form concerned, most notably, its base form (lemma) and paradigm. Automatic analysis of word forms in free text can be used for instance in grammar checker development, and can aid corpus tagging, or semi-automatic dictionary compiling.
     91The NLP Centre has produced a general morphological analyzer for Czech, '''ajka''', which covers vocabulary of over 6 million word forms. It further served as a base for a similar analyzer for Slovak, the '''fispell'''grammar-checker, the '''czaccent''' converter of ascii text to text with diacritics, and an interactive interface for the IM Jabber protocol.
     93''Related projects:''
     95 * [ Ajka]
     98 * [ Fajka (the analyzer with free data)]
     101 * [ CZ accent]
     105([ back to the list of topics]) [[BR]]
     108== Syntactic Analysis == #Syntactic_Analysis
     109The goal of syntactic analysis is to determine whether the text string on input is a sentence in the given (natural) language. If it is, the result of the analysis contains a description of the syntactic structure of the sentence, for example in the form of a derivation tree. Such formalizations are aimed at making computers "understand" grammar of natural languages. Syntactic analysis can be utilized for instance when developing a punctuation corrector, dialogue systems with a natural language interface, or as a building block in a machine translation system. Czech is a language exhibiting rich inflection and free word order and thus belongs to the languages that are very hard to analyze, as it requires more grammar rules than most other languages.
     111The NLP Centre is developing several syntactic analyzers. The '''synt''' syntactic analyzer is based on a handcraftedCzech meta-grammar enhanced by semantic actions and contextual constraints. '''SET''' is a popular lightweightsyntactic analyzer based on set of patterns. Both '''synt''' and '''SET''' perform syntactic analysis of Czech sentences with an accuracy close to 90%. For educational purposes we have a simple syntactic analyzer '''Zuzana'''.
     113''Related projects:''
     115 * [ Synt]
     118 * [ SET]
     121 * [ Zuzana]
     125([ back to the list of topics]) [[BR]]
     128== Semantics == #Semantics
     129Semantic and pragmatic analysis make up the most complex phase of language processing as they build up on results of all the above mentioned disciplines. The ultimate touchstone on this level is machine translation, which hasn't been implemented for Czech with satisfactory results yet.
     131One of the long-term projects of the NLP Centre is the use of'''Transparent Intensional Logic (TIL)''' as a semantic representation of knowledge and subsequently as a transfer language in automatic machine translation. At the current stage, it is realistic to process knowledge in a simpler form - considerably less complex tasks have been addressed, such as machine translation for a restricted domain (eg. official documents and weather reports), or semi-automatic machine translation between close languages. The resources exploited in these applications are corpora, semantic nets, and electronic dictionaries.
     133In the field of representation of meaning and knowledge we shall mention the notable contribution of NLP Centre members to the '''EuroWordNet''' and '''Balkanet''' projects, which were aimed at building a multilingual '''WordNet'''-like semantic net. 
     135''Related projects:''
     137 * [ DEBVisDic]
     140 * [ Logical Analysis of Czech Sentences in TIL]
     143 * [ Visual Browser]
     146 * [ Gensim]
     150''Animated demonstration of the Visual Browser:''
     152 * [ in GIF format (simplified)]
     156([ back to the list of topics]) [[BR]]
     158== Further information == #Further_information
     160 * [ List of selected NLPlab projects]
     163 * [ Currently offered thesis topics]
     166 * [ NLP lab homepage]