Original title: Univerzální morfologická analýza s využitím reinforcement learning
Translated title: Universal Morphological Analysis using ReinforcementLearning
Authors: Cardenas Acosta, Ronald Ahmed ; Zeman, Daniel (advisor) ; Mareček, David (referee)
Document type: Master’s theses
Year: 2020
Language: eng
Abstract: The persistent efforts to make valuable annotated corpora in more diverse, morphologically rich languages has driven research in NLP into considering more explicit techniques to incorporate morphological information into the pipeline. Recent efforts have proposed combined strategies to bring together the transducer paradigm and neural architectures, although ingesting one character at a time in a context-agnostic setup. In this thesis, we introduce a technique inspired by the byte pair encoding (BPE) compression algorithm in order to obtain transducing actions that resemble word formations more faithfully. Then, we propose a neural transducer architecture that operates over these transducing actions, ingesting one word token at a time and effectively incorporating sentential context by encoding per- token action representations in a hierarchical fashion. We investigate the benefit of this word formation representations for the tasks of lemmatization and context-aware morphological tagging for a typologically diverse set of languages, including a low- resourced native language from Peru, Shipibo-Konibo. For lemmatization, we use exploration-based optimization under a reinforcement learning framework, and find that our approach benefits greatly languages that use less commonly studied morphological processes...
Keywords: morphological analysis; reinforcement learning; morfologická analýza; reinforcement learning

Institution: Charles University Faculties (theses) (web)
Document availability information: Available in the Charles University Digital Repository.
Original record: http://hdl.handle.net/20.500.11956/116656

Permalink: http://www.nusl.cz/ntk/nusl-410673


The record appears in these collections:
Universities and colleges > Public universities > Charles University > Charles University Faculties (theses)
Academic theses (ETDs) > Master’s theses