Arısoy, EbruSaraçlar, Murat2019-03-072019-03-072018Arisoy, E. & Saraçlar, M. (2018). Language modeling for Turkish text and speech processing in Turkish Natural Language Processing. pp. 69-9297833199016339783319901657https://hdl.handle.net/20.500.11779/978http://dx.doi.org/10.1007/978-3-319-90165-7This chapter presents an overview of language modeling followed by a discussion of the challenges in Turkish language modeling. Sub-lexical units are commonly used to reduce the high out-of-vocabulary (OOV) rates of morphologically rich languages. These units are either obtained by morphological analysis or by unsupervised statistical techniques. For Turkish, the morphological analysis yields word segmentations both at the lexical and surface forms which can be used as sub-lexical language modeling units. Discriminative language models, which outperform generative models for various tasks, allow for easy integration of morphological and syntactic features into language modeling. The chapter provides a review of both generative and discriminative approaches for Turkish language modeling.eninfo:eu-repo/semantics/closedAccessLanguage modelingBook Part10.1007/978-3-319-90165-7N/AN/A9269