Named entity recognition for nepali language

OM Singh, A Padia, A Joshi - 2019 IEEE 5th international …, 2019 - ieeexplore.ieee.org
2019 IEEE 5th international conference on collaboration and …, 2019ieeexplore.ieee.org
Named Entity Recognition (NER) has been studied for many languages like English,
German, Spanish, and others but virtually no studies have focused on the Nepali language.
One key reason is the lack of an appropriate, annotated dataset. In this paper, we describe a
Nepali NER dataset that we created. We discuss and compare the performance of various
machine learning models on this dataset. We also propose a novel NER scheme for Nepali
and show that this scheme, based on grapheme-level representations, outperforms …
Named Entity Recognition (NER) has been studied for many languages like English, German, Spanish, and others but virtually no studies have focused on the Nepali language. One key reason is the lack of an appropriate, annotated dataset. In this paper, we describe a Nepali NER dataset that we created. We discuss and compare the performance of various machine learning models on this dataset. We also propose a novel NER scheme for Nepali and show that this scheme, based on grapheme-level representations, outperforms character-level representations when combined with BiLSTM models. Our best models obtain an overall F1 score of 86.89, which is a significant improvement on previously reported performance in literature.
ieeexplore.ieee.org
以上显示的是最相近的搜索结果。 查看全部搜索结果