Zamin, N. and Oxley, A. and Bakar, Z.A. and Farhan, S.A. (2012) A lazy man�s way to part-of-speech tagging. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), 7457 L. pp. 106-117. ISSN 03029743
Full text not available from this repository.Abstract
A statistical-based approach to word alignment involving automatically projecting part-of-speech (POS) tags is presented. The approach is referred to as the �lazy man�s way� because it improves POS assignment for a resource-poor language by exploiting its similarity to a resource-rich one. This unsupervised learning method combines the N-gram and Dice Coefficient similarity functions in order to align English texts with Malay texts thus projecting the POS tags from English to Malay. It is a quick method that does not require the laborious effort needed to annotate the Malay dataset. A case study, an experiment done on 25 terrorism news articles written in Malay, has shown that leveraging pre-existing resources from a resource-rich language, i.e. English, to supplement a resource-poor language, i.e. Malay, is feasible and avoids building new text-processing tools from scratch. The system was tested on the Malay corpus, consisting of 5413 word tokens. The results reached values of 86.87 for precision, 72.56 for recall and 79.07 for F1-Score. This shows that the �lazy man�s way�, where a resource-poor language just exploits the rich linguistic information available in English, increases bitext projection accuracy significantly. © Springer-Verlag Berlin Heidelberg 2012.
Item Type: | Article |
---|---|
Additional Information: | cited By 4; Conference of 12th International Workshop on Knowledge Management and Acquisition for Intelligent Systems, PKAW 2012, held in conjunction with 12th Pacific Rim International Conference on Artificial Intelligence, PRICAI 2012 ; Conference Date: 5 September 2012 Through 6 September 2012; Conference Code:194509 |
Uncontrolled Keywords: | Intelligent systems; Knowledge management; Mergers and acquisitions; Natural resources; Text processing; Unsupervised learning, Dice coefficient; Linguistic information; Part of speech tagging; Part-of-speech tags; Resource-Rich; Similarity functions; Unsupervised learning method; Word alignment, Computational linguistics |
Depositing User: | Mr Ahmad Suhairi UTP |
Date Deposited: | 09 Nov 2023 15:51 |
Last Modified: | 09 Nov 2023 15:51 |
URI: | https://khub.utp.edu.my/scholars/id/eprint/3124 |