Enhancing the English natural language processing dictionary using natural language processing++

Abstract

Every natural language-based project requires the use of an English dictionary. But the current English dictionaries are not updated as the English language is constantly evolving. The English dictionary used for natural language processing (NLP) projects needs to be enhanced by adding more words and phrases. This helps in improving the accuracy of NLP applications such as machine translation, performance of text analysis, recognition, and part of speech (POS) tagging. Several approaches are proposed in this direction, this paper develops and demonstrates enhancement of the English dictionary using a more versatile and robust programming language known as NLP++, a plugin to distributed big data analytics platforms such as HPCC systems. The unique features of NLP++ language is the enabler for realization of the proposed approach. This paper also discusses key NLP techniques, dictionary refinements analysis using NLP and NLP++. The results show that the proposed approach using NLP++ has significantly improved the accuracy and comprehensiveness of the English dictionary.