Evolution of Hybrid Distance Based kNN Classification

N. Suresh Kumar, Pothina Praveena


The evolution of classification of opinion mining and user review analysis span from decades reaching into ubiquitous computing in efforts such as movie review analysis. The performance of Linear and Non-Linear models are discussed to classify the positive and Negative reviews of Movie data sets. The effectiveness of Linear and Non-Linear algorithms are tested and compared in-terms of average accuracy. The performance of various algorithms is tested by implementing them on Internet Movie Data base (IMDB). The hybrid kNN model optimizes the performance classification interns of accuracy. The accuracy of polarity prediction rate is improved with Random-distance-Weighted-kNN-ABC when compared with kNN algorithm applied alone.


Classification; Opinion mining; K Nearest Neighbour; Artificial Bee Colony; Distance Weighted


Y. Narasimha Rao et al., Mimicked Web Page Detection over Internet , Vol 5 No1, IJECCE, 2014.

Padmavathi J et al., Effectiveness of Support Vector Machines in Medical Data mining. JCOMSS, Vol 11 no 1, Mar 2015, pp 25-30

Narra S et al., Integrating and Organisation of Multidimensional Virtual Citizen Database wi

th Extinction and Limited Access. IJCA, Vol 85. No2, Jan 2014.


Alexander Scheidler et al.., Learning classifier systems to evolve classification rules for systems of memory constrained components. Springer Evolutionary IntelligenceVolume 4, Issue 3, pp 127–143, 2011.

Harish G. Ramaswamy et al., Consistent algorithms for multiclass classification with an abstain option , Electronic Journal of Statistics, Vol. 12 (2018) 530–554.

Auer, P et al., Algorithmic Learning Theory. Theoretical computer science. 650, 18 Okt 2016 S. 1-3

M. Schmidt et al., Minimizing finite sums with the stochastic average gradient. Cornell University Library, May 2016.

Vanashri et al., “Logistic Regression: Aggregating Reviews by User Preference Modeling”, International Journal of Innovative Research in Computer and Communication Engineering Vol. 3, Issue 8, August 2015

Andrew L Maas, et al., “Learning word vectors for sentiment analysis”, In Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies-Volume 1, 2011, pages 142–150. Association for Computational Linguistics.

JuweiLu et al., Regularization studies of linear discriminant analysis in small sample size scenarios with application to face recognition. Pattern Recognition Letters, Vol 26, Issue 2, 15 January 2005, Pp 181-191.

Sania et al., “Opinion Mining on Twitter Data of Movie Reviews using R”, IOSR Journal of Computer Engineering (IOSR-JCE) Volume 19, Issue 4, Ver. IV. (Jul.-Aug. 2017)

Adebayo et al., “Machine Learning Approach to Sentiment Analysis of Users Movie Reviews”, 2nd International Conference on Information and Communication Technology and Its Applications (ICTA 2018) Federal University of Technology, Minna

Palak Baid et al “Sentiment Analysis of Movie Reviews using Machine Learning Techniques”, International Journal of Computer Applications, Volume 179 – No.7, December 2017

H. Zang, The optimality of Naïve-Bayes. proc. FLAIRS, 2004.

Pablo Gamallo et al., Citius: A Naive-Bayes Strategy for Sentiment Analysis on English Tweets. 8th InternationalWorkshop on Semantic Evaluation (SemEval 2014), Dublin, Ireland,Aug 23-24 2014, pp 171-175.

V. N. Vapnik, The Natural of Statistical Learning Theory, Springer, New York, NY, USA, 1995.

V. N. Vapnik, Statistical Learning Theory, Wiley, New York, NY, USA, 1998.

Liu, S., Li, F., Li, F., Cheng, X., &Shen, H.. Adaptive co-training SVM for sentiment classification on tweets. In Proceedings of the 22nd ACM International conference on Conference on information & knowledge management (pp. 2079-2088). ACM,2013.

Dudani, S. A, “The distance weighted k-nearest-neighbor rule”, IEEE Transactions on Systems, Man, and Cybernetics, vol 6, 1976, pp 325–327.

H. Yigit, “ABC-based distance-weighted kNN algorithm,” J. Exp. Theor. Artif. Intell., vol. 27, no. 2, pp. 189–198, Mar. 2015

A. Moosavian et al., Comparison of two classifiers; K-nearest neighbour and artificial neural network, for fault diagnosis on a main engine journal-bearing. Shock and Vibration 20 (2013) 263–272.

Hamming, R. W. (April 1950). "Error detecting and error correcting codes". The Bell System Technical Journal. 29 (2): 147–160.

Pang, B.and Lee, L. “A sentimental education: Sentiment analysis using subjectivity summarization based on minimum cuts”. 42nd Meeting of the Association for Computational Linguistics[C] (ACL-04). 2004, 271-278.

Vishal A.K et al., “Sentiment Analysis of Twitter Data: A Survey of Techniques”, International Journal of Computer Applications, Volume 139 – No.11, April 2016

Abedini M, Kirley M (2009) Coxcs: a coevolutionary learning classifier based on feature space partitioning. In: AI 2009: advances in artificial intelligence, vol 5866 of LNCS. Springer, Berlin, pp 360–369.

Gershoff M, Schulenburg S (2007) Collective behavior based

hierarchical xcs. In: GECCO ‘07: proceedings of the 2007 GECCO conference companion on genetic and evolutionary computation. ACM, New York, pp 2695–2700

Richter U, Prothmann H, Schmeck H (2008) Improving XCS performance by distribution. In: Proceedings of the 7th international conference on simulated evolution and learning (SEAL2008), vol 5361 of LNCS. Springer, Berlin, pp 111–120.

Zhu F, Guan S-U (2008) Cooperative co-evolution of GA-based classifiers based on input decomposition. Eng Appl Artif Intell 21(8):1360–1369.

KC, Santosh. Editor, Document Processing using Machine Learning Techniques. CRC Press (Taylor & Francis Group), 2018.

Dervis K, An idea based on honey bee swarm for numerical optimization. Techinical Report-TR06, Erciyes University, Engineering Faculty Computer Engineering Department Oct, 2005.

W. F. Gao, S. Y. Liu, L. L. Huang, A Novel Artificial Bee Colony Algorithm Based on Modified Search Equation and Orthogonal Learning , IEEE Transactions on Cybernetics, vol. 43, no. 3, pp. 1011-1024, 2013.

Yan Wang et al., An Improved Artificial Bee Colony (ABC) Algorithm with Advanced Search Ability”q, 8th International Conference on Electronics Information and Emergency Communication (ICEIEC), IEEE Xplore, Oct 2018

DOI: http://doi.org/10.11591/ijai.v10.i3.pp%25p


  • There are currently no refbacks.

View IJAI Stats

Creative Commons License
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.