Binary Image Segmentation Using Classification Methods: Support Vector Machines, Artificial Neural Networks and Kth Nearest Neighbours
Keywords:
Image Segmentation, Binary Classification, SVM, ANN, K-NN, Decision Making.Abstract
The principal objective of this work is to demonstrate efficient parameter selection for various networks used in binary image segmentation. The Support Vector Machines using four kernel functions (i.e., Radial Basis Function, Quadratic, Polynomial, and Linear), Neural Networks (i.e., Feed-forward Back-propagation) and Kth Nearest Neighbours algorithm were applied to five different datasets that had been generated from a given image. Pixel coordinates (x,y) were considered as inputs. Grid search and cross-validation were performed to identify the optimal network parameters. All experiments were repeated five times in order to develop confidence in the obtained results. High accuracy was achieved in most cases 95% for SVM-RBF, 90.4% for SVM-Quadratic, 90.8% for SVM-Polynomial, 60% for SVM-Linear, 88% for Neural Networks and 97% for K-NN. After grid search for SVM-RBF, the accuracy reached 98%. In this project, SVM-RBF showed a high level of accuracy and consistency. It was also found that the selected features (pixel coordinates) were discriminative.
References
Rafael C. Gonzalez, Richard E. Woods, Digital Image Processing, New Jersey: Pearson Prentice Hall, 2008.
Richard O. Duda, Peter E. Hart, David G. Stork, Pattern Claissification, New York: John Wiley and Sons, Inc., 2001.
Milan Sonaka, Vaclav, Hlavac, Roger Boyle, Image Processing, Analysis, and Machine Vision, Toronto: Thomson, 2008.
Corinna Cortes, Vladimir Vapnik, "Support-Vector Networks," Machine Learnin, vol. 20, no. 1995, pp. 273-297, 1995.
Fletcher, Tristan, "Support Vector Machines Explained," University College London, London, 2009.
MathWorks, "Support Vector Machines (SVM)," The MathWorks, Inc., 1994-2013 . [Online]. Available: http://www.mathworks.com/help/bioinfo/ug/support-vector-machines-svm.html. [Accessed 13 01 2013].
S. S. Haykin, Neural networks and learning machines, New York: Prentice Hall, 2009.
B. Wilson, "The Machine Learning Dictionary," 1998 - 2012. [Online]. Available: http://www.cse.unsw.edu.au/~billw/mldict.html#neuralnet. [Accessed 13 01 2013].
Ferreira, Candida, "Designing Neual Networks Using Gene Expression Programming," Springer-Verlag, pp. 517-536, 2006.
Cheryl Grady , Saman Sarraf, Cristina Saverino, and Karen Campbell, "Age Differences in the Functional Interactions among the Default, Frontoparietal Control and Dorsal Attention Networks," Neurobiology of Aging , 2016.
Saman Sarraf, Cristina Saverino, Halleh Ghaderi, John Anderson, "Brain network extraction from probabilistic ICA using functional Magnetic Resonance Images and advanced template matching techniques," in Electrical and Computer Engineering (CCECE), 2014 IEEE 27th Canadian Conference, Toronto, 2014.
David Bremner, Erik Demaine, Jeff Erickson, Joh Iacono, Stefan Lagerman, Pat Morin, Godfried Toussain, "Output-Sensitive Algorithms for Computing Nearest-Neighbour Decision Boundaries," Springer-Verlag, pp. 451-461, 2003.
Saman Sarraf , Cristina Saverino, Ali Mohammad Golestani, "A Robust and Adaptive Decision-Making Algorithm for Detecting Brain Networks Using Functional MRI within the Spatial and Frequency Domain," in The IEEE International Conference on Biomedical and Health Informatics (BHI) , Las Vegas, 2016.
Saman Sarraf, Jian Sun, "ADVANCES IN FUNCTIONAL BRAIN IMAGING: A COMPREHENSIVE SURVEY FOR ENGINEERS AND PHYSICAL SCIENTISTS.," International Journal of Advanced Research, vol. 4, no. 8, pp. 640-660, 2016.
C. Staelin, "Parameter Selection For Support Vector Machines," HP Laboratories Israel, Haifa, 2003.
Cristina Saverino, Zainab Fatima, Saman Sarraf, Anita Oder, Stephen C. Strother, and Cheryl L. Grady, "The Associative Memory Deficit in Aging Is Related to Reduced Selectivity of Brain Activity during Encoding.," Journal of cognitive neuroscience, 2016.
Yonas B. Dibike, Slavco Velickov, Dimitri Solomatine, "Support Vector Machines: Review and Applications in Civil Engineering," Proc. of the 2nd Joint Workshop on Application of AI in Civil Engineering, Cottbus, Germany, 2000.
DTREG, "SVM - Support Vector Machines," DTREG, [Online]. Available: http://www.dtreg.com/svm.htm. [Accessed 13 01 2013].
S. Haykin, Neural Networks, A Comprehensice Foundation, PEARSON, Prentice Hall, 1999.
Chih-Wei Hsu, Chih-Chung Chang, and Chih-Jen Lin,, "A Practical Guide to Support Vector Classification," Department of Computer Science, National Taiwan University, Taipei 106, Taiwan, 2010.
Stephen C. Strother, Saman Sarraf, Cheryl Grady, "A Hierarchy of Cognitive Brain Networks Revealed by Multivariate Performance Metrics," in Signals, Systems and Computers, 2014 48th Asilomar Conference, Asilomar , 2014.
Downloads
Published
How to Cite
Issue
Section
License
Authors who submit papers with this journal agree to the following terms.
