Application of Computer Vision for Real-Time Detection of Fruit Color and Size in Fruit Sorter
Abstract
Computer vision aims to build a computer that can see like humans. Humans can immediately recognize and define an object after seeing and recording an object. This is different from computer visual systems, where camera recordings cannot be directly translated, defined, and recognized by computers, therefore digital image processing is needed first. In this study, computer vision technology was used to detect fruit based on color, size, and shape in real time. The fruit is placed on a conveyor belt, then the fruit object is captured by a webcam using object tracking. Computer vision algorithms and programs can detect fruit objects and recognize ripe and unripe fruits by converting RGB (Red, Green, Blue) colors into HSV (Hue, Saturation, Value) for the color segmentation process. After the detection process, a selector is placed at the end of the conveyor which is used to sort the fruit into 2 categories, namely ripe and unripe. In addition, this study also determines the size and shape of the fruit. From design, realization, and testing, it was found that the success rate of detecting ripe fruit was 97.33% and unripe fruit was 93.33%. To get maximum results, it needs to be supported by room lighting settings that are kept constant.
References
[2] T. S. Huang, “Computer Vision: Evolution and Promise,” 1996, doi: 10.5170/CERN-1996-008.21.
[3] R. Munir, “Pengantar Interpretasi dan Pengolahan Citra (Bagian 1) IF4073 Interpretasi dan Pengolahan Citra,” 2021.
[4] J. A. Fracarolli, F. F. Adimari Pavarin, W. Castro, and J. Blasco, “Computer vision applied to food and agricultural products,” Revista Ciencia Agronomica, vol. 51, no. 5, pp. 1–20, 2020, doi: 10.5935/1806-6690.20200087.
[5] W. Sriratana, N. Narknam, R. Apichitanon, and N. Tammarugwattana, “Application of webcam for inspection of rice grain quality by using image processing technique,” in International Conference on Control, Automation and Systems, IEEE Computer Society, Oct. 2020, pp. 1134–1139. doi: 10.23919/ICCAS50221.2020.9268316.
[6] D. Mehta, S. Sehgal, T. Choudhury, and T. Sarkar, “Fruit Quality Analysis using modern Computer Vision Methodologies,” Proceedings of the IEEE Madras Section International Conference 2021, MASCON 2021, 2021, doi: 10.1109/MASCON51689.2021.9563427.
[7] A. Bhargava and A. Bansal, “Fruits and vegetables quality evaluation using computer vision: A review,” Journal of King Saud University - Computer and Information Sciences, vol. 33, no. 3. King Saud bin Abdulaziz University, pp. 243–257, Mar. 01, 2021. doi: 10.1016/j.jksuci.2018.06.002.
[8] S. M. Iqbal, B. Sundaresan, and A. Gopal, “Development of fruit dropping mechanisms for sorting of fruits,” Proceedings - TIMA 2017: 9th International Conference on Trends in Industrial Measurement and Automation, Oct. 2017, doi: 10.1109/TIMA.2017.8064788.
[9] S. P. Walhekar, K. Rajendra Tungar, S. N. Thorat, R. N. Mundhe, and S. Devidas Gaikhe, “Fruit Sorting Machine,” International Journal of Advanced Research in Science, Communication and Technology (IJARSCT, vol. 2, no. 6, 2022, doi: 10.48175/568.
[10] A. Shaikh, A. Sayyed, and M. Shaikh, “Grading and Sorting of Fruits Based On Image Processing,” 2020.
[11] J. F. Bautista, C. D. Ocena, M. J. Cabreros, and S. P. L. Alagao, “Automated Sorter and Grading of Tomatoes using Image Analysis and Deep Learning Techniques,” in 2020 IEEE 12th International Conference on Humanoid, Nanotechnology, Information Technology, Communication and Control, Environment, and Management, HNICEM 2020, Institute of Electrical and Electronics Engineers Inc., Dec. 2020. doi: 10.1109/HNICEM51456.2020.9400055.
[12] “(PDF) Comparison of Multi-class Classification Algorithms on Early Diagnosis of Heart Diseases.” Accessed: Oct. 28, 2023. [Online]. Available: https://www.researchgate.net/publication/338950098_Comparison_of_Multi-class_Classification_Algorithms_on_Early_Diagnosis_of_Heart_Diseases
[13] L. Amatullah, I. Ein, and M. M. Santoni, Identifikasi Penyakit Daun Kentang Berdasarkan Fitur Tekstur dan Warna Dengan Menggunakan Metode K-Nearest Neighbor. 2021. [Online]. Available: https://www.kaggle.com/
[14] R. (Rahmadwati) Rahmadwati, “Sistem Diagnosis Kanker Servik Berdasarkan Karakteristik Morfologi,” EECCIS, vol. 7, no. 2, p. 61394, 2013, Accessed: Oct. 28, 2023. [Online]. Available: https://www.neliti.com/publications/61394/
[15] P. Srinivasan and V. Srinivasna, “A Comprehensive Diagnostic Tool for Skin Cancer Using a Multifaceted Computer Vision Approach,” 2020 7th International Conference on Soft Computing and Machine Intelligence, ISCMI 2020, pp. 213–217, Nov. 2020, doi: 10.1109/ISCMI51676.2020.9311557.
[16] C. N. Kumar, E. Nithin, C. Sai Krishna, and C. Bindhu Madhavi, “Real-Time Face Mask Detection using Computer Vision and Machine Learning,” Proceedings of the 2023 2nd International Conference on Electronics and Renewable Systems, ICEARS 2023, pp. 1532–1537, 2023, doi: 10.1109/ICEARS56392.2023.10085276.
[17] D. Firmanda and D. Pramadihanto, “Computer Vision Based Analysis for Cursor Control Using Object Tracking and Color Detection,” Proceedings - 2014 7th International Symposium on Computational Intelligence and Design, ISCID 2014, vol. 2, pp. 525–528, Apr. 2015, doi: 10.1109/ISCID.2014.277.
[18] S. Hernanto and I. S. Suwardi, “Webcam virtual keyboard,” Proceedings of the 2011 International Conference on Electrical Engineering and Informatics, ICEEI 2011, 2011, doi: 10.1109/ICEEI.2011.6021617.
[19] E. Rijanto, E. Adiwiguna, L. Rozaqi, A. P. Sadono, and M. H. Nugraha, “Experimental Performance Evaluation of Computer Vision for an Upper Limbs Rehabilitation Robot,” 2019 International Conference on Computer, Control, Informatics and its Applications: Emerging Trends in Big Data and Artificial Intelligence, IC3INA 2019, pp. 59–63, Oct. 2019, doi: 10.1109/IC3INA48034.2019.8949599.
[20] S. Siregar, I. Bin Ibrahim, M. I. Sani, and M. I. Sari, “Design of Computer Vision Based Ball Detection System on Wheeled Robot Soccer,” Proceedings - 2018 International Conference on Control, Electronics, Renewable Energy and Communications, ICCEREC 2018, pp. 46–49, Jul. 2018, doi: 10.1109/ICCEREC.2018.8711988.
[21] Z. Qin, Z. Gao, B. Wen, Y. Zhang, A. Wu, and Z. Wu, “Development of mobile robot system based on computer vision,” Proceedings - 2020 3rd World Conference on Mechanical Engineering and Intelligent Manufacturing, WCMEIM 2020, pp. 1–5, Dec. 2020, doi: 10.1109/WCMEIM52463.2020.00008.
[22] Y.-J. Zhang, “An Overview of Image and Video Segmentation in the Last 40 Years,” Advances in Image and Video Segmentation, pp. 1–16, Apr. 2011, doi: 10.4018/978-1-59140-753-9.CH001.
[23] N. Resfita, R. Kurnia, and Fitrilina, “The Application of Multilevel Colour Thresholding for Coffee Colour Detection in a Coffee Maker Prototype,” 2020.
[24] D. Khattab, H. M. Ebied, A. S. Hussein, and M. F. Tolba, “Color image segmentation based on different color space models using automatic GrabCut,” Scientific World Journal, vol. 2014, Aug. 2014, doi: 10.1155/2014/126025.
[25] N. Vandenbroucke, L. Macaire, and J. G. Postaire, “Color image segmentation by pixel classification in an adapted hybrid color space. Application to soccer image analysis,” Computer Vision and Image Understanding, vol. 90, no. 2, pp. 190–216, May 2003, doi: 10.1016/S1077-3142(03)00025-0.
[26] P. Objek Bergerak Berdasarkan Pendekatan Adaptive Threshold untuk Alpha Matting Menggunakan Metode K-Means Rofiq Harun, “Pelacakan Objek Bergerak Berdasarkan Pendekatan Adaptive Threshold untuk Alpha Matting Menggunakan Metode K-Means,” Jambura Journal of Electrical and Electronics Engineering, vol. 2, no. 1, pp. 1–7, Jan. 2020, doi: 10.37905/JJEEE.V2I1.4289.
Manuscript submission
Submission of a manuscript to the Journal of Applied Electrical Engineering (JAEE) implies that the work described has not been published before (except in the form of an abstract or as part of a published lecture, review or thesis); that it is not under consideration for publication elsewhere; that its publication has been approved by all co-authors, if any, as well as tacitly or explicitly by responsible authorities at the institution where the work was carried out.
The author warrants that his/her contribution is original and that he/she has full power to make this grant. The author signs for and accepts responsibility for releasing this material on behalf of any and all co-authors. The author affirms that the article contains no unfounded or unlawful statements and does not violate the rights of others. If copyrighted works are included, the author bears responsibility to obtain written permission from the copyright owners and to appropriately credit the sources.
The use of general descriptive names, trade names, trademarks, etc. in the publication, even if not specifically identified, does not imply that these names are not protected by the relavant laws and regulation.
Copyright Transfer Agreement
The Copyright Transfer Agreement must be signed and return to the publisher of JAEE before manuscript can be accepted for publication. The Transfer of copyright to JAEE becomes effective if and when the article is accepted for publication. if the submitted manuscript is not accepted by Journal, all rights will returned to the authors of the work.
All articles published in JAEE are protect by copyright, which cover the exclusive and unlimited rights to reproduce and distribute the article in any form of reproduction (printing, electronic media or any other form), as well as the translation rights for all languages and countries, for the full term (including extensions and renewals). No material published in the JAEE may be reproduced photographically or store on microfilm, in electronic databases, video disk, etc., without first obtaining written permission from the publisher.
Author's rights
The author may send or transmit individual copies of the final published version of his/her manuscripts any format, including the PDF, to colleagues upon their specific request provided no fee is charged, and further-provided that there is no systematic distribution of the manuscript, e.g. posting on a listserve, website or automatic delivery. However posting the article on a secure network, not accessible to the public, is permitted.
For other purposes, e.g. publication on his/her own website, the author must use the original author-created version of his/her article, i.e. the original submitted file prior to review. He/she may not use the publisher's PDF version. Furthermore, the author may only post his/her version provided acknowledgement is given to the original source of publication and a link (DOI) is inserted to the published article on the JAEE website. The link must be accompanied by the following text: 'The original publication is available at <insert website link here>'.
The author(s) retain all proprietary rights, other than copyright, such as patent and trademark rights to any process or procedure described in the article. The author(s) have the right to photocopy the article for their own personal use.
An author has the right to use (part of) his/her article in subsequent publication of the authors own works provided that written permission is obtained from the publisher and that proper acknowledgement is made to the original source of publication and the publisher. Any other use or reproduction in a collective work requires a fee and permission from the publisher.
The right to grant or refuse permission to third parties to republish part of the article or translations thereof. However, the publisher except at the direction of the contributor(s) will not refuse such permission.
Warrant
While the information in the JAEE is believed to be true and accurate at the date of its publication, neither the authors, the editors, nor the publisher can accept any legal responsibility for any errors or omissions that may be made. The publisher makes no warranty, express or implied, with respect to material contained herein.
