Open Access Open Access  Restricted Access Subscription or Fee Access

Robotic Apple Harvesting Using Computer Vision Based on Shape & Colour Analysis and Object Positioning

Devinder Jeet Sharma, Jaspreet Kaur

Abstract


In this paper, the new automatic apple harvesting algorithm is designed for harvesting the apple to overcome the labour shortage problem. The apple detection and positioning is the major issue in the automatic robotic systems for apple harvesting. The major hurdle in the fruit detection (apple detection in our case) is the overlapping fruits. The robots are not capable of detecting and separating the layered objects or objects placed over objects. This problem leads to the misdetection or no-detection of the objects. The new algorithm has been developed to address all of the above discussed issues. This algorithm has been developed using color and shape analysis, and has been designed for the object positioning in 2-D and 3-D space. The major objective of this algorithm is to eliminate the overlapping objects, calculating 2-D distances, 3-D distances, etc. The accuracy of the robotic arm movement is increased by using this algorithm. [1] The results have shown that the proposed algorithm is very effective and almost 94-95% accurate in detecting the ripen apples on the apple trees.

Keywords


2-D and 3-D Distances, Apple Harvesting, Automatic Robotic System, Colour and Shape Analysis, Robotic Arm Movement.

Full Text:

PDF

References


A Plebe, G Grasso, “Localization of spherical fruits for robotic harvesting” Machine Vision and Applications, 2001.

Alfatni, Meftah Salem M., Abdul Rashid Mohamed Shariff, Helmi Zulhaidi Mohd Shafri, Osama M. Ben Saaed, and Omar M. Eshanta, "Oil palm fruit bunch grading system using red, green and blue digital number", Journal of Applied Sciences, Vol. 8, no. 8: pp. 1444-1452, 2008.

AR Jimenez, R Ceres, JL Pons. “A vision system based on a laser rangefinder applied to robotic fruit harvesting” Machine Vision and Applications, Vol. 11, pp. 321-329, 2000.

Bama, B. Sathya, S. Mohana Valli, S. Raju, and V. Abhai Kumar, “Content based leaf image retrieval (CBLIR) using shape, color and texture features”, Indian Journal of Computer Science and Engineering, Vol. 2, no. 2: pp. 202-211, 2011.

D Margaritis, S Thrun, “Learning to locate an object in 3d space from a sequence of camera images”, IEEE International Conference on Machine Learning, 1998.

Eitz, Mathias, Ronald Richter, Tamy Boubekeur, Kristian Hildebrand, and Marc Alexa, "Sketch-based shape retrieval", ACM Trans. Graph. Vol. 31, no. 4: pp. 31, 2012.

Esehaghbeygi, A., M. Ardforoushan, S. A. H. Monajemi, and A. A. Masoumi, "Digital image processing for quality ranking of saffron peach." Int. Agro physics Vol. 24, no. 2: pp. 115-120, 2010.

Feng, Guo, Cao Qixin, and Nagata Masateru, "Fruit detachment and classification method for strawberry harvesting robot." International Journal of Advanced Robotic Systems Vol. 5, no. 1: pp. 41-48, 2008.

Ishak, W. I. W., and R. M. Hudzari, "Image based modeling for oil palm fruit maturity prediction." Journal of Food, Agriculture & Environment Vol. 8, no. 2: pp. 469-476, 2010.

Ismail, Wan Ishak Wan, and Mohd Hudzari Razali, "Hue optical properties to model oil palm fresh fruit bunches maturity index." In Proceedings of World Multi-Conference on Systemics, Cybernetics and Pattern Recognition, pp. 168-173. 2010.

Jiang, L., B. Zhu, X. Cheng, Y. Luo, and Y. Tao, "3 D Surface Reconstruction and Analysis in Automated Apple Stem-End/Calyx Identification." American Society of Agricultural and Biological Engineers, Vol. 52, no. 5: pp. 1775-1784, 2009.

JM Saez, F Escolano, “A global 3D map-building approach using stereo vision”, IEEE International Conference on Robotics and Automation. 2004.

Johan Baeten, Kevin Donne, Sven Boedrij, Wim Beckers and EricClaesen, "Autonomous Fruit Picking Machine: A Robotic Apple Harvester" 6th International Conference on Field and Service Robotics - FSR 2007, Chamonix : France, 2007.

June R. Ceres, F. L. Pons, A. R. Jimenez, F. M. Martin, and L. Calderon, “Design and implementation of an aided fruit-harvesting robot (Agribot) Industrial Robot” Volume 25, Number 5, pp. 337-346, 1998.

Kapach, Keren, Ehud Barnea, Rotem Mairon, Yael Edan, and Ohad Ben–Shahar, "Computer vision for fruit harvesting robots–state of the art and challenges ahead." International Journal of Computational Vision and Robotics Vol. 3, no. 1/2: pp. 4-34, 2012.

Keyvan Seyfi, MajidRashidi, “Classification of fruit shape in cantaloupe using the analysis of geometrical attributes”, World journal of agricultural sciences Vol. 3, no. 6: pp. 735-740, 2007.

King Hann Lim, Alpha Agape Gopalai, “Robotic Vision System Design for Black Pepper Harvesting”, IEEE, vol. 1, pp. 1-5, 2013.

MAGALI: “A Self-Propelled Robot to Pick Apples” American Society of Agricultural Engineers, Vol. 46, No. 3, pp.353-358.

Meenu Dadwal, V. K. Banga, “Color Image Segmentation for Fruit Ripeness Detection: A Review”, ICEECE, vol. 2, pp. 190-193, IEEE 2012.

N Kondo, Y Nishitsuji, PP Ling, KC Ting, “Visual feedback guided robotic cherry tomato harvesting” Transactions of the ASAE, 1996.

Panli HE, "Fruit Surface Defects Detection and Classification Based on Attention Model," Journal of Computational Information Systems Vol. 8, no. 10: pp. 4233-4240, 2012.

Patil, Jayamala K., and Raj Kumar, "Advances in image processing for detection of plant diseases." Journal of Advanced Bioinformatics Applications and Research Vol. 2, no. 2: pp. 135-141, 2011.

Peilin Li, Sang-heon Lee, Hung-Yao Hsu, "Review on fruit harvesting method for potential use of automatic fruit harvesting systems", sciverse science direct, Procedia Engineering, Vol. 23, pp. 351 – 366, 2011.

Pouladzadeh, Parisa, Gregorio Villalobos, Rana Almaghrabi, and Shervin Shirmohammadi, "A Novel SVM Based Food Recognition Method for Calorie Measurement Applications," In ICME Workshops, pp. 495-498. 2012.

Puchalski, Czesław, Józef Gorzelany, Grzegorz Zagula, and Gerald Brusewitz, "Image analysis for apple defect detection." Teka kom. Mot. Energ. Roln. – Ol Pan, Vol. 8: pp. 197-205, 2008.

R. Ceres, J.L. Pons, A.R. Jiménez, J.M. Martín and L. Calderón, " Design and implementation of an aided fruit-harvesting robot (Agribot)", Industrial Robot, Vol. 25 • Number 5, pp. 337–346, 1998.

Rabatel, A. Bourely, and F. Sevila, F. Juste, “Robotic Harvesting of citrus: A State of the art and development of French Spanish EUREKA project” Proceedings of the International conference on Harvest and Post harvest Technologies for Fresh Fruits and Vegetables, Guanajuanto, Mexico 1995.

Rashidi, Majid, and Keyvan Seyfi, "Classification of fruit shape in kiwifruit applying the analysis of outer dimensions." International Journal of Agriculture and Biology, Vol. 9, no. 5: pp. 759-762, 2007.

Venkatramanan Jayaraman, “Three Dimensional Mapping of Citrus Fruits In The Canopy Using Computer Vision”, University of Florida, 2010.

Wei Ji , Dean Zhao, Fengyi Cheng, Bo Xu, Ying Zhang, Jinjing Wang, " Automatic recognition vision system guided for apple harvesting robot", journal of Computers and Electrical Engineering, Vol. 38, pp. 1186–1195, 2012.


Refbacks

  • There are currently no refbacks.


Creative Commons License
This work is licensed under a Creative Commons Attribution 3.0 License.