Journal of Computational & Applied Research in Mechanical Engineering (JCARME)

Document Type : Review paper

Authors

¹ Department of Mechanical Engineering, De La Salle University (DLSU), Manila, Philippines

² Department of Manufacturing Engineering and Management, De La Salle University (DLSU), Manila, Philippines

³ Department of Electronics and Communications Engineering, De La Salle University (DLSU), Manila, Philippines

⁴ Department of Mathematics, Computer Science and Engineering, Liverpool Hope University (LHU), Liverpool, England

https://doi.org/10.22061/jcarme.2024.10567.2397

Abstract

Integrating robotic technologies into agricultural practices has witnessed significant strides, particularly in tomato harvesting. This review paper offers a comprehensive examination of robot arms' end effectors developed for the intricate task of harvesting tomatoes. Drawing insights from a diverse range of sources spanning Google Scholar, Scopus, IEEE Xplorer, and AnimoSearch, the study analyzes the trends, challenges, and future trajectories of employing robotic end effectors in the agricultural context. The investigation encompasses an in-depth exploration of various end-effector methodologies, including grippers, rotational mechanisms, scissor-type tools, and suction devices, elucidating their merits and prevalence in the current research literature. Focusing on the utilizations of end effectors in agricultural robotic harvesting systems, the review delves into fruit detachment methods, types of end tools designed explicitly for harvesting tomatoes, and the integration of sensors into end effectors for enhanced capabilities. The paper highlights the nuanced criteria involved in end effector design, emphasizing operational characteristics, technical features, and the need for adaptability to diverse fruit shapes. Furthermore, a detailed analysis of the challenges faced by end effectors in tomato harvesting is presented, with proposed solutions and recommendations for future research. The discussion extends to the future trends in this evolving field, envisioning advancements in sensing technology, artificial intelligence integration, adaptability, autonomy, and sustainability. In conclusion, the synthesis of technological innovation and agricultural expertise holds promise for reshaping tomato harvesting, paving the way for more sustainable, efficient, and cost-effective farming practices.

Graphical Abstract

Keywords

Main Subjects

Robotics

References

[1] B. Marcel, E. V. Henten, J. Billingsley, J. Reid and D. Mingcong, “IEEE robotics and automation society technical committee on agricultural robotics and automation”, IEEE Rob. Autom. Mag., Vol. 20, No. 2, pp. 20-24, (2013).

[2] A. Zahedi, A. M. Shafei and M. Shamsi, “Application of hybrid robotic systems in crop harvesting: kinematic and dynamic analysis”, Comput. Electron. Agric., Vol. 209, pp. 1-19, (2023).

[3] P. Yonghyun, S. Jaehwi, P. Jeonghyeon, J. Yuseung, J. Jongpyo and H. I. Son, “A novel end-effector for a fruit and vegetable harvesting robot: mechanism and field experiment’’, Precis. Agric., Vol. 24, No. 3, pp. 948-970, (2023).

[4] M. B. Lee, C. Kennelly, R. Watson and C. N. Hewitt, “Current global food production is sufficient to meet human nutritional needs in 2050 provided there is radical societal adaptation”, Elem. Sci. Anth., Vol. 6, No. 1, pp. 1-14, (2018).

[5] B. Aurélie, S. Apurba, B. M. Mvumi, N. Patrick, D. Hawi, M. G. Ferruzzi, L. K. Nyanga, M. Sarah and K. I. Tomlins, “Estimation of nutritional postharvest losses along food value chains: A case study of three key food security commodities in sub-Saharan Africa”, Food Secur., Vol. 14, No. 3, pp. 571-590, (2022).

[6] B. C. Wouter, E. J. V. Henten, J. Hemming and Y. Edan, “Harvesting robots for high‐value crops: State‐of‐the‐art review and challenges ahead”, J. Field Rob., Vol. 31, No. 6, pp. 888-911, (2014).

[7] M. H. M. Saad, H. N. Maisarah and M. R. Sarker, “State of the art of urban smart vertical farming automation system: Advanced topologies, issues and recommendations”, Electron., Vol. 10, No. 12, pp. 1-40, (2021).

[8] C. A. Morar, I. A. Doroftei, I. Doroftei, and M. G. Hagan, “Robotic applications on agricultural industry. A review”, IOP Conf. Ser.: Mater. Sci. Eng., Vol. 997, No. 1, pp. 1-15, (2020).

[9] K. Abdul, H. Saddam, A. Muhammad, C. Muhammad, J. Masud, S. R. Saleem and F. Umar, “Development Challenges of Fruit-Harvesting Robotic Arms: A Critical Review”, Agric. Eng., Vol. 5, No. 4, pp. 2216-2237, (2023).

[10] V. Eleni, V. N. Tsakalidou, K. Ioannis, G. Theodoros, P. Theodore and V. G. Kaburlasos, “An overview of end effectors in agricultural robotic harvesting systems”, Agric., Vol. 12, No. 8, pp. 1-35, (2022).

[11] I. Takeshi, F. Ryo, S. Masanori, F. Seiji and N. Fusaomi, “Tomato recognition for harvesting robots considering overlapping leaves and stems”, J. Rob. Mechatron., Vol. 33, No, 6, pp. 1274-1283, (2021).

[12] L. Ziyue, Y. Xianju and W. Chuyan, “A review on structural development and recognition–localization methods for end-effector of fruit–vegetable picking robots”, Int. J. Adv. Rob. Syst., Vol. 19, No. 3, pp. 1-29, (2022).

[13] B. Shivaji, “Deliberation on design strategies of automatic harvesting systems: A survey”, Rob., Vol. 4, No. 2, pp. 194-222, (2015).

[14] Y. Ting, L. Lin, Z. Fan, F. Jun, G. Jin, Z. Junxiong, L. Wei, Z. Chunlong and Z. Wenqiang, “Robust cherry tomatoes detection algorithm in greenhouse scene based on SSD”, Agric., Vol. 10, No. 5, pp. 1-14, (2020).

[15] F. Takuya, Y. Shinsuke and I. Kazuo “Tomato Growth State Map for the Automation of Monitoring and Harvesting”, J. Rob. Mechatron., Vol. 32, No. 6, pp. 1279-1291, (2020).

[16] S. Jeahwi, L. Sechang, S and H. I. Son, “A Review of End-effector for Fruit and Vegetable Harvesting Robot”, J. Korean. Rob. Soc., Vol. 15, No. 2, pp. 91-99, (2020).

[17] X. Xu, H. Jingjing, L. Ming, X. Yongwei and Z. Hongduo, “Parameter analysis and experiment of citrus stalk cutting for robot picking”, Eng. Agric., Vol. 41, No. 5, pp. 551-558, (2021).

[18] G. Rafael, J. Dennis and K. B. Walsh, “Evaluation of End Effectors for Robotic Harvesting of Mango Fruit”, Sustainability., Vol. 15, No. 8, pp. 1-18, (2023).

[19] Y. Takeshi, K. Takuya and F. Takanori, “Fruit recognition method for a harvesting robot with RGB-D cameras”, ROBOMECH J., Vol. 9, No. 1, pp. 1-10, (2022).

[20] R. Jiacheng, F. Jun, Z. Zhiqin, Y. Jinliang, T. Yuzhi, Y. Ting and W. Pengbo, “Development and Evaluation of a Watermelon-Harvesting Robot Prototype: Vision System and End-Effector”, Agron., Vol. 12, No. 11, pp. 1-17, (2022).

[21] F. Gualtiero, S. Marco, D. Gino, T. Kirsten, S. R. Bernd, F. Juergen, K. L. Terje, S. Guenther, R. Gunther, F. Joerg, N. H. Hans and V. Alexander, “Grasping devices and methods in automated production processes”, CIRP Ann., Vol. 63, No. 2, pp. 679-701, (2014).

[22] V. F. Tejada, M. F. Stoelen, K. Kusnierek, N. Heiberg and A. Korsaeth, “Proof-of-concept robot platform for exploring automated harvesting of sugar snap peas”, Precis. Agric., Vol. 18, No. 6, pp. 952-972, (2017).

[23] Z. Fu, C. Zijun, W. Yafei, B. Ruofei, C. Xingguang, F. Sanling, T. Mimi and Z. Yakun, “Research on flexible end-effectors with humanoid grasp function for small spherical fruit picking”, Agric., Vol. 13, No. 1, pp. 1-18, (2023).

[24] V. Eleni, T. Konstantinos, N. Alexandros, K. Theofanis, G.A. Papakostas, T. P Pachidis, M. Spyridon, K. Stefanos and V. G. Kaburlasos, “An autonomous grape-harvester robot: integrated system architecture”, Electron., Vol. 10, No. 9, pp. 1-22, (2021).

[25] X. Dongbo. C. Liang, L. Lichao, C. Liqing and W. Hai, “Actuators and sensors for application in agricultural robots: A review”, Mach., Vol. 10, No. 10, pp. 1-31, (2022).

[26] S. Yinggang, Z. Wei, L. Zhiwen, W. Yong, L. Li and C. Yongjie, “A “Global–Local” Visual Servo System for Picking Manipulators”, Sens., Vol. 20, No. 12, pp. 1-21, (2020).

[27] V. Eleni, V. N. Tsakalidou, K. Loannis, G. Theodoros, P. Theodore and V. G. Kaburlasos, “An overview of end effectors in agricultural robotic harvesting systems”, Agric., Vol. 12, No. 8, pp. 1-35, (2022).

[28] J. Wanteng, X. Huang, S. Wang and H. Xiongkui, “A Comprehensive Review of the Research of the “Eye–Brain–Hand” Harvesting System in Smart Agriculture”, Agron., Vol. 13, No. 9, pp. 1-49, (2023).

[29] Y. Weikang, L. Zhao, X. Luo, G. Junxian and L. Xiangjiang, “Perceptual soft end-effectors for future unmanned agriculture”, Sens., Vol. 23, No. 18, pp. 1-28, (2023).

[30] N. Eduardo, R. Fernández, D. Sepúlveda, M. Armada and G. D. S. Pablo, “Soft grippers for automatic crop harvesting: A review”, sens., Vol. 21, No. 8, pp. 1-27, (2021).

[31] M. Longtao, C. Gongpei, L. Yadong, C. Yongjie, F. Longsheng and Y. Gejima, “Design and simulation of an integrated end-effector for picking kiwifruit by robot”, Inf. Process. Agric., Vol. 7, No. 1, pp. 58-71, (2020).

[32] C. Shoue, P. Yaokun, Y. Hongyan, T. Xiaobo and C. Changyong, “Smart soft actuators and grippers enabled by self‐powered tribo‐skins”, Adv. Mater. Technol., Vol. 5, No. 4, pp. 1-10, (2020).

[33] D. Zhen, J. Yannick, Z. Liwei and Z. Jianwei, “Grasping force control of multi-fingered robotic hands through tactile sensing for object stabilization”, Sens., Vol. 20, No. 4, pp. 1-21, (2020).

[34] Z. Baohua, X. Yuanxin, Z. Jun, W. Kai and Z. Zhen, “Actuators and sensors for application in agricultural robots: A review”, Mach., Vol. 10, No. 10, pp. 1-31, (2022).

[35] D. A. Zhao, L. Jidong, L. Wei, Y, Zhang and Y. Chen, “Design and control of an apple harvesting robot” Biosyst. Eng., Vol. 110, No. 2, pp. 112-122, (2011).

[36] Z. Hongyu, K. Hanwen, W. Xing, A. Wesley, M. Y. Wang and C. Chao, “Branch interference sensing and handling by tactile enabled robotic apple harvesting”, Agron., Vol. 13, No. 2, pp. 1-16, (2023).

[37] B. C. Wouter, H. Jochen, B.A.J Tuijl, B. Ruud, W. Ehud and E. J. Henten, “Performance evaluation of a harvesting robot for sweet pepper”, J. Field Rob., Vol. 34, No. 6, pp. 1123-1139, (2017).

[38] L. Bongki, K. DongHwan, M. ByeongRo, H. JiHo and O. SeBu, “A vision servo system for automated harvest of sweet pepper in Korean greenhouse environment”, Appl. Sci., Vol. 9, No. 12, pp. 1-23, (2019).

[39] P. S. Girão, P. M. P. Ramos, P. Octavian and M. D. P. José, “Tactile sensors for robotic applications”, Meas., Vol. 46, No. 3, pp. 1257-1271, (2013).

[40] L. Wang, B. Zhao, J. Fan, X. Hu, S. Wei, Y. Li, Q. Zhou and C. Wei, “Development of a tomato harvesting robot used in greenhouse”, Int. J. Agric. Biol. Eng., Vol. 10, No. 4, pp. 140-149, (2017).

[41] F. Gualtiero, S. Marco, D. Gino, T. Kirsten, S. R. Bernd, F. Juergen, K. L. Terje, S. Guenther, R. Gunther, F. Joerg, N. H. Hans and V. Alexander, “Grasping devices and methods in automated production processes”, CIRP Ann., Vol. 63, No. 2, pp. 679-701, (2021).

[42] L. Wang. R. Gao, J. Váncza, J. Krüger, X. V. Wang, S. Makris and G. Chryssolouris, “Symbiotic human-robot collaborative assembly”, CIRP Ann., Vol. 68, No. 2, pp. 701-726, (2019).

[43] A. M. Dollar and R. D. Howe, “A robust compliant grasper via shape deposition manufacturing”, IEEE/ASME Trans. Mechatron., Vol. 11, No. 2, pp. 154-161, (2006).

[44] Z. JunJie, Y. ZiYang and L. KaiFeng, “Multi-sensor information fusion detection system for fire robot through back propagation neural network”, PLoS One., Vol. 15, No. 7, pp. 1-13, (2020).

[45] L. Deng, Y. Shen, G. Fan, X. He, Z. Li and Y. Yuan, “Design of a soft gripper with improved microfluidic tactile sensors for classification of deformable objects”, IEEE Rob. Autom. Lett., Vol. 7, No. 2, pp. 5607-5614, (2022).

[46] A. S. M. Rodriguez, H. Mohssen and P. Jamie, “Hybrid control strategy for force and precise end effector positioning of a twisted string actuator”, IEEE/ASME Trans. Mechatron., Vol. 26, No. 5, pp. 2791-2802, (2020).

[47] Y. R. Li, W. Y. Lien, Z. H. Huang and C. T. Chen, “Hybrid Visual Servo Control of a Robotic Manipulator for Cherry Tomato Harvesting”, Actuators., Vol. 12, No. 6, pp. 1-17, (2023).

[48] F. Qingchun, Z. Wei, F. Pengfei, Z. Chunfeng and W. Xiu, “Design and test of robotic harvesting system for cherry tomato”, Int. J. Agric. Biol. Eng., Vol. 11, No. 1, pp. 96-100, (2018).

[49] Y. Takeshi, F. Takanori and H. Takaomi, “Fast detection of tomato peduncle using point cloud with a harvesting robot”, J. Rob. Mechatron., Vol. 30, No. 2, pp. 180-186, (2018).

[50] W. Dong, D. Yongxiang, L. Jie and G. Dongbing, “Adaptive end‐effector pose control for tomato harvesting robots”, J. Field Rob., Vol. 40, No. 3, pp. 535-551, (2022).

[51] Y. Azamat, K. Koichi, Y. Yoshio, B. Zholdas, M. Zhassuzak and A. Yedilkhan, “Development of Continuum Robot Arm and Gripper for Harvesting Cherry Tomatoes”, Appl. Sci., Vol. 12, No. 14, pp. 1-22, (2022). [LinkRef]

[52] L. Wang, B. Zhao, J. Fan, X. Hu, S. Wei, Y. Li, Q. Zhuo and C. Wei, “Development of a tomato harvesting robot used in greenhouse”, Int. J. Agric. Biol. Eng., Vol. 10, No. 4, pp. 140-149, (2017).

[53] Y. Zhao, L. Gong, C. Liu and Y. Huang, “Dual-arm robot design and testing for harvesting tomato in greenhouse”, IFAC-Pap. Online., Vol. 49, No. 16, pp. 161-165, (2016).

[54] O. Yurni, D. Tresna, R. Pola and N. Muhammad, “Tomato harvesting arm robot manipulator; a pilot project”, J. Phys. Conf. Ser., Vol. 1500, No. 1, pp. 1-10, (2020).

[55] Y. Takeshi, O. Yuki, K. Takuya and F. Takanori, “Automated harvesting by a dual-arm fruit harvesting robot”, ROBOMECH J., Vol. 9, No. 1, pp. 1-14, (2022).

[56] F. Spyros, M. Nikos, M. Loannis, R. Efthymios, H. Santos and P. E. Christoph, “Agricultural robotics for field operations”, Sens., Vol. 20, No. 9, pp. 1-27, (2020).

[57] C. F. L. Matheus, K. Anne, V. Constantino, B. Antonio, D. C. Jaime and R. G. JuanJesús, “Monitoring plant status and fertilization strategy through multispectral images”, Sens., Vol. 20, No. 2, pp. 1-21, (2020).

[58] K. Farzad, R. Giovanni, Y. Ilkay, S. Amir, N. Sajjad, F. A. Anka, E. Fahri, Z. Metin, L. Stefania and M. Anselme, “A smart and mechanized agricultural application: From cultivation to harvest”, Appl. Sci., Vol. 12, No. 12, pp. 1-22, (2022).

[59] Z. Linlu, H. Mingzheng, L. Jiuqin, L. Pingzeng, L. Tianhua and S. Fei, “Design and Experiment of Nondestructive Post-Harvest Device for Tomatoes.” Agric., Vol. 12, No. 8, pp. 1-19, (2022).

[60] Y. Ke, Z. Liyun, Z. Yanling, Y. Qian, L. Xiaohong and K. Sujatha, “Design of a workstation based on a human-interfacing robot for occupational health and safety”, Work 68., Vol. 68, No.3, pp. 863-870, (2021).

[61] Z. Hongyu, W. Xing, A. Wesley, K. Hanwen and C. Chao, “Intelligent robots for fruit harvesting: Recent developments and future challenges”, Precis. Agric., Vol. 23, No. 5, pp. 1856-1907, (2022).

[62] S. Robert and H. Mark “Robots in agriculture: prospects, impacts, ethics, and policy”, Precis. Agric., Vol. 22, No 3, pp. 818-833, (2021).

[63] Z. Hongyu, W. Xing, A. Wesley, K. Hanwen and C. Chao, “Intelligent robots for fruit harvesting: Recent developments and future challenges”, Precis. Agric., Vol. 23, No. 5, pp. 1856-1907, (2022).

[64] Y. Weikang, Z. Lin, L. Xuan, G. Junxian and L. Xiangjiang, “Perceptual Soft End-Effectors for Future Unmanned Agriculture”, Sens., Vol. 23, No. 18, pp. 1-28, (2023).

[65] Z. Shuhe, H. Minglei, J. Xuexin, Z. Zebin, W. Xinhui and W. Wuxiong, “Study on Mechanical Properties of Tomatoes for the End-Effector Design of the Harvesting Robot”, Agric., Vol. 13, No. 12, pp. 1-18, (2023).

[66] K. Maria, L. Dimitrios, M. Chrysanthos, D. Christos and K. G. Arvanitis, “Bio-inspired robots and structures toward fostering the modernization of agriculture”, Biomimetics., Vol. 7, No. 2, pp. 1-31, (2022).

[67] J. Jing and T. Dacheng, “Empowering things with intelligence: a survey of the progress, challenges, and opportunities in artificial intelligence of things”, IEEE Internet Things J., Vol. 8, No. 10, pp. 7789-7817, (2021).

[68] D. Lexing, L. Tianyu, J. Ping, Q. Aolin, H. Yuchen, L. Yujie, Y. Mingqin and D. Xin, “Design and Testing of Bionic-Feature-Based 3D-Printed Flexible End-Effectors for Picking Horn Peppers”, Agron., Vol. 13, No. 9, pp. 1-20, (2023).

[69] Y. Weikang, Z. Lin, L. Xuan. G. Junxian and L. Xiangjiang, “Perceptual soft end-effectors for future unmanned agriculture”, Sens., Vol. 23, No. 18, pp. 1-28, (2023).

[70] B. Vasiliki, A. Zoe, V. Zisis and G. Antonios, “Sustainable crop protection via robotics and artificial intelligence solutions”, Mach., Vol. 11, No. 8, pp. 1-15, (2023).

Name *

Email Address *

Affiliation *

Comments *

Security Code *

CAPTCHA Image