Tue, 03 December, 2024
With the conclusion of the SoftGrip project this past summer, the time has come to reflect on the trajectory, milestones, successes and impact this Horizon 2020 initiative has achieved – all of which would not have been possible without the contributions of the close-knit consortium of partners Scuola Superiore Sant'Anna (Italy), the Essex Innovation Centre (a University of Essex-TWI partnership) (UK), represented by TWI Hellas (Greece) on the project, Institute of Communication and Computer Systems (Greece), Teagasc (Ireland), and Mitsui Chemicals (Germany) – each of whom provided their respective expertise, experience and innovative ideas towards implementation of automation into the painstaking process of mushroom harvesting.
The challenging case of mushroom harvesting
The SoftGrip project was informed by research on mushroom cultivation and growth patterns undertaken by Teagasc, the input of materials experts from Mitsui Chemicals and the technological know-how of their fellow consortium partners, all of which contributed to the approach taken to addressing the complex issues faced by mushroom farmers and workers during harvesting. From the delicate nature of mushrooms and the difficult environmental conditions, such as humidity and the dim lighting harvesters are required to work under, through to market demand for more mushrooms and production matters hindering the delivery of larger amounts, the need for the development of soft robotic grippers seemed imperative. These grippers would be able to imitate human dexterity and pick up mushrooms without damaging or blemishing them.
SoftGrip project around the globe
To spread the SoftGrip word, the consortium members showcased their advancements at major events in multiple locations around the world, including ICRA 2024, ISMS 2024, Dutch Mushroom Days 2024, and MED 2023, highlighting the development of the project’s robotic innovations to the agricultural community. The consortium also participated in RoboSoft 2023, the 4th International Workshop on Agriculture Vision 2023, and AIM 2023, sharing results and innovations relevant to artificial intelligence (AI) and soft robotics. Last but not least, the ICRA 2022 and ERF 2021 events were among the project's first ones and deemed pivotal to its early beginnings.
The TWI Hellas machine vision contribution
TWI Hellas developed a machine vision system paired with the project’s robotic grippers to meticulously scan mushroom beds, map them out and assess readiness levels of the mushrooms to be harvested with high accuracy. Equipping the system with high-resolution cameras and advanced image-processing algorithms made analysis of the mushrooms’ size, shape, height and maturity possible in real-time, a process which could lead to the selective harvesting of mushrooms, a much-needed tool in ensuring that mushrooms are harvested at the peak of their ripeness. Moreover, AI models trained on extensive mushroom datasets allowed the robotic system to adapt to appearance variations for increased precision and efficiency.
Athanasios Mastrogeorgiou, the lead TWI Hellas Robotics Software Engineer for SoftGrip, stated that “The SoftGrip project presented an approach to cost-effective mushroom harvesting. At the heart of the system lies a state-of-the-art computer vision algorithm, enabling precise mushroom detection and pose estimation, even in noisy environments. This is achieved through the use of an actuated stereo vision system, a highly economical alternative to expensive laser scanning technologies. Complementing this is an actuated gantry robot, meticulously engineered to integrate seamlessly with existing mushroom farms. This positions a specialised soft gripper to extract white button mushrooms with precision, ensuring the integrity of both the mushroom’s cap and stem. Designed for cost-effectiveness and adaptability, this solution paves the way for scalable, high-quality mushroom harvesting in the future.”
Concluding thoughts on SoftGrip
In a nutshell, the SoftGrip project has been a remarkable exploration into the potential of robotics to bring about change in the harvesting practices of mushrooms as well as vegetables and soft fruit. Continuous investment in research and development is crucial to respond to the increasing needs of the agricultural sector. As efficiency, innovation and sustainability remain key drivers, the example of SoftGrip will work as a strong foundation for future advancements in autonomous systems in agriculture and beyond.