Experiments with cooperative robots that can detect object’s shape, color and size to perform tasks in industrial workplaces

Abstract Automation and human-robot collaboration are increasing in modern workplaces such as industrial manufacturing. Nowadays, humans rely heavily on advanced robotic devices to perform tasks quickly and accurately. Modern robots with computer vision and artificial intelligence are gaining attent...
Ausführliche Beschreibung

Abstract Automation and human-robot collaboration are increasing in modern workplaces such as industrial manufacturing. Nowadays, humans rely heavily on advanced robotic devices to perform tasks quickly and accurately. Modern robots with computer vision and artificial intelligence are gaining attention and popularity rapidly. This paper demonstrates how a robot can automatically detect an object’s shape, color, and size using computer vision techniques and act based on information feedback. In this work, a powerful computational model for a robot has been developed that distinguishes an object’s shape, size, and color in real time with high accuracy. Then it can integrate a robotic arm to pick a specific object. A dataset of 6558 images of various monochromatic objects has been developed, containing three colors against a white background and five shapes for the research. The designed system for detection has achieved 99.8% success in an object’s shape detection. Also, the system demonstrated 100% success in the object’s color and size detection with the OpenCV image processing framework. On the other hand, the prototype robotic system based on Raspberry Pi-4B has achieved 80.7% accuracy for geometrical shape detection and 81.07%, and 59.77% accuracy for color recognition and distance measurement, respectively. Moreover, the system guided a robotic arm to pick up the object based on its color and shape with a mean response time of 19 seconds. The idea is to simulate a workplace environment where a worker will ask the robotic systems to perform a task on a specific object. Our robotic system can accurately identify the object’s attributes (e.g., 100%) and is able to perform the task reliably (81%). However, reliability can be improved by using a more powerful computing system, such as the robotic prototype. The article’s contribution is to use a cutting-edge computer vision technique to detect and categorize objects with the help of a small private dataset to shorten the training duration and enable the suggested system to adapt to components that may be needed for creating a new industrial product in a shorter period. The source code and images of the collected dataset can be found at: https://github.com/TituShahoriar/cse499B_Hardware_Proposed_System. Ausführliche Beschreibung

Autor*in:	Titu, Md Fahim Shahoriar [verfasserIn] Haque, S. M. Rezwanul Islam, Rifad Hossain, Akram Qayum, Mohammad Abdul Khan, Riasat

Format:	E-Artikel
Sprache:	Englisch

Erschienen:	2023

Schlagwörter:	Automation Bounding box regression Computer vision Detection Image processing Library OpenCV Robot

Anmerkung:

© The Author(s), under exclusive licence to Springer Nature Singapore Pte Ltd. 2023. Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Übergeordnetes Werk:	Enthalten in: International journal of intelligent robotics and applications - Springer Nature Singapore, 2017, 8(2023), 1 vom: 25. Nov., Seite 179-192
Übergeordnetes Werk:	volume:8 ; year:2023 ; number:1 ; day:25 ; month:11 ; pages:179-192

Links:	Volltext

DOI / URN:	10.1007/s41315-023-00305-y

Katalog-ID:	SPR05520256X