2025 SMSI Bannerklein

A1.3 - Differentiation of Human and Robots with Thermal Images and Convolutional Neural Network for Human-Robot Collaboration

Event
22. GMA/ITG-Fachtagung Sensoren und Messsysteme 2024
2024-06-11 - 2024-06-12
Nürnberg
Band
Vorträge
Chapter
A1 - Maschinelles Lernen
Author(s)
S. Süme, K. Ponomarjova, T. Wendt - Hochschule Offenburg,Offenburg, S. Rupitsch - Albert-Ludwigs-Universität Freiburg (IMTEK),Freiburg
Pages
32 - 36
DOI
10.5162/sensoren2024/A1.3
ISBN
978-3-910600-01-0
Price
free

Abstract

This paper introduces the use of convolutional neural networks to detect and classify humans and robots in Human-Robot Collaboration workspaces based on their thermal radiation power. The measurement setup includes an infrared camera, two cobots and up to two persons walking or interacting with the cobots in industrial settings. The chosen architectures are the YOLOv5 and YOLOv8 in different model sizes. The results are promising, showing real-time object detection in industrial settings with up to 303 fps with the YOLOv8n model. YOLOv5m achieves the best mAP50 result at 99.2% and the YOLOv5m achieves the best mAP50-95 at 85.8%.

Download