Szczegóły publikacji

Opis bibliograficzny

Implementation of a perception system for autonomous vehicles using a detection-segmentation network in SoC FPGA / Maciej Baczmański, Mateusz WĄSALA, Tomasz KRYJAK // W: Applied Reconfigurable Computing : architectures, tools, and applications : 19th international symposium, ARC 2023 : Cottbus, Germany, September 27-29, 2023 : proceedings / eds. Francesca Palumbo, [et al.]. — Cham : Springer, cop. 2023. — (Lecture Notes in Computer Science ; ISSN 0302-9743 ; LNCS 14251). — ISBN: 978-3-031-42920-0; e-ISBN: 978-3-031-42921-7. — S. 200–211. — Bibliogr., Abstr.

Autorzy (3)

Słowa kluczowe

eGPUperceptiondetection-segmentation neural networkembedded AIvitis AImecanum wheel vehicleSoC FPGA

Dane bibliometryczne

ID BaDAP149007
Data dodania do BaDAP2023-10-10
DOI10.1007/978-3-031-42921-7_14
Rok publikacji2023
Typ publikacjimateriały konferencyjne (aut.)
Otwarty dostęptak
WydawcaSpringer
Czasopismo/seriaLecture Notes in Computer Science

Abstract

Perception and control systems for autonomous vehicles are an active area of scientific and industrial research. These solutions should be characterised by both high efficiency in recognising obstacles and other environmental elements in different road conditions, real-time capability, and energy efficiency. Achieving such functionality requires an appropriate algorithm and a suitable computing platform. In this paper, we have used the MultiTaskV3 detection-segmentation network as the basis for a perception system that can perform both functionalities within a single architecture. It was appropriately trained, quantised, and implemented on the AMD Xilinx Kria KV260 Vision AI embedded platform. By using this device, it was possible to parallelise and accelerate the computations. Furthermore, the whole system consumes relatively little power compared to a CPU-based implementation (an average of 5 W, compared to the minimum of 55 W for weaker CPUs, and the small size (119mm × 140 mm × 36 mm) of the platform allows it to be used in devices where the amount of space available is limited. It also achieves an accuracy higher than 97% of the mAP (mean average precision) for object detection and above 90% of the mIoU (mean intersection over union) score for image segmentation. The article also details the design of the Mecanum wheel vehicle, which was used to test the proposed solution in a mock-up city.

Publikacje, które mogą Cię zainteresować

fragment książki
#148543Data dodania: 6.10.2023
Detection-segmentation convolutional neural network for autonomous vehicle perception / Maciej Baczmański, Robert Synoczek, Mateusz WĄSALA, Tomasz KRYJAK // W: MMAR 2023 [Dokument elektroniczny] : 27th international conference on Methods and Models in Automation and Robotics : 22–25 August 2023, Międzyzdroje, Poland : on line proceedings : technical papers. — Wersja do Windows. — Dane tekstowe. — Piscataway : IEEE, cop. 2023. — (International Conference on Methods and Models in Automation and Robotics ; ISSN 2835-2815). — Dod. ISBN: 979-8-3503-1106-8 (USB), 979-8-3503-1108-2 (print on demand). — e-ISBN: 979-8-3503-1107-5. — S. 117–122. — Wymagania systemowe: Adobe Reader. — Bibliogr. s. 122, Abstr. — Publikacja dostępna online od: 2023-09-11
fragment książki
#159463Data dodania: 16.5.2025
Real-time multi-object tracking using YOLOv8 and SORT on a SoC FPGA / Michał DANIŁOWICZ, Tomasz KRYJAK // W: Applied Reconfigurable Computing : architectures, tools, and applications : 21st international symposium, ARC 2025 : Seville, Spain, April 9–11, 2025 : proceedings / eds. Roberto Giorgi, [et al.]. — Cham : Springer, cop. 2025. — ( Lecture Notes in Computer Science ; ISSN  0302-9743 ; LNCS 15594 ). — ISBN: 978-3-031-87994-4; e-ISBN: 978-3-031-87995-1. — S. 214–230. — Bibliogr., Abstr. — Publikacja dostępna online od: 2025-04-04