|Keywords:||Machine Learning, Signal Processing, Parallelization, FPGA, Embedded Systems|
|Programming languages:||Python, C, Matlab, VHDL|
|Ownership:||This software was developed by the DFKI as well as by the Robotics Research Group and the University of Bremen and is being further developed under this responsibility. For questions and suggestions, please refer to the contact persons.|
Exploiting the Advantages of FPGAs for Mobile and Embedded Signal Processing
Intelligent mobile or embedded systems like robots usually require high-dimensional and realtime-capable signal processing and machine learning. To achieve this, the processing requires to be powerful and energy efficient at the same time. Field-Programmable Gate Arrays (FPGAs) are well suited to meet these requirements. Recent FPGA-models include a high number of programmable logic-cells and special resources for signal processing. Additionally, some of these chips feature complete CPU cores, which allow it to run operating systems and complex software applications.
Applications that utilize signal processing and machine learning can often be divided into computationally expensive parts, which should be mapped to an FPGA, and more high-level management tasks, which should be mapped to a CPU. reSPACE allows to implement the computationally expensive parts on an FPGA by utilizing a model-based development process.
Hardware Dataflow Accelerators
reSPACE is based on static heterogeneous dataflow computing: an application specific dataflow hardware accelerator can be implemented by combining a set of different predefined compute nodes. Every node performs a single transformation on the data. All nodes can operate in serial or parallel. The nodes and the hardware accelerator are purely data-driven and can, therefore, operate independent from the CPU. The final hardware accelerator can be easily integrated into an FPGA-based System on Chip, all required software components, i.e., device drivers and interface libraries, are automatically generated by reSPACE.
Combination with pySPACE
reSPACE can be easily combined with pySPACE. Accordingly, the evaluation and data management functionality of pySPACE can be used to evaluate the hardware system.
Example Application Platform: ZynqBrain
The ZynqBrain electronics board, which contains a Xilinx Zynq® EPP and miscellaneous interfaces, was developed at the DFKI RIC as a central electronics component for various robots and a special purpose platform for signal processing. The ARM® CPU can be used to, e.g., run pySPACE as a high level application, while the computationally expensive parts are mapped to the FPGA-based dataflow accelerators that are implemented using reSPACE.
Anpassung einer Mensch-Maschine Schnittstelle für Mehrrobotersteuerung mittels embedded Brain Reading
Das Video zeigt eine Mensch-Maschine Schnittstelle (MMS) für die Steuerung mehrere Roboter. Die MMS wird durch „embedded Brain Reading“ an die Arbeitsbelastung und das Engagement des Nutzers online angepasst. Die Arbeitsauslastung wird von der Ausprägung der P300 im single-trial abgeleitet. Ein zweite Aufgabe zur Bestimmung der Arbeitsauslastung mittels der P300 Ausprägung nicht nötig.