Reconfigurable Signal Processing and Classification Environment

The framework reSPACE (reconfigurable Signal Processing and Classification Environment) was developed to facilitate the development of application-specific FPGA-based hardware accelerators for embedded and mobile systems. respace uses a model based development process to accelerate the development of the accelerators. The focus lies especially on applications in the areas signal and image processing as well as machine learning.
Keywords: Machine Learning, Signal Processing, Parallelization, FPGA, Embedded Systems
Status: active
Operating system: Linux
Programming languages: Python, C, Matlab, VHDL
Licence: Proprietary
Ownership: This software was developed by the DFKI as well as by the Robotics Research Group and the University of Bremen and is being further developed under this responsibility. For questions and suggestions, please refer to the contact persons.

Software description

All computations are performed by dataflow accelerators, which operate independently from the CPU. (Source: DFKI GmbH)
Structure of an FPGA (Source: DFKI GmbH)
The ZynqBrain can be used as a target platform for reSPACE (Source: DFKI GmbH)

Exploiting the Advantages of FPGAs for Mobile and Embedded Signal Processing
Intelligent mobile or embedded systems like robots usually require high-dimensional and realtime-capable signal processing and machine learning. To achieve this, the processing requires to be powerful and energy efficient at the same time. Field-Programmable Gate Arrays (FPGAs) are well suited to meet these requirements. Recent FPGA-models include a high number of programmable logic-cells and special resources for signal processing. Additionally, some of these chips feature complete CPU cores, which allow it to run operating systems and complex software applications.

Software-Hardware Partitioning
Applications that utilize signal processing and machine learning can often be divided into computationally expensive parts, which should be mapped to an FPGA, and more high-level management tasks, which should be mapped to a CPU. reSPACE allows to implement the computationally expensive parts on an FPGA by utilizing a model-based development process.

Hardware Dataflow Accelerators
reSPACE is based on static heterogeneous dataflow computing: an application specific dataflow hardware accelerator can be implemented by combining a set of different predefined compute nodes. Every node performs a single transformation on the data. All nodes can operate in serial or parallel. The nodes and the hardware accelerator are purely data-driven and can, therefore, operate independent from the CPU. The final hardware accelerator can be easily integrated into an FPGA-based System on Chip, all required software components, i.e., device drivers and interface libraries, are automatically generated by reSPACE.

Combination with pySPACE
reSPACE can be easily combined with pySPACE. Accordingly, the evaluation and data management functionality of pySPACE can be used to evaluate the hardware system.

Example Application Platform: ZynqBrain
The ZynqBrain electronics board, which contains a Xilinx Zynq® EPP and miscellaneous interfaces, was developed at the DFKI RIC as a central electronics component for various robots and a special purpose platform for signal processing. The ARM® CPU can be used to, e.g., run pySPACE as a high level application, while the computationally expensive parts are mapped to the FPGA-based dataflow accelerators that are implemented using reSPACE.


Anpassung einer Mensch-Maschine Schnittstelle für Mehrrobotersteuerung mittels embedded Brain Reading

Das Video zeigt eine Mensch-Maschine Schnittstelle (MMS) für die Steuerung mehrere Roboter.  Die MMS wird durch „embedded Brain Reading“ an die Arbeitsbelastung und das Engagement des Nutzers online angepasst. Die Arbeitsauslastung wird von der Ausprägung der P300 im single-trial abgeleitet. Ein zweite Aufgabe zur Bestimmung der Arbeitsauslastung mittels der P300 Ausprägung nicht nötig.


Application Field: Assistance- and Rehabilitation Systems
Space Robotics
Related Projects: BEAR
Battery electric waste management with robotic assistance (01.2017- 12.2019)
Intelligent Man-Machine Interface - Adaptive Brain-reading for assistive robotics (05.2010- 04.2015)
Learning Intelligent Motions for Kinematically Complex Robots for Exploration in Space (05.2012- 04.2016)
Recupera REHA
Full-body exoskeleton for upper body robotic assistance (09.2014- 12.2017)
Related Robots: Exoskeleton Active (VI-Bot)
Upper body Exoskeleton (right arm)
Sponsor: Federal Ministry of Economics and Technology
German Aerospace Center e.V.
Grant number: FKZ 50 RA 1012, FKZ 50 RA 1011
last updated 02.04.2019
to top