Adaptive software framework for context-sensitive, intuitive man-machine-interaction

The aim of project "KiMMI SF" is the development of a software framework for flexible and context-optimized man-machine-interaction. On the one hand, this shall offer online reconfigurable data handling. Furthermore, methods for context-dependent evaluation, selection and weighting of data sources will be developed.

Duration: 01.06.2020 till 31.05.2023
Donee: German Research Center for Artificial Intelligence GmbH & University of Bremen
Sponsor: Federal Ministry for Economic Affairs and Climate Action
German Aerospace Center e.V.
Grant number: DFKI: 50RA2021 Uni: 50RA2022
Application Field: Space Robotics
Related Projects: BesMan
Behaviors for Mobile Manipulation (05.2012- 07.2016)
Dual-arm exoskeleton (01.2011- 12.2013)
Intelligent Man-Machine Interface - Adaptive Brain-reading for assistive robotics (05.2010- 04.2015)
Intelligent Human-Robot Collaboration (03.2015- 06.2016)
Intelligent Structures for Mobile Robots (05.2010- 08.2013)
Learning Intelligent Motions for Kinematically Complex Robots for Exploration in Space (05.2012- 04.2016)
Technologies and Human-Robot Collaboration for Surface EVA Exploration Activities and Training in European Analogue Environments (09.2013- 08.2016)
Recupera REHA
Full-body exoskeleton for upper body robotic assistance (09.2014- 12.2017)
Semi-autonomous cooperative exploration of planetary surfaces including the installation of a logistic chain as well as consideration of the terrestrial applicability of individual aspects (05.2013- 12.2017)
AI-based Qualification of Deliberative Behaviour for a Robotic Construction Kit (08.2018- 07.2021)
Flexible Interaction for infrastructures establishment by means of teleoperation and direct collaboration; transfer into industry 4.0 (07.2017- 12.2021)
Models, methods and tools for the model based software development of robots (06.2015- 05.2018)
Related Robots: Full Body Exoskeleton
Exoskeleton for upper body robotic assistance
Related Software: Bagel
Biologically inspired Graph-Based Language
Signal Processing and Classification Environment written in Python
Reconfigurable Signal Processing and Classification Environment
Behavior Optimization and Learning for Robots
Robot Construction Kit

Project details

KiMMI SF is a joint research project with the aim of realizing a software framework for flexible human-machine interaction which is optimal for the respective context.

Specifically, in subproject 1 “Development of an adaptive software framework for MMI”, led by DFKI RIC, an adaptive software framework is being developed that enables online reconfigurable data processing based on different data sources. The framework shall enable a multimodal evaluation of the situation of the human being, the agent and the environment.

In subproject 2 “Development of methods for online context recognition”, led by the University of Bremen, methods for context-dependent evaluation, selection and weighting of data soures will be developed to enable online interpretation of context information based on multimodal data and to derive the human condition. The software framework developed in the project is a prerequisite for context-dependent intuitive human-machine interaction, which is to be made possible through collaboration in the project. This will allow the interaction between humans and robotic agents to continue flexibly, i.e. even when the context changes.

Due to the adaptive nature of the software framework to be developed in KiMMI SF for flexible human-machine interaction that is optimal for the respective context, it is expected, among other things, that downtimes due to otherwise unrecognized context and intention changes in humans can be minimized. Thus, it can serve as an essential contribution for the success of future missions. KiMMI SF builds on existing technology developments in previous projects in the field of space travel, particularly in the area of providing services (PS).




Back to the list of projects
last updated 20.03.2023
to top