KiMMI SF is a joint research project with the aim of realizing a software framework for flexible human-machine interaction which is optimal for the respective context.
Specifically, in subproject 1 “Development of an adaptive software framework for MMI”, led by DFKI RIC, an adaptive software framework is being developed that enables online reconfigurable data processing based on different data sources. The framework shall enable a multimodal evaluation of the situation of the human being, the agent and the environment.
In subproject 2 “Development of methods for online context recognition”, led by the University of Bremen, methods for context-dependent evaluation, selection and weighting of data soures will be developed to enable online interpretation of context information based on multimodal data and to derive the human condition. The software framework developed in the project is a prerequisite for context-dependent intuitive human-machine interaction, which is to be made possible through collaboration in the project. This will allow the interaction between humans and robotic agents to continue flexibly, i.e. even when the context changes.
Due to the adaptive nature of the software framework to be developed in KiMMI SF for flexible human-machine interaction that is optimal for the respective context, it is expected, among other things, that downtimes due to otherwise unrecognized context and intention changes in humans can be minimized. Thus, it can serve as an essential contribution for the success of future missions. KiMMI SF builds on existing technology developments in previous projects in the field of space travel, particularly in the area of providing services (PS).
Publications
2023
Detection and recognition of human manipulation building blocks
Lisa Gutzeit
Mar/2023. Universität Bremen.
The VVAD-LRS3 Dataset for Visual Voice Activity Detection
Adrian Lubitz., Matias Valdenegro-Toro., Frank Kirchner.
In Proceedings of the 18th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - HUCAPP, (VISIGRAPP-2023), 19.2.-21.2.2023, Lissabon, SciTePress, pages 39-46, 2023. INSTICC. ISBN: 978-989-758-634-7.
A Reference Implementation for Knowledge Assisted Robot Development for Planetary and Orbital Robotics
Mehmed Yüksel, Thomas M. Röhr, Marko Jankovic, Wiebke Brinkmann, Frank Kirchner
In Acta Astronautica, Elsevier Ltd., volume 2023, pages 1-16, 2023.
CoBaIR: A Python Library for Context-Based Intention Recognition in Human-Robot-Interaction
Adrian Auer, Lisa Gutzeit, Frank Kirchner
In 2023 32nd IEEE International Conference on Robot and Human Interactive Communication (RO-MAN), (RO-MAN-2023), 28.8.-31.8.2023, Busan, IEEE, 2023.
2022
Unsupervised Segmentation of Human Manipulation Movements into Building Blocks
Lisa Gutzeit, Frank Kirchner
In IEEE Access, IEEE, volume 10, pages 125723-125734, Dec/2022.
Ontology-Driven Robot Design for Future Orbital and Planetary Robotics with korcut
Mehmed Yüksel, Thomas M. Röhr
European Aeronautics Science Network International Conference (EASN), Oct/2022.
Hierarchical Segmentation of Human Manipulation Movements
Lisa Gutzeit
In Proc. of the 26th International Conference on Pattern Recognition, (ICPR-2022), 21.8.-25.8.2022, Montreal, QC, IEEE Computer Society, pages 2742-2748, Aug/2022.
A Holistic Approach for Enhancing Data Integrity and Reliability in Human-Robot Interaction
Manuel Meder, Kashmira Shinde, Dennis Hemker, Sadique Siddiqui, Teena Hassan, Nina Hoyer, Elsa Andrea Kirchner
In Proceedings of SpaceCHI 2.0: Human-Computer Interaction for Space Exploration, (SpaceCHI 2.0-2022), 01.5.-01.5.2022, New Orleans, LA, ACM, May/2022.
A Bayesian Approach to Context-based Recognition of Human Intention for Context-Adaptive Robot Assistance in Space Missions
Adrian Auer, Octavio Arriaga, Teena Hassan, Nina Hoyer, Elsa Andrea Kirchner
In Proceedings of SpaceCHI 2.0 - Human-Computer Interaction for Space Exploration - A Workshop at CHI 2022, (SpaceCHI 2.0-2022), 01 .5.-01.5.2022, New Orleans, LA, ACM, May/2022.
Multi-modal manipulation planning for an upper-torso humanoid system
Sankaranarayanan Natarajan, Frank Kirchner
In 2022 IEEE-RAS 21st International Conference on Humanoid Robots, (Humanoids-2022), 28.11.-30.11.2022, Ginowan City, Okinawa, IEEE, 2022.