Hybrid Social Teams for Long-Term Collaboration in Cyber-Physical Environments

Scientific Leader:
Project leader:
Contact person:

The project HySociaTea is a cooperation between various research departments at DFKI GmbH combining the competencies of the complete spectrum of Artificial Intelligence. HySociaTea is an R&D project which is embedded in the future strategy Industry-4.0 and deals with the development of flexible production and mission processes. The basic idea in HySociaTea is that the production environment of the future will consist of a team of humans closely collaborating with robots and virtual agents. The team can flexibly react to incoming requirements. The project establishes the basis for such a team by considering setup, communication and role allocation in such a hybrid team.

Duration: 01.09.2014 till 31.08.2016
Donee: German Research Center for Artificial Intelligence GmbH
Sponsor: Federal Ministry of Education and Research
Grant number: This project is funded by the German Federal Ministry of Education and Research (BMBF), grant no. 01IW14001.
Application Field: Assistance- and Rehabilitation Systems
Related Projects: SemProM
Semantic Product Memory (02.2008- 01.2011)
Related Robots: ARTEMIS
DLR SpaceBot Cup 2013 Rover
Mobile Dual-Arm-Manipulation
Compliant Robot Arm
Related Software: ARC-OPT
Adaptive Robot Control using Optimization

Project details

Components of HySociaTea (Graphic: Sirko Straube)
The project HySociaTea (Hybrid Social Teams for Long-Term Collaboration in Cyber-Physical Environments), which is funded by the German Federal Ministry of Education and Research, realizes and examines the collaboration of technological augmented humans with autonomous robots, virtual characters and softbots, who work together in a team to solve common tasks.
In the context of Industry 4.0, an example application for these hybrid social teams is the realization of a highly flexible production, in which the team can react on unplanned events by autonomous reorganization. Besides research on the technical feasibility, another key aspect of the project lies in the development of robotic team-competencies as well as on intelligent multi-agent behavior, both of which are also important aspects in purely human teams. The technical systems developed in HySociaTea are mainly meant to be used as assistance-systems for humans working in production-plants – the robots should therefore be perceived as partners in the overall working-process.
On the long run, the team organization, as developed and examined in HySociaTea, can be used in different real-world scenarios, e.g. in modularized production facilities in the factory of the future, as rescue teams in emergency situations, or to realize the necessary division of labor between humans and machines to safely deconstruct nuclear power plants.
In order to realize the vision of HySociaTea, different research departments from all DFKI locations (Bremen, Kaiserslautern, Saarbrücken) join their competencies:
  • RIC (Robotics Innovations Center, DFKI Bremen): autonomous and cooperative robotic systems, mobile manipulation
  • CPS (Cyber-Physical Systems, DFKI Bremen): safe human-robot interaction
  • EI (Embedded Intelligence, DFKI Kaiserslautern): augmented humans, wearable sensors
  • AV (Augmented Vision, DFKI Kaiserslautern): perception modules using image processing and sensor fusion
  • KM (Knowledge Management, DFKI Kaiserslautern): gaze-controlled perception recognition, real-time object-recognition
  • IUI (Intelligent User Interfaces, DFKI Saarbrücken): emosocial virtual characters, multimodal dialog platform
  • LT (Language Technology Lab, DFKI Saarbrücken): autonomous team-reorganization, natural speech interaction
  • ASR (Agents and Simulated Reality, DFKI Saarbrücken): communication middleware, Dual Reality


HySociaTea: Ausgewählte Highlights der finalen Projektdemo

Dieses Video zeigt ausgewählte Technologien im HySociaTea-Szenario: das Resourcenplanungsmodul, die Objekterkennung anhand der Eyetracker-Information beim Werker, die Sprach-Interaktion mit den Robotern und dem virtuellen Charakter Gloria, die autonomen Sequenzen der Roboter und die autonome Roboter-Roboter Interaktion.

HySociaTea: Autonome Roboter-Roboter Kollaboration zwischen Compi und AILA

Das Video zeigt die autonome Roboter-Roboter Kollaboration in HySociaTea unter Nutzung des TECS-Framework. Der Roboter Compi nimmt das Werkstück und meldet, dass eine Abholung nötig wird. AILA erkennt, dass sie diese Aufgabe ausführen kann und übernimmt. Bei der Übergabe gibt es ein Kommunikationsprotokoll zwischen beiden Robotern.

HySociaTea: Szenario Maßgefertigte Verpackung

Das Video zeigt den ersten Demo-Aufbau und Ablauf mit dem Hybriden Team.



Back to the list of projects
last updated 09.05.2022
to top