Development of an immersive simulation-based robot control interface with intuitive, natural gesture based interaction

Progress Talk - In this thesis, an alternative approach for remote operation of complex robotic systems is developed and evaluated by deploying a virtual replication of the corresponding robotic system within an immersive virtual environment and augmenting it with further features to allow for a natural-interaction inspired robot control. The software allows the operator to control the robot from within a stereoscopic multi-screen projection environment (CAVE), using the MARS simulation software as visualisation, by manipulating the virtual robot replication in order to generate control commands for the real robot. This progress talk will give a quick summary on the current state of work and focus on the coming evaluation study.