Development of an immersive simulation-based robot control interface with intuitive, natural gesture based interaction

Progress Talk - This thesis aims to develop and evaluate an immersive, simulation-based control system for remote operation of complex robot systems. Therefore, a virtual replication of the corresponding robotic system is implemented in the MARS simulation software and augmented with interaction features which correspond to a specfic control command of the real robot. Using the stereoscopic multiscreen projection environment (CAVE) and a data glove for gesture recognition, the operator can control the robot through natural interaction like grabbing and moving a specific robot component. The control concept will be evaluate against traditional operator control interfaces in order to evaluate whether or not the concept provides better control of complex remote operated systems.