On the Closure of Perceptual Gaps in Man-Machine Interaction: Virtual Immersion, Psychophysics and Electrophysiology

Abstract :

Human behaviour in natural environments almost unconsciously relies on a stable and unified percept. The brain interprets perceptual inconsistencies as behavioural errors and tries to correct them. However, when humans are interacting with artificial Environments the true error source might be based on imperfect implementations. Then, a behavioural change might be unwanted or even produce further errors. The problem arises from two issues: 1) since artificial environments often do not capture the required complexity, inconsistencies and errors are introduced that somehow distort the percept; 2) intended manipulations in the artificial environment (e.g., in man-machine interaction) seldom take the human�s percept into account. Here, we present approaches to reduce such perceptual gaps and therefore enhance the immersion of the human. In our example scenario, the human interacts with an arm exoskeleton, while he is situated into a complex virtual scene. We show that psychophysics can be used to adjust parameter changes in the scenario or modifications in the machine according to intended perceptual changes. Furthermore, we use online classification of EEG data to create an intelligent interface that predicts the state of the operator. Finally, we present a short evaluation to illustrate how well subjects were embedded in the scenario.

Keywords :

virtual immersion, human, psychophysics, EEG, Brain Reading, simulationreality- gap, man-machine interaction

Files:

110713_On_the_Closure_of_Perceptual_Gaps_in_Man-Machine_Interaction_ECVP_Straube.pdf

Links:

http://www.perceptionweb.com/abstract.cgi?id=v110391
http://posters.f1000.com/P2225