Embedded sensing architecture for mixed reality environments

Group: SPECS
Group leader: Paul Verschure (pverschure@ibecbarcelona.eu)

The aim of this project is to research and develop an advanced sensing architecture for mixed reality environments (Brainx3.com). This includes the validation of its application using scientific experimental procedures. In particular, one of the main technological advancements would be in the use of wearable sensors, the extraction of physiological data to infer internal states, and the reliable and efficient measurements of natural behavior in an immersive multimodal environment.

This could also be used to solve current scientific problems, such as the exploration of massive datasets like neural data, by improving the interaction with it. Instead of being limited to traditional human-computer interaction, which relies on explicit input, the use of certain wearable sensors would allow for a deeper coupling between the user and the system, by inferring implicit states such as the affective state of the user that can be used in the interaction process. This would introduce the important role of emotions into our interaction with computers, as proposed in recent years, which could improve the capabilities of machines to assist us.

The development of this project would require a multidisciplinary profile where the candidate has to integrate technical engineering skills with experimental research methodologies.                                                                        The PhD candidate will pursue this projects by working on scientifically-grounded technological development and the conduction of psychophysical experimentation in humans.