Research
Multisensory Perception
My works focuses on models of neural processes that enable us to understand how sensory signals from more than one modality (for example vision and hearing) are integrated.
More recently a significant amount of work considered how multiple senses and sensory substitution, in particular in VR anf flight simulation can enhance subjective user experience and performance. Multisensory Perception
Subjective and Objective Measures of User Experience
My work in this area focuses on combining subjective and objective measures of user experience and performance to evaluate 'tricky' concepts, such as 'comfort', 'simulation fidelity' or user experience in VR.
I work very closely with the Virtual Engineering Centre ( VEC ) and the Flight Simulation Lab Flight Simulation Lab at Liverpool.
A key research question is what defines fidelity in simulated environments, we use a range of tools (from questionnaires to measuring embodies cognition via visually evoked postural responses) to address this question.
A ESRC CASE project linked to STRIVE showed that learning in VR is faster and learning transfer is better if key information is presented using subs, performance, learning and embodied cognition (esp postural responses) in virtual reality and flight simulation.
Neuroimaging
I currently supervise seven PhD students that work on different aspects of Neuroimaging:
The projects all combine behavioural measures of perception and performance with structural and functional changes in the brain. We use structural (conventional T1 structural imagine and diffusion tensor and kurtosis imaging) as well as functional imagine, functional connectivity analysis and resting state imaging as well as EEG.
Example projects include
The link between Brain Microstructure, Musicality and Hallucination Proneness, where we show that the link between musical aptitude and hallucination proneness is mediated by microstructure in the Corpus Callosum.
Neuroimaging of learning and rehabilitation processes with emphasis on functional and rapid micro-structural changes in the brain using diffusion tensor imaging, for example a project that evaluates whether early functional and structural brain changes while patients undergo hemianopia rehabilitation predict outcomes.
Research grants
Structural and functional brain imaging as an early predictor of rehabilitative success in ‘scanning training’ for patients with hemianopia (visual field defects) - Bench Fees Abdulrahman Aloufi
ROYAL EMBASSY OF SAUDI ARABIA CULTURAL BUREAU IN LONDON (UK)
November 2016 - December 2021
Sahal Alotaibi Research Support Fees - 201283587
ROYAL EMBASSY OF SAUDI ARABIA CULTURAL BUREAU IN LONDON (UK)
October 2017 - January 2023
Low-cost colour calibration device for visual displays.
ENGINEERING & PHYSICAL SCIENCES RESEARCH COUNCIL
October 2004 - March 2005
Attentional mechanisms is colour-defined motion perception
WELLCOME TRUST (UK)
October 2006 - August 2008
Hearing organisation and recognition of speech in Europe (HOARSE).
EUROPEAN COMMISSION
February 2003 - August 2006
A universal user design interface framework for business to business collaborative systems.
INNOVATE UK (UK)
November 2013 - April 2014
An information-theoretic and stochastic approach to cochlear implant coding.
ENGINEERING & PHYSICAL SCIENCES RESEARCH COUNCIL
February 2003 - May 2004
The integration of auditory and visual motion signals: neural summation vs independent decisions.
ROYAL SOCIETY (CHARITABLE)
April 2004
Research collaborations
Dr Mark White
Flight simulation fidelity assessment
Natalie Uomini
Brain Corrleates of Tool Use