Neurocomputational modelling of overt attention in naturalistic audiovisual scenes

Tim J. Smith (primary)
Department of Psychological Sciences
Birkbeck, University of London
Ilias Tachtsidis (secondary)
Medical Physics and Biomedical Engineering
University College London

Abstract

How do humans reconcile the demands of an audiovisual environment with their viewing goals when deciding where to shift attention? Current neurocognitive insights into attention control are derived from studies in which the stimuli used are highly artificial (e.g. simple static 2D displays) and viewer movement and behaviour highly constrained, a far cry from the immersive dynamic everyday scenes attention control developed to handle. This PhD project will utilise recent advances in optical imaging (broadband Near-Infrared Spectroscopy), computer graphics and artificial intelligence to develop a neurocomputational model of overt attention in naturalistic visual scenes.


References

1) Nuthmann, A. and Smith, Tim J. and Engbert, R. and Henderson, J.M. (2010) CRISP: a computational model of fixation durations in scene viewing. Psychological Review 117 (2), pp. 382-405. ISSN 0033-295X.
2) Smith, Tim J. and Mital, P.K. (2013) Attentional synchrony and the influence of viewing task on gaze behavior in static and dynamic scenes. Journal of Vision 13 (8), ISSN 1534-7362.
3) Tatler, B. W., Hayhoe, M., Land, M. F., and Ballard, D. H (2011) Eye guidance in natural vision: Reinterpreting salience. Journal of Vision 2011;11(5):5. doi: https://doi.org/10.1167/11.5.5.
4) Pinti, P., Siddiqui, M.F., Levy, A.D. Jone, E., and Tachtsidis, I. (2021). An analysis framework for the integration of broadband NIRS and EEG to assess neurovascular and neurometabolic coupling. Sci Rep 11, 3977. https://doi.org/10.1038/s41598-021-83420-9
5) Pinti, P., Aichelburg, C., Gilbert, S., Hamilton, A., Hirsch, J., Burgess, P. and Tachtsidis, I. (2018), A Review on the Use of Wearable Functional Near-Infrared Spectroscopy in Naturalistic Environments. Jpn Psychol Res, 60: 347-373.


BBSRC Area
Genes, development and STEM* approaches to biology
Area of Biology
Neurobiology
Techniques & Approaches
Image ProcessingMathematics / StatisticsSimulation / Modelling