A Time Delay Neural Network model for simulating eye gaze data

Yun ZHANG, Xiaoyu ZHAO, Hong FU, Zhen LIANG, Zheru CHI, Xinbo ZHAO, Dagan FENG

Research output: Contribution to journalArticlespeer-review

8 Citations (Scopus)

Abstract

Human eye movement modelling is a new, challenging and promising research topic in computer vision. Human eye movement modelling aims at simulating the scan path in which a human being views an image, a scene or a video. The successful modelling of human eye movements potentially benefits a wide range of applications such as image retrieval, image annotation, medical image diagnosis and human visual perception. This article presents a model based on a Time Delay Neural Network (TDNN) to simulate eye gaze data. First, 120 Hz eye gaze data are acquired by a non-intrusive table-mounted eye tracker. Our proposed model is to simulate the image reading process of a single subject. Seven features are then extracted based on the knowledge of the human oculomotor system and the image contents to train a TDNN. Finally, the trained TDNN combined with a saccade control mechanism is used to simulate the scan path of a human being viewing an image. The proposed model can generate 600 points of raw eye gaze data in a 5-second eye viewing window. Both subjective and objective methods are used to evaluate the model by comparing its behaviour and characteristics with the real eye gaze data collected from an eye tracker. Qualitative assessment shows that the subject can hardly tell the differences between the scan path from the model and that from a human being. By evaluating the coincident probability Cp and coincident significance Cs , quantitative assessment shows that the results from the TDNN model are reasonable and similar to human scan paths. Copyright © 2011 Taylor & Francis.
Original languageEnglish
Pages (from-to)111-126
JournalJournal of Experimental and Theoretical Artificial Intelligence
Volume23
Issue number1
Early online date19 Feb 2011
DOIs
Publication statusPublished - 2011

Citation

Zhang, Y., Zhao, X., Fu, H., Liang, Z., Chi, Z., Zhao, X., & Feng, D. (2011). A Time Delay Neural Network model for simulating eye gaze data. Journal of Experimental and Theoretical Artificial Intelligence, 23(1), 111-126. doi: 10.1080/0952813X.2010.506298

Keywords

  • Eye movement modelling
  • Visual attention model
  • Time delayed neural networks
  • Oculomotor control
  • Coincident probability
  • Coincident significance

Fingerprint Dive into the research topics of 'A Time Delay Neural Network model for simulating eye gaze data'. Together they form a unique fingerprint.