4.1 Eye Gaze Interface to Operate Aircraft Displays

ettc2020 - European Test and Telemetry Conference
2020-06-23 - 2020-06-25
Virtual Conference
4. Virtual Testing
L. R. D. Murthy, K. P. S. Saluja, P. Biswas - Indian Institute of Science, Bangalore (India), M. D. Babu - Indian Air Force, Bangalore (India), V. Yelleti - Indian Institute of Information Technology, Kalyani (India)
134 - 140


Eye gaze trackers have been studied widely for their utility in aviation domain since long time. So far, numerous studies have been conducted in the direction of gaze-controlled interfaces for electronic displays in flights and Head mounted display systems under simulated conditions. In this paper, we present our study on usage of eye gaze trackers in real flight conditions and their failure modes under such usage conditions and illumination. We show that the commercially available off the shelf (COTS) eye gaze trackers with state-of-the-art accuracy fails to provide gaze estimates beyond certain level of illumination on the eyes. We also show that the limited available tracking range of eye gaze trackers limit them to provide gaze estimates even during the pilots’ natural operating behavior. Further, we present three approaches of developing eye gaze trackers which are designed to use webcam instead of infrared illumination and are aimed to be functional at high illumination conditions. We present our intelligent tracker, developed using OpenFace framework, provides comparable results to COTS eye tracker in terms of interaction speed for both indoor and outdoor conditions.