Linking gaze tracking with a simulated world


The main focus of this study was to develop a software able to link eye tracking data to simulator data, making it possible to automatically detect what the driver is looking at in the simulated world. This was achieved by merging data from a SmartEye system with data from the simulator. Thereby realtime visualisation of where the driver is looking is facilitated, and what the driver is targeting can be shown to the test leader to trigger events in the scenarios, etc. This also facilitates automatic gaze annotations that can be used in subsequent analyses when studying visual behaviour.

The developed software, VIMSI, is responsible for collecting eye tracking data from SmartEye, filter and aggregate this data with data from the simulation and then send processed data to the graphics to visualize the result. The software was tested in one of VTI’s driving simulators. This initial testing of VIMSI showed that the software is capable of visualising what the driver is looking at in real time. The software also makes it possible to log data from the test drives which can be useful when studying driver behaviour. To improve the functionality of VIMSI, it is necessary to consider using UDP instead of IPC when directing data from the VIMSI software to the graphics engine VISIR. This will enable the use of another software, ScenarioReplay, developed at VTI for replaying test drives. A proper configuration and calibration of the SmartEye cameras is necessary to achieve high quality of the data from the SmartEye Pro software, which is a precondition for VIMSI.



Millions for research into maritime transport and the environment

Maritime transport is a major source of emissions of harmful air pollutants and carbon dioxide. In a new project, a research team from the Swedish National Road and Transport Research Institute (VTI) and the University of Gothenburg has received SEK 6.4...


New research programme for more efficient travel

The Swedish National Road and Transport Research Institute (VTI) is playing an important role in a major new research programme to find radical solutions leading to fewer trips and more efficient travel, along with tools to enable better use of roads and...


Simulator used to practice emergency responses safely

Emergency responses of the police, ambulance, and rescue services are associated with a high risk of accidents, but practicing them in real traffic is neither safe nor permissible. A simulator-based method developed by the Swedish National Road and Transport...


Simulation of cut-in by manually driven vehicles in platooning scenarios

A study in a VTI-driving simulator has showed that a platoon will be able to handle a cut in from a manually driven car. The results of this study have recently been presented at two conferences in Japan.



The five-year anniversary of European Road Profile Users' Group (ERPUG) Forum will take place at Ramboll head quarter, Copenhagen, Denmark October 19-20, 2017.


Self-driving buses in Sweden next year?

A self-driving, fossil-free bus. This idea might become reality through a forthcoming collaborative project involving the Swedish National Road and Transport Research Institute (VTI), Linköping University and several other participants. The project group aim...