Video-based observer rated sleepiness versus self-reported subjective sleepiness in real road driving

Download

Observer-rated sleepiness (ORS) based on video recordings of the driver’s face is often used when analysing naturalistic driving data. The aim of this study is to investigate if ORS ratings agree with subjective self-reported sleepiness (SRS).

Forty raters assessed 54 video-clips showing drivers with varying levels of sleepiness. The video-clips were recorded during a field experiment focusing on driver sleepiness using the same cameras that are typically used in large-scale field studies. The weak results prompted a second test. Ten human factors researchers made pairwise comparisons of videos showing the same four participants in an alert versus a very sleepy condition. The task was simply to select the video-clip where the driver was sleepy.

The overall average percentage of video segments where ORS and SRS matched was 41 % in Test 1. ORS 0 (alert) and ORS 2 (very sleepy) were easier to score than ORS 1 and it was slightly harder to rate night-time drives. Inter-rater agreement was low, with average Pearson’s r correlations of 0.19 and Krippendorff’s alpha of 0.15. In Test 2, the average Pearson’s r correlations was 0.35 and Krippendorff’s alpha was 0.62. The correspondence between ORS and SRS showed an agreement of 35 %.

The results indicate that ORS ratings based on real road video recordings correspond poorly with SRS and have low inter-rater agreement. Further research is necessary in order to further evaluate the usefulness of ORS as a measure of sleepiness.

MEET US


5-6
Dec

Vision Zero for Sustainable Road Safety in the Baltic Sea Region

The conference Vision Zero for Sustainable Road Safety in the Baltic Sea Region is held i Vilnius, Lithuania. VTI is part of the organisation committé and also one of the speakers.

LATEST NEWS


2018-10-05

Users contribute to the development of train simulators

Apart from advanced driving simulators, VTI has developed several variations of train simulators which are used for training, education and research. In recent years, interest has increased drastically among major actors in the railway sector, and VTI has...


2018-10-03

VR study to contribute to a better working environment for bus drivers

A study where bus drivers test autonomous driving in a VR environment may contribute to a better working environment with reduced stress on the driver and safer driving.


2018-10-02

Non-native plant species spread via transport systems

Researchers at VTI have compiled a report on non-native invasive plant species in Sweden and how they spread via transport systems.


2018-09-20

EU-project VIRTUAL: improving road safety with virtual crash tests

Crash tests are used to improve safety on roads. Therefore the EU now funds a research project to develop virtual methods of crash testing. VTI coordinates the project, called VIRTUAL. The project now invites experts interested in Human Body Modeling to join...


2018-08-28

EU project protects cyclists and pedestrians

According to the World Health Organisation, more than one quarter of road traffic fatalities in 2010 were pedestrians and cyclists. Every year, about 335,000 unprotected road users die because of traffic accidents, which shows the scale of the problem. The EU...


2018-08-21

Swedish organisations in EU project on traffic safety and crash testing

Crash safety testing is one of the tools used to improve safety on roads. The EU is therefore funding a research project that started recently to develop virtual methods of crash testing. The long-term goal is to supplement the physical evaluation of crash...