Video-based observer rated sleepiness versus self-reported subjective sleepiness in real road driving

Download

Observer-rated sleepiness (ORS) based on video recordings of the driver’s face is often used when analysing naturalistic driving data. The aim of this study is to investigate if ORS ratings agree with subjective self-reported sleepiness (SRS).

Forty raters assessed 54 video-clips showing drivers with varying levels of sleepiness. The video-clips were recorded during a field experiment focusing on driver sleepiness using the same cameras that are typically used in large-scale field studies. The weak results prompted a second test. Ten human factors researchers made pairwise comparisons of videos showing the same four participants in an alert versus a very sleepy condition. The task was simply to select the video-clip where the driver was sleepy.

The overall average percentage of video segments where ORS and SRS matched was 41 % in Test 1. ORS 0 (alert) and ORS 2 (very sleepy) were easier to score than ORS 1 and it was slightly harder to rate night-time drives. Inter-rater agreement was low, with average Pearson’s r correlations of 0.19 and Krippendorff’s alpha of 0.15. In Test 2, the average Pearson’s r correlations was 0.35 and Krippendorff’s alpha was 0.62. The correspondence between ORS and SRS showed an agreement of 35 %.

The results indicate that ORS ratings based on real road video recordings correspond poorly with SRS and have low inter-rater agreement. Further research is necessary in order to further evaluate the usefulness of ORS as a measure of sleepiness.

LATEST NEWS


2018-06-13

International Conference on Electric Road Systems starts today

Electric Road Systems (ERS) is a relatively new concept with many initiatives on the way. To learn from each other and stimulate new collaborations the Swedish Research and Innovation Platform for Electric Roads arranged the first international conference...


2018-05-18

Same survey of road users’ attitudes in 50 countries

At the Road Safety on Five Continents Conference, RS5C, one entire session presented a large survey of road users' attitudes in 38 countries. Results show large differences between countries in many areas, both regarding behavior and attitudes. A new survey...


2018-05-17

Good results with alcohol interlock program according to Swedish study

An alcohol interlock program makes it possible for drink driving offenders to continue their everyday lives. In a Swedish study most of the participants were satisfied with the program and experienced improved health. They also reported drinking alcohol more...


2018-05-16

Traffic safety in the spotlight

Today the Conference Road Safety on Five Continents (RS5C) opened in Jeju Island, South Korea. More than 220 participators have come from all over the world to present findings and learn about traffic safety. Dr. Young Tae Kim, Secretary-General of the...


2018-04-17

VTI will develop simulators for ambulance staff

VTI has initiated a pilot study for paramedics with the Centre for Teaching & Research in Disaster Medicine and Traumatology and Linköping University. The aim is to give ambulance staff the opportunity to practice critical medical tasks in a moving vehicle in...


2018-04-12

Unique electrified road opens in Sweden

The world’s first electrified road recharging the batteries of cars and trucks while driving opened in Sweden. The Swedish Minister for Infrastructure, Tomas Eneroth, was at the formal inauguration of the electrified road on April 11, 2018. VTI is one of 22...