Change search
ReferencesLink to record
Permanent link

Direct link
Video-based observer rated sleepiness versus self-reported subjective sleepiness in real road driving
Stockholm University, Faculty of Social Sciences, Stress Research Institute.
Number of Authors: 4
2015 (English)In: European Transport Research Review, ISSN 1867-0717, E-ISSN 1866-8887, Vol. 7, no 4, 38Article in journal (Refereed) Published
Abstract [en]

Purpose: Observer-rated sleepiness (ORS) based on video recordings of the driver's face is often used when analysing naturalistic driving data. The aim of this study is to investigate if ORS ratings agree with subjective self-reported sleepiness (SRS). Methods: Forty raters assessed 54 video-clips showing drivers with varying levels of sleepiness. The video-clips were recorded during a field experiment focusing on driver sleepiness using the same cameras that are typically used in large-scale field studies. The weak results prompted a second test. Ten human factors researchers made pairwise comparisons of videos showing the same four participants in an alert versus a very sleepy condition. The task was simply to select the video-clip where the driver was sleepy. Results: The overall average percentage of video segments where ORS and SRS matched was 41 % in Test 1. ORS 0 (alert) and ORS 2 (very sleepy) were easier to score than ORS 1 and it was slightly harder to rate night-time drives. Inter-rater agreement was low, with average Pearson's r correlations of 0.19 and Krippendorff's alpha of 0.15. In Test 2, the average Pearson's r correlations was 0.35 and Krippendorff's alpha was 0.62. The correspondence between ORS and SRS showed an agreement of 35 %. Conclusions: The results indicate that ORS ratings based on real road video recordings correspond poorly with SRS and have low inter-rater agreement. Further research is necessary in order to further evaluate the usefulness of ORS as a measure of sleepiness.

Place, publisher, year, edition, pages
2015. Vol. 7, no 4, 38
Keyword [en]
Observer rated sleepiness, Video annotation, Driver sleepiness, Field study
National Category
Health Sciences Psychology Transport Systems and Logistics
URN: urn:nbn:se:su:diva-128014DOI: 10.1007/s12544-015-0188-yISI: 000369916800008OAI: diva2:912710
Available from: 2016-03-17 Created: 2016-03-15 Last updated: 2016-03-17Bibliographically approved

Open Access in DiVA

No full text

Other links

Publisher's full text
By organisation
Stress Research Institute
In the same journal
European Transport Research Review
Health SciencesPsychologyTransport Systems and Logistics

Search outside of DiVA

GoogleGoogle Scholar
The number of downloads is the sum of all downloads of full texts. It may include eg previous versions that are now no longer available

Altmetric score

Total: 132 hits
ReferencesLink to record
Permanent link

Direct link