Learning pre-attentive driving behaviour from holistic visual features

Pugeault, N. and Bowden, R. (2010) Learning pre-attentive driving behaviour from holistic visual features. In: Daniilidis, K., Maragos, P. and Paragios, N. (eds.) Computer Vision – ECCV 2010: 11th European Conference on Computer Vision, Heraklion, Crete, Greece, September 5-11, 2010, Proceedings, Part VI. Series: Lecture notes in computer science (6312). Springer: Berlin ; Heidelberg, pp. 154-167. ISBN 9783642155666 (doi: 10.1007/978-3-642-15567-3_12)

Abstract

The aim of this paper is to learn driving behaviour by associating the actions recorded from a human driver with pre-attentive visual input, implemented using holistic image features (GIST). All images are labelled according to a number of driving–relevant contextual classes (eg, road type, junction) and the driver’s actions (eg, braking, accelerating, steering) are recorded. The association between visual context and the driving data is learnt by Boosting decision stumps, that serve as input dimension selectors. Moreover, we propose a novel formulation of GIST features that lead to an improved performance for action prediction. The areas of the visual scenes that contribute to activation or inhibition of the predictors is shown by drawing activation maps for all learnt actions. We show good performance not only for detecting driving–relevant contextual labels, but also for predicting the driver’s actions. The classifier’s false positives and the associated activation maps can be used to focus attention and further learning on the uncommon and difficult situations.

• Item Type: Book Sections
• Status: Published
• Glasgow Author(s) Enlighten ID: Pugeault, Dr Nicolas
• Authors: Pugeault, N., and Bowden, R.
• College/School: College of Science and Engineering > School of Computing Science
• Publisher: Springer
• ISBN: 9783642155666