A journal of IEEE and CAA , publishes high-quality papers in English on original theoretical/experimental research and development in all areas of automation
Advanced Search
Volume 6 Issue 3
May  2019

IEEE/CAA Journal of Automatica Sinica

  • JCR Impact Factor: 15.3, Top 1 (SCI Q1)
    CiteScore: 23.5, Top 2% (Q1)
    Google Scholar h5-index: 77， TOP 5
Turn off MathJax
Article Contents
Article Navigation >  IEEE/CAA Journal of Automatica Sinica  > 2019  >  6(3): 716-732
Renran Tian, Keyu Ruan, Lingxi Li, Jialiang Le, Jeff Greenberg and Saeed Barbat, "Standardized Evaluation of Camera-based Driver State Monitoring Systems," IEEE/CAA J. Autom. Sinica, vol. 6, no. 3, pp. 716-732, May 2019. doi: 10.1109/JAS.2019.1911483
Citation: Renran Tian, Keyu Ruan, Lingxi Li, Jialiang Le, Jeff Greenberg and Saeed Barbat, "Standardized Evaluation of Camera-based Driver State Monitoring Systems," IEEE/CAA J. Autom. Sinica, vol. 6, no. 3, pp. 716-732, May 2019. doi: 10.1109/JAS.2019.1911483
shu

Standardized Evaluation of Camera-based Driver State Monitoring Systems

doi: 10.1109/JAS.2019.1911483
  • 1.

    Transportation Active Safety Institute (TASI), and also with the Department of Computer Information and Graphics Technology, Purdue School of Engineering and Technology, Indiana University-Purdue University Indianapolis (IUPUI), 799 West Michigan Street, ET-309R, Indianapolis, IN 46202 USA

  • 2.

    Transportation Active Safety Institute (TASI), and also with the Department of Electrical and Computer Engineering, Purdue School of Engineering and Technology, Indiana University-Purdue University Indianapolis (IUPUI), 723 West Michigan Street, SL-160, Indianapolis, IN 46202 USA

  • 3.

    Ford Research and Innovation Center, 2101 Village Road, Dearborn, MI 48124 USA

Funds:  This work was supported by Ford Motor Company Research and Innovation Center
More Information
    Abstract
  • Driver state sensing technologies, such as vehicular systems, start to be widely considered by automotive manufacturers. To reduce the cost and minimize the intrusiveness towards driving, the majority of these systems rely on the in-cabin camera(s) and other optical sensors. With their great capabilities in detecting and intervening of driver distraction and inattention, these technologies may become key components in future vehicle safety and control systems. However, to the best of our knowledge, currently, there is no common standard available to objectively compare the performance of these technologies. Thus, it is imperative to develop one standardized process for evaluation purposes. In this paper, we propose one systematic and standardized evaluation process after successfully addressing three difficulties: 1) defining and selecting the important influential individual and environmental factors, 2) countering the effects of individual differences and randomness in driver behaviors, and 3) building a reliable in-vehicle driver head motion tracking tool to collect ground-truth motion data. We have collected data on a large scale on a commercial driver state-sensing platform. For each subject, 30 to 40 minutes of head motion data was collected and included variables, such as lighting conditions, head/face features, and camera locations. The collected data was analyzed based on a proposed performance measure. The results show that the developed process can efficiently evaluate an individual camera-based driver state sensing product, which builds a common base for comparing the performance of different systems.

     

    • FullText(HTML)
  • loading
    • References(31)
  • [1]
    T. Liu, H. Yu, H. Guo, Y. Qin, and Y. Zou, "Online energy management for multimode plug-in hybrid electric vehicles, " IEEE Transactions on Industrial Informatics, 2018, DOI: 10.1109/TⅡ.2018.2880897
    [2]
    T. Liu, B. Wang, and C. Yang, "Online markov chain-based energy management for a hybrid tracked vehicle with speedy Q-learning, " Energy, vol. 160, 2018, pp. 544-555. doi: 10.1016/j.energy.2018.07.022
    [3]
    NHTAS (National Highway Traffic Safety Administration), "Distracted Driving: 2015, " in Traffic Safety Research Notes, DOT HS 812 381, 2017.
    [4]
    L. Yekhshatyan and J. D. Lee, "Changes in the correlation between eye and steering movements indicate driver distraction, " IEEE Transactions on Intelligent Transportation Systems, vol. 14, no. 1, pp. 136-145, March 2013.
    [5]
    R. Tian, L. Li, M. Chen, Y. Chen, and G. J. Witt, "Studying the effects of driver distraction and traffic density on the probability of crash and near-crash events in naturalistic driving environment, " IEEE Transactions on Intelligent Transportation Systems, vol. 14, no. 3, pp. 1547-1555, September 2013.
    [6]
    P. Hermannstadter and B. Yang, "Driver distraction assessment using driver modeling, " in Proc. IEEE Int Conference on Systems, Man, and Cybernetics, 2013.
    [7]
    G. K. Kountouriotis and N. Merat, "Leading to distraction: Driver distraction, lead car, and road environment, " Accident Analysis and Prevention, vol. 89, 2016, 22-30. doi: 10.1016/j.aap.2015.12.027
    [8]
    O. Dehzangi and C. Williams, "Towards multi-modal wearable driver monitoring: Impact of road condition on driver distraction, " in Proc. IEEE Intl. Conference on Wearable and Implantable Body Sensor Networks, 2015.
    [9]
    R. Oyini Mbouna, S. G. Kong, and C. Myung-Geun, "Visual analysis of eye state and head pose for driver alertness monitoring, " IEEE Transactions on Intelligent Transportation Systems, vol. 14, no. 3, pp. 1462-1469, September 2013.
    [10]
    A. Tawari, S. Martin, and M. M. Trivedi, "Continuous head movement estimator for driver assistance: Issues, algorithms, and on-road evaluations, " IEEE Transactions on Intelligent Transportation Systems, vol. 15, no. 2, pp. 818-830, April 2014.
    [11]
    H. B. Qin and J. W. Lin, "Detecting driver drowsiness and distraction via FFT, " in Proc. IEEE Int Conference on Signal Processing, Communications and Computing, 2011.
    [12]
    S. Maralappanavar, R. Behera, and U. Mudenagudi, "Driver's distraction detection based on gaze estimation, " in Proc. IEEE Int Conference on Advances in Computing, Communications and Informatics, 2016.
    [13]
    V. Paruchuri and A. Kumar, "Detecting driver distraction using smartphones, " in Proc. IEEE 29th Int Conference on Advanced Information Networking and Applications, 2015.
    [14]
    X. Fu, X. Guan, E. Peli, H. Liu, and G. Luo, "Automatic calibration method for driver's head orientation in natural driving environment, " IEEE Transactions on Intelligent Transportation Systems, vol. 14, no. 1, pp. 303-312, March 2013.
    [15]
    F. Vicente, Z. Huang, X. Xiong, F. De la Torre, W. Zhang, and D. Levi, "Driver gaze tracking and eyes off the road detection system, " IEEE Transactions on Intelligent Transportation Systems, vol. 16, no. 4, pp. 2014-2027, August 2015.
    [16]
    A. Azman, S. Z. Ibrahim, Q. G. Meng, and E. A. Edirisinghe, "Physiological measurement used in real time experiment to detect driver cognitive distraction, " in Proc. IEEE Int Conference on Electronics, Information and Communications, 2014.
    [17]
    R. Manoharan and S.Chandrakala, "Android OpenCV based effective driver fatigue and distraction monitoring system", in Proc. IEEE Int Conference on Computing and Communications Technologies, 2015.
    [18]
    A. Narayanan, R. M. Kaimal, and K. Bijlani, "Estimation of driver head yaw angle using a generic geometric model, " IEEE Transactions on Intelligent Transportation Systems, vol. 17, no. 12, pp. 3446-3460, December 2016.
    [19]
    M. Nekoui, D. Ni, H. Pishro-Nik, R. Prasad, M. R. Kanjee, H. Zhu and T. Nguyen, "Development of a Ⅶ-enabled prototype intersection collision warning system, " in Proc. 5th Int Conference on Testbeds and Research Infrastructures for the Development of Networks Communities and Workshops, 2009.
    [20]
    J.-R. Lin, T. Talty, and O. K. Tonguz, "A blind zone alert system based on intra-vehicular wireless sensor networks, " IEEE Transactions on Industrial Informatics, vol. 11, no. 2, pp. 476-484, April 2015.
    [21]
    S. L. Gallahan, G. F. Golzar, A. P. Jain, A. E. Samay, T. J. Trerotola, J. G. Weisskopf, and N. Lau, "Detecting and mitigating driver distraction with motion capture technology: Distracted driving warning system, " in Proc. IEEE Systems and Information Engineering Design Symposium, University of Virginia, Charlottesville, VA, USA, 2013.
    [22]
    C. Ahlstrom, K. Kircher, and A. Kircher, "A gaze-based driver distraction warning system and its effect on visual behavior, " IEEE Transactions on Intelligent Transportation Systems, vol. 14, no. 2, pp. 965-973, June 2013.
    [23]
    G. Abe, M. Itoh, and T. Yamamura, "Visual distraction when driving and its influence on driver response to a forward collision warning system, " in Proc.SICE Annual Conference, 2011, Tokyo, Japan.
    [24]
    C. Cabrall, N. Janssen, J. Goncalves, A. Morando, M. Sassman, and J. de Winter, "Eye-based driver state monitor of distraction, drowsiness, and cognitive load for transitions of control in automated driving, " in Proc. IEEE International Conference on Systems, Man, and Cybernetics, 2016, Budapest, Hungary.
    [25]
    B. Wijayasinghe, E. Aulisa, U. Büttner, B. K. Ghosh, S. Glasauer, and O. Kremmyda, "Potential and optimal target fixating control of the human head/eye complex, " IEEE Transactions on Control Systems Technology, vol. 23, no. 2, pp. 796-804, March 2015.
    [26]
    B. Fleming, "New technologies for automotive electronics", IEEE Vehicular Technology Magazine, vol. 7, no. 4, pp. 4-12, December 2012.
    [27]
    K. Shoemake, "Euler angle conversion, " in Graphics Gems Ⅳ (Paul S. Heckbert, Ed.), pp. 222-229, 1994.
    [28]
    National Highway Traffic Safety Administration (NHTSA), "Visual-Manual NHTSA Driver Distraction Guidelines for In-Vehicle Electronic Devices, " US DOT Docket No. NHTSA-2010-0053, 2012, access online: https://www.nhtsa.gov/sites/nhtsa.dot.gov/files/distraction_npfg-02162012.pdf
    [29]
    R. D. De Veaux, P. F. Velleman, and D. E. Bock, "Intro Stats, " 5th edition, Boston MA: Pearson
    [30]
    K. Pearson, "Notes on regression and inheritance in the case of two parents, " Proceedings of the Royal Society of London, vol. 58, pp. 240-242, June 1895.
    [31]
    J. W. Tukey, "Comparing Individual Means in the Analysis of Variance, " International Biometric Society, vol. 5, no. 2, June, 1949, pp. 99-114
    • Related Articles
    • Supplements(0)

Catalog

    通讯作者: 陈斌, bchen63@163.com
    • 1. 

      沈阳化工大学材料科学与工程学院 沈阳 110142

    1. 本站搜索
    2. 百度学术搜索
    3. 万方数据库搜索
    4. CNKI搜索

    Figures(20)  / Tables(9)

    Get Citation
    PDF
    XML

    Article Metrics

    Article views (2083) PDF downloads(47) Cited by()

    /

    DownLoad:  Full-Size Img  PowerPoint
    Return
    Return