Parallel Planning: A New Motion Planning Framework for Autonomous Driving

Long Chen; Xuemin Hu; Wei Tian; Hong Wang; Dongpu Cao; Fei-Yue Wang

doi:10.1109/JAS.2018.7511186

Volume 6 Issue 1

Jan. 2019

IEEE/CAA Journal of Automatica Sinica

JCR Impact Factor: 15.3, Top 1 (SCI Q1)

CiteScore: 23.5, Top 2% (Q1)
Google Scholar h5-index: 77， TOP 5

Turn off MathJax

Article Contents

Article Navigation > IEEE/CAA Journal of Automatica Sinica > 2019 > 6(1): 236-246

Long Chen, Xuemin Hu, Wei Tian, Hong Wang, Dongpu Cao and Fei-Yue Wang, "Parallel Planning: A New Motion Planning Framework for Autonomous Driving," IEEE/CAA J. Autom. Sinica, vol. 6, no. 1, pp. 236-246, Jan. 2019. doi: 10.1109/JAS.2018.7511186

Citation:

Long Chen, Xuemin Hu, Wei Tian, Hong Wang, Dongpu Cao and Fei-Yue Wang, "Parallel Planning: A New Motion Planning Framework for Autonomous Driving," IEEE/CAA J. Autom. Sinica, vol. 6, no. 1, pp. 236-246, Jan. 2019. doi: 10.1109/JAS.2018.7511186

Citation:

PDF( 27316 KB)

Parallel Planning: A New Motion Planning Framework for Autonomous Driving

doi: 10.1109/JAS.2018.7511186

Long Chen^1
,,
Xuemin Hu^{2
,
,},
Wei Tian^3
,,
Hong Wang^4
,,
Dongpu Cao^4
,,
Fei-Yue Wang^5
,

1.
School of Data and Computer Science, Sun Yat-sen University, Guangzhou 510275, China
2.
School of Computer Science and Information Engineering, Hubei University, Wuhan 430062, China
3.
Institute of Measurement and Control Systems, Karlsruhe Institute of Technology, Karlsruhe 76131, Germany
4.
Department of Mechanical and Mechatronics Engineering, University of Waterloo, 200 University Avenue West, Waterloo, Ontario N2L3G1, Canada
5.
State Key Laboratory of Management and Control for Complex Systems. Institute of Automation, Chinese Academy of Sciences, China, and also with the Research Center for Military Computational Experiments and Parallel Systems Technology, National University of Defense Technology, Changsha 410073, China

Funds:

the National Natural Science Foundation of China 61773414

the National Natural Science Foundation of China 61806076

Hubei Provincial Natural Science Foundation of China 2018CFB158

More Information

Author Bio:
Long Chen (SM'18) received the Ph.D. degree in signal and information processing from Wuhan University, Wuhan China, in 2013. From October 2010 to November 2012, he was co-trained Ph.D. Student at National University of Singapore. He is currently an Associate Professor with School of Data and Computer Science, Sun Yat-sen University, Guangzhou, China. He received the IEEE Vehicular Technology Society 2018 Best Land Transportation Paper Award, IEEE Intelligent Vehicle Symposium 2018 Best Student Paper Award and Best Workshop Paper Award. His interests include autonomous driving, robotics, artificial intelligence where he has contributed more than 50 publications. He serves as an Associate Editor for IEEE Technical Committee on Cyber-Physical Systems newsletter and Guest Editor for IEEE Transactions on Intelligent Vehicles. e-mail: chenl46@mail.sysu.edu.cn

Xuemin Hu received the B.Eng. degree in biomedical engineering from Huazhong University of Science and Technology and the Ph.D. degree in signal and information processing from Wuhan University in 2007 and in 2012, respectively. He was a visiting scholar in the University of Rhode Island, Kingston, RI, US from November 2015 to May 2016. He is currently an Associate Professor of School of Computer Science and Information Engineering, Hubei University, Wuhan China. His research interests include motion planning, computer vision and autonomous driving. e-mail: huxuemin2012@hubu.edu.cn

Wei Tian received the B.Sc degree in mechatronics engineering from Tongji University, Shanghai, China, in 2010. From October 2010, he was with the Department of Electrical Engineering and Information Technology at KIT, Karlsruhe, Germany, and received the M.Sc. degree in May 2013. He is currently working toward the Ph.D. degree at the Institute of Measurement and Control Systems at KIT. His research interests include robust object detection and tracking. e-mail: wei.tian@kit.edu

Hong Wang received the Ph.D. degree in Beijing Institute of Technology in China in 2015. Her research focuses on the component sizing, modeling of hybrid powertrains and power management control strategies design for hybrid electric vehicles; intelligent control theory and application; path planning for autonomous vehicles. e-mail: hong.wang@uwaterloo.ca

Dongpu Cao (M'08) received the Ph.D. degree from Concordia University, Canada, in 2008. He is currently a Senior Lecturer at Advanced Vehicle Engineering Center, Cranfield University, UK. His research focuses on vehicle dynamics, control and intelligence, where he has contributed more than 90 publications and 1 US patent. He received the ASME AVTT 2010 Best Paper Award and 2012 SAE Arch T. Colwell Merit Award. Dr. Cao serves as an Associate Editor for IEEE Transactions on Intelligent Transportation Systems, IEEE Transactions on Vehicular Technology, IEEE Transactions on Industrial Electronics and ASME Journal of Dynamic Systems, Measurement, and Control. He has been a Guest Editor for IEEE/ASME Transactions on Mechatronics, Vehicle System Dynamics, and IEEE Transactions on Human-Machine Systems. He serves on the SAE International Vehicle Dynamics Standards Committee and a few ASME, SAE, IEEE technical committees. e-mail: dongpu@uwaterloo.ca

Fei-Yue Wang (S'87-M'89-SM'94-F'03) received his Ph.D. in computer and systems engineering from Rensselaer Polytechnic Institute, Troy, New York in 1990. He joined the University of Arizona in 1990 and became a Professor and Director of the Robotics and Automation Lab (RAL) and Program in Advanced Research for Complex Systems (PARCS). In 1999, he founded the Intelligent Control and Systems Engineering Center at the Institute of Automation, Chinese Academy of Sciences (CAS), Beijing, China, under the support of the Outstanding Overseas Chinese Talents Program from the State Planning Council and 100 Talent Program from CAS, and in 2002, was appointed as the Director of the Key Lab of Complex Systems and Intelligence Science, CAS. From 2006 to 2010, he was Vice President for Research, Education, and Academic Exchanges at the Institute of Automation, CAS. In 2011, he became the State Specially Appointed Expert and the Director of the State Key Laboratory of Management and Control for Complex Systems. Dr. Wangs research focuses on methods and applications for parallel systems, social computing, and knowledge automation. He was the Founding Editor-in-Chief of the International Journal of Intelligent Control and Systems (1995-2000), Founding EiC of IEEE ITS Magazine (2006-2007), EiC of IEEE Intelligent Systems (2009-2012), and EiC of IEEE Transactions on ITS (2009-2016). Currently he is EiC of IEEE Transactions on Computational Social Systems, Founding EiC of IEEE/CAA Journal of Automatica Sinica, and Chinese Journal of Command and Control. Since 1997, he has served as General or Program Chair of more than 20 IEEE, INFORMS, ACM, and ASME conferences. He was the President of IEEE ITS Society (2005-2007), Chinese Association for Science and Technology (CAST, USA) in 2005, the American Zhu Kezhen Education Foundation (2007-2008), and the Vice President of the ACM China Council (2010-2011). Since 2008, he has been the Vice President and Secretary General of Chinese Association of Automation. Dr. Wang has been elected as Fellow of IEEE, INCOSE, IFAC, ASME, and AAAS. In 2007, he received the National Prize in Natural Sciences of China and was awarded the Outstanding Scientist by ACM for his research contributions in intelligent control and social computing. He received IEEE ITS Outstanding Application and Research Awards in 2009, 2011 and 2015, and IEEE SMC Norbert Wiener Award in 2014. e-mail: feiyue.wang@ia.ac.cn
Corresponding author: Xuemin Hu, e-mail: huxuemin2012@hubu.edu.cn
Received Date: 2017-11-21
Revised Date: 2018-03-08
Accepted Date: 2018-04-06

Abstract

Abstract

Motion planning is one of the most significant technologies for autonomous driving. To make motion planning models able to learn from the environment and to deal with emergency situations, a new motion planning framework called as "parallel planning" is proposed in this paper. In order to generate sufficient and various training samples, artificial traffic scenes are firstly constructed based on the knowledge from the reality. A deep planning model which combines a convolutional neural network (CNN) with the Long Short-Term Memory module (LSTM) is developed to make planning decisions in an end-toend mode. This model can learn from both real and artificial traffic scenes and imitate the driving style of human drivers. Moreover, a parallel deep reinforcement learning approach is also presented to improve the robustness of planning model and reduce the error rate. To handle emergency situations, a hybrid generative model including a variational auto-encoder (VAE) and a generative adversarial network (GAN) is utilized to learn from virtual emergencies generated in artificial traffic scenes. While an autonomous vehicle is moving, the hybrid generative model generates multiple video clips in parallel, which correspond to different potential emergency scenarios. Simultaneously, the deep planning model makes planning decisions for both virtual and current real scenes. The final planning decision is determined by analysis of real observations. Leveraging the parallel planning approach, the planner is able to make rational decisions without heavy calculation burden when an emergency occurs.
- Autonomous driving,
- artificial traffic scene,
- deep learning,
- emergencies,
- motion planning,
- parallel planning

FullText(HTML)

References(37)

References

[1]	M. L. Cummings and S Guerlain, "Developing operator capacity estimates for supervisory control of autonomous vehicles, " Hum. Factors, vol. 49, no. 1, pp. 1-15, Feb. 2007. http://med.wanfangdata.com.cn/Paper/Detail/PeriodicalPaper_PM17315838
[2]	X. S. Hu, H. Wang, and X. L. Tang, "Cyber-physical control for energy-saving vehicle following with connectivity, " IEEE Trans. Ind. Electron., vol. 64, no. 11, pp. 8578-8587, Nov. 2017. http://ieeexplore.ieee.org/document/7926369/
[3]	C. Katrakazas, M. Quddus, W. H. Chen, and L. Deka, "Real-time motion planning methods for autonomous on-road driving: State-of-the-art and future research directions, " Transport. Res. C, vol. 60, pp. 416-442, Nov. 2015. http://www.sciencedirect.com/science/article/pii/S0968090X15003447
[4]	S. M. Zhang, W. W. Deng, Q. R. Zhao, H. Sun, and B. Litkouhi, "Dynamic trajectory planning for vehicle autonomous driving, " in Proc. IEEE Int. Conf. Systems, Man, and Cybernetics, Manchester, UK, 2013, pp. 4161-4166. http://ieeexplore.ieee.org/document/6722462/
[5]	L. Zuo, Q. Guo, X. Xu, and H. Fu, "A hierarchical path planning approach based on A* and least-squares policy iteration for mobile robots, " Neurocomputing, vol. 170, pp. 257-266, Dec. 2015. http://dl.acm.org/citation.cfm?id=2827268
[6]	R. X. Cui, Y. Li, and W. S. Yan, "Mutual information-based Multi-AUV path planning for scalar field sampling using multidimensional RRT, " IEEE Trans. Syst., Man, Cybern.: Syst., vol. 46, no. 7, pp. 993-1004, Jul. 2016. http://ieeexplore.ieee.org/document/7345594
[7]	X. M. Hu, L. Chen, B. Tang, D. P. Cao, and H. B. He, "Dynamic path planning for autonomous driving on various roads with avoidance of static and moving obstacles, " Mech. Syst. Signal Process., vol. 100, pp. 482-500, Feb. 2018.
[8]	S. M. LaValle, Planning Algorithms. Cambridge: Cambridge University Press, 2006.
[9]	K. Fragkiadaki, P. Agrawal, S. Levine, and J. Malik, "Learning visual predictive models of physics for playing billiards, " arXiv: 1511.07404, 2015. http://arxiv.org/abs/1511.07404
[10]	W. Z. Hu, Q. Zhuo, C. S. Zhang, and J. K. Li, "Fast branch convolutional neural network for traffic sign recognition, " IEEE Intellig. Transport. Syst. Mag., vol. 9, no. 3, pp. 114-126, Jul. 2017. http://ieeexplore.ieee.org/document/7990644/
[11]	M. Kurdej, J. Moras, V. Cherfaoui, and P. Bonnifait, "Map-aided evidential grids for driving scene understanding, " IEEE Intellig. Transport. Syst. Mag., vol. 7, no. 1, pp. 30-41, Jan. 2015. http://ieeexplore.ieee.org/xpls/icp.jsp?arnumber=7014409
[12]	T. Gindele, S. Brechtel, and R. Dillmann, "Learning driver behavior models from traffic observations for decision making and planning, " IEEE Intellig. Transport. Syst. Mag., vol. 7, no. 1, pp. 69-79, Jan. 2015. http://ieeexplore.ieee.org/xpls/icp.jsp?arnumber=7014400
[13]	M. Pfeiffer, M. Schaeuble, J. Nieto, R. Siegwart, and C. Cadena, "From perception to decision: A data-driven approach to end-to-end motion planning for autonomous ground robots, " in Proc. IEEE Int. Conf. Robotics and Automation (ICRA), Singapore, 2017, pp. 1527-1533. http://arxiv.org/abs/1609.07910
[14]	F. Y. Wang, "Artificial societies, computational experiments, and parallel systems: A discussion on computational theory of complex social-economic systems, " Complex Syst. Complex. Sci., vol. 1, no. 4, pp. 25-35, Apr. 2004.
[15]	F. Y. Wang, "Parallel system methods for management and control of complex systems, " Control Decision, vol. 19, no. 5, pp. 485-484, May 2004. http://en.cnki.com.cn/Article_en/CJFDTotal-KZYC200405001.htm
[16]	F. Y. Wang, "Agent-based control for networked traffic management systems, " IEEE Intellig. Syst., vol. 20, no. 5, pp. 92-96, Sep.-Oct. 2005. http://openurl.ebscohost.com/linksvc/linking.aspx?stitle=IEEE%20Intelligent%20Systems&volume=20&issue=5&spage=92
[17]	F. Y. Wang, "Toward a revolution in transportation operations: AI for complex systems, " IEEE Intellig. Syst., vol. 23, no. 6, pp. 8-13, Nov.-Dec. 2008. http://openurl.ebscohost.com/linksvc/linking.aspx?stitle=IEEE%20Intelligent%20Systems&volume=23&issue=6&spage=8
[18]	N. Zhang, F. Y. Wang, F. H. Zhu, D. B. Zhao, and S. M. Tang, "DynaCAS: Computational experiments and decision support for ITS, " IEEE Intellig. Syst., vol. 23, no. 6, pp. 19-23, Nov.-Dec. 2008. http://gateway.proquest.com/openurl?res_dat=xri:pqm&ctx_ver=Z39.88-2004&rfr_id=info:xri/sid:baidu&rft_val_fmt=info:ofi/fmt:kev:mtx:article&genre=article&jtitle=IEEE%20Intelligent%20Systems&atitle=DynaCAS%3A%20Computational%20Experiments%20and%20Decision%20Support%20for%20ITS
[19]	F. Y. Wang, "The emergence of intelligent enterprises: From CPS to CPSS, " IEEE Intellig. Syst., vol. 25, no. 4, pp. 85-88, Jul.-Aug. 2010. http://openurl.ebscohost.com/linksvc/linking.aspx?stitle=IEEE%20Intelligent%20Systems&volume=25&issue=4&spage=85
[20]	F. Y. Wang, "Parallel control and management for intelligent transportation systems: concepts, architectures, and applications, " IEEE Trans. Intellig. Transport. Syst., vol. 11, no. 3, pp. 630-638, Sep. 2010. http://ieeexplore.ieee.org/document/5549912/
[21]	F. Y. Wang, "Agent-based control strategies for smart and safe vehicles, " in Proc. IEEE Int. Conf. Vehicular Electronics and Safety, Shaan'xi, China, 2005, pp. 331-332.
[22]	F. Y. Wang, "Scanning the issue and beyond: Parallel driving with software vehicular robots for safety and smartness, " IEEE Trans. Intellig. Transport. Syst., vol. 15, no. 4, pp. 1381-1387, Aug. 2014. http://ieeexplore.ieee.org/xpls/abs_all.jsp?arnumber=6871456
[23]	T. X. Bai, S. Wang, Z. Shen, D. P. Cao, N. N. Zheng, and F. Y. Wang, "Parallel robotics and parallel unmanned systems: framework, structure, process, platform and applications, " Acta Autom. Sinica, vol. 43, no. 2, pp. 161-175, Feb. 2017. http://www.en.cnki.com.cn/Article_en/CJFDTOTAL-MOTO201702001.htm
[24]	F. Y. Wang, N. N. Zheng, D. P. Cao, C. M. Martinez, L. Li, and T. Liu, "Parallel driving in CPSS: A unified approach for transport automation and vehicle intelligence, " IEEE/CAA J. Autom. Sinica, vol. 4, no. 4, pp. 577-587, Sep. 2017. http://www.cnki.com.cn/Article/CJFDTotal-ZDHB201704001.htm
[25]	[25 K. F. Wang, C. Gou, and F. Y. Wang, "Parallel vision: An ACP-based approach to intelligent vision computing, " Acta Autom. Sinica, vol. 42, no. 10, pp. 1490-1500, Oct. 2016. http://www.en.cnki.com.cn/Article_en/CJFDTOTAL-MOTO201610003.htm
[26]	P. Furgale and T. D. Barfoot, "Visual teach and repeat for long-range rover autonomy, " J. Field Robot., vol. 27, no. 5, pp. 534-560, Sep.-Oct. 2010. http://openurl.ebscohost.com/linksvc/linking.aspx?stitle=Journal%20of%20Field%20Robotics&volume=27&issue=5&spage=534
[27]	M. Mathieu, C. Couprie, and Y. Lecun, "Deep multi-scale video prediction beyond mean square error, " arXiv: 1511.05440, 2015. http://arxiv.org/abs/1511.05440
[28]	C. Y. Zhang and Y. L. Tian, "Automatic video description generation via LSTM with joint two-stream encoding, " in Proc. 23rd Int. Conf. Pattern Recognition, Cancun, Mexico, 2016, pp. 2924-2929. http://ieeexplore.ieee.org/document/7900081/
[29]	D. P. Kingma and M. Welling, "Auto-encoding Variational Bayes, " In Proc. 2nd Int. Conf. Learning Representations (ICLR), Ithaca, NY, 2014. http://arxiv.org/abs/1312.6114
[30]	Y. C. Pu, Z. Gan, R. Henao, X. Yuan, C. Y. Li, A. Stevens, and L. Carin, "Variational autoencoder for deep learning of images, labels and captions, " in Proc. 29th Conf. Neural Information Processing Systems (NIPS), Barcelona, Spain, 2016. http://arxiv.org/abs/1609.08976
[31]	E. Santana, M. Emigh, and J. C. Principe, "Information theoretic-learning auto-encoder, " in Proc. Int. Joint Conf. Neural Networks, Vancouver, BC, Canada, 2016, pp. 3296-3301. http://ieeexplore.ieee.org/document/7727620/
[32]	I. Goodfellow, J. Pouget-Abadie, M. Mirza, B. Xu, D. Warde-Farley, S. Ozair, A. Courville, and Y. Bengio, "Generative adversarial nets, " in Advances in Neural Information Processing Systems 27, Montreal, Quebec, Canada, 2014, pp. 2672-2680. http://dl.acm.org/citation.cfm?id=2969125
[33]	A. Radford, L. Metz, and S. Chintala, "Unsupervised representation learning with deep convolutional generative adversarial networks, " arXiv: 1511.06434, 2015. http://arxiv.org/abs/1511.06434
[34]	E. Denton, S. Chintala, A. Szlam, and R. Fergus, "Deep generative image models using a laplacian pyramid of adversarial networks, " arXiv: 1506.05751, 2015. http://dl.acm.org/citation.cfm?id=2969239.2969405
[35]	C. Vondrick, H. Pirsiavash, and A. Torralba, "Generating videos with scene dynamics, " in Advances in Neural Information Processing Systems 29, Barcelona, Spain, 2016, pp. 613-621. http://arxiv.org/abs/1609.02612
[36]	E. Santana and G. Hotz, "Learning a driving simulator, " arXiv: 1608.01230, 2016. http://arxiv.org/abs/1608.01230
[37]	S. Sivaraman and M. M. Trivedi, "Looking at vehicles on the road: A survey of vision-based vehicle detection, tracking, and behavior analysis, " IEEE Trans. Intellig. Transport. Syst., vol. 14, no. 4, pp. 1773-1795, Dec. 2013. http://ieeexplore.ieee.org/document/6563169/

Supplements(0)

Cited By

Proportional views

Proportional views

通讯作者: 陈斌, bchen63@163.com

1.
沈阳化工大学材料科学与工程学院沈阳 110142

Figures(11)

Get Citation

PDF

XML

Article Metrics

Article views (2475) PDF downloads(149)

Parallel Planning: A New Motion Planning Framework for Autonomous Driving

doi: 10.1109/JAS.2018.7511186

Abstract

References

Proportional views

Catalog

通讯作者: 陈斌, bchen63@163.com

Article Metrics

Export File

Citation

Format

Content