Intent Pattern Recognition of Lower-limb Motion Based on Mechanical Sensors

Zuojun Liu; Wei Lin; Yanli Geng; Peng Yang

doi:10.1109/JAS.2017.7510619

Volume 4 Issue 4

Oct. 2017

IEEE/CAA Journal of Automatica Sinica

JCR Impact Factor: 15.3, Top 1 (SCI Q1)

CiteScore: 23.5, Top 2% (Q1)
Google Scholar h5-index: 77， TOP 5

Turn off MathJax

Article Contents

Article Navigation > IEEE/CAA Journal of Automatica Sinica > 2017 > 4(4): 651-660

Zuojun Liu, Wei Lin, Yanli Geng and Peng Yang, "Intent Pattern Recognition of Lower-limb Motion Based on Mechanical Sensors," IEEE/CAA J. Autom. Sinica, vol. 4, no. 4, pp. 651-660, Oct. 2017. doi: 10.1109/JAS.2017.7510619

Citation:

Zuojun Liu, Wei Lin, Yanli Geng and Peng Yang, "Intent Pattern Recognition of Lower-limb Motion Based on Mechanical Sensors," IEEE/CAA J. Autom. Sinica, vol. 4, no. 4, pp. 651-660, Oct. 2017. doi: 10.1109/JAS.2017.7510619

Citation:

PDF( 16816 KB)

Intent Pattern Recognition of Lower-limb Motion Based on Mechanical Sensors

doi: 10.1109/JAS.2017.7510619

Zuojun Liu^{1, 2
,
,},
Wei Lin^3
,,
Yanli Geng^1
,,
Peng Yang^1
,

1.
School of Control Science and Engineering, Hebei University of Technology, Tianjin 300130, China
2.
Engineering Research Center of Intelligent Rehabilitation, Ministry of Education, Tianjin 300130, China
3.
Department of Electrical Engineering and Computer Science, Case Western Reserve University, Cleveland, OH 44106, USA

Funds:

the National Nature Science Fundation 61174009

the National Nature Science Fundation 61203323

Youth Foundation of Hebei Province F2016202327

the Colleges and Universities in Hebei Province Science and Technology Research Project ZC2016020

Wei Lin's work was supported in part by Key Project of NSFC 61533009

111 Project B08015

Research Project JCYJ20150403161923519

More Information

Author Bio:
Zuojun Liu received the B.S.degree in the automation from Hebei University of Technology, Tianjin, China, in 1994, and M.S degree in the control theory and control engineering from Hebei University of Technology, Tianjin, China, in 2000, and B.A of English from Nankai University, Tianjin, China, in 2000, and Ph.D degree in the control theory and control engineering from Nankai University, Tianjin, China, in 2004.He completed his visiting scholar research at Nanyang Technological University, Singapore, in 2004 and CASE Western Reserve University, U.S in 2013, respectively.He is currently a Professor at the School of Control Science and Engineering, Hebei University of Technology.He is also with the Engineering Research Center of Intelligent Rehabilitation, Ministry of Education of China.His research interests include rehabilitation engineering, robotics, learning control, intelligent building and smart grid, (e-mail: liuzuojun@hebut.edu.cn)

Wei Lin received the D.Sc.and M.S.degrees in systems science and mathematics from Washington University, St.Louis, MO, USA, in 1993 and 1991, M.S.degree from Huazhong University of Science and Technology in 1986 and B.S.from Dalian University of Science and Technology in 1983, both in electrical engineering.During 1986-1989, he was a Lecturer in the Department of Mathematics, Fudan University, Shanghai, China.From 1994 to 1995, he was a Post-doctor and a Visiting Assistant Professor in Washington University.Since Spring of 1996, he has been a Professor in the Department of Electrical Engineering and Computer Science, Case Western Reserve University, Cleveland, OH, USA.His current research interests include nonlinear control, time-delay systems, homogeneous systems theory, estimation and adaptive control, renewable energy, power systems and smart grids.In these areas, he has published more than 200 papers in peer-refereed journals and conferences.
Dr.Lin was a recipient of the NSF CAREER Award, the Warren E.Rupp Endowed Professorship, and the Robert Herbold Faculty Fellow Award.He served as an Associate Editor of the IEEE Trans.on Automa.Contr.(1999-2002), a Guest Editor of the Special Issue on New Directions in Nonlinear Control in the IEEE Trans.on Automatic Control (2003), an Associate Editor of Automatica (2003-2005), an Associate Editor of Journal of Control Theory and Applications (2005-2008), a Subject Editor (2005-2010) and Associate Editor (2011-present) of the Int.J.of Robust and Nonlinear Control, (e-mail: linwei@case.edu)

Yanli Geng received the B.S.degree in the control technology and instruments from Agricultural University of Hebei, Hebei, China, in 2006, and M.S degree in the control theory and control engineering from Hebei University of Technology, Tianjin, China, in 2009, and Ph.D degree in the control theory and control engineering from Hebei University of Technology, Tianjin, China, in 2012.She is currently a Lecturer at the School of Control Science and Engineering, Hebei University of Technology.She is also with the Engineering Research Center of Intelligent Rehabilitation, Ministry of Education of China.Her research interests include rehabilitation engineering, intelligent control and robotics, (e-mail: gengyanli318813@163.com)

Peng Yang received the B.S.degree in the automation from Hebei University of Technology, Tianjin, China, in 1982, and M.S degree in the control theory and control engineering from Haerbing Institute of Technology, Heilongjiang, China, in 1986, and Ph.D degree in the electrical engineering from Hebei University of Technology, Tianjin, China, in 1998.He completed his visiting scholar research at Technical University of Munich, Germany, in 2005.He is currently a Professor at the School of Control Science and Engineering, Hebei University of Technology.He is also with the Engineering Research Center of Intelligent Rehabilitation, Ministry of Education of China.His research interests include rehabilitation engineering, intelligent control and robotics, (e-mail: yphebu@aliyun.com)
Corresponding author: Zuojun Liu, e-mail:liuzuojun@hebut.edu.cn
Received Date: 2016-05-29
Accepted Date: 2017-01-16

Abstract

Abstract

Based on the regularity nature of lower-limb motion, an intent pattern recognition approach for above-knee prosthesis is proposed in this paper. To remedy the defects of recognizer based on electromyogram (EMG), we develop a pure mechanical sensor architecture for intent pattern recognition of lower-limb motion. The sensor system is composed of an accelerometer, a gyroscope mounted on the prosthetic socket, and two pressure sensors mounted under the sole. To compensate the delay in the control of prosthesis, the signals in the stance phase are used to predict the terrain and speed in the swing phase. Specifically, the intent pattern recognizer utilizes intraclass correlation coefficient (ICC) according to the Cartesian product of walking speed and terrain. Moreover, the sensor data are fused via DempsterShafer's theory. And hidden Markov model (HMM) is used to recognize the realtime motion state with the reference of the prior step. The proposed method can infer the prosthesis user's intent of walking on different terrain, which includes level ground, stair ascent, stair descent, up and down ramp. The experiments demonstrate that the intent pattern recognizer is capable of identifying five typical terrain-modes with the rate of 95.8%. The outcome of this investigation is expected to substantially improve the control performance of powered above-knee prosthesis.
- Above-knee prosthesis,
- hidden Markov model (HMM),
- intra-class correlation coefficient (ICC),
- intent pattern recognition,
- sensor fusion

FullText(HTML)

References(34)

References

[1]	H. Huang, T. A. Kuiken, and R. D. Lipschutz, "A strategy for identifying locomotion modes using surface electromyography, " IEEE Trans. Biomed. Eng. , vol. 56, no. 1, pp. 65-73, Jan. 2009. http: //ieeexplore. ieee. org/document/4595659/
[2]	H. A. Varol, F. Sup, and M. Goldfarb, "Multiclass real-time intent recognition of a powered lower limb prosthesis, " IEEE Trans. Biomed. Eng. , vol. 57, no. 3, pp. 542-551, Mar. 2010. http: //www. ncbi. nlm. nih. gov/pubmed/19846361
[3]	P. Yang, Z. J. Liu, Y. L. Geng, and L. N. Zhao, "Research advance on key technology of intelligent lower limb prosthesis, " J. Hebei. Univ. Technol. , vol. 42, no. 1, pp. 76-80, Feb. 2013. http: //en. cnki. com. cn/Article_en/CJFDTotal-HBGB201301013. htm
[4]	J. D. Miller, M. S. Beazer, and M. E. Hahn, "Myoelectric walking mode classification for transtibial amputees, " IEEE Trans. Biomed. Eng. , vol. 60, no. 10, pp. 2745-2750, Oct. 2013. http: //www. ncbi. nlm. nih. gov/pubmed/23708765
[5]	X. R. Zhang, Y. H. Liu, F. Zhang, J. Ren, Y. L. Sun, Q. Yang, and H. Huang, "On design and implementation of neural-machine interface for artificial legs, " IEEE Trans. Industr. Inform. , vol. 8, no. 2, pp. 418-429, May 2012. http: //ieeexplore. ieee. org/document/6009191/
[6]	A. Presacco, L. W. Forrester, and J. L. Contreras-Vidal, "Decoding intra-limb and inter-limb kinematics during treadmill walking from scalp electroencephalographic (EEG) signals, " IEEE Trans. Neural Syst. Rehabil. Eng. , vol. 20, no. 2, pp. 212-219, Mar. 2012. http: //ieeexplore. ieee. org/document/6171068/
[7]	H. Huang, F. Zhang, L. J. Hargrove, Z. Dou, D. R. Rogers, and K. B. Englehart, "Continuous locomotion-mode identification for prosthetic legs based on neuromuscular-mechanical fusion, " IEEE Trans. Biomed. Eng. , vol. 58, no. 10, pp. 2867-2875, Oct. 2011. http: //ieeexplore. ieee. org/document/5951743/
[8]	L. Du, F. Zhang, M. Liu, and H. Huang, "Toward design of an environment-aware adaptive locomotion-mode-recognition system, " IEEE Trans. Biomed. Eng. , vol. 59, no. 10, pp. 2716-2725, Oct. 2012. http: //www. ncbi. nlm. nih. gov/pubmed/22996721
[9]	E. H. Zheng, L. Wang, K. L. Wei, and Q. N. Wang, "A noncontact capacitive sensing system for recognizing locomotion modes of transtibial amputees, " IEEE Trans. Biomed. Eng. , vol. 61, no. 12, pp. 2911-2920, Dec. 2014. http: //ieeexplore. ieee. org/xpls/abs_all. jsp?arnumber=6847122
[10]	A. J. Young, L. J. Hargrove, and T. A. Kuiken, "Improving myoelectric pattern recognition robustness to electrode shift by changing interelectrode distance and electrode configuration, " IEEE Trans. Biomed. Eng. , vol. 59, no. 3, pp. 645-652, Mar. 2012. http: //europepmc. org/articles/PMC4234037/
[11]	Q. C. Ding, A. B. Xiong, X. G. Zhao, and J. D. Han, "A review on researches and applications of sEMG-based motion intent recognition methods, " Acta Automat. Sin. , vol. 42, no. 1, pp. 13-25, Jan. 2016. http: //en. cnki. com. cn/Article_en/CJFDTotal-MOTO201601002. htm
[12]	L. Shen and H. L. Yu, "Development course of prosthetics at home and abroad, " Chin. J. Tiss. Eng. Res. , vol. 16, no. 13, pp. 2451-2454. Mar. 2012. http: //en. cnki. com. cn/Article_en/CJFDTOTAL-XDKF201213045. htm
[13]	Y. L. Geng, Y. Pang, Z. J. Liu, and X. R. Wang, "Walking speed recognition system for transfemoral amputee based on accelerometer and gyroscopes, " in System Simulation and Scientific Computing, Shanghai, China, 2012, pp. 383-389. doi: 10. 1007/978-3-642-34381-0_44
[14]	X. R. Zhang, D. Wang, Q. Yang, and H. Huang, "An automatic and user-driven training method for locomotion mode recognition for artificial leg control, " in Proc. of Annu. Int. Conf. IEEE Engineering in Medicine and Biology Society. San Diego, CA, USA, 2012. http: //www. ncbi. nlm. nih. gov/pubmed/23367324
[15]	Y. Y. Gao, Q. S. She, M. Meng, and Z. Z. Luo, "Recognition method based on multi-information fusion for gait patterns of above-knee prosthesis, " Chin. J. Sci. Instrum. , vol. 31, no. 12, pp. 2682-2688, Dec. 2010. http: //en. cnki. com. cn/Article_en/CJFDTOTAL-YQXB201012006. htm
[16]	F. Sup, H. A. Varol, and M. Goldfarb, "Upslope walking with a Powered knee and ankle prosthesis: initial results with an amputee subject, " IEEE Trans. Neural Syst. Rehabil. Eng. , vol. 19, no. 1, pp. 71-78, Feb. 2011. http: //europepmc. org/abstract/med/20952344
[17]	X. G. Wang, Q. N. Wang, E. H. Zheng, K. L. Wei, and L. Wang, "A wearable plantar pressure measurement system: Design specifications and first experiments with an amputee, " in in Proc. the 12th Int. Conf. Intelligent Autonomous Systems, Jeju Island, Korea, 2012, pp. 273-281. doi: 10. 1007/978-3-642-33932-5_26
[18]	B. J. Chen, E. H. Zheng, X. D. Fan, T. Liang, Q. N. Wang, K. L. Wei, and L. Wang, "Locomotion mode classification using a wearable capacitive sensing system, " IEEE Trans. Neural Syst. Rehabil. Eng. , vol. 21, no. 5, pp. 744-755, Sep. 2013. http: //ieeexplore. ieee. org/document/6517244/
[19]	K. B. Yuan, Q. N. Wang, and L. Wang, "Fuzzy-logic-based terrain identification with multisensor fusion for transtibial amputees, " IEEE/ASME Trans. Mechatron. , vol. 20, no. 2, pp. 618-630, Apr. 2015 http: //ieeexplore. ieee. org/document/6775332/
[20]	A. J. Young, A. M. Simon, and L. J. Hargrove, "A training method for locomotion mode prediction using powered lower limb prostheses, " IEEE Trans. Neural Syst. Rehabil. Eng. , vol. 22, no. 3, pp. 671-677, May 2014. http: //ieeexplore. ieee. org/document/6650103/
[21]	Y. D. Li and E. T. Hsiao-Wecksler, "Gait mode recognition and control for a portable-powered ankle-foot orthosis, " in Proc. 2013 IEEE Int. Conf. Rehabilitation Robotics, Seattle, WA, USA, 2013, pp. 1-8. doi: 10. 1109/ICORR. 2013. 6650373
[22]	G. M. Leigh, "Fast FIR algorithms for the continuous wavelet transform from constrained least squares, " IEEE Trans. Signal Process. , vol. 61, no. 1, pp. 28-37, Jan. 2013. http: //ieeexplore. ieee. org/document/6320705/
[23]	A. G. Polimeridis, and J. R. Mosig, "Evaluation of weakly singular integrals via generalized cartesian product rules based on the double exponential formula, " IEEE Trans. Antennas Propag. , vol. 58, no. 6, pp. 1980-1988, Jun. 2010. http: //ieeexplore. ieee. org/document/5439871/
[24]	A. S. Anna, A. Salarian, and N. Wickstrom, "A new measure of movement symmetry in early parkinson's disease patients using symbolic processing of inertial sensor data, " IEEE Trans Biomed. Eng. , vol. 58, no. 7, pp. 2127-2135, Jul. 2011. http: //www. ncbi. nlm. nih. gov/pubmed/21536527
[25]	M. L. Audu, C. S. To, R. Kobetic, and R. J. Triolo, "Gait evaluation of a novel hip constraint orthosis with implication for walking in paraplegia, " IEEE Trans. Neural Syst. Rehabil. Eng. , vol. 18, no. 6, pp. 610-618, Dec. 2010. http: //www. ncbi. nlm. nih. gov/pubmed/20378478
[26]	A. Arami, A. Barré, R. Berthelin, and K. Aminian, "Estimation of prosthetic knee angles via data fusion of implantable and wearable sensors, " in Proc. of IEEE Int. Conf. Body Sensor Networks, Cambridge, MA, USA, 2013, pp. 1-6. http://ieeexplore.ieee.org/document/6575473/
[27]	A. L. Delis, J. L. A. de Carvalho, G. A. Borges, S. de Siqueira Rodrigues, I. dos Santos, and A. F. da Rocha, "Fusion of electromyographic signals with proprioceptive sensor data in myoelectric pattern recognition for control of active transfemoral leg prostheses, " in Proc. of Annu. Int. Conf. the Engineering in Medicine and Biology Society, Minneapolis, MN, USA, 2009, pp. 4755-4758. http: //www. ncbi. nlm. nih. gov/pubmed/19964650
[28]	R. R. Murphy, "Dempster-Shafer theory for sensor fusion in autonomous mobile robots, " IEEE Trans. Robot. and Automat. , vol. 14, no. 2, pp. 197-206, Apr. 1998. http: //ieeexplore. ieee. org/xpls/abs_all. jsp?arnumber=681240
[29]	S. Foucher, M. Germain, J. M. Boucher, and G. B. Benie, "Multisource classification using ICM and Dempster-Shafer theory, " IEEE Trans. Instrum. Meas. , vol. 51, no. 2, pp. 277-281, Apr. 2002. http: //ieeexplore. ieee. org/xpls/abs_all. jsp?arnumber=997824
[30]	F. Delmotte and P. Smets, "Target identification based on the transferable belief model interpretation of Dempster-Shafer model, " IEEE Trans. Syst. Man Cybern. A Syst. Hum, vol. 34, no. 4, pp. 457-471, Jul. 2004. http: //ieeexplore. ieee. org/xpls/icp. jsp?arnumber=1306525
[31]	A. D. C. Chan and K. B. Englehart, "Continuous myoelectric control for powered prostheses using hidden Markov models, " IEEE Trans. Biomed. Eng. , vol. 52, no. 1, pp. 121-124, Jan. 2005. http: //www. ncbi. nlm. nih. gov/pubmed/15651571
[32]	Z. Y. Liu and S. Sarkar, "Effect of silhouette quality on hard problems in gait recognition, " IEEE Trans. Syst. Man Cybern. B, vol. 35, no. 2, pp. 170-183, Apr. 2005. http: //www. ncbi. nlm. nih. gov/pubmed/15828648
[33]	Z. H. Zhou, A. Prugel-Bennett, and R. I. Damper, "A Bayesian framework for extracting human gait using strong prior knowledge, " IEEE Trans Pattern Anal. Mech. Intell. , vol. 28, no. 11, pp. 1738-1752, Nov. 2006. http: //www. ncbi. nlm. nih. gov/pubmed/17063680
[34]	L. N. Tong, Z. G. Hou, L. Peng, W. Q. Wang, Y. X. Chen, and M. Tan, "Multi-channel sEMG time series analysis based human motion recognition method, " Acta Automat. Sin. , vol. 40, no. 5, pp. 810-821, May 2014. http: //en. cnki. com. cn/Article_en/CJFDTotal-MOTO201405003. htm

Supplements(0)

Cited By

Proportional views

Proportional views

通讯作者: 陈斌, bchen63@163.com

1.
沈阳化工大学材料科学与工程学院沈阳 110142

Figures(8) / Tables(6)

Get Citation

PDF

XML

Article Metrics

Article views (1503) PDF downloads(134)

Intent Pattern Recognition of Lower-limb Motion Based on Mechanical Sensors

doi: 10.1109/JAS.2017.7510619

Abstract

References

Proportional views

Catalog

通讯作者: 陈斌, bchen63@163.com

Article Metrics

Export File

Citation

Format

Content