Design and Development of Lower Limb Chair Exercise Support System with Depth Sensor
Keywords:chair exercise, lower limb, elderly population, depth sensor, exercise system design, preventative care
Sustaining lower limb functionality is extremely important in the preventative care of the elderly. Chair exercise, in which the exerciser sits on an ordinary chair, offers a way for seniors with little physical strength to exercise without a great deal of effort. Meanwhile, Microsoft's Kinect sensor that is capable of detecting human motion without the subject having to wear any kind of a special marker are becoming widely available. Exploiting this new sensor technology, this paper describes the design and development of a prototype lower limb chair exercise support system. The system supports five different chair exercises designed to strengthen the lower limbs, recognizes and evaluates exercises based on 3D position data and joint angles for each joint obtained from the Kinect sensor. The system illustrates how to do the exercises by voice instructions and model images, and superimposes the muscles used onto an image of the exerciser in real time. The system also provides exercise assessment results and advice by voice and text. In a series of trials involving seven elderly subjects in their late 70s and early 80s, an overall average recognition rate of 89% was obtained for the five exercises. Feedback was obtained through a questionnaire given to subjects ranging in age from 50 to 65, which highlighted a number of issues that should be addressed to improve the effectiveness of the system.
(1) Cabinet Office, 2015 Annual Report on the Aging Society, http://www8.cao.go.jp/kourei/whitepaper/w-2015/zenbun/ index.html, Accessed June 18, 2015.
(2) Ministry of Health, Labour and Welfare, Manual of Long-Term Care, http://www.mhlw.go.jp/topics/2009/ 05/tp0501-1.html, Accessed June 18, 2015.
(3) Matsukuma, H., Fujioka, S., Nakajima, A., Kaneko, K., Kajiwara, J., Hayashida, K., and Hattori, F., Research and development of serious games to support stand-up rehabilitation exercises, Journal of Information Processing, 53(3), 1041-1049, March 2012.
(4) Hashimoto, Y., Munesawa, T., Mitsuto, R., Tanabe, K., Masumoto, K., Morimoto, R., Sawada, K., and So, B. C., Internet technology in cognitive rehabilitation: review and pactice, Trans. of the Institute of Electronics, Information and Communication Engineers, J95-D(5), 1091-1099, May 2012.
(5) Cognitive Rehabilitation Anywhere, http://reha.heteml.jp , Accessed June 18, 2015.
(6) Mentiplay, B. F., Clark, R. A., Mullins, A., Bryant, A. L., Bartold, S., and Paterson, K., Reliability and validity of the Microsoft Kinect for evaluating static foot posture, Journal of Foot and Ankle Research 2013，6-14，2013.
(7) Metcalf, C. D., Robinson, R., Malpass, A. J., Bogle, T. P., Dell, T. A., Harris, C. and Demain, S. H., Markerless motion capture and measurement of hand kinematics: validation and application to home-based upper limb rehabilitation， IEEE Trans. on Biomedical Eng.，
(8), 2184-2192，Aug. 2013.
(8) Obdrzalek, S., Kurillo, G., Ofli, F., Bajcsy, R., Seto, E., Jimison, H., and Pavel, M., Accuracy and robustness of Kinect pose estimation in the context of coaching of elderly population, The 34th Annual Int. Conf. of the IEEE Engineering in Medicine and Biology Society EMBC'12, 1188-1193, 2012.
(9) Erazo, O., Pino, J. A., Pino, R., Asenjo, A., Fernández, C., and Asenjo, A., Magic mirror for neurorehabilitation of people with upper limb dysfunction using Kinect, The 47th Hawaii Int. Conf. on System Sciences HICSS, 2607–2615, Jan. 2014.
(10) Webster, D. and Celik, O., Systematic review of Kinect applications in elderly care and stroke rehabilitation, Journal of NeuroEngineering and Rehabilitation, 11(108), 2014.
(11) Watanabe, T., Ohtsuka, N., Shibusawa, S., Kamada, M., and Yonekura, T., Design of lower limb chair exercise support system with depth sensor, The 11th IEEE Int. Conf. on Ubiquitous Intelligence and Computing, 104-111, Dec. 2014.
(12) Watanabe, T., Ohtsuka, N., Shibusawa, S., Kamada, M., and Yonekura, T., Motion detection and evaluation of chair exercise support system with depth image sensor, Int. Workshop on Future Trends in Computing System Technologies and Applications, 800-807, Dec. 2014.
(13) Tolentino, G. P., Battaglini, C., Pereira, A. C. V., Oliveria，R. J., and Paula, M. G. M., Usability of serious games for health, The Third Int. Conf. on Games and Virtual Worlds for Serious Applications VS-GAMES, 172-175, May 2011.
(14) Moya, S., Grau, S., Tost, D., Campeny, R., and Ruiz, M., Animation of 3D avatars for rehabilitation of the upper limbs, The Third Int. Conf. on Games and Virtual Worlds for Serious Applications VS-GAMES, 168-171, May 2011.
(15) Bruckheimer, A. D., Hounsell, M. S., and Soares, A. V., Dance2Rehab3D: A 3D virtual rehabilitation game, The 14th Symp. on Virtual and Augmented Reality, 182-190, May 2012.
(16) Asakura, R., Miyasaka, J., Kondo, K., Nakamura, Y., Akita, J., Toda, M., and Sakurazawa, S., Design of a rehabilitation supporting system integrating myoelectric sensing and image-based pose sensing, Trans. of the Institute of Electronics, Information and Communication Engineers, J97-D(1), 50-61, Jan. 2014.
(17) Pei, Y., Kim, Y., Obinata, G., and Hase, K., Design of motion trajectory and external force on foot based on musculo-skeletal model in robot-assisted lower limb rehabilitation, Trans. of the Japan Society of Mechanical Engineers, Series C, 77(781), 236-250, Sept. 2011.
(18) Fasola, J. and Mataric, M. J., Using socially assistive human–robot interaction to motivate physical exercise for older adults, Proc. of the IEEE, 100(8), 2512-2526, Aug. 2012.
(19) Igarashi, N., Suzuki, K., Kawamoto, and H., Sankai, Y., A Wearable light-emitting sensor suit for supporting the lower-limb motion perception, Journal of Information Processing, 53(4), 1360-1371, April 2012.
(20) Reflexion Health, http://reflexionhealth.com/ , Accessed July 22, 2015.
(21) Virtualrehab, http://www.virtualrehab.info/ , Accessed July 22, 2015.
(22) Seeme, http://www.virtual-realityrehabilitation.com/products/ seeme/what-is-seeme, Accessed July 22, 2015.
(23) Jintronix, http://www.jintronix.com/ , Accessed July 22, 2015.
(24) Patent WO 2013090554 A1, Method and system for evaluating a patient during a rehabilitation exercise, Publication date June 20, 2013. Also, Patent US 20140371633 A1, Publication date Dec. 18, 2014.
(25) Tao, G., Archambault, P., and Levin, M. F., Evaluation of a virtual reality rehabilitation system for upper limb hemiparesis, Int. Conf. on Virtual Rehabilitation ICVR, pp.164-165, Aug. 2013.
(26) Norouzi-Gheidari, N., Levin, M. F., Fung, J., and Archambault, P., A research protocol exploring the use of haptic forces for stroke rehabilitation, Int. Conf. on Virtual Rehabilitation ICVR, pp.220-221, Aug. 2013.