Charalampos Doukas
ABSTRACT
The paper presents the concept and an initial implementation of a patient status awareness system that may be used for patient activity interpretation and emergency recognition in cases like elder falls. The system utilizes audio and video data captured from the patient's environment. Visual information is acquired using overhead cameras and audio data is collected from microphone arrays. Proper audio data processing allows the detection of sounds related to body falls or distress speech expressions. Appropriate tracking techniques are applied to the visual perceptual component enabling the trajectory tracking of the subjects. Sound directionality in conjunction to trajectory information and subject's visual location can verify fall and indicate an emergency event. Post fall visual behavior of the subject indicates the severity of the fall (e.g., if patient remains unconscious or patient recovers). A number of advanced classification techniques have been evaluated using the latter perceptual components. The performance of the classifiers has been assessed in terms of accuracy and efficiency and results are presented.
- Noury N., Herve T., Rialle V., Virone G., Mercier E., Morey G., Moro A., Porcheron T., "Monitoring behavior in home using a smart fall sensor and position sensors", In Proc. of 1st Annual International Conference on Microtechnologies in Medicine and Biology, pp. 607--610, Oct. 2000.Google Scholar
Cross Ref
- Noury N., "A smart sensor for the remote follow up of activity and fall detection of the elderly", In Proc. of 2nd Annual International Conference on Microtechnologies in Medicine and Biology, pp. 314--317, May 2002.Google ScholarCross Ref
- Prado M., Reina-Tosina J., Roa L., "Distributed intelligent architecture for falling detection and physical activity analysis in the elderly", In Proc. of the 24th Annual IEEE EMBS Conference, pp. 1910--1911, Oct. 2002.Google ScholarCross Ref
- Fukaya K., "Fall detection sensor for fall protection airbag", In Proc. of the 41st SICE Annual Conference, pp. 419--420, Aug. 2002.Google ScholarCross Ref
- Nait-Charif, H. McKenna, S. J., "Activity summarisation and fall detection in a supportive home environment", In Proc. of the 17th International Conference on Pattern Recognition ICPR 2004, pp. 323--236, Aug. 2004. Google ScholarDigital Library
- Hwang, J. Y. Kang, J. M. Jang, Y. W. Kim, H. C., "Development of novel algorithm and real-time monitoring ambulatory system using Bluetooth module for fall detection in the elderly", In Proc. of the 26th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, pp. 2204--2207, 2004.Google Scholar
- Shuangquan Wang, Jie Yang, Ningjiang Chen, Xin Chen, Qinfeng Zhang, "Human activity recognition with user-free accelerometers in the sensor networks", In Proc. of International Conference on Neural Networks and Brain, pp. 1212--1217, Oct. 2005.Google Scholar
- S.-G. Miaou, Pei-Hsu Sung, Chia-Yuan Huang, "A Customized Human Fall Detection System Using Omni-Camera Images and Personal Information", In Proc. of 1st Transdisciplinary conference on Distributed Diagnosis and Home Healthcare, pp. 39--42, 2006.Google ScholarCross Ref
- Allen, F. R. Ambikairajah, E. Lovell, N. H. Celler, B. G., "An Adapted Gaussian Mixture Model Approach to Accelerometry-Based Movement Classification Using Time-Domain Features", In Proc. of 28th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, pp. 3600--3603, Aug. 2006.Google Scholar
- R. E. Kalman, "A New Approach to Linear Filtering and Prediction Problems," Transactions of the ASME -- Journal of Basic Engineering, Vol. 82, Series D, pp. 35--45, 1960.Google ScholarCross Ref
- A. Pnevmatikakis and L. Polymenakos, "Robust Estimation of Background for Fixed Cameras," International Conference on Computing (CIC2006), Mexico City, Mexico, 2006. Google ScholarDigital Library
- C. Stauffer and W. E. L. Grimson, "Learning patterns of activity using real-time tracking," IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 22, No. 8, pp. 747--757, 2000. Google ScholarDigital Library
- Charalampos Doukas, Ilias Maglogiannis, Philippos Tragkas, Dimitris Liapis, Gregory Yovanof, "Patient Fall Detection using Support Vector Machines", In Proc. of the 4th IFIP Conference on Artificial Intelligence Applications & Innovations (AIAI), Sept. 19--21, Athens, Greece.Google Scholar
- Charalampos Doukas, Ilias Maglogiannis, "Advanced Patient or Elder Fall Detection based on Movement and Sound Data", presented at 2nd International Conference on Pervasive Computing Technologies for Healthcare 2008.Google Scholar
- Ian H. Witten and Eibe Frank (2005) "Data Mining: Practical machine learning tools and techniques", 2nd Edition, Morgan Kaufmann, San Francisco, 2005. Google ScholarDigital Library
- Knapp C. and Carter G. "The generalized correlation method for estimation of time delay", IEEE Transactions on Acoustics, Speech and Signal Processing, vol. 24, No. 4, pp. 320--327, Aug. 1976.Google ScholarCross Ref
- Anthony J. Bell and Terrence J. Sejnowski, "An Information-Maximization Approach to Blind Separation and Blind Deconvolution", Neural Computation, Vol. 7, No. 6, pp. 1129--1159, 1995. Google ScholarDigital Library
- Talantzis F., Constantinides A. G. and Polymenakos L. C., "Estimation of direction of arrival using information theory", IEEE Signal Processing Letter, Vol. 12, No. 8, pp. 561--564, Aug. 2005Google ScholarCross Ref
- Istrate D., Castelli E., Vacher M., Besacier L., Serignat J.-F., "Information extraction from sound for medical telemonitoring", IEEE Transaction on Information Theory in Biomedicine, vol. 10, 2, pp. 264--274, April 2006. Google ScholarDigital Library
- M Vacher, D Istrate, JF Serignat, "Sound Detection and Classification through transient models using Wavelet Coefficient Trees", presented at 12th Eurasip European Signal Processing Conference, Sept. 2004.Google Scholar
- Dan Istrate, Michel Vacher and Jean Francois Serignat. 2006. Generic Implementation of a Distress Sound Extraction System for Elder Care. Proceedings of the 28th IEEE EMBS Annual International Conference New York City, USA, (Aug 30-Sept 3), 3309--3312.Google ScholarCross Ref
- Laydrus, Nelly Christina Ambikairajah, Eliathamby Celler, Branko. 2007. Automated Sound Analysis System for Home Telemonitoring using Shifted Delta Cepstral Features. In 15th International Conference on Digital Signal Processing, July 2007, 135--138.Google Scholar
- Yoav Freund, Robert E. Schapire: Experiments with a new boosting algorithm. In: Thirteenth International Conference on Machine Learning, San Francisco, 148--156, 1996.Google ScholarDigital Library
- E. Frank, Y. Wang, S. Inglis, G. Holmes, I. H. Witten (1998). Using model trees for classification Machine Learning. 32(1):63--76. Google ScholarDigital Library
- R. Kohavi (1995). Wrappers for Performance Enhancement and Oblivious Decision Graphs. Department of Computer Science, Stanford University.Google Scholar
- Tin Kam Ho (1998). The Random Subspace Method for Constructing Decision Forests. IEEE Transactions on Pattern Analysis and Machine Intelligence. 20(8):832--844. Google ScholarDigital Library
- Lin Dong, Eibe Frank, Stefan Kramer: Ensembles of Balanced Nested Dichotomies for Multi-class Problems. In: PKDD, 84--95, 2005.Google Scholar
- Ting, K. M., Witten, I. H.: Stacking Bagged and Dagged Models. In: Fourteenth international Conference on Machine Learning, San Francisco, CA, 367--375, 1997. Google ScholarDigital Library
- Jean Carletta, "Assessing Agreement on Classification Tasks: The Kappa Statistic", Computational Linguistics, 22 (2), pp. 249--254, 1996. Google ScholarDigital Library
- Charalampos Doukas, Ilias Maglogiannis, "Human Distress Sound Analysis and Characterization using Advanced Classification Techniques", In Proc of 5<sup>th</sup> Hellenic Conference in Artificial Intelligence, SETN 08, October 2--4, Syros, Greece. Google ScholarDigital Library
- Charalampos Doukas, Ilias Maglogiannis, Nikos Katsarakis, Aristodimos Pneumatikakis, "Enhanced Human Body Fall Detection utilizing Advanced Classification of Video and Motion Perceptual Components", 5th IFIP Conference on Artificial Intelligence Applications & Innovations, April 23--25, Salonica, Greece.Google Scholar
Index Terms
- Emergency incidents detection in assisted living environments utilizing sound and visual perceptual components
Recommendations
Emergency Fall Incidents Detection in Assisted Living Environments Utilizing Motion, Sound, and Visual Perceptual Components
This paper presents the implementation details of a patient status awareness enabling human activity interpretation and emergency detection in cases, where the personal health is threatened like elder falls or patient collapses. The proposed system ...
Enabling Cloud-Based and Personalized Sensors in Assisted Living Environments
In this work, the authors combine the field of cloud computing with assisted living to improve activity classification. The proposed system addresses the challenge of enabling heterogeneous, cloud-based sensors in domestic environments. With a semantic ...
Enabling Virtual, Cloud-Based Sensors in Assisted Living Environments
CLOUDCOM '13: Proceedings of the 2013 IEEE International Conference on Cloud Computing Technology and Science - Volume 01In this work, we combine the field of cloud computing with assisted living to utilize an improved activity classification. The proposed system addresses the challenge of enabling heterogeneous, cloud-based sensors in small home environments. With a ...
Comments