An intelligent decision supporting system for international classification of functioning, disability, and health

Abstract

Background

In recent years, the population structure in Taiwan has changed so dramatically. Based on concerns of social welfare issues, Taiwanese government began to seek principles for assessment of disability. After seven years of carefully evaluation, the World Health Organization's International Classification of Functioning, Disability, and Health (Abbreviated to ICF) is officially adopted as Taiwan's assessment standard while most of the assessment procedures of ICF are sophisticated, and time consuming.

In this paper, we propose a sensor based decision supporting system for ICF. Our prototype system aims to reduce the burden of medical staffs, and to assist subjects to perform the assessments.

Methods

This paper integrate multiple devices including ASUS XtionTM, temperature/acceleration/gyro sensors on Arduino, and Zigbee to measure the mobility of limbs and joints. The subject's log of assessments is then recorded in the database so that the medical staffs can remote-monitor the co ndition of subjects immediately, and analyze the results later. Additionally, in our system, a user-friendly interface is implemented for the detection of dementia.

Results

In this paper, three experiments have been conducted for different purpose. The experiment was conducted to compare the variation between thermometer and our device. Moreover, we invited 20 elders aged for 65 to 80 to use our system and all of them gave positive feedback. Two elders were invited to perform full assessment for dementia and the results show that both of them didn't have sign of dementia. Also, the assessment of joint movement was performed by a 67 year-old elder and the result shows that the elder had well physical function and could take care of daily life.

Conclusions

The proposed system has potential for aiding users to perform the ICF testing better and provide benefits to medical staffs and society. With current technology, integration between sensor network systems and artificial intelligence approaches will more and more important. We develop a simple interface for user to manipulate and perform the ICF assessment. In addition, the early detection of dementia likely has the potential to provide patients with an increased level of precaution, which may improve quality of life.

Hsieh et al. Visualization in Engineering (2015) 3:11 DOI 10.1186/s40327-015-0023-5

RESEARCH ARTICLE Open Access

An intelligent decision supporting system for international classification of functioning, disability, and health

Wei-Fen Hsieh1, Lieu-Hen Chen1*, Hao-Ming Hung1, Eri Sato-Shimokawara2, Yasufumi Takama2, Toru Yamaguchi2, Eric Hsiao-Kuang Wu3 and Yu-Wei Chen4

Abstract

Background: In recent years, the population structure in Taiwan has changed so dramatically. Based on concerns of social welfare issues, Taiwanese government began to seek principles for assessment of disability. After seven years of carefully evaluation, the World Health Organizations International Classification of Functioning, Disability, and Health (Abbreviated to ICF) is officially adopted as Taiwans assessment standard while most of the assessment procedures of ICF are sophisticated, and time consuming.

In this paper, we propose a sensor based decision supporting system for ICF. Our prototype system aims to reduce the burden of medical staffs, and to assist subjects to perform the assessments.

Methods: This paper integrate multiple devices including ASUS XtionTM, temperature/acceleration/gyro sensors on Arduino, and Zigbee to measure the mobility of limbs and joints. The subjects log of assessments is then recorded in the database so that the medical staffs can remote-monitor the co ndition of subjects immediately, and analyze the results later. Additionally, in our system, a user-friendly interface is implemented for the detection of dementia.

Results: In this paper, three experiments have been conducted for different purpose. The experiment was conducted to compare the variation between thermometer and our device. Moreover, we invited 20 elders aged for 65 to 80 to use our system and all of them gave positive feedback. Two elders were invited to perform full assessment for dementia and the results show that both of them didnt have sign of dementia. Also, the assessment of joint movement was performed by a 67 year-old elder and the result shows that the elder had well physical function and could take care of daily life.

Conclusions: The proposed system has potential for aiding users to perform the ICF testing better and provide benefits to medical staffs and society. With current technology, integration between sensor network systems and artificial intelligence approaches will more and more important. We develop a simple interface for user to manipulate and perform the ICF assessment. In addition, the early detection of dementia likely has the potential to provide patients with an increased level of precaution, which may improve quality of life.

Keywords: Social welfare; ICF; Arduino; Xtion Pro Live; Sensoring techologies

Introduction

People with Disabilities Rights Protection Act was revised and promulgated in 2007, also new disability classification assessment method and applying disability certification process were scheduled to practice on July 11, 2012 (Directorate-General for the Information

Society and Media 2010). People who are physically challenged can apply for the social welfare services according to the results of disabilities assessment.

At the same time, Taiwan is facing the impacts of aging society with fewer children, including demographic imbalance, dependency burden, and lack of elderly nursing care services. Based on concerns about these social welfare issues, Taiwanese government began to seek principles for assessment of disability.

* Correspondence: mailto:[email protected]

Web End [email protected]

1Computer Science and Information Engineering, National Chi Nan University, Puli, TaiwanFull list of author information is available at the end of the article

2015 Hsieh et al.; licensee Springer. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/4.0

Web End =http://creativecommons.org/licenses/by/4.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly credited.

Hsieh et al. Visualization in Engineering (2015) 3:11 Page 2 of 17

Figure 1 Xtion PRO live.

Figure 2 TMP36.

Hsieh et al. Visualization in Engineering (2015) 3:11 Page 3 of 17

After seven years of carefully evaluation, as a result, the World Health Organizations International Classification of Functioning, Disability, and Health (Abbreviated to ICF) is officially adopted as Taiwans assessment standard.

For this new international standard, WHO changed the classification from 16 items in the previous policies to 8 coding system (Directorate-General for the Information Society and Media 2010; World Health Organization 2001; World Health Organization 2007). The old assessment methods and service applying processes are also modified by WHO. One of the most important change in the new policies is the evaluation results are no more available for the entire lifetime. From now on, several aspects of lives have to be investigated at least once every five years.

With these changes, not only the methods that we used to apply social welfare service and attend disabilities assessment are transformed, but also the government is forced to establish new follow up social welfare service, evaluation index, evaluation tool, evaluation flow, etc. Though ICF provides a better system for evaluating disability in accordance with systematic regulations, it takes both people with disabilities and medical staffs more time to perform and complete the evaluation (Liao and Huang 2009; Shotton et al. 2011).

Due to the serious lack of human resource of medicine in Taiwan, in this paper, we propose a sensor based decision supporting system for ICF. At the moment, we

focus on the part of assessment for disability and dementia. We developed the friendly interface which leads users to perform the actions required for ICF assessments according to Mobility of joint functions (ID b701). In order to detect users movement, this project use Xtion PRO Live to measure and assess subjects actions and activities; combined with OPENI2 and NiTE2 to conduct the structure of skeleton. We also integrated multiple devices including ASUS Xtion, Zigbee, and temperature/acceleration/gyro sensors on Arduino as wearable device to capture users movement. There are many reports on using Kinect, Xtion PRO LIVE and other related devices for the purpose of motion capture (Mulvenna and Nugent 2010). There are also many software developing tools available for implementing interfaces using these devices. Subject can easily wear our multi-sensors monitoring device on the wrist like wearing a bracelet during the movement assessment test. This wearable device combines temperature, acceleration, and gyro sensors with Arduino. The temperature sensor measures subjects skin temperature on wrist vein so that inspector can monitor subjects health state during the test. Besides, the device includes gyroscope to detect the rotations of the wrist for testing items and it can assure that the subject raising their hands in correct orientation. We also implement accelerator to check whether the subjects movement is smooth or not. If the subject finishes the testing item but with uneven movement, the subject might have potential joint disease. The

Figure 3 L3G4200D.

Hsieh et al. Visualization in Engineering (2015) 3:11 Page 4 of 17

Figure 4 MMA7455L.

Figure 5 XBee - Series 2.

Hsieh et al. Visualization in Engineering (2015) 3:11 Page 5 of 17

Figure 6 System architecture.

observation of movement can be used as meaningful information of health.

A dementia assessment interface with gesture recognizer on virtual button is developed to enable users to perform the test under a more convenient and comfortable condition. This project use Webcam combining with OpenCV to develop this interactive GUI interface. We designed the dementia questions according to the items referring to dementia according to

Orientation functions (ID b114), Intellectual functions (ID b117), Memory functions (ID b144), and Higher-level cognitive functions (ID 164) in ICF. In this project we assume that subjects all have the basic abilities to answer the question and to recognize words so that subjects can do dementia assessment test by themselves.

For the purpose of releasing the burden of medical staffs and increasing efficiency of evaluation work of ICF, our system collects the subjects test results in a

Hsieh et al. Visualization in Engineering (2015) 3:11 Page 6 of 17

Figure 7 Joints mobility measurement interface. (Figure translation: (1) : Please follow the video to perform the test movement, (2) : Assessment of Right Joints, (3): Assessment of Left Joints, (4) : The result of right shoulder extension, (5) : The result of right elbow extension, (6) : The result of right hip flexion, (7)

: The result of right hip extension, (8) : The result of right knee extension).

database so that the medical staffs can keep up-to-date with subjects condition through mobile phones or Internet (Eriksson et al. 2005; Morris 1993).

In the current version of prototype system, we still need a trained volunteer managing the movement assessment assistance interface on the computer to assist subjects to do the test.

Background

As a classification, ICF systematically groups different domains for a person in a given health condition within two parts and each part with two components.

Part one Functioning and Disability has the component (a) Body Functions and Structures, (b) Activities and Participation. Part two Contextual Factors has the

Figure 8 Recording demonstration.

Hsieh et al. Visualization in Engineering (2015) 3:11 Page 7 of 17

Table 1 The joints mobility measurement result of 67 year-old subject

Age Range of motion Shoulder flexion Elbow flexion Hip flexion Knee flexion

67 Right Limb 165.321 141.412 120.265 140.965

Left Limb 165.242 142.732 119.253 139.961

component (c) Environmental Factors, (d) Personal Factors.

In this project we implement a method to calculate the degree of joint movement to measure the activity of body movement. As for questions in dementia assessment test are design by us according to part which dont need medical staffs ask subjects in person from Clinical Dementia Rating (abbreviate CDR).

Skeleton tracking

In this project, we use Xtion PRO LIVE as a sensor to track skeleton. Xtion PRO LIVE is made by ASUS uses infrared sensors, adaptive depth detection technology, color image sensing and audio stream to capture a users real-time image, movement, and voice, making user tracking more precise (Figure 1). We use visual C++ to develop the joint detection.

OpenNI defined 24 joints for a person but the NITE2 offers tracking of 15 of them.

Dementia assessment test

The Clinical Dementia Rating or CDR was developed at the Memory and Aging Project at Washington University School of Medicine in 1979 for the evaluation of staging severity of dementia (Reed and Bufka 2006). The Clinical Dementia Rating is a five-point scale in which CDR-0 connotes no cognitive impairment, and then the remaining four points are for various stages of dementia:

CDR-0.5=very mild dementia CDR-1=mild CDR-2=moderate CDR-3=severe

There are six aspects in Clinical Dementia Rating scale. They are memory, orientation, judgment and problem solving, home and hobbies and community affairs (Muilder and Stappers 2009). Moreover, Dementia assessment according to the items in ICF are: Orientation functions (ID b114), Intellectual functions (ID b117), Memory functions (ID b144), and Higher-level cognitive functions (ID 164). We designed the questions referring to above aspects except for home and hobbies and community affairs in Clinical Dementia Rating scale. Caregivers would deal with the questions consisting of the left aspects.

Temperature sensing

Normal human body temperature depends upon the place in the body at which the measurement is made, and the time of day and level of activity of the person. Temperatures cycle regularly up and down through the day.

TMP36 is a low voltage, precision centigrade temperature sensor (Figure 2). It provides a voltage output that is linearly proportional to the Celsius temperature. The output voltage can be converted to temperature easily using the scale factor of 10 mV/C. Arduino is a single-board

Figure 9 Dementia assessment interface. (Figure Translation: (1) ? : What day is today? (2) : Monday, (3) : Wednesday, (4) : Tuesday, (5) : Friday).

Hsieh et al. Visualization in Engineering (2015) 3:11 Page 8 of 17

Figure 10 The elder doing the dementia test.

microcontroller to make using electronics in multidisciplinary projects more accessible. In this project we develop this temperature sensing device by using open source Arduino software. We use TMP36 as the sensor and combine it with Arduino to sensor the temperature via wrist vein.

Gyroscope

In this paper we implement L3G4200D as the sensor to detect the rotation of wrist (Figure 3). It is a 3 Axis ultra-stable digital MEMS motion sensor. It gives stable sensitivity over temperature and time. L3G4200D module features an on board low drop out voltage regulator which takes input supply in the range of 3.6 V to6 V DC. The L3G4200D has user selectable full scale of 250, 500, 2000 degrees per second.

Accelerator

The MMA7455L is a Digital Output, low power, low profile capacitive micro-machined accelerometer featuring pulse detect for quick motion detection (Figure 4).

Figure 11 Correctness ratio of dementia assessment.

Hsieh et al. Visualization in Engineering (2015) 3:11 Page 9 of 17

0 g offset and sensitivity are factory set and require no external devices. The 0 g offset can be customer calibrated using assigned 0 g registers and g-Select which allows for three kinds of acceleration selection ranges (2 g/4 g/8 g). It is suitable for handheld battery powered electronics because MMA7455L includes a Standby Mode.

Wireless technology

ZigBee is the latest wireless technology using high level communication protocol to create personal network area (Figure 5). Each ZigBee module can transmit and receive data from the other ZigBee module. These modules allow reliable communication between micro-controllers and computers. We use XCTU to manage and configure ZigBee module. Its a free and multiple platform application designed to enable developers to interact with Zigbee.

Methods

A user-friendly interface was developed for the ICF assessment in this paper. The system is based on multi-sensor technology which integrate multiple

devices including ASUS XtionTM, temperature/acceleration/gyro sensors. And we invited subjects to perform the assessment through our system. The subjects log of assessments is then recorded in the database. The log includes subjects personal information, assessment result and medical history. Our system is likely to extract useful information for medical staffs and support decision making. Written informed consent was obtained for the publication of this report and any accompanying images.

System architecture

As shown in Figure 6, we have implemented two main assessment functions in our prototype system. These functions include: joints mobility measurement, dementia progression assessment.

The first process of our system is joints mobility measurement. In the beginning of the joints mobility measurement, in order to let Xtion PRO LIVE detect the subject successfully, the subject needs to stand in the restricted position. After detecting successfully, the subject can start the measurement. In addition, during the assessment, the subject is asked to wear our sensing device on his/her wrist for detecting subjects body temperature. There are three sensors installed on this device, including a body temperature sensor, an accelerator sensor, and a gyroscope sensor. After the subject completes a designated posture, the inspector can keep going on next movement. After all testing movements are completed, the results are then recorded into the database.

As for dementia progression assessment, our system picks out 10 questions from 100 designed questions in the database randomly. Our system implement a multimodal interface for subjects to input their answers either by using a traditional keyboard-mouse combination, or by using gestures directly with virtual push-buttons on screen. The reason why we implemented two methods for users to manipulate the

Figure 12 Temperature sensing circuit.

Figure 13 Pins of TMP36.

Hsieh et al. Visualization in Engineering (2015) 3:11 Page 10 of 17

Figure 14 Temperature sensing device.

Figure 15 Wearable device.

Hsieh et al. Visualization in Engineering (2015) 3:11 Page 11 of 17

Figure 16 Detecting temperature via device.

system is because we are afraid that the elder are unable to control the mouse properly. Instead of mouse, we think manipulate by gesture is a more instinct way for the elder.

Finally, Medical staffs can query and check the assessment results through their mobile devices or computers by requesting the database.

Results

Joints mobility measurement

With the purpose of acknowledging subjects bodys condition, the system will take subjects whole body picture through the webcam on Xtion PRO LIVE while beginning the measurement. Next, the system will show the video of the measurement item on

Figure 17 Temperature comparison. This is the comparison between the result measured by our device and the result measured by thermometer.

Figure 18 Body temperature of a male and a female during Exercising. We recorded the temperature of a man and a female to observe the variation.

Hsieh et al. Visualization in Engineering (2015) 3:11 Page 12 of 17

Figure 19 Wearable wrist detection device.

the interface of joints mobility measurement to instruct users what to do directly instead of words expression or oral direction (Figure 7). As for the instruction video, we previously recorded the demonstration animation so that the subject can imitate

the movement in the animation to finish the testing items (Figure 8). We use Xtion PRO LIVE for joint skeleton tracking then calculate whether users joint movement reach the standard degree or not. If users cant reach the standard degree within 60 seconds, the system would record the latest detected extension and continue to next measurement item.

Joints mobility measurement comprises two parts as following: upper extremity and lower extremity.

According to the items from Mobility of joint functions (ID b701) in ICF, we pick out the relative measurement testing items as below:

Upper extremity

Mobility of shoulder

Range of motion at the shoulder extension (Standard degree: 180)

Range of motion at the shoulder flexion (Standard degree: 60)

Joint function (standard degree: 240).

Mobility of elbow

Range of motion at the elbow extension (Standard degree: 145)

Range of motion at the elbow flexion (Standard degree: 0)

Joint function (standard degree: 145)

Mobility of wrist

Range of motion at the wrist extension (Standard degree: 80)

Range of motion at the wrist flexion (Standard degree: 70)

Joint function (standard degree: 150)

Figure 20 Wearable rate detection device.

Hsieh et al. Visualization in Engineering (2015) 3:11 Page 13 of 17

Lower extremity

Mobility of hip

Range of motion at the hip extension (Standard degree: 125)

Range of motion at the hip flexion (Standard degree: 10)

Joint function (standard degree: 135)

Mobility of knee

Range of motion at the knee extension (Standard degree: 145)

Range of motion at the knee flexion (Standard degree: 0)

Joint function (standard degree: 140)

In this paper, our system was performed by a 67 year-old elder. Through our system, the subjects mobility of joints could be measured and quantified as shown in Table 1. According to this result, this elder had well physical function and could take care of daily life.

Dementia assessment interface

The dementia assessment interface is based on gesture recognition (Figure 9). Users can choose the answers through pressing the virtual button on the screen or just using the mouse. It provides two simple and easy methods for users to manipulate the system. We design the questions and options according to the different aspect in Clinical Dementia Rating scale respectively and the referring items from ICF. The system pick out 10 questions from 100 designed questions in the database randomly. The questions are all multiple choice which subjects choose one answer from four. The sequence of questions and options are randomly to prevent subjects from memorizing the answer from doing the test last time. Our system was tested by 20 elders aged from 65 to 80 under the help of volunteers (Figure 10). All of them feel that using our system is not only interesting but also fascinating. Their reactions show that our system arouses their interest and increase their willingness to do dementia test.

In order to improve the accuracy of our system, full examination was performed by two elders aged 67 and 77 respectively. And their family, as caregiver, was asked to answer the AD8 questionnaire which is the version for caregiver. All the questions are based on daily life, for example, the color judgment, shape recognition, and simple calculation. We couldnt determine if the subject have dementia by merely one test. The assessment factor should consist of assessment test, the questionnaire for caregiver and the judgment by medical staffs. The main purpose of our system is preliminary assessment and its clearer for medical staff to understand subjects situation. The standard of high risk population is that if answers correctness percentage is lower 80% and the

questionnaire answered by caregiver got low score, the subject need to be kept under observation.

From Dementia Assessment, we could learn the subjects ability in different aspects. During the process, we found that it was helpful for the subject to keep calm and focus on the assessment when their family was sitting around. According to the result and the questionnaire answered by their family, both of subjects didnt have the sign of Dementia (Figure 11).

Multisensor device

As previously mentioned, we integrated temperature/acceleration/gyro sensors on Arduino which we developed the device with open source Arduino software. We implemented Zigbee to detect users body temperature and sophisticated movement during the test. The detail

Figure 21 Create a medical staffs account. (Figure Translation: (1) : Account, (2) : Password, (3) : Name, (4) : Gender,(5) : Telephone, (6) : Address, (7) ID: Staff ID, (8) : Institution, (9) : Hospital Department).

Hsieh et al. Visualization in Engineering (2015) 3:11 Page 14 of 17

prototype would be described in this session respectively. For the convenience of measurement, these devices were integrated into a sensing module for users to wear on the wrist so that wont cause their uneasiness.

Temperature sensing device

The temperature sensing circuit is based on TMP36 and Arduino UNO (Figure 12). Owing to the device without switch, the LED on Arduino board can make sure whether the device is on or not. The resistance prevents electric current from passing through the LED and damaging the LED.

The system would read the voltage on the Vout pin shown in Figure 13, the output voltage can be converted

to temperature easily using the scale factor of 10 mV/C (Eq.1]).

Temperature in C Voutin mV

500

=10 1

In order to show the result on the system, we connect Arduino and computer via USB and use the 5 V power on Arduino as power. We connect Vout on TMP36 to Analog IN Pin0 on Arduino UNO so that the device does not need other external power supply (Figure 14).

Subject can wear this device to record the temperature variation and which testing item will cause the variation most during the joints mobility measurement (Figure 15). If the temperature changes higher than 0.5 degree the system will record the time and temperature into the

Figure 22 Query subjects information. (Figure Translation: (1) : Please enter Identity card ID to search subject, (2) : Record Number, (3) : Name, (4)

Name of Hospital).

Figure 23 Build subjects personal information. (Figure Translation: (1) : Name, (2) : Gender, (3) : Blood type,(4) : Date of Birth, (5) : Record Number, (6) : Name of Hospital, (7) : Identity Card ID, (8) : Telephone, (9) : Address, (10) Allergies).

Hsieh et al. Visualization in Engineering (2015) 3:11 Page 15 of 17

database so that the medical staffs can acknowledge subjects health state during the measurement (Figure 16).

In this project, we focus more on understanding the variation of subjects body temperature rather than the accuracy of degree. In order to prove that thermometer can be substituted by our device, we compare the result through our device with the result form thermometer when the indoor temperature was 26C. The comparison result shows that the devices variation is consists with thermometers variation with the stable average difference of 1.88C (Figure 17). Thus, Subject can wear our device instead of using the thermometer.

Another experiment is designed to compare the differences between a male and a female user while they were doing indoor bicycling exercise at temperature 26C. According to the result, we acknowledged that females body temperature was normally higher under the same environmental condition and body temperature roses gradually (Figure 18). Through observing the variation of body temperature, we could know subjects body condition and the medical staffs can analyze this information to know more about subjects health condition.

In this paper, in order to observe the sophisticated movement of wrist, we use L3G4200D to detect the rotation of wrist. And moreover, to observe if the subjects movement is fluently or not, our system use MMA7455L as the sensor to detect the rate of subjects movement.

We let user wear it with the temperature sensor so that the device can also detect the wrist motion

regarding the test item of wrist extension and flexion (Figure 19).

During the test, the purpose of doing these tests is not only finishing the test but also observing the health condition of the elder. The elder might have potential joints problems if they reach the standard movement with uneven movement (Figure 20).

Query interface on the mobile and on the computer

We developed the query interface on the mobile and on the computer which can connect to the database and access the assessment result so that medical staffs can query the results immediately. To enter the system, medical staffs need to create an account. After entering the system, if subjects information has not been established yet, medical staffs need to create subjects basic information for the sake of convenience querying. Then the assessment can start after establishing this information.

Functions on the mobile and computer interface mentioned above are listed as follows:

Connect to the database Medical staffs can register accounts (Figure 21) Build subjects basic information (Figure 22) Query subjects information by identify ID

(Figure 23)

Record the result of the test Query the results of test (Figures 24 and 25).

Figure 24 Query results of temperature detection. (Figure Translation: (1) : The result of temperature detecting, (2) : Date, (3) : Name of Hospital, (4) Port, (5) : Subjects Name, (6) Record ID, (7) Baud rate, (8)

The result of temperature detection).

Hsieh et al. Visualization in Engineering (2015) 3:11 Page 16 of 17

Figure 25 Query result of joints mobility assessment. (Figure Translation: (1) : Query the result of joints mobility assessment, (2) : Date, (3) : Name of Hospital, (4) : Subjects Name, (5) Record Number, (6)

: The result of joints mobility assessment, (7) : The result of right shoulder extension, (8) : The result of right elbow extension, (9) : The result of right hip flexion, (10) : The result of right hip extension.

Discussion

In the joint mobility measurement, subject was able to perform the measurement according to the demonstration animation and the degree of joint mobility was recorded in database. Through the subjects moment we could observe not only if he/she has the ability to take care of themselves but also the inconvenience might occur in everyday life. The experiment results show that our system has potential for enabling the ICF assessment to be performed by users themselves or with assistance from family, and therefore releasing medical staffs burden.

In the experiment, we found that the elder could recollect their memories by asking question about family affairs. During dementia test, when the subjects were asked about their date of birth, they both incidentally mentioned funny stories in their childhood. Subject 1 is a traditional farmer living with family. Subject 2 is subject 1s wife who is a housekeeper Table 2. Both of them were confused when they were asked about What date is today?, though they could remember What date is today? From the results, we could tell that subject1 was good at calculating because he could count the price correctly for harvest. In contrast, Subject 2s ability of calculating was not as good as Subject1. Though subject 2 performed badly at calculation we figured out that it was caused by less use of calculating

in life. The questionnaire answered by their family/ caregiver is also an important information for decision supporting. Through our system, early detection of dementia might be found and possibly provides patients with benefit from better treatment option and may improve patients and their familys life quality.

Conclusion

Our research results contain the following three parts: First, our system can successfully track users movement. And consequently, most of the measurement results, which was originally performed by subject with the assistant of medical staffs, can now be recorded automatically under the help of volunteer. Therefore our system is able to release medical staffs burden. Second, our system can measure and visualize users body temperature automatically. In addition, through our graphical interface, helpers and medical staffs can

Table 2 Subjects information

Gender Age Note

Subject1 Male 77 Farmer

Subject2 Female 67 Housekeeper

Figure 26 Future work.

Hsieh et al. Visualization in Engineering (2015) 3:11 Page 17 of 17

acknowledge auxiliary information of subjects body condition more easily than the conventional way. Third, our system provides a user-friendly multimodal interface for elders, such as the virtual buttons with webcam-based gesture recognizer, etc.

For the current version, we still have lots of work to do. In the part of joint mobility measurement, we are adding a voice guide to encourage users while performing assessment. Also, we are also implementing a wireless sensor network so that we can overcome some measuring problems for sophisticated joints, such as ankle and wrist.

Moreover, understanding the massage presented by the computer is not always easy, especially for the elderly. Therefore, we would like to develop a more flexible and customizable interface which can provide necessary services according to the users need by introducing more AI approaches (Figure 26).

Comparison of the joint mobility measurement results of the system and those done by an expert as gold standard is suggested for validation. We may need a lot of subjects to have the statistics of P-values. The questions about dementia are even more complicated. We may need comparison between the answers by subjects using computer and the answers by the expert. We are planning to test our system on more patients with the help of medical staffs in the near future. Finally, being encouraged by the positive feedbacks from both medical staffs and elders, we are also planning to further develop our system as a more general platform for visualizing medical metadata.

In this paper, we described an ongoing project of a sensor-based decision supporting system for ICF. Many parts of this project are still at its early stage. However, the first goal which aims to develop a conceptual prototype by utilizing the advices from medical staffs, is reported in this paper. And the requirements for the research of this paper in the medical field are higher and higher.

Competing interestsThe authors declare that they have no competing interests.

Authors contributionsLHC, WEH and HMH participated in the sequence alignment and drafted the manuscript. YWC gave the professional suggestion as medical staff. EHW gave conceptual advice of medical mobile device. ESS and TY gave the conceptual advice of Quality of life. YT gave the suggestion for visualization in users daily log. All authors read and approved the final manuscript.

Author details

1Computer Science and Information Engineering, National Chi Nan University, Puli, Taiwan. 2Faculty of System Design Tokyo Metropolitan University, Hino, Tokyo, Japan. 3Computer Science and information Engineering, National Central University, Taoyuan, Taiwan. 4Department of Internal Medicine, Landseed Hospital, Taoyuan, Taiwan.

Received: 1 December 2014 Accepted: 27 February 2015

ReferencesDirectorate-General for the Information Society and Media. (2010). Advancing and applying Living Lab methodologies: an update on Living Labs for user-driven open innovation in the ICT domain. European Union: European Network of Living Labs publication.

Eriksson, M, Niitamo, V-P, & Kulkki, S. (2005). State-of-the-art in utilizing Living Labs approach to user-centric ICT innovationa European approach. Technology 13, 1, 113.

Liao, H-F, & Huang, A-W. (2009). Introduction to International Classification of Functioning, Disability and Health (ICF) and recommendations forits application in disability evaluations in Taiwan. Formosan Journal of Physical Therapy, 34(5), 310318.

Morris, JC. (1993). The Clinical Dementia Rating (CDR): current version and scoring rules. Neurology, 43, 24122414.

Muilder, I, & Stappers, PJ. (2009). Co-creating in practice: result and challenges, collaborative innovation: emerging technologies, environments and communities (pp. 2224).

Mulvenna, MD, & Nugent, CD. (2010). Supporting people with dementia using pervasive health technologies. Berlin: Springer.

Reed, G, Bufka, L. (2006). Using the ICF in Clinical Practice, Annual NorthAmerican Collaborating Center Conference on ICF; 12, [Online] http://www.wcpt.org/sites/wcpt.org/files/files/KN-ICF-Clinical_practice.pdf

Web End =http://www. http://www.wcpt.org/sites/wcpt.org/files/files/KN-ICF-Clinical_practice.pdf

Web End =wcpt.org/sites/wcpt.org/files/files/KN-ICF-Clinical_practice.pdf .

Shotton, J, Fitzgibbon, A, Cook, M, Sharp, T, Finocchio, M, & Moore, R. (2011). Real-time human pose recognition in parts from single depth images. Computer Vision and Pattern Recognition (CVPR), 2, 12971304.

World Health Organization. (2001). International classification of functioning, disability and health: ICF-CY. Geneva: World Health Organization.

World Health Organization. (2007). International classification of functioning, disability and health: children and youth version: ICF-CY. World Health Organization.

Submit your manuscript to a journal and benet from:

7 Convenient online submission7 Rigorous peer review7 Immediate publication on acceptance7 Open access: articles freely available online 7 High visibility within the eld7 Retaining the copyright to your article

Submit your next manuscript at 7 springeropen.com