Continuous Monitoring of Vital Signs Using Wearable Devices on the General Ward: Pilot Study

Abstract

Background: Measurement of vital signs in hospitalized patients is necessary to assess the clinical situation of the patient. Early warning scores (EWS), such as the modified early warning score (MEWS), are generally calculated 3 times a day, but these may not capture early deterioration. A delay in diagnosing deterioration is associated with increased mortality. Continuous monitoring with wearable devices might detect clinical deterioration at an earlier stage, which allows clinicians to take corrective actions.

Objective: In this pilot study, the feasibility of continuous monitoring using the ViSi Mobile (VM; Sotera Wireless) and HealthPatch (HP; Vital Connect) was tested, and the experiences of patients and nurses were collected.

Methods: In this feasibility study, 20 patients at the internal medicine and surgical ward were monitored with VM and HP simultaneously for 2 to 3 days. Technical problems were analyzed. Vital sign measurements by nurses were taken as reference and compared with vital signs measured by both devices. Patient and nurse experiences were obtained by semistructured interviews.

Results: In total, 86 out of 120 MEWS measurements were used for the analysis. Vital sign measurements by VM and HP were generally consistent with nurse measurements. In 15% (N=13) and 27% (N=23) of the VM and HP cases respectively, clinically relevant differences in MEWS were found based on inconsistent respiratory rate registrations. Connection failure was recognized as a predominant VM artifact (70%). Over 50% of all HP artifacts had an unknown cause, were self-limiting, and never took longer than 1 hour. The majority of patients, relatives, and nurses were positive about VM and HP.

Conclusions: Both VM and HP are promising for continuously monitoring vital signs in hospitalized patients, if the frequency and duration of artifacts are reduced. The devices were well received and comfortable for most patients.

Introduction

In hospitalized patients, vital signs are measured to assess the clinical situation of the patient and to identify clinical deterioration [1]. Monitoring of these vital signs is usually done by nurses, and includes blood pressure (BP), heart rate (HR), respiratory rate (RR), blood oxygen saturation, and core temperature. Early warning scores (EWS) are physiological track-and-trigger systems, which use a multiparameter or aggregate weighted scoring system that assists in detecting physiological changes and thereby identify patients at risk for further deterioration [2,3]. The modified early warning score (MEWS) is a commonly used and validated EWS system (see Multimedia Appendix 1) [4-6]. A higher MEWS is associated with admissions to the intensive care unit (ICU), cardiac arrest, and mortality [7-9]. Since the introduction of EWS, a trend was seen toward a decrease in unplanned admissions to the ICU and a decrease in hospital mortality [10-16]. Although the EWS provides relevant data on patients’ health status, the interval measurements may not capture early deterioration of vital signs [17], particularly during the night when clinical deterioration may remain undetected until the next day [18]. This could explain why the majority of the unplanned ICU admissions take place between 8 am and 4 pm [19]. Unplanned ICU admissions are associated with an increased mortality rate, a longer hospital stay [20-22], and a 60% increase in hospitalization costs [23]. Continuous monitoring of vital signs could be a useful tool to detect clinical deterioration in an earlier phase, which allows clinicians to take corrective interventions, particularly since subtle changes in vital signs often are present 8 to 24 hours before a life-threatening event such as ICU admission, cardiac arrest, and death [13,24-27]. Nowadays, wearable devices that facilitate remote continuous monitoring of vital signs exist [28]. These wireless devices could reduce patient discomfort due to fewer measurements by nurses [29-31], allow patient mobility [31], and might reduce workload for nurses [30]. Moreover, wearable devices are promising for safe patient transports between wards, the operating room, and the radiology department [32]. However, these devices are still underutilized in health care, even though they have been shown to be accurate [17,33], and may reduce costs [34]. Despite many potential advantages, wearable devices may have disadvantages regarding technical dysfunction and adverse psychological effects increasing anxiety of patients for disturbances of vital signs [33].

Recently, ViSi Mobile (VM; Sotera Wireless) and HealthPatch (HP; Vital Connect), two new devices approved by the US Food and Drug Administration (FDA) for wireless remote monitoring of vital signs, were introduced in health care. At present, little is known about the feasibility of continuous monitoring and experiences of patients and caregivers. The objective of this pilot study was to assess the technical feasibility of continuous monitoring with these new devices and to evaluate the experiences of patients and nurses with this method of monitoring on the general ward.

Methods

Setting and Recruitment

Patients hospitalized in the internal medicine and surgical ward of the Radboud University Medical Center were included between December 2014 and March 2015. All consecutively admitted patients were approached for participation if they were hospitalized for at least 48 hours, and MEWS measurements were ordered at least three times a day by their medical doctor. Patients had to be 18 years or older and able to speak, read, and understand the local language. At the internal medicine ward, both VM and HP were attached to the patient after signed informed consent was obtained. At the surgical ward, patients signed informed consent before an elective surgical procedure. Both devices were attached to the patients after surgery and arrival at the ward. Patients were excluded from further analyses if they unexpectedly participated for a duration shorter than 24 hours in the study. To determine the technical feasibility and practical usability, the two wearable devices were used to continuously measure vital signs in patients, which were compared with regular data collected in the same patients. Since a formal power calculation was not feasible due to the lack of preliminary data with these monitoring systems, a sample size of 20 was estimated to obtain sufficient data for analysis. After reviewing the study protocol, the institutional review board waived the need for formal review and approval (number 2014-1434).

ViSi Mobile

The VM system has received Conformité Européenne (CE) mark and is FDA-cleared for continuously monitoring of 3- or 5-lead electrocardiogram (ECG), heart and pulse rate, blood oxygen saturation, RR, skin temperature, and BP (cuff-based and cuff-less on beat-to-beat basis; Figure 1). All vital signs are displayed on a patient-worn wrist device, which can be locked by an authentication code. This wrist device is connected to a thumb sensor, which measures blood oxygen saturation and BP. A chest sensor measures RR and skin temperature, and is connected with 3 or 5 ECG cables and sensors. In this pilot study, VM was wirelessly connected to a stand-alone Toughbook (Panasonic) pre-installed with VM software, from where the investigators received real-time insights on patients’ vital signs and where all the data were stored. This Toughbook also showed alarms as soon as vital signs dropped out of normal ranges. The VM wrist device was powered by rechargeable batteries, which needed to be replaced every 12 to 14 hours.

HealthPatch

The HP consists of a reusable sensor and a disposable adhesive patch with 2 ECG electrodes at the bottom of the patch and a reusable sensor (see Figure 1). The HP has received CE mark and is FDA-cleared for continuous measurement of single-lead ECG, HR, heart rate variability (HRV), RR, skin temperature, body posture, fall detection, and activity. This small and lightweight patch can be attached to the patient’s chest, from where the data is transmitted to a mobile device (eg, mobile phone, via Bluetooth). Wi-Fi connection facilitates data transmission from the mobile device to a secured cloud server. The patch is powered by a coin-cell battery that lasts 3 to 4 days.

Figure 1. ViSi Mobile system (left) and HealthPatch (right).

Study Procedures

Patients gave verbal and written consent after being informed about the study protocol. Demographics including gender, age, reason for admission, and type of surgery were collected. At the surgical ward, VM and HP were attached to the patient after surgery and arrival at the ward. At the internal medicine ward, both devices were attached to the patient directly after signed informed consent was obtained. Vital signs were continuously measured during 2 or 3 days. This time frame was chosen to obtain enough vital sign data for analysis and to allow patients to get familiar with the devices. Nurses measured vital signs three times daily according to the protocol. Trained medical students additionally observed time-related vital signs monitored by VM at the Toughbook and HP on the cloud server. They marked the time points where vital signs were taken by the nurse and manually selected the results for vital signs measured by both devices at these time points for comparison. They also registered the cause and duration of technical problems and fixed them when necessary. In case of a VM alarm, the student warned the nurse. After 2 to 3 days, the enrolled patients and their relatives were interviewed about their experiences regarding continuous monitoring and both wearable devices. Nurses involved in the care of included patients were interviewed as well.

Data Collection and Analysis

Technical Feasibility

All registered data from VM and HP were retrieved for analysis in the Statistical Package for the Social Sciences version 20.0 (SPSS, Inc). Data of both devices were compared with measurements by nurses at the same time points. For each variable, the accepted discrepancy between nurse measurements and both devices was determined, which are listed in Table 1. These thresholds were defined as the maximum possible discrepancy in vital signs between the nurse measurements and both devices that would not lead to a change in medical treatment. A difference in MEWS score of 1 point or more between the nurse measurements and both devices was defined as a clinically relevant difference. The MEWS scores were calculated using vital signs measured by the nurses, VM, and HP. As VM and HP did not measure all required vital signs to calculate the MEWS score, such as level of consciousness, these vital signs were taken from the electronic health records (EHR). Bland-Altman plots [35] were created to assess the agreement between MEWS measurements by nurses and corresponding values of VM and HP. All artifacts ≥1 minute were analyzed, since we reasoned that artifacts of less than one minute would not be clinically relevant for a patient’s situation. An artifact had occurred if no or an invalid value was recorded. Since trained medical students were not present all the time (primarily not during out-of-office hours), artifacts were divided into two groups, depending on the presence of a student.

Table 1. Accepted discrepancies between nurse measurements, ViSi Mobile, and HealthPatch.

Vital sign	Accepted discrepancy
Heart rate	5 beats/min
Respiratory rate	2 breaths/min
Oxygen saturation	2%
Temperaturea	0.5˚C
Blood pressure	5 mm Hg
MEWS	1

^aViSi Mobile and HealthPatch measure skin temperature.

Practical Usability

User experiences were obtained by means of semistructured face-to-face interviews, after the patients had used the devices for 2 to 3 days. Patients’ relatives and nurses were also interviewed. Interviews lasted approximately 10 minutes and the following topics were discussed: feelings of unsafety or safety, user friendliness, adverse events, and detection of clinical deterioration. One researcher (MW) performed a thematic content analysis to determine perceived positive and negative effects, and facilitators and barriers, which was critically reviewed by a second researcher (TB). Perceived positive and negative effects were presented according to the Donabedian framework for the quality of health care [36], which includes three main domains: structure, process, and outcome. Facilitators and barriers were divided into four domains: characteristics related to the patient, professional, intervention, and context [37].

Results

Demographics

A total of 25 patients were invited, of which 20 participated in the study—10 patients at the surgical ward and 10 patients at the internal medicine ward. The other 5 patients refused participation because they thought it would be too much of a mental or physical burden (see Figure 2). The study population included 13 males and 7 females with a mean age (standard deviation, SD) of 49.9 (13.4) years, ranging between 33 and 82 years. At the surgical ward, most patients were admitted for an elective gastrointestinal operation. Patients at the internal medicine ward were admitted for several conditions such as sepsis, arthritis, and blood pressure control.

Technical Feasibility

In total, 120 vital sign measurements by nurses were observed by the trained medical students (see Figure 2). In 40 measurements, one or more vital signs were missing. In 6 measurements, data were completed by consulting the EHR. As a result, 86 measurements were used for further analysis. For the remaining 34 measurements, VM and HP data were lacking (25 measurements), or vital signs were not documented by nurses (9 measurements). In 8 patients, data from the Toughbook was not available for further analysis due to accidental deletion of data; in 2 patients, no HP data were saved at the cloud server due to technical failures (eg, WiFi failures, disconnection between HP and its mobile device). In total, 742.8 hours of VM data and 1033.6 hours of HP data were collected; on an average 61.9 hours of VM and 57.5 hours of HP data were collected per patient.

Figure 2. Included patients and vital sign measurements.

Figure 3. Bland-Altman plots: (a) heart rate (VM and HP), (b) respiratory rate (VM and HP), (c) systolic and diastolic blood pressure (VM). Dotted lines indicate mean difference and solid lines indicate limits of agreement.

Figure 4. Bland-Altman plots showing modified early warning score: (a) VM and HP, (b) VM and HP (jittered). Dotted lines indicate mean difference and solid lines indicate limits of agreement.

Vital Signs

Bland-Altman plots showing the mean of the two devices and the differences between the two devices (y-axis) with limits of agreement (1.96 SD) are displayed in Figures 3 and 4. Comparing the results for vital signs and MEWS score measured by nurses and VM, the mean differences were all within range with the predefined accepted discrepancies in Table 1, although wide limits of agreement were found (see Table 2). The largest discrepancy in the mean difference was found for diastolic BP. In 13 (15%) cases, the MEWS difference between nurse and VM was 2 points or higher, indicating important clinical differences between VM and nurse measurements (see Table 3). In four cases, this was related to differences in RR alone. In the remaining cases, the combination of RR and oxygen saturation, or RR and systolic BP caused the difference. Moreover, in six of these cases, VM measured a higher RR than nurses (range: 1-6 breaths/min), and in the four other cases, nurses measured a higher RR than VM (difference: 2-6 breaths/min). In the three remaining cases that resulted in a different MEWS, there was a difference in systolic BP (difference: 14 mm Hg) or oxygen saturation (difference: 1%-5%) between VM and the nurse. The mean differences between nurse measurement and HP were all in agreement with accepted discrepancies, although wide limits of agreement were found (see Table 2). In 23 (27%) cases, MEWS differed 2 or 3 points between HP and nurse measurements (see Table 3). In 17 cases, HP measured higher RR compared with nurses. In 16 cases, differences were in the range of 3 to 8 breaths/minute. However, in one case, nurses measured 16 breaths/minute and HP measured 42 breaths/minute, indicating possible measurement errors in HP. In the remaining six cases, nurses measured a higher RR than HP (difference: 4-12 breaths/min).

Table 2. ViSi Mobile and HealthPatch data in comparison with corresponding nurse measurements.

Vital signs	Nurse	ViSi Mobile		HealthPatch
	Mean (SD)j	Mean (SD)	Mean difference (SD) versus nurse	Mean (SD)	Mean difference (SD) versus nurse
HRf (beats/min)	81.81 (13.12)	81.62 (12.23)	−0.20 (5.54)	84.34 (12.24)	−1.52c (5.63)
RRg (breaths/min)	17.38 (3.89)	16.20 (4.57)	1.19a (3.43)	18.02 (5.82)	−0.64 (4.94)
Saturation (%)	97.00 (96.00 to 98.00)d	97.00 (95.00 to 98.00)d	0.10 (1.65)	N/Ak	N/A
Temperature (˚C)	37.01 ( 0.60)	33.61(1.25)e		34.16 (1.16)e
BPh, systolic (mm Hg)	127.93 (19.33)	127.49 (18.68)	0.44 (11.99)	N/A	N/A
BP, diastolic (mm Hg)	73.17 (10.25)	81.17 (11.24)	−8.00b (9.93)	N/A	N/A
MEWSi	0.99 (1.13)	1.38 (1.30)	−0.40a (1.13)	1.59 (1.54)	−0.60b (1.22)

^aP=.002.

^bP < .001.

^cP=.01.

^dOxygen saturation was reported as median with interquartile range.

^eSkin temperature.

^fHR: heart rate.

^gRR: respiratory rate.

^hBP: blood pressure.

ⁱMEWS: modified early warning score.

^jSD: standard deviation.

^kN/A: Not applicable.

Artifacts

ViSi Mobile

In total, 306 artifacts were found, with a total time of 121 hours. In 111 (36.3%) of 306 artifacts, a trained medical student was present, and 86 of 111 (77.5%) were identified and reported. A cause was found in 82 (95.1%) of 86 artifacts. Almost 70% of all reported artifacts were caused by connection failure between Toughbook and VM. Other artifact causes were motion of the sensors due to patient movements (n=21, 25.6%) and required calibration of blood pressure (n=2, 2.3%). Over 74% of all artifacts lasted less than 5 minutes. Almost 20% lasted less than 1 hour, and approximately 7% lasted longer than 1 hour.

HealthPatch

In total, 648 artifacts were found in 18 patients, with a total time of 135 hours. More than 50% (n=354) of all artifacts lasted less than 1 minute and were excluded from further analysis. In the remaining 294 artifacts, a trained medical student was present in 60% (n=176) of the artifacts, and identified and reported the artifact in 53 (30%) cases. A cause was found in 24 (45%) artifacts such as HealthPatch losing skin contact (n=13, 54%), Bluetooth (n=4, 17%) or Wi-Fi problems (n=3, 13%), and patients leaving the ward without their mobile device (n=3, 13%). Around 43% of all artifacts lasted less than 5 minutes. Over 95% of all artifacts lasted less than 1 hour.

Table 3. ViSi Mobile (VM) and HealthPatch (HP) data in comparison with corresponding nurse measurements.

Vital signs	ViSi Mobile	HealthPatch
	Difference; nurse-VM (%)	Difference; nurse-HP (%)
HRa (beats/min)	≤5: 71 (82.5)	≤5: 65 (75.6)
	6-10: 12 (14.0)	6-10: 16 (18.6)
	> 10: 3 (3.5)	> 10: 5 (5.8)
RRb (breaths/min)	≤2: 50 (58.2)	≤2: 36 (41.9)
	3-5: 26 (30.2)	3-5: 31 (36.0)
	> 5: 10 (11.6)	> 5: 19 (22.1)
Saturation (%)	≤2: 76 (88.4)	N/Ae
	3-4: 9 (10.5)
	≥5: 1 (1.1)
BPc systolic (mm Hg)	≤5: 36 (41.9)	N/A
	6-14: 33 (38.4)
	≥15: 17 (19.7)
BP diastolic (mm Hg)	≤5: 27 (31.4)	N/A
	6-14: 40 (46.5)
	15: 19 (22.1)
MEWSd	−4: 1 (1.2)	−3: 9 (10.5)
	−3: 5 (5.8)	−2: 11 (12.8)
	−2: 4 (4.7)	−1: 13 (15.1)
	−1: 23 (26.7)	0: 47 (54.7)
	0: 40 (46.5)	1: 3 (3.5)
	1: 10 (11.6)	2: 2 (2.3)
	2: 3 (3.5)	3: 1 (1.2)

^aHR: heart rate.

^bRR: respiratory rate.

^cBP: blood pressure.

^dMEWS: modified early warning score.

^eN/A: not applicable.

Practical Usability

Evaluations were performed with all 20 patients, 7 relatives, and 4 nurses (see Table 4).

Perceived Positive and Negative Effects

Processes

One positive effect was identified in this dimension. Patients stated that nurses could keep an eye on the vital signs from a distance (n=3); this was also mentioned by one relative. No negative effects were identified.

Outcomes

Two positive effects were identified in this dimension. Eight patients and 66 relatives mentioned increased feelings of safety by being monitored continuously in comparison with the MEWS measurements by nurses only. A patient described:

Being monitored continuously is a very pleasant experience; I felt very safe. [Translated from Dutch]

Earlier interventions were deemed possible in case of clinical deterioration (n=3). One negative effect was identified; one patient complained about having redness and itching while wearing the devices.

Facilitators and Barriers

Intervention

Seven facilitators were identified. Eight patients said they were not aware of the HP while it was attached to their chest. Other facilitators included not being restricted by the devices during daily activities such as bathing and putting on clothes (n=3), more freedom of movements compared with conventional devices (n=2), the small size of the HP (n=1), the good adhesive properties of the patches (n=1), and the invisibility of the devices under clothes (n=1). One patient described:

I have used a holter monitor at home several times. These devices are much smaller and they do not limit mobility to the same extent. [Translated from Dutch]

One patient experienced great advantage of having an insight on his own vital signs. One barrier was noted 15 times. Patients mentioned that the VM wrist device was big or heavy (n=10); patches came off very quick (6 VM; 2 HP); VM had many cables (n=4); and VM had a short battery life (n=2).

Professional

Two facilitators and one barrier were identified in this domain. Two nurses stated that the patches did not lose skin contact while washing the patient, and one nurse said that it was very easy to attach the devices to the patient. One nurse mentioned that Wi-Fi connection was poor between Toughbook and the VM device.

Additional Findings

During the study, clinical deterioration was detected with the VM in one patient 3 days postoperatively after elective colorectal surgery. The device alerted the nurse who cared for the patient because he developed a tachycardia and tachypnea. This situation occurred between two regular measurements. He underwent relaparotomy after an anastomotic leak was confirmed by computer tomography.

Table 4. Users’ experiences.

Users’experience			Nurse	Patient	Relatives
Perceived positive and negative effects
	Processesa
		Nurse could keep eye on vital signs more easily		+	+
	Outcomes
		Feelings of safety		+	+
		Earlier interventions		+
		Adverse events (redness and itching)		−
Barriers and facilitators
	Intervention
		Not aware of HPb		+
		Small size of HP		+
		Good adhesive properties		+
		Not being restricted during daily activities		+
		More freedom of movements		+
		Invisibility under clothes		+
		Better insight on own vital signs		+
		VMc wrist device too big/heavy		−
		Patches came off very quickly		−
		VM has too many cables		−
		Short VM battery life		−
	Professional
		Good adhesive properties	+
		Very easy to attach the devices	+
		Bad Wi-Fi connection between VM and Toughbook	−

^aNo positive or negative effects in the “Structure” or “Context” fields were found.

^bHP: HealthPatch.

^cVM: ViSi Mobile.

Discussion

Principal Findings

This study describes a unique approach in which we continuously measured vital signs on the ward using two recently released wireless devices. In general, data obtained by these devices correlated well with predefined accepted discrepancies and MEWS calculated on the basis of these devices correlated to a larger extent. Patients and nurses were mainly positive about the two devices. Both VM and HP are promising devices for continuous patient monitoring on the general ward. However, the number of artifacts should be reduced and the barriers mentioned by the users could be addressed to further improve both devices.

Vital Signs

The largest discrepancy in mean difference was found in VM diastolic blood pressure, which is unlikely to be directly clinically meaningful since it is not a component of the MEWS. Additionally, clinical decisions are mainly based on systolic blood pressure and other vital signs. Wide limits of agreement were found for almost all vital signs and MEWS. Although more than 70% of all MEWS differed 0 or only 1 point between devices and nurse measurements, larger differences in MEWS were found in a few cases, which may have important clinical consequences (eg, additional diagnostic procedures or change in treatment). In most of these cases, VM and HP measured a higher RR when nurses did not. Although most differences between nurse and device measurements were small ( < 5 breaths/min), in one case, difference between nurse and HP measurements was large (26 breaths/min). These findings are important as abnormal RR has been shown to be an important predictor of cardiac arrest [38] and an indicator of sepsis, pneumonia and respiratory depression [39]; therefore, it could under- or overestimate a clinical condition of a patient. Inaccurate RR measurements by nurses could explain the discrepancy. Direct measurement of RR is usually done by visually observing chest movement or by manual observations. Reproducibility may be limited by significant interobserver variability [40]. Conversely, ECG-derived RR measurements by HP and VM may be inaccurate. In case of HP, RR is estimated by ECG using the respiratory sinus arrhythmia method, which derives RR from HRV. Since this method has some limitations, an accelerometer was added to measure RR more accurately [41]. In VM, RR is derived from impedance pneumography, measuring respiratory volume and rate through the relationship between respiratory depth and thoracic impedance rate [42]. ECG-derived RR may not be accurate when there is excessive patient motion or during lower respiratory rates [43,44]. More research is required to gain a deeper insight in the different methods of measuring RR by devices and nurses.

Artifacts

Most reported that VM artifacts concerned connectivity failure between VM and Toughbook. This was caused by a restricted Wi-Fi connection of approximately 15 meters between VM and Toughbook, which explains why more artifacts were found in mobile patients. These artifacts were not deemed relevant since more stable Wi-Fi connections, such as by using multiple access points and 5 Ghz networks, would be used to implement VM in a hospital setting. This would also facilitate continuous monitoring during patient transport between different wards. However, it is important to consider that a wireless connection can always fail, thus proper backup power and Internet connections are always demanded. Most HP artifacts were of unknown cause. However, most artifacts lasted less than one hour and were self-limiting.

Although HP could not measure all vital signs that are currently used to monitor patients and to calculate the MEWS, it may still provide more patient data than interval measurements by nurses, resulting in a more continuous dataflow and more specific trends. This may be of significance, in particular, since literature shows important lack of documentation of vital signs before a life-threatening event [27]. Besides that, several studies show that HR and RR change significantly before ICU transfer, cardiac arrest, and mortality and therefore, HP can have a valuable contribution to the prediction of life-threatening events [24,27].

Practical Usability

The majority of patients, relatives, and nurses were positive about VM and HP. Whereas HP is able to administer vital signs in real time to patient’s mobile phone, VM shows vital signs in real time on the wrist device; these devices could therefore increase insight on patient’s health status and potentially influence their behaviors [45,46]. Although patients mentioned that the VM wrist device was heavy and VM consisted of many cables, they were not restricted during daily activities or mobility. This is important as hospitalized patients benefit from mobility, resulting in increased recovery and reduced risk of complications [47,48]. Another benefit of VM and HP is that nurses are able to see patients’ vital signs from a distance. A review by Ulrich et al [49] has shown that sleep deprivation in patients is a common problem that is associated with hindrance of the healing process and an increase in morbidity and mortality. Using VM and HP, patients could continue sleeping during the night and did not have to be disturbed by vital sign measurements.

Possible negative aspects of continuous monitoring should also be taken into consideration. Wearable devices generate a large quantity of data each day. The workload of nurses and physicians withholds them from inspecting all these data, which means that the predictive value of continuous monitoring is lost [17]. Validated devices are available to process all these data and to send an alert when patient’s vital signs drop out of normal ranges. A large number of alerts and even false-positive alerts could cause alarm-fatigue in nurses [17,50]. Algorithms using machine learning could be utilized to reduce false-positive alarms [51-53]. The VM battery has a battery life of 12 to 14 hours, which means that nurses have to change batteries twice a day. This might outweigh the fact that nurses no longer need to perform the standard MEWS measurements three times a day.

Comparison With Prior Work

A few studies about continuous monitoring at the general ward have been published. A wireless sensor was successfully used in pregnant women in an inpatient obstetric unit, which was able to monitor HR, RR, and temperature [30]. Recently, the SensiumVitals digital patch was tested in hospitalized patients [54]. This patch is able to measure HR and RR and was compared with a commonly used clinical monitor. A satisfactory agreement, comparable with the result in our study, was shown. The drawback of the study design was that the patients were monitored for only 2 hours, which prevented the authors from detecting trends in vital signs and lowered predictive value. The use of an implantable device for continuous monitoring has been described in the ambulatory setting. Abraham et al [55] described the use of a wireless implantable hemodynamic monitoring system in heart failure patients, which has shown to reduce hospitalization. Wireless technology systems in which patients measure vital signs at home have been described, such as for patients with chronic obstructive pulmonary disease [56], patients with hypertension [57], and patients with diabetes mellitus [58,59]. These systems were often well received by patients and health care providers, showing improvement of blood values such as glucose [58,60], patients’ disease management [56,61], and better connection between the patient and the health care provider [59]. Particularly, the HP might be suitable for home monitoring, although its current version lacks the possibility to measure all vital signs. Though VM measures all vital signs, its size and cables might demand much from patients to enable monitoring at home.

Strength and Limitations

An important strength of the study is that we were able to monitor patients in a clinical setting instead of healthy participants in controlled settings. The study had a small sample size, and we missed some VM and HP data, particularly since VM data of 8 patients were automatically deleted from the Toughbook and could not be used for artifact analysis. This was due to wrong Toughbook settings and was changed with support from the manufacturer. The VM vital signs observed by students were used for the comparison with nurse measurements, and we were therefore able to draw conclusions about the feasibility of both VM and HP. However, data saturation in patient, nurse, and relative interviews may not have been reached. Selection bias could have occurred as not all patients who were approached did agree to participate. A further limitation of VM and HP is that both devices measure skin temperature instead of body temperature. Although it is not yet clear whether or not all vital signs are necessary for proper clinical judgment of ill patients, an algorithm should be developed to convert skin temperature into body temperature.

Conclusions

The VM and HP are promising devices for wireless continuous patient monitoring in the hospital and were very well received by both patients and nurses. The frequency and duration of artifacts should be reduced and the barriers mentioned could be addressed to further improve VM and HP. An ongoing follow-up study focuses on the different effects of VM or HP compared with routine MEWS measurements on patient comfort and safety and nurse workload, and on early detection of deterioration. Future studies should focus on the effect of continuous monitoring on clinical outcome.

Acknowledgments

The project was funded by the Radboud University Medical Center.

Conflicts of Interest

None declared.

Multimedia Appendix 1

Modified Early Warning Score (MEWS); A: alert, V: response to speaking, P: response to pain, U: no response.

References

Welch J, Moon J, McCombie S. Early detection of the deteriorating patient: the case for a multi-parameter patient-worn monitor. Biomed Instrum Technol 2012;Suppl:57-64.

Centre for Clinical Practice at NICE (UK). Acutely ill patients in hospital: recognition of and response to acute illness in adults in hospital. National Institute for Health and Clinical Excellence: Guidance 2007 Jul.

Burch VC, Tarr G, Morroni C. Modified early warning score predicts the need for hospital admission and inhospital mortality. Emerg Med J 2008 Oct;25(10):674-678.

Subbe CP, Kruger M, Rutherford P, Gemmel L. Validation of a modified Early Warning Score in medical admissions. QJM 2001 Oct;94(10):521-526

Gardner-Thorpe J, Love N, Wrightson J, Walsh S, Keeling N. The value of Modified Early Warning Score (MEWS) in surgical in-patients: a prospective observational study. Ann R Coll Surg Engl 2006 Oct;88(6):571-575

Ludikhuize J, Borgert M, Binnekade J, Subbe C, Dongelmans D, Goossens A. Standardized measurement of the Modified Early Warning Score results in enhanced implementation of a Rapid Response System: a quasi-experimental study. Resuscitation 2014 May;85(5):676-682.

Goldhill DR, McNarry AF, Mandersloot G, McGinley A. A physiologically-based early warning score for ward patients: the association between score and outcome. Anaesthesia 2005 Jun;60(6):547-553

Quarterman CP, Thomas AN, McKenna M, McNamee R. Use of a patient information system to audit the introduction of modified early warning scoring. J Eval Clin Pract 2005 Apr;11(2):133-138.

Smith ME, Chiovaro JC, O'Neil M, Kansagara D, Quiñones AR, Freeman M, et al. Early warning system scores for clinical deterioration in hospitalized patients: a systematic review. Ann Am Thorac Soc 2014 Nov;11(9):1454-1465.

Alam N, Hobbelink EL, van Tienhoven AJ, van de Ven PM, Jansma EP, Nanayakkara PW. The impact of the use of the Early Warning Score (EWS) on patient outcomes: a systematic review. Resuscitation 2014 May;85(5):587-594.

Churpek MM, Yuen TC, Edelson DP. Risk stratification of hospitalized patients on the wards. Chest 2013 Jun;143(6):1758-1765

Hillman K, Chen J, Cretikos M, Bellomo R, Brown D, Doig G, MERIT study investigators. Introduction of the medical emergency team (MET) system: a cluster-randomised controlled trial. Lancet 2005 Jun;365(9477):2091-2097.

Mapp ID, Davis LL, Krowchuk H. Prevention of unplanned intensive care unit admissions and hospital mortality by early warning systems. Dimens Crit Care Nurs 2013;32(6):300-309.

McNeill G, Bryden D. Do either early warning systems or emergency response teams improve hospital patient survival? A systematic review. Resuscitation 2013 Dec;84(12):1652-1667.

Kim WY, Shin YJ, Lee JM, Huh JW, Koh Y, Lim CM, et al. Modified early warning score changes prior to cardiac arrest in general wards. PLoS One 2015 Jun;10(6):e0130523

Schmidt PE, Meredith P, Prytherch DR, Watson D, Watson V, Killen RM, et al. Impact of introducing an electronic physiological surveillance system on hospital mortality. BMJ Qual Saf 2015 Jan;24(1):10-20.

Clifton L, Clifton DA, Pimentel MA, Watkinson PJ, Tarassenko L. Predictive monitoring of mobile patients by combining clinical observations with data from wearable sensors. IEEE J Biomed Health Inform 2014 May;18(3):722-730.

Beckett D, Gordon C, Paterson R, Chalkley S, Macleod D, Bell D. Assessment of clinical risk in the out of hours hospital prior to the introduction of Hospital at Night. Acute Med 2009;8(1):33-38.

Jonsson T, Jonsdottir H, Möller AD, Baldursdottir L. Nursing documentation prior to emergency admissions to the intensive care unit. Nurs Crit Care 2011;16(4):164-169.

Haller G, Myles PS, Wolfe R, Weeks AM, Stoelwinder J, McNeil J. Validity of unplanned admission to an intensive care unit as a measure of patient safety in surgical patients. Anesthesiology 2005 Dec;103(6):1121-1129.

Frost SA, Alexandrou E, Bogdanovski T, Salamonson Y, Parr MJ, Hillman KM. Unplanned admission to intensive care after emergency hospitalisation: risk factors and development of a nomogram for individualising risk. Resuscitation 2009 Feb;80(2):224-230.

Calzavacca P, Licari E, Tee A, Egi M, Downey A, Quach J, et al. The impact of Rapid Response System on delayed emergency team activation patient characteristics and outcomes--a follow-up study. Resuscitation 2010 Jan;81(1):31-35.

Kaboli PJ, Rosenthal GE. Delays in transfer to the ICU: a preventable adverse advent? J Gen Intern Med 2003 Feb;18(2):155-156

Churpek MM, Yuen TC, Edelson DP. Predicting clinical deterioration in the hospital: the impact of outcome selection. Resuscitation 2013 May;84(5):564-568

Cretikos M, Chen J, Hillman K, Bellomo R, Finfer S, Flabouris A, MERIT study investigators. The objective medical emergency team activation criteria: a case-control study. Resuscitation 2007 Apr;73(1):62-72.

Kyriacos U, Jelsma J, Jordan S. Record review to explore the adequacy of post-operative vital signs monitoring using a local modified early warning score (mews) chart to evaluate outcomes. PLoS One 2014 Jan 31;9(1):e87320

Ludikhuize J, Smorenburg SM, de Rooij SE, de Jonge E. Identification of deteriorating patients on general wards; measurement of vital parameters and potential effectiveness of the Modified Early Warning Score. J Crit Care 2012 Aug;27(4):424.e7-424.13.

Kroll RR, Boyd JG, Maslove DM. Accuracy of a wrist-worn wearable device for monitoring heart rates in hospital inpatients: a prospective observational study. J Med Internet Res 2016 Sep 20;18(9):e253

Zubiete ED, Luque LF, Rodríguez AV, González IG. Review of wireless sensors networks in health applications. Conf Proc IEEE Eng Med Biol Soc 2011;2011:1789-1793.

Boatin AA, Wylie BJ, Goldfarb I, Azevedo R, Pittel E, Ng C, et al. Wireless vital sign monitoring in pregnant women: a functionality and acceptability study. Telemed J E Health 2016 Jul;22(7):564-571.

Sahandi R, Noroozi S, Roushan G, Heaslip V, Liu Y. Wireless technology in the evolution of patient monitoring on general hospital wards. J Med Eng Technol 2010 Jan;34(1):51-63.

Ohashi K, Kurihara Y, Watanabe K, Ohno-Machado L, Tanaka H. Feasibility evaluation of Smart Stretcher to improve patient safety during transfers. Methods Inf Med 2011;50(3):253-264.

Appelboom G, Camacho E, Abraham ME, Bruce SS, Dumont EL, Zacharia BE, et al. Smart wearable body sensors for patient self-assessment and monitoring. Arch Public Health 2014 Aug;72(1):28

Frost & Sullivan. EarlySense. 2016. Finding Top-Line Opportunities in a Bottom-Line Healthcare Market: Revenue Generation Opportunities Created by an Innovative Contact-Free Continuous Monitoring Solution URL: http://www.earlysense.com/wp-content/uploads/2013/08/Frost-Sullivan-White-Paper-FINAL.pdf [WebCite Cache]

Bland JM, Altman DG. Statistical methods for assessing agreement between two methods of clinical measurement. Lancet 1986 Feb 8;1(8476):307-310.

Donabedian A. The quality of care. How can it be assessed? JAMA 1988 Sep;260(12):1743-1748.

Grol R, Wensing M. What drives change? Barriers to and incentives for achieving evidence-based practice. Med J Aust 2004 Mar 15;180(6 Suppl):S57-S60.

Fieselmann JF, Hendryx MS, Helms CM, Wakefield DS. Respiratory rate predicts cardiopulmonary arrest for internal medicine inpatients. J Gen Intern Med 1993 Jul;8(7):354-360.

Taenzer AH, Pyke JB, McGrath SP, Blike GT. Impact of pulse oximetry surveillance on rescue events and intensive care unit transfers: a before-and-after concurrence study. Anesthesiology 2010 Feb;112(2):282-287.

Edmonds ZV, Mower WR, Lovato LM, Lomeli R. The reliability of vital sign measurements. Ann Emerg Med 2002 Mar;39(3):233-237.

Chan AM, Ferdosi N, Narasimhan R. Ambulatory respiratory rate detection using ECG and a triaxial accelerometer. Conf Proc IEEE Eng Med Biol Soc 2013;2013:4058-4061.

Helfenbein E, Firoozabadi R, Chien S, Carlson E, Babaeizadeh S. Development of three methods for extracting respiration from the surface ECG: a review. J Electrocardiol 2014;47(6):819-825.

Lee PJ. Clinical evaluation of a novel respiratory rate monitor. J Clin Monit Comput 2016 Apr;30(2):175-183.

Folke M, Cernerud L, Ekström M, Hök B. Critical review of non-invasive respiratory monitoring in medical care. Med Biol Eng Comput 2003 Jul;41(4):377-383.

Chen KY, Bassett Jr DR. The technology of accelerometry-based activity monitors: current and future. Med Sci Sports Exerc 2005 Nov;37(11 Suppl):S490-S500.

Dobkin BH, Dorsch A. The promise of mHealth: daily activity monitoring and outcome assessments by wearable sensors. Neurorehabil Neural Repair 2011;25(9):788-798

Markey DW, Brown RJ. An interdisciplinary approach to addressing patient activity and mobility in the medical-surgical patient. J Nurs Care Qual 2002 Jul;16(4):1-12.

Pashikanti L, Von Ah D. Impact of early mobilization protocol on the medical-surgical inpatient population: an integrated review of literature. Clin Nurse Spec 2012;26(2):87-94.

Ulrich RS, Zimring C, Zhu X, DuBose J, Seo HB, Choi YS, et al. A review of the research literature on evidence-based healthcare design. HERD 2008;1(3):61-125.

Welch J, Kanter B, Skora B, McCombie S, Henry I, McCombie D, et al. Multi-parameter vital sign database to assist in alarm optimization for general care units. J Clin Monit Comput 2016 Dec;30(6):895-900

Eerikäinen LM, Vanschoren J, Rooijakkers MJ, Vullings R, Aarts RM. Reduction of false arrhythmia alarms using signal selection and machine learning. Physiol Meas 2016 Aug;37(8):1204-1216.

Antink CH, Leonhardt S, Walter M. Reducing false alarms in the ICU by quantifying self-similarity of multimodal biosignals. Physiol Meas 2016 Aug;37(8):1233-1252.

Luo W, Phung D, Tran T, Gupta S, Rana S, Karmakar C, et al. Guidelines for developing and reporting machine learning predictive models in biomedical research: a multidisciplinary view. J Med Internet Res 2016 Dec 16;18(12):e323

Hernandez-Silveira M, Ahmed K, Ang SS, Zandari F, Mehta T, Weir R, et al. Assessment of the feasibility of an ultra-low power, wireless digital patch for the continuous ambulatory monitoring of vital signs. BMJ Open 2015 May 19;5(5):e006606

Abraham WT, Adamson PB, Bourge RC, Aaron MF, Costanzo MR, Stevenson LW, CHAMPION Trial Study Group. Wireless pulmonary artery haemodynamic monitoring in chronic heart failure: a randomised controlled trial. Lancet 2011 Feb 19;377(9766):658-666.

Bond CS, Worswick L. Self management and telehealth: lessons learnt from the evaluation of a Dorset telehealth program. Patient 2015 Aug;8(4):311-316.

Ahern DK, Stinson LJ, Uebelacker LA, Wroblewski JP, McMurray JH, Eaton CB. E-health blood pressure control program. J Med Pract Manage 2012;28(2):91-100.

Greenwood DA, Blozis SA, Young HM, Nesbitt TS, Quinn CC. Overcoming clinical inertia: a randomized clinical trial of a telehealth remote monitoring intervention using paired glucose testing in adults with Type 2 diabetes. J Med Internet Res 2015 Jul;17(7):e178

Ralston JD, Revere D, Robins LS, Goldberg HI. Patients' experience with a diabetes support programme based on an interactive electronic medical record: qualitative study. BMJ 2004 May 15;328(7449):1159

Alharbi NS, Alsubki N, Jones S, Khunti K, Munro N, de Lusignan S. Impact of information technology-based interventions for Type 2 diabetes Mellitus on glycemic control: a systematic review and meta-analysis. J Med Internet Res 2016 Nov 25;18(11):e310

Ahmed S, Ernst P, Bartlett SJ, Valois MF, Zaihra T, Paré G, et al. The effectiveness of web-based asthma self-management system, My Asthma Portal (MAP): a pilot randomized controlled trial. J Med Internet Res 2016 Dec 01;18(12):e313