Comparison of Grip Strength Measurements by Widely Used Three Dynamometers in Outpatients Aged 60 Years and Over

Abstract

Grip strength (GS) is widely used in various fields such as sports, rehabilitation, and geriatrics to assess muscle strength, and to diagnose sarcopenia and frailty in older adults. There is a potential for measurement differences among different dynamometers available, and studies comparing GS measurements by variable tools have conflicting results. The two most frequently used dynamometers are the Jamar hydraulic (Jamar) and spring-type hand grip dynamometers, and Jamar has not been compared to Jamar PLUS+ Digital (Jamar+) dynamometer in older adults. So, we aimed to assess GS measurements with the Jamar as the reference standard against Jamar+, and spring-type Takei T.KK. 5401 (Takei) digital dynamometers. One hundred and ten outpatients aged >60 years were included. Inter-instrumental reliability was determined. The differences between dynamometers were evaluated by Bland–Altman plots and measurement error. The measurements with Jamar+, and Takei dynamometers were reliable and valid regarding the Jamar dynamometer. Takei and Jamar+ dynamometers overestimated GS over the Jamar dynamometer. Though the differences in the measured values might be disregarded in clinical practice, individuals defined to have low GS varied by the use of different dynamometers. Grip strength better be measured by the same dynamometer in serial measurements of older individuals.

1. Introduction

Muscle weakness is a component of the diagnostic criteria for major geriatric syndromes such as sarcopenia [1] and frailty [2] which are getting more and more substantial in the aging World population, thus a part of the comprehensive geriatric assessment where low muscle strength measurements predict poor outcomes such as functional decline, decreased quality of life, increased morbidity, and mortality [1,3,4,5]. Those overlapping [6,7] geriatric conditions are relevant to geriatric rehabilitation [8], and sarcopenia is closely related to physical frailty [9]. To date, numerous diagnostic definitions, and measurement methods for sarcopenia were proposed [1,10,11,12,13,14,15]. One of the operational definitions for sarcopenia is the broadly used revised European Working Group on Sarcopenia in Older People-EWGSOP (EWGSOP2) criteria that designates muscle strength as the primary parameter [1]. The choice of one of those diverse criteria and methods is generally arbitrary, and this might lead to inconsistent results in studies on sarcopenia [1,16]. As the measurement of muscle strength has become crucial for geriatric practices, reproducibility and comparability of muscle strength measurements need to be investigated.

Grip strength (GS) measurement is widely used in numerous areas such as sports, rehabilitation, and geriatrics in population-based studies, research topics, and clinical practice to assess muscle strength [3,4,11] as it is an easy and reproducible method [17,18]. Grip strength measurements by dynamometry have been reported to be reliable regarding test-retest reliability, valid, and responsive [18,19,20]. Several thresholds specific to genders, geographic regions, and/or ethnicity for normative values of GS have been defined [1,21,22,23], but there are various dynamometer alternatives for quantitative GS measurements available, and there are no device-specific thresholds. Additionally, it might be interpreted that there is no globally accepted dynamometer type or protocol for GS measurements in practice [1,24,25,26], particularly for older individuals. In addition, given the diversity of dynamometers and procedures, there exists a potential for measurement errors [27]. Grip strength measurement tools and protocols are not only variable, but they are also inadequately reported in studies [25].

Hand dynamometers for GS might be examined in four categories; hydraulic, pneumatic, mechanical (spring-type), and strain dynamometers [27,28]. The two most frequently used dynamometers are the Jamar hydraulic (referred to as Jamar hereinafter) and Smedley (spring-type) hand grip dynamometers [26]. The hydraulic Jamar dynamometer has an adjustable anatomical, and rigid handle, and an analog screen. It has high re-test reliability and precision for GS measurements [28], and it is the most cited dynamometer in the literature [27]. Though it is considered the gold standard by the American Society of Hand Therapists for measuring GS [29,30], and a validated dynamometer, some authors assume that Jamar is not up to date because of the higher weight, calibration requirement, leaking issue, and as it is not precise at lower measurements [27,30]. Additionally, for older patients with joint problems or muscle weakness, measurements with Jamar might not be accurate or easy to perform [31,32,33,34]. So, in such conditions, a pneumatic dynamometer is reported to be an option [31,32,33]. Various updated instruments have been reported to demonstrate good-to-excellent inter-instrument reliability with Jamar [30]. However, those devices are not widely used, and not available in our clinic. Furthermore, the use of the Jamar dynamometer is also limited in our region. On the other hand, it is suggested not to compare earlier data of GS by Jamar with the latest data, as GS might be higher in recent models of Jamar, and prior models might measure GS with a greater error rate [33,35]. As an alternative to Jamar, the Jamar PLUS+ Digital (referred to as Jamar+ hereinafter) has a digital display using the electronic measurement principle [30]. It is lighter than Jamar with minor differences [30]. Takei T.K.K. 5401, a spring-type dynamometer also with a digital screen presents measurements to the nearest 0.1 kg that enables operator interpretation limited, unlike Jamar. But Takei is similar to Jamar in terms of weight, and adjustable handles. Spring-type dynamometers are widely used in Asian countries [28]. Most importantly, this device is widely used in the majority of healthcare settings in our region for practice and research purposes. We could define one study comparing the measurements of the Jamar+ and Jamar dynamometer that is performed among younger adults with a lack of inter-instrument reliability [36]. To the best of our knowledge, the Jamar dynamometer has not been studied in comparison to the Jamar+ dynamometer in older adults. However, the studies investigating Jamar and other hydraulic dynamometers in comparison with Smedley dynamometers among older individuals and young to middle-aged adults have shown conflicting results [17,26,28,37,38,39,40].

So, though many comparisons with several brands, and models (digital-analog) or hydraulic and spring-type dynamometers have been carried out, comparison of GS measurements and outcomes of different dynamometers is problematic and the agreement between different hand-held dynamometers needs to be further investigated. As present variations in the features of dynamometers might affect the validity and reliability of GS measurements [26], we aimed to examine GS measurements by Jamar+ and Takei 5401 digital dynamometers with reference to the Jamar dynamometer in older outpatients in this study.

2. Methods

This is a cross-sectional study carried out at the Geriatrics and Internal Medicine Outpatient Clinics of Ege University Medical Faculty between May and October 2019. The participants were recruited consecutively, and the patients aged 60 years and over who gave informed consent were included in the study. Socio-demographic data, present comorbidities, anthropometric measurements, and assessments of nutritional, functional, and cognitive status by Mini Nutritional Assessment Short Form (MNA-SF) [41,42], Katz Activities of Daily Living (ADLs) [43,44], and Mini-Mental State Examination (MMSE) [45,46] were evaluated. Muscle strength was assessed by hand grip dynamometers as GS measurement. Patients who did not give informed consent, aged <60 years, with sensory deficits, finger/hand amputations, and active arthritis as well as hemiplegic/quadriplegic patients, and those with a recent (last three months) operation in upper extremities, and an acute infection/symptoms were excluded from the study. Participants with MMSE score < 24, poor nutritional status (MNA-SF score < 12), and functional dysfunction (Katz score < 5) were also excluded.

2.1. Measures

2.1.1. Grip Strength Measurements

The GS was measured by the three hand dynamometers; the Jamar dynamometer (Performance Health Supply, Cedarburg, WI, USA), the Jamar+ dynamometer (Performance Health Supply, Cedarburg, WI, USA), and Takei T.K.K. 5401 digital dynamometer (Takei Scientific Instruments Co. Ltd., Tokyo, Japan). Both Jamar and Jamar+ dynamometers were provided through the funding of Ege University Higher Education Institutions Scientific Research & Development Project. Takei digital dynamometer was already in use in our department. Calibration of the Jamar dynamometer was performed according to the protocols set by the manufacturer. Before GS measurements, the researchers adjusted the grip size of each dynamometer according to the manufacturers’ instructions if needed. All of the measurements were performed in a silent room and around a.m. from 09.30 h to 12.30 by two trained researchers (A.K. and F.Ö.K.K.). Before starting the procedures, the participants were given verbal guidance to squeeze the dynamometers to ensure a maximum value. Then the participants squeezed the dynamometer, as hard as possible, for three seconds duration [47]. A total of nine GS measurements were performed for each patient by the dominant hand, three measurements per dynamometer with 60 s pause intervals between the trials. The participants rested for two minutes between measurements with different dynamometers. Measurements of GS were performed in an alternating sequence, in the first patient starting with the Jamar+ dynamometer, then Takei digital dynamometer, and lastly Jamar dynamometer; in the consecutive patients starting with the second dynamometer (i.e., Takei dynamometer), and then the next dynamometers in each consecutive patient. The maximum value of three GS measurements was selected for further analysis for each dynamometer. We applied the Southampton protocol for both Jamar+ and Jamar dynamometers. Participants sat in a chair holding the dynamometer with the dominant hand as the forearms rested on the arms of the chair, wrist over the end of the arm in a neutral position [27]. Dynamometers were supported at the bottom by the researchers. The procedure recommended by the National Health and Nutrition Examination Survey (NHANES) was applied to the Takei dynamometer [48]. Participants stood upright with their feet standing hip width, the shoulder neutrally positioned, each arm at the side, and the elbow extended [48].

2.1.2. Anthropometric Measurements

The hand circumference (HC) (cm) was evaluated as the perimeter of the middle section of the hand at the two major transverse palmar creases. Hand length (HL) (cm) was measured by the tip of the middle finger to the midline of the distal wrist crease [49].

2.1.3. Other Measures

The MMSE is a cognitive screening test with a threshold set at 24 defining ‘normal’ cognitive function [45]. The MNA-SF consists of six questions, and defines “normal nutritional status”, “at risk of malnutrition”, and “malnutrition” [41]. The performance of patients on ADLs is considered fully independent or fully dependent according to six functions [43].

2.2. Statistical Analysis

Normality was assessed by Shapiro-Wilk’s test, skewness, and kurtosis. The quantitative variables with a distribution consistent with the normal distribution were presented as the mean and standard deviation (SD) values. For those that differ significantly from the normal distribution, the median and interquartile range values of the data were given. Categorical variables were given as frequencies and percentages. Possible differences in general characteristics of male and female participants were tested with a t-test or Mann Whitney-U, and χ²-test whereas correlations for the GS measurements performed by different dynamometers and hand anthropometrics were analyzed by Pearson’s or Spearman correlation analysis (correlation coefficients deemed if >0.80 very strong, 0.60 to 0.79 strong, 0.40 to 0.59 moderate, 0.20 to 0.39 weak, lower than 0.19 very weak) where available [50].

To compare GS measurements by the three dynamometers, repeated measures of ANOVA and Bonferroni correction were performed. Inter-instrumental reliability of the Jamar dynamometer with the Takei and Jamar+ dynamometers was determined through intraclass correlation coefficient (ICC) analyses. ICC was performed based on a two-way random-effects model. ICC values are usually evaluated as poor, moderate, good, and excellent reliability, if <0.50, 0.50–0.75, 0.75–0.90, and >0.90, respectively. The differences between the measurements of dynamometers were evaluated by systematic bias expressed as the mean differences between the tools through Bland–Altman plots and measurement error. The normal distribution of the differences was verified. The 95% limits of agreement were defined as 1.96 standard deviations of the differences [28,51]. Standard error of measurement (SEM) and minimal detectable change (MDC) were computed using the formulations: “SEM = SD × √(1 − ICC); MDC = 1.96 × √2 × SEM [SEM% = (SEM/mean) × 100%”, and “MDC% = (MDC/mean) × 100%” (mean: average GS of dynamometers; SD: standard deviation of the differences)] [28,52,53]. Values lower than 10% or 15% for SEM% [28,54], and <30% for MDC% are suggested to show acceptable reliability [28].

There are approximately 8,000,000 individuals over the age of 65 in Turkey. To calculate the sample size, a power analysis based on ICC analysis was performed [55]. When the concordance between the 3 methods is 0.80 and above, the lowest limit of acceptability is 0.70, and at least 101 patients must be recruited to reject the H0 hypothesis at 80% power and 0.05 alpha level. However, it is a fact that there may be losses in measurement. For this reason, when the dropout rate is 10%, a minimum of 113 people should be taken. All analyses were conducted using SPSS (Statistical Package for Social Sciences) (version 25.0; SPSS, Inc, IBM Corp, Armonk, New York, NY, USA). p values < 0.05 were reported as statistically significant.

3. Results

Participants and Clinical Characteristics

Patients aged <60 years (n = 102), with missing data (n = 38), finger/hand amputations (n = 2), active arthritis (n = 12), sensory deficits (n = 47), acute infection/symptoms (n = 92), and those who did not give informed consent (n = 37) were excluded from the study. After the application of the tests; participants with MMSE scores <24 (n = 57), poor nutritional status (n = 31), and functional dysfunction were also excluded (n = 26) (all, n = 444). Finally, 110 older subjects aged 60–90 years (mean 69.4 ± 6.3 years) were recruited (56.4% females). Of all, 97.3% of the study group was right-handed. The characteristics of the patients are shown in Table 1. The mean GS value of each dynamometer was significantly higher in males than in females (all p < 0.01). The average GS by Jamar dynamometer was lower than both Jamar+ and Takei dynamometers in the whole group (p = 0.004). The mean GS measurements by the Jamar dynamometer were lower than only measurements with the Takei dynamometer for women (p = 0.002) whereas mean values for both Jamar, and Takei dynamometers were lower than the Jamar+ dynamometer for men (p = 0.022) (Table 1). The mean scores of ADLs, MNA-SF, and MMSE were; 5.9 ± 0.07, 13.1 ± 0.44, and 28.5 ± 1.28, respectively.

The results of the correlational analyses between mean GS measurements by the Jamar and both Takei, and Jamar+ dynamometers are presented in Table S1a in the Online Supplement File S1: Additional Tables. Correlations between hand grip measurements of the three dynamometers and measures of the hand are presented in Table S1b in the Online Supplement File S1: Additional Tables. The overall ICC value for Jamar and Jamar+ dynamometers was deemed excellent in the total group, and good both for females and males (all p < 0.001) indicating a good-to-excellent inter-instrument consistency between the devices. The ICC values between the Jamar and Takei dynamometers were good in the whole group of participants, and for both genders (all p < 0.001). The ICC results are shown in Table 2.

In our study, all the SEM values were lower than 10%, and all MDC values were lower than <30%. Those values reflect acceptable reliability between the dynamometers. The SEM% was between 3.60% and 6.33%, and values for MDC% were from 9.99 to 17.55%. The highest, but still acceptable values were for females between the Jamar hydraulic versus Jamar+ and Takei dynamometers, in descending order (Table 2). A Bland-Altman analysis was run for the agreements of the GS measurements by the Jamar hydraulic versus Takei and Jamar+ dynamometers where variability did not increase with the mean values. Bland–Altman plots showing the differences in Jamar dynamometer measurements with Takei and Jamar+ measurements against their means are presented in Figures S1–S3 in the Online Supplement File S2: Bland–Altman Plots. There were negative mean differences regarding the total group, females and males. Mean values were close to zero, and the distribution was deemed uniform. In the total group according to the Bland-Altman plot, the Takei dynamometer overestimated GS measurements by 0.85 kg (bias: −0.85, 95% CI −1.47 to −2.22) whereas the difference was 0.98 (bias: −0.98, 95% confidence interval (CI) −1.62 to −0.34) kg for Jamar+ dynamometer over Jamar dynamometer (Figure S1a,b). Takei dynamometer and Jamar+ dynamometer measurements overestimated GS over Jamar dynamometer by 1.42 kg (bias: −1.42, 95% CI −2.16 to −0.68) and 0.76 kg (bias: 0.76, 95% CI −1.6 to 0.08) in women (Figure S2a,b), and 0.11 kg (bias: −0.11, 95% CI −1.18 to 2.97) and 1.27 kg (bias: −1.27, 95% CI −2.28 to −0.25) in men, respectively (Figure S3a,b). Linear regression analyses were also performed for the data in the whole group, female and male participants regarding the Jamar hydraulic versus Takei dynamometer and Jamar+ dynamometers reflecting no proportional bias (p = 0.079, p = 0.301, p = 0.945 and p = 0.458, p = 0.790, p = 0.887, respectively).

Low GS prevalences according to the EWGSOP2 thresholds [1] by the Jamar, Jamar+, and Takei dynamometers were 6.4%, 3.6%, 4.5 in all participants, 4.8%, 0%, 0% in women, 8.3%, 8.3%, 10.4% in men, respectively.

4. Discussion

Though hand GS is a widely used measurement method for muscle strength evaluation, there are multiple dynamometer types, models, brands, and protocols available. So, measurement errors or differences are likely, not limited to dynamometer-dependent factors, and the interchangeability of dynamometers is questionable. Thus, we evaluated GS measurements by the Jamar hydraulic dynamometer as a reference standard against spring-type Takei and Jamar+ dynamometers in older outpatients in this study. To the best of our knowledge, this is the first study comparing the GS measurements with Jamar and Jamar+ in older adults. Overall, in all participants, GS measured by the Jamar was lowest, values by Jamar+ in males were highest whereas the values significantly varied among females by Takei and Jamar, lower in the letter. The ICCs between the dynamometers were good to excellent indicating inter-instrumental good relative reliability. Both SEM% and MDC% values reflected acceptable reliability between the dynamometers. Takei and Jamar+ dynamometers overestimated GS over the Jamar dynamometer in females, males, and the total group, with no proportional bias noted. Low GS prevalence varied significantly by the use of different dynamometers. Hand size did not seem to have a substantial impact on GS measurements, particularly in men, but there was a variable gender effect.

In the only study we could find in the literature, addressing the validity and reliability of Jamar+ compared to Jamar, inter-instrument reliability between the tools was poor-to-moderate, with Jamar hydraulic overestimating 10% higher than Jamar+ in a small sample of 40 adults [36]. In a recent short communication utilizing the unpublished data of a mixed-aged population (aged 45–74 years), the authors reported that low GS highly varied with hydraulic, spring-gauge or electronic devices [56]. On the contrary, in our study on outpatients aged 60 years and over, we showed relative reliability, and absolute reliability between Jamar+ and Jamar whereas Jamar+ overestimated GS by clinically neglectable measurement results. In the review by Lee and Gong, the authors reported that GS measurements tend to be higher in new models of Jamar and its variants [33] because of the friction of the handles. Both Jamar dynamometers were provided for the project in our study, so, investigating and reproducing those data are essential. We could find only a few studies investigating Jamar dynamometers in comparison with spring-type dynamometers among older adults with conflicting results [26,28,37,38]. In the only study by Benton et al. on the Takei dynamometer, the authors reported excellent reliability, but poor agreement and lack of validity between the Jamar and the Smedley spring (Takei) hand grip dynamometers in 67 community-dwelling older adults. Grip strength measured with the Jamar was greater than the Smedley dynamometer while differences between dynamometers were considerably lower in women and old-old subjects (>75 years). The authors concluded that standardization and thresholds specific to dynamometers are needed [26]. This study was the only study based on the Takei dynamometer like in our study. However, the item number of the dynamometer was not provided. Likewise, in a small sample of older residents (n = 55) of a retirement home and social day care center, Guerra and Amaral 2009 evaluated the reliability of Jamar, Smedlay (specified as Smedlay in the article), Eisenhut, and Sammons Preston Rolyan Bulb, reporting significant differences between the dynamometers, though results of Smedlay were close to Jamar [37]. Moreover, in 467 community-dwelling older adults aged 69 to 89 years, Kim et al. indicated that they compared Jamar and spring-type Smedley (YD-100) dynamometers, and they found statistically significant differences, though there was an excellent correlation between the two dynamometers. When using the Smedley dynamometer, weakness prevalence was higher [38]. On the contrary to those studies; in a recent study by Huang et al., the authors compared the Jamar dynamometer to another spring-type dynamometer; the CAMRY EH101 dynamometer in 1064 healthy community-dwelling adults aged over 50 years, and reported that CAMRY EH101 was valid and reliable for Jamar dynamometer (systematic bias underestimated by CAMRY was 0.5 kg, and 0.6 kg in males, and females) [28]. In our study, the Takei dynamometer was valid and reliable for the Jamar dynamometer, but the Takei dynamometer overestimated GS over the Jamar dynamometer. Grip strength measurements by Takei were significantly higher than the Jamar dynamometer in women in the present study. Likewise, Guerra et al. showed that there was a variable gender effect on the differences between the dynamometers, depending on the dynamometer used [37]. Overall, in all participants, GS measured by the Jamar was lowest than both of the dynamometers in our study, contrary to most of the articles published reporting otherwise in older, mixed, and young to middle-aged populations [17,37,49]. Recently, Abe et al. showed that young to middle-aged adults with relatively higher GS values provided higher measurements by hydraulic (Baseline) than the Smedley (Takei 5401) dynamometer whereas this difference did not exist at lower GS measurements or depending on hand size [39]. Accordingly, correlations between hand GS measurements and HC or HL were weak to moderate, varying according to gender in our study. Consistent with our results, the digital dynamometer (Takei 5401) measured higher values than the hydraulic (Baseline) dynamometer with a satisfactory agreement in the study by Yu et al. among young and middle-aged adults [40]. They also reported that GS values differed with the same dynamometer, but different protocols. Though the Jamar hydraulic is generally taken as a reference standard against other devices, it is reported that there might be a potential for significant reader error for the Jamar hydraulic as the dial shows 2 kg increments [27,30]. On the other hand, Hogrel reported that during the measurement process, at the inertial movement of the needle of the Jamar dynamometer, it jumps slightly higher than the actual value which might tend to overestimate the GS value [30,49].

On the other hand, though, intra-instrument reliability and validity of diverse digital (Takei 5401), and analog (Takei 5001) models of Takei dynamometers were high in the study by Cadenas-Sanchez et al., the investigators suggested that GS should be measured with the same instrument and model for serial assessments for the same individual as inter-instrument reliability might add a certain amount of error [57]. Herein, low GS prevalence varied from zero to 10.4% according to EWGSOP2 thresholds depending on gender, and the dynamometer type used, in our study. Those prevalences might vary by the use of local thresholds, as well.

As we investigated the inter-instrumental reliability, but not the test-retest reliability, this is a limitation of the study and necessitates further investigation. Inter-rater reliability is not available in the present study. We did not entirely discuss the Jamar+ dynamometer and Takei dynamometer, as the aim of the study was to compare those instruments against the reference standard Jamar. Nevertheless, there is no other study than the present research in the literature comparing Jamar+ against a digital spring-type dynamometer in older adults.

5. Conclusions

The reproducibility and comparability of GS measurements by different brands, types, and models of dynamometers is a critical issue for older individuals as present few studies vary in terms of sample sizes, settings, protocols, and the characteristics of the participants. The measurements with Jamar+, and Takei dynamometers were reliable and valid regarding the Jamar dynamometer in the present study. Though the differences in the measured values might be disregarded in clinical practice, GS better be measured by the same dynamometer in serial measurements of individuals, considering the impact of gender, as well. Individuals defined to have low GS, sarcopenia, or frailty have the potential to vary by the use of different dynamometers which may affect related intervention and rehabilitation. Further studies comparing GS measurements in geriatric individuals are essential taking into consideration variable characteristics of the instruments, gender, frailty, and comorbidities as well as the protocols in order to standardize the GS measurements and to create consensus on the methodology, even instrument-specific thresholds.

Author Contributions

Conceptualization, S.S.; Data curation, S.S. and S.C.; Formal analysis, S.S.; Funding acquisition, S.S.; Investigation, S.S., A.K., F.Ö.K.K. and S.C.; Methodology, S.S., A.K., F.Ö.K.K. and S.C.; Project administration, S.S.; Resources, S.S.; Software, F.Ö.K.K. and S.C.; Supervision, S.S.; Validation, S.S., F.Ö.K.K. and S.C.; Visualization, A.K.; Writing—original draft, S.S., A.K., F.Ö.K.K. and S.C.; Writing—review & editing, S.S., A.K., F.Ö.K.K. and S.C. All authors have read and agreed to the published version of the manuscript.

Institutional Review Board Statement

The present study was approved by the Medical Research Ethics Committee of Ege University, Faculty of Medicine (Approval date and number: 7 February 2019/E41277), and all recruited patients provided written informed consent.

Informed Consent Statement

Informed consent was obtained from all subjects involved in the study, and written informed consent has been obtained from the patient(s) to publish this paper.

Data Availability Statement

The data presented in this study are available on request from the corresponding author. The data are not publicly available due to ethical statements.

Conflicts of Interest

All authors declare no conflict of interest.

Footnotes

Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Tables

Table 1

The Characteristics of the participants.

Variables		All (n = 110)	Females (n = 62)	Males (n = 48)
Age, years		69.4 ± 6.3	68.0 ± 5.8 *	71.2 ± 6.5 *
Gender, n (%)	Females	62 (56.4)	62 (100)	-
	Males	48 (43.6)	-	48 (100)
Higher education, n (%)	Yes	31 (28.2)	16 (25.8)	15 (31.3)
Living alone, n (%)	Yes	12 (10.9)	10 (16.1)	2 (4.2)
Comorbid conditions, n (%)	Diabetes Mellitus	37 (33.6)	21 (33.9)	16 (33.3)
	Hypertension	60 (54.5)	32 (51.6)	28 (58.3)
	Coronary artery disease	22 (20)	9 (14.5)	13 (27)
	Other diseases	75 (68.2)	43 (69.3)	32 (66.7)
Measures of the hand (cm)	Circumference	21.2 ± 1.8	20.3 ± 1.1 **	22.4 ± 1.8 **
	Length	18.4 ± 1.1	17.9 ± 1 **	18.9 ± 1.1 **
Grip strength (kg)	Jamar dynamometer 1	28.5 ± 7.7 †	23.9 ± 5.0 ** ‡	34.3 ± 6.5 ** §
	Takei dynamometer 2	29.3 ± 7.1 †	25.4 ± 4.6 ** ‡	34.4 ± 6.6 ** §
	Jamar+ dynamometer 3	29.5 ± 7.9 †	24.7 ± 5.1 **	35.6 ± 6.6 ** §

Numerical variables are expressed as mean (SD). Other diseases: Malignancy, chronic pulmonary-liver disease, thyroid disease. Jamar+; The Jamar PLUS+ Digital dynamometer. * Significance at p < 0.01 level between genders. ** Significance at p < 0.001 level between genders. ^† Significance at p < 0.01 level between the three dynamometers in the whole group (1 < 2,3). ^‡ Significance at p < 0.01 level between the three dynamometers among females (1 < 2). ^§ Significance at p < 0.05 level between the three dynamometers among males (1,2 < 3). ₁: The measurements with the Jamar dynamometer, ₂: The measurements with the Takei dynamometer, ₃: The measurements with the Jamar+ dynamometer.

Table 2

Intraclass correlation coefficient analyses, standard error of measurement, and minimal detectable change values for grip strength measured by the three dynamometers.

	ICC 1,2 (95% CI)	ICC 1,3 (95% CI)	SEM (%)	MDC (%)
All (n = 110)	0.899 [0.856–0.930] *	0.905 [0.865–0.934] *	3.66 1,23.60 1,3	10.14 1,29.99 1,3
Females (n = 62)	0.819 [0.716–0.887] *	0.784 [0.666–0.864] *	5.01 1,26.33 1,3	13.89 1,217.55 1,3
Males(n = 48)	0.839 [0.730–0.907] *	0.858 [0.760–0.918] *	4.33 1,23.76 1,3	12.00 1,210.43 1,3

ICC; intraclass correlation coefficient, SEM; standard error of measurement, MDC; minimal detectable change. ¹ Jamar dynamometer, ² Takei dynamometer, ³ Jamar+ dynamometer. * Significance at p < 0.001 level.

Supplementary Materials

The supporting information can be downloaded at: https://www.mdpi.com/article/10.3390/jcm12134260/s1, File S1: Additional Tables, and File S2: Bland-Altman Plots.

References

1. Cruz-Jentoft, A.J.; Bahat, G.; Bauer, J.; Boirie, Y.; Bruyère, O.; Cederholm, T.; Cooper, C.; Landi, F.; Rolland, Y.; Sayer, A.A. et al. Sarcopenia: Revised European consensus on definition and diagnosis. Age Ageing; 2019; 48, pp. 16-31. [DOI: https://dx.doi.org/10.1093/ageing/afy169]

2. Fried, L.P.; Tangen, C.M.; Walston, J.; Newman, A.B.; Hirsch, C.; Gottdiener, J.; Seeman, T.; Tracy, R.; Kop, W.J.; Burke, G. et al. Frailty in Older adults: Evidence for a phenotype. J. Gerontol. Ser. A Biol. Sci. Med. Sci.; 2001; 56, pp. M146-M156. [DOI: https://dx.doi.org/10.1093/gerona/56.3.M146]

3. Yeung, S.S.; Reijnierse, E.M.; Trappenburg, M.C.; Hogrel, J.-Y.; McPhee, J.S.; Piasecki, M.; Sipila, S.; Salpakoski, A.; Butler-Browne, G.; Pääsuke, M. et al. Handgrip Strength Cannot Be Assumed a Proxy for Overall Muscle Strength. J. Am. Med. Dir. Assoc.; 2018; 19, pp. 703-709. [DOI: https://dx.doi.org/10.1016/j.jamda.2018.04.019] [PubMed: https://www.ncbi.nlm.nih.gov/pubmed/29935982]

4. Rijk, J.M.; Roos, P.R.; Deckx, L.; Akker, M.V.D.; Buntinx, F. Prognostic value of handgrip strength in people aged 60 years and older: A systematic review and meta-analysis. Geriatr. Gerontol. Int.; 2015; 16, pp. 5-20. [DOI: https://dx.doi.org/10.1111/ggi.12508] [PubMed: https://www.ncbi.nlm.nih.gov/pubmed/26016893]

5. Jakubiak, G.K.; Pawlas, N.; Cieślar, G.; Stanek, A. Chronic Lower Extremity Ischemia and Its Association with the Frailty Syndrome in Patients with Diabetes. Int. J. Environ. Res. Public Health; 2020; 17, 9339. [DOI: https://dx.doi.org/10.3390/ijerph17249339] [PubMed: https://www.ncbi.nlm.nih.gov/pubmed/33327401]

6. Kato, Y.; Shimizu, A.; Momosaki, R. Assessment and Management of Frailty. J. Clin. Med.; 2023; 12, 833. [DOI: https://dx.doi.org/10.3390/jcm12030833]

7. Gordon, A.L.; Witham, M.D.; Henderson, E.J.; Harwood, R.H.; Masud, T. Research into ageing and frailty. Futur. Health J.; 2021; 8, pp. e237-e242. [DOI: https://dx.doi.org/10.7861/fhj.2021-0088] [PubMed: https://www.ncbi.nlm.nih.gov/pubmed/34286191]

8. Achterberg, W.P.; Cameron, I.D.; Bauer, J.M.; Schols, J.M. Geriatric Rehabilitation—State of the Art and Future Priorities. J. Am. Med. Dir. Assoc.; 2019; 20, pp. 396-398. [DOI: https://dx.doi.org/10.1016/j.jamda.2019.02.014]

9. Cruz-Jentoft, A.J.; Sayer, A.A. Sarcopenia. Lancet; 2019; 393, pp. 2636-2646. [DOI: https://dx.doi.org/10.1016/S0140-6736(19)31138-9]

10. Epidemiologic and methodologic problems in determining nutritional status of older persons. Proceedings of a conference. Albuquerque, New Mexico, October 19–21, 1988. Am. J. Clin. Nutr.; 1989; 50, (Suppl. 5), pp. 1121-1235.

11. Cruz-Jentoft, A.J.; Baeyens, J.P.; Bauer, J.M.; Boirie, Y.; Cederholm, T.; Landi, F.; Martin, F.C.; Michel, J.-P.; Rolland, Y.; Schneider, S.M. et al. Sarcopenia: European consensus on definition and diagnosis: Report of the European Working Group on Sarcopenia in Older People. Age Ageing; 2010; 39, pp. 412-423. [DOI: https://dx.doi.org/10.1093/ageing/afq034] [PubMed: https://www.ncbi.nlm.nih.gov/pubmed/20392703]

12. Morley, J.E.; Abbatecola, A.M.; Argiles, J.M.; Baracos, V.; Bauer, J.; Bhasin, S.; Cederholm, T.; Coats, A.J.S.; Cummings, S.R.; Evans, W.J. et al. Sarcopenia With Limited Mobility: An International Consensus. J. Am. Med. Dir. Assoc.; 2011; 12, pp. 403-409. [DOI: https://dx.doi.org/10.1016/j.jamda.2011.04.014] [PubMed: https://www.ncbi.nlm.nih.gov/pubmed/21640657]

13. Fielding, R.A.; Vellas, B.; Evans, W.J.; Bhasin, S.; Morley, J.E.; Newman, A.B.; van Kan, G.A.; Andrieu, S.; Bauer, J.; Breuille, D. et al. Sarcopenia: An Undiagnosed Condition in Older Adults. Current Consensus Definition: Prevalence, Etiology, and Consequences. International Working Group on Sarcopenia. J. Am. Med. Dir. Assoc.; 2011; 12, pp. 249-256. [DOI: https://dx.doi.org/10.1016/j.jamda.2011.01.003] [PubMed: https://www.ncbi.nlm.nih.gov/pubmed/21527165]

14. Studenski, S.A.; Peters, K.W.; Alley, D.E.; Cawthon, P.M.; McLean, R.R.; Harris, T.B.; Ferrucci, L.; Guralnik, J.M.; Fragala, M.S.; Kenny, A.M. et al. The FNIH Sarcopenia Project: Rationale, Study Description, Conference Recommendations, and Final Estimates. J. Gerontol. A Biol. Sci. Med. Sci.; 2014; 69, pp. 547-558. [DOI: https://dx.doi.org/10.1093/gerona/glu010]

15. Chen, L.-K.; Liu, L.-K.; Woo, J.; Assantachai, P.; Auyeung, T.-W.; Bahyah, K.S.; Chou, M.-Y.; Chen, L.-Y.; Hsu, P.-S.; Krairit, O. et al. Sarcopenia in Asia: Consensus Report of the Asian Working Group for Sarcopenia. J. Am. Med. Dir. Assoc.; 2014; 15, pp. 95-101. [DOI: https://dx.doi.org/10.1016/j.jamda.2013.11.025]

16. Savas, S.; Taşkıran, E.; Sarac, F.Z.; Akcicek, F. A cross-sectional study on sarcopenia using EWGSOP1 and EWGSOP2 criteria with regional thresholds and different adjustments in a specific geriatric outpatient clinic. Eur. Geriatr. Med.; 2019; 11, pp. 239-246. [DOI: https://dx.doi.org/10.1007/s41999-019-00256-3]

17. Amaral, J.F.; Mancini, M.; Júnior, J.M.N. Comparison of three hand dynamometers in relation to the accuracy and precision of the measurements. Braz. J. Phys. Ther.; 2012; 16, pp. 216-224. [DOI: https://dx.doi.org/10.1590/S1413-35552012000300007]

18. Wang, Y.-C.; Bohannon, R.W.; Li, X.; Yen, S.-C.; Sindhu, B.; Kapellusch, J. Summary of grip strength measurements obtained in the 2011–2012 and 2013–2014 National Health and Nutrition Examination Surveys. J. Hand Ther.; 2018; 32, pp. 489-496. [DOI: https://dx.doi.org/10.1016/j.jht.2018.03.002]

19. Bohannon, R.W. Hand-Grip Dynamometry Predicts Future Outcomes in Aging Adults. J. Geriatr. Phys. Ther.; 2008; 31, pp. 3-10. [DOI: https://dx.doi.org/10.1519/00139143-200831010-00002]

20. Bohannon, R.W.; Wang, Y.-C.; Yen, S.-C.; Grogan, K.A. Handgrip Strength: A Comparison of Values Obtained From the NHANES and NIH Toolbox Studies. Am. J. Occup. Ther.; 2019; 73, pp. 7302205080p1-7302205080p9. [DOI: https://dx.doi.org/10.5014/ajot.2019.029538]

21. Dodds, R.M.; Syddall, H.E.; Cooper, R.; Benzeval, M.; Deary, I.J.; Dennison, E.M.; Der, G.; Gale, C.R.; Inskip, H.M.; Jagger, C. et al. Grip Strength across the Life Course: Normative Data from Twelve British Studies. PLoS ONE; 2014; 9, e113637. [DOI: https://dx.doi.org/10.1371/journal.pone.0113637] [PubMed: https://www.ncbi.nlm.nih.gov/pubmed/25474696]

22. Bahat, G.; Aydin, C.O.; Tufan, A.; Karan, M.A.; Cruz-Jentoft, A.J. Muscle strength cutoff values calculated from the young reference population to evaluate sarcopenia in Turkish population. Aging Clin. Exp. Res.; 2021; 33, pp. 2879-2882. [DOI: https://dx.doi.org/10.1007/s40520-021-01785-3] [PubMed: https://www.ncbi.nlm.nih.gov/pubmed/33501623]

23. Bulut, E.A.; Soysal, P.; Dokuzlar, O.; Kocyigit, S.E.; Aydin, A.E.; Yavuz, I.; Isik, A.T. Validation of population-based cutoffs for low muscle mass and strength in a population of Turkish elderly adults. Aging Clin. Exp. Res.; 2020; 32, pp. 1749-1755. [DOI: https://dx.doi.org/10.1007/s40520-019-01448-4] [PubMed: https://www.ncbi.nlm.nih.gov/pubmed/31898170]

24. Chen, L.-K.; Woo, J.; Assantachai, P.; Auyeung, T.-W.; Chou, M.-Y.; Iijima, K.; Jang, H.C.; Kang, L.; Kim, M.; Kim, S. et al. Asian Working Group for Sarcopenia: 2019 Consensus Update on Sarcopenia Diagnosis and Treatment. J. Am. Med. Dir. Assoc.; 2020; 21, pp. 300-307.e2. [DOI: https://dx.doi.org/10.1016/j.jamda.2019.12.012]

25. Sousa-Santos, A.R.; Amaral, T.F. Differences in handgrip strength protocols to identify sarcopenia and frailty-a systematic review. BMC Geriatr.; 2017; 17, 238. [DOI: https://dx.doi.org/10.1186/s12877-017-0625-y]

26. Benton, M.J.; Spicher, J.M.; Silva-Smith, A.L. Validity and reliability of handgrip dynamometry in older adults: A comparison of two widely used dynamometers. PLoS ONE; 2022; 17, e0270132. [DOI: https://dx.doi.org/10.1371/journal.pone.0270132]

27. Roberts, H.C.; Denison, H.J.; Martin, H.J.; Patel, H.P.; Syddall, H.; Cooper, C.; Sayer, A.A. A review of the measurement of grip strength in clinical and epidemiological studies: Towards a standardised approach. Age Ageing; 2011; 40, pp. 423-429. [DOI: https://dx.doi.org/10.1093/ageing/afr051]

28. Huang, L.; Liu, Y.; Lin, T.; Hou, L.; Song, Q.; Ge, N.; Yue, J. Reliability and validity of two hand dynamometers when used by community-dwelling adults aged over 50 years. BMC Geriatr.; 2022; 22, 580. [DOI: https://dx.doi.org/10.1186/s12877-022-03270-6]

29. MacDermid, J.; Solomon, G.; Fedorczyk, J.; Valdes, K. American Society of Hand Therapists. Clinical Assessment Recommendations: Impairment-Based Conditions; 3rd ed. American Society of Hand Therapists: Mount Laurel, NJ, USA, 2015.

30. Mutalib, S.A.; Mace, M.; Seager, C.; Burdet, E.; Mathiowetz, V.; Goldsmith, N. Modernising grip dynamometry: Inter-instrument reliability between GripAble and Jamar. BMC Musculoskelet. Disord.; 2022; 23, 80. [DOI: https://dx.doi.org/10.1186/s12891-022-05026-0]

31. Sipers, W.M.; Verdijk, L.B.; Sipers, S.J.; Schols, J.M.; van Loon, L.J.C. The Martin Vigorimeter Represents a Reliable and More Practical Tool Than the Jamar Dynamometer to Assess Handgrip Strength in the Geriatric Patient. J. Am. Med. Dir. Assoc.; 2016; 17, pp. 466.e1-466.e7. [DOI: https://dx.doi.org/10.1016/j.jamda.2016.02.026]

32. De Dobbeleer, L.; Theou, O.; Beyer, I.; Jones, G.R.; Jakobi, J.M.; Bautmans, I. Martin Vigorimeter assesses muscle fatigability in older adults better than the Jamar Dynamometer. Exp. Gerontol.; 2018; 111, pp. 65-70. [DOI: https://dx.doi.org/10.1016/j.exger.2018.07.004] [PubMed: https://www.ncbi.nlm.nih.gov/pubmed/30004005]

33. Lee, S.H.; Gong, H.S. Measurement and Interpretation of Handgrip Strength for Research on Sarcopenia and Osteoporosis. J. Bone Metab.; 2020; 27, pp. 85-96. [DOI: https://dx.doi.org/10.11005/jbm.2020.27.2.85] [PubMed: https://www.ncbi.nlm.nih.gov/pubmed/32572369]

34. Neumann, S.; Kwisda, S.; Krettek, C.; Gaulke, R. Comparison of the Grip Strength Using the Martin-Vigorimeter and the JAMAR-Dynamometer: Establishment of Normal Values. In Vivo; 2018; 31, pp. 917-924. [DOI: https://dx.doi.org/10.21873/invivo.11147]

35. Richards, L.; Palmiter-Thomas, P. A Critical Review of Tools, Methods, and Clinical Utility for Grip Strength Measurement. Crit. Rev. Phys. Rehabilitation Med.; 2017; 29, pp. 315-340. [DOI: https://dx.doi.org/10.1615/CritRevPhysRehabilMed.v29.i1-4.90]

36. King, T.I. Interinstrument Reliability of the Jamar Electronic Dynamometer and Pinch Gauge Compared With the Jamar Hydraulic Dynamometer and B&L Engineering Mechanical Pinch Gauge. Am. J. Occup. Ther.; 2013; 67, pp. 480-483. [DOI: https://dx.doi.org/10.5014/ajot.2013.007351]

37. Guerra, R.S.; Amaral, T.F. Comparison of hand dynamometers in elderly people. J. Nutr. Health Aging; 2009; 13, pp. 907-912. [DOI: https://dx.doi.org/10.1007/s12603-009-0250-3] [PubMed: https://www.ncbi.nlm.nih.gov/pubmed/19924352]

38. Kim, M.; Shinkai, S. Prevalence of muscle weakness based on different diagnostic criteria in community-dwelling older adults: A comparison of grip strength dynamometers. Geriatr. Gerontol. Int.; 2017; 17, pp. 2089-2095. [DOI: https://dx.doi.org/10.1111/ggi.13027] [PubMed: https://www.ncbi.nlm.nih.gov/pubmed/28517036]

39. Abe, T.; Loenneke, J.P.; Thiebaud, R.S.; Loftin, M. The Bigger the Hand, the Bigger the Difference? Implications for Testing Strength With 2 Popular Handgrip Dynamometers. J. Sport Rehabil.; 2019; 28, pp. 278-282. [DOI: https://dx.doi.org/10.1123/jsr.2017-0189]

40. Yu, R.; Ong, S.; Cheung, O.; Leung, J.; Woo, J. Reference Values of Grip Strength, Prevalence of Low Grip Strength, and Factors Affecting Grip Strength Values in Chinese Adults. J. Am. Med. Dir. Assoc.; 2017; 18, pp. 551.e9-551.e16. [DOI: https://dx.doi.org/10.1016/j.jamda.2017.03.006]

41. Rubenstein, L.Z.; Harker, J.O.; Salvà, A.; Guigoz, Y.; Vellas, B. Screening for Undernutrition in Geriatric Practice: Developing the Short-Form Mini-Nutritional Assessment (MNA-SF). 2001; Available online: https://academic.oup.com/biomedgerontology/article/56/6/M366/526432 (accessed on 1 May 2023).

42. Sarikaya, D.; Halil, M.; Kuyumcu, M.E.; Kilic, M.K.; Yesil, Y.; Kara, O.; Öztürk, S.; Gungor, E.; Karabulut, E.; Yavuz, B.B.D. et al. Mini nutritional assessment test long and short form are valid screening tools in Turkish older adults. Arch. Gerontol. Geriatr.; 2015; 61, pp. 56-60. [DOI: https://dx.doi.org/10.1016/j.archger.2015.04.006]

43. Katz, S.; Ford, A.B.; Moskowitz, R.W.; Jackson, B.A.; Jaffe, M.W. Studies of Illness in the Aged. The index of Adl: A standardized measure of biological and phychological funcation. JAMA; 1963; 185, pp. 914-919. [DOI: https://dx.doi.org/10.1001/jama.1963.03060120024016] [PubMed: https://www.ncbi.nlm.nih.gov/pubmed/14044222]

44. Arik, G.; Varan, H.D.; Yavuz, B.B.D.; Karabulut, E.; Kara, O.; Kilic, M.K.; Kizilarslanoglu, M.C.; Sumer, F.; Kuyumcu, M.E.; Yesil, Y. et al. Validation of Katz index of independence in activities of daily living in Turkish older adults. Arch. Gerontol. Geriatr.; 2015; 61, pp. 344-350. [DOI: https://dx.doi.org/10.1016/j.archger.2015.08.019] [PubMed: https://www.ncbi.nlm.nih.gov/pubmed/26328478]

45. Folstein, M.F.; Folstein, S.E.; McHugh, P.R. “Mini-Mental State”. A Practical Method for Grading the Cognitive State of Patients for the Clinician. J. Psychiatr. Res.; 1975; 12, pp. 189-198. [DOI: https://dx.doi.org/10.1016/0022-3956(75)90026-6] [PubMed: https://www.ncbi.nlm.nih.gov/pubmed/1202204]

46. Güngen, C.; Ertan, T.; Eker, E.; Yaşar, R.; Engin, F. Reliability and validity of the standardized Mini Mental State Examination in the diagnosis of mild dementia in Turkish population. Turk Psikiyatri Derg.; 2002; 13, pp. 273-281.

47. Mehmet, H.; Yang, A.W.; Robinson, S.R. Measurement of hand grip strength in the elderly: A scoping review with recommendations. J. Bodyw. Mov. Ther.; 2020; 24, pp. 235-243. [DOI: https://dx.doi.org/10.1016/j.jbmt.2019.05.029]

48. Centers for Disease Control and Prevention (CDC). National Health and Nutrition Examination Survey (NHANES)—Muscle Strength Procedures Manual. 2011; Available online: https://www.cdc.gov/nchs/nhanes/default.aspx (accessed on 11 March 2018).

49. Hogrel, J.-Y. Grip strength measured by high precision dynamometry in healthy subjects from 5 to 80 years. BMC Musculoskelet. Disord.; 2015; 16, 139. [DOI: https://dx.doi.org/10.1186/s12891-015-0612-4]

50. Evans, J.D. Straightforward Statistics for the Behavioral Sciences; Thomson Brooks/Cole Publishing, Co.: Pacific Grove, CA, USA, 1996.

51. Bland, J.M.; Altman, D.G. Statistical methods for assessing agreement between two methods of clinical measurement. Lancet; 1986; 1, pp. 307-310. [DOI: https://dx.doi.org/10.1016/S0140-6736(86)90837-8]

52. Shrout, P.E.; Fleiss, J.L. Intraclass correlations: Uses in assessing rater reliability. Psychol. Bull.; 1979; 86, pp. 420-428. [DOI: https://dx.doi.org/10.1037/0033-2909.86.2.420]

53. Lexell, J.E.; Downham, D.Y. How to Assess the Reliability of Measurements in Rehabilitation. Am. J. Phys. Med. Rehabil.; 2005; 84, pp. 719-723. [DOI: https://dx.doi.org/10.1097/01.phm.0000176452.17771.20]

54. Buckinx, F.; Croisier, J.-L.; Reginster, J.-Y.; Dardenne, N.; Beaudart, C.; Slomian, J.; Leonard, S.; Bruyère, O. Reliability of muscle strength measures obtained with a hand-held dynamometer in an elderly population. Clin. Physiol. Funct. Imaging; 2015; 37, pp. 332-340. [DOI: https://dx.doi.org/10.1111/cpf.12300]

55. Arifin, W.N.; Yusof, U.K. Correcting for partial verification bias in diagnostic accuracy studies: A tutorial using R. Stat. Med.; 2022; 41, pp. 1709-1727. [DOI: https://dx.doi.org/10.1002/sim.9311] [PubMed: https://www.ncbi.nlm.nih.gov/pubmed/35043447]

56. Cooper, R.; Lessof, C.; Wong, A.; Hardy, R. The impact of variation in the device used to measure grip strength on the identification of low muscle strength: Findings from a randomised cross-over study. J. Frailty, Sarcopenia Falls; 2021; 6, pp. 225-230. [DOI: https://dx.doi.org/10.22540/JFSF-06-225] [PubMed: https://www.ncbi.nlm.nih.gov/pubmed/34950813]

57. Cadenas-Sanchez, C.; Sanchez-Delgado, G.; Martinez-Tellez, B.; Mora-Gonzalez, J.; Löf, M.; España-Romero, V.; Ruiz, J.R.; Ortega, F.B. Reliability and Validity of Different Models of TKK Hand Dynamometers. Am. J. Occup. Ther.; 2016; 70, 7004300010. [DOI: https://dx.doi.org/10.5014/ajot.2016.019117] [PubMed: https://www.ncbi.nlm.nih.gov/pubmed/27294996]