Potentially inappropriate prescriptions according to explicit and implicit criteria in patients with multimorbidity and polypharmacy. MULTIPAP: A cross-sectional study

Abstract

Background

Multimorbidity is a global health challenge that is associated with polypharmacy, increasing the risk of potentially inappropriate prescribing (PIP). There are tools to improve prescription, such as implicit and explicit criteria.

Objective

To estimate the prevalence of PIP in a population aged 65 to 74 years with multimorbidity and polypharmacy, according to American Geriatrics Society Beers Criteria® (2015, 2019), the Screening Tool of Older Person’s Prescription -STOPP- criteria (2008, 2014), and the Medication Appropriateness Index -MAI- criteria in primary care.

Methods

This was an observational, descriptive, cross-sectional study. The sample included 593 community-dwelling elderly aged 65 to 74 years, with multimorbidity and polypharmacy, who participated in the MULTIPAP trial. Socio-demographic, clinical, professional, and pharmacological-treatment variables were recorded. Potentially inappropriate prescribing was detected by computerized prescription assistance system, and family doctors evaluated the MAI. The MAI-associated factors were analysed using a logistic regression model.

Results

A total of 4,386 prescriptions were evaluated. The mean number of drugs was 7.4 (2.4 SD). A total of 94.1% of the patients in the study had at least one criterion for drug inappropriateness according to the MAI. Potentially inappropriate prescribing was detected in 57.7%, 43.6%, 68.8% and 71% of 50 patients according to the explicit criteria STOPP 2014, STOPP 2008, Beers 2019 and Beers 2015 respectively. For every new drug taken by a patient, the MAI score increased by 2.41 (95% CI 1.46; 3.35) points. Diabetes, ischaemic heart disease and asthma were independently associated with lower summated MAI scores.

Conclusions

The prevalence of potentially inappropriate prescribing detected in the sample was high and in agreement with previous literature for populations with multimorbidity and polypharmacy. The MAI criteria detected greater inappropriateness than did the explicit criteria, but their application was more complex and difficult to automate.

About the Authors:

Juan A. Lopez-Rodriguez

Contributed equally to this work with: Juan A. Lopez-Rodriguez, Eloísa Rogero-Blanco

Roles Conceptualization, Data curation, Formal analysis, Methodology, Validation, Writing – original draft, Writing – review & editing

Affiliations Primary Healthcare Center General Ricardos, Madrid, Spain, Medical Specialties and Public Health Department, School of Health Sciences, University Rey Juan Carlos Alcorcón, Madrid, Spain, Research Support Unit, Primary Care Management, Madrid, Spain, Health Services Research on Chronic Patients Network (REDISSEC), Madrid, Spain

Eloísa Rogero-Blanco

Contributed equally to this work with: Juan A. Lopez-Rodriguez, Eloísa Rogero-Blanco

Roles Conceptualization, Formal analysis, Investigation, Methodology, Validation, Writing – original draft, Writing – review & editing

* E-mail: [email protected]

Affiliations Primary Healthcare Center General Ricardos, Madrid, Spain, Medical Specialties and Public Health Department, School of Health Sciences, University Rey Juan Carlos Alcorcón, Madrid, Spain, Health Services Research on Chronic Patients Network (REDISSEC), Madrid, Spain

ORCID logo http://orcid.org/0000-0002-8732-6120

Mercedes Aza-Pascual-Salcedo

Roles Investigation, Validation, Writing – review & editing

Affiliation: Primary Care Direction, Sector Zaragoza III, Zaragoza, Spain

Fernando Lopez-Verde

Roles Investigation, Validation, Writing – review & editing

Affiliations Unidad Docente Multiprofesional de Atención Familiar y Comunitaria Distrito Málaga/Guadalhorce, Málaga, Spain, Primary Healthcare Center Las Delicias, Málaga, Spain

ORCID logo http://orcid.org/0000-0001-7870-0793

Victoria Pico-Soler

Roles Investigation, Validation, Writing – review & editing

Affiliations Health Services Research on Chronic Patients Network (REDISSEC), Madrid, Spain, EpiChron Research Group, IIS Aragón, Aragon Health Sciences Institute, Zaragoza, Spain, Primary Healthcare Center Torrero-La Paz, Zaragoza, Spain

Francisca Leiva-Fernandez

Roles Conceptualization, Investigation, Writing – review & editing

Affiliations Unidad Docente Multiprofesional de Atención Familiar y Comunitaria Distrito Málaga/Guadalhorce, Málaga, Spain, Biomedical Research Institute of Malaga (IBIMA), Malaga, Spain

ORCID logo http://orcid.org/0000-0001-6919-4817

J. Daniel Prados-Torres

Roles Conceptualization, Funding acquisition, Supervision, Writing – review & editing

¶‡ JDPT, APT and ICG are Joint Senior Authors.

Affiliations Health Services Research on Chronic Patients Network (REDISSEC), Madrid, Spain, Unidad Docente Multiprofesional de Atención Familiar y Comunitaria Distrito Málaga/Guadalhorce, Málaga, Spain, Biomedical Research Institute of Malaga (IBIMA), Malaga, Spain

ORCID logo http://orcid.org/0000-0001-5204-7781

Alexandra Prados-Torres

Roles Conceptualization, Funding acquisition, Supervision, Writing – review & editing

¶‡ JDPT, APT and ICG are Joint Senior Authors.

Affiliations Health Services Research on Chronic Patients Network (REDISSEC), Madrid, Spain, EpiChron Research Group, IIS Aragón, Aragon Health Sciences Institute, Zaragoza, Spain, Miguel Servet University Hospital, Zaragoza, Spain

Isabel Cura-González

Roles Funding acquisition, Methodology, Supervision, Writing – original draft, Writing – review & editing

¶‡ JDPT, APT and ICG are Joint Senior Authors.

Affiliations Medical Specialties and Public Health Department, School of Health Sciences, University Rey Juan Carlos Alcorcón, Madrid, Spain, Research Support Unit, Primary Care Management, Madrid, Spain, Health Services Research on Chronic Patients Network (REDISSEC), Madrid, Spain

MULTIPAP group

¶Membership of the MULTIPAP group is provided in the Acknowledgments.

Introduction

Multimorbidity, defined by the WHO as the coexistence of two or more chronic illnesses in a person [1], is a growing phenomenon. It describes the complex interaction in a patient of several co-existing diseases. It has become a health problem and an international health challenge [2] resulting from increased life expectancy and non-transmittable disease rates, among other factors.

Patients with multimorbidity usually present polypharmacy, defined as the simultaneous use of several medicines[3]. Data from the USA National Health Survey yielded a prevalence of polypharmacy of 39% in the population aged over 65 years [4]. An European study, with medication dispensing data for 310,000 adults, observed that the proportion of patients with ≥5 drugs dispensed doubled, reaching 20.8% in the 1995–2014 period[5]. In the National Health Survey in Spain in 2017, in this same age range, 27.7% of respondents reported consuming at least 5 or more drugs or pharmaceutical preparations [6].

Polypharmacy entails a greater risk for potentially inappropriate prescribing (PIP), which is defined as “the prescribing of medications that should generally be avoided in persons 65 years or older because they are either ineffective or they pose unnecessarily high risk where a safer alternative is available” [7]. Optimization and the appropriateness of prescriptions in this population has become a global public health problem.

To analyse potentially inappropriate prescriptions in primary care complex patients, explicit and implicit methods have been proposed [8,9]. Explicit methods, are focused on drugs (e.g., Beers and STOPP/START criteria), measuring how they fit to a set of predefined criteria [10–12]. These criteria are updated according to the available evidence for each different drug catalogues (USA or Europe). The implicit criteria are based on the global assessment by a health professional (pharmacist, internist, geriatrician or primary care physician), which takes into account the overall situation of the patient and whether the prescription corresponds to an indication or need. The most accepted implicit method internationally is the medication appropriateness index (MAI) [13].

Depending in the criteria used, the prevalence of patients with PIP differs significantly depending on the tools and the populations analysed (hospitalized, institutionalized or community patients) [14,15]. It ranges from 40.4% detected using STOPP criteria [16] to 98.7% of prevalence using MAI criteria in primary care young elderly patients taking at least 5 drugs [17]. In Spain, the MAI has been evaluated in hospitalised patients [18] and has also been adapted and validated for primary care [19]. However, we still lack in young-elderly population studies in primary care patients complaining with multimorbidity and polypharmacy.

The association between explicit methods (STOPP or Beers) and implicit methods (MAI) in the primary care population has been investigated [20]. Recently, a study was published comparing the sensitivity and specificity of these three methods performed by two pharmacists, using the MAI as the gold standard, in a population from Kuwait. This study compared Beers 2015, STOPP 2014 and FORTA with the MAI, obtaining kappa values of 0.16 (p <0.001), 0.40 (p <0.001) and 0.23 (p <0.001), respectively [21]. The most updated version of Beers 2019 has not been compared with the rest of the criteria.

Studies have shown association of high prevalence of PIP with worse health outcomes in patients such as unscheduled outpatient visits, emergency room visits, adverse events [17,22–24], and hospital admissions and re-admissions [25–28]. Furthermore, this association has also been found when analysing patient reported outcomes (PROMs), such as quality of life (EQ-5D-3L) [29].

In an attempt to facilitate the detection of PIP in patients, in recent years, explicit criteria (STOPP and Beers) have been automated into computerized prescription assistance systems(CPAS) [30]. The translation of explicit criteria to computer algorithms is complex [31,32] although easier than programming the implicit criteria (MAI) to computer pre-sets. The MAI criteria imply evaluating ten different aspects of each drug including indication, dose, effectiveness, interactions and duration, among others. Some of this evaluations even require health professional confirmation making this implicit criteria time consuming [13,33–35].

The main aim of this study was to estimate the prevalence of PIP in a population aged 65 to 74 years with multimorbidity and polypharmacy, according to explicit criteria (Beers 2015 and 2019, STOPP 2008 and 2014); and implicit criteria (Medication appropriateness index–MAI-) in primary care. The secondary objectives were to assess the clinical and socio-demographic predictors for PIP and to compare these criteria in order to detect PIP with greater applicability to the Spanish population.

Material and methods

The project has been favourably evaluated by the Central Committee of Primary Care Research of the Community of Madrid, the Commission for Health Research of the Aragon Institute for Health Research (IIS Aragon), and the Commission for Health Research of the Bio-Sanitary Research Institute in Malaga (IBIMA). The trial protocol was approved by the Clinical Research Ethics Committee of Aragon (CEICA) on September 30, 2015 (CP14/2015), and by the Research Ethics Committee of the Province of Malaga on September 25, 2015. Participant provided written consent to participate in the Multi-PAP trial Clinicaltrials.gov NCT02866799.

Design

This was a cross-sectional, descriptive, multicentric, observational study conducted in the Spanish primary care setting.

Participants and setting

Patients aged 65 to 74 years with multimorbidity (≥ 3 diseases) and polypharmacy (≥ 5 prescriptions taken for at least 3 months), who had attended their doctor consultation at least once over the last year and provided written consent to participate in the Multi-PAP trial Clinicaltrials.gov NCT02866799 were included [36]. Institutionalized patients, those whose life expectancy was <12 months, as estimated by their doctor, and patients with any severe mental disorder were excluded. For physicians, the inclusion criterion was at least one year in their job. Presentations of the Multi-PAP project were held in health centres, and professionals were offered the chance to participate. One hundred and seventeen family doctors from 38 healthcare centres from three Spanish regions (Andalucia, Aragon, and Madrid) and 593 patients agreed to participate. For the proposed objective and based on previous studies in a similar population reporting an average MAI summated score of 15.8 (10.1 SD) [17], with this sample size and a design effect of 1.2, a maximum type I error of 0.975% with a 95% confidence interval (95%CI) was determined.

Data collection

Sociodemographic and clinical data were obtained during the period of patient recruitment in the MULTIPAP study, which was conducted between December 2016 and January 2017 through an interview with each patient's family doctor.

The method of collecting data on patients and doctors was not the same. Data on professionals (age, sex, length of physician career, and being postgraduate medical supervisor) were recorded by each physician in the data collection notebook after signing their commitment to collaborate in the study. Subsequently, sociodemographic and clinical data on patients were collected through an interview with each patient's general practitioner after signing the written informed consent.

Subsequently, the data were uploaded from the DCN into the CPAS ChecktheMeds®.

Variables

The following socio-demographic variables were recorded for patients: age, sex, marital status, education level, social class according to the Spanish classification [37], and family income in thousands of euros adjusted by the number of people in the household (using the method proposed by the OECD Organisation for Economic Co-operation and Development). Additionally, the following clinical variables were collected: number of active pharmaceutical ingredients per patient according to the Anatomical, Therapeutic, Chemical (ATC) classification system; and chronic conditions in accordance with the international classification of primary care (ICPC), with the most relevant ones selected according to the criterion by O’Halloran [38]. The variables for the professional were age, sex, length of physician career, and being postgraduate medical supervisor.

Evaluation of prescribing appropriateness

One researcher with broad clinical and therapeutic drug monitoring expertise supervised information transfer to the ChecktheMeds® tool and used this tool to globally review the treatment of all patients. ChecktheMeds® is a web-based tool to help health professionals for treatment plan review. It quickly analyses potentially inappropriate prescriptions, potentially drug-drug and drug-disease interactions, contraindications and adverse events. It takes into account clinical variables, diagnosis codes and the whole treatment of a patient. All collected data were supervised by a second reviewer. PIP was identified using the four explicit criteria selected and using one implicit criterion.

The explicit criteria were a) the 2019 Updated Beers criteria by the American Geriatric Society [11], b) the 2015 Beers criteria by the American Geriatrics Society [39], c) the 2014 v2 STOPP criteria [12], and d) the 2008 v1 STOPP criteria [40]. All the STOPP and Beers criteria were analysed. In agreement with former studies and to avoid potential information bias, this research team agreed on omitting the A1P STOPP criterion from the analysis (any drug prescribed but not indicated by clinical evidence) to prevent its overestimation [41]. START criteria assessing potential prescribing omissions were dismissed because the focus of this study was on already-prescribed inappropriate medications, instead of the need of starting new medications. The four criteria were automatically reported by the CPAS and compared.

The implicit criterion was the MAI [13], which includes 10 implicit criteria (indication, effectiveness, dosage, correct directions, practical directions, drug-drug interactions, drug-disease interaction, duplication, duration and expense). The MAI measures the suitability of each of a patient's drugs to these 10 criteria on a 3-grade Likert scale (A appropriate, C inappropriate). Only the “correct direction” criterion was omitted because this information was not able to be evaluated.

Each medication prescribed was rated by an independent family physician with pharmacological expertise for each Region, applying the usual weighted criteria (three raters in total). The raters were able to review the clinical history of the patients in the study to obtain as much information as possible. The drug-drug and drug-disease interactions were detected with the help of the CPAS ChecktheMeds®. A pilot rating of 17 different drugs (three patients) was carried out between the three raters using the same electronic health records and cases. Discrepancies were discussed until a consensus was reached. Additionally, a family physician and a pharmacist conducted a second appraisal of the inter-observer reliability over a randomly selected 10% of the completed questionnaires.

The MAI was evaluated by drug and by patient. The following were calculated: the percentage of drugs with at least one inappropriate criterion; the percentage of patients with at least one inappropriate criterion for any of the drugs [13]; the percentage of patients with a summated MAI of 3 or more [20]; and the summated MAI score per drug and per patient.

Statistical analysis

Categorical variables are presented as frequencies and percentages. Quantitative variables are presented as the mean and standard deviation, with the corresponding CI 95% when the data fit a normal distribution or by the median and interquartile range (IQR) in the case of asymmetric data distribution. The MAI was used a reference point due to it’s reliably and validity as a standardized assessment tool. For the gold standard test (MAI), a pilot rating for the level of absolute agreement across the three raters was evaluated using the intraclass correlation coefficient (ICC). Specificity and sensitivity of the explicit criteria were assessed using a contingency table, and confidence intervals were calculated using exact correction. Concordance between implicit and explicit criteria was estimated using kappa statistics. A multivariate linear regression model was developed to assess factors associated with the summated MAI score per patient (maximum of 18 points multiplied by each drug prescribed). The independent variables were those reaching statistical significance in the univariate analysis or considered of clinical relevance. Five different multivariate logistic regression models were built to determined factors that were independently associated with PIP, with robust estimators that controlled for the effect of cluster sampling. For each model, the dependent variable was constructed as follows: (I) being prescribed at least one PIP according to Beers 2019 criteria (0 = no, 1 = yes); (II) being prescribed at least one PIP according to Beers 2015 criteria (0 = no, 1 = yes); (III) being prescribed at least one PIP according to STOPP 2014 criteria (0 = no, 1 = yes); (IV) being prescribed at least one PIP according to STOPP 2008 criteria (0 = no, 1 = yes); and (V) being prescribed medication with one or more inappropriate rating in the MAI criteria (0 = summated patient score 0, 1 = summated patient score≥1) according to the original Hanlon definition [13]. Stata v14.0 software was employed for the statistical analyses.

Ethical approval

The MULTIPAP study was designed in accordance with the basic ethical principles of autonomy, beneficence, justice, and non-maleficence and was conducted in accordance with the rules of Good Clinical Practice outlined in the most recent Declaration of Helsinki and the Oviedo Convention (1997). Written informed consent of patients was required. Data confidentiality and anonymity was ensured, according to the provisions of Spanish Law 15/1999, both during the implementation phase of the project and in any resulting presentations or publications. The project has been favourably evaluated by the Central Committee of Primary Care Research of the Community of Madrid, the Commission for Health Research of the Aragon Institute for Health Research (IIS Aragon), and the Commission for Health Research of the Bio-Sanitary Research Institute in Malaga (IBIMA). It was approved by the Clinical Research Ethics Committee of Aragon (CEICA) on September 30, 2015, and by the Research Ethics Committee of the Province of Malaga on September 25, 2015.

Results

Characteristics of the study participants

A total of 4,386 prescriptions were rated for the 593 included patients. The mean age of the patients was 69.7 (2.7 SD) years, the age range was 65–74, 55.8% were women, 75.4% were married, and 17.9% lived alone. Table 1 provides the main socio-demographic and clinical characteristics of the patients and the professionals variables. Among chronic clinical conditions, 78.9% of patients had hypertension, and 50.8% hypercholesterolemia. The mean number of chronic conditions and medications per patient were 5.8 (2.3 SD) diseases and 7.4 (2.4 SD) prescriptions per patient. 17.9% of patients were prescribed ≥10 drugs (Table 1).

[Figure omitted. See PDF.]

Table 1. Socio-demographic, clinical, and pharmacological characteristics of patients and physicians characteristic.

https://doi.org/10.1371/journal.pone.0237186.t001

For ATC groups, one of every three drugs (34.1%) prescribed belonged to the cardiovascular group, followed by metabolism and alimentary tract group and nervous system group. Table 2 shows the categories of drugs prescribed to patients according to ATC classification.

[Figure omitted. See PDF.]

Table 2. Anatomical therapeutics classification groups of drugs prescribed.

https://doi.org/10.1371/journal.pone.0237186.t002

Inappropriate prescribing ratings

The implicit criteria, the MAI, was evaluated for 4,386 prescriptions (589 patients). Four patients could not be evaluated due to not being able to access their medical records at the time of the evaluation. Moderate absolute agreement between the three raters was found, with an intraclass correlation coefficient of 0.41 (CI 95% 0.109–0.701). More than half of the prescriptions were considered appropriate (51.9%). The mean summated MAI score per drug was 1.4 (2.3 SD) (median 0; IQR 0–1). The mean summated MAI score per patient was 17.5 (16.8 SD) (median 14, IQR 5–25; range 0–102). Five hundred and fifty-four patients out of 589 had one or more inappropriate rating among their prescribed medications (94.1%). Of the 2,110 drugs considered inappropriate, 1,416 (67.1%) had less than three MAI inappropriate criteria ratings according to the Steinman classification [20], and 694 (32.9) met three or more MAI inappropriate criteria ratings. The MAI criteria with the highest inappropriate percentages were cost-effectiveness, duration, effectiveness and potential drug-drug interactions. Table 3 shows the distribution of inappropriate prescribing for each criterion. Omeprazole was the drug that accounted for the vast majority of inappropriate prescribing, having almost one in every five patients (19.9%) with an inappropriate MAI criterion rating. Additional information for the most common type of drug rated inappropriate can be found in S1 Table.

[Figure omitted. See PDF.]

Table 3. Distribution of inappropriate prescribing for each MAI criterion per drug prescribed or per patient.

https://doi.org/10.1371/journal.pone.0237186.t003

Based on the updated 2014 STOPP criteria, CPAS ChecktheMeds® detected PIP (at least one explicit criterion) for 340 patients (57.4%), 83 more than with the 2008 version (43.3%) (see Table 4). Eighty-two patients (13.8%) had 2 or more PIP with STOPP 2014 and 64 with STOPP 2008 (10.8%). The most frequently found PIP was the prolonged use of benzodiazepines (BZDs) for 217 patients (36.6%) using STOPP 2014 and 87 using STOPP 2008 (14.7%).

[Figure omitted. See PDF.]

Table 4. Sensitivity, specificity and measurements of agreements between different implicit and explicit criteria for appropriateness prescribing evaluation.

https://doi.org/10.1371/journal.pone.0237186.t004

More than two out of every three study participants (68.8%) met at least one of the 2019 updated Beers criteria, twelve less than when assessing the participants with the 2015 version (70.8%). For these patients, 197 (33.2%)had two or more PIP using Beers 2015 and 193 (30.6%) using Beers 2019. Applying the 2019 Beers criteria, the most frequent PIP was the prolonged used of proton-pump inhibitors (PPIs) by 260 patients (43.8%). This PIP is also the most frequent using Beers 2015 (45.4%).

Comparisons between the implicit criteria (gold standard) and updated explicit criteria

Table 4 shows the prevalence rates and the sensitivity and specificity for the two pair of versions of the explicit criteria comparing the old with the updated versions (STOPP 2008, STOPP 2014, Beers 2015 and Beers 2019) and comparing all of them with the implicit MAI criteria considered as the reference standard. A Venn diagram shows the agreement among the versions (Fig 1).

[Figure omitted. See PDF.]

Fig 1. Venn diagram.

Agreement among the versions.

https://doi.org/10.1371/journal.pone.0237186.g001

For the original version of the MAI, Beers 2015 had the highest sensitivity (71.8%) to detect PIP, followed by Beers 2019 (68.8%) and STOPP 2014 (60.1%). STOPP 2008 had the highest specificity (82.9%). The highest positive predictive value was obtained for STOPP 2014 (97.9%). The measurements of agreement (kappa indexes) were 0.104 between STOPP 2014 and the MAI, 0.057 between STOPP 2008 and the MAI and 0.001 between Beers 2019 and the MAI criteria.

There was no significant difference between the number of patients with PIP identified electronically by CPAS using Beers and STOPP criteria in their two more updated versions (p = 0.277). There were significant correlations between PIP identified by STOPP 2014 and the MAI (r = 0.192; p<0.001), STOPP 2008 and the MAI (r = 0.185; p<0.001) and Beers 2015 and the MAI (r = 0.311; p<0.001). The highest correlation was found between STOPP 2014 and Beers 2015 (r = 0.358; p<0.001) (correlation in S2 Table; the distribution of summated MAI score per number of explicit criteria can be found in S3 Table).

Factors independently associated with inappropriate prescribing based on implicit criteria and a comparison among explicit criteria methods

Based on the multivariable linear regression analysis for the summated MAI score, diabetes, ischaemic heart disease and asthma were independently associated with lower summated MAI scores (see Table 5). For every new drug taken by a patient, the MAI score increased by 2.41 (95% CI 1.46; 3.35) points. Out of all the physician factors studied, patients of doctors working also as postgraduate medical supervisors had lower MAI scores (coef. -5.52, 95% CI -9.60; -1.44).

[Figure omitted. See PDF.]

Table 5. Factors associated with summated medication appropriateness index scores.

https://doi.org/10.1371/journal.pone.0237186.t005

Based on the multivariable logistic regressions performed for the MAI, STOPP and Beers criteria, taking more than 10 drugs was independently associated with inappropriate prescribing according to the MAI (OR: 20.86; 95% CI: 2.09;207.78, p = 0.010), STOPP 2014 criteria (OR: 4.96; 95% CI: 2.77;8.88, p<0.001), STOPP 2008 criteria (OR: 7.88; 95% CI: 4.48;13.8, p<0.001) and Beers 2015 criteria (OR: 3.31; 95% CI: 1.77;6.22, p<0.001). This association was not found for the Beers 2019 criteria. Some of the clinical conditions were found to be related with inappropriate medication use, such as anxiety or depression, across the four main criteria or the presence of osteoarthritis (see S4 Table). Fig 2 presents the estimated effects for different patient and physician characteristics for the two most sensitive explicit criteria compared to the MAI.

[Figure omitted. See PDF.]

Fig 2. Estimated effects for different patient and physician characteristics for the two most sensitive explicit criteria compared to the MAI.

https://doi.org/10.1371/journal.pone.0237186.g002

Discussion

Main findings

This study estimates, for the first time, the prevalence of PIP using the latest versions of explicit internationally accepted criteria and compares it with implicit criteria (MAI). The analysis of the criteria was performed by family doctors, with the help of a CPAS, for patients with multimorbidity and polypharmacy in primary care in Spain.

A total of 94.1% of the patients in this study had at least one criterion of inappropriateness for one of their drugs according to the MAI. PIP was detected in 57.7%, 43.6%, 68.8% and 71% of patients according to STOPP 2014, STOPP 2008, Beers 2019 and Beers 2015, respectively. Patients with more than 10 drugs had a significantly greater presence of inappropriateness using any of the four criteria. The MAI detected greater inappropriateness than did the explicit criteria. Using the MAI as the gold standard, the criteria with the highest sensitivity was Beers 2015; however, the highest positive predictive value was obtained with STOPP 2014, with better concordance measures to detect PIP compared with other versions of STOPP or Beers.

Prevalence of PIP

Implicit criteria.

The prevalence of PIP varies according to the criteria used and the characteristics of the population and studies [14,15,42]. The mean score of the summated MAI score per drug was 1.4 (2.3), and the mean MAI score per patient was 17.5 (16.8). A total of 94.1% of the patients presented an inappropriate MAI criterion for a drug. These results were similar to those reported for a study conducted in the primary care setting in the United States with polymedicated patients aged>65 years. This study detected PIP in 98.7% of patients and a summated MAI score per patient of 15.8 (10.1 SD) [17]. In another study in the primary care setting in Kuwait [21], the prevalence of PIP and mean MAI score were lower (PIP in 73.6% and MAI score per patient of 5.8 (5.8 SD)), but the population in this case had a mean consumption of drugs below that in our study. In a systematic review by Patterson et al. [43] of patients with polypharmacy aged over 65 years included in clinical trials from various areas, this score ranged from 6.5 to 19.3 in a total of 965 participants. In the PRIMUM trial [44], with a methodology and population similar to ours, the mean MAI was lower (4.6 (5.8 SD) in the control group and 4.8 (5.4 SD) in the intervention group). It is possible that the way in which the professional (pharmacist or doctor) evaluated patients with the MAI was not the same in the studies. The results will be different when the MAI is performed together with the patient, reviewing the clinical history (as in our study), or when only limited data are available from a DCN. There are some limited data regarding the summated MAI score in Spanish primary care population. Only data from palliative care patients in Spain [45] or primary care in France [18,46].

The most frequent MAI individual criterion found in our study also differ from those found in the literature [17]. The item cost-effectiveness, the most frequent observed for our patients, could be biased due to the different prices of drugs in the different regions. This item has been eliminated in the adapted versions used in the studies that we previously indicated [21,44]. The criterion “potential drug-drug interactions” was much more frequent in our work than in the previous studies [21]. This difference can be related to the support tools for the detection of interactions used by the rater. In our case, a CPAS was used that provides information from various sources in an automated manner; this may have helped to better detect interactions.

Language variations and different MAI-criteria weighting reduced the comparability of these studies and can explain the differences found.

Explicit criteria.

Using the Beers criteria, the prevalence was 68.8% and 70.8% for the 2019 and 2015 versions, respectively. To date, there are no data available to compare the latest versions (2015 and 2019). For the 2015 version, the data obtained is slightly higher than those reported by previous studies in a hospital population (53.5%) [47], and similar to studies conducted with insurance databases (72.8%) [14,48]. With STOPP, this study obtained prevalence of 57.4% and 43.6% using STOPP 2014 and 2008, respectively, which is higher than those reported by prior studies [49,50] using previous STOPP versions in the primary care setting and in the European population (36% and 39%, respectively). In those who used the 2014 version, the prevalence ranged between 8.7 and 40.4% [16,41]; in a polymedicated geriatric primary care population in Kuwait, similar results were found (55.7%) [21]. The greater prevalence observed in this study could result from the included population, which had to meet the polypharmacy criterion to participate in the Multi-PAP trial, whereas only 72.9% or 72.1% of the patients in the abovementioned study were polymedicated.

Our results coincide with those of the majority of previous studies, placing BZDs and PPIs among the most frequently detected PIP with explicit criteria [14–16,41,49,51]. The percentage of patients in our sample who used BZDs for more than four weeks (STOPP v2) was similar to that obtained by Blanco Reina [13] (36.6% vs. 38.6%). The prolonged use of PPIs was the PIP most frequently detected in our sample, with both Beers versions (2019 (43.8%) and 2015 (45.5%)). The Beers 2015 update included this criterion, and there are already authors who describe the prolonged use of PPIs as frequent [47], with 41.9%; however, the samples are not comparable to ours.

Comparison between implicit criteria and explicit criteria

Taking the MAI as the gold standard, Beers 2015 had the highest sensitivity (71.8%) to detect PIP, followed by Beers 2019 (68.8%) and STOPP 2014 (60.1%). The highest positive predictive value was obtained using STOPP 2014 (97.9%). Our data differ from those obtained in the Kuwait study [21] in terms of the sensitivities obtained in the explicit criteria. However, given the characteristics of our population and the high prevalence of PIP, STOPP 2014 could have a better diagnostic yield by having a greater positive predictive value. In other words, when faced with a positive STOPP 2014 value, it would be more likely that PIP would actually be confirmed by the MAI in patients with multimorbidity and polypharmacy. This is especially relevant in populations with a priori suspicion of a high prevalence of inappropriateness. This differs from similar studies in which the median number of drugs was lower and the population was different [21].

In Steinman’s study they found that patients with a MAI score of three or more points on any drug had a Beers criterion of 34%. In hospitalized patients, those with a Beers criterion at admission had a mean of 7.17 (0.11–14.23) summated-MAI score [52].

We obtained a higher prevalence of PIP with the MAI. These implicit criteria are potentially the most sensitive ones and can take into account patients’ preferences. However, these methods are time-consuming and it requires intensive training and extensive knowledge [8,20]. This means that they may not be the first option in clinical settings. Other tools, such as computer-automated explicit criteria, may be better options as an initial approach to determining the risk of drug inappropriateness.

It is evident that the common use measures of the quality of prescriptions produce widely discordant results (different quality metrics measuring different constructs). In studies comparing explicit methods with each other, the concordance among methods was low [16,51,53]. The different tools available can be complementary, and the decision to use one or the other should be related to the setting in which it is used and the purpose of its use. In research settings, a robust evaluation of the quality of prescriptions is probably necessary. However, in clinical practice, the use of explicit criteria, with less clinical detail and more easily automatable, can be applied more easily and quickly.

Factors associated with PIP

In this study, we found that diseases such as diabetes, ischaemic heart disease and asthma were significantly associated with a lower summated MAI score. It is possible that patients with these pathologies, which are well defined and delimited, with frequent and protocolled visits, are subjected to more follow-ups at which there is opportunity to properly review medication and to easily detect situations of drug inappropriateness. Patients of doctors working both, as family physicians and postgraduate medical supervisors, had lower summated MAI score. We have not found other studies that have reported similar results. This could be related to the greater training required for those working as supervisors and also because of increased awareness in terms of reviewing treatments for polymedicated patients. Additionally, there is a clear association between a greater number of drugs and the summated MAI score. Taking more than 10 drugs is associated independently with greater detection of PIP with explicit criteria and with the MAI. This result continues to make the cut-off of 10 drugs a possible proxy for complex multimorbidity and an important indicator of risk.

Conclusion

In conclusion, the prevalence of PIP detected in the sample was high and in agreement with previous literature in young senior population with multimorbidity and polypharmacy. The MAI criteria detected greater inappropriateness than did the explicit criteria, but their application was more complex and difficult to automate.

Future studies should evaluate whether the application of implicit and explicit criteria with the help of automated tools by a professional alone, among others, could change the usual clinical practice and improve patient health.

Strengths and limitations

We found that this study covers an objective for which it was not initially designed. There was an attempt to partially correct this fact by estimating the aforementioned power as well as estimating the intervals with robust estimators to control the randomness introduced by the type of sampling. However, although the baseline information is trustworthy and was collected by each patient’s doctor and verified, the MAI evaluation, which was performed by another external physician, was not performed with the patient in an interview but rather by reviewing each patient’s medical history, which may have resulted in an inappropriate valuation of some criteria related to the perspectives of the patient and the prescribing physician that may not be included in medical records.

Among the strengths, it is noteworthy that this is the first Spanish study that automatically evaluated PIP with Beers 2019. It is also the first one comparing explicit and implicit criteria in its latest versions with the MAI. In addition, data collection through an interview with each patient's own doctor, the pragmatic design and an exhaustive review of each patient’s clinical history by the raters confer reliability to the data in this work.

Future studies should evaluate whether the application of implicit and explicit criteria with the help of automated tools by a professional alone, among others, could change the usual clinical practice and improve patient health.

Supporting information

[Figure omitted. See PDF.]

S1 Table. Qualitative distribution of drug type and inadequacy in the 4 questions with the greatest relative weight in the medication appropriateness index of total prescriptions and patients.

https://doi.org/10.1371/journal.pone.0237186.s001

(XLSX)

S2 Table. Correlation table.

Correlation between criteria.

https://doi.org/10.1371/journal.pone.0237186.s002

(XLSX)

S3 Table. Quantitative distribution of summated MAI score according to the number of explicit criteria detected.

https://doi.org/10.1371/journal.pone.0237186.s003

(XLSX)

S4 Table. Factors associated with inappropriate prescribing as determined by MAI criteria, STOPP 2008 and 2014 versions and Beers 2015 and 2019 criteria.

https://doi.org/10.1371/journal.pone.0237186.s004

(XLSX)

Acknowledgments

To our colleagues from the Research Unit, including the assistants Marcial Caboblanco Muñoz, and Juan Carlos Gil Moreno for their unconditional support. To all patients for their contribution to this research.

MULTIPAP GROUP:

Lead authors for the MULTIPAP Study group: Alexandra Prados-Torres (EpiChron Research Group, Aragon Health Sciences Institute (IACS), IIS Aragón, REDISSEC ISCIII, Miguel Servet University Hospital, Zaragoza, Spain) [email protected], Juan Daniel Prados-Torres (Multiprofessional Teaching Unit for Family and Community Care Primary Care District Málaga-Guadarhorce, Instituto de Investigación Biomédica de Málaga–IBIMA-, Universidad de Málaga, Spain) [email protected], Isabel del Cura (Research unit. Primary Health Care Management Madrid. Spain) [email protected].

Coordinating committee

María José Bujalance-Zafra (Victoria PCHC, Andalousian Health Service, Instituto de Investigación Biomédica de Málaga–IBIMA-, Universidad de Málaga, Spain), Francisca Leiva-Fernández (Multiprofessional Teaching Unit for Family and Community Care Primary Care District Málaga-Guadarhorce, Instituto de Investigación Biomédica de Málaga–IBIMA-, Universidad de Málaga, Spain), Fernando López Verde (Las Delicias PCHC, Andalousian Health Service, Málaga, Spain), Mercedes Aza-Pascual-Salcedo (EpiChron Research Group, Aragon Health Sciences Institute (IACS), IIS Aragón, REDISSEC ISCIII. Aragon Health Service (SALUD), Zaragoza, Spain), Luis Gimeno-Feliu (EpiChron Research Group, Aragon Health Sciences Institute (IACS), IIS Aragón, REDISSEC ISCIII. San Pablo Health Centre, Aragon Health Service (SALUD), Zaragoza, Spain), Antonio Gimeno-Miguel (EpiChron Research Group, Aragon Health Sciences Institute (IACS), IIS Aragón, REDISSEC ISCIII, Miguel Servet University Hospital, Zaragoza, Spain), Francisca González Rubio (EpiChron Research Group, Aragon Health Sciences Institute (IACS), IIS Aragón, REDISSEC ISCIII. Delicias Sur Health Centre, Aragon Health Service (SALUD), Zaragoza, Spain), Victoria Pico-Soler (EpiChron Research Group, Aragon Health Sciences Institute (IACS), IIS Aragón, REDISSEC ISCIII. Torrero-LaPaz Health Centre, Aragon Health Service (SALUD), Zaragoza, Spain), Beatriz Poblador-Plou (EpiChron Research Group, Aragon Health Sciences Institute (IACS), IIS Aragón, REDISSEC ISCIII, Miguel Servet University Hospital, Zaragoza, Spain), Juan A López Rodríguez (Research unit. Primary Health Care Management Madrid. Spain), Cristina M Lozano Hernández (Research unit. Primary Health Care Management Madrid. Spain), Alessandra Marengoni (Department of Clinical and Experimental Sciences, University of Brescia, Brescia, Italy), Jesús Martín Fernández (Multiprofessional Teaching Unit for Family and Community Care Primary Care Oeste Primary Health Care Centre, Madrid, Spain), Christiane Muth (Institute of General Practice, Johann Wolfgang Goethe University, Frankfurt, Germany), Elena Polentinos Castro (Research unit. Primary Health Care Management Madrid. Spain), MA Elosisa Rogero (General Ricardos Primary Health Care Centre, Madrid, Spain), José María Valderas Martínez (University of Exeter Medical School, Exeter, UK. 22Department).

Collaborating Investigators

Maria del Pilar Barnestein-Fonseca (Fundación CUDECA, Instituto de Investigación Biomédica de Málaga–IBIMA-, Universidad de Málaga, Spain), (Marcos Castillo-Jimena (Coín PCHC, Malaga-Guadalhorce Sanitary District, Andalousian Health Service. Coín, Málaga, Instituto de Investigación Biomédica de Málaga (IBIMA), Universidad de Málaga, Spain), Miguel Domínguez-Santaella (Victoria PCHC, Malaga-Guadalhorce Sanitary District, Andalousian Health Service, Málaga, Spain), Nuria García-Agua-Soler (Department of Pharmacology, Faculty of Medicine, Malaga University), María Isabel Márquez-Chamizo (Carranque PCHC, Malaga-Guadalhorce Sanitary District, Andalousian Health Service, Málaga, Spain), José María Ruiz-San-Basilio (Coín PCHC, Malaga-Guadalhorce Sanitary District, Andalousian Health Service, Coín, Málaga, Spain), José María Abad-Díez (Department of Health, Social Welfare and Family, Government of Aragon), Marta Alcaraz Borrajo (Subdirectorate General of Pharmacy and Health Products), Gloria Ariza Cardiel (Multiprofessional Teaching Unit for Family and Community Care Primary Care Oeste Primary Health Care Centre, Madrid, Spain), Amaya Azcoaga Lorenzo (Pintores Primary Health Care Centre, Madrid, Spain), José María Abad-Díez (Aragon Health Service (SALUD), Government of Aragon, Zaragoza, Spain), Marta Alcaraz Borrajo (Subdirectorate General of Pharmacy and Health Products), Ana Cristina Bandrés-Liso (EpiChron Research Group, Aragon Health Sciences Institute (IACS), IIS Aragón, REDISSEC ISCIII. Aragon Health Service (SALUD), Zaragoza, Spain), Amaia Calderon-Larrañaga (EpiChron Research Group, Aragon Health Sciences Institute (IACS), IIS Aragón, REDISSEC ISCIII, Zaragoza, Spain. Aging Research Center, Department of Neurobiology, Care Sciences and Society, Karolinska Institutet, Stockholm University, Stockholm, Sweden.) Mercedes Clerencia-Sierra (EpiChron Research Group, Aragon Health Sciences Institute (IACS), IIS Aragón, REDISSEC ISCIII. Miguel Servet University Hospital, Aragon Health Service (SALUD), Zaragoza, Spain), Javier Marta-Moreno (EpiChron Research Group, Aragon Health Sciences Institute (IACS), IIS Aragón, REDISSEC ISCIII. Miguel Servet University Hospital, Aragon Health Service (SALUD), Zaragoza, Spain), Antonio Poncel-Falcó (EpiChron Research Group, Aragon Health Sciences Institute (IACS), IIS Aragón, REDISSEC ISCIII. Aragon Health Service, Zaragoza, Spain), Ana Isabel González González (Technical Support Unit, Primary Care Management, Madrid Health Service), Virginia Hernández Santiago (Ninewells Hospital & Medical School, Dundee, UK), Angel Mataix SanJuan (Subdirección General de Farmacia y Productos Sanitarios), Ricardo Rodríguez Barrientos (Research unit. Primary Health Care Management Madrid. Spain), Mercedes Rumayor Zarzuelo (Centro de Salud Pública de Coslada, Área II Subdirección de Promoción de la Salud y Prevención), Luis Sánchez Perruca (Dirección Sistemas de Información, Gerencia Asistencial de Atención Primaria, Servicio Madrileño de Salud), Teresa Sanz Cuesta (Research unit. Primary Health Care Management Madrid. Spain), Mª Eugenia Tello Bernabé (El Naranjo PCHC, Madrid, Spain).

Collaborating Investigators: Clinical Investigators in Primary Care Health Centres (PCHC):

(Andalucía): PCHC Alhaurín el Grande Javier Martín Izquierdo, Macarena Toro Sainz. PCHC Carranque: Mª José Fernández Jiménez, Esperanza Mora García, José Manuel Navarro Jiménez. PCHC Ciudad Jardín: Leovigildo Ginel Mendoza, Luz Pilar de la Mota Ybancos, Jaime Sasporte Genafo. PCHC Coín: Mª José Alcaide Rodríguez, Elena Barceló Garach, Beatriz Caffarena de Arteaga, Mª Dolores Gallego Parrilla, Catalina Sánchez Morales. PCHC Delicias: Mª del Mar Loubet Chasco, Irene Martínez Ríos, Elena Mateo Delgado. PCHC La Roca: Esther Martín Aurioles. PCHC Limonar: Sylvia Hazañas Ruiz. PCHC Palmilla: María Auxiliadora Nieves Muñoz Escalante. PCHC Puerta Blanca: Enrique Leonés Salido, Mª Antonia Máximo Torres, Mª Luisa Moya Rodríguez, María encarnación Peláez Gálvez, José Manuel Ramírez Torres, Cristóbal Trillo Fernández. PCHC Tiro Pichón: Mª Dolores García Martínez Cañavate, Mª del Mar Gil Mellado, Mª Victoria Muñoz Pradilla. PCHC Vélez Sur: Mª José Clavijo Peña, José Leiva Fernández, Virginia Castillo Romero. PCHC Vera: Rubén Vázquez Alarcón. PCHC Victoria: Rafael Ángel Maqueda, Gloria Aycart Valdés, Ana Mª Fernández Vargas, Irene García, Antonia González Rodríguez, Mª Carmen Molina Mendaño, Juana Morales Naranjo, Francisco Serrano Guerra.PCHC Alcorisa (Alcorisa): Carmen Sánchez Celaya del Pozo. (Aragón): PCHC Alcorisa (Alcorisa): Carmen Sánchez Celaya del Pozo. PCHC Delicias Norte (Zaragoza): José Ignacio Torrente Garrido, Concepción García Aranda, Marina Pinilla Lafuente, Mª Teresa Delgado Marroquín. PCHC Picarral (Zaragoza): Mª José Gracia Molina, Javier Cuartero Bernal, Mª Victoria Asín Martín, Susana García Domínguez. PCHC Fuentes de Ebro (Zaragoza): Carlos Bolea Gorbea.PCHC Valdefierro (Zaragoza): Antonio Luis Oto Negre. PCHC Actur Norte (Zaragoza): Eugenio Galve Royo, Mª Begoña Abadía Taira.PCHC Alcañiz (Alcañiz): José Fernando Tomás Gutiérrez. PCHC Sagasta—Ruiseñores (Zaragoza): José Porta Quintana, Valentina Martín Miguel, Esther Mateo de las Heras, Carmen Esteban Algora. PCHC Ejea (Ejea de los Caballeros): Mª Teresa Martín Nasarre de Letosa, Elena Gascón del Prim, Noelia Sorinas Delgado, Mª Rosario Sanjuan Cortés. PCHC Canal Imperial—Venecia (Zaragoza): Teodoro Corrales Sánchez. PCHC Canal Imperial—San José Sur (Zaragoza): Eustaquio Dendarieta Lucas. PCHC Jaca (Jaca): Mª del Pilar Mínguez Sorio. PCHC Santo Grial (Huesca): Adolfo Cajal Marzal. (Madrid)PCHC Mendiguchía Carriche (Leganés): Eduardo Díaz García, Juan Carlos García Álvarez, Francisca García De Blas González, Cristina Guisado Pérez, Alberto López García Franco, Mª Elisa Viñuela Benitez. PCHC El Greco (Getafe): Ana Ballarín González, Mª Isabel Ferrer Zapata, Esther Gómez Suarez, Fernanda Morales Ortiz, Lourdes Carolina Peláez Laguno, José Luis Quintana Gómez, Enrique Revilla Pascual. PCHC Cuzco (Fuenlabrada): M Ángeles Miguel Abanto.PCHC El Soto (Móstoles): Blanca Gutiérrez Teira. PCHC General Ricardos (Madrid): Francisco Ramón Abellán López, Carlos Casado Álvaro, Paulino Cubero González, Santiago Manuel Machín Hamalainen, Raquel Mateo Fernández, Mª Eloisa Rogero Blanco, Cesar Sánchez Arce.PCHC Ibiza (Madrid): Jorge Olmedo Galindo. PCHC Las Américas (Parla): Claudia López Marcos, Soledad Lorenzo Borda, Juan Carlos Moreno Fernández, Belén Muñoz Gómez, Enrique Rodríguez De Mingo. PCHC Mª Ángeles López (Leganés): Juan Pedro Calvo Pascual, Margarita Gómez Barroso, Beatriz López Serrano, Mª Paloma Morso Peláez, Julio Sánchez Salvador, Jeannet Dolores Sánchez Yépez, Ana Sosa Alonso. PCHC Mª Jesús Hereza (Leganés): Mª del Mar Álvarez Villalba. PCHC Pavones (Madrid): Purificación Magán Tapia. PCHC Pedro Laín Entralgo (Alcorcón): Mª Angelica Fajardo Alcántara, Mª Canto De Hoyos Alonso, Mª Aránzazu Murciano Antón. PCHC Pintores (Parla): Manuel Antonio Alonso Pérez, Ricardo De Felipe Medina, Amaya Nuria López Laguna, Eva Martínez Cid De Rivera, Iliana Serrano Flores, Mª Jesús Sousa Rodríguez. PCHC Ramón y Cajal (Alcorcón): Mª Soledad Núñez Isabel, Jesús Mª Redondo Sánchez, Pedro Sánchez Llanos, Lourdes Visedo Campillo.

Citation: Lopez-Rodriguez JA, Rogero-Blanco E, Aza-Pascual-Salcedo M, Lopez-Verde F, Pico-Soler V, Leiva-Fernandez F, et al. (2020) Potentially inappropriate prescriptions according to explicit and implicit criteria in patients with multimorbidity and polypharmacy. MULTIPAP: A cross-sectional study. PLoS ONE 15(8): e0237186. https://doi.org/10.1371/journal.pone.0237186

References

1. World Health Organization. The Challenges of a changing world. The World Health Report 2008—primary Health Care (Now More Than Ever). 2008. p. 21.

2. The Academy of Medical Sciences. Multimorbidity: a priority for global health research. London; 2018.

3. Rankin A, Cadogan CA, Patterson SM, Kerse N, Cardwell CR, Bradley MC, et al. Interventions to improve the appropriate use of polypharmacy for older people. Cochrane Database Syst Rev. 2018; 1–11. pmid:30175841

4. Kantor ED, Rehm CD, Haas JS, Chan AT, Giovannucci EL. Trends in Prescription Drug Use Among Adults in the United States From 1999–2012. JAMA. 2015;314: 1818–31. pmid:26529160

5. Guthrie B, Makubate B, Hernandez-Santiago V, Dreischulte T. The rising tide of polypharmacy and drug-drug interactions: population database analysis 1995–2010. BMC Med. 2015;13: 74. pmid:25889849

6. Ministerio de Sanidad Consumo y Bienestar Social. Encuesta Nacional Salud España. In: Portal Estadístico [Internet]. 2017 [cited 16 Apr 2019]. https://www.mscbs.gob.es/estadisticas/microdatos.do

7. Beers MH. Explicit Criteria for Determining Inappropriate Medication Use in Nursing Home Residents. Arch Intern Med. 1991;151: 1825. pmid:1888249

8. Spinewine A, Schmader KE, Barber N, Hughes C, Lapane KL, Swine C, et al. Appropriate prescribing in elderly people: how well can it be measured and optimised? Lancet (London, England). 2007;370: 173–84.

9. Galván-Banqueri M, Santos-Ramos B, Vega-Coca MD, Alfaro-Lara ER, Nieto-Martín MD, Pérez-Guerrero C. Adecuación del tratamiento farmacológico en pacientes pluripatológicos. Atención Primaria. 2013;45: 6–18. pmid:23218683

10. Beers MH. Explicit criteria for determining potentially inappropriate medication use by the elderly. An update. Arch Intern Med. 1997;157: 1531–1536. pmid:9236554

11. By the 2019 American Geriatrics Society Beers Criteria® Update Expert Panel. American Geriatrics Society 2019 Updated AGS Beers Criteria® for Potentially Inappropriate Medication Use in Older Adults. J Am Geriatr Soc. 2019;67: 674–694. pmid:30693946

12. O’mahony D, O’sullivan D, Byrne S, O’connor MN, Ryan C, Gallagher P. STOPP/START criteria for potentially inappropriate prescribing in older people: Version 2. Age Ageing. 2015;44: 213–218. pmid:25324330

13. Hanlon JT, Schmader KE, Samsa GP, Weinberger M, Uttech KM, Lewis IK, et al. A method for assessing drug therapy appropriateness. J Clin Epidemiol. 1992;45: 1045–51. pmid:1474400

14. Tommelein E, Mehuys E, Petrovic M, Somers A, Colin P, Boussery K. Potentially inappropriate prescribing in community-dwelling older people across Europe: A systematic literature review. Eur J Clin Pharmacol. 2015;71: 1415–1427. pmid:26407687

15. Hill-Taylor B, Sketris I, Hayden J, Byrne S, O’Sullivan D, Christie R. Application of the STOPP/START criteria: a systematic review of the prevalence of potentially inappropriate prescribing in older adults, and evidence of clinical, humanistic and economic impact. J Clin Pharm Ther. 2013;38: 360–372. pmid:23550814

16. Blanco-Reina E, García-Merino MR, Ocaña-Riola R, Aguilar-Cano L, Valdellós J, Bellido-Estévez I, et al. Assessing potentially inappropriate prescribing in community-dwelling older patients using the updated version of STOPP-START criteria: A comparison of profiles and prevalences with respect to the original version. PLoS One. 2016;11: 1–10. pmid:27907210

17. Lund BC, Carnahan RM, Egge JA, Chrischilles EA, Kaboli PJ. Inappropriate prescribing predicts adverse drug events in older adults. Ann Pharmacother. 2010;44: 957–963. pmid:20460558

18. Galván-Banqueri M, González-Méndez AI, Alfaro-Lara ER, Nieto-Martín MD, Pérez-Guerrero C, Santos-Ramos B. [Evaluation of the appropriateness of pharmacotherapy in patients with high comorbidity]. Aten primaria. 2013;45: 235–43. pmid:23337466

19. Gavilán Moral E, Villafaina Barroso A, Aranguez Ruiz A, Sánchez Robles GA, Suliman Criado S, Jiménez de Gracia L. Índice de adecuación de los medicamentos—Versión española modificada manual de usuario [Internet]. Laboratorio de Prácticas Innovadoras en Polimedicación y Salud; 2012 p. http://www.somuca.es/ServletDocument?document=122

20. Steinman MA, Rosenthal GE, Landefeld CS, Bertenthal D, Sen S, Kaboli PJ. Conflicts and concordance between measures of medication prescribing quality. Med Care. 2007;45: 95–99. pmid:17279026

21. Awad A, Hanna O. Potentially inappropriate medication use among geriatric patients in primary care setting: A cross-sectional study using the Beers, STOPP, FORTA and MAI criteria. PLoS One. 2019;14: e0218174. pmid:31194800

22. Schmader KE, Hanlon JT, Landsman PB, Samsa GP, Lewis IK, Weinberger M. Inappropriate prescribing and health outcomes in elderly veteran outpatients. Ann Pharmacother. 1997;31: 529–533. pmid:9161643

23. Hanlon JT, Sloane RJ, Pieper CF, Schmader KE. Association of adverse drug reactions with drug-drug and drug-disease interactions in frail older outpatients. Age Ageing. 2011;40: 274–7. pmid:21177281

24. Moriarty F, Bennett K, Cahir C, Kenny RA, Fahey T. Potentially inappropriate prescribing according to STOPP and START and adverse outcomes in community-dwelling older people: a prospective cohort study. Br J Clin Pharmacol. 2016; 849–857. pmid:27136457

25. Hellström LM, Bondesson Å, Höglund P, Midlöv P, Holmdahl L, Rickhag E, et al. Impact of the Lund Integrated Medicines Management (LIMM) model on medication appropriateness and drug-related hospital revisits. Eur J Clin Pharmacol. 2011;67: 741–752. pmid:21318595

26. Somers A, Mallet L, Van Der Cammen T, Robays H, Petrovic M. Applicability of an adapted medication appropriateness index for detection of drug-related problems in geriatric inpatients. Am J Geriatr Pharmacother. 2012;10: 101–109. pmid:22304791

27. Gillespie U, Alassaad A, Hammarlund-Udenaes M, Mörlin C, Henrohn D, Bertilsson M, et al. Effects of Pharmacists’ Interventions on Appropriateness of Prescribing and Evaluation of the Instruments’ (MAI, STOPP and STARTs’) Ability to Predict Hospitalization-Analyses from a Randomized Controlled Trial. PLoS One. 2013;8. pmid:23690938

28. Alassaad A, Melhus H, Hammarlund-Udenaes M, Bertilsson M, Gillespie U, Sundstrom J. A tool for prediction of risk of rehospitalisation and mortality in the hospitalised elderly: secondary analysis of clinical trial data. BMJ Open. 2015;5: e007259–e007259. pmid:25694461

29. Olsson IN, Runnamo R, Engfeldt P. Medication quality and quality of life in the elderly, a cohort study. Health Qual Life Outcomes. 2011;9: 95. pmid:22054205

30. Soiza RL, Subbarayan S, Antonio C, Cruz-Jentoft AJ, Petrovic M, Gudmundsson A, et al. The SENATOR project: developing and trialling a novel software engine to optimize medications and nonpharmacological therapy in older people with multimorbidity and polypharmacy. Ther Adv Drug Saf. 2017;8: 81–85. pmid:28382196

31. Anrys P, Strauven G, Boland B, Dalleur O, Declercq A, Degryse JM, et al. Collaborative approach to Optimise MEdication use for Older people in Nursing homes (COME-ON): Study protocol of a cluster controlled trial. Implement Sci. 2016;11. pmid:26968520

32. Nauta KJ, Groenhof F, Schuling J, Hugtenburg JG, van Hout HPJ, Haaijer-Ruskamp FM, et al. Application of the STOPP/START criteria to a medical record database. Pharmacoepidemiol Drug Saf. 2017;26: 1242–1247. pmid:28799295

33. Kassam R, Martin LG, Farris KB. Reliability of a Modified Medication Appropriateness Index in Community Pharmacies. Ann Pharmacother. 2003;37: 40–46. pmid:12503931

34. Bright TJ, Wong A, Dhurjati R, Bristow E, Bastian L, Coeytaux RR, et al. Effect of clinical decision-support systems: a systematic review. Ann Intern Med. 2012;157: 29–43. pmid:22751758

35. Dreesens D, Kremer L, van der Weijden T. The Dutch chaos case: a scoping review of knowledge and decision support tools available to clinicians in the Netherlands. Health Policy (New York). 2019;

36. Prados-torres A, Cura-gonzález I, Prados-torres D, López-rodríguez JA. Effectiveness of an intervention for improving drug prescription in primary care patients with multimorbidity and polypharmacy: study protocol of a cluster randomized clinical trial (Multi-PAP project). Implement Sci. 2017; 1–10.

37. Domingo-Salvany A, Bacigalupe A, Carrasco JM, Espelt A, Ferrando J, Borrell C. Propuestas de clase social neoweberiana y neomarxista a partir de la Clasificación Nacional de Ocupaciones 2011. Gac Sanit. 2013;27: 263–272. pmid:23394892

38. O’Halloran J, Miller GC, Britt H. Defining chronic conditions for primary care with ICPC-2. Fam Pract. 2004;21: 381–6. pmid:15249526

39. By the American Geriatrics Society 2015 Beers Criteria Update Expert Panel. American Geriatrics Society 2015 Updated Beers Criteria for Potentially Inappropriate Medication Use in Older Adults. J Am Geriatr Soc. 2015;63: 2227–46. pmid:26446832

40. Gallagher P, Ryan C, Byrne S, Kennedy J, O’Mahony D. STOPP (Screening Tool of Older Person’s Prescriptions) and START (Screening Tool to Alert doctors to Right Treatment). Consensus validation. Int J Clin Pharmacol Ther. 2008;46: 72–83. pmid:18218287

41. Riordan DO, Aubert CE, Walsh KA, Van Dorland A, Rodondi N, Du Puy RS, et al. Prevalence of potentially inappropriate prescribing in a subpopulation of older European clinical trial participants: a cross-sectional study. BMJ Open. 2018;8: e019003. pmid:29567842

42. Delgado Silveira E, Montero Errasquín B, Muñoz García M, Vélez-Díaz-Pallarés M, Lozano Montoya I, Sánchez-Castellano C, et al. Mejorando la prescripción de medicamentos en las personas mayores: Una nueva edición de los criterios STOPP-START. Rev Esp Geriatr Gerontol. 2015;50: 89–96. pmid:25466971

43. Patterson SM, Cadogan CA, Kerse N, Cardwell CR, Bradley MC, Ryan C, et al. Interventions to improve the appropriate use of polypharmacy for older people. Cochrane Database Syst Rev. 2014;10: CD008165. pmid:25288041

44. Muth C, Uhlmann L, Haefeli WE, Rochon J, van den Akker M, Perera R, et al. Effectiveness of a complex intervention on Prioritising Multimedication in Multimorbidity (PRIMUM) in primary care: results of a pragmatic cluster randomised controlled trial. BMJ Open. 2018;8: e017740. pmid:29478012

45. Sevilla-Sánchez D, Molist-Brunet N, Amblàs-Novellas J, Espaulella-Panicot J, Codina-Jané C. Potentially inappropriate medication at hospital admission in patients with palliative care needs. Int J Clin Pharm. 2017;39: 1018–1030. pmid:28744675

46. Kalisch LM, Caughey GE, Barratt JD, Ramsay EN, Killer G, Gilbert AL, et al. Prevalence of preventable medication-related hospitalizations in Australia: an opportunity to reduce harm. Int J Qual Health Care. 2012;24: 239–49. pmid:22495574

47. Zhang X, Zhou S, Pan K, Li X, Zhao X, Zhou Y, et al. Potentially inappropriate medications in hospitalized older patients: A cross-sectional study using the Beers 2015 criteria versus the 2012 criteria. Clin Interv Aging. 2017;12: 1697–1703. pmid:29066875

48. Kim GJ, Lee KH, Kim JH. South Korean geriatrics on Beers Criteria medications at risk of adverse drug events. PLoS One. 2018;13: 1–24. pmid:29543860

49. Cruz-Esteve I, Marsal-Mora JR, Galindo-Ortego G, Galván-Santiago L, Serrano-Godoy M, Ribes-Murillo E, et al. Análisis poblacional de la prescripción potencialmente inadecuada en ancianos según criterios STOPP/START (estudio STARTREC). Aten Primaria. 2017;49: 166–176. pmid:27693033

50. Cahir C, Fahey T, Teeling M, Teljeur C, Feely J, Bennett K. Potentially inappropriate prescribing and cost outcomes for older people: A national population study. Br J Clin Pharmacol. 2010;69: 543–552. pmid:20573091

51. Blanco-Reina E, Ariza-Zafra G, Ocaña-Riola R, Leõn-Ortiz M. 2012 American geriatrics society beers criteria: Enhanced applicability for detecting potentially inappropriate medications in European older adults? a comparison with the screening tool of older person’s potentially inappropriate prescriptions. J Am Geriatr Soc. 2014. pmid:24917083

52. Luo R, Scullin C, Mullan AMP, Scott MG, McElnay JC. Comparison of tools for the assessment of inappropriate prescribing in hospitalized older people. J Eval Clin Pract. 2012;18: 1196–1202. pmid:21883716

53. Pastor Cano J, Aranda García A, Gascón Cánovas JJ, Rausell Rausell VJ, Tobaruela Soto M. Criterios Beers versus STOPP. Posibles implicaciones de la adaptación española de los criterios de Beers. / Beers versus STOPP criteria and the possible implications of the Beers criteria’s Spanish adaptation. Farm Hosp. 2017;41: 130–131. pmid:28045656