Challenges of the Implementation of a Delirium Rate Scale in a Pediatric Intensive Care Unit: A Qualitative Approach

Abstract

Introduction: Delirium in the pediatric population admitted to intensive care is a worrying reality due to its potential complications and the increase in associated costs. This study aims to explore the experiences of nursing staff of a Pediatric Intensive Care Unit after 15 months of starting a program to fight against childhood delirium in their unit. Methodology: A qualitative study was conducted through semi-structured interviews with Pediatric Intensive Care Unit (PICU) Key Informants. The Standards for Reporting Qualitative Research (SRQR) and the consolidated criteria for Reporting Qualitative Research (COREQ) were followed as quality measures for the study. Seven nurses (33% of the eligible population) from the PICU of a referral hospital were interviewed. Text transcripts were analyzed using the Interpretative Description and Qualitative Content Analysis method. Results: The interviewees indicated not identifying delirium as an important reality; with great deficiencies observed in what is related to the identification of delirium; identifying CAPD as an unreliable tool in their unit; and not sharing therapeutic objectives in this respect with the medical staff. Conclusions: The nursing staff presented a series of negative attitudes towards the phenomena of delirium in their unit, with gaps in training and in clinical management, and the diagnostic tool used, and did not see it as a priority objective of the unit, partly due to a resistance to change and a latent interprofessional communication conflict. A change at the formative, attitudinal, and relational levels is urgently needed for the success of the program and the well-being of the children in the unit.

1. Introduction

Delirium is a neuropsychiatric syndrome with decompensation of brain function, characterized by acute cognitive changes, arousal states, motor agitation, dementia in-stability, bradypsychia, among other manifestations [1,2]. The DSM VI considers the diagnosis of “delirium” as an acute alteration of consciousness accompanied by inattention, disorganization of thought, and alterations of perception that fluctuate in a short period of time [3]. The ICD 10 considers delirium with the synonym of “Acute Confusional Syndrome”, as an acute, transitory, global and reversible condition that affects the consciousness of the subject who suffers from it [4].

In the ICU, delirium results from a serious underlying medical condition or side effects of treatment [5].

Delirium in a critically ill adult patient has been recognized as a problem, with a prevalence ranging from 25–87% [6,7,8]. This variability is explained by the different types of patients and pathologies, with age and hemodynamic deterioration as influential factors.

In the pediatric population, prevalence studies published to date show a range between 25% and 69% [9,10,11] of admitted patients. The use of sedative drugs [12] and opioid analgesics has been identified as one of the predisposing factors to the occurrence of delirium in a critically ill pediatric patient as a consequence of the different procedures performed in the unit.

Delirium in both adults and children is associated with a prolonged hospital stay, increased morbidity and mortality, increased workloads, and consequent increased social and health care costs [13], and decreased quality of life for the patient and/or family [14,15,16,17,18].

Among the guidelines provided in 2013 for the management of the impact of delirium in critical patient units, by the Society of Critical Care Medicine [19], an affiliate of the American College of Critical Care Medicine, we find the use of validated tools for the measurement of delirium and pain for its identification, and therefore, for actions in initial phases and identification of predisposing factors.

Among the tools validated for the assessment of delirium in critical pediatric patients, we find the “Cornell Assessment of Pediatric Delirium” (CAPD) [20], the “Pediatric Confusion Assessment Method for the Intensive Care Unit” (pCAM-ICU) [21], and the “Preschool Confusion Assessment Method for the Intensive Care Unit” (psCAM-ICU) [22]. The latter are adaptations for the pediatric population of the Assessment method from the “Confusion Assessment Method for the Intensive Care Unit” (CAM-ICU) [23], originally created for the identification of delirium of critically ill adult patients. All of these versions are presented in their original versions, as well as versions adapted to other languages, such as Spanish [24,25,26], which eases their use and their independent application within the cultural context of the present study.

Nevertheless, the use of tools such as the CAM-ICU or CAPD by health professionals requires a strong orientation towards the identification of the problem, which implies a change of attitude towards it, and the applicability of the tool: how it will be utilized, the definition of the process of identification and recording of the basal mental state, and the definition of how the documentation will be crafted [27].

Despite this significance, health professionals [28] feel that delirium is a complex situation of a patient who needs care, but do not perceive it as an urgent condition that must be resolved immediately, which results in variable management strategies.

Intensive care nurses are recognized as nurses with skills and opportunity to apply these tools, given their presence at the bedside of the patient, and the possibility of recording the changes in behavior of patients with delirium [29,30]. Likewise, the fact that the diagnostic instruments be validated and possess excellent psychometric qualities make their use possible by any health professional [31].

Considering the above, and the recommendations from the Society of Critical Care Medicine and the Spanish Society of Pediatrics, in January 2020, a program of early detection and care of delirium was implemented within the Pediatrics ICU at our hospital. At the start of the program, no previous data was available with respect to the prevalence of delirium in our unit, given that the use of the detection tools was not systematic with all the children admitted.

The program was designed considering the pediatricians belonging to the unit. It was based on the systematic application of the delirium scale CAPD to all the children admitted to the unit, independently of their pathology or treatment. The application was performed by the nurse caring for the child, at admittance into the unit, and posteriorly in a routine manner every 12 h and/or when a change in the child’s behavior was observed. The scale had to be administered by the nurse responsible for the care of the child during working hours. Thus, it was listed as an additional task in the routine care of the child. This tool was integrated into the Phillips-IntelliSpace Critical Care and Anesthesia^® (ICCA^®) program, for its computerized recording by the nurse.

Data analysis at 6 and 12 months after application was established as control and follow-up points. The implementation of the protocol was not agreed-upon with the nursing staff, and no specific training was provided on the use of the selected tool. Nevertheless, all the health professionals were aware of the existence of the tool.

The emergence of the COVID-19 pandemic resulted in the lack of consideration of the control points expected for June of 2021. In January 2022, a data analysis was performed, which indicated the presence of delirium in 56% of the children admitted. Nevertheless, it was only implemented in 45% of the patients admitted, so that the data were not concluding, with respect to the prevalence of delirium in the unit. At the time of the study, the completion of the CAPD tool is still an obligatory requisite as part of the care of children admitted to the unit.

Given the data collected, and the worrying low completion of the scale, the objective of the study was to identify the attitudes, values, and beliefs of the pediatric ICU nursing personnel towards the program of detection of acute delirium in treated children, and the use of the delirium diagnostic tool.

2. Materials and Methods

2.1. Study Design

The research is based on semi-structured interviews with key Informants in the intensive care unit. The analysis of this qualitative study is based on an Interpretive Description (ID) [32] to understand the work of nurses in the Pediatric Intensive Care Unit (PICU). ID research describes and interprets a phenomenon, considers the meaning of related behaviors, and admits reality as socially constructed, and that reality involves multiple constructed realities, while also recognizing that experimenter and party influence one another. ID studies provide a thematic description of a phenomenon of interest [33], in this case, to identify the impressions and experience related by the nursing staff about the phenomenon of delirium in pediatric patients attended in the intensive care unit.

ID, which is widely used in the qualitative exploration system within nursing, offers an accessible and theoretically flexible approach to analyzing qualitative data within the exploration of the phenomena studied. ID is a methodological approach applicable to the exploration of healthcare professional education, as it can address complex existential questions and at the same time raise practical questions.

The performance and reporting of this study were guided by the Standards for Reporting Qualitative Research (SRQR) [34] (See it at Supplementary Materials S1). In addition, the authors followed the guidance offered by the Consolidated Criteria for Reporting Qualitative (COREQ) research checklist (See it at Supplementary Materials S2) [35].

2.2. Setting and Context

Our hospital has a multi-purpose, level III Pediatric Intensive Care Unit, able to tend to 13 children aged between 0 and 18 (according to the pathology). This ICU is considered first-class for the treatment of children in the Region of Murcia (Spain), which has a population of 1.5 million people. The rate of bed occupation is 87% during the year, and it employs 25 registered nurses (RN) and 4 pediatricians specialized in pediatric intensive care. All of the nurses who work in this unit are specialized in children’s nursing, as stated in the current legislation on health professionals in Spain [36]. The unit has a Phillips-IntelliSpace Critical Care and Anesthesia^® (ICCA) computerized system for recording the clinical history and medical and nursing treatment of admitted patients, which speeds up the documentation and communication between the different health professionals.

2.3. Sample

The sample consisted of nursing staff belonging to the PICU of a first-class hospital in southeastern Spain. Participants were recruited by convenience sampling through the Snowball sampling method. Snowball sampling can be used effectively to analyze vulnerable groups or sensitive or socially questionable situations [37]. Researchers often start with a small number of initial contacts that fit the research criteria and use the social contacts from this initial set to increase the number of research subjects [38].

We understand a “Key Informant” (KI) as a person who possesses exceptional knowledge of a situation, given their personal skills or position within a society, and can provide further information and insight of what is occurring around them [39].

As inclusion criteria, we considered the participants who work as registered nurses in the unit for at least three years, as they are considered KI. No exclusion criteria were defined. At the end of the interview, each KI provided two names of persons belonging to the unit who met the inclusion criteria, thus complying with the snowball sampling system.

The study was carried out in a first-class PICU for a population of approximately 1.5 million inhabitants, with 13 multi-purpose beds, where children with critical pathologies from 21 days of life to 14 years of age are cared for. The nursing staff comprised a total of 25 nurses specialized in pediatrics, together with 10 auxiliary nursing care technicians (healthcare assistants), and 8 pediatricians specialized in critical care. More than 80% of the nurses working in this unit have the title of “Nurse Specialist in Pediatrics”, as recognized by the Spanish Ministry of Health. More than 80% (N = 21) of the nurses in this unit have more than 3 years of continuous experience in the unit.

In qualitative research, the number of subjects is adjusted according to data saturation [40,41]; data saturation is the term used to describe the phase of data collection in which no further information emerges from subsequent collection efforts, meaning that continuing to explore more themes does not provide modification of the data already obtained.

The current evidence has not reached a consensus on the minimum number of subjects to reach saturation, with reports indicating that 4–6 key informants are sufficient [42], while others increase this number up to 12 [43].

After the data collection process, seven nurses were selected as research subjects. They represented approximately 33% of the total PICU nurses analyzed.

2.4. Data Collection

A qualitative, semi-structured interview was conducted (Supplementary Materials S3). The interviews focused on how the nurses understood delirium in child patients admitted to their unit, the use of any tools for its termination, their degree of acceptance of its use, and difficulties inherent in its use.

The interview script [44] was created based on the purpose of the research and the literature review, and included the following four main axes summarized in the following topics: (1) What do you think about the phenomenon of delirium in children in your unit? (2) Do you believe that its incidence is higher in recent times; Why? (3) As a nurse, do you have any kind of tool to combat this phenomenon? (4) Do you feel that working against delirium is a multi-professional objective in your unit? Do you feel involved as a professional or is it something outside your work as a nurse? (5) Do you have sufficient training and skills to care for children with delirium? Do you feel confident in your professional skills to identify and handle a child with delirium? (6) Concerning the experience you have had following the care of a child with delirium, do you have any other thoughts you would like to share with me? This interview script was not tested previously. It was only checked by the senior researcher of the research group.

Before interview, the research team (ARR & PBM) contacted the proposed research subjects and arranged a suitable date and time for the interview, after explaining the procedure to follow and the objectives of the study to them. Contact was conducted face to face.

The interviews were performed during the professionals’ working day, using time slots with low work-loads in an environment with adequate privacy and sound conditions. Their information was collected in a location inside the PICU itself, where private information is usually exchanged between the parents of the children admitted and the healthcare staff, using respiratory protection measures (face mask), as required by the post-COVID pandemic situation and the clinical environment where the interview was carried out. The minimum distance measures were maintained, and physical contact was avoided between the interviewer and the interviewee.

The nurses were interviewed by the first author. The interview was carried out only once for each interviewee, without interruptions. The interviewer was present at all times, no other person was present during the interview, and there were no repeat interviews. The session began with a welcome to the participant, followed by the reading and signing of the informed consent form. The interview began with initial questions about the participants’ work, followed by the central themes. The participant could stop the interview at any time if they were uncomfortable. Participants were informed of the option to withdraw their testimony from the study at any time until their data were included in the analysis phase. No selected nurse renounced participation.

All the interviews were conducted throughout the month of June 2021 (1–30 June 2021) and lasted between 45 and 150 min.

The interviews were audio-recorded and transcribed by the research team. The investigator took field notes to support the discourse of the interviewer. The transcripts were supplemented by the field notes taken by the interviewer. The interviewees were coded with the acronym NUR followed by the interview number temporarily. In this way, the subject interviewed first was coded with the code “NUR1”, the second with “NUR2”, and so on. This coding allows the data to be analyzed on the basis of the interview order, so that the timing of data saturation could be precisely adjusted. The identity of the interviewees was not transferred to the transcripts texts; only age, gender, length of time working as a nurse, and length of time spent in the PICU were collected as personal variables, with the intention of providing qualitative aspects of the sample analyzed.

Neither the transcripts nor the codes were reviewed by the interviewees.

2.5. Data Analysis

Four researchers were involved throughout the collection and analysis process to ensure the reliability and objectivity of the process. Two of them (RMG & AMY) have a Master’s degree in nursing, as well as a specialization in pediatric nursing, and experience in the unit where the study was carried out. The third (PBM) was in the process of obtaining a Master’s degree in nursing. Finally, the process was supervised by a researcher (ARR) with first-hand knowledge of the situation in the study unit, experience in qualitative research methodologies, and a PhD degree.

The analysis was carried out using a Qualitative Content Analysis Method (QCA) of the transcribed discourse [45]. The QCA method is defined as “the systematic reduction of content, analyzed with special attention to the context in which it was created, to identify themes and extract meaningful interpretations of the data [46] (p. 361)”.

The two-phase, eight-step process associated with conducting a QCA [44] was followed; in phase 1 (data generation), the same researcher (PBM) who conducted the interviews listened to the interviews several times, transcribed and typed them, including interpretative aspects such as gestures, emotional aspects of the interviewee, and the researcher’s perceptions during the interview. In phase 2 (data analysis), another two researchers (RMG & AMY) monitored the categories found in phase 1, analyzed the relationships between the different categories and established the contextual interpretations and implications of the testimonies collected. The entire process was supervised by the researcher (ARR) with experience in qualitative methods.

Discrepancies that arose in the process of coding and/or interpreting the codes were resolved through a group discussion of the four researchers responsible for the analysis. The research questions were taken as initial themes or categories and formulated as preliminary hypotheses. The definitions of the initial categories and themes were discussed with all authors to arrive at a final version.

No software was used for the technical coding and classification of the data.

2.6. Trust and Reliability Strategist

We ensured the rigor of the data analysis with the three researchers working independently in the initial phases of the process; the data were extracted and coded (phase 1) by a researcher who was not involved in the conceptual phase, avoiding possible contamination of the process. Phase 2 was carried out by two researchers in parallel and independently, who were familiar with the reality of the situation under study. After the completion of phase 2, the results of the analyses were discussed as a group by the three researchers, together with the senior researcher, identifying overlapping interpretations and reaching consensus on diverging interpretations [47].

We understand that this process ensures that the data analysis was not contaminated by qualitative research biases such as observational bias. In addition, the use of the SRQR and COREQ guidelines ensured that the research process was validated.

2.7. Ethics Approval and Consent to Participate

Ethical approval for this study was obtained through the Ethics Committee of the Catholic University of Murcia (UCAM), protocol report number CE06211. The participants gave their informed consent in person by signing a consent form and through verbal consent recorded at the beginning of the interview. No participants withdrew from the study. To maintain participant confidentiality, the participants were coded in order of interview, with an alpha-numeric code identifying the category and order.

3. Results

Seven nurses were interviewed in the selected study period (see Table 1 for characteristics). Their average age was 32.5 years (25–42), with an average experience of 11 years (4–23), and an average experience in the PICU of 7 years (1–15). All the participants were female; all of them were pediatric nurse specialists; but 70% of them obtained the specialization of pediatric nursing through the specific training program of Resident Internal Nurse, according to the current Spanish legislation. Those who did not take part in this training program obtained this recognition given their experience in the unit.

A total of 15 code categories were identified, grouped into four main themes; some categories were emergent while others were raised in the interview script. (Table 2 for an overview). The themes will be described below, using quotes to illustrate the interviewees’ experiences.

3.1. Childhood Delirium in the PICU

This theme describes the experiences and impressions of the participants about the central theme of the study. This theme captures an important core of issues, which raised a priori. The general impression of the participants is that the number of children diagnosed with “delirium” has been increasing over time, especially in the last year (2021).

“…it is fashionable; there is no child who has been with us for a while, for whatever reason, who is not labeled as having delirium”.

NUR 6

“…it seems to be fashionable”.

NUR 2

“…I have never seen as many children diagnosed with delirium,…as I have seen so far”.

NUR 7

“I hadn’t heard the word delirium for at least a year and a half or two years,…… I heard kids with “withdrawal”, taking methadone and stuff. I don’t think I saw any hypoactive delirium either. They were all clear withdrawal syndromes. So I think there’s been some change in the way we diagnose or something,…. Or what used to be called Withdrawal Syndrome is now called delirium.

NUR 3

The participants understand this fact as a diagnostic desire from the doctors rather than the real existence of the symptoms. They understand that it is a disproportionate interest that overestimates the presence of delirium, when what the child truly has is a process of dehabituation to morphine-derived drugs. It is therefore clear that nursing professionals are not involved in the diagnosis of this condition.

“…it is not possible that depending on the doctor on duty, children are classified as delirious, and if there is another doctor, they are not. Perhaps it is because one has a perception that the other does not, and that is why there are more deliriums now than before….. when the children are in the same situation”.

NUR 6

“Nursing professionals must be taken into account because we are with the child 24 h a day,… but we cannot establish a diagnosis; that is the doctor’s job”.

NUR 3

“we can tell the doctor what we think about the diagnosis of delirium in a child… but it is up to him (or her) to label it or not”.

NUR 2

Regarding the identification of the patient with delirium, some testimonies identify situations compatible with delirium,

“For me, … a child with delirium, …well, it is a child who has been sedated, who has just woken up and is conscious but is not connected. He is therefore looking up a lot. He doesn’t communicate well and that’s why he cries and is nervous…”.

NUR 6

In terms of treatment, the use of pharmacotherapy is the main pillar on which the interviewees state that the unit’s doctors treat delirium. Comfort or non-pharmacological measures are left to the initiative of the nurses working at the time and are not related to the identification or not of the child as a patient with delirium, but rather to general or preventive measures.

“Delirium is treated with medication prescribed by the doctor. Normally with levomepromazine”.

NUR 1

“I think they put him on Sinogan. Basically. I don’t know if they put him on something else. I think… dexmedetomidine”.

NUR 5

“Well, we try to make them feel as comfortable as possible. But I don’t distinguish between those who have delirium and those who don’t. I think it’s good for all children, a quiet environment, with little noise, and the parents present with them. It calms them down”.

NUR 3

“If we can do something… And we have time. So… we do those things too”.

NUR 6

3.2. Childhood Abstinence Syndrome in the PICU

This theme emerges as a category in the discourse of several interviewees. One is seen as an error in the identification of one diagnostic label with another. The nursing professionals understand that most of the children diagnosed with delirium are suffering from withdrawal syndrome derived from the use of morphine-derived medications in children in hospitals.

“Perhaps we lack more information or more understanding of the difference between delirium and withdrawal syndrome. I don’t see it very clearly nowadays”.

NUR 5

“There is a bit of confusion as to what is or isn’t delirium. That is confused with what is withdrawal syndrome”.

NUR 2

“All children who used to have withdrawal syndrome and now what is called delirium. Normally hypoactive, which is true that we didn’t see it before,…… Of course, that’s what it is for me, in the other (hyperactive delirium) it would be difficult to differentiate it from withdrawal syndrome. For me. I haven’t received any training”.

NUR 1

“And from a year ago, a lot of children have been seen… …Yes, there is a difference between withdrawal syndrome and hyperactive syndrome. Because I do notice that some tremors and things are different from withdrawal, and the other way around. The hypoactive one, you can see that the child is… that he doesn’t move, he’s looking at the moon… And you can see that it’s something”.

NUR 3

“The concepts are not clear. In fact, not even for them. Because of the doctors, there are eight who still talk about withdrawal syndrome and there are two who are in charge of delirium and are the ones who diagnose it”.

NUR 6

3.3. Use of Diagnostic Tools

Another issue to be highlighted in the interviews is the use of scales for the detection of delirium in the pediatric patient. Of the multitude of scales that have been validated for the detection of delirium in the pediatric population [31], all the nurses interviewed indicated that the specific scale for delirium is the Cornell Assessment of Paediatric Delirium (CAP-D). Although this scale is adapted to the specific nursing role, all interviewed nurses state that the tool has a high inter-observer variability, which depends on the subjectivity of the observer, and the characteristics of the individual patient. In addition to this criticism, based on their own experience, the nurses also point out that there is a lack of knowledge among the nursing staff about the use and handling of the scale in particular, and about delirium in general.

“I have to apply the delirium scale to a girl who is intubated, sedated and relaxed. So I’m not going to be able to answer most of the things. What’s going to come out of it? It’s not assessable.”

NUR 1

“Sometimes the parameters that are asked are not appropriate for all age groups”.

NUR 3

“Well, … I don’t see them (delirim scale) as an objective tool at all. I don’t know how to assess … I don’t know what score to give the child, …?”

NUR 6

“The delirium scales you have to make them up because you can’t complete them if you don’t make them up. Because they are not real. That’s what I think.”.

NUR 5

“For me that tool is useless. It’s that, really, it’s also very … never, rarely, such … I mean, I think that’s what I think. Maybe their mother, who is at the bedside, can give you an answer, and she will also be wrong”.

NUR 4

The interviewees state that there are no criteria to use the scale; in their clinical setting, it is indicated by the pediatricians that the delirium detection scale is applied for all patients without distinction. However, they add that nursing should take part in the decision on whether to implement the scale, as there are occasions when it would not be necessary due to the absence of risk factors in the patient. They feel left out of such decisions and are merely executors of doctors’ orders.

“While the study was being carried out, it had to be done systematically to all children, even if they had a catheterisation, and they didn’t need so…beasuse the child was aware…”.

NUR 5

“It goes like a packet. Just as if they (the doctors) order us to put a nasogastric tube into the child, they order us to assess the delirium scale. But it is not necesary … We know when the delirium scale should be applied to a child, and when it is not needed …. We know what a valid measurement is, and when it is not”.

NUR 1

“We have the right to decide that this child doesn’t have to pass the delirium scale, because he doesn’t have delirium. He is not taxed and others are”.

NUR 2

3.4. Professional Training

The training of nursing staff in delirium is a key aspect for providing quality care. The team that was interviewed indicated that they had little training on the subject and that the information received from the unit was scarce.

So they (…the doctors…) have started to train themselves, they introduce the scales to us and from there they get into training that we…they don’t take into account.

NUR 3

Maybe we have little training on delirium. Nowadays, this subject is more in vogue, and I do think it is important to deal with it. But I think we need a bit more… We need to know what delirium is and how it is treated.

NUR 1

Nothing has been explained to us. We have a video there, which they play it for us to watch, but apparently it couldn’t be opened. I asked recently and he told me that yes, I could watch it, but in the end we haven’t tried it. But it wasn’t training either, it was just a video. Here. You know?

NUR 3

4. Discussion

The present study helps us to better understand the experiences of nurses working in the PICU regarding the phenomenon of delirium in the critically ill pediatric population cared for in these units. The multidimensional nature of this pathology makes nursing work crucial in both management and diagnosis [48].

If we consider the low quality of the data obtained in relation to the low degree of completion of the CAPD records, they are not surprising. The fact that the COVID-19 pandemic burst into the area of healthcare at that time could have affected the implementation of detection measures against delirium, as it diverted the attention of all healthcare providers to other, higher-priority areas. However, the incidence of COVID patients in the unit was lower than in the adult units. The National Epidemiological Surveillance Network of Spain [49] indicated that only 0.6% of pediatric patients affected by COVID (positive in a detection test and with symptoms of the illness) required hospital admission, and of these, only 5.2% were admitted to the ICU, with these figures being much lower in relation to those obtained in the adult population. For this reason, we consider that the impact of COVID-19 does not justify not completing the detection records; on the contrary, if it had been carried out, it could have contributed to linking the presence of delirium in the child with COVID-infected children admitted to the ICU.

Some authors point out that despite international recommendations on the impact and measures to be considered to prevent delirium in critically ill patients, both in adult and pediatric patients, the use of these measures, especially the use of validated diagnostic tools, is very limited. Patel [50] conducted a survey of 1384 professionals from various ICUs in North America and revealed that more than half of them (59%) assessed their patients for delirium, although only 20% used a valid evaluation tool. Luetz [51] investigated the implementation rate of delirium monitoring in several hospitals through anonymous surveys and questionnaires, with similar results (a 27% implementation rate of delirium assessment with a validated tool).

The recorded testimonies indicated that the nurses in this PICU identified that behavioral problems similar to delirium already existed before starting this program, which was nothing new. They indicate that the label “Delirium” is not entirely appropriate, and that the phenomenon is exaggerated, not agreeing with the use of this diagnostic label; that the indiscriminate use of delirium detection tools is “absurd” and a “waste of time”. For most of the interviewees, the diagnostic label of delirium was, in fashion, associated with medical approaches, and not a reality that they had to tackle. Delirium was not highlighted as a concern that nursing must address imminently.

In this sense, their opinions towards the phenomenon of delirium and the use of identification scales coincide with previous studies [52,53] that analyzed the application by intensive care nurses of pain, agitation, and delirium scales, finding that only 41% felt comfortable or very comfortable with the use of delirium measurement tools, as compared to the use of pain and agitation scales that showed satisfaction figures greater than 80%. Likewise, they indicate that delirium only represents a priority concern for 3% of critical care nurses.

As in previous research [54,55], they do not trust delirium detection tools, they do not feel comfortable with their use, they consider them arbitrary, and they report that their application has not been agreed upon with them, that it has been imposed. That is why they do not feel it as a shared measure, but as an obligation.

Despite the reluctance shown by the nurses interviewed in relation to delirium and the use of detection scales, our interviews point out the importance they attach to the management of environmental and/or family factors as preventive measures, as indicated by the evidence [56,57,58,59]. However, this care is not provided as specific and intentional care against delirium, but rather as measures of comfort or well-being for the child.

Several studies [60,61], indicate a high overall sensitivity of 94.1% (95% CI, 83.8–98.8%) and a specificity of 79.2% (95% CI, 73.5–84.9%), with a Cronbach’s α of 0.90, with a range of 0.87–0.90 for each of the eight items, indicating good internal consistency, a positive predictive value of 90% (95% CI, 79–97%), and a negative predictive value of 91% (95% CI, 80–97%). However, for inter-observer validity in the nursing population [62], the kappa coefficient between nurses was 0.60 (95% CI 0.44–0.76), indicating low to moderate agreement. The inter-observer reliability is especially low in the youngest infants (under 9 weeks), where the indices decrease to an ICC of 0.59 (95% CI 0.44–0.71), or in mechanically ventilated infants, where the ICC was 0.5 (95% CI 0.34–0.65). The Fleiss kappa for all infants was 0.47 (95% CI 0.34–0.6), which is a mild to fair agreement [63]. A study examining the validity of the CAP-D in children older than 6 months found mild to moderate agreement between the bedside nurse and the reference standard, with a kappa of 0.4 (95% CI 0.26–0.54) and a higher likelihood of discordant results when patients were younger (odds ratio [OR] = 1.1, 95% CI 1–1.2) and received some form of sedation ([OR = 4.1, 95% CI 1.5–11.5) [64].

Ultimately, these studies confirmed the reluctance shown by the interviewed personnel towards the use of the selected tool.

However, we must remember that reliability is not a fixed property of a measurement tool, but a product of the interactions between the tool, the subjects and the context of the evaluation, with the training of the observers being of special relevance in the use of the tool and its different variations as a strategy to increase the inter-observer reliability of the tool. In our case, this was not properly attended to, and the tool was selected without the “conviction” of those who should apply it, and without specific training on how to use it. All of this resulted into variations in observations, distrust in the tool, and disaffection with the detection program.

The problem regarding the knowledge and attitudes of health personnel, especially nurses towards the phenomenon of delirium, is common, and has been shown by some research, both in children [65,66,67] and adults [68,69], and intervention programs to have provided positive responses and changes in attitude and knowledge in the professionals involved [70,71].

As we find ourselves in a complex socio-work environment, the hypothesis of “resistance to change” in the nursing staff of the unit cannot be ruled out. While resistance has been considered a major barrier to the implementation of successful practice change in the popular literature, specific evidence on how it is a barrier within healthcare organizations is lacking [72]. However, resistance is a normal response to a threat to the baseline status quo. Nurse leaders prepared with knowledge of resistance, including background and attributes, can minimize the potential negative consequences of resistance and capitalize on the powerful impact of adapting to change.

This phenomenon is not new when dealing with changes in the nursing work structure. It has been estimated that more than half of all organizational change projects are unsuccessful [73].

Even in the presence of evidence in favor and the goodness of new care practices, some nurses may be reluctant to implement them or to have positive attitudes toward them.

Among the justifications for this phenomenon, we find rapidly changing regulatory requirements, technological innovation, and a constant flow of new information and knowledge that may present nurses with challenges they are reluctant to embrace.

Individuals fear the unknown and even experience a kind of loss associated with change, an increase in personal demands that they are unwilling to take on. Mistrust of leaders, lack of communication, or lack of clarity in group goals and objectives fuel the phenomenon, further increasing resistance to change [72].

Among the justifications that are provided in the evidence to show resistance to change, we find traditional ways of working that work well (“we have always done it this way without problems… I was trained this way…this is how we do things here…”) lack of confidence in the evidence shown in favor of change (“I do not trust the evidence…. We do not believe it makes a difference…”), and lack of time (“we cannot make so many changes at once… We are in a hurry… we are short of time…”) [73].

For changes to be accepted, there needs to be a “change agent”. When nurses are part of the decision-making process, organizations are much more likely to turn “enemies” into allies, and, at the same time, decrease the general anxiety around change [74].

More effective strategies include the application of the techniques or assistance protocols in a tutored manner at the outset, adequate and prompt training programs, visual guides or tutorials with the new procedures, etc. In addition, management and leadership positions can implement “pep-talk” groups or meetings, where staff can talk about the evidence for change and discuss the benefits or drawbacks of new practices.

Therefore, we can sense that while resistance to change is a common problem for care teams facing a new task that is seen as a “burden”, it is the responsibility of management and leadership teams to manage the incorporation of new practices with safe strategies to avoid this phenomenon. In short, motivating and training staff is one of the keys to success.

Regarding the apparent confusion shown by the interviewees between delirium and withdrawal syndrome observed in children, due to the use of opioid drugs (Iatrogenic), this is not strange, but rather a frequent one among clinicians. Both of them are not mutually exclusive, and can coexist in the same patient at the same time, especially for hyperactive delirium [75]. The rating scales of both diagnostic labels have common aspects with considerable overlap [76]. This may be due to a deficient degree of knowledge regarding these different diagnostic labels, and their defining causes and forms of identification [77].

As limitations, we recognize that this study was conducted in a single PICU of a public hospital in the southeast of Spain. Therefore, the findings of this study may not be the same as those found in other hospitals around the country. That is why studies based on mixed-type methodologies, with the inclusion of a representative sample from other centers, are necessary to reaffirm the findings, or to consider them as a local phenomenon.

For reasons of time pressure, the transcribed testimonies were not given back to the interviewees, so that they could corroborate their testimonies as true or modify what was reflected in the transcripts them in some manner. This is a practice that contributes to the process of transparency and truthfulness of qualitative research, and should be implemented as a good practice measure. In our case, it was not performed. However, the impartiality of the researcher transcribing and analyzing the interview data in the first phase was maintained throughout the process.

Finally, we understand that the non-use of specific qualitative analysis software limited the possibility of specific analysis of interview text, such as the “word cloud”. This tool helps us, in a visual and clear way, to understand what the subject feels about a topic/situation, as it allows them to summarize their view of a topic, and key words emerge on the surface.

5. Conclusions

In the hospital unit studied, we found negative attitudes, values, and beliefs of the PICU nursing staff towards infant delirium, especially towards the use of the measurement instruments used (DPCA), and the manner in which the action program was implemented. These negative attitudes partly explain the failure of the delirium detection program implemented in the unit.

It has been shown that there is a detachment of the PICU nursing staff towards the phenomenon of delirium, among other things, due to the lack of training in this regard, conceptual confusion (withdrawal syndrome with hypoactive delirium), and interprofessional conflicts (doctors-nurses).

The actions carried out in the delirium detection program were seen by the nursing professionals of the unit as measures imposed by the medical community, not thinking of them as a priority of care for the sick child. Early detection of delirium is not assumed to be a priority in their work as nurses.

These results are consistent with diverse evidence that indicates that the success of an intervention program depends on the choice of the correct tool, the adequate training of professionals, teamwork, and the joint mission, all carried out prior to the implementation of corrective measures. This did not occur in the investigated context.

Thus, the challenges when implementing a delirium detection program start from aspects such as staff motivation, sharing common therapeutic objectives among all professionals involved, regardless of their category, specific training, and continuous support. All of this assumes the ultimate responsibility of both the nurses responsible for applying the measures and the program managers.

Author Contributions

Conceptualization, P.B.-M., G.M.M.-R. and A.R.-R.; Methodology, A.R.-R.; Investigation, P.B.-M., R.M.-G. and A.M.-Y.; Data curation, P.B.-M., R.M.-G. and A.M.-Y.; Writing—original draft, P.B.-M. and M.B.-M.; Writing—review and editing, M.B.-M.; Supervision, A.R.-R. All authors have read and agreed to the published version of the manuscript.

Institutional Review Board Statement

The study was conducted according to the guidelines of the Declaration of Helsinki, and approved by the Ethics Committee of the Catholic University of Murcia (UCAM), protocol code number CE06211, approved on 9 January 2021.

Informed Consent Statement

Informed consent was obtained from all subjects involved in the study.

Data Availability Statement

The data are available within the article.

Conflicts of Interest

The authors declare no conflicts of interest.

Footnotes

Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Tables

Table 1

Characteristic of the sample.

ID	Age(Years)	Nursing Experience(Years)	PICU Experience(Years)	Adult ICU Experience(Years)	Specific Training Pediatric Nurse
N1	26	4	1	No	Yes
N2	25	4	1	No	Yes
N3	28	8	3	No	Yes
N4	35	13	6	No	Yes
N5	37	13	7	No	Yes
N6	35	14	15	Yes	No
N7	42	23	15	Yes	No

Table 2

Main Codes and Themesc.

	First Order Codes	Code Definition	Main Themes
1	Specific Training Delirium for Nursing	Expressions related to nurses’ training on the subject of delirium are included here.	Training of professionals
2	Specific Training Delirium for Medicine	The expressions of the nursing professionals regarding the specific training of doctors on the subject of delirium are included here.
4	Diagnosis of Delirium	The different definitions of delirium according to the opinion of the professionals are included here.	Childhood Delirium in ICU.
5	Definition of Delirium	The different comments defining delirium and describing its characteristics according to the participants are included in this code.
6	Pharmacological Treatment of Delirium	Comments referring to the different drugs used to treat delirium are included in this code.
7	Non-pharmacological Treatment of Delirium	This category includes activities and measures used for the non-pharmacological treatment of patients with delirium.
8	Delirium Incidence	It collects the incidence data according to sex and age of delirium in the unit’s patients.
9	Delirium Prevention Measures	Collects the activities carried out by the nursing team for the prevention of delirium in patients.
10	Delirium Registry	Collects the additional resources used to record delirium, the characteristics of delirium in each patient, as well as extra data that could be relevant.
11	Treatment Withdrawal Syndrome	Pharmacological measures used for treatment.	Abstinence Syndrome in ICU.
12	Withdrawal Syndrome Symptoms	This category collects the symptoms of withdrawal syndrome that can be observed in patients.
3	Confusion between Withdrawal Syndrome and Delirium	Nurses’ expressions and ideas about the confusion between Withdrawal Syndrome and Delirium.
13	Limitations Scales	They describe the drawbacks and limitations of the scales used to measure delirium.	Use of Diagnostic Tools.
14	Criteria for Passing Scales	The indications and situations in which these scales are used, as well as the nursing staff’s own criteria, are included.
15	Validity Scales	The opinions of nursing professionals on the validity and reliability of the scales measuring delirium are included.

Supplementary Materials

The following are available online at https://www.mdpi.com/article/10.3390/healthcare12010052/s1, Supplementary Materials S1: SRQR-Checklist; Supplementary Materials S2: ISSM-COREQ-Checklist; Supplementary Materials S3: Semi-Structured Individual Interview Script.

References

1. Silver, G.H.; Kearney, J.A.; Bora, S.; De Souza, C.; Giles, L.; Hrycko, S.; Jenkins, W.; Malas, N.; Namerow, L.; Ortiz-Aguayo, R. et al. A Clinical Pathway to Standardize Care of Children With Delirium in Pediatric Inpatient Settings. Hosp. Pediatr.; 2019; 9, pp. 909-916. [DOI: https://dx.doi.org/10.1542/hpeds.2019-0115] [PubMed: https://www.ncbi.nlm.nih.gov/pubmed/31662421]

2. Smith, H.A.; Brink, E.; Fuchs, D.C.; Ely, E.W.; Pandharipande, P.P. Pediatric delirium: Monitoring and management in the pediatric intensive care unit. Pediatr. Clin. N. Am.; 2013; 60, pp. 741-760. [DOI: https://dx.doi.org/10.1016/j.pcl.2013.02.010] [PubMed: https://www.ncbi.nlm.nih.gov/pubmed/23639666]

3. American Psychiatric Association. Diagnostic and Statistical Manual of Mental Disorders; 4th ed. Text Revision American Psychiatric Association: Washington, DC, USA, 2006; [DOI: https://dx.doi.org/10.1176/ajp.152.8.1228]

4. Ely, E.W.; Siegel, M.D.; Inouye, S.K. Delirium in the IntensiveCare Unit: An under-recognized syndrome of organ dysfunction. Semin. Respir. Crit. Care Med.; 2001; 22, pp. 115-116. [DOI: https://dx.doi.org/10.1055/s-2001-13826] [PubMed: https://www.ncbi.nlm.nih.gov/pubmed/16088667]

5. Salluh, J.I.; Sharshar, T.; Kress, J.P. Does this patient have delirium?. Intensive Care Med.; 2017; 43, pp. 693-695. [DOI: https://dx.doi.org/10.1007/s00134-016-4527-9] [PubMed: https://www.ncbi.nlm.nih.gov/pubmed/27620296]

6. Devlin, J.W.; Skrobik, Y.; Gélinas, C.; Needham, D.M.; Slooter, A.J.; Pandharipande, P.P.; Watson, P.L.; Weinhouse, G.L.; Nunnally, M.E.; Rochwerg, B. et al. Clinical Practice Guidelines for the Prevention and Management of Pain, Agitation/Sedation, Delirium, Immobility, and Sleep Disruption in Adult Patients in the ICU. Crit. Care Med.; 2018; 46, pp. e825-e873. [DOI: https://dx.doi.org/10.1097/CCM.0000000000003299] [PubMed: https://www.ncbi.nlm.nih.gov/pubmed/30113379]

7. Brown, C.H., IV; Laflam, A.; Max, L.; Lymar, D.; Neufeld, K.J.; Tian, J.; Shah, A.S.; Whitman, G.J.; Hogue, C.W. The Impact of Delirium After Cardiac Surgical Procedures on Postoperative Resource Use. Ann. Thorac. Surg.; 2016; 101, pp. 1663-1669. [DOI: https://dx.doi.org/10.1016/j.athoracsur.2015.12.074] [PubMed: https://www.ncbi.nlm.nih.gov/pubmed/27041454]

8. Ouimet, S.; Kavanagh, B.P.; Gottfried, S.B.; Skrobik, Y. Incidence, risk factors and consequences of ICU delirium. Intensive Care Med.; 2007; 33, pp. 66-73. [DOI: https://dx.doi.org/10.1007/s00134-006-0399-8]

9. Traube, C.; Silver, G.; Gerber, L.M.; Kaur, S.M.; Mauer, E.A.; Kerson, A.B.; Joyce, C.; Greenwald, B.M. Delirium and Mortality in Critically Ill Children: Epidemiology and Outcomes of Pediatric Delirium. Crit. Care Med.; 2017; 45, pp. 891-898. [DOI: https://dx.doi.org/10.1097/CCM.0000000000002324]

10. Ista, E.; van Dijk, M. High Incidence of Pediatric Delirium in PICU; Time for Action!. Pediatr. Crit. Care Med.; 2020; 21, pp. 96-97. [DOI: https://dx.doi.org/10.1097/PCC.0000000000002166]

11. Holly, C.; Porter, S.; Echevarria, M.; Dreker, M.; Ruzehaji, S. CE: Original Research: Recognizing Delirium in Hospitalized Children: A Systematic Review of the Evidence on Risk Factors and Characteristics. Am. J. Nurs.; 2018; 118, pp. 24-36. [DOI: https://dx.doi.org/10.1097/01.NAJ.0000532069.55339.f9]

12. Patel, A.K.; Biagas, K.V.; Clarke, E.C.M.; Gerber, L.M.; Mauer, E.; Silver, G.; Chai, P.; Corda, R.M.; Traube, C. Delirium in Children After Cardiac Bypass Surgery. Pediatr. Crit. Care Med.; 2017; 18, pp. 165-171. [DOI: https://dx.doi.org/10.1097/PCC.0000000000001032] [PubMed: https://www.ncbi.nlm.nih.gov/pubmed/27977539]

13. Traube, C.; Mauer, E.A.; Gerber, L.M.; Kaur, S.M.; Joyce, C.; Kerson, A.B.; Carlo, C.B.; Notterman, D.; Worgall, S.; Silver, G. et al. Cost Associated With Pediatric Delirium in the ICU. Crit. Care Med.; 2016; 44, pp. e1175-e1179. [DOI: https://dx.doi.org/10.1097/CCM.0000000000002004] [PubMed: https://www.ncbi.nlm.nih.gov/pubmed/27518377]

14. Girard, T.D.M.; Jackson, J.C.P.; Pandharipande, P.P.M.; Pun, B.T.M.; Thompson, J.L.; Shintani, A.K.; Gordon, S.M.P.; Canonico, A.E.; Dittus, R.S.; Bernard, G.R. et al. Delirium as a predictor of long-term cognitive impairment in survivors of critical illness. Crit. Care Med.; 2010; 38, pp. 1513-1520. [DOI: https://dx.doi.org/10.1097/CCM.0b013e3181e47be1] [PubMed: https://www.ncbi.nlm.nih.gov/pubmed/20473145]

15. Martin, B.J.; Buth, K.J.; Arora, R.C.; Baskett, R.J. Delirium: A cause for concern beyond the immediate postoperative period. Ann. Thorac. Surg.; 2012; 93, pp. 1114-1120. [DOI: https://dx.doi.org/10.1016/j.athoracsur.2011.09.011] [PubMed: https://www.ncbi.nlm.nih.gov/pubmed/22200370]

16. Kupferschmid, M.; Tripathi, S. Utilization of Kotter’s Stages and Statistical Process Control to Implement and Sustain Delirium Screening in PICU. Pediatr. Qual. Saf.; 2021; 6, e536. [DOI: https://dx.doi.org/10.1097/pq9.0000000000000536] [PubMed: https://www.ncbi.nlm.nih.gov/pubmed/34901682]

17. Zhu, X.; Feng, X.; Lin, J.; Ding, Y. Risk factors of delirium in paediatric intensive care units: A meta-analysis. PLoS ONE; 2022; 17, e0270639. [DOI: https://dx.doi.org/10.1371/journal.pone.0270639] [PubMed: https://www.ncbi.nlm.nih.gov/pubmed/35802701]

18. Silver, G.; Doyle, H.B.; Hegel, E.; Kaur, S.M.; Mauer, E.A.; Gerber, L.M.; Traube, C.M. Association between Pediatric Delirium and Quality of Life after Discharge. Crit. Care Med.; 2020; 48, pp. 1829-1834. [DOI: https://dx.doi.org/10.1097/CCM.0000000000004661]

19. Barr, J.; Fraser, G.L.; Puntillo, K.; Ely, E.W.; Gélinas, C.; Dasta, J.F.; Davidson, J.E.; Devlin, J.W.; Kress, J.P.; Joffe, A.M. et al. Clinical practice guidelines for the management of pain, agitation, and delirium in adult patients in the intensive care unit. Crit. Care Med.; 2013; 41, pp. 263-306. [DOI: https://dx.doi.org/10.1097/CCM.0b013e3182783b72]

20. Schieveld, J.N.; Janssen, N.J.; van Cauteren, Y.J. On the Cornell Assessment for Pediatric Delirium and both the diagnostic and statistical manual, 5th edition, and International Classification of Diseases, 11th revision: Quo vadis?*. Crit. Care Med.; 2014; 42, pp. 751-752. [DOI: https://dx.doi.org/10.1097/01.ccm.0000435686.08339.b6]

21. Smith, H.A.B.M.; Boyd, J.; Fuchs, D.C.; Melvin, K.; Berry, P.; Shintani, A.; Eden, S.K.; Terrell, M.K.N.; Boswell, T.; Wolfram, K. et al. Diagnosing delirium in critically ill children: Validity and reliability of the Pediatric Confusion Assessment Method for the Intensive Care Unit. Crit. Care Med.; 2011; 39, pp. 150-157. [DOI: https://dx.doi.org/10.1097/CCM.0b013e3181feb489]

22. Smith, H.A.B.M.; Gangopadhyay, M.; Goben, C.M.; Jacobowski, N.L.; Chestnut, M.H.N.; Savage, S.; Rutherford, M.T.; Denton, D.; Thompson, J.L.; Chandrasekhar, R. et al. The Preschool Confusion Assessment Method for the ICU: Valid and Reliable Delirium Monitoring for Critically Ill Infants and Children. Crit. Care Med.; 2016; 44, pp. 592-600. [DOI: https://dx.doi.org/10.1097/CCM.0000000000001428] [PubMed: https://www.ncbi.nlm.nih.gov/pubmed/26565631]

23. Ely, E.W.; Inouye, S.K.; Bernard, G.R.; Gordon, S.; Francis, J.; May, L.; Truman, B.; Speroff, T.; Gautam, S.; Margolin, R. et al. Delirium in mechanically ventilated patients: Validity and reliability of the confusion assessment method for the intensive care unit (CAM-ICU). JAMA; 2001; 286, pp. 2703-2710. [DOI: https://dx.doi.org/10.1001/jama.286.21.2703] [PubMed: https://www.ncbi.nlm.nih.gov/pubmed/11730446]

24. Tobar, E.; Romero, C.; Galleguillos, T.; Fuentes, P.; Cornejo, R.; Lira, M.; de la Barrera, L.; Sánchez, J.; Bozán, F.; Bugedo, G. et al. Método para la evaluación de la confusión en la unidad de cuidados intensivos para el diagnóstico de delírium: Adaptación cultural y validación de la versión en idioma español [Confusion Assessment Method for diagnosing delirium in ICU patients (CAM-ICU): Cultural adaptation and validation of the Spanish version]. Med. Intensiva.; 2010; 34, pp. 4-13. [DOI: https://dx.doi.org/10.1016/j.medin.2009.04.003] [PubMed: https://www.ncbi.nlm.nih.gov/pubmed/19819041]

25. Figueroa-Ramos, M.; Arroyo-Novoa, C.; García-DeJesús, R.; Sepúlveda-Santiago, C.; Solís-Báez, S.; Ely, E.; Smith, H. Translation and cultural adaptation process to Spanish of the Preschool Confusion Assessment Method for the Intensive Care Unit. Traducción y adaptación cultural al español del Preschool Confusion Assessment Method for the Intensive Care Unit. Med. Intensive (Engl. Ed.); 2020; 44, pp. 453-456. [DOI: https://dx.doi.org/10.1016/j.medin.2019.06.007] [PubMed: https://www.ncbi.nlm.nih.gov/pubmed/31345601]

26. Fernández-Carrión, F.; González-Salas, E.; Silver, G.; Traube, C. Translation and Cultural Adaptation of Cornell Assessment of Pediatric Delirium to Spanish. Pediatr. Crit. Care Med.; 2019; 20, pp. 400-402. [DOI: https://dx.doi.org/10.1097/PCC.0000000000001853] [PubMed: https://www.ncbi.nlm.nih.gov/pubmed/30951003]

27. Thomas, N.; Coleman, M.; Terry, D. Nurses’ Experience of Caring for Patients with Delirium: Systematic Review and Qualitative Evidence Synthesis. Nurs. Rep.; 2021; 11, pp. 164-174. [DOI: https://dx.doi.org/10.3390/nursrep11010016] [PubMed: https://www.ncbi.nlm.nih.gov/pubmed/34968321]

28. Cachón-Pérez, J.M.; Alvarez-López, C.; Palacios-Ceña, D. Medidas no farmacológicas para el tratamiento del síndrome confusional agudo en la unidad de cuidados intensivos [Non-pharmacological steps for the treatment of acute confusional syndrome in the intensive care unit]. Enferm. Intensiva.; 2014; 25, pp. 38-45. [DOI: https://dx.doi.org/10.1016/j.enfi.2013.11.004]

29. Mencía Bartolomé, S.; Tapia Moreno, R. Escalas de sedoanalgesia en la Unidad de Cuidados Intensivos Pediátricos. Protoc. Diagn. Ter. Pediatr.; 2020; 3, pp. 51-73. Available online: https://www.aeped.es/sites/default/files/documentos/05_escalas_sedoanalgesia.pdf (accessed on 10 October 2023).

30. Rodríguez Mondéjar, J.J. Aportación de la Enfermería y Mejora de la Calidad Asistencial en la Atención del Síndrome Confusional Agudo en los Pacientes Críticos. Ph.D. Thesis; Universidad de Murcia, Facultad de Enfermería: Murcia, Spain, 2015; Available online: https://www.tdx.cat/bitstream/handle/10803/317388/TJJRM.pdf?sequence1&isAllowed=y (accessed on 10 October 2023).

31. Yun Castilla, C.; Fernández Carrión, F. Delirium pediátrico en la Unidad de Cuidados Intensivos Pediátricos. Protoc. Diagn. Ter. Pediatr.; 2020; 3, pp. 35-49. Available online: https://www.aeped.es/sites/default/files/documentos/04_delirium_ucip.pdf (accessed on 10 October 2023).

32. Thompson Burdine, J.; Thorne, S.; Sandhu, G. Interpretive description: A flexible qualitative methodology for medical education research. Med. Educ.; 2021; 55, pp. 336-343. [DOI: https://dx.doi.org/10.1111/medu.14380]

33. Thorne, S. Interpretive Description; Routledge Publishing: New York, NY, USA, 2016.

34. O’Brien, B.C.; Harris, I.B.; Beckman, T.J.; Reed, D.A.; Cook, D.A. Standards for reporting qualitative research: A synthesis of recommendations. Acad. Med.; 2014; 89, pp. 1245-1251. [DOI: https://dx.doi.org/10.1097/ACM.0000000000000388] [PubMed: https://www.ncbi.nlm.nih.gov/pubmed/24979285]

35. Orden SAS/1730/2010, de 17 de Junio, Por la Que se Aprueba y Publica el Programa Formativo de la Especialidad de Enfermería Pediátrica. (Order SAS/1730/2010, of June 17, Which Approves and Publishes the Training Program for the Specialty of Pediatric Nursing). Available online: https://www.boe.es/eli/es/o/2010/06/17/sas1730 (accessed on 10 October 2023).

36. Tong, A.; Sainsbury, P.; Craig, J. Consolidated criteria for reporting qualitative research (COREQ): A 32-item checklist for interviews and focus groups. Int. J. Qual. Health Care; 2007; 19, pp. 349-357. [DOI: https://dx.doi.org/10.1093/intqhc/mzm042] [PubMed: https://www.ncbi.nlm.nih.gov/pubmed/17872937]

37. Naderifar, M.; Goli, H.; Ghaljaie, F. Snowball sampling: A purposeful method of sampling in qualitative research. Strides Dev. Med. Educ.; 2017; 14, 3. [DOI: https://dx.doi.org/10.5812/sdme.67670]

38. Parker, C.; Scott, S.; Geddes, A. Snowball Sampling. SAGE Research Methods Foundations. 2019; Available online: http://eprints.glos.ac.uk/6781/1/6781%20Parker%20and%20Scott%20%282019%29%20Snowball%20Sampling_Peer%20reviewed%20pre-copy%20edited%20version.pdf (accessed on 10 October 2023).

39. Marshall, M.N. The key informant technique. Fam. Pract.; 1996; 13, pp. 92-97. [DOI: https://dx.doi.org/10.1093/fampra/13.1.92] [PubMed: https://www.ncbi.nlm.nih.gov/pubmed/8671109]

40. Fusch, P.I.; Ness, L.R. Are We There Yet? Data Saturation in Qualitative Research. Qual. Rep.; 2015; 20, pp. 1408-1416. [DOI: https://dx.doi.org/10.46743/2160-3715/2015.2281]

41. Guest, G.; Namey, E.; Chen, M. A simple method to assess and report thematic saturation in qualitative research. PLoS ONE; 2020; 15, e0232076. [DOI: https://dx.doi.org/10.1371/journal.pone.0232076] [PubMed: https://www.ncbi.nlm.nih.gov/pubmed/32369511]

42. Kostadinov, I.; Daniel, M.; Stanley, L.; Gancia, A.; Cargo, M. A systematic review of community readiness tool applications: Implications for reporting. Int. J. Environ. Res. Public Health; 2015; 12, pp. 3453-3468. [DOI: https://dx.doi.org/10.3390/ijerph120403453] [PubMed: https://www.ncbi.nlm.nih.gov/pubmed/25811769]

43. Guest, G.; Bunce, A.; Johnson, L. How many interviews are enough? An experiment with data saturation and variability. Field Methods; 2006; 18, pp. 59-82. [DOI: https://dx.doi.org/10.1177/1525822X05279903]

44. Kallio, H.; Pietilä, A.M.; Johnson, M.; Kangasniemi, M. Systematic methodological review: Developing a framework for a qualitative semi-structured interview guide. J. Adv. Nurs.; 2016; 72, pp. 2954-2965. [DOI: https://dx.doi.org/10.1111/jan.13031]

45. Roller, M.R. A Quality Approach to Qualitative Content Analysis: Similarities and Differences Compared to Other Qualitative Methods. Forum Qual. Sozialforschung Forum Qual. Soc. Res.; 2019; 20, [DOI: https://dx.doi.org/10.17169/fqs-20.3.3385]

46. Roller, M.R.; Lavrakas, P.J. Applied Qualitative Research Design: A Total Quality Framework Approach; Guilford Press: New York, NY, USA, 2015.

47. Graneheim, U.H.; Lindgren, B.M.; Lundman, B. Methodological challenges in qualitative content analysis: A discussion paper. Nurse Educ. Today; 2017; 56, pp. 29-34. [DOI: https://dx.doi.org/10.1016/j.nedt.2017.06.002] [PubMed: https://www.ncbi.nlm.nih.gov/pubmed/28651100]

48. Burke, H.; Jiang, S.; Stern, T.A. Assessment and Management of Delirium in Pediatric Patients. Prim. Care Companion CNS Disord.; 2023; 25, 22f03257. [DOI: https://dx.doi.org/10.4088/PCC.22f03257] [PubMed: https://www.ncbi.nlm.nih.gov/pubmed/36821763]

49. Luz Romero, R.M.; Illán Ramos, M.; Berzosa Sánchez, A.; Joyanes Abancens, B.; Baos Muñoz, E.; Ramos Amador, J.T. Clinical characteristics of children hospitalized for COVID-19. Med. Clin.; 2022; 158, pp. 336-339. [DOI: https://dx.doi.org/10.1016/j.medcli.2021.11.016] [PubMed: https://www.ncbi.nlm.nih.gov/pubmed/35039168]

50. Patel, R.P.; Gambrell, M.; Speroff, T.; Scott, T.A.; Pun, B.T.; Okahashi, J.; Strength, C.; Pandharipande, P.; Girard, T.D.; Burgess, H. et al. Delirium and sedation in the intensive care unit: Survey of behaviors and attitudes of 1384 healthcare professionals. Crit. Care Med.; 2009; 37, pp. 825-832. [DOI: https://dx.doi.org/10.1097/CCM.0b013e31819b8608] [PubMed: https://www.ncbi.nlm.nih.gov/pubmed/19237884]

51. Luetz, A.; Balzer, F.; Radtke, F.M.; Jones, C.; Citerio, G.; Walder, B.; Weiss, B.; Wernecke, K.-D.; Spies, C. Delirium, sedation and analgesia in the intensive care unit: A multinational, two-part survey among intensivists. PLoS ONE; 2014; 9, e110935. [DOI: https://dx.doi.org/10.1371/journal.pone.0110935]

52. Marino, J.; Bucher, D.; Beach, M.; Yegneswaran, B.; Cooper, B. Implementation of an Intensive Care Unit Delirium Protocol: An Interdisciplinary Quality Improvement Project. Dimens. Crit. Care Nurs.; 2015; 34, pp. 273-284. [DOI: https://dx.doi.org/10.1097/DCC.0000000000000130]

53. Spronk, P.E.; Riekerk, B.; Hofhuis, J.; Rommes, J.H. Occurrence of delirium is severely underestimated in the ICU during daily care. Intensive Care Med.; 2009; 35, pp. 1276-1280. [DOI: https://dx.doi.org/10.1007/s00134-009-1466-8]

54. Maximous, R.; Miller, F.; Tan, C.; Camargo, M.; Ross, K.; Marshall, C.; Yung, P.; Fleming, D.; Law, M.; Tsang, J.L.Y. Pain, agitation and delirium assessment and management in a community medical-surgical ICU: Results from a prospective observational study and nurse survey. BMJ Open Qual.; 2018; 7, e000413. [DOI: https://dx.doi.org/10.1136/bmjoq-2018-000413]

55. Devlin, J.W.; Fong, J.J.; Howard, E.P.; Skrobik, Y.; McCoy, N.; Yasuda, C.; Marshall, J. Assessment of delirium in the intensive care unit: Nursing practices and perceptions. Am. J. Crit. Care; 2008; 17, pp. 555-566. [DOI: https://dx.doi.org/10.4037/ajcc2008.17.6.555]

56. Silver, G.; Kearney, J.; Traube, C.; Hertzig, M. Delirium screening anchored in child development: The Cornell Assessment for Pediatric Delirium. Palliat. Support. Care; 2015; 13, pp. 1005-1011. [DOI: https://dx.doi.org/10.1017/S1478951514000947]

57. Rosa, R.G.; Tonietto, T.F.; da Silva, D.B.; Gutierres, F.A.; Ascoli, A.M.; Madeira, L.C.; Rutzen, W.; Falavigna, M.; Robinson, C.C.; Salluh, J.I. et al. Effectiveness and Safety of an Extended ICU Visitation Model for Delirium Prevention: A Before and After Study. Crit. Care Med.; 2017; 45, pp. 1660-1667. [DOI: https://dx.doi.org/10.1097/CCM.0000000000002588] [PubMed: https://www.ncbi.nlm.nih.gov/pubmed/28671901]

58. Kalvas, L.B. The Life Course Health Development Model: A theoretical research framework for paediatric delirium. J. Clin. Nurs.; 2019; 28, pp. 2351-2360. [DOI: https://dx.doi.org/10.1111/jocn.14776] [PubMed: https://www.ncbi.nlm.nih.gov/pubmed/30653772]

59. Kawai, Y.; Weatherhead, J.R.; Traube, C.; Owens, T.A.; Shaw, B.E.; Fraser, E.J.; Scott, A.M.; Wojczynski, M.R.; Slaman, K.L.; Cassidy, P.M. et al. Quality Improvement Initiative to Reduce Pediatric Intensive Care Unit Noise Pollution With the Use of a Pediatric Delirium Bundle. J. Intensive Care Med.; 2019; 34, pp. 383-390. [DOI: https://dx.doi.org/10.1177/0885066617728030] [PubMed: https://www.ncbi.nlm.nih.gov/pubmed/28859578]

60. Traube, C.; Silver, G.; Kearney, J.; Patel, A.; Atkinson, T.M.; Yoon, M.J.; Halpert, S.; Augenstein, J.; Sickles, L.E.B.; Li, C.M. et al. Cornell Assessment of Pediatric Delirium: A valid, rapid, observational tool for screening delirium in the PICU*. Crit. Care Med.; 2014; 42, pp. 656-663. [DOI: https://dx.doi.org/10.1097/CCM.0b013e3182a66b76] [PubMed: https://www.ncbi.nlm.nih.gov/pubmed/24145848]

61. Hoshino, H.; Matsuishi, Y.; Enomoto, Y.; Shimojo, N.; Kido, T.; Matsuzaki, A.; Matsubara, M.; Kato, H.; Hoshino, T.; Traube, C. et al. The Validity and Reliability of the Japanese Version of the Cornell Assessment of Pediatric Delirium. Pediatr. Crit. Care Med.; 2020; 21, pp. e267-e273. [DOI: https://dx.doi.org/10.1097/PCC.0000000000002274]

62. Valdivia, H.R.; Carlin, K.E. Determining Interrater Reliability of the Cornell Assessment of Pediatric Delirium Screening Tool Among PICU Nurses. Pediatr. Crit. Care Med.; 2019; 20, pp. e216-e220. [DOI: https://dx.doi.org/10.1097/PCC.0000000000001896]

63. Cleveland, M.; Baute, R.; Clindaniel, C.; Hertz, L.; Pond, R.; Centers, G.I. Inter-Rater Reliability of Delirium Screening of Infants in the Cardiac ICU: A Prospective, Observational Study. Pediatr. Crit. Care Med.; 2023; 24, pp. e147-e155. [DOI: https://dx.doi.org/10.1097/PCC.0000000000003182]

64. Paterson, R.S.; Kenardy, J.A.; Dow, B.L.; De Young, A.C.; Pearson, K.; Aitken, L.M.; Long, D.A. Accuracy of delirium assessments in critically ill children: A prospective, observational study during routine care. Aust. Crit. Care; 2021; 34, pp. 226-234. [DOI: https://dx.doi.org/10.1016/j.aucc.2020.07.012]

65. McGetrick, M.E.; Lach, C.; Mullen, J.E.; Munoz-Pareja, J.C. Assessing Nursing and Pediatric Resident Understanding of Delirium in the Pediatric Intensive Care Unit. Crit. Care Nurs. Clin. N. Am.; 2019; 31, pp. 481-488. [DOI: https://dx.doi.org/10.1016/j.cnc.2019.07.003]

66. Flaigle, M.C.; Ascenzi, J.; Kudchadkar, S.R. Identifying Barriers to Delirium Screening and Prevention in the Pediatric ICU: Evaluation of PICU Staff Knowledge. J. Pediatr. Nurs.; 2016; 31, pp. 81-84. [DOI: https://dx.doi.org/10.1016/j.pedn.2015.07.009]

67. Ercan, İ.; Kızıler, E. Pediatric Delirium Knowledge and Attitudes of Nurses in the Intensive Care Unit. J. Ed. Res. Nurs.; 2023; 20, pp. 380-386. [DOI: https://dx.doi.org/10.14744/jern.2023.22449]

68. Papaioannou, M.; Papastavrou, E.; Kouta, C.; Tsangari, H.; Merkouris, A. Investigating nurses’ knowledge and attitudes about delirium in older persons: A cross-sectional study. BMC Nurs.; 2023; 22, 10. [DOI: https://dx.doi.org/10.1186/s12912-022-01158-9] [PubMed: https://www.ncbi.nlm.nih.gov/pubmed/36631856]

69. Carin-Levy, G.; Nicol, K.; van Wijck, F.; Mead, G.; McVittie, C. Identifying and Responding to Delirium in Acute Stroke: Clinical Team Members’ Understandings. Qual. Health Res.; 2021; 31, pp. 137-147. [DOI: https://dx.doi.org/10.1177/1049732320959295] [PubMed: https://www.ncbi.nlm.nih.gov/pubmed/32969764]

70. Norman, S.L.; Taha, A.A. Delirium Knowledge, Self-Confidence, and Attitude in Pediatric Intensive Care Nurses. J. Pediatr. Nurs.; 2019; 46, pp. 6-11. [DOI: https://dx.doi.org/10.1016/j.pedn.2019.01.013] [PubMed: https://www.ncbi.nlm.nih.gov/pubmed/30802805]

71. Ramoo, V.; Abu, H.; Rai, V.; Singh, S.K.S.; Baharudin, A.A.; Danaee, M.; Thinagaran, R.R.R. Educational intervention on delirium assessment using confusion assessment method-ICU (CAM-ICU) in a general intensive care unit. J. Clin. Nurs.; 2018; 27, pp. 4028-4039. [DOI: https://dx.doi.org/10.1111/jocn.14525] [PubMed: https://www.ncbi.nlm.nih.gov/pubmed/29775510]

72. DuBose, B.M.; Mayo, A.M. Resistance to change: A concept analysis. Nurs. Forum.; 2020; 55, pp. 631-636. [DOI: https://dx.doi.org/10.1111/nuf.12479] [PubMed: https://www.ncbi.nlm.nih.gov/pubmed/32578229]

73. Johnson, J.A. Why are nurses so reluctant to implement changes based on evidence and what can we do to help?. J. Nurses Prof. Dev.; 2014; 30, pp. 45-46. [DOI: https://dx.doi.org/10.1097/NND.0000000000000033]

74. Hader, R. The only constant is change. Nurs. Manag.; 2013; 44, 6. [DOI: https://dx.doi.org/10.1097/01.NUMA.0000429006.47269.22]

75. Traube, C.; Silver, G. Iatrogenic Withdrawal Syndrome or Undiagnosed Delirium?. Crit. Care Med.; 2017; 45, pp. e622-e623. [DOI: https://dx.doi.org/10.1097/CCM.0000000000002347]

76. Madden, K.; Burns, M.M.; Tasker, R.C. Differentiating Delirium from Sedative/Hypnotic-Related Iatrogenic Withdrawal Syndrome: Lack of Specificity in Pediatric Critical Care Assessment Tools. Pediatr. Crit. Care Med.; 2017; 18, pp. 580-588. [DOI: https://dx.doi.org/10.1097/PCC.0000000000001153]

77. Ista, E.; van Dijk, M. We Can Not Compartmentalize Our Patients! Overlapping Symptoms of Iatrogenic Withdrawal Syndrome, Pediatric Delirium, and Anticholinergic Toxidrome. Pediatr. Crit. Care Med.; 2017; 18, pp. 603-604. [DOI: https://dx.doi.org/10.1097/PCC.0000000000001163] [PubMed: https://www.ncbi.nlm.nih.gov/pubmed/28574912]