Personal resilience and rural doctors retention: a study in Indonesia

Abstract

Introduction: Retaining the health workforce in rural areas is a global problem. Job dissatisfaction or work-related distress are among the factors that drive doctors to leave rural places. Resilience has been recognised as a key component of wellbeing and is associated with better satisfaction with life. Building personal resilience has the benefits of lowering vulnerability to work-related adversity. This study examined the association between rural doctors’ personal resilience and the duration of rural practice.

Methods: This cross-sectional study was set in a rural province in Indonesia. A total sampling procedure was implemented. A total of 528 participants responded to an online survey. The survey tool measured six dimensions of a resilience profile (determination, endurance, adaptability, recuperability, comfort zone and life calling) and collected personal data such as date of birth, practice location and duration of rural practice experience. These participants were classified into four groups: intern, general (GP) with <5 years experience, GP with 5–10 years experience, and GP with >10 years experience. The data were analysed quantitatively using Oneway analysis of variance (ANOVA).

Results: Doctors with longer durations of rural experience showed higher resilience levels in four of the dimensions of personal resilience: endurance, adaptability, recuperabilit­y and comfort zone. Among those four dimensions, endurance and comfort zone showed significant differences between groups with >10 years of difference in rural experience (p<0.05). The other two dimensions, determination and life calling, showed fluctuations across groups with different rural durations.

Conclusion: This study provides a preliminary result for understanding the relationship between personal resilience and rural doctor retention. It suggests that resilience is partly associated with rural doctor retention. Further studies are needed to examine the causal relationship between resilience and retention.

Introduction

Retaining a health workforce willing to serve in rural areas is a global problem faced by both developed and developing countries^1-5. Various strategies and recommendations to retain doctors have been developed and suggested by WHO^1,2 and have been implemented. These include a year of compulsory service in rural areas for new medical and specialist graduates, offering high financial incentives to work in rural areas and giving priority in specialist training admission for doctors who have rural service experience. The evidence suggests that interventions based on incentives have worked well for recruitment, but not for retention⁶. These approaches are mainly behaviorist (based on external incentives). Typically, the effect of behaviorist drivers does not last for long after the incentive is taken away (or no longer seen as an incentive) – such as increased pay that starts to be seen as normal⁷ – unless it is internalised and becomes intrinsically meaningful and owned.

Social cognitive theory

Bandura’s social cognitive theory provides a useful lens on this phenomenon. According to this theory, there are reciprocal interactions between human behaviour, cognitive factors and social environment⁸. This means that humans are not simply reactive to environmental stimuli; they have cognitive abilities and behaviours (agency) that influence their actions⁹. Human cognitive abilities include anticipating consequences of one’s actions, thinking, planning and self-motivating. Agency refers to acts done intentionally⁹. These cognitive abilities and agency enable individuals to intentionally direct their actions toward the accomplishment of tasks and goals that give meaning and satisfaction to their lives⁹.

Self-efficacy is vital for personal agency⁹. It is an individual’s belief that he or she is able to successfully perform a novel or difficult task¹⁰. Highly self-efficacious people tend to see problems and adversities as challenges to overcome, not as threats. Hence, self-efficacy has a role in developing motivation and goals to achieve despite challenges, and to persevere during the process.

Resilience and its dimensions

The concept of self-efficacy is closely linked to resilience¹⁰. Resilience is the ability of a person to rebound, spring back and maintain wellbeing, which enables that person thrive during ongoing stress and adversity^11-14. This can be illustrated as a rubber ball that bounces back to its original form¹⁵. The difference between the concept of resilience and self-efficacy lies on the presence of a stressor. One cannot be perceived to be resilient without any stressor, while self-efficacy may be present without any stressor¹⁰.

Retaining doctors in rural areas is not easy because they face more uncertainties and adversities than their urban colleagues¹⁵. Doctors who are not well prepared and equipped to work in rural areas may feel lost, lonely and distressed with a risk of becoming burnt out. Job dissatisfaction is the main factor that drives doctors to leave rural contexts¹⁶. The most common sources of work-related distress reported by doctors are poor work–life balance, fear of making mistakes¹⁷ and lack of control over workload^18,19.

Personal resilience has been recognised as a key component of wellbeing^20,21 and it is associated with better quality of life¹³. Improving wellbeing contributes to lowering stress and improving retention of rural doctors²². Therefore, resilience has been suggested to be a core competency in rural general practitioner (GP) registrar training²³ and studies suggest that medical schools should focus their curriculum on providing opportunities for the development of students’ resilience¹³.

Resilience consists of several dimensions: determination, endurance, adaptability, recuperability, comfort zone and life calling²⁴. Determination is a person’s willpower and decision to persevere and/or to succeed. Endurance is a person’s strength to withstand difficult situations without giving up. Adaptability is a person’s capacity to be flexible and resourceful and to cope with adverse environments and adjust oneself to changing conditions^11,25. Determination, endurance and adaptability are associated with career satisfaction in nurses²⁵.

Recuperability is a person’s ability to recover from various types of harm, setbacks or difficulties^11,25. Doctors in rural areas are always dealing with uncertainties and various adversities and difficulties along their rural career, so it is logical to assume that this ability may also have a role in their staying in rural areas. Comfort zone is the ability of an individual to accept and feel enough/satisfied with their current condition. Doctors who are satisfied with their job or the compensation received tend to stay longer in rural²⁶ areas.

Life calling is an individual’s sense of personal fulfillment and meaning from recognising or simply believing that what they do has a socially useful purpose²⁷, which cannot be substituted by economic means²⁴. A reported reason that doctors kept working in rural areas was because they had a desire (or calling) to serve underserved populations^26,28.

Thus, it is plausible that promoting personal resilience has the potential to support the mere survival and even thriving of doctors at work despite adversities and challenges. Logically then, resilience may play an important role in the retention of doctors in rural areas^23,29.

Exploring resilience and rural retention

Based on this argument, the relationship between personal resilience and retention of doctors in the rural context is likely to be important. However, to the best of the authors’ knowledge, this relationship has not been studied in the Indonesian context. Studying this relationship in different cultural contexts is important: what may be found in one context may be different in others. By studying these phenomena in various context, a deeper understanding can be achieved. This study seeks to examine the association between rural doctors’ personal resilience and duration of rural practice.

Methods

Context

This study was located in Nusa Tenggara Timur (NTT) Province, a rural province in Indonesia. NTT is an archipelago province with 1192 islands, of which only 44 are inhabited. The population of 5.28 million is a culturally diverse but predominantly Christian (90%)³⁰. The NTT Province predominantly consists of medically underserved areas (18 of 22 districts)³¹. NTT has the second-lowest doctor-to-population ratio in Indonesia (14/100 000), which is much less than the recommended WHO ratio of 100/100 000³².

Participants

Participants in this study were doctors working in NTT Province, excluding those working in the capital, Kupang City. For the selection of the participants, a total sampling approach was used³³. The inclusion criteria were as follows: GP or intern; working in the health sector (eg primary health centre/puskesmas, hospital, district health office, non-governmental organisation); working in NTT Province (except in Kupang City) during the study period; and available and willing to participate. In Indonesia medical education is typically an undergraduate entry program, with medical graduates conducting a year-long internship before being fully licensed. After this they can opt to apply for a hospital, clinic or community health service position, either in a city or rural areas. They can also choose to apply for a specialist or primary care training pathway. Thus in this study ‘GP’ refers to a medical doctor, before they undertake any further study, working in a rural area³⁴.

Participants who could not participate due to illness (physical or mental) or detention were excluded. Participants who were actively involved in any political campaigns and with possible vested interests at the time of the study period were also excluded. They were identified through the contact person for the Indonesian Doctor Association branch in each district.

Instrument

The adapted Indonesian version of Taormina’s Adult Personal Resilience Questionnaire was used²⁴. The internal consistency (Cronbach’s alpha) of the adapted questionnaire was 0.81–0.96 for each dimension²⁴.

This adapted questionnaire consisted of six dimensions, with five items in each dimension. Examples of the items are ‘Once I set a goal, I am determined to achieve it’ (determination), ‘I can withstand a difficult situation’ (endurance), ‘I can change to fit into many kinds of circumstances’ (adaptability), ‘I am able to bounce back from any kind of adversity’ (recuperability), ‘This is the right place for me’ (comfort zone) and ‘Even in difficult situations, God has been there to guide me’ (life calling)²⁴.

The questionnaire was scored using a five-point Likert scale ranging from 1 (’strongly disagree’) to 5 (‘strongly agree’). The range of total scores for each dimension (five items) was 5–25 with a mean range of 1–5. For all subscales, a higher mean score indicated a higher resilience level for that particular dimension¹¹. Because there is no previous reference for a doctor’s performance on this scale, for the purpose of this study and its statistical convenience the ranges of the mean score (1–5) were distributed evenly into three classifications: low (<2.3), moderate (2.3–3.7), and high (>3.7).

The scores analysed and presented in this article are the subscales/dimension scores, not the composite score. Combining all dimensions into one composite score, although statistically logical, tended to obscure the results. The participants’ resilience profiles of which dimensions were strong or weak would be unknown. For example, having scores of one in three dimensions and five in the other three dimensions­­ would result in an average score of 3.

Design

A cross-sectional comparative design³⁵ was used to measure and compare the resilience profiles between groups of participants with different durations of rural practice. An online survey was selected as the data collection strategy because of its large-scale population access³⁶.

Survey process

The data collection procedure involved several steps (Fig1). Data about potential participants (eg names and mobile phone numbers) were identified from the database of the Provincial Indonesian Doctor Association in NTT, district health offices, and by snowballing³⁷. All of the registered GPs in NTT, except for those in Kupang City, were contacted by WhatsApp or SMS and asked to participate in the study. Links to further explanations about the study, informed consen, and the online version of the questionnaire were also sent by WhatsApp or SMS. The WhatsApp social media application was chosen as an alternative to email because many people in NTT Province use this social media application and open it frequently. Reminders were sent to non-responders 1 week and 2 weeks after the previous reminder³⁶.

Fig ure 1: Flowchart of data collection and analysis procedures.

Data analysis

Data analysis procedures involved several steps (Fig1). First, descriptive analysis (means, percentage, range of scores and 95% confidence interval (CI)) were calculated. Second, internal consistency coefficients of each dimension were determined using Cronbach’s alpha³⁶. Third, inferential analyses were conducted using one-way analysis of variance (ANOVA) on each dimension. The Statistical Package for the Social Sciences v20 (IBM; http://www.ibm.com/SPSS/Statistics) was used.

The independent variables were duration of rural practice (in the province and in the current/last district). The participants were divided into four groups: intern, young GPs (<5 years of experience), mid-career GPs (5–10 years of experience) and senior GPs (>10 years of experience). The dependent variables were resilience dimensions, and six dimensions of resilience were tested: determination, endurance, adaptability, recuperability, comfort zone and life calling)²⁴. Because those six dimensions behave largely as independent constructs, ANOVAs were done separately for each dimension in relation to the duration of rural practice. Each dimension’s effect size was determined using the eta squared (%u019E²) measure³⁸.

Ethics approval

This study was approved as part of a bigger study, which aims to design a clinical education model as an intervention to enhance resilience development, previously approved by the Ethical Committee, Faculty of Medicine, University of Gadjah Mada, Yogyakarta, Indonesia (KE/FK/0877/EC/2018) and University of Nusa Cendana, Kupang, NTT, Indonesia (64/UN15.16/KEPK/2018).

Results

Demographic

A total of 528 out of 737 (72%) registered GPs who were contacted responded to the questionnaire. Of these, 65 participants were excluded (Fig2), leaving 463 participants for the quantitative analysis (Table 1). Most of the participants were Christian, females and not in a relationship (Table 1). The schooling background of the participants showed a movement from the rural to the city as they grew up (Table 2).

Table 1: Demographics of study participants ( n =463)

Table 2: Level of school education by participant childhood location

Figure 2: Study exclusion criteria and numbers.

Resilience dimensions

Analysis of each of the dimensions of resilience showed that the internal consistency of the scales was high (Cronbach’s alpha score range 0.79–0.96). Determination and life calling had the lowest and the highest scores, of 0.79 and 0.96 respectively. Given the high internal consistency of each dimension – some even higher than the internal consistency of the total scores – it was decided not to represent the final score by a single composite score but by six different scores, with each score representing its particular dimension.

In general, the analysis of the scores of the total group of participants showed that the mean scores for all dimensions except comfort zone were high (>3.7 on five-point Likert scale). Comfort zone was moderate (between 2.3 and 3.7) with a mean score of 3.30 (95%CI 3.23–3.36). The highest mean score of 4.59 (95%CI 4.54–4.65) was for the life calling dimension (Fig3).

Figure 3: Dimensions of resilience by rural duration. †

Resilience and retention

There are three important findings. First, groups with longer rural experience showed higher levels of resilience. However, these differences were significant in only two dimensions: endurance and comfort zone. Second, these significant differences were found only between groups with >10 years difference in rural practice and, specific for comfort zone, when there was a change in the status from intern to GP. Third, life calling held the highest score among the six dimensions. However, it showed no association with the rural duration since the differences between groups were very small.

The differences between groups in the endurance and comfort zone dimensions were statistically significant, with p-values of 0.011 and 0.0001, respectively (Table 3). Tukey’s posthoc analysis was conducted to examine which groups within these two dimensions were different. The significant p-values (p<0.05) are summarised in Table 4.

Table 5 shows that the practice duration for interns, young GPs and senior GPs were 0.5 years, 2 years and 16.5 years, respectively. Therefore, endurance and comfort zone were significantly higher in groups with at least 10 years of differences in rural practice (senior GPs compared to interns and young GP groups). However, only 21% (98 out of 463) of participants had >5 years of rural experience, and even a smaller number of participants (11%) remained after 10 years (Table 5). In contrast to endurance, the comfort zone score for interns was significantly different compared to all groups.

Life calling had the highest total participants’ mean score of 4.59 (95%CI 4.54–4.65) and the intern group had the lowest score, of 4.58 (95%CI 4.47–4.70). To further explore the unique trend in life calling, in which the senior GP score was lower than the mid-career GP group, the groups’ classification was restructured based on working duration in most recent district only (excluding practice duration in previous different districts). The graph of results is similar to the other dimensions in which the groups with longer rural experience showed higher scores. This is illustrated in Figure 4 as a change from the blue line to the orange line. However, both before and after the change, the differences between groups were not statistically significant: the difference between the lowest (4.584) and the highest (4.651) scores was only 0.071 (Fig4).

Closer examination of the different trends of the life calling dimension for different rural groups’ classification found that 14 participants in the senior GP group had moved across districts. This is illustrated in more detail by the red arrows in Figure 5. These two histograms show that the participants who moved across districts had lower scores of life calling when compared to those who stayed longer in the same district. The red arrows denote the locations of these 14 participants’ scores within the group, which exist on the left histogram (provincial duration) and not on the right histogram (‘current/most recent district only’ duration). Those scores are considered to be within the lower range of the group scores.

Table 3: Within- and between-group ANOVA results for resilience dimensions

Table 4: Statistically significant groups on Tukey’s posthoc analysis ( p †

Table 5: Rural experience by group and participant childhood location (NTT Province or not)

Figure 4: Life calling analysis by participant group and most recent practice location.

Figure 5: Histograms of life calling dimension for senior GPs in NTT Province and by most recent district. †

Discussion

This study examined the association between GPs’ resilience levels and the duration of rural practice. Two dimensions, endurance and comfort zone, showed significant associations between groups with >10 years of differences in rural practice. Their effect sizes are small for endurance and moderate for comfort zone dimensions. The guidelines for small and moderate are %u019E² of 0.01 and 0.059 respectively³⁸. This means that the practice duration differences between groups account for 2.4% and 5.9% of the change in the endurance and comfort zone scores, respectively.

Many factors not measured in this study have a role in rural doctors’ retention, such as extrinsic and intrinsic incentives³⁹, intrinsic values, positive rural training experiences, rural infrastructure, professional development opportunities, work–life balance⁴⁰, and having a rural background^41,42 or a spouse with rural background⁴². Thus, the findings should be carefully interpreted by taking into account the possibility of the presence and interference of these factors.

In addition, because of the cross-sectional nature of the present study, it is not possible to conclude whether the high resilience levels caused the participants to stay longer or vice-versa. For example, natural attrition may have eventually led to attrition from those doctors with lower resilience, leaving the more resilient ones. Highly resilient people have the ability to survive, learn and find meaning from adversity⁴³. Accordingly, resilience attributes are likely to support the participants’ capacity to thrive and stay longer in rural settings.

Challenging experiences and exposures to risks or adverse events theoretically support the development of resilience^15,43,44. Experiences, especially in relation to adverse events, are likely to be essential to developing resilience. Each dimension of resilience develops for a specific context (eg task, culture, geographic location)^45,46 through person–environment interactional processes⁴⁶. However, an individual’s internal characteristics (eg cognitive, skills, affective, spiritual) play roles in resilience in different contexts⁴⁶. From this perspective, it could be argued that the participants’ experiences over time assisted in nurturing resilience attributes for specific contexts.

Endurance enables one to withstand difficult situations without giving up. It is similar to the term ‘perseverance’ in other studies^13,47,48. The positive association found between endurance and retention aligns with a previous study in which doctors were adapted to and kept working despite difficulties they faced during the Palestine conflict⁴⁹. Limitations of rural practice, which include underdeveloped infrastructure, lack of recreational activities, inadequate accommodation facilities, high workload and feelings of isolation, may become negative predictors for retention^40,50. Thus, the ability to endure these limitations is likely to support rural doctors’ retention.

The significant differences in comfort zone scores between the interns and all other groups suggest that a status change from interns to GPs might be important. It seems that these participants were adapting to the rural context and those who stayed longer were the ones reaching their comfort zone. A previous study suggests that more time spent in the rural community offers opportunities to develop an emotional connection to local people and rural living, which then facilitates the uptake of rural lifestyle⁵¹. In addition, by staying long enough, the doctors also have opportunities to develop a better private practice and businesses, such as a farm, a pharmacy or a hotel²⁸. The ensuing better earnings may increase comfort zone level. This aligns with another study suggesting that increased remuneration and other monetary incentives are associated with higher retention of rural doctors⁴⁰. Most importantly, satisfaction with earnings may prevent a doctor from leaving²⁸. Job satisfaction also related to the retention of rural health practitioners⁵².

Although statistically significant, the actual score of the comfort zone dimension is only moderate and the lowest among other dimensions. The authors interpret this as reflecting the rural specific context with its limitations⁴⁰. On the other hand, the high level of resilience on the other dimensions aligns with a previous study in which the doctors’ resilience levels are higher than those of the general population⁵³.

Although not all dimensions show a significant association, most of the graphs show similar trends; groups with longer duration of rural experience show higher resilience levels, except determination. A possible explanation for this in the mid-career group is that they might have experienced multiple adversities and failures in achieving their goals during their 5–10 years of rural practice. For example, it was observed that most medical graduates sought specialist training but many were not accepted, even after several attempts. It is entirely plausible that some of them tried to make a change in rural areas, but the outcome was disappointing to them. Self-determination theory offers an explanation for this, suggesting that the fulfilment of needs for competence, autonomy and relatedness is needed for individuals to experience a sense of wellbeing⁵⁴. In this case, experiencing failures is most likely to have undermined their sense of competence and caused them to set a lower goal/target to achieve¹⁰, leading to a lower determination score.

In contrast to comfort zone, the life calling dimension is not significantly associated with rural duration, but it holds the highest scores among other dimensions, even for the intern group. This might be due to a ceiling effect⁵⁵ of all groups’ scores. The authors’ interpretation of this is that people who choose a rural career are likely to have a sense of personal meaning for this work. This aligns with some previous studies. Kim and Equivel identified spirituality and religion as resilience factors⁵⁶. Resilience was developed through faith in the power of a person’s god⁴⁴, which provides a purpose to life and assists one in finding meaning beyond the adversity experienced^56,57, through the practice of sharing within a faith-based community, prayer and meditation⁵⁷. Spirituality also helps in developing a sense of meaning in one’s life and shaping behaviour⁵⁸. Another study found that doctors who work in underserved areas were more likely to have a sense of responsibility or moral obligation⁵⁹. Work attitude (commitment, self-esteem and intrinsic satisfaction) among doctors is positively correlated with spirituality and religion⁵⁸. Job dissatisfaction, on the other hand, has been the main reason for doctors leaving rural areas¹⁶. Another study found that helping people and following ‘God’s call’ provided intrinsic motivation and had an important role in retention²⁸. Reliance on faith was one reason why doctors kept on working in the middle of the Palestine war⁴⁹. However, according to the World Values Survey, there are differences in how societies see religion as important. In some societies, including Indonesia, the values and daily behaviour of its people are strongly influenced by religion⁶⁰. So, life calling is likely to have a role in retention of doctors in rural areas in certain societies. But this interpretation is limited by the absence of the data on the resilience level of doctors who leave rural practice. Its generalisability is also limited by the cultural differences between societies.

The present study showed a different trend in the life calling graph when counting the participants’ experience only in the last district, excluding any previous experiences. A possible explanation for this is that those participants who moved across districts may have not yet found their life calling in the previous location and may have been looking out for a better place, which explanation would align with self-determination theory^61,62, in which the highest and preferable motivation is intrinsic motivation. However, extrinsic motivation is important too, and these participants may have moved to another district, giving better extrinsic rewards. This aligns with behaviourism theory⁷ in which one conducts an action with an expectation of getting a reward. A combination of both extrinsic and intrinsic motivations is needed for an effective rural retention program^39,63.

These findings are important for rural workforce interventions because they provide a basis for understanding resilience in regard to its impact on rural doctors’ retention. They suggest that the endurance and comfort zone dimensions are better developed in doctors who have stayed in rural areas for more than 10 years. This aligns with a previous study suggesting the need to increase resilience to help doctors deal with the challenges they face, avoid burnout, reduce staff turnover and recruitment ­­costs⁶⁴. Thus, it is also logical to assume that any attempt to increase endurance and comfort zone dimensions may have an impact on retaining doctors longer in rural areas. Further study is needed to prove this assumption.

Implications of findings

To the best of the authors’ knowledge, currently most developing countries’ rural workforce interventions implement behaviourist approaches by giving rewards or punishment (eg compulsory rural service, rural bound scholarship and high financial incentives)^31,65-67. These interventions have been proven to increase recruitment but not retention⁶.

In the present study, the proportion of the participants studying in the city was increasing from elementary to medical school. This is logical given the limited availability of senior high school in the rural locations where none of the medical schools were located⁶⁸. However, the proportions of participants who grew up in the province of the present study (NTT) was similar to those of participants who came to the province later after graduation from medical school, showing that the rural recruitment programs^32,65-67 are quite successful in attracting non-local doctors. However, recruitment and retention are two different issues. Although recruitment of doctors was effective, in this study only 21% of the doctors stayed for more than 5 years. This means that incentive-based interventions are successful only in recruiting doctors, not in retaining them⁶⁷, which makes additional strategies for longer term benefits, such as developing resilience during medical training, worth considering.

Some previous studies found that resilience was associated with certain personality characteristics²⁰ and coping abilities⁴³ of doctors and that these can be developed during clinical training to support resilience and wellbeing^13,20,23,43. The UK General Medical Council also acknowledged the need for resilience training for medical students and doctors⁶⁹ and has included resilience as one of the capabilities to be acquired by GP trainees⁷⁰. Nevertheless, further studies are needed to explore how resilience develops among doctors in rural areas and how students can be better assisted to develop their resilience capacities, especially endurance and comfort zone dimensions.

It is logical to suggest that evaluating life calling in student selection may assist in choosing students with good potential for future rural practice. Examining humanistic factors during student selection has been identified as important for increasing the number of graduates⁵⁹ with interest in a rural career. However, this suggestion may not be applicable to every culture and further studies are needed to explore the best way to do this and its impact.

Limitations

Because this is a cross-sectional study, it is not possible to draw inferences of causality and the individual longitudinal development of resilience. It is not possible to conclude whether high resilience caused GPs to stay longer in rural work or if the duration of their rural work was what contributes to the development of resilience. In either case, programs to support resilience development could be useful.

The strong Christian background (82%) of participants may limit the generalisability of the findings. For example, life calling was very prominent in this study’s participants, which may not be the case in other contexts. However, the demographics of the participants align with the proportions of religion in the general population in NTT Province, where the majority were Catholic (52%) and Christian (38%), with a small percentage of Muslims (9.3%) and Hindus (0.2%)³⁰.

Conclusion

Although this is a preliminary study, it shows differences in the resilience profile of GPs with >10 years differences in rural practice. It also provides a basis for understanding the possibility that resilience is partly associated with the retention of rural doctors.

Acknowledgements

The authors thank all rural doctors who participated in the survey, Karol Octrisdey for his statistical assistance and Marselino Abdi Keraf for his help in understanding the survey result on resilience.

References

1 Buchan J, Couper ID, Tangcharoensathien V, Thepannya K, Jaskiewicz W, Perfilieva G, et al. Early implementation of WHO recommendations for the retention of health workers in remote and rural areas. Bulletin of the World Health Organization [Internet]. 2013; 91(11): 834-40. PMid:24347707

2 World Health Organization. Increasing access to health workers in remote and rural areas through improved retention. [Internet]. 2010. Available: web link (Accessed 16 April 2019).

3 Strasser RP, Lanphear JH, Mccready WG, Topps MH, Hunt DD, Matte MC. Canada’s New medical school: the Northern Ontario School of Medicine: social accountability through distributed community engaged learning. Academic Medicine 2009; 84(10): 1459-1464. PMid:19881443

4 Lehmann U, Dieleman M, Martineau T. Staffing remote rural areas in middle- and low-income countries: a literature review of attraction and retention. BMC Health Services Research 2008; 8: 1-10. PMid:18215313

5 Chomitz KM, Setiadi G, Azwar A, Ismail N, Widiyarti. Attracting doctors to rural areas (Indonesia). Report no. 1888. Washington, DC: World Bank, 1998.

6 Anderson I, Meliala A, Marzoeki P, Pambudi E. The production, distribution, and performance of physicians, nurses, and midwives in Indonesia: an update. Report no. 91324. Washington, DC: World Bank, 2014.

7 Mergel B. Instructional design and learning theory. Learn Matters 1998; 2: 1-27.

8 LaMorte WW. The Social Cognitive Theory. 2019. Available: web link (Accessed 8 August 2020).

9 Bandura A. Social Cognitive Theory: an agentic perspective. Annual Review of Clinical Psychology 2001; 52: 1-26. PMid:11148297

10 Prince-Embury S, Saklofske DH (Eds). Resilience in children, adolescents, and adults: translating research into practice. New York, NY: Springer, 2013. DOI link

11 Taormina RJ. personal resilience: a new theory, new measure, and practical implications. Psychological Thought 2015; 8(1): 35-46. Available: web link (Accessed 16 April 2019). DOI link

12 Wald HS, Anthony D, Hutchinson TA, Liben S, Smilovitch M, Donato AA. Professional identity formation in medical education for humanistic, resilient physicians. Academic Medicine 2015; 90(6): 1. PMid:25901874

13 Tempski P, Martins MA, Paro HBMS. Teaching and learning resilience: a new agenda in medical education. Medical Education 2012; 46(4): 345-346. PMid:22429168

14 Tusaie K, Dyer J. Resilience: a historical review of the construct. Holistic Nursing Practice 2004; 18(1): 3-8. PMid:14765686

15 Hegney DG, Buikstra E, Baker P, Pearce S, Ross H, King C, et al. Individual resilience in rural people: a Queensland study, Australia. Rural and Remote Health 2007; 7: 620. Available: web link (Accessed 16 April 2019).

16 Clark S. From burnout to resilience: a general practice perspective. New Zealand Medical Journal [Internet]. 2011; 124(1341): 76-79.

17 Cates AN De, Knott G, Cole-king A, Jones M. ‘Dying to help’: female doctor suicide and the NHS workforce crisis. Journal of Holistic Healthcare 2017; 14(2): 28-35.

18 Maslach C, Leiter MP. Understanding the burnout experience: recent research and its implications for psychiatry. World Psychiatry 2016; 15: 103-111. PMid:27265691

19 Rutherford K, Oda J. Family medicine residency training and burnout: a qualitative study. Canadian Medical Education Journal 2014; 5(1): 13-23. DOI link

20 Eley DS, Cloninger CR, Walters L, Laurence C, Synnott R, Wilkinson D. The relationship between resilience and personality traits in doctors: implications for enhancing well being. PeerJ [Internet]. 2013; 1: 1-16. Available: web link (Accessed 16 April 2019). PMid:24282675

21 Jackson D, Firtko A, Edenborough M. Personal resilience as a strategy for surviving and thriving in the face of workplace adversity: a literature review. Journal of Advanced Nursing 2007; 60(1): 1-9. PMid:17824934

22 Gardiner M, Kearns H, Tiggemann M. Effectiveness of cognitive behavioural coaching in improving the well-being and retention of rural general practitioners. Australian Journal of Rural Health 2013; 21(3): 183-189. PMid:23782287

23 Walters L, Laurence CO, Dollard J, Elliott T, Eley DS. Exploring resilience in rural GP registrars – implications for training. BMC Medical Education [Internet]. 2015; 15(1): 110. Available: web link (Accessed 16 April 2019). PMid:26134975

24 Handoyo NE, Rahayu GR, Claramita M, Keraf M, Octrisdey K, Yuniarti KW, et al. Cross-cultural adaptation of Four Dimensions Adult Personal Resilience Questionnaire into Indonesian rural health context. 10th International Conference on Indigenous and Cultural Psychology [Internet]. 2019. Available: web link (Accessed 8 October 2020).

25 Wei W, Taormina RJ. A new multidimensional measure of personal resilience and its use: Chinese nurse resilience, organizational socialization and career success. Nursing Inquiry 2014; 21(4): 346-357. PMid:24707977

26 Leonardia JA, Prytherch H, Ronquillo K, Nodora RG, Ruppel A. Assessment of factors influencing retention in the Philippine National Rural Physician Deployment Program. BMC Health Services Research 2012; 12(1): 411. Available: web link (Accessed 8 October 2020). PMid:23167701

27 Compton WC. An introduction to positive psychology. Belmont, CA: Thomson Wadsworth, 2005.

28 Handoyo NE, Prabandari YS, Rahayu GR. Identifying motivations and personality of rural doctors: a study in Nusa Tenggara Timur, Indonesia. Education for Health 2018; 31(3): 174-177.

29 Eley DS, Leung J, Hong BA, Cloninger KM, Cloninger CR. Identifying the dominant personality profiles in medical students: implications for their well-being and resilience. PLoS One 2016; 11(8): e0160028. Available: web link (Accessed 8 October 2020). PMid:27494401

30 Central Bureau of Statistics for East Nusa Tenggara Province. Nusa Tenggara Timur Province in figures 2016. [In Indonesian]. Kupang: Central Bureau of Statistics for East Nusa Tenggara Province, 2016.

31 President of Republic of Indonesia. Presidential Regulation of the Republic of Indonesia Number 131 the Year 2015 regarding the Determination of Disadvantaged Areas for the Year 2015–2019. [In Indonesian] [Internet]. 2015. Available: web link (Accessed 9 October 2020).

32 Ministry of Health Republic of Indonesia. Health practitioner to population ratio (for each province) per 100.000 population. [In Indonesian] [Internet]. 2020. Available: web link (Accessed 9 October 2020).

33 Glen S. Statistics How To: Total population sampling. [Internet]. 2018. Available: web link (Accessed 12 April 2019).

34 Indonesian Medical Council. Standard of Indonesian Doctor Competence. [In Indonesian]. 2nd edn. Jakarta: Indonesian Medical Council, 2012.

35 Sugiyono. Educational research methods. [In Indonesian]. Bandung: Alfabeta Publisher, 2008.

36 Food and Agriculture Organization Advantages and disadvantages of survey methods. [Internet]. 2018. Available: web link (Accessed 21 February 2018).

37 Creswell JW. Research design: qualitative, quantitative, and mixed methods approaches. 4th Edn. Thousand Oaks, CA. Sage Publications, 2014.

38 Eddy S. Effect size for Analysis of Variance (ANOVA). [Internet]. 2010. Available: web link (Accessed 29 July 2020).

39 Campbell N, McAllister L, Eley D. The influence of motivation in recruitment and retention of rural and remote allied health professionals: a literature review. Rural and Remote Health 2012; 12: 1900. Available: web link (Accessed 16 April 2019).

40 Viscomi M, Larkins S, Sen Gupta T. Recruitment and retention of general practitioners in rural Canada and Australia : a review of the literature. Canadian Journal of Rural Medicine 2013; 18(1): 13-23.

41 Kondalsamy-Chennakesavan S, Eley DS, Ranmuthugala G, Chater AB, Toombs MR, Darshan D, et al. Determinants of rural practice: positive interaction between rural background and rural undergraduate training. Medical Journal of Australia 2015; 202(1): 41-46. PMid:25588445

42 Laven G, Wilkinson D. Rural doctors and rural backgrounds: how strong is the evidence? A systematic review. Australian Journal of Rural Health 2003; 11: 277-284. PMid:14678410

43 Howe A, Smajdor A, Stockl A. Towards an understanding of resilience and its relevance to medical training. Medical Education 2012; 46(4): 349-356. PMid:22429170

44 Richardson GE. The metatheory of resilience and resiliency. Journal of Clinical Psychology 2002; 58: 307-321. PMid:11836712

45 Gunnestad A. Resilience in a cross-cultural perspective: how resilience is generated in different cultures. Journal of Intercultural Communication 2006; (11): 1121. Available: web link (Accessed 16 April 2019).

46 Kumpfer KL. Factors and processes contributing to resilience: the resilience framework. In: Glantz MD, Johnson JL (Eds). Resilience and development: positive life adaptations. New York, NY: Kluwer Academic Publisher, 1999; 179-224. DOI link

47 Oladipo SE, Idemudia ES. Reliability and validity testing of Wagnild and Young's Resilience Scale in a sample of Nigerian youth. Journal of Psychology 2015; 6(1): 57-65. DOI link

48 Eley DS, Laurence C, Cloninger CR, Walters L. Who attracts whom to rural general practice? Variation in temperament and character profiles of GP registrars across different vocational training. Rural and Remote Health 2015; 15(4): 3426. Available: web link (Accessed 16 April 2019).

49 Sousa C, Hagopianb A. Conflict, health care and professional perseverance: a qualitative study in the West Bank. Global Public Health 2011; 6(5): 520-533. PMid:21623507

50 Hancock C, Steinbach A, Nesbitt TS, Adler SR, Auerswald CL. Why doctors choose small towns: a developmental model of rural physician recruitment and retention. Social Science & Medicine 2009; 69(9): 1368-1376. PMid:19747755

51 Ranmuthugala G, Humphreys J, Solarsh B, Walters L, Worley P, Wakerman J, et al. Where is the evidence that rural exposure increases uptake of rural medical practice? . Australian Journal of Rural Health 2007; 15(5): 285-288. PMid:17760911

52 McDonald GE. Surviving and thriving in the face of workplace adversity: an intervention to improve personal resilience in nurses and midwives. Doctoral thesis. Sydney, NSW: Western Sydney University, 2010.

53 West CP, Dyrbye LN, Sinsky C, Trockel M, Tutty M, Nedelec L. Resilience and burnout among physicians and the general US working population. Jama Network Open 2020; 3(7): 1-11.

54 Mario C. Theories of self-determination. In: Global encyclopedia of public administration, public policy, and governance. Available: web link (Accessed 16 April 2019). DOI link

55 Garin O. Ceiling effect. Encyclopedia of quality of life and well-being research 2014. Available: web link (Accessed 16 April 2019). DOI link

56 Kim S, Esquivel GB. Adolescent spirituality and resilience: theory, research, and educational practices. Psychology in Schools 2011; 48(7): 755-765. DOI link

57 Bethea H, Mayo E, Smit K. Faith and resiliency. Report no. COM 436. Tuscaloosa, AL: University of Alabama Undergraduate Research and Creative Activity Conference, 2016.

58 Malik S, Riaz N, Nazir S. Personal spirituality and work attitudes among doctors. Journal of Behavioural Sciences 2015; 25(1): 136-149.

59 Walker KO, Ryan G, Ramey R, Nunez FL, Beltran R, Splawn RG. Recruiting and retaining primary care physicians in urban underserved communities : the importance of having a mission to serve. American Journal of Public Health 2010; 100(11): 2168-2176. PMid:20935263

60 Inglehart R, Welzel C. The WVS cultural map of the world. World Values Survey 2011. Available: web link (Accessed 8 August 2020).

61 Kusurkar RA, Croiset G, Mann KV, Custers E, Ten Cate O. Have motivation theories guided the development and reform of medical education curricula? A review of the literature. Academic Medicine 2012; 87(6): 735-743. PMid:22534597

62 Kusurkar RA, Ten Cate TJ, Van Asperen M, Croiset G. Motivation as an independent and a dependent variable in medical education: a review of the literature. Medical Teacher 2011; 33(5): 142-159. PMid:21517676

63 Warburton J, Moore ML, Clune SJ, Hodgkin SP. Extrinsic and intrinsic factors impacting on the retention of older rural healthcare workers in the north Victorian public sector : a qualitative study. Rural and Remote Health 2014; 14: 2721. Available: web link (Accessed 16 April 2019).

64 Mills J, McKimm J. Resilience: Why it matters and how doctors can improve it. British Journal of Hospital Medicine 2016; 77(11): 630-633. PMid:27828741

65 Ministry of Health Republic of Indonesia. ‘Nusantara Sehat’ at a glance. [In Indonesian] [Internet]. 2017. Available: web link (Accessed 3 December 2018).

66 Ministry of Health Republic of Indonesia. Distribution of doctor associated with doctor’s motivation to work in underserved areas. [In Indonesian] [Internet]. 2013. Available: web link (Accessed 16 April 2019).

67 Notter ML, MacTavish KA, Shamah D. Pathways toward resilience among women in rural trailer parks. Family Relations 2008; 57(5): 613-624. DOI link

68 Indonesian Medical Council. Faculty of Medicine data 2020. [In Indonesian] [Internet]. 2020. Available: web link (Accessed 9 October 2020).

69 Cole-king A. Doctors under pressure need resilience, not mental toughness. 2015. Available: web link (Accessed 2 August 2020).

70 Peninsula School of Primary Care. Survive and Thrive – a resilience framework for GP trainees. [Internet]. 2018. Available: web link (Accessed 6 August 2020).