The Social Determinants of Health: Time to Re-Think?

Abstract

Twelve years have now passed since the influential WHO Report on the Social Determinants of Health (SDoH) in 2008. A group of senior international public health scholars and decision-makers met in Italy in mid-2019 to review the legacy of the SDoH conceptual framework and its adequacy for the many challenges facing our field as we enter the 2020s. Four major categories of challenges were identified: emerging “exogenous” challenges to global health equity, challenges related to weak policy and practice implementation, more fundamental challenges related to SDoH theory and research, and broader issues around modern research in general. Each of these categories is discussed, and potential solutions offered. We conclude that although the SDoH framework is still a worthy core platform for public health research, policy, and practice, the time is ripe for significant evolution.

1. Purpose/Rationale

The underlying concept of the social determinants of health (SDoH) has a long public health history [1]. More recently, the WHO Commission on SDoH Report of 2008 [2,3] represented a major milestone in that history, reaching a much wider public than previously. Since this landmark report, much research has attempted to document the impact of SDoH thinking on health policy, health disparities, and public health practice. However, many prominent observers have judged “the health gap” across social classes not to be closing in most societies over the last decade [4,5,6,7]. Strikingly, despite this negative finding, few researchers—McQueen, Crammond and Carey, and Schrecker being notable exceptions [8,9,10]—appear to have seriously questioned the conceptual SDoH framework itself.

The international authors of this paper held a think tank in the summer of 2019 to discuss potential limitations of the traditional SDoH framework and possible approaches to updating it. This paper summarizes their thoughts, emphasizing areas of agreement. The aim of the group was not to critique SDoH concepts purely for the sake of being critical (though we appreciate that many academics would find that laudable). Nor did we reach the point of proposing a new approach to “replace” the SDoH framework, which has been a helpful beacon for progressive public health policy and practice for a dozen years. Rather, in this paper we identify some emerging global issues as well as theoretical and methodological critiques of the SDoH conceptual framework that, in our view, should provoke public health professionals and researchers to rethink that framework. In sum, we identify 15 emerging global issues across four broad categories that provoke us to ask whether the SDoH framework ought to be rethought and updated. We believe this is just the beginning of a long and complex process necessarily involving many diverse international stakeholders, for which we only hope to provide the stimulus. 2. Previous Critical Commentaries on the SDoH Approach

In his 2009 editorial [8] “Three challenges for the social determinants of health pursuit,” McQueen identifies three specific challenges facing those who would implement the SDoH perspective:

• The foundational basis for the SDoH approach is “ancient,” with written materials dating back hundreds of years, documenting the ubiquity of health inequalities by socioeconomic status. This in turn means that it is very difficult to “create a sense of urgency” to address these perennial phenomena observed in virtually all human societies. Indeed, the biblical observation that “the poor are always with us” (Deuteronomy 15) captures the kind of inured and complacent audience reaction which frequently occurs when SDoH ideas are presented, especially to policy stakeholders.
• The measurement of “what is social” is problematic. McQueen points to a persistent lack of convincing conceptual work in public health publications around the complex construct of social class and its profound nonequivalence to simple unidimensional markers such as individual income or education, let alone area-based measures such as indices of multiple deprivation, which can have remarkably different implications in different settings.

• The etiological evidence base is relatively well-developed for social determinants as key causal factors affecting health status. However, the evidence base for the effectiveness of specific public health interventions (programs and policies) to reduce overall ill health in a society, while also reducing health inequalities by socioeconomic status (SES), is much less well developed [11].

Crammond and Carey, writing in 2017 [9] for a social-science audience, point out that policy-making to reduce health inequalities is essentially a normative process, requiring more explicitly political analysis and activity rather than merely empirically based efforts to assemble “evidence” for decision-making. Yet, most research to support SDoH-based policies and programmes has been overwhelmingly framed as “evidence” [2,3,4,5].

Schrecker [10], writing a decade after McQueen, calls attention to the “hard (difficult) politics of inequality,” which he blames for much of the apparent ineffectiveness of policies in several countries which have at least tried to reduce socioeconomic inequalities and related health disparities. He is particularly convincing on the role of international trade agreements in maintaining both economic and health inequalities, combined with transnational corporations’ normal operating methods—including shifting profits/jobs to lower-tax/pay settings, aided and abetted by the shadowy world of global tax shelters. Such forces have been conspiring for decades to make it harder and harder for even the most committed national governments to actually reduce socioeconomic inequalities “in their own backyards”—indeed, the fences around those backyards are now completely porous. We pick this topic up again below in identifying missing elements in traditional (pre-2009) SDoH writings that are important considerations today in public health policy-making and practice.

3. Emerging Challenges to the SDoH Model We see the following major challenges to traditional SDoH thinking that have either grown or emerged over time: 3.1. Emerging “Exogenous” Challenges to Global Health Equity

• Emergence and recognition of ever more complex and “wicked” public health problems. For example, the obesity pandemic continues unabated in high-income countries (HICs) and is rapidly growing in lower- and middle-income settings (LMICs), despite widespread policy and program efforts to control it. One challenge to SDoH thinking is that obesity is not consistently socially patterned internationally. Indeed, obesity tends to demonstrate “reverse social gradients” in some HIC adult male populations, and more widely in LMICs [12]. This suggests that SDoH concepts are not well-suited to helping public health professionals and policy makers deal effectively with obesity at a global scale. As the widely cited Foresight Report on Obesity in the UK pointed out more than a decade ago [13], using the word “determinants” in relation to such a complex, system-level problem seems problematically reductionistic.

• In a similar vein, over the last decade there has been increasing recognition of the importance of government legislation/regulation to control “marketable health hazards” to combat the ongoing global rise in noncommunicable/chronic diseases. Such hazards include poor-quality and energy-dense food and drink, alcohol, tobacco and psychoactive drugs, and gambling (especially online) [14,15,16]. Yet, typical SDoH writings appear unclear—or at least uninformed—about the specific sections and levels of government at which such decisions are actually taken, making targeted, effective advocacy more difficult.

• Increased multisectorality of global health and development thinking: The UN Sustainable Development Goals (SDGs) cover many sectors. On the one hand, health is explicitly prominent in only 1 of its 17 Goals. On the other hand, in line with the “health in all policies” terminology, health is typically interpreted by public health advocates as inherent in all of the SDGs. This is an expansion of those SDoH writings that can be read as assuming that all societies should value health outcomes above others—so-called “health-ism.” This issue is extensively discussed by Crammond and Carey [9].

• Increasing scientific evidence and public recognition that socioeconomic inequality, per se, probably has a causal relationship to the suboptimal “performance” of many societies globally, extending well beyond health outcomes [17,18,19,20,21]. This recognition has led to an increased emphasis on equity-oriented public policy-making, with a focus on redistributive tax and transfer (welfare benefits) policies as key levers for achieving increased societal inequity [22,23,24]. SDoH writings before 2009 often do not prioritize tax and transfer policies in this way.

• Increased recognition by the global public health community that climate change and environmental degradation (barely mentioned in the main SDoH writings) are core priorities for public health, in partnership with many others in civil society. Fortunately, it is quite possible to update SDoH thinking to incorporate the repeated observation that the poorest and least educated persons in any society are most affected by incipient climate change and environmental degradation, so that, in fact, the environmental justice movement fits well into SDoH concepts [25].

• SDoH approaches tend to avoid the “relationality” in the unequal distribution of resources for health. SDoH thinking tends to focus on “deprivation,” saying nothing about the privileged side. However, insofar as health inequalities are socially made or reproduced (i.e., they are preventable “inequities”), their generation and perpetuation represent an issue of political power and economic influence [19,20,21]. SDoH writings traditionally appear to avoid confronting this issue head-on, perhaps for strategic reasons related to the conservative political environment during the years after the WHO Commission Report in 2008, which, of course, coincided with the 2008 recession.

3.2. Challenges Related to Weak Policy and Practice Implementation There are recurring lacunae among publications expounding the traditional SDoH model concerning the most frequent “pitfalls” and threats to the actual implementation of effective and widely acceptable policies and programs to improve health equitably in the real world:

• Lack of in-depth analysis of institutions’ key role in codetermining how well-intended, pro-equity policies and programs are finally executed in communities: Institutions—whether NGOs, government-based, or academic—all have a role in supporting, both in spirit and financially, key areas of SDoH work. For example, the WHO played a key role in creating excitement about the SDoH with the Marmot report (2005–8). However, the WHO, like all large global institutions, is a microcosm of diverse ministries of health and political leaders of all types who constantly want to move on to new agendas. It thus sometimes appears to act rapidly onto the next exciting idea before the last one has been fully implemented. Such influential institutional behaviours are worthy of more study.

• Institutions are often affected by the overarching influence of cultural and political beliefs and related national politics: In the USA’s Healthy People 2020 planning process, for example, the SDoH played a role, but it was minor. Even before the Trump period, there was a distinct lack of enthusiasm for SDoH ideas at the top of US public health leadership, a situation that could only get worse under the current government. Notably, there has been a sharp falloff of support for SDoH in the USA, reflected in rising right-wing political activities globally, which signals a move away from the “social.” Lack of financial support for SDoH policies then follows in lockstep [26].

• Insufficient attention to the precise public sector context for intervention (i.e., the precise sections and levels of government most likely to be able to action policy and program advice in a given setting concerning SDoH): As mentioned in the previous section, providing advice to public health professionals on interventions to improve health equitably without clearly specifying which section and level of government should be the priority target of advocacy efforts can seriously impair those advocates’ effectiveness. For example, the radical 2012 Lansley reforms of England’s previously NHS-based public health system were sold by the Tory-led coalition government on the basis that there would be clear population health benefits from relocating public health services out of the NHS to some 200 local authorities (LAs) across England. Specifically, it was argued that this reorganisation would enable those professionals to have more access to decisions made by local authorities (LAs), such as zoning and licensing of fast-food or alcohol/tobacco outlets, potentially having a strong impact on NCD risk factors in an equitable way. That argument systematically avoided pointing out that public health professionals immersed in the local bureaucracies of LAs might well be unable to engage simultaneously in effective national-level advocacy. That failure of dual tasking by public health might in turn be expected to reduce the chances of successful control of noncommunicable disease risk factors through national-level legislation or regulation, as has been advocated by many experts [14,15,16]. This is particularly the case for increased taxes on unhealthy foods and drinks or subsidies on healthy ones—policy options now widely advocated by public health experts [15], which necessarily require advocacy at the national level aimed at that level of government, which largely controls such taxes and transfers—certainly within the UK.

• Innovative approaches to the governance of programs/policies/interventions: Given the deep complexity of many current public health challenges (e.g., the obesity pandemic) and the need to involve multiple actors of “pluralistic society,” it is essential to innovate public/voluntary sector governance in order to avoid “pouring new wine into old wineskins.” The cocreation approach [27,28,29], for instance, accepts this complexity and the several “multis” linked to it (multilevel, multidisciplinary, multi-actors, etc.). This approach focuses on searching for common objectives across the typically diverse stakeholder constituencies with an interest in such challenges.

• Weak analysis of, and planning for, powerful and sophisticated political opposition to proequity policies and programs: In many pre-2009 writings about SDoH, there appears to be a slightly naïve unwillingness to acknowledge the virtual certainty of explicit and profound opposition by powerful vested interests to policies likely to improve health equitably. Policy-analytic approaches originating in political science, including the careful identification of “interest groups” around any proposed legislation or regulation, would better enable public health professionals to plan for, and succeed in overcoming, such daunting opposition. A particularly disturbing example is the protracted resistance on the part of the British food production, processing, marketing, and distribution firms to shift their obesogenic practices that massively contribute to that slow global pandemic [14,15].

3.3. More Fundamental Challenges Related to SDoH Theory and Research There are weaknesses in much public health research, including that intended to support SDoH approaches, which have held back the generation of robust and practical evidence needed to guide policy-making to improve health equitably. These include the following:

• SDoH research tends to focus on individuals/populations as more or less passive “victims of deprivation/inequality” and thus “carriers of risks”: This reflects a limited and rather paternalistic view; more importantly, it leaves unexplored the potential agency of people to use social resources for health. The early SDoH approach included the broader sense of agency by referring to A. Sen’s “capability” approach [30] but later dropped it.

• Persistent focus on, and repetition of, mere descriptions of health and other inequalities: Although some public health research has been brilliant at analysing the underlying origins and drivers of social and economic inequalities in health, the vast bulk of such research rarely goes beyond increasingly more “precise” description. This continued focus on description has led to a paucity of studies on “how and why” to change things—developing and testing feasible policy and program interventions to guide policy makers in improving health equitably. More recently, critical social scientists have provided strong theoretical frameworks to support the development of a new field of “public health intervention research” to address previous shortcomings in this arena [31,32].

• Weak research theory and methods for assessing the socioeconomic redistributive effects of public health interventions (i.e., whether they increase or decrease health inequalities): As an example, a recent review of the degree to which the existing evaluations of all sorts of public health interventions have adhered to widely accepted methodological criteria for assessing an intervention’s differential effects, in this case across different socioeconomic groups, shows that remarkably few studies to date have passed this basic test of quality [9]. Analogously, there has been inadequate development of theory to support public health interventions’ evaluations, especially related to their distributional effects [33]. This weakness is accompanied by widespread failure among public health researchers to understand and address the complex interplay of structural conditions and individual agency [34].

• Excessive reliance on traditional scientific ideas about “generalizability” (external validity) of evidence: Biomedical science, viewing all human beings as members of one “genetically bottlenecked” species, has traditionally tended to assume biological equivalence across human societies for biomedical interventions. Notably, even that is increasingly coming into question—for example, due to humans’ surprising genetic and epigenetic diversity. However, policy and program interventions aimed at changing human behaviour for health gains are typically so contextualized by the sociocultural and political setting of their implementation that their effects (both desired and undesired) may be virtually impossible to extrapolate generally. Fortunately, recent social science innovations in both “realist evaluation” and “complex intervention” methodologies are shifting public health practice towards a more explicit characterization of the context of any such interventions, which are the mainstay of chronic disease prevention through behavioural change [35,36]. Explicitly addressing instead of ignoring or controlling context effects could be achieved by more use of parallel case studies of particular settings’ influence on such variation in a given intervention’s effects.

• Excessive reliance on randomization in intervention trials: The randomised controlled trial (RCT) still reigns supreme in the eyes of many public health experts, even when randomization is not feasible or ethical, or more cost-effective, compared with sophisticated quasi-experimental/observational study designs from sociology and economics, which are especially well suited to evaluating policy and program effectiveness across societies and time periods [37,38,39]. However, epidemiology, “the basic science of public health,” has been slow to adopt these new study designs.

3.4. Broader Issues around Modern Research A more fundamental development is that the state of the art in scientific research at large is currently being challenged, and sometimes undermined, by current societal trends. Two such trends are illustrative: research funding and publishing. Research funding bodies—both governmental and private—privilege conservative traditional research, often falling behind in the adoption of newer (but sometimes riskier) research methods. Publishing houses for peer-reviewed research tend to reinforce this traditional conservatism, a point reinforced in our think tank group, which included much editorial experience. Further noted was the now almost complete global dominance of the English language among research funders and publishers, which can perpetuate a conceptually limited range of research models in many fields. The United States, the largest funder of global health research, continues to privilege biomedically oriented investigations. In the public health field, this has contributed to a lack of attention to and interest in complex “messy” questions requiring a more philosophical and historical approach. For example, issues of social and cultural context and the influence on health of different political and governance systems are not given the research attention needed. Multidisciplinary research has become widely acknowledged as important, but it is still not routinely practised because research, funding, and publishing institutions are still more comfortable operating within traditional disciplinary borders.

A current example is the social patterning of COVID-19 cases, hospitalizations, and deaths. Prominent publications have called for more explicit and effective policy consideration of the widely confirmed preponderance of this new burden of illness among the socially disadvantaged, including visible minorities [40]. Yet no policies or programs have been launched in either the UK or the USA to effectively tackle this prominent and profoundly inequitable aspect of the pandemic. It is just as if the relevant research documenting this problem had never been done.

4. Conclusions

Without question, the SDoH conceptual framework has positively altered public health thinking since 2008, and it is still very salient to policy and practice. However, its “fit” to current global challenges across sectors requires recalibration—a “rethink.” Many researchers have shown how health inequalities, despite many well-intended policy interventions to reduce them, are increasing almost everywhere. However, very few public health experts have questioned the SDoH theoretical approach itself, which has inspired most such interventions. Here, we have made the first systematic attempt to show the multiple reasons why the SDoH approach now should be revised. We urge national and international public health organizations, as well as the corresponding research, policy, and practice communities, to face this challenge. One recalls the quotation “All models are wrong, some are useful” [41]. No conceptual framework is suitable for indefinite use: times have changed, new challenges have emerged, public health knowledge has improved, and the arsenals of available methods have grown. It is time for changes to the way we think about SDoH. This is particularly urgent in the (post) COVID-19 times, when, both for differential access to care and for the effects of the economic crisis linked to the pandemic, inequalities in health are likely to increase, showing fragilities unthinkable at the time in which the SDoH paradigm was proposed [42].

Author Contributions

J.F. prepared the first draft of the paper, based on a group workshop in mid-2019, in which all authors fully conceptualized the paper, creating a detailed outline. T.A., S.C. (Stefano Campostrini), S.C. (Sarah Cook), V.K.L. and D.V.M. reading and editing sequential drafts, and finally, responding to all rounds of peer-reviewers' comments, coordinated by J.F. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding. The Stop&Think 2019 think tank received a partial contribution from the Department of Economics at the Ca' Foscari University of Venice.

Conflicts of Interest

The authors declare no conflict of interest.

References

1. Feinstein, J.S. The relationship between socioeconomic status and health: A review of the literature. Milbank Q. 1993, 71, 279-322.

2. WHO Commission on Social Determinants of Health, World Health Organization. Closing the Gap in a Generation: Health Equity through Action on the Social Determinants of Health: Commission on Social Determinants of Health Final Report; World Health Organization: Geneva, Switzerland, 2008.

3. Solar, O.; Irwin, A. A Conceptual Framework for Action on the Social Determinants of Health: Discussion Paper for the Commission on Social Determinants of Health; World Health Organization: Geneva, Switzerland, 2007.

4. Mackenbach, J.P. Can we reduce health inequalities? An analysis of the English strategy (1997-2010). J. Epidemiol. Community Health 2011, 65, 568-575.

5. Marmot, M.; Allen, J.; Bell, R.; Bloomer, E.; Goldblatt, P. WHO European review of social determinants of health and the health divide. Lancet 2012, 380, 1011-1029.

6. McCartney, G.; Popham, F.; Katikireddi, S.V.; Walsh, D.; Schofield, L. How do trends in mortality inequalities by deprivation and education in Scotland and England & Wales compare? A repeat cross-sectional study. BMJ Open 2017, 7, e017590.

7. Lewer, D.; Jayatunga, W.; Aldridge, R.W.; Edge, C.; Marmot, M.; Story, A.; Hayward, A. Premature mortality attributable to socioeconomic inequality in England between 2003 and 2018: An observational study. Lancet Public Health 2020, 5, e33-e41.

8. McQueen, D.V. Three challenges for the social determinants of health pursuit McQueen (Editorial). Int. J. Public Health 2009, 54, 1-2.

9. Crammond, B.R.; Carey, G. Policy change for the social determinants of health: The strange irrelevance of social epidemiology. Evid. Policy 2017, 13, 365-374.

10. Schrecker, T. The Commission on Social Determinants of Health: Ten years on, a tale of a sinking stone, or of promise yet unrealised? Crit. Public Health 2019, 29, 610-615.

11. Inglis, G.; Archibald, D.; Doi, L.; Laird, Y.; Malden, S.; Marryat, L.; McAteer, J.; Pringle, J.; Frank, J. Credibility of sub-group analyses by socioeconomic status in public health intervention evaluations: An underappreciated problem? Soc. Sci. Med. Popul. Health 2018, 6, 245-251.

12. Wang, Y.; Lim, H. The global childhood obesity epidemic and the association between socio-economic status and childhood obesity. Int. Rev. Psychiatry 2012, 24, 176-188.

13. Butland, B.; Jebb, S.; Kopelman, P.; McPherson, K.; Thomas, S.; Mardell, J.; Parry, V. Tackling Obesities: Future Choices-Project Report; Department of Innovation, Universities and Skills: London, UK, 2007; pp. 1-164.

14. Moodie, R.; Stuckler, D.; Monteiro, C.; Sheron, N.; Neal, B.; Thamarangsi, T.; Lincoln, P.; Casswell, S.; Lancet NCD Action Group. Profits and pandemics: Prevention of harmful effects of tobacco, alcohol, and ultra-processed food and drink industries. Lancet 2013, 381, 670-679.

15. Marteau, T.M.; White, M.; Rutter, H.; Petticrew, M.; Mytton, O.T.; McGowan, J.G.; Aldridge, R.W. Increasing healthy life expectancy equitably in England by 5 years by 2035: Could it be achieved? Lancet 2019, 393, 2571-2573.

16. Beaglehole, R.; Bonita, R.; Horton, R.; Adams, C.; Alleyne, G.; Asaria, P.; Baugh, V.; Bekedam, H.; Billo, N.; Casswell, S.; et al. Priority actions for the non-communicable disease crisis. Lancet 2011, 377, 1438-1447.

17. Wilkinson, R.; Pickett, K. The Spirit Level: Why Greater Equality Makes Societies Stronger; Bloomsbury Publishing: London, OH, USA, 2009.

18. Pickett, K.E.; Wilkinson, R.G. Income inequality and health: A causal review. Soc. Sci. Med. 2015, 128, 316-326.

19. Piketty, T. The Economics of Inequality; Translated by Arthur Goldhammer; Beltknap Press Harvard University Press: Cambridge, MA, USA, 2014.

20. Stiglitz, W. The Great Divide; Allen Lane Penguin Books: London, UK, 2015.

21. Dorling, D. Inequality and the 1%; Verso: London, UK, 2014.

22. Lundberg, O. How do welfare policies contribute to the reduction of health inequalities? Eurohealth 2009, 15, 24.

23. Taylor-Robinson, D.; Lai, E.T.; Wickham, S.; Rose, T.; Norman, P.; Bambra, C.; Whitehead, M.; Barr, B. Assessing the impact of rising child poverty on the unprecedented rise in infant mortality in England, 2000-2017: Time trend analysis. BMJ Open 2019, 9, e029424.

24. Barr, B.; Taylor-Robinson, D.; Stuckler, D.; Loopstra, R.; Reeves, A.; Whitehead, M. 'First do no harm': Are disability assessments associated with adverse trends in mental health? A longitudinal ecological study. J. Epidemiol. Community Health 2016, 70, 339-345.

25. Pearce, J.R.; Richardson, E.A.; Mitchell, R.J.; Shortt, N.K. Environmental justice and health: The implications of the socio-spatial distribution of multiple environmental deprivation for health inequalities in the United Kingdom. Trans. Inst. Br. Geogr. 2010, 35, 522-539.

26. Krisberg, K. President's budget would hinder US public health progress: Huge cuts proposed. Nation's Health 2019, 49, 1-14.

27. Stokols, D.; Hall, K.L.; Vogel, A.L. Transdisciplinary Public Health: Core Characteristics, Definitions, and Strategies for Success. In Transdisciplinary Public Health: Research, Methods, and Practice; Haire-Joshu, D., McBride, T.D., Eds.; Jossey-Bass Publishers: San Francisco, CA, USA, 2013; pp. 3-30.

28. Klein, J.T. The Transdisciplinary Moment (um). Integral Rev. 2013, 9, 189-199.

29. Osborne, S.P. From public service-dominant logic to public service logic: Are public service organizations capable of co-production and value co-creation? Public Manag. Rev. 2018, 20, 225-231.

30. Sen, A. Commodities and Capabilities; OUP Catalogue number 9780195650389; Oxford University Press: Oxford, UK, 1999.

31. Hawe, P.; Potvin, L. What is population health intervention research? Can. J. Public Health 2009, 100, I8-I14.

32. Potvin, L. Yes! More research is needed; but not just any research. Int. J. Public Health 2009, 54, 127.

33. Phelan, J.C.; Link, B.G.; Tehranifar, P. Social conditions as fundamental causes of health inequalities: Theory, evidence, and policy implications. J. Health Soc. Behav. 2010, 51, S28-S40.

34. Abel, T.; Frohlich, K.L. Capitals and capabilities: Linking structure and agency to reduce health inequalities. Soc. Sci. Med. 2012, 74, 236-244.

35. Pawson, R.; Greenhalgh, T.; Harvey, G.; Walshe, K. Realist Synthesis: An Introduction; ESRC Research Methods Programme, University of Manchester: Manchester, UK, 2004; Available online: https://pdfs.semanticscholar.org/4351/46e6e6617491ff1c4b32b76e0a534c86d6c7.pdf (accessed on 11 August 2020).

36. Craig, P.; Dieppe, P.; Macintyre, S.; Michie, S.; Nazareth, I.; Petticrew, M. Developing and evaluating complex interventions: The new Medical Research Council guidance. BMJ 2008, 337, a1655.

37. Sanson-Fisher, R.W.; Bonevski, B.; Green, L.W.; D'Este, C. Limitations of the randomized controlled trial in evaluating population-based health interventions. Am. J. Prev. Med. 2007, 33, 155-161.

38. Sanson-Fisher, R.W.; D'Este, C.A.; Carey, M.L.; Noble, N.; Paul, C.L. Evaluation of systems-oriented public health interventions: Alternative research designs. Annu. Rev. Public Health 2014, 35, 9-27.

39. Campostrini, S. Measurement and Effectiveness. Chapter 18. In Global Perspectives on Health Promotion Effectiveness; McQueen, D.V., Jones, C.M., Eds.; Springer: New York, NY, USA, 2007; pp. 305-325.

40. Anderson, G.; Frank, J.W.; Naylor, C.D.; Wodchis, W.; Feng, P. Using socioeconomics to counter health disparities arising from the COVID-19 pandemic. BMJ 2020, 369, m2149.

41. Box, G.E.P.; Draper, N.R. Empirical Model.-Building and Response Surfaces; Wiley: New York, NY, USA, 1987; p. 424. ISBN 0471810339.

42. Mesa Vieira, C.; Franco, O.H.; Gómez Restrepo, C.; Abel, T. COVID-19: The forgotten priorities of the pandemic. Maturitas 2020, 136, 38-41.