Simulating the bounds of plausibility: Estimating the impact of high-risk versus population-based approaches to prevent firearm injury

Abstract

Background

Firearm violence remains a persistent public health threat. Comparing the impact of targeted high-risk versus population-based approaches to prevention may point to efficient and efficacious interventions. We used agent-based modeling to conduct a hypothetical experiment contrasting the impact of high-risk (disqualification) and population-based (price increase) approaches on firearm homicide in New York City (NYC).

Methods

We simulated 800,000 agents reflecting a 15% sample of the adult population of NYC. Three groups were considered and disqualified from all firearm ownership for five years, grouped based on prevalence: low prevalence (psychiatric hospitalization, alcohol-related misdemeanor and felony convictions, 0.23%); moderate prevalence (drug misdemeanor convictions, domestic violence restraining orders, 1.03%); and high prevalence (all other felony/misdemeanor convictions, 2.30%). Population-level firearm ownership was impacted by increasing the price of firearms, assuming 1% price elasticity.

Results

In this hypothetical scenario, to reduce firearm homicide by 5% in NYC, 25% of the moderate prevalence group, or 12% of the high prevalence group needed to be effectively disqualified; even when all of the low prevalence group was disqualified, homicide did not decrease by 5%. An 18% increase in price similarly reduced firearm homicide by 5.37% (95% CI 4.43–6.31%). Firearm homicide declined monotonically as the proportion of disqualified individuals increased and/or price increased. A combined intervention that both increased price and effectively disqualified “high-risk” groups achieved approximately double the reduction in homicide as any one intervention alone. Increasing illegal firearm ownership by 20%, a hypothetical response to price increases, did not meaningfully change results.

Conclusion

A key takeaway of our study is that adopting high-risk versus population-based approaches should not be an “either-or” question. When individual risk is variable and diffuse in the population, “high-risk approaches” to firearm violence need to focus on relatively prevalent groups and be highly efficacious in disarming people at elevated risk to achieve meaningful reductions in firearm homicide, though countering issues of social justice and stigma should be carefully considered. Similar reductions can be achieved with population-based approaches, such as price increases, albeit with fewer such countering issues.

Introduction

In 2019, approximately 40,000 individuals were killed with firearms in the United States (US); among those, almost 37% were designated as homicides [1]. Mass shootings regularly capture national headlines and media attention [2], often coupled with calls for increased governmental regulation of firearm purchases, ownership, and use [3]. However, mass shootings are by far the smallest category of gun death. Further, there are over two to three times as many non-fatal firearm injuries as death [4,5], which places an extraordinary burden on emergency departments and trauma centers throughout the country.

Leading prevention strategies prohibit firearm access based on individual characteristics thought to increase the risk of firearm injuries, such as mental health ajudications and criminal records. Such strategies are “high-risk approaches” to intervention [6], in that individuals belonging to specific groups thought to be at elevated risk for gun violence are specifically targeted [7,8]. These approaches aim to reduce risk among high-risk individuals, particularly in the near term. However, the true risk associated with prohibiting categories varies greatly [9], with some actually at relatively low risk of violence perpetration. While high-risk approaches such as disqualifications are porous in effectivness if not enforced or not well targeted based on risk, they remain a central yet controversial focus of firearm control in the US [10], and are thus important to consider. A high-risk approach may even have population-level impacts when the predictive power is strong, prevalence is high, and the response mechanism is effective and has sufficient reach [11,12]. However, it is challenging for high-risk approaches to produce population-level effects given the ubiquity of gun violence, the difficulty of predicting who will commit harms with firearms [13], possible misclassification of at-risk individuals, potential loopholes in the background check system, and the existence of the black market [14–17].

As the US is estimated to have the highest rates of civilian firearm ownership in the world [18], an alternative to the high-risk approach would be to follow the examples of other countries (e.g., Australia [19]) and limit access to firearms across the population, regardless of risk, a “population-based approach” [6]. Population-based methods that are highly effective typically involve product price and use. Taxes on products that adversely impact public health are among the most effective [20–25] and cost-effective [22,26–28] means of reducing negative consequences of use, both in the US and worldwide. While there are many population-based approaches to firearm control that could hypothetically be considered to reduce firearm violence in the US, there are increasing efforts to influence firearm pricing through taxation [29], and implementation of ammunition and firearm purchase taxes, thus a focus on violence prevention through price control in the US is a feasible consideration.

The ability of taxation to influence product sales depends on the product’s price elasticity. Price elasticity refers to the percentage change of a product in response to a percentage change in another, such that if a product’s price elasticity of demand is -1.5, a 10% increase in price causes the quantity demand to fall 15%. Available evidence indicates that firearms used for criminal purposes have a relatively low elasticity [30–32], but firearms and ammunition purchased for recreation and safety are relatively price elastic [33,34]. Cook et al. demonstrated that homicide is elastic to gun ownership prevalence, suggesting that measures to reduce ownership, including gun costs, are viable approaches to reduce homicide but may have limited impact on other crimes [35]. While firearms used for assaults resulting in homicide are often carried by individuals who procure them illegally [36], most firearms in the US are obtained through legal means [37], either through a licensed dealer or secondary market [38]. Thus, there is potential to affect public health outcomes by controlling the legal market.

Evaluating the potential impact of high-risk versus population-based approaches to reducing firearm violence ideally would involve randomized trials or other experimental evidence [39,40], which are not easy to conduct. Instead, we can use simulation methods to illustrate the principles that underlie high-risk and population-based approaches, alone and in combination, under different assumptions [40–42]. Such hypothetical scenarios have the unique advantage of allowing us to quickly illustrate numerous interventions, vary assumptions about their enforcement, and leverage available empirical information in the literature regarding firearm injury and purchase denial criteria. However, simulation scenarios are imperfect. It can be challenging to estimate the effects of gun disqualifications as there are many groups already disqualified who have used firearms (e.g., based on age, immigration status, involvement with the legal system) and limited evidence on price elasticity across levels of firearm ownership, especially given other data limitations.

We illustrate central principles of the high-risk versus population-based approach using an agent-based modeling simulation to explore how firearm disqualifications and price elasticity affect firearm ownership and use in violence in synthetic New York City. The scenarios are hypothetical abstractions of the ‘real world,’ given data limitations and the need to make varying assumptions about the proportion of owned guns used in violence. Nevertheless, theoretical examples demonstrate public health approaches to reducing firearm-related morbidity and mortality through simulating health outcomes given changes in access to firearms.

In sum, to reduce firearm-related homicide in the population by increasingly high percentages, we tested adjusting the efficacy of disqualification criteria and increasing firearm and ammunition pricing. Further, we estimated the combined effect of disqualification criteria and price increases on firearm-related homicide. In doing so, we present the potential bounds of reductions in firearm-related homicide for each approach.

Methods

We developed an agent-based model (ABM) simulating the dynamic processes contributing to firearm-related homicide in New York City (NYC). Fig A.1.1 in S1 Appendix illustrates the relations included in the model [42–45]. In addition, S1 Appendix includes a description of the model following the ODD (Overview, Design concepts, Details) protocol [46,47], initialization parameters and default values (Table A1.2 in S2 Appendix), flow charts illustrating steps in the model (Figs A1.2 and A1.3 in S1 Appendix), and final calibration formulae for key model parameters. The data used to parameterize this model consists of previously collected, de-identified, aggregated data. The study meets the requirements by Columbia University’s Institutional Review Board (#AAAO6752) for a waiver of informed consent under 45 CFR 46.116(a) and 45 CFR 46.116(d).

Agent population and neighborhoods

The population of 800,000 agents was initialized to approximate a 15% sample of the NYC adult population aged 18–84 years in 2010 [42,48–51]. Agent attributes are described fully in S1 Appendix. Agents were assigned to neighborhoods, proportionate to population and size; distributions of age, sex, race/ethnicity, and household income matched Census data for the 59 NYC community districts in 2010 [49]. New agents enter the model at age 18 and age through the lifecourse; their behaviors and outcomes are influenced by past trends as they enter the model.

Social network and neighborhood influences

Each agent was assigned a target number of close social ties [52] based on age, sex, race/ethnicity, education, gun-carrying and ownership, drinking, drug use, and spatial proximity [52,53]. Agents’ probability of involvement in violence or gun-carrying increased if they had a social tie involved with violence or gun-carrying [54]. As a result, homicides and firearm-related homicides were clustered in certain social networks, following observed real-life dynamics.

Agents were embedded in neighborhoods. Predictive equations drawing on data from NYC were used to model the strength of the relationship between neighborhood characteristics (e.g., demographics, average mental health and suicide, violence and substance use) and homicide (S1 Appendix).

Aging, mortality, movement

Each model step represented one year, and the model ran for 30 years. At each time step, agents aged, a proportion of agents moved to a new neighborhood [55,56], and agents died consistent with 2010 NYC adult all-cause mortality [57].

Gun-carrying and ownership

At each timestep, agents could have firearms in their household and separately carry firearms. We modeled household guns and gun-carrying independently in order to allow agents to use guns without legal purchase (e.g., through non-licensed or illegal markets or exchanged within their social network). Probabilities of household firearms and gun-carrying were calibrated to National Comorbidity Survey Replication (NCS-R) [58] estimates based on demographics, history of victimization and perpetration, and substance use. Previous lifetime ownership influenced ownership at each timestep based on data from a survey conducted among US adults 18 years or older in 2013 by (http://www.yougov.com) [59]. We also allowed for agents with social network ties to agents who carried or had household firearms to use those firearms (S1 Appendix) [54].

High-risk approaches to firearm ownership disqualification

We chose firearm disqualification categories based on their similarity with prohibited groups identified in the Gun Control Act of 1968 or state policies limiting firearm access by group with some variation in definitions based on data availability or for the purpose of exploration. We grouped examples of firearm disqualifications based on the prevalence of the criteria in the population to demonstrate how the size of the group targeted for disqualification is related to population impact [60,61]; membership in each group was not mutually exclusive. Details on data used for each category are provided in sections below.

Low prevalence disqualifications included 1) Office of Mental Health (OMH)-identified psychiatric hospitalization (throughout the model, the yearly average number of hospitalizations was 112/100,000), 2) alcohol-related misdemeanor (117/100,000), and 3) and felony (10/100,000) convictions; the rate of firearm-related homicide among the low prevalence group was 12/100,000. We note that psychiatric hospitalization alone does not result in firearm prohibition in much of the US. However, we use it in our models as a proxy for the prohibiting category, “committed to a mental institution”, which often does not include voluntary admissions. The association between mental illness and firearm violence is small and inconsistent [62,63], whereas alcohol-related convictions substantially increase risk of firearm violence [64].

Moderate prevalence disqualifications included 1) drug misdemeanor convictions (532/100,000) and 2) DVROs (517/100,000); the rate of firearm-related homicide among the moderate prevalence group was 22/100,000 in the model. Drugs convictions [65,66] and intimate partner violence [67] are both substantially associated with an increased risk of firearm violence.

High prevalence disqualifications included 1) all other felony convictions (i.e., drug and violent felonies) (753/100,000) and 2) misdemeanor convictions (i.e., larceny, impersonation) (1,652/100,000); the rate of firearm-related homicide among the high prevalence group was 17/100,000. People convicted or arrested for a violent felony or misdemeanor [68] are at a substantially increased risk for firearm violence. Less is known about associations with nonviolent misdemeanor convictions. Agents who met multiple groups’ criteria were disqualified from gun ownership based on the criteria met for their first disqualification. Agents meeting criteria for each prohibition were restricted from gun ownership and purchasing for five years. This disqualification timeframe is recommended for mental health hospitalization based on the Consortium for Risk-Based Firearm Policy [60], and for consistency, we set all interventions to five years. Gun-carrying remained possible for prohibited agents, as outlined below.

Population approach to firearm ownership: Price increases

We simulated the impact of increasing price on firearm ownership by implementing price elasticity based on empirical evidence [31,38]. While information on the specific price elasticity of firearms in the US is scant, prior studies have shown that legal handgun and other gun purchases are sensitive to price [31,38]. Ownership was determined based on increasing the price by a certain percentage, multiplied by the price elasticity. Note that while we conceptualize this as a price increase through taxation, the model is agnostic to the mechanism through which the price was increased. Thus, this simulation is conceptualized as an intervention that effectively increases the cost of gun ownership through taxation, ammunition taxes, or other interventions that would manipulate the price of legal market firearms. Elasticity was varied in sensitivity analysis. Gun carrying did not increase due to changes in illicit ownership after price increases in the base model; rather the increase in illicit gun carrying after price increases was modeled in a sensitivity analysis (see below).

Psychiatric hospitalization

We modeled psychiatric hospitalization using data from the 2013 Patient Characteristics Survey. This questionnaire collects information on all individuals in the public mental health system in New York, including inpatient psychiatric stays [69,70]. We calibrated the number of psychiatric hospitalizations to match the number of NYC adults hospitalized for psychiatric reasons identified by the NY State Office of Mental Health, based on race, age, and borough (i.e., Bronx, Brooklyn, Manhattan, Queens, Staten Island).

Perpetration, arrests, convictions, and incarceration

Agents could be arrested, charged, and convicted with a felony or misdemeanor. Arrest probabilities were calculated from 2008–2014 National Survey on Drug Use and Health (NSDUH) data and included past 12-month arrests and reason for arrest (see S1 Appendix for equations).

After an alcohol-related, drug-related, or other type of arrest, agents were convicted of a misdemeanor or felony. However, under New York Penal Law §70.02, any crime designated as violent is considered a felony. We calculated conviction probabilities from the New York State Division of Criminal Justice Services (DCJS) 2011–2014 data for NYC based on sex, race, age, and borough. At each step, an agent could have up to seven convictions: a violent felony, an alcohol-related misdemeanor or felony, a drug-related misdemeanor or felony, or another type of misdemeanor or felony.

An agent convicted of a felony had a probability of incarceration based on NYC Department of Corrections [71], Justice Atlas data [72], and Survey of Inmates in State and Federal Correctional Facilities (SISCF) data [73]. Details on agent activity while incarcerated can be found in S1 Appendix.

Intimate partner violence and domestic violence restraining orders

Agents could be victims and perpetrators of intimate partner violence (IPV). Using NCS-R data, probabilities were based on demographics, relationship and cohabitation status, household firearms and carrying status at previous time steps, history of violent and intimate partner victimization and perpetration, and substance use. Rates were calibrated to National Intimate Partner and Sexual Violence Survey 2010 report data [74]. IPV perpetrators could also have a Domestic Violence Restraining Order (DVRO) based on New York State Unified Court System [75].

Homicide outcomes

Potential victims and perpetrators of violence were identified at each timestep, and violent incidents occurred, including homicides. Potential perpetrators (i.e., agents with a high predicted probability of perpetrating violence) searched a 15-cell radius around their location for potential victims (i.e., agents with a high probability of being victimized); any such agents who had not already been victimized at that time step were matched to a perpetrator. The potential victim was protected from violence only if a police officer was present within a 2-cell radius of the victim. Perpetration-victim matches could be due to IPV, which was modeled probabilistically based on sex and marital/dating status.

If the assault victim (IPV or non-IPV) was also a potential homicide victim, based on Office of Chief Medical Examiner (OCME) data [76], the violent incident became a homicide. Rates were calibrated to 2008–2014 NYC vital statistics data [77] based on race, sex, age, drug and alcohol use [78,79].

Homicide outcomes were influenced by social network [54,80], incarceration [81], and firearm ownership statuses [82,83]. Additionally, firearm-related homicide probability increased due to firearm ownership [83,84] and carrying statuses [82]. When a homicide occurred, it was determined to be firearm-related if the victimized agent was a potential firearm-related homicide victim and the victim or perpetrator owned, carried, or had access to a firearm through their social network.

Model calibration and intervention scenarios

During model calibration, ABM estimates were compared to empirical data. An iterative process [85] was used to adjust predictive equations and initial conditions in the model (see Table 1).

[Figure omitted. See PDF.]

After a burn-in period to stabilize estimates, each model scenario was run 100 times for 30 years. The mean across runs was reported for outcomes of interest; 95% confidence intervals (CI) reflect variation across runs. The model was developed using the Recursive Porous Agent Simulation Toolkit for Java (RepastJ, version 3.0) and implemented in Eclipse (version 4.6.1).

For the high-risk intervention approach, we determined what proportion of individuals (within each prevalence category) would need to be effectively disarmed for the homicide rate to decrease by ~5%. We then re-estimated how effective firearm disqualification criteria would need to be across prohibited groups to obtain higher reductions in homicide, up to a 100% effectiveness assumption. Similarly, for the population approach, we adjusted the increase in price necessary to reduce firearm-related homicide by 5%, 10%, etc. Because of the stochastic nature of the agent-based model, there was random variation in the percent reductions across simulations that approached the target decrease in firearm-associated homicide.

Finally, we estimated the combined impact of high-risk and population approaches. For each reduction bracket (e.g., 5%, 10%, etc.), we combined the estimates of the proportion of the prohibited group effectively prevented from ownership along with the needed price increase to estimate the decrease in firearm-related homicide if all strategies were implemented simultaneously. For example, if 25% of the moderate prevalence prohibited group needs to be effectively disqualified or price needs to increase by 18% to achieve 5% reduction in homicide, the combined intervention effect estimates the expected reduction in homicide with 25% disqualification in the moderate prevalence prohibited group and 18% price increase.

Sensitivity analyses

1) Because data on the price elasticity of firearms is relatively scarce, we varied the price elasticity to both 0.5% and 2%. 2) Given the realistic assumption that some people will purchase a gun illegally (via a straw purchase, borrowing, or theft) when priced out of the legal market [10,86], we increased gun-carrying—our marker of unlawful access to firearms—(by 5%, 10%, and 20%) when the price increased in a sensitivity analysis. Specifically, for each 1% increase in price, we increased the prevalence of gun carrying (regardless of gun ownership) by 5, 10, and 20%.

Results

Table 2 displays the simulation results of reducing firearm-related homicide in 5% brackets, up to 25%. We show the percentage of individuals who must effectively be disarmed (percent efficacy) in each prohibited group and the firearm price increase required to achieve the percentage reduction.

[Figure omitted. See PDF.]

Estimated impact of high-risk approaches and price increases on firearm-related homicide

As shown in the first row of Table 2, even if 100% of individuals in the low-prevalence prohibited group were identified and effectively disqualified from gun purchasing, the maximum reduction of firearm-related homicide would be an average of 1.96% (95% CI 1.07–2.85%).

As the size of the disqualified group increased, the proportion of the group that would have to be effectively denied to reduce firearm-related homicide by 5% decreased: 25% among a moderate prevalence prohibited group (5.15% reduction, 95% CI 3.35–5.95%), or 12% among a high prevalence prohibited group (5.33% reduction, 95% CI 4.45–6.20%). In contrast, an 18% increase in price would reduce firearm homicide by 5.37% (95% CI 4.43–6.31%).

We then increased the desired reduction in firearm-related homicide to 10% using the same approach. To reduce firearm-related homicide by ~10%, firearm disqualification would need to be 55% effective among a moderate prevalence prohibited group (9.99% reduction, 95% CI 9.37–10.62%) or 25% among a high prevalence prohibited group (10.23% reduction, 95% CI 9.39–11.08%). Alternatively, overall firearm price would need to increase by 35% (9.65% reduction, 95% CI 8.78–10.52%).

We proceeded to evaluate the percent efficacy needed for increasing reductions in homicide. When the desired reduction was more extreme, the proportion of prohibited individuals who needed to be disarmed increased to 100% regardless of prohibited group prevalence, and even then, desired reductions could not be achieved in some cases.

Reducing the firearm-related homicide rate by 30% or more could not be achieved by disqualifying any prohibited group that we modeled, even at 100% efficacy. In addition, the price of firearms would need to increase by an estimated 300% to achieve this reduction (30.54% reduction, 95% CI 29.83–31.26%).

Estimated impact of combined high-risk and population approaches on firearm-related homicide

Table 2 also presents the additional decrease in firearm-related homicide resulting from implementing all of the high-risk approaches (at the level of effective enforcement identified for an isolated desired effect) simultaneously, along with the price increase necessary to achieve the desired result.

For example, if the percent efficacy of firearm disqualification was enforced for low, moderate, and high prevalence prohibited groups at 100%, 25%, and 12%, respectively, while simultaneously increasing price by 18%, we estimated that firearm-related homicide would decrease by 12.34% (95% CI 11.40–13.27%), as opposed to the ~5% reduction each intervention could achieve alone.

For the 5%, 10%, and 15% groups, the increase in price coupled with reductions in ownership by prohibited groups achieved approximately double the decrease in firearm-related homicide than any intervention could achieve in isolation.

Sensitivity analysis

Changing the price elasticity of firearm purchases.

Results are shown in S2 Appendix. Overall, the results confirm our initial analyses, where combined interventions result in approximately double the decrease in firearm-related homicide. However, to reduce firearm-related homicide, you would need to increase the price by approximately 50% with a 2% increase in price elasticity and double the increase in price with a 0.5% increase in price elasticity.

Reducing the efficacy of price increases through changes in illicit markets.

Because it is difficult to estimate the extent to which the illicit firearm market changes following a price change in the licit market using existing data, sensitivity analyses provided insight into the potential impact of increased illicit gun purchases on firearm-related homicide reductions. We increased firearm carrying for each percentage increase in price by 5%, 10%, and 20%. The results are shown in S2 Appendix. Increasing the percentage of gun carrying even by 20% did not affect the impact on firearm-related homicide. As firearm ownership accounts for most firearms in the model (even with the most restrictive intervention, ownership prevalence is still >13%), even increasing carrying by 20% is still less than a 1% increase in total firearm availability in the model. Thus this small increase combined with the decrease in ownership does not affect the firearm-related homicide rate.

Discussion

We simulated a hypothetical example of how restrictions on firearm access can have heterogeneous impacts on firearm-related homicide based on the size of the group restricted and whether a high-risk, population-based, or combined approach is used. Our hypothetical experiment found that modest (5–10%) reductions in firearm homicide were achieved through firearm disqualification among individuals meeting hypothetical disqualification criteria, even when those high-risk approaches were imperfectly enforced. The magnitude of the effect depends on the size of the group disqualified, the level of enforcement, and the concentration of firearm violence in each group. The same reductions could be achieved with increases in firearm price of about 18–35%. For larger decreases in firearm homicide (20% or higher), firearm disqualification in the hypothetical experiment needed to be virtually perfectly implemented and effective, and decreases of similar magnitude with increases in firearm price became unfeasible. Combined implementation of firearm purchase denial criteria for prohibited groups and price increases produced the greatest reduction in firearm-related homicide.

These results illustrated the principle that the effectiveness of a high-risk approach is dependent on the size of the groups considered to be “high risk,” and simultaneously, the strength of the relationship between the high-risk criterion and firearm violence and the extent to which the “high-risk” group is effectively disarmed. All three are critical in conjunction; that is, the size of the group is meaningless if individuals in the group do not have high concentration of the outcome, or if the intervention is ineffective. Prevalence, however, is also key. Because the prevalence of psychiatric hospitalizations in the population was low [62,63,87], and the causal effect of psychiatric illness on perpetration of firearm violence is weak and nuanced [63], disqualifying this group from purchasing firearms resulted in a small reduction in firearm-related homicide, even assuming perfect enforcement. While there may be other reasons to consider firearm control among those with particular psychiatric disorders, such as reduced suicide [88], our model suggests there would be a negligible impact on homicide.

In contrast, those convicted of a misdemeanor or felony are a much larger group, and the associations with violent perpetration are stronger [11,89], which leads to a larger reduction in firearm-related homicide even under imperfect enforcement of firearm purchase disqualifications. The high-risk approach faces numerous challenges, however. Available data from Massachussetts indicate that over 60% of individuals arrested for firearm violence perpetration are disqualified from gun ownership by federal law [90]; to the extent that these individuals owned or carried guns despite disqualification, it reduces the utility of high-risk approaches focused on ownership disqualification. Approaches to high-risk firearm owner identification and enforcement of firearm removal such as recent efforts in California provide frameworks to consider how to improve the efficacy of disqualification policies [91]. These gun-disqualification considerations, however, should also be evaluated in light of economic and racial injustices in the criminal legal system [92], as well as potential increases in stigma of criminal legal system involvement if more civil liberties are eroded with convictions.

An alternative, or adjunctive, hypothetical approach would be a population-based approach, including to increase price. While this approach burdens low-income more than high-income groups, it does not target any group in particular for a legal restriction on firearm access. We find that modest price increases can have the same impact on the population firearm homicide rate as enacting purchase denials for prohibited groups in synthetic NYC, considering that such denials are imperfectly implemented across US states. The example of price control is just one of an array of population-based strategies that countries have considered, and public health models of potential efficacy could feasibly be conducted for any number of population-based strategies; our model provides an example of one strategy, and the conclusion that we draw illustrates fundamental principles of public health. Indeed, a key takeaway of our study is that adopting high-risk versus population-based approaches should not be an “either-or” question. The greatest reduction in firearm-related homicide was achieved in this hypothetical example by adopting a combination of high-risk approaches that prohibited individuals meeting criteria for (adapted) firearm disqualification criteria, combined with population-based approaches that increased the price of firearms. Further, price increases affect many other areas of the firearm market, and are influenced by exogenous policies, laws, and events, thus price increases may have variable effectiveness and sustainability based on other factors [31,93]. Given the concerns about stigmatizing specific groups of people and enforcing firearm purchase disqualification criteria, future research should build on this work by identifying specific policies that effectively combine high-risk and population-based approaches. Additional ‘high-risk’ approaches such as extreme risk protection orders (or “red flag laws”) [94,95] and firearm buy-back programs [96] may be useful targets for estimating impacts on homicide in future work.

The present simulation study is a hypothetical example that does not perfectly reflect reality; for example, there are other high-risk groups that we could have modeled (e.g., those under 21), gun disqualifications differ at local and state levels, and further, the vast majority (over 60%) of people who perpetrate homicide already have a disqualification from gun ownership [90]. Further, we made broad assumptions about gun purchase elasticity that may not reflect the number of guns owned by consumers, specific products, differences in elasticity based on legal versus illegal ownership/carrying, or the purchase patterns of guns at different price points. The purpose of our simulation was to illustrate the underlying principles of the high-risk and population-based approaches using hypothetical examples, but not to recreate true underlying dynamics of disqualification and purchasing behavior. Further, modeling firearm ownership and firearm carrying remain challenging due to the lack of comprehensive data.

While there is tremendous interest in reducing the impact of gun violence in the United States, there remains substantial disagreement about how to achieve meaningful and sustained reductions in violence using a policy response. Price increases have been a cornerstone of public health responses for many other products that damage the public’s health, and modest increases in price can have even more impact when coupled with high-risk interventions that reduce firearm access. As always, however, equity and civil liberty concerns need to be constantly evaluated; too often policy responses in the US have the unintended consequence of increasing health and criminal justice inequities, and as these decisions are increasingly debated in public and private discourse, continued attention to reducing inequity should be at the forefront.

Supporting information

S1 Appendix. Description of ABM using the ODD protocol.

Fig A1.1. Diagram of relations between agent, social network, and neighborhood characteristics in the agent-based model. Table A1.1. Agent, social network, and neighborhood parameters, values, data sources, and update rules. Table A1.2. Agent-based model initialization parameters and default values. Fig A1.2. Flow diagram illustrating steps in model initialization. Fig A1.3. Flow diagram illustrating processes occurring at each step of the model.

https://doi.org/10.1371/journal.pone.0269372.s001

(DOCX)

S2 Appendix. Sensitivity analyses.

Table A2.1. Simulation of gun-related homicide in New York City after implementing firearm disqualification and price increases with a 1% price elasticity, increase in carrying among those who do not own by 5%. Table A2.2. Simulation of gun-related homicide in New York City after implementing firearm disqualification and price increases with a 1% price elasticity, increase in carrying among those who do not own by 10%. Table A2.3. Simulation of gun-related homicide in New York City after implementing firearm disqualification and price increases with a 1% price elasticity, increase in carrying among those who do not own by 20%.

https://doi.org/10.1371/journal.pone.0269372.s002

(DOCX)

Citation: Keyes KM, Hamilton A, Tracy M, Kagawa RMC, Pear VA, Fink D, et al. (2022) Simulating the bounds of plausibility: Estimating the impact of high-risk versus population-based approaches to prevent firearm injury. PLoS ONE 17(6): e0269372. https://doi.org/10.1371/journal.pone.0269372

About the Authors:

Katherine M. Keyes

Roles: Conceptualization, Funding acquisition, Investigation, Supervision, Writing – original draft, Writing – review & editing

E-mail: [email protected]

Affiliation: Department of Epidemiology, Mailman School of Public Health, Columbia University, New York, New York, United States of America

Ava Hamilton

Roles: Data curation, Formal analysis, Visualization, Writing – original draft

Affiliation: Department of Epidemiology, Mailman School of Public Health, Columbia University, New York, New York, United States of America

Melissa Tracy

Roles: Data curation, Methodology, Writing – review & editing

Affiliation: Department of Epidemiology and Biostatistics, State University of New York at Albany, Albany, New York, United States of America

Rose M. C. Kagawa

Roles: Methodology, Writing – review & editing

Affiliation: Department of Emergency Medicine, Violence Prevention Research Program, School of Medicine, University of California, Davis, Sacramento, California, United States of America

Veronica A. Pear

Roles: Investigation, Writing – original draft

Affiliation: Department of Emergency Medicine, Violence Prevention Research Program, School of Medicine, University of California, Davis, Sacramento, California, United States of America

https://orcid.org/0000-0002-2462-3785

David Fink

Roles: Writing – review & editing

Affiliation: Division of Translational Epidemiology, New York State Psychiatric Institute, New York, New York, United States of America

Charles C. Branas

Roles: Investigation, Writing – review & editing

Affiliation: Department of Epidemiology, Mailman School of Public Health, Columbia University, New York, New York, United States of America

Magdalena Cerdá

Roles: Conceptualization, Funding acquisition, Investigation, Methodology, Supervision, Writing – original draft, Writing – review & editing

Affiliation: Department of Population Health, New York University Langone Health, New York, New York, United States of America

References

1. Murphy SL, Xu J, Kochanek KD, Arias E, Tejada-Vera B. National Vital Statistics Reports Volume 69, Number 13 January 12, 2021. Natl Vital Stat Reports. 2021. Available: https://www.cdc.gov/nchs/products/index.htm.

2. Wintemute GJ. How to stop mass shootings. New England Journal of Medicine. 2018. pmid:30257162

3. Reeping PM, Cerdá M, Kalesan B, Wiebe DJ, Galea S, Branas CC. State gun laws, gun ownership, and mass shootings in the US: cross sectional time series. BMJ. 2019;364. pmid:30842105

4. Kaufman EJ, Wiebe DJ, Xiong RA, Morrison CN, Seamon MJ, Delgado MK. Epidemiologic Trends in Fatal and Nonfatal Firearm Injuries in the US, 2009–2017. JAMA Intern Med. 2021;181: 237–244. pmid:33284327

5. Gani F, Sakran J V., Canner JK. Emergency department visits for firearm-related injuries in the United States, 2006–14. Health Aff. 2017;36: 1729–1738. pmid:28971917

6. Rose G. Sick individuals and sick populations. Int J Epidemiol. 1985;14: 32–38. pmid:3872850

7. Braga AA, Wintemute GJ, Pierce GL, Cook PJ, Ridgeway G. Interpreting the empirical evidence on illegal gun market dynamics. J Urban Heal. 2012. pmid:22669643

8. Webster DW, Vernick JS, Bulzacchelli MT. Effects of state-level firearm seller accountability policies on firearm trafficking. J Urban Heal. 2009. pmid:19479382

9. Wintemute GJ. Background Checks For Firearm Purchases: Problem Areas And Recommendations To Improve Effectiveness. 2019;38: 1702–1710. pmid:31589523

10. Webster DW, Wintemute GJ. Effects of Policies Designed to Keep Firearms from High-Risk Individuals. Annu Rev Public Health. 2015;36: 21–37. pmid:25581152

11. Cook PJ, Ludwig J, Braga AA. Criminal records of homicide offenders. J Am Med Assoc. 2005. pmid:16077054

12. Webster DW, Cerdá M, Wintemute GJ, Cook PJ. Epidemiologic Evidence to Guide the Understanding and Prevention of Gun Violence. Epidemiologic Reviews. 2016. pmid:26905892

13. Lidz CW, Mulvey EP, Gardner W. The Accuracy of Predictions of Violence to Others. JAMA J Am Med Assoc. 1993.

14. Miller M, Hepburn L, Azrael D. Firearm acquisition without background checks: Results of a national survey. Annals of Internal Medicine. 2017. pmid:28055050

15. Vittes KA, Vernick JS, Webster DW. Legal status and source of offenders’ firearms in states with the least stringent criteria for gun ownership. Inj Prev. 2012. pmid:22729164

16. Kagawa RMC, Castillo-Carniglia A, Vernick JS, Webster D, Crifasi C, Rudolph KE, et al. Repeal of comprehensive background check policies and firearm homicide and suicide. Epidemiology. 2018. pmid:29613872

17. Castillo-Carniglia A, Kagawa RMC, Cerdá M, Crifasi CK, Vernick JS, Webster DW, et al. California’s comprehensive background check and misdemeanor violence prohibition policies and firearm mortality. Ann Epidemiol. 2019. pmid:30744830

18. Karp A. Estimating global civilian-held firearms numbers. Small Arms Surv Available http//www.smallarmssurvey.org/fileadmin/docs/T-Briefing-Papers/SAS-BP-Civilian-Firearms-Numbers.pdf. 2018.

19. Chapman S, Stewart M, Alpers P, Jones M. Fatal firearm incidents before and after Australia’s 1996 national firearms agreement banning semiautomatic rifles. Annals of Internal Medicine. 2018. pmid:29532070

20. Babor T. Alcohol: no ordinary commodity: research and public policy. Oxford University Press; 2010.

21. Wagenaar AC, Salois MJ, Komro KA. Effects of beverage alcohol price and tax levels on drinking: a meta-analysis of 1003 estimates from 112 studies. Addiction. 2009/01/20. 2009;104: 179–190. pmid:19149811

22. Chaloupka FJ, Straif K, Leon ME. Effectiveness of tax and price policies in tobacco control. Tobacco Control. 2011. pmid:21115556

23. Chaloupka FJ, Yurekli A, Fong GT. Tobacco taxes as a tobacco control strategy. Tobacco Control. 2012. pmid:22345242

24. Teng AM, Jones AC, Mizdrak A, Signal L, Genç M, Wilson N. Impact of sugar-sweetened beverage taxes on purchases and dietary intake: Systematic review and meta-analysis. Obes Rev. 2019. pmid:31218808

25. Cabrera Escobar MA, Veerman JL, Tollman SM, Bertram MY, Hofman KJ. Evidence that a tax on sugar sweetened beverages reduces the obesity rate: A meta-analysis. BMC Public Health. 2013. pmid:24225016

26. Anderson P, Chisholm D, Fuhr DC. Effectiveness and cost-effectiveness of policies and programmes to reduce the harm caused by alcohol. Lancet. 2009;373: 2234–2246. Available: http://thelancet.com/journals/lancet/article/PIIS0140-6736(09)60744-3/abstract. pmid:19560605

27. Ranson MK, Jha P, Chaloupka FJ, Nguyen SN. Global and regional estimates of the effectiveness and cost-effectiveness of price increases and other tobacco control policies. Nicotine Tob Res. 2002. pmid:12215240

28. Cecchini M, Sassi F, Lauer JA, Lee YY, Guajardo-Barron V, Chisholm D. Tackling of unhealthy diets, physical inactivity, and obesity: Health effects and cost-effectiveness. The Lancet. 2010.

29. Smart R. Firearm and Ammunition Taxes. RAND Res Gun Policy Am Available https//www.rand.org/research/gun-policy/analysis/essays/firearm-and-ammunition-taxes.html. 2018.

30. Balkin S, McDonald J. A Market Analysis for Handguns and Gun Control Issues. In: Kates D, editor. Firearms and Violence. San Francisco: Pacific Institute for Public Policy Research; 1984.

31. Bice DC, Hemley DD. The market for new handguns: An empirical investigation. Journal of Law and Economics. 2002.

32. Polsby DD, Brennen D. Taking Aim at Gun Control. Heartl Policy Study Available http//www.rkba.org/research/polsby/polsby-ps.htm. 1995.

33. Pinho R, Rappa J. Special Taxes on Guns, Ammunition, and Gun Shows. Hartford, Conn: Connecticut General Assembly, Office of Legislative Research, OLR Research Report 2013-r-0034; 2013.

34. Cook PJ, Braga AA, Moore MH. Gun control. In: Wilson JQ, Petersilia J, editors. Crime and Public Policy. New York, NY: Oxford University Press; 2011. https://doi.org/10.1016/S0262-4079(13)60494-7

35. Cook PJ, Ludwig J. The social costs of gun ownership. J Public Econ. 2006.

36. Cook PJ, Parker ST, Pollack HA. Sources of guns to dangerous people: What we learn by asking them. Prev Med (Baltim). 2015. pmid:25937592

37. Wintemute GJ. Ghost guns: spookier than you think they are. Inj Epidemiol. 2021;8: 1–3.

38. Cook PJ. Gun Markets. Annu Rev Criminol. 2018.

39. Marshall BD, Galea S. Formalizing the role of agent-based modeling in causal inference and epidemiology. Am J Epidemiol. 2015;181: 92–99. pmid:25480821

40. Tracy M, Cerdá M, Keyes KM. Agent-Based Modeling in Public Health: Current Applications and Future Directions. Annu Rev Public Health. 2018;39: 1–18.

41. Keyes KM, Shev A, Tracy M, Cerdá M. Assessing the impact of alcohol taxation on rates of violent victimization in a large urban area: an agent-based modeling approach. Addiction. 2019. pmid:30315599

42. Cerdá M, Tracy M, Keyes KM, Galea S. To Treat or to Prevent?: Reducing the Population Burden of Violence-related Post-traumatic Stress Disorder. Epidemiology. 2015;26: 681. pmid:26237744

43. Cerdá M, Tracy M, Keyes KM. Reducing Urban Violence: A Contrast of Public Health and Criminal Justice Approaches. Epidemiology. 2018;29: 142–150. pmid:28926374

44. Keyes KM, Shev A, Tracy M, Cerda M. Assessing the impact of alcohol taxation on rates of violent victimization in a large urban area: an agent-based modeling approach. under Rev.

45. Cerdá M, Tracy M, Ahern J, Galea S. Addressing population health and health inequalities: The role of fundamental causes. Am J Public Health. 2014;104. pmid:25100428

46. Grimm V, Berger U, Bastiansen F, Eliassen S, Ginot V, Giske J, et al. A standard protocol for describing individual-based and agent-based models. Ecol Modell. 2006;198: 115–126.

47. Grimm V, Berger U, DeAngelis DL, Polhill JG, Giske J, Railsback SF. The ODD protocol: A review and first update. Ecol Modell. 2010;221: 2760–2768.

48. U.S. Census Bureau 2010. Summary Files 1. 2010.

49. Infoshare Online. American Community Survey, 2006–2010 5-yr average. [cited 24 Jan 2019]. Available: http://www.infoshare.org.

50. Infoshare Online. American Community Survey, 2012–2016 5-yr average. [cited 31 Jan 2019]. Available: http://www.infoshare.org.

51. Cerda M, Tracy M, Keyes KM. Reducing Urban Violence: A Contrast of Public Health and Criminal Justice Approaches. Epidemiology. 2018;29: 142–150. pmid:28926374

52. Marsden P V. Core Discussion Networks of Americans. Am Sociol Rev. 1987;52: 122–131.

53. McPherson M, Smith-Lovin L, Brashears ME. Social isolation in America: Changes in core discussion networks over two decades. Am Sociol Rev. 2006;71: 353–375.

54. Tracy M, Braga AA, Papachristos A V. The Transmission of Gun and Other Weapon-Involved Violence Within Social Networks. Epidemiologic Reviews. 2016. pp. 70–86. pmid:26733492

55. Goldmann E, Aiello A, Uddin M, Delva J, Koenen K, Gant LM, et al. Pervasive exposure to violence and posttraumatic stress disorder in a predominantly African American Urban Community: The Detroit neighborhood health study. J Trauma Stress. 2011;24: 747–751. pmid:22144187

56. Sharkey P. Stuck in Place: Urban Neighborhoods and the End of Progress Toward Racial Equality. University of Chicago Press; 2013. Available: https://books.google.com/books?id=R-b_NlPJeuUC.

57. New York City Department of Health and Mental Hygiene. Summary of Vital Statistics 2010: The City of New York. 2010 [cited 29 Jan 2019] p. Tables P2 and M2. Available: https://www1.nyc.gov/assets/doh/downloads/pdf/vs/2010sum.pdf.

58. Kessler RC, Merikangas KR. The National Comorbidity Survey Replication (NCS-R). Int J Methods Psychiatr Res. 2004;13: 60–68. pmid:15297904

59. Kalesan B, Villarreal MD, Keyes KM, Galea S. Gun ownership and social gun culture. Inj Prev. 2016;22: 216–220. pmid:26124073

60. Consortium for Risk-Based Firearm Policy. Guns, Public Health and Mental Illness: An Evidence-Based Approach for State Policy. Available at: http://www.jhsph.edu/research/centers-and-institutes/johns-hopkins-center-for-gun-policy-and-research/publications/GPHMI-State.pdf. 2013.

61. McGinty EE, Frattaroli S, Appelbaum PS, Bonnie RJ, Grilley A, Horwitz J, et al. Using research evidence to reframe the policy debate around mental illness and guns: Process and recommendations. Am J Public Health. 2014;104: e22–e26. pmid:25211757

62. Swanson JW, Easter MM, Robertson AG, Swartz MS, Alanis-Hirsch K, Moseley D, et al. Gun violence, mental illness, and laws that prohibit gun possession: Evidence from two florida counties. Health Aff. 2016;35: 1067–1075. pmid:27269024

63. Swanson JW, McGinty EE, Fazel S, Mays VM. Mental illness and reduction of gun violence and suicide: Bringing epidemiologic research to policy. Annals of Epidemiology. 2015. pp. 366–376. pmid:24861430

64. Kagawa RMC, Stewart S, Wright MA, Shev AB, Pear VA, McCort CD, et al. Association of Prior Convictions for Driving Under the Influence With Risk of Subsequent Arrest for Violent Crimes Among Handgun Purchasers. JAMA Intern Med. 2020;180: 35–43. pmid:31566654

65. Cerdá M, Messner SF, Tracy M, Vlahov D, Goldmann E, Tardiff KJ, et al. Investigating the effect of social changes on age-specific gun-related homicide rates in New York City during the 1990s. American Journal of Public Health. 2010. pmid:20395590

66. Bellair PE, Mcnulty TL. Gang membership, drug selling, and violence in neighborhood context. Justice Q. 2009. pmid:25429188

67. Zeoli AM, McCourt A, Buggs S, Frattaroli S, Lilley D, Webster DW. Analysis of the Strength of Legal Firearms Restrictions for Perpetrators of Domestic Violence and Their Association With Intimate Partner Homicide. Am J Epidemiol. 2017. pmid:29194475

68. Wintemute GJ, Wright MA, Drake CM, Beaumont JJ. Subsequent Criminal Activity Among Violent Misdemeanants Who Seek to Purchase Handguns. JAMA. 2001. pmid:11209172

69. New York State Office of Mental Health. Patient Characteristics Survey. In: Office of ITS/EIM Division [Internet]. 2013 [cited 27 Jun 2018]. Available: https://www.omh.ny.gov/omhweb/pcs/submissions/2013/guidelines.pdf.

70. New York States Office of Mental Health. GUIDELINES FOR COMPLETING THE 2013 PATIENT CHARACTERISTICS SURVEY. 2013. Available: https://omh.ny.gov/omhweb/pcs/submissions/2013/guidelines.pdf.

71. Department of Correction. Prison Population Demographics Q3 2016. [cited 7 Oct 2016]. Available: http://www1.nyc.gov/site/doc/about/doc-statistics.page.

72. Cardora E. Justice Atlas of Sentencing and Corrections. 2010 [cited 24 May 2018]. Available: https://www.justiceatlas.org/.

73. Bureau of Justice Statistics. Survey of Inmates in State Correctional Facilities (SISCF), 2004.

74. Black MC, Basile KC, Smith SG, Walters ML, Merrick MT, Chen J, et al. National Intimate Partner and Sexual Violence Survey: 2010 Summary Report. Natl Cent Inj Prev Control Centers Dis Control Prev. 2011.

75. Bender JP, Marie A, Director S, Staff V, Schaefer B, Palombo D, et al. NYS Division of Criminal Justice Services Office of Program Development and Funding. 2014.

76. Messner SF, Galea S, Tardiff KJ, Tracy M, Bucciarelli A, Piper TM, et al. Policing, drugs, and the homicide decline in New York City in the 1990s. Criminology. 2007;45: 385–414.

77. Centers for Disease Control and Prevention, National Center for Health Statistics. Underlying cause of death 1999–2017. In: CDC WONDER Online Database. 2018.

78. Galea S, Ahern J, Tracy M, Hubbard A, Cerda M, Goldmann E, et al. Longitudinal determinants of posttraumatic stress in a population-based cohort study. Epidemiology. 2008;19: 47–54. pmid:18091003

79. Kaplan MS, McFarland BH, Huguet N, Conner K, Caetano R, Giesbrecht N, et al. Acute alcohol intoxication and suicide: A gender-stratified analysis of the National Violent Death Reporting System. Inj Prev. 2012;19: 38–43. pmid:22627777

80. Papachristos A V., Wildeman C, Roberto E. Tragic, but not random: The social contagion of nonfatal gunshot injuries. Soc Sci Med. 2015;125: 139–150. pmid:24560101

81. Zlodre J, Fazel S. All-cause and external mortality in released prisoners: Systematic review and meta-analysis. American Journal of Public Health. 2012. pmid:23078476

82. Branas CC, Richmond TS, Culhane DP, Ten Have TR, Wiebe DJ. Investigating the link between gun possession and gun assault. Am J Public Health. 2009;99: 2034–2040. pmid:19762675

83. Anglemyer A, Horvath T, Rutherford G. The accessibility of firearms and risk for suicide and homicide victimization among household members: A systematic review and meta-analysis. Ann Intern Med. 2014. pmid:24592495

84. Wiebe DJ. Homicide and suicide risks associated with firearms in the home: A national case-control study. Ann Emerg Med. 2003;41: 771–782. pmid:12764330

85. Windrum P, Fagiolo G, Moneta A. Empirical Validation of Agent - Based Models: Alternatives and Prospects. J Artif Soc Soc Simul. 2007;10: 1–21. doi:Article.

86. Knight B. State Gun Policy and Cross-State Externalities: Evidence from Crime Gun Tracing. Am Econ J Econ Policy. 2013;5: 200–229. Available: http://www.jstor.org.ezproxy.cul.columbia.edu/stable/43189358.

87. Heslin KC, Weiss AJ. Hospital Readmissions Involving Psychiatric Disorders, 2012. Healthc Cost Util Proj. 2015.

88. Keyes KM, Hamilton A, Swanson J, Tracy M, Cerdá M. Simulating the suicide prevention effects of firearms restrictions based on psychiatric hospitalization and treatment records: Social benefits and unintended adverse consequences. Am J Public Health. 2019;109. pmid:31242005

89. Bailey JE, Kellermann AL, Somes GW, Banton JG, Rivara FP, Rushforth NP. Risk factors for violent death of women in the home. Arch Intern Med. 1997. pmid:9125010

90. Braga AA, Cook PJ. The Criminal Records of Gun Offenders. Georg J Law Public Policy. 2016;14.

91. Laqueur HS, Wintemute GJ. Identifying high-risk firearm owners to prevent mass violence. Criminol Public Policy. 2020;19: 109–127.

92. Coker D. Foreword: Addressing the real world of racial injustice in the criminal justice system. Journal of Criminal Law and Criminology. 2003.

93. McDougal TL, Montolio D, Brauer J. Modeling the U.S. Firearms Market: The Effects of Civilian Stocks, Crime, Legislation, and Armed Conflict. SADO Work Pap Ser. 2020. Available: http://www.ieb.ub.edu.

94. Gondi S, Pomerantz AG, Sacks CA. Extreme Risk Protection Orders: An Opportunity to Improve Gun Violence Prevention Training. Acad Med. 2019. pmid:31397705

95. Pear VA, Garen;, Wintemute J, Jewell NP, Ahern J. Firearm Violence Following the Implementation of California’s Gun Violence Restraining Order Law. JAMA Netw Open. 2022;5: e224216–e224216. pmid:35380646

96. Makarios MD, Pratt TC. The effectiveness of policies and programs that attempt to reduce firearm violence: A meta-analysis. Crime Delinq. 2012.