Content area
Full text
Paper #1: Noise in the Process: A Meta-Analysis of Mediation Effects in Marketing Journals
Aaron Charlton, College of Business, Illinois State University, USA
Amanda Montoya, Department of Psychology, University of California Los Angeles, USA
John Price, WU, Vienna University of Economics and Business, Austria
Joe Hilgard, College of Arts and Sciences, Illinois State University, USA
Paper #2: Outlier Exclusion Procedures Must be Blind to the Researchers' Hypothesis
Quentin André, Leeds School of Business, University of Colorado Boulder, USA
Paper #3: A Framework for Imputing Choice Shares from Rating Data
Ioannis Evangelidis, ESADE, Universität Ramon Llull, Spain
Paper #4: A Recipe for Honest Consumer Research
Stijn van Osselaer, SC Johnson College of Business, Cornell University, USA
Chris Janiszewski, Warrington College of Business, University of Florida, USA
SESSION OVERVIEW
Ten years ago, two papers launched a quiet revolution in behavioral research. Daryl Bem's "Feeling the Future" provided 9 experiments demonstrating an impossible result: People possess pre-cognitive ability, such that they react to stimuli that they have not seen yet. The same year, Simonsohn, Simmons and Nelson's "False-Positive Psychology" (2011) showed that common practices in behavioral research (e.g., not reporting all conditions and measures, or deciding when to stop data collection) allowed researchers to provide significant evidence for impossible results (e.g., that listening to "When I'm 64" by The Beatles can lower people's age by more than a year).
These concerning results prompted soul-searching efforts among behavioral researchers and launched a new stream of methodological research. On the one hand, large-scale data collection efforts have examined the replicability of behavioral research in general (Ebersole et al., 2016; Klein et al., 2014, 2018; Open Science Collaboration, 2015), or of highly-influential findings (IJzerman et al., 2020; Klein et al., 2019).
On the other hand, papers have re-examined the research practices of behavioral researchers, and offered suggestions to increase the rigor and replicability of behavioral science. In psychology, some papers have for instance discussed the value of analyzing the cumulative amount of statistical evidence present in a paper (Simonsohn et al., 2013), or argued for pre-registration as a way to achieve greater replicability (van't Veer & Giner-Sorolla, 2016). In marketing, other papers have for instance discussed how to increase power in experiments (Meyvis & Van Osselaer, 2018), or under which conditions...