In response to concerns that have been raised about reproducibility in biomedical research, the Federation of American Societies for Experimental Biology (FASEB) invited experts, delegates from its member societies (including GSA), and representatives from the National Institutes of Health (NIH), National Science Foundation (NSF), and other stakeholders to discuss general factors that may impede the ability to reproduce experimental results.


It should be emphasized that the challenges in reproducing research results are not due to research misconduct nor to poor research design; rather, they generally result from the lack of uniform definitions, insufficient reporting of specific experimental details, and gaps in our understanding of biological systems. Indeed, variations in results often provide key insights into previously unrecognized phenomena and enhanced understanding of biology.

The dialog convened by FASEB is captured in Enhancing Research Reproducibility, which provides recommendations to promote the reproducibility and transparency of biomedical and biological research. The 15 recommendations in the report, which address actions for researchers, institutions, professional societies, journals, and federal agencies are listed below.

Recommendations:

FASEB identified three overarching recommendations that it believes will help enhance the reproducibility and transparency of research overall:

  1. Scientists, policy makers, and journalists should use precisely defined terms and definitions when discussing research rigor and transparency to promote uniform understanding.
  2. The inability to reproduce research findings among laboratories may result from a lack of sufficient detail in the reporting of critical materials or methods. FASEB
    recommends that professional societies, commercial reagent vendors, scientific journals, and funding agencies engage in a dialog to develop expectations for describing reagents, laboratory tools, and protocols in publications and grant applications.
  3. Rigorous and transparent research is dependent upon adherence to good research practices by all research team members, including but not limited to principal investigators/faculty members, staff scientists, postdoctoral scholars, graduate and undergraduate students, core facility staff, and institutional leadership.

 

The FASEB report also includes focused discussion on some of the research areas that have provided some of the most concern: research using mouse and other animal models—and research using antibodies. Recommendations in these areas are below:

  1. In 2010, two independent groups—the National Centre for the Replacement, Refinement, and Reduction of Animals in Research (NC3Rs) and the Institute for Laboratory Animal Research (ILAR) published guidelines to improve the reporting of research using animals, maximizing the utility of published studies and minimizing the need for additional studies. NC3Rs’s Animal Research: Reporting of In Vivo Experiments (ARRIVE) Guidelines and ILAR’s Guide for the Care and Use of Laboratory Animals  and Guidance for the Description of Animal Research in Scientific Publications serve as useful references. FASEB recommends that institutional animal facilities, Institutional Animal Care and Use Committees (IACUCs), and professional societies work together to promote awareness and use—as appropriate—of the ARRIVE and ILAR guidelines in animal research.
  2. As their research roles expand or change, research team members may require additional training to understand, implement, and report animal husbandry practices and genetic backgrounds of animal subjects. Access to statisticians or additional statistical training may also be necessary to ensure that animal sample sizes are sufficient for the required analyses. FASEB recommends that training resources be made available to the research community on a regular, on demand basis.
  3. The organization, daily operation, environment, and staffing of an animal facility can affect the outcomes of experiments. Therefore, animal facilities and staff should be considered extensions of an investigator’s laboratory and research team. FASEB recommends that investigators include animal facility staff in discussions of relevant aspects of experimental design. FASEB also recommends development of checklists to facilitate review of animal care variables and to denote study-specific variations.
  4. Animal models provide critical insights into human biology and health. When communicating to the public about preclinical studies, researchers should clearly articulate the rationale for the choice of an animal model as well as its value and limitations in recapitulating human disease and its treatment.
  5. Investigators and animal facility staff ensure humane treatment and care of animal subjects by adhering to established guidelines and federal regulations. To minimize environmental effects on experimental outcomes and continue to improve animal care standards, FASEB encourages institutions, veterinarians, and researchers to identify, understand, and promote the adoption of evidence-based husbandry practices. Reporting of animal care practices and study-specific variations will enhance reproducibility.
  6. FASEB recommends that researchers, professional societies, and journals use standard nomenclature when reporting animal husbandry practices, breeding practices, and genetic backgrounds of study subjects in grant applications and publications.
  7. FASEB strongly recommends that researchers, journals, and funding agencies work together to develop and adopt a standard format for citing antibodies in grant applications and publications. At minimum, this standard format should include the complete product name, catalog number, antibody type (monoclonal, polyclonal, or recombinant), vendor, target, lot number, and dilution/concentration.
  8. There is a growing concern that all lab personnel may not fully appreciate the underlying science or limitations of commercially available antibodies or antibody based kits. Although vendor-supplied technical information may help investigators select reagents such as antibodies, this information is insufficient for validation. Therefore, FASEB recommends that stakeholders—including researchers, funding agencies, product vendors, and journals—convene an impartial advisory body to determine information needed for high quality technical bulletins. This might include immunogenic sequence, epitope sequence, cross-species reactivity, and methodologies for which the antibody is validated.
  9. To achieve uniform reporting of research findings, FASEB recommends that investigators, funding agencies, and journals adopt best practices for experiments
    using antibodies. Best practices may vary by field and technique.

 

Finally, FASEB recommended several strategies that it believes will help increase awareness about these issues among scientists:

  1. Rigor and reproducibility are critical for the advancement of science. To improve awareness within the scientific community regarding concerns about the translatability of basic research discoveries to clinical applications, strategies to enhance transparent reporting of research findings, and the new NIH policy that will go into effect on January 25, 2016, FASEB recommends that professional societies emphasize proactive efforts demonstrating the research community’s commitment to rigorous and transparent research. This could take several forms, including editorials in scientific journals, press releases, and development of uniform talking points. These efforts should acknowledge the distinction between strategies to enhance scientific rigor and transparency versus identification of scientific misconduct.
  2. To facilitate investigator access to resources intended to enhance scientific rigor and transparency, FASEB recommends the establishment of a publicly accessible clearinghouse website. This website would aggregate existing training resources and best practices to enhance scientific rigor and transparency, such as those developed by NIH, professional societies, and research consortia. A resource hosted by a third-party such as FASEB would allow distribution of uniform information regardless of discipline or funding agency.
  3. While the goal of FASEB’s rigor and reproducibility roundtables was to develop strategies to assist individual investigators in addressing the NIH policy that will go into effect on January 25, 2016, several opportunities for journals and society publications committees were also identified. Many journals have taken significant actions to address concerns about rigor and reproducibility. FASEB encourages professional societies to continue to enhance scientific rigor and transparency within their specific disciplines and share alternative strategies developed to address these issues.

 

The full report is available for download on the FASEB website.

, , , , , ,

Chloe Poston is the Policy and Communications Manager for the Genetics Society of America where she serves as a liaison to the Public Policy Committee. She has a background in bio-analytical chemistry and science policy.

View all posts by Chloe Poston »

Read more in

  • Collage of 2021 Rosalind Franklin Award recipients

    Where are they now? Rosalind Franklin Young Investigator Award recipients share updates on their research

    Rosalind Franklin Young Investigator Award applications are open–make sure you submit your application or nomination of a colleague by September 30, 2024.

  • University of Minnesota researchers map genome of the last living wild horse species

    The study, published in G3: Genes|Genomes|Genetics, is part of larger conservation efforts to save Przewalski’s horse.

  • Congratulations to the Spring 2024 DeLill Nasser Awardees!

    GSA is pleased to announce the recipients of the DeLill Nasser Award for Professional Development in Genetics for Spring 2024! Given twice a year to graduate students and postdoctoral researchers, DeLill Nasser Awards support attendance at meetings and laboratory courses. The award is named in honor of DeLill Nasser, a long-time GSA supporter and National Science Foundation…

  • Carolyn Damilola headshot

    Carolyn Damilola: an NFS Rising Scientist on a lifelong quest to learn more

    Carolyn Damilola is an NFS Rising Scientist from Nigeria doing respiratory system research and paving the way for scientists from underrepresented communities through mentorship.

  • Text over a blue background image: Apply for up to $2,000 for your project from the Starter Culture Microgrant Program.

    What does a good microgrant proposal look like?

    Members of the Microgrant Review Committee share their tips for a successful proposal.

  • A blurred image of a human face is shown against a dark background.

    The first piece of the facial recognition puzzle

    New research in GENETICS gives a first peek at the molecular pathway involved in recognizing faces.

  • New Senior Editor Amy MacQueen joins GENETICS

    A new senior editor is joining GENETICS in the Genome Integrity and Transmission section. We’re excited to welcome Amy MacQueen to the editorial team.

  • Close up of an adult zebrafish with blue and white stripes in an aquarium with red lighting.

    Block party on the zebrafish sex chromosome

    Research in G3 identifies a gene regulatory block of the zebrafish genome responsible for overseeing the maternal-to-zygotic-transition.

  • Lemna Minor, the common duckweed

    Unraveling the mysteries of duckweed: epigenetic insights from Spirodela polyrhiza

    Research published in G3 offers insight into the impact of DNA methylation on clonal propagation in asexually reproducing plants.

  • Luciano Marraffini headshot

    A microbiologist’s quest to understand CRISPR in bacterial self-defense

    2024 Genetics Society of America Medal recipient Luciano Marraffini determined how CRISPR-Cas systems destroy genetic targets with precision, paving the way for gene editing technology development.

  • Elaine Ostrander headshot

    Unlocking mysteries of trait and disease heritability in dogs

    2024 Edward Novitski Prize recipient Elaine Ostrander, a pioneer of the domestic dog model, discovered numerous genes affecting dog size, morphology, behavior, and disease susceptibility—many of which have relevance in humans.

  • NSF-funded BIO-LEAPS Grant to Support Culture Change in Genetics

    GSA and collaborators Personal Genetics Education & Dialogue and Reclaiming STEM Institute launch NSF-funded BIO-LEAPS project to support culture change in genetics 

    We are thrilled to announce that the Genetics Society of America (GSA) is collaborating with the Personal Genetics Education & Dialogue (PGED) based in the Department of Genetics at Harvard Medical School, and the Reclaiming STEM Institute (RSI) on a Leading Culture Change Through Professional Societies of Biology (BIO-LEAPS) grant from the U.S. National Science…

  • Daman Saluja: Navigating Science and Policy in India

    In the Paths to Science Policy series, we talk to individuals who have a passion for science policy and are active in advocacy through their various roles and careers. The series aims to inform and guide early career scientists interested in science policy. This series is brought to you by the GSA Early Care­er Scientist…

  • Deborah Andrew headshot

    A fly geneticist’s journey into discovering rules of organ development

    2024 George W. Beadle Award recipient Deborah Andrew discovered new genes and pathways in Drosophila salivary gland organogenesis. Now, her work can help optimize cell secretion in therapeutic applications and fight malaria.

  • Małgorzata Gazda's headshot

    Małgorzata Gazda: How receiving the DeLill Nasser Award helped her land her dream job

    Have you ever experienced an event that changes the course of your life, or in this case, your career? Małgorzata (Gosia) Gazda is Assistant Professor at the University of Montreal and in 2022, she received the DeLill Nasser Award for Professional Development in Genetics, which she used to attend and present at the 2022 Population,…

  • Hongyu Zhao joins GENETICS as new Senior Editor

    A new senior editor is joining GENETICS in the Statistical Genetics and Genomics section. We’re excited to welcome Hongyu Zhao to the editorial team.

  • Julio Molina Pineda at TAGC 2024

    GSA Member Julio Molina Pineda Receives DeLill Nasser Award, Shines at TAGC 2024 

    “At any career stage, the GSA membership is an amazing investment for any genetics professional!” Julio Molina Pineda is a PhD Candidate in Cell and Molecular Biology and a Research Assistant at the University of Arkansas, and a Doctoral Academy Fellow at the Lewis Lab. In 2023, Julio was awarded the DeLill Nasser Award for…

  • Ed Grell at his dissecting microscope using ether to anesthetize his flies.

    In Memoriam: Ellsworth Herman Grell (1932–2023), a pioneer of Drosophila genome engineering and annotation

    Ellsworth (Ed) Grell blessed the Drosophila community through three enduring legacies: as a pioneer of chromosome mechanics, as a primary organizer and synthesizer of genetic knowledge in Drosophila, and as a graceful mentor to those fortunate to have known him personally. Ed grew up in rural Nebraska, completed his undergraduate studies at Iowa State, and…

  • Congratulations to the #Fungal24 Poster Award winners!

    We are pleased to announce the recipients of the GSA Poster Awards for posters presented at the 32nd Fungal Genetics Conference! Undergraduate and graduate student members of GSA were eligible for the awards, and a hard-working team of judges made the determinations. Congratulations to all! Felicia Ebot Ojong, The University of Georgia My research is focused…

  • Poster presentation tips for TAGC 2024

    You’ve been selected to present a poster at The Allied Genetics Conference 2024 in March—you’ve celebrated, made plans to attend, now what? This is an exciting opportunity to showcase your research and engage with fellow members of the genetics community, so you want to make sure you’re prepared. We wanted to offer you some tips…

  • Maximize your TAGC 2024 experience 

    A guide to all that National Harbor & DC have to offer Are you joining us for The Allied Genetics Conference 2024 in March? Make the most of your #TAGC24 experience in National Harbor! We know the science will keep you busy, but you deserve to unwind and have some fun, so we’ve curated a…

  • Early Career Leadership Spotlight: Sarah Petrosky

    We’re taking time to get to know the members of the GSA’s Early Career Scientist Committees. Join us to learn more about our early career scientist advocates. Sarah PetroskyMultimedia SubcommitteeUniversity of Pittsburgh Research Interest I am interested in understanding adaptation that has been happening recently in populations by dissecting the ways that genes underlying an adaptation…

  • TAGC 2024 Early Career Award Winners

    GSA is pleased to announce the winners of the early career awards presented at The Allied Genetics Conference 2024. These awards are specific to particular TAGC communities and recognize early career scientists’ outstanding work on their respective research organisms. The awardees will present their talks in keynote sessions at TAGC 2024.  Don’t miss the opportunity…

  • Preeminent geneticists recognized with revamped GSA Awards

    In 2022, GSA’s Board of Directors launched an audit to review the five major awards conferred by the Society. Today, we are thrilled to announce the recipients of the reimagined GSA Awards, including the new Genetics Society of America Early Career Medal. The scientists honored this year are recognized by their peers for their outstanding…

  • Fly Board funds outreach programs to spread the word about Drosophila research

    In 2020, the Fly Board voted to use part of its reserve fund to support efforts to increase trainee participation as well as equity and diversity in the Drosophila community. An awards committee decides how the money will be spent each year, and from 2020–2022, the committee posted a very broad call for applications from…

  • New members of the GSA Board of Directors: 2024–2026

    We are pleased to announce the election of four new leaders to the GSA Board of Directors: 2024 Vice President/2025 President Brenda Andrews Professor, University of Toronto It’s an honor to continue my association with the Society by serving as Vice President of the Board of Directors. I have broad knowledge of the ongoing activities…

  • The Fly Meeting is one-of-a-kind! Dros 2025 organizers share their excitement

    The 66th Annual Drosophila Research Conference promises to be a meeting rich with the latest in Drosophila research as well as opportunities to advance your career and connect with a global community of 1,400+ scientists. The organizers Todd Nystul, Michelle Bland, Leila Rieder, Amanda Crocker, and Justin Crocker are hard at work, planning a conference…

  • Early Career Leadership Spotlight: Olufemi Osonowo

    We’re taking time to get to know the members of the GSA’s Early Career Scientist Committees. Join us to learn more about our early career scientist advocates. Olufemi Adekunle OsonowoCareer Development SubcommitteeDalhousie University Research Interest Metabolomics and genomics are two distinct but complimentary approaches that offer valuable insights into the underlying mechanisms of complex traits, such…

  • Early Career Leadership Spotlight: Hector Mendoza

    We’re taking time to get to know the members of the GSA’s Early Career Scientist Committees. Join us to learn more about our early career scientist advocates. Hector MendozaCommunication and Outreach SubcommitteeUniversity of Michigan Research Interest My research goals converge around the evolution of sexual reproduction. During my doctoral program, I investigated mitochondrial inheritance, a mechanism…