|
 |
| STATISTICS |
|
| Year : 2016 | Volume
: 7
| Issue : 2 | Page : 106-107 |
|
Common pitfalls in statistical analysis: The perils of multiple testing
Priya Ranganathan1, CS Pramesh2, Marc Buyse3
1 Department of Anaesthesiology, Tata Memorial Centre, Mumbai, Maharashtra, India
2 Department of Surgical Oncology, Division of Thoracic Surgery, Tata Memorial Centre, Mumbai, Maharashtra, India
3 International Drug Development Institute, San Francisco, California, USA; Department of Biostatistics, Hasselt University, Hasselt, Belgium
| Date of Web Publication | 31-Mar-2016 |
Correspondence Address:
Priya Ranganathan
Department of Anaesthesiology, Tata Memorial Centre, Ernest Borges Road, Parel, Mumbai - 400 012, Maharashtra
India
 Source of Support: None, Conflict of Interest: None  | Check |
DOI: 10.4103/2229-3485.179436
 Abstract | | |
Multiple testing refers to situations where a dataset is subjected to statistical testing multiple times - either at multiple time-points or through multiple subgroups or for multiple end-points. This amplifies the probability of a false-positive finding. In this article, we look at the consequences of multiple testing and explore various methods to deal with this issue.
Keywords: Biostatistics, data interpretation, multiplicity, statistical significance
How to cite this article:
Ranganathan P, Pramesh C S, Buyse M. Common pitfalls in statistical analysis: The perils of multiple testing. Perspect Clin Res 2016;7:106-7 |
| Introduction | |  |
In a previous article, we discussed the alpha error rate (or false-positive error rate), which is the probability of falsely rejecting the null hypothesis.[1] In any study, when two or more groups are compared, there is always a chance of finding a difference between them just by chance. This is known as a Type 1 error, in contrast to a Type 2 error, which consists of failing to detect a difference that truly exists. Conventionally, the alpha error is set at 5% or less which ensures that when we do find a difference between the groups, we can be at least 95% confident that this is a true difference and not a chance finding.
The 5% limit for alpha, known as the significance level of the study, is set for a single comparison between groups. When we compare treatment groups multiple times, the probability of finding a difference just by chance increases depending on the number of times, we perform the comparison. In many clinical trials, a number of interim analyses are planned to occur during the course of the trial, with the final analysis taking place when all patients have been accrued and followed up for a minimum period. If all these interim (and final) analyses were performed at the 5% significance level, the overall probability of a Type 1 error would exceed the prespecified limit of 5%. It can be calculated that if two groups are compared 5 times, the probability of a false positive finding is as high as 23%; if they are compared 20 times, the probability of finding a significant difference just by chance increases to 64%.[2],[3] Fortunately, much statistical research has been devoted to this problem, and “group sequential designs” have been proposed to control the Type 1 error rate when the data of a trial need to be analyzed multiple times.
Another, more challenging type, of multiple testing occurs when authors try to salvage a negative study. If the primary endpoint does not show statistical significance, looking at multiple other (less important) comparisons quite often produce a “positive” result, especially if there are many such comparisons. Investigators can try to analyze different endpoints, among different subsets of patients, using different statistical tests, and so on, so the opportunity for multiplicity can be substantial.[2],[4] One case in point is subset analyses when the treatments are compared among subsets of patients defined using prognostic features such as their gender, age, tumor location, stage, histology, and grade If there were only three such binary factors, 8 = 23 subsets could be formed. If we were to compare the treatments among these 8 subsets, we would have one chance in three (33% probability) to observe a statistically significant (P <= 0.05) treatment effect in one of them even if there was no true difference between the treatments. Worse still, if there was an overall statistically significant benefit (P <= 0.05) in favor of one of treatments, we would have a nine in ten chance (90% probability) to observe a benefit in favor of the other treatment in one of the subsets!
It is to avoid these serious problems that all intended comparisons should be fully prespecified in the research protocol, with appropriate adjustments for multiple testing. However, for retrospective studies, it is difficult to ascertain with certainty whether the analyses performed were actually thought of when the research idea was conceived or whether the performed analyses were mere data dredging.
| How Are Adjustments Made for Multiple Testing? | | |
Two main techniques have been described for controlling the overall alpha error:
- The family–wise error rate: This approach attempts to control the overall false-positive rate for all comparisons. “Family” is defined as a set of tests related to the same hypothesis.[2] Various approaches for correcting the alpha error include the Bonferroni, Tukey, Hochberg and Holm's step-down methods. The Bonferroni correction consists of simply dividing the overall alpha level by the number of comparisons. For example, if 20 comparisons are being made, then the alpha level for significance for each comparison would be 0.05/20 = 0.0025. However, while this is simple to do (and understand), it has been criticized as being far too conservative, especially when the various tests being performed are highly correlated [3]
- The false discovery rate: This approach attempts to control the fraction of “false significant results” among the significant results only. The Benjamini and Hochberg procedure has been described for this approach.[5]
| Is Adjustment or Common Sense Needed for Multiple Testing? | | |
Many statisticians feel that alpha-adjustment for multiple comparisons reduces the significance value to very stringent levels and increases the chances of a Type 2 error (false negative error; falsely accepting the null hypothesis).[2] It has also been argued that an obsessive reliance on alpha-adjustment may be counterproductive.[6]
The following simple strategies have been suggested to handle multiple comparisons:[2],[7]
- Readers should evaluate the quality of the study and the actual effect size instead of focusing only on statistical significance
- Results from single studies should not be used to make treatment decisions; instead, one should look for scientific plausibility and supporting data from other studies which can validate the results of the original study
- Authors should try to limit comparisons between groups and identify a single primary endpoint; using a composite endpoint or global assessment tool is also an acceptable alternative to using multiple endpoints.
Financial support and sponsorship
Nil.
Conflicts of interest
There are no conflicts of interest.
| References | | |
| 1. | Ranganathan P, Pramesh CS, Buyse M. Common pitfalls in statistical analysis: “P” values, statistical significance and confidence intervals. Perspect Clin Res 2015;6:116-7.  [ PUBMED]  |
| 2. | Drachman D. Adjusting for multiple comparisons. J Clin Res Best Pract 2012;8:1-3. Available from: https://www. firstclinical.com/journal/2012/1207_Multiple.pdf. [Last cited on 2016 Mar 21]. |
| 3. | |
| 4. | Cabral HJ. Multiple comparisons procedures. Circulation 2008;117:698-701. |
| 5. | Benjamini Y, Hochberg Y. Controlling the false discovery rate: A practical and powerful approach to multiple testing. J R Stat Soc Series B 1995;57:289-300. |
| 6. | Buyse M, Hurvitz SA, Andre F, Jiang Z, Burris HA, Toi M, et al. Statistical controversies in clinical research: Statistical significance-too much of a good thing. Ann Oncol 2016. pii: Mdw047. [Epub ahead of print]. |
| 7. | Feise RJ. Do multiple outcome measures require p value adjustment? BMC Med Res Methodol 2002;2:8. |
| This article has been cited by | | 1 |
Will Computers Replace School Psychologists? An Analysis of Tech-Based Tools for Assessment, Consultation, and Counseling |
|
| S. Kathleen Krach, Stephanie Corcoran | | Contemporary School Psychology. 2023; | | [Pubmed] | [DOI] | | | 2 |
If you build it, will they come? Is test site availability a root cause of geographic disparities in COVID-19 testing? |
|
| B. Hendricks, B.S. Price, T. Dotson, W. Kimble, S. Davis, M. Khodaverdi, A. Halasz, G.S. Smith, S. Hodder | | Public Health. 2023; 216: 21 | | [Pubmed] | [DOI] | | | 3 |
Review of Studies on Incremental Validity of Assessment Measures Used in Psychological Assessment of Attention-Deficit Hyperactivity Disorder |
|
| Helen Sawaya, Joseph C. Miller, Jeremy M. Raines | | Assessment. 2023; : 1073191123 | | [Pubmed] | [DOI] | | | 4 |
Association between radiographic hand osteoarthritis and bone microarchitecture in a population-based sample |
|
| Canchen Ma, Dawn Aitken, Feitong Wu, Kathryn Squibb, Flavia Cicuttini, Graeme Jones | | Arthritis Research & Therapy. 2022; 24(1) | | [Pubmed] | [DOI] | | | 5 |
Exposure to Outdoor Particulate Matter Air Pollution and Risk of Gastrointestinal Cancers in Adults: A Systematic Review and Meta-Analysis of Epidemiologic Evidence |
|
| Natalie Pritchett, Emily C. Spangler, George M. Gray, Alicia A. Livinski, Joshua N. Sampson, Sanford M. Dawsey, Rena R. Jones | | Environmental Health Perspectives. 2022; 130(3) | | [Pubmed] | [DOI] | | | 6 |
Association between systemic inflammation and experimental pain sensitivity in subjects with pain and painless neuropathy after traumatic nerve injuries |
|
| Adriana Ana Miclescu, Pontus Granlund, Stephen Butler, Torsten Gordh | | Scandinavian Journal of Pain. 2022; 0(0) | | [Pubmed] | [DOI] | | | 7 |
Mechanical Energy Expenditure at Lumbar Spine and Lower Extremity Joints During the Single-Leg Squat Is Affected by the Nonstance Foot Position |
|
| Steven M. Hirsch, Christopher J. Chapman, David M. Frost, Tyson A.C. Beach | | Journal of Strength and Conditioning Research. 2022; 36(9): 2417 | | [Pubmed] | [DOI] | | | 8 |
Three trajectories of gestational weight gain identified in an Australian twin study |
|
| Deborah N. Ashtree, Deborah A. Osborne, Amelia Lee, Mark P. Umstad, Jeffrey M. Craig, Katrina J. Scurrah | | European Journal of Obstetrics & Gynecology and Reproductive Biology. 2022; | | [Pubmed] | [DOI] | | | 9 |
Assessment of self-report response bias in high functioning autistic people |
|
| Marilyn A. Sher, Caroline Oliver | | Psychiatry, Psychology and Law. 2022; : 1 | | [Pubmed] | [DOI] | | | 10 |
The impact of aging on interhemispheric transfer time and respective sex differences |
|
| David Riedel, Tim Fellerhoff, Andreas Mierau, Heiko Strüder, Dominik Wolf, Florian Fischer, Andreas Fellgiebel, Oliver Tüscher, Bianca Kollmann, Kristel Knaepen | | Aging Brain. 2022; 2: 100040 | | [Pubmed] | [DOI] | | | 11 |
Comparing fixed-array and functionally-defined channel of interest approaches to infant functional near-infrared spectroscopy data |
|
| Yiyu Liu, Fernando Sánchez Hernández, Fransisca Ting, Daniel C. Hyde | | NeuroImage. 2022; : 119520 | | [Pubmed] | [DOI] | | | 12 |
A new angle on mental rotation ability in transgender men: Modulation by ovarian milieu |
|
| Diana E. Peragine, Nicole J. Gervais, Chiara Simeon-Spezzaferro, Gillian Einstein | | Psychoneuroendocrinology. 2022; : 105751 | | [Pubmed] | [DOI] | | | 13 |
The Impact of Mandatory Nonmedical Switching From Originator to Biosimilar Insulin Glargine |
|
| Anat Fisher, Jason D. Kim, Colin Dormuth | | Clinical Therapeutics. 2022; | | [Pubmed] | [DOI] | | | 14 |
Utility of performance-based outcome measures (PBOMs) used in fall risk assessment tools for older adults |
|
| Kevin M. Parcetich, Daniel G. Miner, Arco Paul, Lane Wildman | | Dialogues in Health. 2022; : 100043 | | [Pubmed] | [DOI] | | | 15 |
No credible evidence for links between 2D:4D and COVID-19 outcomes: A probabilistic perspective on digit ratio, ACE variants, and national case fatalities |
|
| Alex L. Jones,Bastian Jaeger,Christoph Schild | | Early Human Development. 2021; 152: 105272 | | [Pubmed] | [DOI] | | | 16 |
Effect of azithromycin on incidence of acute respiratory exacerbations in children with HIV taking antiretroviral therapy and co-morbid chronic lung disease: a secondary analysis of the BREATHE trial |
|
| Amy Price, Grace McHugh, Victoria Simms, Robina Semphere, Lucky G Ngwira, Tsitsi Bandason, Hilda Mujuru, Jon O Odland, Rashida A Ferrand, Andrea M Rehman | | EClinicalMedicine. 2021; 42: 101195 | | [Pubmed] | [DOI] | | | 17 |
Lack of predictive tools for conventional and targeted cancer therapy: Barriers to biomarker development and clinical translation |
|
| Nikolaos Batis,Jill M. Brooks,Karl Payne,Neil Sharma,Paul Nankivell,Hisham Mehanna | | Advanced Drug Delivery Reviews. 2021; : 113854 | | [Pubmed] | [DOI] | | | 18 |
Smoke-Free Laws and Disparities in Youth Smoking in the U.S., 2001–2018 |
|
| Andrea R. Titus,Yanmei Xie,David C. Colston,Megan E. Patrick,Michael R. Elliott,David T. Levy,James F. Thrasher,Nancy L. Fleischer | | American Journal of Preventive Medicine. 2021; | | [Pubmed] | [DOI] | | | 19 |
Are nudging and pricing strategies on food purchasing behaviors equally effective for all? Secondary analyses from the Supreme Nudge virtual supermarket study |
|
| Annemarijn E.H. van der Molen,Jody C. Hoenink,Joreintje D. Mackenbach,Wilma Waterlander,Jeroen Lakerveld,Joline W.J. Beulens | | Appetite. 2021; 167: 105655 | | [Pubmed] | [DOI] | | | 20 |
The relationship between urinary phthalate metabolites and polycystic ovary syndrome in women undergoing in vitro fertilization: Nested case-control study |
|
| Iman Al-Saleh | | Chemosphere. 2021; : 131495 | | [Pubmed] | [DOI] | | | 21 |
Adopted children who kill their adoptive parents: An examination through the lens of attachment theory |
|
| James T. Hubbell,Kathleen M. Heide,Shelly M. Wagers | | Behavioral Sciences & the Law. 2021; | | [Pubmed] | [DOI] | | | 22 |
To Approach or to Avoid: The Role of Ambivalent Motivation in Attentional Biases to Threat and Spider Fear |
|
| Mengran Xu,Katelyn Rowe,Christine Purdon | | Cognitive Therapy and Research. 2021; | | [Pubmed] | [DOI] | | | 23 |
Assessing the Robustness of Mediation Analysis Results Using Multiverse Analysis |
|
| Judith J. M. Rijnhart,Jos W. R. Twisk,Dorly J. H. Deeg,Martijn W. Heymans | | Prevention Science. 2021; | | [Pubmed] | [DOI] | | | 24 |
The Long-Term Relationship Between Psychological Resilience, Psychosis, Distress, and Suicidal Thoughts and Behaviors |
|
| Kamelia Harris,Gillian Haddock,Sarah Peters,Patricia Gooding | | Schizophrenia Bulletin Open. 2021; 2(1) | | [Pubmed] | [DOI] | | | 25 |
Even a Mild Sleep Restriction Can Impact Daytime Functioning in Children with ADHD and Their Typically Developing Peers |
|
| Fiona Davidson,Gabrielle Rigney,Sarah Brine,Tamara Speth,Laura Miller,Benjamin Rusak,Christine Chambers,Malgorzata Rajda,Esmot Ara Begum,Penny Corkum | | Behavioral Sleep Medicine. 2021; : 1 | | [Pubmed] | [DOI] | | | 26 |
Intake of New Zealand Blackcurrant Powder Affects Skin-Borne Volatile Organic Compounds in Middle-Aged and Older Adults |
|
| M. E. T. Willems,M. Todaka,M. Banic,M. D. Cook,Y. Sekine | | Journal of Dietary Supplements. 2021; : 1 | | [Pubmed] | [DOI] | | | 27 |
Associations between pre- and postnatal exposure to air pollution and lung health in children and assessment of CC16 as a potential mediator |
|
| Anna Stapleton,Maribel Casas,Judith García,Raquel García,Jordi Sunyer,Stefano Guerra,Alicia Abellan,Iris Lavi,Carlota Dobaño,Marta Vidal,Mireia Gascon | | Environmental Research. 2021; : 111900 | | [Pubmed] | [DOI] | | | 28 |
Factors Limiting Subgroup Analysis in Cost-Effectiveness Analysis and a Call for Transparency |
|
| Gemma E. Shields, Mark Wilberforce, Paul Clarkson, Tracey Farragher, Arpana Verma, Linda M. Davies | | PharmacoEconomics. 2021; | | [Pubmed] | [DOI] | | | 29 |
Birthweight-for-gestational-age z-scores are associated with early childhood cardiometabolic health in the Peri/Postnatal Epigenetic Twin Study |
|
| Deborah N. Ashtree,Mihiri J. Silva,Cong Sun,Jeffrey M. Craig,Katrina J. Scurrah | | Journal of Developmental Origins of Health and Disease. 2021; : 1 | | [Pubmed] | [DOI] | | | 30 |
Molecular correlates of response to eribulin and pembrolizumab in hormone receptor-positive metastatic breast cancer |
|
| Tanya E. Keenan,Jennifer L. Guerriero,Romualdo Barroso-Sousa,Tianyu Li,Tess O’Meara,Anita Giobbie-Hurder,Nabihah Tayob,Jiani Hu,Mariano Severgnini,Judith Agudo,Ines Vaz-Luis,Leilani Anderson,Victoria Attaya,Jihye Park,Jake Conway,Meng Xiao He,Brendan Reardon,Erin Shannon,Gerburg Wulf,Laura M. Spring,Rinath Jeselsohn,Ian Krop,Nancy U. Lin,Ann Partridge,Eric P. Winer,Elizabeth A. Mittendorf,David Liu,Eliezer M. Van Allen,Sara M. Tolaney | | Nature Communications. 2021; 12(1) | | [Pubmed] | [DOI] | | | 31 |
Context-Based Testing as Assessment Tool in Chemistry Learning on University Level |
|
| Boris Bortnik,Natalia Stozhko,Irina Pervukhina | | Education Sciences. 2021; 11(8): 450 | | [Pubmed] | [DOI] | | | 32 |
Does increasing social presence enhance the effectiveness of writing explanations? |
|
| Leonie Jacob,Andreas Lachner,Katharina Scheiter,Juan Cristobal Castro-Alonso | | PLOS ONE. 2021; 16(4): e0250406 | | [Pubmed] | [DOI] | | | 33 |
Association between urban environment and mental health in Brussels, Belgium |
|
| Ingrid Pelgrims,Brecht Devleesschauwer,Madeleine Guyot,Hans Keune,Tim S. Nawrot,Roy Remmen,Nelly D. Saenen,Sonia Trabelsi,Isabelle Thomas,Raf Aerts,Eva M. De Clercq | | BMC Public Health. 2021; 21(1) | | [Pubmed] | [DOI] | | | 34 |
Impact of emergency department opioid use on future health resource utilization among patients with migraine |
|
| Qiujun Shao,Karen L. Rascati,Kenneth A. Lawson,James P. Wilson,Sanket Shah,John S. Garrett | | Headache: The Journal of Head and Face Pain. 2021; | | [Pubmed] | [DOI] | | | 35 |
Occupation and risk of severe COVID-19: prospective cohort study of 120 075 UK Biobank participants |
|
| Miriam Mutambudzi,Claire Niedzwiedz,Ewan Beaton Macdonald,Alastair Leyland,Frances Mair,Jana Anderson,Carlos Celis-Morales,John Cleland,John Forbes,Jason Gill,Claire Hastie,Frederick Ho,Bhautesh Jani,Daniel F Mackay,Barbara Nicholl,Catherine OæDonnell,Naveed Sattar,Paul Welsh,Jill P Pell,Srinivasa Vittal Katikireddi,Evangelia Demou | | Occupational and Environmental Medicine. 2021; 78(5): 307 | | [Pubmed] | [DOI] | | | 36 |
Physical health status in first-degree relatives of patients with bipolar disorder, a systematic review |
|
| Louise Holm Madsen, Kimie Stefanie Ormstrup Sletved, Lars Vedel Kessing, Maj Vinberg | | Nordic Journal of Psychiatry. 2021; : 1 | | [Pubmed] | [DOI] | | | 37 |
A Survey of Arizona Pharmacists to Identify Opportunities to Enhance Pharmacists’ Competitiveness in a Tightening Labor Market |
|
| Caitlin K. Cameron, Ahmad A. Alamer, Eliane Fossati, Gamal Raslan, Tiffany Nguyen, Trevor Bermingham, Maryam T. Fazel | | Journal of Pharmacy Practice. 2021; : 0897190021 | | [Pubmed] | [DOI] | | | 38 |
Plasma Biomarkers of Reticular Pseudodrusen and the Risk of Progression to Advanced Age-Related Macular Degeneration |
|
| Anne M. Lynch,Brandie D. Wagner,Alan G. Palestine,Nebojsa Janjic,Jennifer L. Patnaik,Marc T. Mathias,Frank S. Siringo,Naresh Mandava | | Translational Vision Science & Technology. 2020; 9(10): 12 | | [Pubmed] | [DOI] | | | 39 |
Heterogeneous treatment effects of a text messaging smoking cessation intervention among university students |
|
| Marcus Bendtsen,Wisit Cheungpasitporn | | PLOS ONE. 2020; 15(3): e0229637 | | [Pubmed] | [DOI] | | | 40 |
Factors affecting adolescents’ participation in randomized controlled trials evaluating the effectiveness of healthcare interventions: the case of the STEPSTONES project |
|
| Markus Saarijärvi,Lars Wallin,Philip Moons,Hanna Gyllensten,Ewa-Lena Bratt | | BMC Medical Research Methodology. 2020; 20(1) | | [Pubmed] | [DOI] | | | 41 |
Reliability of gait parameters in male and female healthy adults during self-paced treadmill-based walking |
|
| Shayan Bahadori,Tikki Immins,Thomas W Wainwright | | International Journal of Therapy and Rehabilitation. 2020; 27(9): 1 | | [Pubmed] | [DOI] | | | 42 |
Study designs: Part 5 – Interventional studies (III) |
|
| Priya Ranganathan,Rakesh Aggarwal | | Perspectives in Clinical Research. 2020; 11(1): 47 | | [Pubmed] | [DOI] | | | 43 |
Uncharacteristic Task-Evoked Pupillary Responses Implicate Atypical Locus Ceruleus Activity in Autism |
|
| Michael C. Granovetter, Charlie S. Burlingham, Nicholas M. Blauch, Nancy J. Minshew, David J. Heeger, Marlene Behrmann | | The Journal of Neuroscience. 2020; 40(19): 3815 | | [Pubmed] | [DOI] | | | 44 |
Association of Diet Quality and Dietary Components with Clinical Resolution of HPV |
|
| Amber Naresh,Michael Hagensee,Leann Myers,Jennifer Cameron | | Nutrition and Cancer. 2020; : 1 | | [Pubmed] | [DOI] | | | 45 |
Transcutaneous electrical nerve stimulation for advanced cancer pain inpatients in specialist palliative care—a blinded, randomized, sham-controlled pilot cross-over trial |
|
| Waldemar Siemens,Christopher Boehlke,Michael I. Bennett,Klaus Offner,Gerhild Becker,Jan Gaertner | | Supportive Care in Cancer. 2020; | | [Pubmed] | [DOI] | | | 46 |
Brain-predicted age difference score is related to specific cognitive functions: a multi-site replication analysis |
|
| Rory Boyle,Lee Jollans,Laura M. Rueda-Delgado,Rossella Rizzo,Görsev G. Yener,Jason P. McMorrow,Silvin P. Knight,Daniel Carey,Ian H. Robertson,Derya D. Emek-Savas,Yaakov Stern,Rose Anne Kenny,Robert Whelan | | Brain Imaging and Behavior. 2020; | | [Pubmed] | [DOI] | | | 47 |
Cancer-Relevant Self-Efficacy Is Related to Better Health-Related Quality of Life and Lower Cancer-Specific Distress and Symptom Burden Among Latina Breast Cancer Survivors |
|
| Sharon H. Baik,Laura B. Oswald,Diana Buitrago,Joanna Buscemi,Francisco Iacobelli,Alejandra Perez-Tamayo,Judy Guitelman,Alma Diaz,Frank J. Penedo,Betina Yanez | | International Journal of Behavioral Medicine. 2020; | | [Pubmed] | [DOI] | | | 48 |
Histopathologic Prevalence and Severity of Testicular Oocytes in Smallmouth Bass from Two Archival Collections |
|
| K. Christiana Grim,Eileen E. Henderson,Marilyn J. Wolfe,Jeffrey C. Wolf | | Journal of Aquatic Animal Health. 2020; | | [Pubmed] | [DOI] | | | 49 |
Evaluation of the Interrater Reliability of End-of-Life Medical Orders in the Physician Orders for Life-Sustaining Treatment Form |
|
| Gustavo Bigaton Lovadini,Fernanda Bono Fukushima,Joao Francisco Lindenberg Schoueri,Roberto dos Reis,Cecilia Guimarães Ferreira Fonseca,Jahaira Jeanainne Casanova Rodriguez,Cauana Silva Coelho,Adriele Ferreira Neves,Aniela Maria Rodrigues,Marina Almeida Marques,Alessandro Ferrari Jacinto,Karen Harrison Dening,Rick Bassett,Alvin H. Moss,Karl E. Steinberg,Edison Iglesias de Oliveira Vidal | | JAMA Network Open. 2019; 2(4): e192036 | | [Pubmed] | [DOI] | | | 50 |
Victimization and poly-victimization in a community sample of Mexican adolescents |
|
| Claudia Méndez-López,Noemí Pereda | | Child Abuse & Neglect. 2019; 96: 104100 | | [Pubmed] | [DOI] | | | 51 |
Group identities benefit well-being by satisfying needs |
|
| A. Kyprianides,M.J. Easterbrook,R. Brown | | Journal of Experimental Social Psychology. 2019; 84: 103836 | | [Pubmed] | [DOI] | | | 52 |
Perspective: Advancing Understanding of Population Nutrient–Health Relations via Metabolomics and Precision Phenotypes |
|
| Stephanie Andraos,Melissa Wake,Richard Saffery,David Burgner,Martin Kussmann,Justin OæSullivan | | Advances in Nutrition. 2019; | | [Pubmed] | [DOI] | | | 53 |
Age-Related Survival Differences in Patients With Inflammatory Bowel Disease–Associated Colorectal Cancer: A Population-Based Cohort Study |
|
| Jessica Bogach,Gregory Pond,Cagla Esckicioglu,Hsien Seow | | Inflammatory Bowel Diseases. 2019; | | [Pubmed] | [DOI] | | | 54 |
Serotonin Receptor 1A Variation Is Associated with Anxiety and Agonistic Behavior in Chimpanzees |
|
| Nicky Staes,Chet C Sherwood,Hani Freeman,Sarah F Brosnan,Steven J Schapiro,William D Hopkins,Brenda J Bradley,Katja Nowick | | Molecular Biology and Evolution. 2019; | | [Pubmed] | [DOI] | | | 55 |
Monetary reinforcement for self-monitoring of blood glucose among young people with type 1 diabetes: evaluating effects on psychosocial functioning |
|
| J. J. Wong,A. Addala,D. Naranjo,K. K. Hood,E. Cengiz,M. K. Ginley,R. S. Feinn,J. A. Wagner | | Diabetic Medicine. 2019; | | [Pubmed] | [DOI] | | | 56 |
Smoke-Free Policies and Smoking Cessation in the United States, 2003–2015 |
|
| Andrea R. Titus,Lucie Kalousova,Rafael Meza,David T. Levy,James F. Thrasher,Michael R. Elliott,Paula M. Lantz,Nancy L. Fleischer | | International Journal of Environmental Research and Public Health. 2019; 16(17): 3200 | | [Pubmed] | [DOI] | | | 57 |
What Was Helpful Questionnaire (WHQ): Psychometric Properties of a Novel Tool Designed to Capture Parental Perceived Helpfulness of Interventions in Children Requiring Mental Health Inpatient Care |
|
| Ifigeneia Mourelatou,Jorge Gaete,Sandra Fewings,Oona Hickie,Marinos Kyriakopoulos | | Frontiers in Psychiatry. 2019; 10 | | [Pubmed] | [DOI] | | | 58 |
Use of meloxicam, buprenorphine, and Maxilene® to assess a multimodal
approach for piglet pain management, part 1: surgical castration |
|
| AV Viscardi, PV Turner | | Animal Welfare. 2019; 28(4): 487 | | [Pubmed] | [DOI] | | | 59 |
Decision Biases and Heuristics Among Emergency Managers: Just Like the Public They Manage For? |
|
| Patrick S. Roberts,Kris Wernstedt | | The American Review of Public Administration. 2019; 49(3): 292 | | [Pubmed] | [DOI] | | | 60 |
Value of Collaboration among Multi-Domain Experts in Analysis of High-Throughput Genomics Data |
|
| Daoud Meerzaman,Barbara K. Dunn | | Cancer Research. 2019; 79(20): 5140 | | [Pubmed] | [DOI] | | | 61 |
Are socioeconomic inequalities in the incidence of small-for-gestational-age birth narrowing? Findings from a population-based cohort in the South of England |
|
| Sam Wilding,Nida Ziauddeen,Paul Roderick,Dianna Smith,Debbie Chase,Nick Macklon,Nuala McGrath,Mark Hanson,Nisreen A Alwan | | BMJ Open. 2019; 9(7): e026998 | | [Pubmed] | [DOI] | | | 62 |
Risk factors for childhood enteric infection in urban Maputo, Mozambique: A cross-sectional study |
|
| Jackie Knee,Trent Sumner,Zaida Adriano,David Berendes,Ellen de Bruijn,Wolf-Peter Schmidt,Rassul Nalá,Oliver Cumming,Joe Brown,Rojelio Mejia | | PLOS Neglected Tropical Diseases. 2018; 12(11): e0006956 | | [Pubmed] | [DOI] | | | 63 |
Use of Meloxicam or Ketoprofen for Piglet Pain Control Following Surgical Castration |
|
| Abbie V. Viscardi,Patricia V. Turner | | Frontiers in Veterinary Science. 2018; 5 | | [Pubmed] | [DOI] | | | 64 |
MicroRNA and Long Non-coding RNA Regulation in Skeletal Muscle From Growth to Old Age Shows Striking Dysregulation of the Callipyge Locus |
|
| Jasmine Mikovic,Kate Sadler,Lauren Butchart,Sarah Voisin,Frederico Gerlinger-Romero,Paul Della Gatta,Miranda D. Grounds,Séverine Lamon | | Frontiers in Genetics. 2018; 9 | | [Pubmed] | [DOI] | | | 65 |
Self-management interventions for cancer survivors: a systematic review |
|
| Lauren Boland,Kathleen Bennett,Deirdre Connolly | | Supportive Care in Cancer. 2017; | | [Pubmed] | [DOI] | |
|
 |
|
|
|
