1
|
Trafimow D. A New Way to Think About Internal and External Validity. PERSPECTIVES ON PSYCHOLOGICAL SCIENCE 2023; 18:1028-1046. [PMID: 36469834 DOI: 10.1177/17456916221136117] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 09/02/2023]
Abstract
Researchers have been concerned with internal and external validity for decades, and the discussion continues. The present proposal is that there are less important and more important senses in which one can interpret internal and external validity, and these can be integrated with a taxonomy that includes theoretical, auxiliary, statistical, and inferential assumptions. The integration sheds light on recent exchanges in the literature on validity and suggests that the vaunted internal-external validity trade-off is false for more important senses of internal and external validity; internal and external validity increase or decrease together when there is an emphasis on underlying theories. Finally, the integration implies the desirability of some changes in typical research advice and practice.
Collapse
|
2
|
Valerie IC, Prabandari AASM, Wati DK. Ferritin in pediatric critical illness: a scoping review. Clin Exp Pediatr 2023; 66:98-109. [PMID: 36229027 PMCID: PMC9989723 DOI: 10.3345/cep.2022.00654] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 05/06/2022] [Accepted: 08/17/2022] [Indexed: 11/27/2022] Open
Abstract
This scoping review aimed to elucidate and summarize the predictive role of serum ferritin in critical pediatric illness. The Preferred Reporting Items for Systematic reviews and Meta-Analyses methodology was employed to conduct a scoping review of 5 databases (MEDLINE, CENTRAL, ProQuest, ScienceDirect, and Epistemonikos) from the date of inception through January 24, 2022. Primary research studies involving subjects aged <18 years and serum ferritin levels were screened and reviewed independently following an a priori defined protocol. Of the 1,580 retrieved studies, 66 were analyzed. Summary statistics of serum ferritin levels for overall and condition-specific studies were reported in 30 (45.4%) and 47 studies (71.2%), respectively. The normal range was defined in 16 studies (24.2%), whereas the threshold was determined in 43 studies (65.1%). A value of <500 ng/mL was most often the upper limit of the normal range. Serum ferritin as a numerical variable (78.9%) was usually significantly higher (80.8%) in the predicted condition than in controls, while as a categorical variable with preset thresholds, ferritin was a significant predictor in 84.6% of studies. A total of 22 predictive thresholds predicted mortality (12 of 46 [26.1%]), morbidity (18 of 46 [39.1%]), and specific (16 of 46 [34.8%]) outcomes in 15 unique conditions. Increased precision in serum ferritin measures followed by close attention to the threshold modeling strategy and reporting can accelerate the translation from evidence to clinical practice.
Collapse
Affiliation(s)
- Ivy Cerelia Valerie
- Department of Child Health, Faculty of Medicine, Universitas Udayana/Sanglah General Hospital, Bali, Indonesia
| | | | - Dyah Kanya Wati
- Department of Child Health, Faculty of Medicine, Universitas Udayana/Sanglah General Hospital, Bali, Indonesia
| |
Collapse
|
3
|
Munro GD, Huang T. How Much Evidence Is Enough? Biased Thresholds in Judgments of Scientific Conclusions. BASIC AND APPLIED SOCIAL PSYCHOLOGY 2023. [DOI: 10.1080/01973533.2023.2177542] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/17/2023]
|
4
|
The Dark Tetrad, cybervictimization, and cyberbullying: The role of moral disengagement. CURRENT PSYCHOLOGY 2022. [DOI: 10.1007/s12144-022-03456-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/03/2022]
Abstract
AbstractCyberbullying is a form of antisocial online behaviors. Perpetration of intentional and repeated harm inflicted through electronic devices is associated with dark personality traits and may be caused by morally impaired reasoning. In the current study, we investigated the associations between the Dark Tetrad (narcissism, Machiavellianism, psychopathy, sadism), cybervictimization, and cyberbullying. We also examined the intervening role of moral disengagement in the relationship between the Dark Tetrad and cyberbullying. Two hundred fifty-one adults (72.6% women) participated in an on-line study. Correlational analysis indicated that all dark personality traits were associated with higher cyberbullying and cybervictimization (except narcissism as a predictor of cybervictimization). Moral disengagement was positively related to Machiavellianism, sadism and cybervictimization. Controlled for covariance between the Dark Tetrad traits and cybervictimization, sadism and cybervictimization appeared to be associated with cyberbullying. Moreover, moral disengagement did not account for the associations between the Dark Tetrad and cyberbullying.
Collapse
|
5
|
Zhang W, Yan S, Tian B, Fei D. Statistical Assumptions and Reproducibility in Psychology: Data Mining Based on Open Science. Front Psychol 2022; 13:905977. [PMID: 35712145 PMCID: PMC9196269 DOI: 10.3389/fpsyg.2022.905977] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/30/2022] [Accepted: 04/27/2022] [Indexed: 11/25/2022] Open
Abstract
The failures of reproducibility in psychology (or other social sciences) can be investigated by tracing their logical chains, from statistical hypothesis to their conclusion. This research starts with the normality hypothesis, the homoscedasticity hypothesis, and the robust hypothesis and uses the R language to simulate and analyze the original data of 100 studies in Estimating the Reproducibility of Psychological Science to explore the influence of the premise hypothesis on statistical methods on the reproducibility of psychological research. The results indicated the following: (1) the answer to the question about psychological studies being repeatable or not relates to the fields to which the subjects belonged, (2) not all the psychological variables meet the normal distribution hypothesis, (3) the t-test is a more robust tool for psychological research than the Analysis of Variance (ANOVA), and (4) the robustness of ANOVA is independent of the normality and variance congruence of the analyzed data. This study made us realize that the repeatable study factors in psychology are more complex than we expected them to be.
Collapse
Affiliation(s)
- Wenqing Zhang
- Department of Psychology, Wuhan University, Wuhan, China
| | - Shu Yan
- Department of Psychology, Wuhan University, Wuhan, China
| | - Bo Tian
- Department of Psychology, Wuhan University, Wuhan, China
| | - Dingzhou Fei
- Department of Psychology, Wuhan University, Wuhan, China
| |
Collapse
|
6
|
Contreras-Reyes JE. Information–Theoretic Aspects of Location Parameter Estimation under Skew–Normal Settings. ENTROPY 2022; 24:e24030399. [PMID: 35327910 PMCID: PMC8947508 DOI: 10.3390/e24030399] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 02/14/2022] [Revised: 03/09/2022] [Accepted: 03/11/2022] [Indexed: 02/04/2023]
Abstract
In several applications, the assumption of normality is often violated in data with some level of skewness, so skewness affects the mean’s estimation. The class of skew–normal distributions is considered, given their flexibility for modeling data with asymmetry parameter. In this paper, we considered two location parameter (μ) estimation methods in the skew–normal setting, where the coefficient of variation and the skewness parameter are known. Specifically, the least square estimator (LSE) and the best unbiased estimator (BUE) for μ are considered. The properties for BUE (which dominates LSE) using classic theorems of information theory are explored, which provides a way to measure the uncertainty of location parameter estimations. Specifically, inequalities based on convexity property enable obtaining lower and upper bounds for differential entropy and Fisher information. Some simulations illustrate the behavior of differential entropy and Fisher information bounds.
Collapse
Affiliation(s)
- Javier E Contreras-Reyes
- Instituto de Estadística, Facultad de Ciencias, Universidad de Valparaíso, Valparaíso 2360102, Chile
| |
Collapse
|
7
|
Salas-Blas E, Merino-Soto C, Pérez-Amezcua B, Toledano-Toledano F. Social Networks Addiction (SNA-6) - Short: Validity of Measurement in Mexican Youths. Front Psychol 2022; 12:774847. [PMID: 35095659 PMCID: PMC8790061 DOI: 10.3389/fpsyg.2021.774847] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/13/2021] [Accepted: 12/15/2021] [Indexed: 01/10/2023] Open
Abstract
The excessive use of social networks needs to be addressed, and this phenomenon needs to be measured for the purpose of evaluation, prevention, and intervention among adolescents and young people. The objective of the study was to adapt and psychometrically validate the Brief Scale of Addiction to Social Networks (SNA-6) among Mexican adolescents and young adults. The participating sample consisted of 2,789 students from 6 public educational campuses in Cuernavaca (Morelos, Mexico). Data collection was carried out through a web platform to strictly maintain anonymity, voluntary participation, and confidentiality. Data analysis first focused on the detection of possible response biases (random intercept model and careless/insufficient effort), the quality of the response structure partial credit model (PCM), dimensionality (CFA and invariance), and the relationship with external variables. It was found that when the range of efficient response options was limited to less than five, reliability was high (0.91), and unidimensionality was maintained. Response biases slightly affected the dimensional structure of the instrument. Measurement invariance reached scalar invariance in the sex, age, and campus groups. The association with sensation seeking and depression, controlling for sex and age covariates, was statistically significant, small, and theoretically consistent. Implications of the results are discussed.
Collapse
Affiliation(s)
- Edwin Salas-Blas
- Instituto de Investigación de Psicología, Universidad de San Martín de Porres, Lima, Peru
| | - César Merino-Soto
- Instituto de Investigación de Psicología, Universidad de San Martín de Porres, Lima, Peru
| | - Berenice Pérez-Amezcua
- Centro de Investigación Transdisciplinar en Psicología, Universidad Autónoma del Estado de Morelos, Cuernavaca, Mexico
| | - Filiberto Toledano-Toledano
- Unida de Investigación en Medicina Basada en Evidencias, Hospital Infantil de México Federico Gómez, Mexico City, Mexico
- Unidad de Investigación Sociomédica, Instituto Nacional de Rehabilitación Luis Guillermo Ibarra Ibarra, Mexico City, Mexico
| |
Collapse
|
8
|
Cao L, Wang C, Wang T, Trafimow D. The APP for estimating population proportion based on skew normal approximations and the Beta-Bernoulli process. COMMUN STAT-SIMUL C 2021. [DOI: 10.1080/03610918.2021.2012192] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/19/2022]
Affiliation(s)
- Lixia Cao
- School of Sciences, Xian Technological University, Xian, Shaanxi, China
| | - Cong Wang
- Department of Mathematics, University of Nebraska Omaha, Omaha, Nebraska, USA
| | - Tonghui Wang
- School of Sciences, Xian Technological University, Xian, Shaanxi, China
- Department of Mathematical Sciences, New Mexico State University, Las Cruces, New Mexico, USA
| | - David Trafimow
- Department of Psychology, New Mexico State University, Las Cruces, New Mexico, USA
| |
Collapse
|
9
|
Hughes JS, Sandel A, Yelderman LA, Inman V. Beliefs about an Offender’s Capacity to Be Rehabilitated: Black Offenders Are Seen as More Capable of Change. BASIC AND APPLIED SOCIAL PSYCHOLOGY 2021. [DOI: 10.1080/01973533.2021.1982714] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/20/2022]
|
10
|
Legate N, Weinstein N, Ryan RM. Ostracism in Real Life: Evidence That Ostracizing Others Has Costs, Even When It Feels Justified. BASIC AND APPLIED SOCIAL PSYCHOLOGY 2021. [DOI: 10.1080/01973533.2021.1927038] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/21/2022]
|
11
|
Abstract
In a recent article, Trafimow suggested the usefulness of imagining an ideal universe where the only difference between original and replication experiments is the operation of randomness. This contrasts with replication in the real universe where systematicity, as well as randomness, creates differences between original and replication experiments. Although Trafimow showed (a) that the probability of replication in the ideal universe places an upper bound on the probability of replication in the real universe, and (b) how to calculate the probability of replication in the ideal universe, the conception is afflicted with an important practical problem. Too many participants are needed to render the approach palatable to most researchers. The present aim is to address this problem. Embracing skewness is an important part of the solution.
Collapse
|
12
|
Wang C, Wang T, Trafimow D, Talordphop K. Estimating the location parameter under skew normal settings: is violating the independence assumption good or bad? Soft comput 2021. [DOI: 10.1007/s00500-021-05679-4] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/28/2022]
|
13
|
Ridley D, Ngnepieba P, de Silva A. The doctrine of normal tendency in active learning teaching methodology: investigations into probability distributions and averages. SN SOCIAL SCIENCES 2021; 1:144. [PMID: 34693323 PMCID: PMC8164912 DOI: 10.1007/s43545-021-00154-1] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 10/27/2020] [Accepted: 04/30/2021] [Indexed: 02/04/2023]
Abstract
Traditional lecture and active learning methods of teaching a university course are compared. The particular course is university calculus. The lecture method was applied to two sections of calculus. The active learning method was applied to two other sections. In all cases students were given an examination near the beginning of the course and a final examination at the end of the course. The score averages for the active learning method were higher than for the lecture method. The distribution of scores for the lecture method were non-normal multimodal in the first and final examinations. The distribution for the active learning method went from non-normal multimodal in the first examination to unimodal normal in the final examination. A new undeceivable nature evidence-based method is presented for measuring teaching efficacy by probability distribution. SUPPLEMENTARY INFORMATION The online version contains supplementary material available at 10.1007/s43545-021-00154-1.
Collapse
Affiliation(s)
- Dennis Ridley
- School of Business and Industry, Florida A&M University and Department of Scientific Computing, Florida State University, Tallahassee, FL USA
| | - Pierre Ngnepieba
- College of Science and Technology, Florida A&M University, Tallahassee, FL USA
| | - Aryanne de Silva
- Abigail Wexner Research Institute at Nationwide Children’s Hospital, 700 Childrens Dr, Columbus, OH 43205 USA
| |
Collapse
|
14
|
Trafimow D, Uhalt J. The inaccuracy of sample-based confidence intervals to estimate a priori ones. METHODOLOGY-EUROPEAN JOURNAL OF RESEARCH METHODS FOR THE BEHAVIORAL AND SOCIAL SCIENCES 2020. [DOI: 10.5964/meth.2807] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/20/2022] Open
Abstract
Confidence intervals (CIs) constitute the most popular alternative to widely criticized null hypothesis significance tests. CIs provide more information than significance tests and lend themselves well to visual displays. Although CIs are no better than significance tests when used solely as significance tests, researchers need not limit themselves to this use of CIs. Rather, CIs can be used to estimate the precision of the data, and it is the precision argument that may set CIs in a superior position to significance tests. We tested two versions of the precision argument by performing computer simulations to test how well sample-based CIs estimate a priori CIs. One version pertains to precision of width whereas the other version pertains to precision of location. Using both versions, sample-based CIs poorly estimate a priori CIs at typical sample sizes and perform better as sample sizes increase.
Collapse
|
15
|
Irby-Shasanmi A, Erving CL. Gender Differences in the Effects of Support Exchanges on Self-Esteem and Mastery for Mid- to Late-Life Adults. BASIC AND APPLIED SOCIAL PSYCHOLOGY 2020. [DOI: 10.1080/01973533.2020.1768393] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/24/2022]
|
16
|
Hu D, Ahn JN, Vega M, Lin-Siegler X. Not All Scientists Are Equal: Role Aspirants Influence Role Modeling Outcomes in STEM. BASIC AND APPLIED SOCIAL PSYCHOLOGY 2020. [DOI: 10.1080/01973533.2020.1734006] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/24/2022]
|
17
|
Trafimow D, Wang C, Wang T. Making the A Priori Procedure Work for Differences Between Means. EDUCATIONAL AND PSYCHOLOGICAL MEASUREMENT 2020; 80:186-198. [PMID: 31933498 PMCID: PMC6943990 DOI: 10.1177/0013164419847509] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/10/2023]
Abstract
Previous researchers have proposed the a priori procedure, whereby the researcher specifies, prior to data collection, how closely she wishes the sample means to approach corresponding population means, and the degree of confidence of meeting the specification. However, an important limitation of previous research is that researchers sometimes are interested in differences between means, rather than in the means themselves. To address this limitation, we propose additional equations that expand the a priori procedure to handle differences between means, both in matched and in independent samples. Finally, implications are discussed.
Collapse
Affiliation(s)
| | - Cong Wang
- New Mexico State University, Las Cruces, NM, USA
| | - Tonghui Wang
- New Mexico State University, Las Cruces, NM, USA
| |
Collapse
|
18
|
Abstract
After obtaining a sample of published, peer-reviewed articles from journals with high and low impact factors in social, cognitive, neuro-, developmental, and clinical psychology, we used a priori equations recently derived by Trafimow (Educational and Psychological Measurement, 77, 831-854, 2017; Trafimow & MacDonald in Educational and Psychological Measurement, 77, 204-219, 2017) to compute the articles' median levels of precision. Our findings indicate that developmental research performs best with respect to precision, whereas cognitive research performs the worst; however, none of the psychology subfields excelled. In addition, we found important differences in precision between journals in the upper versus lower echelons with respect to impact factors in cognitive, neuro-, and clinical psychology, whereas the difference was dramatically attenuated for social and developmental psychology. Implications are discussed.
Collapse
|
19
|
Dolinska B, Jarząbek J, Dolinski D. I like You Even Less at Christmas Dinner! Prejudice Level as a Function of an Approaching National or Religious Holiday. BASIC AND APPLIED SOCIAL PSYCHOLOGY 2019. [DOI: 10.1080/01973533.2019.1695615] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/25/2022]
|
20
|
Uzarevic F, Saroglou V, Pichon I. Rejecting Opposite Ideologies without Discriminating against Ideological Opponents? Understanding Nonbelievers’ Outgroup Attitudes. BASIC AND APPLIED SOCIAL PSYCHOLOGY 2019. [DOI: 10.1080/01973533.2019.1689980] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/25/2022]
Affiliation(s)
- Filip Uzarevic
- Université catholique de Louvain
- Belgian National Fund for Scientific Research
| | | | | |
Collapse
|
21
|
Wang C, Wang T, Trafimow D, Myüz HA. Necessary sample sizes for specified closeness and confidence of matched data under the skew normal setting. COMMUN STAT-SIMUL C 2019. [DOI: 10.1080/03610918.2019.1661473] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/26/2022]
Affiliation(s)
- Cong Wang
- Department of Mathematical Sciences, New Mexico State University, Las Cruces, NM, USA
| | - Tonghui Wang
- Department of Mathematical Sciences, New Mexico State University, Las Cruces, NM, USA
| | - David Trafimow
- Department of Psychology, New Mexico State University, Las Cruces, NM, USA
| | - Hunter A. Myüz
- Department of Psychology, New Mexico State University, Las Cruces, NM, USA
| |
Collapse
|
22
|
A Frequentist Alternative to Significance Testing, p-Values, and Confidence Intervals. ECONOMETRICS 2019. [DOI: 10.3390/econometrics7020026] [Citation(s) in RCA: 24] [Impact Index Per Article: 4.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/17/2022]
Abstract
There has been much debate about null hypothesis significance testing, p-values without null hypothesis significance testing, and confidence intervals. The first major section of the present article addresses some of the main reasons these procedures are problematic. The conclusion is that none of them are satisfactory. However, there is a new procedure, termed the a priori procedure (APP), that validly aids researchers in obtaining sample statistics that have acceptable probabilities of being close to their corresponding population parameters. The second major section provides a description and review of APP advances. Not only does the APP avoid the problems that plague other inferential statistical procedures, but it is easy to perform too. Although the APP can be performed in conjunction with other procedures, the present recommendation is that it be used alone.
Collapse
|
23
|
Trafimow D. Why successful replications across contexts and Operationalizations might not be good for theory building or testing. JOURNAL FOR THE THEORY OF SOCIAL BEHAVIOUR 2019. [DOI: 10.1111/jtsb.12211] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/01/2022]
|
24
|
Trafimow D. Five Nonobvious Changes in Editorial Practice for Editors and Reviewers to Consider When Evaluating Submissions in a Post p < 0.05 Universe. AM STAT 2019. [DOI: 10.1080/00031305.2018.1537888] [Citation(s) in RCA: 12] [Impact Index Per Article: 2.4] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/27/2022]
Affiliation(s)
- David Trafimow
- Department of Psychology, New Mexico State University, Las Cruces, NM
| |
Collapse
|
25
|
Trafimow D, Wang T, Wang C. Means and standard deviations, or locations and scales? That is the question! NEW IDEAS IN PSYCHOLOGY 2018. [DOI: 10.1016/j.newideapsych.2018.03.001] [Citation(s) in RCA: 14] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/29/2022]
|