BEGIN:VCALENDAR VERSION:2.0 PRODID:-//events.la.psu.edu//EN CALSCALE:GREGORIAN BEGIN:VTIMEZONE TZID:America/New_York BEGIN:STANDARD DTSTART:20201101T020000 TZOFFSETFROM:-0400 TZOFFSETTO:-0500 RRULE:FREQ=YEARLY;BYMONTH=11;BYDAY=1SU END:STANDARD BEGIN:DAYLIGHT DTSTART:20200308T020000 TZOFFSETFROM:-0500 TZOFFSETTO:-0400 RRULE:FREQ=YEARLY;BYMONTH=3;BYDAY=2SU END:DAYLIGHT END:VTIMEZONE BEGIN:VEVENT UID:16980-4dd5710b2cb4710f936842ca3548f6ae@events.la.psu.edu DTSTAMP:20260412T053932Z DTSTART;TZID=America/New_York:20230331T090000 DTEND;TZID=America/New_York:20230331T103000 SUMMARY:Dr. Joseph Casillas (Rutgers University) DESCRIPTION:\n“Out of the Garden and into the Multiverse: Open Science P ractices\, Multidimensional Degrees of Freedom\, and the Speech Sciences "\n\nDr. Joseph Casillas\, Associate Professor in the Department of Span ish and Portuguese at Rutgers University\n\nFriday\, March 31\, 2023\, 9 :00-10:30 am\, in 127 Moore and via Zoom\n\nThe early 2010’s saw the rep roducibility crisis take hold of the psychological sciences. As a conseq uence\, a push for increased transparency and reproducible methodology ( e.g. open access publishing\, preregistration\, sharing study materials\ , data\, and analyses\, performing study replications\, declaring confli cts of interest\, ect.) to help mitigate the effects of questionable res earch practices (e.g.\, p-hacking\, HARKing\, researcher degrees of free dom) has followed. The resulting methodological framework and associated techniques\, now referred to as open science\, have reshaped research m ethods in psychology and have slowly but surely made their way into adja cent fields. In this talk\, Joseph Casillas will consider challenges rel ated to open science practices and researcher degrees of freedom in the field of linguistics.\n\nLanguage-related data are complicated and typic ally subject to myriad operationalizations. Analytic flexibility in data analysis— commonly referred to as researcher degrees of freedom (Gelman &\; Loken\, 2014\; Simmons\, Nelson\, &\; Simonsohn\, 2011)—can r esult in substantially different conclusions based on the same data set\ , a situation some refer to as the inference crisis (see Rotello\, Heit\ , &\; Dubé\, 2015\; Starns et al.\, 2019). The so-called “garden of f orking paths” associated with researcher degrees of freedom directly aff ects our ability to replicate findings and accumulate knowledge.\n\nMore over\, the scientific study of language spans numerous disciplines and e ncompasses social\, cultural\, cognitive\, technological\, and biomedica l studies of human nature and behavior. As linguistics becomes increasin gly empirical and quantitative\, unique challenges arise regarding the m ethodological practices aimed at improving reproducibility/replicability . One of the proposed solutions to the replicability crisis has been the implementation of open science practices. As a consequence\, today’s sp eech researcher must be up to date on the current protocols of open scie nce in order to produce research projects that meet these new methodolog ical standards. However\, an important consideration often overlooked in the wake of the open science movement deals with how current linguists train the next generation of researchers. Few\, if any\, researchers hav e had explicit instruction on the practices of open science as part of t heir professional training.\n\nIn this talk\, he will present research o n open science and transparency practices in the field of linguistics. H e will show that\, by and large\, linguistics does not engage in open sc ience and transparency practices\, though there is reason to believe thi s is changing for the better. Furthermore\, he will present data from th e Many Speech Analyses Project showing that the problem of researcher de grees of freedom is likely much more serious than our current understand ing suggests. To conclude\, he will discuss what we learn from methodolo gical reform\, many analyst-type studies\, and big team science\, as wel l as what current trends mean for linguistics\, generally—and for some s ub-fields of linguistics\, specifically—. He will present solutions aime d at reducing researcher degrees of freedom and fostering open science p ractices in linguistics.\n\nFor more details: https://events.la.psu.edu/ event/dr-joseph-casillas-rutgers-university/ X-ALT-DESC;FMTTYPE=text/html:

“Out of the Garden and into the Multiverse: Open Science Practices, Multidimens ional Degrees of Freedom, and the Speech Sciences"

Dr. Joseph Casillas, Associate Professor in the Department of Spanish and Portuguese at Rutgers University

Friday, Marc h 31, 2023, 9:00-10:30 am, in 127 Moore and via Zoom

The early 2010’s saw the reproducibility crisis take hold of the psychologic al sciences. As a consequence, a push for increased transparency and rep roducible methodology (e.g. open access publishing, preregistration, sha ring study materials, data, and analyses, performing study replications, declaring conflicts of interest, ect.) to help mitigate the effects of questionable research practices (e.g., p-hacking, HARKing, researcher de grees of freedom) has followed. The resulting methodological framework a nd associated techniques, now referred to as open science, have reshaped research methods in psychology and have slowly but surely made their wa y into adjacent fields. In this talk, Joseph Casillas will consider chal lenges related to open science practices and researcher degrees of freed om in the field of linguistics.

Language-related data are complica ted and typically subject to myriad operationalizations. Analytic flexib ility in data analysis— commonly referred to as researcher degrees of fr eedom (Gelman & Loken, 2014; Simmons, Nelson, & Simonsohn, 2011) —can result in substantially different conclusions based on the same dat a set, a situation some refer to as the inference crisis (see Rotello, H eit, & Dubé, 2015; Starns et al., 2019). The so-called “garden of fo rking paths” associated with researcher degrees of freedom directly affe cts our ability to replicate findings and accumulate knowledge.

Mo reover, the scientific study of language spans numerous disciplines and encompasses social, cultural, cognitive, technological, and biomedical s tudies of human nature and behavior. As linguistics becomes increasingly empirical and quantitative, unique challenges arise regarding the metho dological practices aimed at improving reproducibility/replicability. On e of the proposed solutions to the replicability crisis has been the imp lementation of open science practices. As a consequence, today’s speech researcher must be up to date on the current protocols of open science i n order to produce research projects that meet these new methodological standards. However, an important consideration often overlooked in the w ake of the open science movement deals with how current linguists train the next generation of researchers. Few, if any, researchers have had ex plicit instruction on the practices of open science as part of their pro fessional training.

In this talk, he will present research on open science and transparency practices in the field of linguistics. He will show that, by and large, linguistics does not engage in open science an d transparency practices, though there is reason to believe this is chan ging for the better. Furthermore, he will present data from the Many Spe ech Analyses Project showing that the problem of researcher degrees of f reedom is likely much more serious than our current understanding sugges ts. To conclude, he will discuss what we learn from methodological refor m, many analyst-type studies, and big team science, as well as what curr ent trends mean for linguistics, generally—and for some sub-fields of li nguistics, specifically—. He will present solutions aimed at reducing re searcher degrees of freedom and fostering open science practices in ling uistics.

For more details: https://events.la.psu.edu/even t/dr-joseph-casillas-rutgers-university/

END:VEVENT END:VCALENDAR