BEGIN:VCALENDAR
VERSION:2.0
PRODID:-//History and Philosophy of Science Events - ECPv6.15.20//NONSGML v1.0//EN
CALSCALE:GREGORIAN
METHOD:PUBLISH
X-ORIGINAL-URL:https://hps-events.sydney.edu.au
X-WR-CALDESC:Events for History and Philosophy of Science Events
REFRESH-INTERVAL;VALUE=DURATION:PT1H
X-Robots-Tag:noindex
X-PUBLISHED-TTL:PT1H
BEGIN:VTIMEZONE
TZID:Australia/Sydney
BEGIN:STANDARD
TZOFFSETFROM:+1100
TZOFFSETTO:+1000
TZNAME:AEST
DTSTART:20240406T160000
END:STANDARD
BEGIN:DAYLIGHT
TZOFFSETFROM:+1000
TZOFFSETTO:+1100
TZNAME:AEDT
DTSTART:20241005T160000
END:DAYLIGHT
BEGIN:STANDARD
TZOFFSETFROM:+1100
TZOFFSETTO:+1000
TZNAME:AEST
DTSTART:20250405T160000
END:STANDARD
BEGIN:DAYLIGHT
TZOFFSETFROM:+1000
TZOFFSETTO:+1100
TZNAME:AEDT
DTSTART:20251004T160000
END:DAYLIGHT
BEGIN:STANDARD
TZOFFSETFROM:+1100
TZOFFSETTO:+1000
TZNAME:AEST
DTSTART:20260404T160000
END:STANDARD
BEGIN:DAYLIGHT
TZOFFSETFROM:+1000
TZOFFSETTO:+1100
TZNAME:AEDT
DTSTART:20261003T160000
END:DAYLIGHT
END:VTIMEZONE
BEGIN:VEVENT
DTSTART;TZID=Australia/Sydney:20250915T170000
DTEND;TZID=Australia/Sydney:20250915T180000
DTSTAMP:20260429T015557
CREATED:20250804T014709Z
LAST-MODIFIED:20250909T231204Z
UID:97-1757955600-1757959200@hps-events.sydney.edu.au
SUMMARY:If peer review is broken\, what can fix it? Some suggestions from the repliCATS project (Collaborative Assessments for Trustworthy Science) - Prof Fiona Fidler
DESCRIPTION:Abstract \nIn many scientific fields\, post-publication surveys of the literature find that peer reviewers routinely overlook methodological flaws and statistical errors\, avoid reporting suspected instances of fraud\, and commonly reach a level of agreement barely exceeding what would be expected by chance. Other studies expose the extent of gender bias in peer review\, and questionable editorial protocols that lack transparency. Anecdotally\, editors also report increasingly difficulty in recruiting reviewers. What can be done about these well-known problems? This talk proposes an alternative model of peer review\, drawing from expert elicitation\, deliberation and decision-making literature and our experience running the repliCATS project. There is perhaps a limited role for AI in an overhaul of peer review\, but that is not the focus of the talk. \nNow in its seventh year\, the repliCATS project has evaluated over 4\,000 published social science articles across 8 disciplines\, including psychology\, economics\, and education\, as well as hundreds of preprints on PsyArXiv. For each paper\, a diverse group of experts discuss and forecast the likely replicability of the research findings and make a variety of other judgements about the credibility of the evidence presented using a structured deliberation protocol. This talk will present our approach to evaluating research\, and for cases where we have the outcome of actual replication studies\, data about the accuracy of our forecasts. \nSpeaker \nFiona Fidler is Professor and Head of the History & Philosophy of Science (HPS) Program at the University of Melbourne. She is broadly interested in how experts\, especially scientists\, make decisions and change their minds. Her past research has examined how methodological change occurs in different disciplines\, including psychology\, medicine and ecology. She is also interested in methods for eliciting reliable expert judgements to improve decision making\, including peer review decisions. She has been active in establishing the Metascience community in Australia\, and was the founding president of the Association for Interdisciplinary Metaresearch and Open Science (AIMOS). She is co-director of the MetaMelb Research Initiative at the University of Melbourne\, and lead PI of the repliCATS project (Collaborative Assessments for Trustworthy Science). \n 
URL:https://hps-events.sydney.edu.au/event/if-peer-review-is-broken-what-can-fix-it-some-suggestions-from-the-replicats-project-collaborative-assessments-for-trustworthy-science/
LOCATION:Michael Spence Building\, F23\,Level 5\, Room 501\, University of Sydney\, New South Wales\, 2006\, Australia
ORGANIZER;CN="School of History and Philosophy of Science":MAILTO:hps.admin@sydney.edu.au
END:VEVENT
END:VCALENDAR