#MetaSci is an active hashtag on Bluesky. In the last 30 days, 5 people shared 12 posts with it — around 0 a day. Activity is up 0% versus the previous week, peaking on Jul 14 with 3 posts.

Posts with #MetaSci

Berna Devezer

@devezer.bsky.social

over 1 year ago

Finally our editorial for the "What makes a good theory?" special issue is out (co-edited with @irisvanrooij.bsky.social, @jcskewes.bsky.social, Sashank Varma, and Todd Wareham). It's an interdisciplinary issue and the contents are transdisciplinary. #philsci #metasci #cogsci #ai #psych 🧪

link.springer.com

What Makes a Good Theory? Interdisciplinary Perspectives - Computational Brain & Behavior

Computational Brain & Behavior -

18 141 341

The HPS Podcast

@hpspodcast.bsky.social

almost 2 years ago

We made another thing! Here is a pretty great 'HPS Starter Pack' so you too can follow all the awesome history, philosophy and social studies of science (and #metasci #histSTM #philsci #philsky #hps #histsci 🧪) accounts on Bluesky. Please share widely #academicsky :)

History & Philosophy of Science (HPS) Starter Pack

A starter pack focussing on HPS, History of Science and Philosophy of Science, along with relevant STS (science & technology studies), metascience and HistSTM (history of science, technology and medicine) accounts

69 187 341

Eric Schares

@eschares.bsky.social

over 1 year ago

🚨 Preprint! We combine our recent open dataset of #APC prices with the article counts per journal-year from #OpenAlex to estimate how much the academic community has paid in APCs over the last 5 years. A. $8.349 billion ($8.968 B in 2023 USD) $2.5B in 2023 alone. arxiv.org/abs/2407.16551 #metasci

arxiv.org

Estimating global article processing charges paid to six publishers for open access between 2019 and 2023

This study presents estimates of the global expenditure on article processing charges (APCs) paid to six publishers for open access between 2019 and 2023. APCs are fees charged for publishing in some ...

6 144 186

Angela Potochnik

@apotochnik.bsky.social

over 2 years ago

Do you teach about the nature of science and scientific methods, or want to? Recipes for Science 2nd ed. is shipping 4/10! This book fits needs of education, HPS, STS, and some science courses. Read on for details... #philsci #philsky #histsci #STS #metasci #SciComm

Image of book cover: Recipes for Science: An Introduction to Scientific Methods and Reasoning. Angela Potochnik, Matteo Colombo, and Cory Wright. Second Edition.

7 41 141

Berna Devezer

@devezer.bsky.social

almost 2 years ago

Article fresh off the print (no paywall)! The tl;dr is in the quoted thread. We advance a measure of replication distance to capture differences btw an original study & its replications. We also discuss how statistics needs to go beyond ideal assumptions to serve science better. #metasci #sts #stat

www.mdpi.com

Statistics in Service of Metascience: Measuring Replication Distance with Reproducibility Rate

Motivated by the recent putative reproducibility crisis, we discuss the relationship between the replicability of scientific studies, the reproducibility of results obtained in these replications, and...

Berna Devezer @devezer.bsky.social

Alright, time for a thread! This new collaboration with Erkan is an extension of our stats-heavy approach to understanding reproducibility and replications. It is based on our theoretical framework and previous results reported over a series of papers in the last five years. #metasci #sts #philsci

doi.org

6 47 128

Berna Devezer

@devezer.bsky.social

about 1 year ago

all this talk about changes in p-value magnitude being interpreted as an increase in the "quality of evidence" necessitates that i share this. we all should share and actually read this in fact (for starters). #stats #metasci

www.tandfonline.com

The Difference Between “Significant” and “Not Significant” is not Itself Statistically Significant

It is common to summarize statistical comparisons by declarations of statistical significance or nonsignificance. Here we discuss one problem with such declarations, namely that changes in statisti...

4 34 115

Berna Devezer

@devezer.bsky.social

over 1 year ago

A revised version of "Minimum Viable Experiment to Replicate" is up, where we expound why standard expectations from replications are unrealistic and experiments that may deliver on those replications are rare, if not nonexistent. #metasci #sts #philsci philsci-archive.pitt.edu/24720/7/Mini...

Minimum Viable Experiment to Replicate
Berna Devezer and Erkan O. Buzbas
Department of Business, University of Idaho
Department of Mathematics and Statistical Science, University of Idaho

Abstract: In theory, replication experiments purport to independently
validate claims from previous research or provide some diagnostic evidence about their truth value. In practice, this value
of replication experiments is often taken for granted. Our research shows that in replication experiments, practice often does
not live up to theory. Most replication experiments involve confounding factors and their results are not uniquely determined
by the treatment of interest, hence are uninterpretable. These
results can be driven by the true data generating mechanism,
limitations of the original experimental design, discrepancies
between the original and the replication experiment, distinct
limitations of the replication experiment, or combinations of any
of these factors. Here we introduce the notion of minimum viable experiment to replicate which defines experimental conditions that always yield interpretable replication results and is
replication-ready. We believe that most reported experiments
are not replication-ready and before striving to replicate a given
result, we need theoretical precision in or systematic exploration
of the experimental space to discover empirical regularities.

6 32 108

Angela Potochnik

@apotochnik.bsky.social

over 2 years ago

Newly published: Science and the Public. In this Element, I explore the relationship between science and the public with resources from philosophy of science. Details in thread below. Volume is free online until 4/9. t.co/mKYvwSls3c #philsci #philsky #histsci #STS #metasci #SciComm

Image of test tubes, which is the cover art for all books in this series, with text: "Cambridge Elements Philosophy of Science, Science and the Public, Angela Potochnik"

8 49 104

Berna Devezer

@devezer.bsky.social

almost 2 years ago

Retraction notice for "High replicability of newly discovered social-behavioural findings is achievable" is up: www.nature.com/articles/s41... The editors cite @jbakcoleman.bsky.social and my MA as the original source of concerns: www.nature.com/articles/s41... #metasci

The Editors are retracting this article following concerns initially raised by Bak-Coleman and Devezer.

The concerns relate to lack of transparency and misstatement of the hypotheses and predictions the reported meta-study was designed to test; lack of preregistration for measures and analyses supporting the titular claim (against statements asserting preregistration in the published article); selection of outcome measures and analyses with knowledge of the data; and incomplete reporting of data and analyses.

Post-publication peer review and editorial examination of materials made available by the authors upheld these concerns. As a result, the Editors no longer have confidence in the reliability of the findings and conclusions reported in this article. The authors have been invited to submit a new manuscript for peer review.

All authors agree to this retraction due to incorrect statements of preregistration for the meta-study as a whole but disagree with other concerns listed in t

Jessica Hullman @jessicahullman.bsky.social

In other science reform implosion news, the contested article including OSF & Data Colada authors on how preregistration & other rigor-enhanching practices led to high observed replicability (the one that couldn't produce its own preregistration) was just retracted www.nature.com/articles/s41...

www.nature.com

5 31 99

Mark Rubin

@markrubin.bsky.social

over 1 year ago

Few #MetaSci #STS and Science of Science Starter Packs here 👇 🧵 (1) Science of Science Starter Pack 1 by @shahanmemon.bsky.social

People working on science of science, meta science, STS, philosophy of science, history of science, economics of science, science policy, science of AI-mediated science, AI4science, and so on.

7 36 87

Alisa Bokulich

@alisabokulich.bsky.social

about 1 year ago

⏰ Free access to read & download thru August 20 the final published version of Wendy Parker & my paper "Understanding Data Uncertainty" at this link ⬇️ authors.elsevier.com/c/1l…. #philsci #metasci 🧪 ⚒️

Studies in History and Philosophy of Science
journal homepage: www.elsevier.com/locate/shpsa
Understanding data uncertainty
Alisa Bokulich", Wendy S. Parker b,"
" Department of Philosophy, Boston University, United States
› Department of Philosophy, Virginia Tech, United States
ABSTRACT
Scientific data without uncertainty estimates are increasingly seen as incomplete. Recent discussions in the philosophy of data, however, have given little attention to the nature of uncertainty estimation. We begin to redress this gap by, first, discussing the concepts and practices of uncertainty estimation in metrology and showing how they can be adapted for scientific data more broadly; and second, advancing five philosophical theses about uncertainty estimates for data: they are substantive
adequacy-for-purpose view of uncertainty estimation, addresses a weakness in a recent philosophical account of data, and provides a new perspective on the "safety" versus "precision" debate in metrology.
1. Introduction
Uncertainty is an inescapable part of science. Yet while much has been written in recent years on uncertainty in computational modeling contexts (especially related to climate modeling; see, e.g., Parker, 2010;
Frigg, Thompson, & Werndl, 2015; Knutti et al., 2019), comparatively little philosophical attention has been given to uncertainty associated with scientific data collected via observation, measurement, and experiment. Important preliminary work on this topic examines the evaluation of systematic uncertainty in measurement (Staley, 2020), changing conceptions of uncertainty in metrology (de Courtenay & Grégis, 2017; Grégis, 2019b), and the representation of uncertainty when measurements are discordant (Grégis, 2019a). Overall, however, when it comes to uncertainty associated with scientific data obtained via observation, measurement, and experiment—what we will call "data uncertainty"-the territory remains largely unexplored from a philosophical point of view.
Conception…

1 24 81

Anna Alexandrova

@annaalexandrova.bsky.social

over 2 years ago

My review of The Tangle of Science is out. Have a look at this book for how to think of reliability of science without appealing to the usual suspects of confirmation, scientific method, rigour etc. I found it genuinely important and refreshing if incomplete. #philsci #philsky #metasci #scipol

academic.oup.com

The Tangle of Science: Reliability Beyond Method, Rigour, and Objectivity, by Nancy Cartwright, Jere...

The Tangle of Science undertakes to change the focus of philosophy of science towards the reliability of scientific products. Both parts matter. Reliability is

5 29 80