Genuinely unsure how this will play out for science. We have tools to do better science. Make fewer errors. Eliminate menial tasks But also to produce sloppier science. Make more errors than ever before. And create even more need for AI to help clean up the mess The case study has already begun.
Daniel LakensSeeing how these results are based on 2024 AI models, and based on my experience with agentic AI (such as Claude in VS Code, where it has access to data and the paper, and can iteratively run analyses) it seems clear that in the future AI will assist researchers in reproducibility checks.