Science, AI, and illusions of understanding - Many Minds
- Rating
-
- Fav.
- Waveform
-
- Action
-
- Link
- Title
- Science, AI, and illusions of understanding
- Description
- <p class="p1"><em>AI will fundamentally transform science. It will supercharge the research process, making it faster and more efficient and broader in scope. It will make scientists themselves vastly more productive, more objective, maybe more creative. It will make many human participants—and probably some human scientists—obsolete</em>… Or at least these are some of the claims we are hearing these days. There is no question that various AI tools could radically reshape how science is done, and how <em>much</em> science is done. What we stand to gain in all this is pretty clear. What we stand to lose is less obvious, but no less important.</p> <p class="p1">My guest today is <a href= "https://psychology.princeton.edu/people/molly-crockett"><span class="s1"> Dr. Molly Crockett</span></a>. Molly is a Professor in the Department of Psychology and the University Center for Human Values at Princeton University. In a recent <a href= "https://static1.squarespace.com/static/538ca3ade4b090f9ef331978/t/65f071f8fd3e3b478a4f4b86/1710256633821/Messeri&Crockett_2024_Nature.pdf"> <span class="s1">widely-discussed article</span></a>, Molly and the anthropologist <a href="https://www.lisamesseri.com/"><span class= "s1">Dr. Lisa Messeri</span></a> presented a framework for thinking about the different roles that are being imagined for AI in science. And they argue that, when we adopt AI in these ways, we become vulnerable to certain illusions.</p> <p class="p1">Here, Molly and I talk about four visions of AI in science that are currently circulating: AI as an Oracle, as a Surrogate, as a Quant, and as an Arbiter. We talk about the very real problems in the scientific process that AI promises to help us solve. We consider the ethics and challenges of using Large Language Models as experimental subjects. We talk about three illusions of understanding the crop up when we uncritically adopt AI into the research pipeline—an illusion that we understand more than we actually do; an illusion that we're covering a larger swath of a research space than we actually are; and the illusion that AI makes our work more objective. We also talk about how ideas from Science and Technology Studies (or STS) can help us make sense of this AI-driven transformation that, like it or no, is already upon us. Along the way Molly and I touch on: AI therapists and AI tutors, anthropomorphism, the culture and ideology of Silicon Valley, Amazon's Mechanical Turk, fMRI, objectivity, quantification, Molly's mid-career crisis, monocultures, and the squishy parts of human experience.</p> <p class="p1">Without further ado, on to my conversation with Dr. Molly Crockett. Enjoy!</p> <p class="p2"> </p> <p class="p1">A transcript of this episode will be posted soon.</p> <p class="p3"> </p> <p class="p4"><span class="s2"><em>Notes and links</em></span></p> <p class="p4">5:00 – For more on LLMs—and the question of whether we understand how they work—see our <a href= "https://disi.org/what-does-chatgpt-really-know/"><span class= "s1">earlier episode</span></a> with Murray Shanahan.</p> <p class="p4">9:00 – For the paper by Dr. Crockett and colleagues about the social/behavioral sciences and the COVID-19 pandemic, see <a href= "https://www.nature.com/articles/s41562-020-0884-z"><span class= "s1">here</span></a>. </p> <p class="p4">11:30 – For Dr. Crockett and colleagues’ work on outrage on social media, see this <a href= "https://www.nature.com/articles/s41562-023-01582-0"><span class= "s1">recent paper</span></a>.<span class= "Apple-converted-space"> </span></p> <p class="p4">18:00 – For a recent exchange on the prospects of using LLMs in scientific peer review, see <a href= "https://www.nature.com/articles/d41586-025-01839-w"><span class= "s1">here</span></a>.</p> <p class="p4">20:30 – Donna Haraway’s essay, 'Situated Knowledges: The Science Question in Feminism and the Privilege of Partial Perspective’, is <a href= "https://www.jstor.org/stable/3178066?seq=1"><span class= "s1">here</span></a>. See also Dr. Haraway's book, <a href= "https://www
- Publication Date
- 2025-06-26T21:11:00+00:00
- Status
- completed
- Website
- https://manyminds.libsyn.com/science-ai-and-illusions-of-understanding
- Length
- 59:46
- File
- /podcasts/Many Minds/1750972260-5090.mp3
- Size
- 82.08 MB
- Bitrate
- 187-CBR
- Channels
- 1
Queries: 25 | Cache Hits: 0 | Load Time: 0.4717 | 2 MB