Siddique, Muhammad Omar2024-06-122024-06-122023https://hdl.handle.net/2440/141221This item is only available electronically.Limited research has explored the application of Large Language Models (LLMs), such as ChatGPT, in writing journal abstracts. To determine the practicability of LLMs in psychology research writing, I investigated the distinguishability of Al-generated versus human-authored abstracts through a mixed between-within participants experiment. Fifty-six participants with varying levels of researcher experience in psychology completed a survey in which they viewed five Al-generated and five human-authored psychology abstracts. Using Signal Detection Theory (SDT) to investigate whether participants were able to distinguish between Al-generated and human-authored abstracts, it was found that students and researchers performed poorly when distinguishing between the two types of abstracts, with a mean performance of 52% correct and a d-prime of 0.11. I then investigated if the level of researcher experience between Undergraduate Students, Ongoing Postgraduate Students, and Completed Postgraduate Researchers, influenced ability to distinguish between Al-generated and human-authored abstracts. A one-way ANOVA and post-hoc tests revealed that Undergraduates and Ongoing Postgraduates were almost equally as proficient and demonstrated significantly better distinguishing ability than Completed Postgraduates. Finally, linvestigated whether participants evaluated the textual quality of ChatGPT abstracts as equivalent to human-authored abstracts and discovered through a paired t-test that Al-generated abstracts were evaluated as significantly better. The results present important implications regarding the use of LLMs within psychological research, as well as the need for students and researchers to build their Al literacy. Research protocol is available on the Open Science Framework (OSF). Key words: Artificial Intelligence (Al), Large Language Model (LLM), Abstracts, ChatGPT, Signal Detection Theory (SDT)Honours; PsychologyThesis