Exploring the Impact of ChatGPT on Scientific Research: Assessing Strengths, Weaknesses, Opportunities, and Threats

Yousef F. Alfarraj; Yousef Wardat

doi:10.25159/1947-9417/16006

Authors

Yousef F. Alfarraj King Saud University
Yousef Wardat Yarmouk University https://orcid.org/0000-0003-2370-9808

DOI:

https://doi.org/10.25159/1947-9417/16006

Keywords:

AI, ethics, artificial intelligence, ChatGPT , large language model, prompt engineering, scientific research, SWOT analysis

Abstract

ChatGPT’s adaptability spans various fields, notably scientific research. This research investigates the transformative possibilities of incorporating ChatGPT into scientific enquiry, employing a strengths, weaknesses, opportunities, and threats (SWOT) analysis to examine its merits and drawbacks. The analysis highlights the model’s strengths, encompassing an extensive knowledge base, linguistic proficiency, information-retrieval capabilities, and continuous learning capacity. Conversely, it uncovers weaknesses such as a lack of contextual comprehension, potential dependence on training data, limitations in information verification, and constrained critical thinking abilities. Amidst these considerations, opportunities emerge, including support for literature reviews, fostering collaborative ideation, facilitating seamless language translation, interpretation, and enhancing knowledge dissemination. However, a range of threats looms, encompassing concerns about plagiarism, ethical dilemmas, the dissemination of misinformation, and the potential erosion of higher-order cognitive skills. These multifaceted elements warrant comprehensive examination. Recommendations for researchers incorporating ChatGPT advocate for a balanced approach that harmonises artificial intelligence with human creativity to maintain research integrity. The potential of ChatGPT to reshape scientific exploration hinges on judicious use and ongoing oversight.

Metrics

Metrics Loading ...

References

Alkaissi, H., and S. I. McFarlane. 2023. “Artificial Hallucinations in ChatGPT: Implications in Scientific Writing”. Cureus 15 (2): e35179. https://doi.org/10.7759/cureus.35179. DOI: https://doi.org/10.7759/cureus.35179

Alneyadi, S., and Y. Wardat. 2023. “ChatGPT: Revolutionizing Student Achievement in the Electronic Magnetism Unit for Eleventh-Grade Students in Emirates Schools”. Contemporary Educational Technology 15 (4): ep448. https://doi.org/10.30935/cedtech/13417. DOI: https://doi.org/10.30935/cedtech/13417

Alneyadi, S., Y. Wardat, Q. Alshannag, and A. Abu-Al-Aish. 2023. “The Effect of Using Smart E-Learning App on the Academic Achievement of Eighth-Grade Students”. Eurasia Journal of Mathematics, Science and Technology Education 19 (4): em2248. https://doi.org/10.29333/ejmste/13067. DOI: https://doi.org/10.29333/ejmste/13067

Alser, M., and E. Waisberg. 2023. “Concerns with the Usage of ChatGPT in Academia and Medicine: A Viewpoint”. American Journal of Medicine Open 9: 100036. https://doi.org/10.1016/j.ajmo.2023.100036. DOI: https://doi.org/10.1016/j.ajmo.2023.100036

Azaria, A., R. Azoulay, and S. Reches. 2023. “ChatGPT Is a Remarkable Tool—For Experts”. arXiv. https://doi.org/10.48550/arXiv.2306.03102. DOI: https://doi.org/10.1162/dint_a_00235

Bang, Y., S. Cahyawijaya, N. Lee, W. Dai, D. Su, B. Wilie, H. Lovenia, Z. Ji, T. Yu, W. Chung, Q. V. Do, Y. Xu, and P. Fung. 2023. “A Multitask, Multilingual, Multimodal Evaluation of ChatGPT on Reasoning, Hallucination, and Interactivity”. arXiv. https://doi.org/10.48550/arXiv.2302.04023. DOI: https://doi.org/10.18653/v1/2023.ijcnlp-main.45

Benzaghta, M. A., A. Elwalda, M. M. Mousa, I. Erkan, and M. Rahman. 2021. “SWOT Analysis Applications: An Integrative Literature Review”. Journal of Global Business Insights 6 (1): 55–73. https://www.doi.org/10.5038/2640-6489.6.1.1148. DOI: https://doi.org/10.5038/2640-6489.6.1.1148

Bin-Hady, W. R. A., A. Al-Kadi, A. Hazaea, and J. K. M. Ali. 2023. “Exploring the Dimensions of ChatGPT in English Language Learning: A Global Perspective”. Library Hi Tech. https://doi.org/10.1108/LHT-05-2023-0200. DOI: https://doi.org/10.1108/LHT-05-2023-0200

Bom, H. S. H. 2023. “Exploring the Opportunities and Challenges of ChatGPT in Academic Writing: A Roundtable Discussion”. Nuclear Medicine and Molecular Imaging 57: 165–167. https://doi.org/10.1007/s13139-023-00809-2. DOI: https://doi.org/10.1007/s13139-023-00809-2

Chinonso, E. T. 2023. “The Impact of ChatGPT on Privacy and Data Protection Laws”. SSRN. https://doi.org/10.2139/ssrn.4574016. DOI: https://doi.org/10.2139/ssrn.4574016

Chiu, T. K., and C.-S. Chai. 2020. “Sustainable Curriculum Planning for Artificial Intelligence Education: A Self-Determination Theory Perspective”. Sustainability 12 (14): 5568. https://doi.org/10.3390/su12145568. DOI: https://doi.org/10.3390/su12145568

Chowdhury, N., and S. Rahman. 2023. “A Brief Review of ChatGPT: Limitations, Challenges and Ethical-Social Implications”. BSc essay, Chongqing University of Posts and Telecommunications. https://www.researchgate.net/publication/368397881_A_brief_review_of_ChatGPT_Limitations_Challenges_and_Ethical-Social_Implications.

Chubb, J., P. Cowling, and D. Reed. 2022. “Speeding Up to Keep Up: Exploring the Use of AI in the Research Process”. AI and Society 37: 1439–1457. https://doi.org/10.1007/s00146-021-01259-0. DOI: https://doi.org/10.1007/s00146-021-01259-0

Cotton, D. R., P. A. Cotton, and J. R. Shipway. 2023. “Chatting and Cheating: Ensuring Academic Integrity in the Era of ChatGPT”. Innovations in Education and Teaching International 61 (2): 228–239. https://doi.org/10.1080/14703297.2023.2190148. DOI: https://doi.org/10.1080/14703297.2023.2190148

Dale, R. 2021. “GPT-3: What’s It Good For?” Natural Language Engineering 27 (1): 113–118. https://doi.org/10.1017/S1351324920000601. DOI: https://doi.org/10.1017/S1351324920000601

Farrokhnia, M., S. K. Banihashem, O. Noroozi, and A. Wals. 2023. “A SWOT Analysis of ChatGPT: Implications for Educational Practice and Research”. Innovations in Education and Teaching International 61 (3): 460–474. https://doi.org/10.1080/14703297.2023.2195846. DOI: https://doi.org/10.1080/14703297.2023.2195846

Gao, Y., R. Wang, and F. Hou. 2023. “Unleashing the Power of ChatGPT for Translation: An Empirical Study”. arXiv. https://doi.org/10.48550/arXiv.2304.02182.

Gibson, L., F. E. Obiakor, and S. O. Obi. 2023. “Using Technology to Enhance Learning for Students from Culturally and Linguistically Diverse Backgrounds”. In Using Technology to Enhance Special Education, edited by J. P. Bakken and F. E. Obiakor, Advances in Special Education Vol. 37, 199–214. Leeds: Emerald Publishing. https://doi.org/10.1108/S0270-401320230000037012. DOI: https://doi.org/10.1108/S0270-401320230000037012

Gilson, A., C. W. Safranek, T. Huang, V. Socrates, L. Chi, R. A. Taylor, and D. Chartash. 2023. “How Does ChatGPT Perform on the United States Medical Licensing Examination (USMLE)? The Implications of Large Language Models for Medical Education and Knowledge Assessment”. JMIR Medical Education 9: e45312. https://doi.org/10.2196/45312. DOI: https://doi.org/10.2196/45312

Giray, L. 2023. “Prompt Engineering with ChatGPT: A Guide for Academic Writers”. Annals of Biomedical Engineering 51: 2629–2633. https://doi.org/10.1007/s10439-023-03272-4. DOI: https://doi.org/10.1007/s10439-023-03272-4

Gningue, S. M., R. Peach, A. M. Jarrah, and Y. Wardat. 2022. “The Relationship between Teacher Leadership and School Climate: Findings from a Teacher-Leadership Project”. Education Sciences 12 (11): 749. https://doi.org/10.3390/educsci12110749. DOI: https://doi.org/10.3390/educsci12110749

Hidayat, R., and Y. Wardat. 2024. “A Systematic Review of Augmented Reality in Science, Technology, Engineering and Mathematics Education”. Education and Information Technologies 29: 9257–9282. https://doi.org/10.1007/s10639-023-12157-x. DOI: https://doi.org/10.1007/s10639-023-12157-x

Jain, S., and R. Jain. 2019. “Role of Artificial Intelligence in Higher Education: An Empirical Investigation”. IJRAR: International Journal of Research and Analytical Reviews 6 (2): 144–150. http://ijrar.com/upload_issue/ijrar_issue_20544069.pdf.

Jarrah, A. M., H. Almassri, J. D. Johnson, and Y. Wardat. 2022. “Assessing the Impact of Digital Games-Based Learning on Students’ Performance in Learning Fractions Using (ABACUS) Software Application”. Eurasia Journal of Mathematics, Science and Technology Education 18 (10): em2159. https://doi.org/10.29333/ejmste/12421. DOI: https://doi.org/10.29333/ejmste/12421

Jarrah, A. M., Y. Wardat, and P. Fidalgo. 2023. “Using ChatGPT in Academic Writing Is (Not) a Form of Plagiarism: What Does the Literature Say?” Online Journal of Communication and Media Technologies 13 (4): e202346. https://doi.org/10.30935/ojcmt/13572. DOI: https://doi.org/10.30935/ojcmt/13572

Jiao, W., W. Wang, J.-T. Huang, X. Wang, S. Shi, and Z. Tu. 2023. “Is ChatGPT a Good Translator? Yes with GPT-4 as the Engine”. arXiv. https://doi.org/10.48550/arXiv.2301.08745.

Kalla, D., and N. Smith. 2023. “Study and Analysis of ChatGPT and Its Impact on Different Fields of Study”. International Journal of Innovative Science and Research Technology 8 (3): 827–833.

Kasneci, E., K. Seßler, S. Küchemann, M. Bannert, D. Dementieva, F. Fischer, U. Gasser, G. Groh, S. Günnemann, E. Hüllermeier, S. Krusche, G. Kutyniok, T. Michaeli, C. Nerdel, J. Pfeffer, O. Poquet, M. Sailer, A. Schmidt, T. Seidel, M. Stadler, J. Weller, J. Kuhn, and G. Kasneci. 2023. “ChatGPT for Good? On Opportunities and Challenges of Large Language Models for Education”. arXiv. https://doi.org/10.35542/osf.io/5er8f. DOI: https://doi.org/10.35542/osf.io/5er8f

Kengam, J. 2020. “Artificial Intelligence in Education”. Bournemouth University. http://dx.doi.org/10.13140/RG.2.2.16375.65445.

Khalil, M., and E. Er. 2023. “Will ChatGPT Get You Caught? Rethinking of Plagiarism Detection”. arXiv. https://doi.org/10.48550/arXiv.2302.04335. DOI: https://doi.org/10.35542/osf.io/fnh48

Kuleto, V., M. Ilić, M. Dumangiu, M. Ranković, O. M. Martins, D. Păun, and L. Mihoreanu. 2021. “Exploring Opportunities and Challenges of Artificial Intelligence and Machine Learning in Higher Education Institutions”. Sustainability 13 (18): 10424. https://doi.org/10.3390/su131810424. DOI: https://doi.org/10.3390/su131810424

Kung, T. H., M. Cheatham, A. Medenilla, C. Sillos, L. De Leon, C. Elepaño, M. Madriaga, R. Aggabao, G. Diaz-Candido, J. Maningo, and V. Tseng. 2023. “Performance of ChatGPT on USMLE: Potential for AI Assisted Medical Education Using Large Language Models”. PLOS Digital Health 2 (2): e0000198. https://doi.org/10.1371/journal.pdig.0000198. DOI: https://doi.org/10.1371/journal.pdig.0000198

Lyu, C., J. Xu, and L. Wang. 2023. “New Trends in Machine Translation Using Large Language Models: Case Examples with ChatGPT”. arXiv. https://www.researchgate.net/publication/370220951_New_Trends_in_Machine_Translation_using_Large_Language_Models_Case_Examples_with_ChatGPT.

McGee, R. 2023. “Is ChatGPT Biased against Conservatives? An Empirical Study”. Social Science Research Network. http://dx.doi.org/10.2139/ssrn.4359405. DOI: https://doi.org/10.2139/ssrn.4359405

Mijwil, M., M. Aljanabi, and A. H. Ali. 2023. “ChatGPT: Exploring the Role of Cybersecurity in the Protection of Medical Information”. Mesopotamian Journal of Cybersecurity 18–21. http://dx.doi.org/10.58496/MJCS/2023/004. DOI: https://doi.org/10.58496/MJCS/2023/004

Nandalwar, J., V. Shirashyad, P. Pandhare, and P. Kothawale. 2023. “An Intelligent Approach for Automating Data Inputs on Web Portals for Several Apex/Statutory Bodies in the Field of Education Using Robotics and Machine Learning”. International Journal for Multidisciplinary Research 5 (3). https://doi.org/10.36948/ijfmr.2023.v05i02.2397. DOI: https://doi.org/10.36948/ijfmr.2023.v05i02.2397

Onat, O., and S. Gulsecen. 2023. “Reducing Perceived Transactional Distance in Distance Education: The Impact of the Chatbot”. International Journal of Technology in Education and Science (IJTES) 7 (4): 483–499. https://doi.org/10.46328/ijtes.511. DOI: https://doi.org/10.46328/ijtes.511

Opara, E., A. Mfon-Ette Theresa, and T. C. Aduke. 2023. “ChatGPT for Teaching, Learning and Research: Prospects and Challenges”. Global Academic Journal of Humanities and Social Sciences 5 (2): 33–40. https://doi.org/10.36348/gajhss.2023.v05i02.001. DOI: https://doi.org/10.36348/gajhss.2023.v05i02.001

Pinzolits, R. 2024. “AI in Academia: An Overview of Selected Tools and Their Areas of Application”. MAP Education and Humanities 4: 37–50. https://doi.org/10.53880/2744-2373.2023.4.37. DOI: https://doi.org/10.53880/2744-2373.2023.4.37

Rahman, M., H. J. R. Terano, N. Rahman, A. Salamzadeh, and S. Rahaman. 2023. “ChatGPT and Academic Research: A Review and Recommendations Based on Practical Examples”. Journal of Education, Management and Development Studies 3 (1): 1–12. https://doi.org/10.52631/jemds.v3i1.175. DOI: https://doi.org/10.52631/jemds.v3i1.175

Roumeliotis, K. I., and N. D. Tselikas. 2023. “ChatGPT and Open-AI Models: A Preliminary Review”. Future Internet 15 (6): 192. https://doi.org/10.3390/fi15060192. DOI: https://doi.org/10.3390/fi15060192

Rozado, D. 2023. “The Political Biases of ChatGPT”. Social Sciences 12 (3): 148. https://doi.org/10.3390/socsci12030148. DOI: https://doi.org/10.3390/socsci12030148

Rudolph, J., S. Tan, and S. Tan. 2023. “ChatGPT: Bullshit Spewer or the End of Traditional Assessments in Higher Education?” Journal of Applied Learning and Teaching 6 (1): 342–363. https://doi.org/10.37074/jalt.2023.6.1.9. DOI: https://doi.org/10.37074/jalt.2023.6.1.9

Santra, P. P., and D. Majhi. 2023. “Scholarly Communication and Machine-Generated Text: Is It Finally AI vs AI in Plagiarism Detection?” Journal of Information and Knowledge 60 (3): 173–181. https://doi.org/10.17821/srels%2F2023%2Fv60i3%2F171028. DOI: https://doi.org/10.17821/srels

Schwab, K. 2017. The Fourth Industrial Revolution. New York: Crown Publishing.

Shidaganti, G., R. Sanjana, K. Shubeeksh, V. R. Monish Raman, and V. Thakshith. 2023. “ChatGPT: Information Retrieval from Image Using Robotic Process Automation and OCR”. In 7th International Conference on Intelligent Computing and Control Systems (ICICCS), Madurai, India, 2023, 1264–1270. Piscataway: Institute of Electrical and Electronics Engineers. https://doi.org/10.1109/ICICCS56967.2023.10142461. DOI: https://doi.org/10.1109/ICICCS56967.2023.10142461

Simpson, D. 2023. “Educators, Students, and Plagiarism in the Age of AI”. BMJ 381: p1403. https://doi.org/10.1136/bmj.p1403. DOI: https://doi.org/10.1136/bmj.p1403

Stojanov, A. 2023. “Learning with ChatGPT 3.5 as a More Knowledgeable Other: An Autoethnographic Study”. International Journal of Educational Technology in Higher Education 20 (35). https://doi.org/10.1186/s41239-023-00404-7. DOI: https://doi.org/10.1186/s41239-023-00404-7

Strubell, E., A. Ganesh, and A. McCallum. 2019. “Energy and Policy Considerations for Deep Learning in NLP”. In Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics (ACL), edited by A. Korhonen, D. Traum and L. Màrquez, 3645–3650. Stroudsburg: Association for Computational Linguistics. https://doi.org/10.48550/arXiv.1906.02243. DOI: https://doi.org/10.18653/v1/P19-1355

Tashtoush, M. A., R. AlAli, Y. Wardat, N. Alshraifin, and H. Toubat. 2023. “The Impact of Information and Communication Technologies (ICT)-Based Education on the Mathematics Academic Enthusiasm”. Journal of Educational and Social Research 13 (3): 284–293. https://doi.org/10.36941/jesr-2023-0077. DOI: https://doi.org/10.36941/jesr-2023-0077

Tlili, A., R. Huang, B. Shehata, D. Liu, J. Zhao, A. H. S. Metwally, H. Wang, M. Denden, A. Bozkurt, L.-H. Lee, D. Beyoglu, F. Altinay, R. C. Sharma, Z. Altinay, Z. Li, J. Liu, F. Ahmad, Y. Hu, S. Salha, M. Abed, and D. Burgos. 2022. “Is Metaverse in Education a Blessing or a Curse: A Combined Content and Bibliometric Analysis”. Smart Learning Environments 9 (1): 1–31. DOI: https://doi.org/10.1186/s40561-022-00205-x

Ufuk, F. 2023. “The Role and Limitations of Large Language Models Such as ChatGPT in Clinical Settings and Medical Journalism”. Radiology 307 (3): e230276. https://doi.org/10.1148/radiol.230276. DOI: https://doi.org/10.1148/radiol.230276

Van der Vorst, T., and N. Jelicic. 2019. “Artificial Intelligence in Education: Can AI Bring the Full Potential of Personalized Learning to Education?” Paper presented at the 30th European Conference of the International Telecommunications Society, “Towards a Connected and Automated Society”, Helsinki, Finland, June16–19, 2019. https://www.econstor.eu/bitstream/10419/205222/1/van-der-Vorst-Jelicic.pdf.

Wardat, Y., M. A. Tashtoush, R. AlAli, and A. M. Jarrah. 2023. “ChatGPT: A Revolutionary Tool for Teaching and Learning Mathematics”. Eurasia Journal of Mathematics, Science and Technology Education 19 (7): e2286. https://doi.org/10.29333/ejmste/13272. DOI: https://doi.org/10.29333/ejmste/13272

Zhai, X. 2022. “ChatGPT User Experience: Implications for Education”. Social Science Research Network. https://dx.doi.org/10.2139/ssrn.4312418. DOI: https://doi.org/10.2139/ssrn.4312418