Lawyers are Safe from the AI Invasion—For Now! A Brief Consideration of the Use of Artificially Generated Tools in Legal Research in SA and the US

Ciresh Singh; Menelisi Ncube

doi:10.25159/2522-3062/20632

Authors

Ciresh Singh University of South Africa https://orcid.org/0000-0002-7216-3883
Menelisi Ncube University of South Africa https://orcid.org/0000-0003-0910-4570

DOI:

https://doi.org/10.25159/2522-3062/20632

Keywords:

artificial intelligence (AI), ChatGPT, hallucination, legal practitioners, legal research

Abstract

A legal maxim holds that ‘it is not knowing all the law that counts but knowing where to find the law that makes a good lawyer a great lawyer,’ highlighting the importance of legal research. While technology and artificial intelligence (AI) have transformed research and drafting, they are prone to errors, including fabricated authorities. Courts, especially in the United States (US), have sanctioned misuse and South African courts have raised concerns, though no regulations yet exist. This paper examines AI use in legal research by undertaking a detailed analysis of the recent case law, in the US and South Africa, that has considered this topic. This paper will be divided into five parts: Part 1 serves as an introduction and overview of the topic; Part 2 briefly considers some of the AI tools currently available and their possible application in legal practice; Part 3 investigates how some AI tools have been used in the US; Part 4 considers the use of AI tools in the South African legal system; and Part 5 serves as a conclusion and provides some key recommendations in this area. It is hoped that this discussion will bring to light the need for AI regulation and, possibly, the prompt implementation of guidelines and rules to regulate its use not only in legal practice, but also in society. The article draws on both primary and secondary materials and employs a qualitative desktop research method. This article calls for, inter alia, concerted efforts by the legislature and other relevant stakeholders to comprehensively regulate the use of AI by legal practitioners when conducting legal research in order to retain the integrity of the South African legal profession.

References

Abdel Latif YA, ‘Hallucinations in Large Language Models and Their Influence on Legal Reasoning: Examining the Risks of AI-Generated Factual Inaccuracies in Judicial Processes’ (2025) 10 Journal of Computational Intelligence, Machine Reasoning, and Decision-Making.

Alzbeta K and Václav M, ‘Disappearing Authorship: Ethical Protection of AI-Generated News’ (2022) 13 jipitec (Journal of Intellectual Property, Information Technology and Electronic Commerce Law).

Anderson J, ‘AI and the Legal Puzzle: Filling Gaps, but Missing Pieces’ (2024) 75(5) Mercer Law Review.

Andhov A, ‘OpenAI’s Transformation: From a Non-profit to a 157 Billion Valuation’ (2025) 46(1) Business Law Review 2–11 <https://doi.org/10.54648/bula2025003> DOI: https://doi.org/10.54648/BULA2025003

Babar SM, Husaain Z, Akhtar N and Ali S, ‘The Impact of Technology on the Legal System: Exploring How Technology is Changing the Way Laws are Created, Enforced, and Interpreted’ (2025) 3(1) Review Journal of Social Psychology & Social Works.

Bakht M, Artificial Intelligence for Lawyers: Navigating Novel Methods and Practices for the Future of Law (KU Wheat Law Library 2025).

Booth R, ‘High court tells UK lawyers to stop misuse of AI after fake case-law citations’ (The Guardian, 6 June 2025) <https://www.theguardian.com/technology/2025/jun/06/high-court-tells-uk-lawyers-to-urgently-stop-misuse-of-ai-in-legal-work> accessed 16 February 2026.

Da Costa WJ, ‘Legal hallucinations: fake AI case law plagues court’ (Independent on Saturday Newspaper, 12 July 2025).

Emejuo CC, Joseph OC, Odeyemi E and Igwe AO, ‘The Impact of Artificial Intelligence on Legal Practice: Enhancing Legal Research, Contract Analysis, and Predictive Justice’ (2025) 14(1) International Journal of Science and Research Archive <https://doi.org/10.30574/ijsra.2025.14.1.0124> DOI: https://doi.org/10.30574/ijsra.2025.14.1.0124

Fulciniti G, Kabli A, Cannataro M, Guardasole G and Agapito G, ‘Artificial Intelligence to Analyse Huge Amounts of Juridical Documents via Edge Computing’ in Proceedings of the International Conference on Embedded Wireless Systems and Networks (EWSN) (2023) <https://doi.org/10.5555/3639940.3639996>

George AS and George ASH, ‘A Review of ChatGPT AI’s Impact on Several Business Sectors’ (2023) 1(1) Partners Universal International Innovation Journal <https://doi.org/10.5281/zenodo.7644359>

Han SC, Weld H, Li Y, Lee J and Poon J, ‘Applications and Case Studies in Natural Language Understanding’ in Soyeon Caren Han and others (eds), Natural Language Understanding in Conversational AI with Deep Learning (Springer Nature Switzerland 2025) <https://doi.org/10.1007/978-3-031-74364-1_6> DOI: https://doi.org/10.1007/978-3-031-74364-1_6

Hassija V, Chamola V, Mahapatra A, Singal A, Goel D, Huang K, Scardapane S, Spinelli I, Mahmud M, and Hussain A, ‘Interpreting Black‑Box Models: A Review on Explainable Artificial Intelligence’ (2024) 16(1) CILSA <https://doi.org/10.1007/s12559-023-10179-8> DOI: https://doi.org/10.1007/s12559-023-10179-8

Krausova A and Moravec V, ‘“Disappearing Authorship”: Ethical Protection of AI-generated News’ (2022) 13 jipitec 132–144.

Kufakwababa CZ, ‘Artificial Intelligence Tools in Legal Work Automation: The Use and Perception of Tools for Document Discovery and Privilege Classification Processes in Southern African Legal Firms’ (MA dissertation, Stellenbosch University 2021).

LegalEase, ‘About LegalEase’ (2025) <https://leweb.netlify.app/> accessed 1 August 2025.

LexisNexis, ‘Enhancing the Potential of the African Continent by Advancing the Rule of Law’ <https://www.lexisnexis.com/en-za/about/overview> accessed 8 April 2025.

LexisNexis, ‘Lexis+ Transform Your Legal Work’ <https://www.lexisnexis.com/en-us/products/lexis-plus-ai.page> accessed 8 April 2025.

LexisNexis, ‘Protégé™ Your Personalised AI Assistant Now in Lexis+ AI®, Lexis® Create+, and Lex Machina®’ <https://www.lexisnexis.com/en-us/products/protege.page> accessed 8 April 2025.

Luminance, ‘Luminance Showcases World’s First Completely AI-powered Contract Negotiation’ (7 November 2023) <https://www.luminance.com/news/press/20231107 _luminance_showcases.html> accessed 1 April 2025.

Magesh V, Surani F, Dahl M, Suzgun M, Manning CD and Ho DE, ‘Hallucination Free? Assessing the Reliability of Leading AI Legal Research Tools’ (2025) Journal of Empirical Legal Studies <https://doi.org/10.1111/jels.12413>

Magrath P, ‘The Genie and the Lamp: How Can Artificial Intelligence Help Us Find New Case Law?’ (2022) 22 Legal Information Management <https://doi.org/10.1017/S1472669622000342> DOI: https://doi.org/10.1017/S1472669622000342

Marwala T and Mpedi LG, Artificial Intelligence and the Law (Palgrave Macmillan 2024) DOI: https://doi.org/10.1007/978-981-97-2827-5

<https://doi.org/10.1007/978-981-97-2827-5>

Matthee J and Stopforth G, ‘The Importance of Ethical and Responsible AI Training in Law Schools to Avoid Career-Ending Pitfalls for Aspiring Attorneys’ (2025) 50(1) Journal for Juridical Science <https://doi.org/10.38140/jjs.v50i1.9302> DOI: https://doi.org/10.38140/jjs.v50i1.9302

Menon D and Shilpa K, ‘“Chatting with ChatGPT”: Analyzing the Factors Influencing Users’ Intention to Use the Open AI’s ChatGPT Using the UTAUT Model’ (2023) 9 Heliyon <https://doi.org/10.1016/j.heliyon.2023.e20962> DOI: https://doi.org/10.1016/j.heliyon.2023.e20962

Munir B, ‘Hallucinations in Legal Practice: A Comparative Case Law Analysis’ (2025) International Journal of Law, Ethics, and Technology <https://doi.org/10.55574/QKMD5023> DOI: https://doi.org/10.55574/QKMD5023

Munyoro F, ‘Zimbabwe’s Supreme Court rejects AI-generated legal submissions citing fictitious cases’ (The Herald, 30 October 2025) <https://www.heraldonline.co.zw/zimbabwes-supreme-court-rejects-ai-generated-legal-submissions-citing-fictitious-cases/> accessed 12 February 2026.

Naik I, Naik D and Naik N, ‘Chat Generative Pre-trained Transformer (ChatGPT): Comprehending its Operational Structure, AI Techniques, Working, Features and Limitations’ (2023) IEEE International Conference on ICT in Business Industry & Government <https://doi.org/10.1109/ICTBIG59752.2023.10456201> DOI: https://doi.org/10.1109/ICTBIG59752.2023.10456201

Niero B, ‘AI-Law Firms of the Future: The Integration of Artificial Intelligence and Other Cutting-Edge Technologies for Value Creation’ (2023) <https://doi.org/10.13140/RG.2.2.36647.11684> accessed 12 August 2025.

Ogunde F, ‘Legal Large Language Models (LLMs): Legal Dynamos or “Fancifully Packaged ChatGPT?”’ (2025) 5(21) Discover Artificial Intelligence DOI: https://doi.org/10.1007/s44163-024-00167-8

<https://doi.org/10.1007/s44163-024-00167-8>

Peoples LF, ‘Artificial Intelligence and Legal Analysis: Implications for Legal Education and the Profession’ (2025) Law Library Journal <https://doi.org/10.2139/ssrn.5123122> DOI: https://doi.org/10.2139/ssrn.5123122

Perlman A, ‘The Implications of ChatGPT for Legal Services and Society’ (2023) 1(30) Michigan Technology Law Review <https://doi.org/10.36645/mtlr.30.1.implications> DOI: https://doi.org/10.36645/mtlr.30.1.implications

Posthoff C, Artificial Intelligence for Everyone (Springer Nature Switzerland 2024) <https://doi.org/10.1007/978-3-031-57208-1> DOI: https://doi.org/10.1007/978-3-031-57208-1

Rane NL, ‘ChatGPT and Similar Generative Artificial Intelligence (AI) for Smart Industry: Role, Challenges, and Opportunities for Industry 4.0, Industry 5.0, and Society 5.0’ (2024) 2 Innovations in Business and Strategic Management <https://doi.org/10.61577/ibsm.2024.100002> DOI: https://doi.org/10.61577/ibsm.2024.100002

Saha A, ‘Human-Centred Innovation in Society 5.0’ in Acharya B, Shukla M, Chowdhury C and Garg H (eds) Society 5.0: A Transformation towards Human-Centered Artificial Intelligence (1st edn, CRC Press 2025) <https://doi.org/10.1201/9781003643166-7> DOI: https://doi.org/10.1201/9781003643166-7

Saleh Al Adwan MAS, Qutieshat EMA and Qtaishat AM, ‘Transforming Legal Professional Bodies: The Role of Artificial Intelligence in Modern Legal Practice’ (2024) 22(2) Pakistan Journal of Life & Social Sciences DOI: https://doi.org/10.57239/PJLSS-2024-22.2.001256

<https://doi.org/ /10.57239/PJLSS-2024-22.2.001256>

Scott B, ‘A Case of “AI Hallucination” in the Air’ (7 August 2023) Leiden Law Blog <https://www.leidenlawblog.nl/articles/a-case-of-ai-hallucination-in-the-air> accessed 30 April 2025.

Sharma A and Singh BJ, ‘Evolution of Industrial Revolutions: A Review’ (2020) 9 International Journal of Innovative Technology and Exploring Engineering <https://doi.org/10.35940/ijitee.I7144.0991120> DOI: https://doi.org/10.35940/ijitee.I7144.0991120

Siino M, Falco M, Croce D and Rosso P, ‘Exploring LLMs Applications in Law: A Literature Review on Current Legal NLP Approaches’ (2025) IEEE Access <https://doi.org/10.1109/ACCESS.2025.3533217> DOI: https://doi.org/10.1109/ACCESS.2025.3533217

South African Judiciary, ‘Court online’ <https://www.judiciary.org.za/index.php/63-caselines?start=3> accessed on 26 June 2025.

Thaldar D, ‘Can AI Think Like a Lawyer? Evaluating Generative AI in South African Law’ (2025) 28 Potchefstroom Electronic Law Journal <https://doi.org/10.17159/1727-3781/2025/v28i0a21584> DOI: https://doi.org/10.17159//1727-3781/2025/v28i0a21584

Thaldar D, Mbatha S, Botes M and Esselaar P, ‘Responsible AI Use in South African Legal Practice: A Call for Ethical Guidelines’ (1 July 2025) De Rebus <https://www.derebus.org.za/wp-content/uploads/2025/06/Ethics-Guidelines-for-Legal-Practitioners-in-South-Africa-on-the-Use-of-Generative-AI1.pdf?utm> accessed 25 February 2026.

Thaldar D, ‘How Effectively can ChatGPT-4 Draft Data Transfer Agreements for Health Research?’ (2025) 12(1) Humanities and Social Sciences Communications <https://doi.org/10.1057/s41599-025-04643-z> DOI: https://doi.org/10.1057/s41599-025-04643-z

Thomas Reuters, ‘Legal research tools’ <https://africa.thomsonreuters.com/en/products-services/legal/westlaw.html> accessed 22 February 2026.

Vailshery LS, ‘Artificial Intelligence (AI) Worldwide—Statistics & Facts’ (Statista, 17 December 2025) <https://www.statista.com/topics/3104/artificial-intelligence-ai-worldwide/> accessed 21 February 2026.

Van Eck M, ‘AI “hallucinations” are threatening the administration of justice in SA’ (Daily Maverick, 15 July 2025) <https://www.dailymaverick.co.za/opinionista/2025-07-15-ai-hallucinations-are-threatening-the-administration-of-justice-in-sa/> accessed 4 March 2026.

Van Eck M, ‘An Ethical Framework for the Use of Artificial Intelligence in the Legal Profession” (2025) TSAR <https://doi.org/10.47348/TSAR/2025/i3a2> DOI: https://doi.org/10.47348/TSAR/2025/i3a2

Van Eck M, “Error 404 or An Error in Judgment: An Ethical Framework for the Use of ChatGPT in the Legal Profession” (2024) 3 TSAR <https://doi.org/10.47348/TSAR/2024/i3a4> DOI: https://doi.org/10.47348/TSAR/2024/i3a4

Waddell TF, ‘A Robot Wrote This? How Perceived Machine Authorship Affects News Credibility’ (2018) 6(2) Digital Journalism <https://doi.org/10.1080/21670811.2017.1384319> DOI: https://doi.org/10.1080/21670811.2017.1384319

Wang H, ‘Authorship of Artificial Intelligence-Generated Works and Possible System Improvement in China’ (2023) 14 Beijing Law Review DOI: https://doi.org/10.4236/blr.2023.142049

<https://doi.org/ 10.4236/blr.2023.142049>

Warraich MKS, Usman H, Zakir S and Mehboob M, ‘Ethical Governance of Artificial Intelligence Hallucinations in Legal Practice’ (2025) 4 Social Sciences Spectrum <https://doi.org/10.71085/sss.04.02.297> DOI: https://doi.org/10.71085/sss.04.02.297

Zheng W, ‘Research on Generative Artificial Intelligence Legal Profession Substitution’ (2023) 4 Modern Law Review <https://doi.org/10.37420/j.mlr.2023.017>

Zurth P, ‘Artificial Creativity? A Case Against Copyright Protection for AI-Generated Works’ (2020) 25 UCLA Journal of Law and Technology.

Cases

Al-Haroun v Qatar National Bank [2025] EWHC 1383 (Admin).

Ayinde v London Borough of Haringey [2025] EWHC 1383 (Admin).

Daubert v Merrell Dow Pharms. Inc. 509 U.S. 579, 589 (1993).

Dube v Schleich [2013] ZALC 16.

Kohls v Ellison 24-cv-3754 (LMP/DLM) 2025.

Makunga v Barlequins Beleggings (Pty) Ltd t/a Indigo Spur (19733/2017) [2023] ZAWCHC 332.

Mata v Avianca Inc. 22-cv-01461-PKC 2023.

MEC v Mavundla: Department of Co-Operative Government and Traditional Affairs KwaZulu-Natal and Others (7940/2024P) [2025] ZAKZPHC 2; 2025 (3) SA 534 (KZP) (8 January 2025).

Morgan v Cmty. Against Violence, No 23-cv-353-WPJ/JMR, 2023 WL 6976510.

Northbound Processing (Pty) Ltd v South African Diamond and Precious Metals Regulator and Others (2025/072038) [2025] ZAGPJHC 661 (30 June 2025).

Park v Kim No 22-2057 2024. DOI: https://doi.org/10.1093/nc/niad027

Parker v Forsyth NNO and Others (1585/20) [2023] ZAGPRD 1 (29 June 2023).

Pieterse v The Public Protector 2014 (3) SA 551.

Pulserate Investments (Pvt) Ltd v Andrew Zuze and Others [SC202/25].

S v Aliyu (A12/2023) [2023] ZAGPJHC 697 (14 June 2023).

Scalia v Reliance Trust Co., No 17-cv-4540 (SRN/ECW), 2021 WL 795270.

Thomson Reuters v Ross Intelligence Inc. 1:20-cv-613-SB 2025.

Legislation

Constitution of the Republic of South Africa, 1996.

Code of Conduct for All Legal Practitioners, Candidate Legal Practitioners and Juristic Entities Notice 198 of 2019.