Artificial intelligence (“AI“) has rapidly transformed many industries, including the legal profession. Lawyers and self-represented litigants are increasingly relying on AI tools to assist with legal research, draft pleadings, and analyze legal strategy.
While AI offers many advantages, the growing reliance also raises concerns. They can generate fictitious cases, fabricate legal citations, misstate legal principles, or provide convincing but inaccurate legal analysis. If these errors go undetected, there can be serious consequences for the client, self-litigant, or legal system.
As technology continues to evolve, understanding its limitations has become essential. By recognizing the limitations of AI, legal professionals and self-represented litigants can maintain their professional obligation, improve efficiency, and preserve the integrity of the legal system.
Misuse of AI
In The Rise of AI-Hallucinated Case Law in Canadian Courts and Tribunals, it was identified that within 132 decisions, 96 decisions had at least one fictitious citation generated by AI tools. The study relied on data between 2024 and the first quarter of 2026. In 2024, 7 decisions containing fictious citations were identified. In 2025, 86 decisions with fictious citations were identified and in the first quarter of 2026, 39 decisions had been identified. These findings represent an emerging challenge affecting the Canadian legal system.
A notable example of the current reality is Ko v. Li, in which a lawyer cited fictious cases in a factum. Justice Myers clarified that the lawyer’s error was not in using ChatGPT to assist in drafting, but rather her failure to authenticate the cases before submission. Furthermore, Justice Myers outlined several fundamental professional obligations owed by every lawyer, including:
- The duty to faithfully represent the law to the court;
- The duty not to fabricate case precedents and not to mis-cite cases for propositions that they do not support;
- The duty to supervise staff and review material prepared for her signature;
- The duty not to mislead the court.
How Canadian Courts Have Responded
Canadian courts have responded to the increased use of AI in the legal industry by introducing measures intended to promote transparency, accuracy, and professionalism. In Ontario, amendments to the Rules of Civil Procedure have introduced requirements concerning verification of authorities cited in factums.
Ontario’s Provincial Practice Directions also address the use of AI in court proceedings. It emphasizes that lawyers and litigants must guarantee the accuracy of all materials submitted to the court and caution against carelessly relying on cases generated by AI tools. For lawyers who delegate tasks to articling students, legal assistants, or law clerks, these obligations also include properly supervising the work produced and reviewing all court materials before they are filed.
Implications for Lawyers and Self-Represented Litigants
As AI tools become increasingly sophisticated, AI usage by lawyers and self-represented litigants will likely continue to increase. However, it is important to remember that greater use of AI must be accompanied by greater diligence.
Lawyers must continue to comply with their professional duties and ethical obligations under the Rules of Professional Conduct. Lawyers must also stay up to date about emerging AI tools, their capabilities, and their limitations. Furthermore, delegation does not diminish a lawyer’s professional responsibilities.
Self-represented litigants should also exercise similar caution. While AI may help simplify legal concepts, it should never be treated as a substitute for professional legal advice. Court materials prepared with the assistance of AI should always be carefully reviewed and verified before being submitted.
If you have questions about your legal rights or believe you may have a potential claim, please contact us to schedule a consultation and discuss your options.