
Why a General Chatbot Can't Be Trusted With Indian Law (and Grounded AI Can)
LawWorld
Two AI tools can sit side by side, both fluent, both fast, both confident — and only one of them can be trusted to cite a real Supreme Court judgment. Understanding why is not a technical indulgence. It is the single most important thing an advocate can learn about AI, because it explains the entire hallucination problem and points to the fix.
How a general chatbot "knows" law
A general-purpose model like a consumer chatbot is a prediction engine. During training it absorbed enormous amounts of text and learned the statistical patterns of language. When you ask it for a case on a point of Indian law, it does not look anything up. It generates the sequence of words most likely to follow your question — a plausible case name, a plausible citation, a plausible holding.
Most of the time the general shape is right. But when you ask for something specific — an exact citation, a paragraph number, a precise holding — the model fills the gap with an invention that looks correct. This is not a bug that a future update will quietly fix. It is inherent to how the technology works. That is why courts keep catching fabricated citations, and why the Supreme Court's 2026 Draft AI Regulations had to formally define "AI hallucination" as fictitious or inaccurate legal content, including fabricated precedents and quotations.
Keep reading — it’s free.
Create a free LawWorld account to finish this piece and unlock the full library of practice guides written for advocates in India.
- Finish every guide, free
- Save articles to read later
- New practice insights weekly
Free forever. No card required.
LawWorld Pro
Research, drafting and case management for the whole practice.
₹1,500 per month, or ₹12,000 per year — save 33%. 1 user, 250 active cases, 10 GB. Prices exclusive of 18% GST.
Comments
Sign in to read the discussion and share your thoughts.
Latest from LawWorld
News
View all- Supreme Court Bars Customs Refund Without Challenge to Self-Assessment15 Nov 2026
- Karnataka High Court Restores GST Appeal Dismissed for 226-Day Delay15 Nov 2026
- Karnataka High Court Holds Adulterer Is Proper But Not Necessary Party in Divorce Plea15 Nov 2026
- Karnataka High Court Quashes SC/ST Act Complaint Against Bharat Forge Chairman Over 11-Year Delay15 Nov 2026
- Karnataka High Court Directs Review of Mental Health Policies for Armed Personnel While Quashing Suicide-Attempt Case15 Nov 2026
Articles
View all- Article 22(2) Clock Starts at Curtailment of Liberty, Not Formal Arrest: Supreme Court in NDPS Bail Case15 Nov 2026
- Supreme Court Upholds Bihar Special Intensive Revision of Electoral Rolls14 Nov 2026
- Seven-Judge Constitution Bench Holds Decades-Old State Sales Tax Surcharge Reference Academic After GST6 Nov 2026







