The short answer
AI liability in consulting is a firm’s legal and financial responsibility for errors caused by AI tools. This risk became concrete when Deloitte partially refunded a AU$440,000 government contract after its AI-assisted report included fabricated legal cases and sources. Firms are liable for AI outputs as they would be for any other tool; courts do not recognize AI as a separate legal entity.
In late 2025, a cautionary tale for the entire professional services industry unfolded. Deloitte Australia delivered a report to the Australian government as part of a AU$440,000 (US$290,000) contract to review the country’s welfare-penalty IT system. A problem emerged when a law professor read the report and identified “fabricated references,” including a non-existent book and a completely made-up quote from a judge.
Deloitte later re-issued the report with a new disclosure—it had used Azure OpenAI—and agreed to refund the final portion of its fee. The incident was not a failure of the AI model, which performed as designed by generating plausible text. It was a failure of professional oversight. This case provides a stark lesson: when you use AI in client work, you own the output, including its mistakes. For consultants, whose currency is trust and accuracy, managing this new layer of liability is not optional.
At ZEKAI, we review tools and workflows for professionals, and this article provides a practical framework for consulting firms to manage the risk of AI hallucinations. We are not lawyers, and this is not legal advice, but a guide to the operational and tool-based safeguards your firm can implement today. This is a core challenge for every practitioner in professional services.
What Is AI Hallucination Liability?
AI liability refers to the legal and financial responsibility for harm caused by an artificial intelligence system. Crucially, current legal principles in the US, UK, and EU do not treat AI as a legal personality that can be sued. Liability rests with the humans and companies that develop, deploy, or use the AI. For a consulting firm, this means if an AI tool produces a flawed analysis, a fabricated data point, or a biased recommendation that leads to client losses, the consulting firm—not the AI vendor—is likely on the hook for professional negligence.
Hallucinations—when an AI model generates false, misleading, or nonsensical information but presents it as fact—are the most direct source of this risk. These are not rare edge cases. Depending on the complexity of the task, LLM hallucination rates can range from under 3% to over 80%. A 2025 study found that fake news and disinformation cost the global economy an estimated $78 billion annually. While that figure covers broad societal impact, it signals the immense financial damage that can stem from a single piece of incorrect information.
The estimated global cost to businesses from fake online reviews and similar disinformation, according to a 2021 study. Source: weforum.org
The core legal principle is that AI is just a tool, like a spreadsheet or a research database. If you use a faulty calculator to give a client financial advice, you are liable for the error. The same applies to AI. Courts have already sanctioned lawyers for submitting legal briefs containing AI-fabricated case law. The Deloitte case simply extends this precedent into the consulting domain.
Your Firm’s Four Layers of AI Risk
Liability isn’t a single problem but a stack of interconnected risks. For a consulting firm, the exposure comes from four distinct areas. Understanding them is the first step to mitigating them.
- Data Input Risk (Confidentiality & Privacy): The first risk occurs before you even prompt the AI. Feeding sensitive client information—financial data, strategic plans, PII—into a public AI tool can violate confidentiality agreements and data privacy laws like GDPR. Unless your contract with an AI vendor explicitly guarantees a zero-data-retention, private-instance model, you should assume your inputs could be used to train the model.
- Model Output Risk (Hallucinations & Inaccuracy): This is the risk highlighted by the Deloitte case. The AI can produce plausible but factually incorrect information, flawed analysis, or biased conclusions. If this output makes it into a client deliverable, it becomes a direct representation of your firm’s work product and a clear basis for a professional negligence claim.
- Employee Action Risk (Misuse & Over-reliance): Your employees are the primary users of these tools. The risk here is twofold: intentional misuse (e.g., using AI for tasks it’s not suited for) and unintentional over-reliance (blindly trusting AI output without verification). Without clear governance and training, an employee rushing to meet a deadline can easily copy-paste a hallucinated statistic into a final report, making the firm liable.
- Vendor Contract Risk (Liability Shifting): AI vendors often use their terms of service to shift liability for outputs to the user. Your contract with your AI provider may contain clauses that indemnify them against any damages caused by their tool. This leaves your firm holding the entire bag if a client sues over an AI-generated error.
Tools for Safer AI-Powered Consulting Work
While process is the first line of defense, purpose-built tools can significantly reduce liability risk compared to using general-purpose chatbots. Tools designed for professional workflows often include features for verification, source-grounding, and data privacy that are absent in consumer-grade AI.
We recommend firms evaluate tools based on their ability to mitigate the specific risks of consulting work. Here, we compare two tools relevant to common consulting tasks: proposal generation and data visualization. Our ranking criteria are: Accuracy & Verifiability, Data Security & Privacy, Workflow Integration, and Value for Cost. ZEKAI reviews all tools independently.
| Feature | AutogenAI | ChartGen AI |
|---|---|---|
| Primary Use Case | AI-powered proposal and bid writing | AI-powered data visualization and dashboarding |
| Hallucination Mitigation | Builds a dedicated language engine on your firm’s verified content; reduces reliance on public data. | Provides data traceability, allowing users to trace chart elements back to the source data in the uploaded file. |
| Data Security | FedRAMP High authorized environment available for government work; customer data is not used for model training. | SOC 2 compliance, end-to-end encryption; no permanent storage of uploaded files. |
| Ideal Workflow | Responding to complex RFPs and generating structured, evidence-based proposals for enterprise and government clients. | Quickly turning raw data (Excel, CSV) into stakeholder-ready charts and dashboards for presentations and reports. |
| Pricing (as of Sep 2026) | Custom enterprise pricing. Reported to start around $30,000/year for a minimum of 5 seats. | Free tier available. Paid plans for advanced features. |
Swipe the table sideways →
AutogenAI
Designed for firms where proposal quality and compliance are critical, but the high cost makes it overkill…
Designed for firms where proposal quality and compliance are critical, but the high cost makes it overkill for smaller teams.
What it does badly: AutogenAI is not a self-serve tool for casual use. It requires a dedicated onboarding process and a significant financial commitment, making it inaccessible for solo consultants or boutiques that only write a few proposals a year. Its focus is squarely on structured bid and proposal documents, not general-purpose creative or analytical work. Who should not buy it: Small firms, independent consultants, or teams that primarily need a tool for informal presentations rather than formal RFP responses will find the cost and complexity prohibitive.
- Price from
- Custom enterprise pricing
- Free tier
- No free tier available, only a demo.
ChartGen AI
Designed for rapidly creating presentation-quality visuals from spreadsheets, with strong data security…
Designed for rapidly creating presentation-quality visuals from spreadsheets, with strong data security for client work.
What it does badly: ChartGen AI is a visualization tool, not a full business intelligence (BI) suite. It lacks the deep project management integrations or complex data modeling capabilities of platforms like Tableau or Power BI. It is built for speed and presentation quality on a specific dataset, not for creating a permanent, enterprise-wide BI infrastructure. Who should not buy it: Data science teams or enterprises needing a central, governed BI platform with complex data modeling and user permissions will find it too lightweight.
- Price from
- Paid plans for full features
- Free tier
- A free tier is available with basic functionality (as of Sep 2026).
How to Build a Defensible AI Policy
A tool is only as good as the process it supports. To manage AI liability effectively, every consulting firm, regardless of size, needs a clear and enforceable AI usage policy. A human verification policy is widely considered a best practice for demonstrating a reasonable standard of care, though its precise legal weight would depend on the specifics of any claim.
1. **Client Data is Prohibited in Public AI:** No employee may input any client-identifying information, confidential data, or non-public material into any public AI tool (e.g., the free versions of ChatGPT, Claude, Gemini). All client-related work must be done using firm-approved, enterprise-grade AI tools that guarantee data privacy and have been vetted by IT.
2. **All AI Output Must Be Verified:** Every claim, statistic, citation, or piece of analysis generated by an AI must be independently verified for accuracy by a human before it is included in any client-facing deliverable. The employee using the AI is responsible for this verification.
3. **Disclose AI Use When Required:** Follow all contractual obligations and regulatory requirements regarding the disclosure of AI use in client work. When in doubt, err on the side of transparency with the client.
4. **Final Judgment is Human:** AI is a tool for drafting and analysis, not for final decision-making. The final professional judgment on any recommendation or conclusion rests with the human consultant, who remains fully accountable.
5. **Approved Tool List:** The firm will maintain a list of approved AI tools that have been vetted for security, privacy, and reliability. Use of non-approved tools for client work is prohibited.
Implementing this policy requires more than just sending a memo. It involves training, updating client engagement letters to clarify AI use, and discussing AI governance with your professional liability insurance provider. Insurers are increasingly scrutinizing how firms are managing AI risk, and having a robust policy in place can be critical.
AI is an undeniable accelerant for consulting work, but it is not an oracle. The Deloitte case wasn’t an indictment of AI; it was a reminder that professional diligence, verification, and accountability cannot be automated. By adopting a clear framework of risk awareness, robust internal policies, and the right purpose-built tools, consulting firms can leverage the power of AI without betting their reputation on a black box. For more guidance on tools and strategies, visit our hub for professional services.
Who is liable when an AI makes a mistake?
In almost all cases, the user or operator of the AI system is liable, not the AI itself. Courts and regulators view AI as a tool, and the person or company deploying that tool is responsible for its output, just as they would be for errors from a spreadsheet or any other software.
Can a company be sued for an AI hallucination?
Yes. If an AI hallucination (a fabricated output) is included in a professional report or service deliverable and it causes financial or reputational harm to a client, that can be grounds for a lawsuit based on professional negligence. This has already happened in the legal field and is a clear risk for consultants.
Does professional liability insurance cover AI mistakes?
It depends on the policy. Some traditional general liability policies may have exclusions for AI-related failures. Firms are increasingly turning to specific “AI insurance” or riders to ensure they have affirmative coverage. It is critical to discuss your firm’s AI usage and governance with your insurance broker.
How can you prevent AI hallucinations?
You cannot completely eliminate hallucinations, as they are inherent to how current large language models work. However, you can significantly mitigate the risk by using AI tools that are “grounded” in your own verified data, implementing a strict human verification process for all AI outputs, and training employees to never blindly trust AI-generated facts.
Should we disclose our use of AI to clients?
It depends on your contractual obligations and the client’s expectations, but transparency is the safest policy. Some contracts may require disclosure. Even if not required, being upfront about how you use AI to enhance efficiency while maintaining human oversight can build trust and prevent disputes later.
Where to go next
Three routes, picked for what you just read.
Sources (41)
- Current time information in London, GB. https://www.google.com/search?q=time+in+London,+GB
- LLM Hallucination Statistics 2026. *Google Search*.
- Legal statement on liability for AI harms – lessons for professionals. *Google Search*.
- Gartner Survey Finds AI Discovery of Cyber Vulnerabilities is Top Emerging Risk in Second Quarter of 2026. *Gartner*.
- AI Liability Explained: Who Is Responsible When AI Fails? – SolvLegal. *Google Search*.
- What’s the real cost of disinformation for corporations? *World Economic Forum*. https://www.weforum.org/agenda/2025/07/disinformation-cost-corporations-billions/
- AI Hallucination Statistics 2026: Rates, Costs & Model Data – AI Business Weekly. *Google Search*.
- Gartner Survey Finds Information Integrity Risk Now the Top Concern Among Risk Leaders in First Quarter of 2026. *Gartner*.
- Gartner Survey Shows AI-Enhanced Malicious Attacks as Top Emerging Risk for Enterprises for Third Consecutive Quarter. *Gartner*.
- Misinformation in Business: Don’t Eradicate, Educate – SAP. *SAP Insights*.
- AI Hallucination Rate Benchmarks 2026: 5-Model Study – Digital Applied. *Google Search*.
- AI Hallucination Rate 2026: 20% & How to Cut It 78× – Iternal Technologies. *Google Search*.
- Market Guide for AI Trust, Risk and Security Management – Gartner. *Gartner*.
- Confidently Wrong: Hallucinations Revisited – The Information Difference. *Google Search*.
- Best AI Proposal Software in 2026: 11 Tools Compared – AutogenAI. *Google Search*.
- How to Build an AI Dashboard in 2026: From Raw Data to Executive-Ready Analytics in Minutes – ChartGen AI. *Google Search*.
- Gartner Says General Counsel Should Assess AI Insurance to Mitigate AI Risks. *Gartner*.
- HSB Introduces AI Liability Insurance for Small Businesses – Munich Re. *Google Search*.
- Using AI to ask difficult questions about AI liability. *Google Search*.
- Liability for AI companies could help rein in unsafe AI – Facebook. *Google Search*.
- Employers don’t have to build the AI algorithm to own the liability. *HR Dive*.
- The Business Cost Of Fake News: Lessons For Leadership In An Era Of Misinformation. *Google Search*.
- The 12 Best AI RFP Software Tools in 2026 – SiftHub. *Google Search*.
- 12 Best AI RFP Software Tools in 2026: Ranked for Enterprise Proposal Teams. *Google Search*.
- Law Professor Catches Deloitte Using Made-Up AI Hallucinations In Government Report. *Google Search*.
- Deloitte to Refund Australian Government After “AI Mistake” Report | Vantage on Firstpost. *YouTube*.
- Combat Misinformation for a Stable Economy – HKU Business School. *Google Search*.
- (Why) Is Misinformation a Problem? – PMC. *Google Search*.
- Deloitte AI debacle seen as wake-up call for corporate finance. *CFO Dive*.
- AI Hallucinations Hit Deloitte, EY, and a Top Law Firm. Here’s the Real Lesson. – 한국딥러닝. *Google Search*.
- Best Tender & Bid Management Software 2026: 12 Tools, Real Prices. *Lucius AI*.
- AI and Legal Malpractice: Attorney Risks and Ethical Duties. *Google Search*.
- Best Gantt Diagram Creator in 2026 (7 Tools Compared) – ChartGen AI. *Google Search*.
- AI Litigation Lawyer – Federal Lawyer – Oberheiden P.C. *Google Search*.
- How consumer AI tools create hidden malpractice risks for law firms – Thomson Reuters. *Google Search*.
- AI and Legal Malpractice: How Is AI Impacting the Legal Profession? – Vanderbilt Law School. *Google Search*.
- Best RFP Software in 2026: 12 AI Tools Compared – AutogenAI. *Google Search*.
- ChartGen – AI Tool For Charts. *Google Search*.
- ChartGen AI: Data visualization platform. *MOGE*.
- Deloitte Dolittle: Stop treating AI like a magic wand. *Horses for Sources*.
- AI Tool to Generate Dashboards from Excel: 8 Tools (2026) – Anomaly AI. *Google Search*.
See Zekai first in Google
The weekly AI briefing for your profession
One weekly email: the AI changes that actually affect your profession — tools, deals, and what to do about them.


