Cynical Sally← All rulings
Don'tContracts

Trusting an "AI lawyer" to generate valid legal documents unsupervised

"Robot lawyer" is a marketing phrase, not a malpractice policy. The robot does not carry the risk. You do.

By Cynical SallyIssue NΒΊ 1

Not legal advice. Sally roasts behaviour and use-cases in general, never your specific situation, and nothing here replaces a real lawyer. The cases are real; what you do about them is between you and someone licensed to tell you.

The use-case

Using a consumer "AI lawyer" product to generate contracts or legal filings and treating the output as attorney-grade.

This actually happenedA real case, in full
The receiptRegulator action

FTC v. DoNotPay, Inc.

FTC consent order finalized Jan. 2025 Β· US (Federal Trade Commission)

What happened

DoNotPay marketed an "AI lawyer" that it claimed could generate valid legal documents and replace human attorneys, without testing accuracy or retaining lawyers to verify the output.

The outcome

Settled for $193,000 in monetary relief, was barred from claiming its service performs like a real lawyer without evidence, and had to notify affected subscribers.

Why

A regulator went after a company that marketed an "AI lawyer" claiming it could generate perfectly valid legal documents and replace human attorneys, without testing accuracy or having actual lawyers verify the output. Marketing AI legal work as attorney-equivalent without substantiation is a deceptive-practices problem.

A contract that looks lawyerly and is quietly wrong is more dangerous than no contract, because it gives you confidence right up until the moment it fails you in front of someone who reads it for a living.

β€œIt generated a contract in four seconds. A real lawyer takes longer because they are the only one in the room who will be liable when it is wrong.”

What to do instead
  • 01Use AI to demystify a document, draft a rough first pass, or build your list of questions. Then have a qualified lawyer review anything you will actually rely on.
  • 02Treat AI output as a starting draft, never the signed version.
  • 03Be suspicious of any tool that promises to replace a lawyer. The ones that work tell you when to get one.

Not legal advice. General commentary on a use-case, not your situation. Talk to a real lawyer before you act.