Legalnaut

AI IN PRACTICE 2026-09-04 2 MIN READ

Check these 5 things before AI text enters a filing

In Mata v. Avianca (S.D.N.Y., June 2023) lawyers were sanctioned over case citations a model invented. The defence is procedural.

Language models write fluent, confident text that is sometimes about a world that does not exist. In a filing that is a professional problem, as Mata v. Avianca (S.D.N.Y., 2023) showed.

The risk is specific, so the check can be too

The failure mode is that a model has no way to distinguish between recalling something and constructing something that fits the shape of the answer. Both come out in the same confident register.

So the useful check is whether each factual claim can be traced to a document you can open. Five passes, in order, and they get faster with practice.

1. Every claim names a source

Take each sentence that asserts a fact and ask what it points at. A passage that cites nothing is a hypothesis. Send it back or delete it.

This is why it matters that the tool you use attaches sources as it works rather than offering to find them afterwards. Retrofitted citations get attached to whatever is closest, which is a different thing from where the claim came from.

2. Open the source, do not trust the label

A reference that looks right is not the same as a reference that is right. Open the document. Confirm it exists, confirm it says what the passage says it says, and confirm it is the document you think it is rather than a similar one.

For file material a checksum makes this cheap: the same document, verifiably unaltered since it entered the file. For cited authorities there is no shortcut. Look it up.

3. Quotations are verbatim, or they are not quotations

Check quoted text character by character against the original. Models paraphrase while keeping quotation marks, which is the most dangerous error on this list because it survives casual review.

A related trap in multilingual files: a quotation translated into the language of the filing has stopped being a quotation. Quote the original and translate alongside it.

4. Dates and numbers, individually

Dates drift. Figures get rounded, transposed, or attached to the wrong party. These are exactly the errors an opponent enjoys finding, and they are quick to check against the source you already have open from step two.

5. Cut what nobody asked for

Models fill space. Ask for a summary of three documents and you may get a fourth point that reads well and rests on nothing. Anything that does not trace back to a document in step one comes out, however good it sounds.

Build the check into the tool

A process that relies on someone remembering to be careful late at night gets skipped eventually.

Legalnaut attaches the source to every generated statement and marks AI drafts as drafts requiring review, so an unsupported claim has nowhere to hide and nothing leaves the system labelled as finished work. The checking still belongs to a lawyer. What changes is that the material needed to check is already attached.

Claims that survive step one sometimes conflict with other documents in the file. How to find contradictions in witness statements covers what to do with them.

Create your account and check an AI draft against the documents it claims to rely on. No card needed.

The Legalnaut assistant searches and reads your file before it answers, and every answer cites the page you can check. Ask the demo case a question, no sign-up needed, or start the 14-day trial on your own file.