BlogLegal AI First-Pass Review: What Should AI Touch Before a Lawyer Does?

Legal AI First-Pass Review: What Should AI Touch Before a Lawyer Does?

AI first-pass review checks contracts, requests, and invoices before they reach a lawyer. Here's how it works, what it needs to be trustworthy, and how to evaluate it.

Checkbox Team

Checkbox Team

Legal operations insights

September 21, 2026 · 8 min read

Editorial illustration for Legal AI First-Pass Review: What Should AI Touch Before a Lawyer Does?

Every piece of work that comes into your legal department gets an initial review. Someone opens the contract to identify its type. Someone reads the request to understand what’s actually being asked. Someone scans the invoice before approving payment.

That “first look” feels free because it isn’t tracked, but it’s almost always done by a lawyer—often a senior one—and it’s essentially the same review, repeated thousands of times a year.

A new category of legal AI aims squarely at that moment. First-pass review tools read incoming contracts, requests, and invoices before a lawyer does, resolve what’s routine, and hand the rest over already summarized, scored, and routed. Used well, the first look stops being a tax on your team. Used carelessly, you’ve delegated judgment you meant to keep. The difference comes down to what the review checks against, and what happens at the edges.

What Is AI First-Pass Review?

First-pass review is legal AI that examines incoming legal work against your own standards before a human touches it.

  • For a contract, it reads the document against your playbook or gold-standard template and returns a risk score, a summary, and suggested edits before the contract reaches a lawyer.
  • For an invoice, it checks the math and format, then reviews line items against your billing guidelines.
  • For an incoming request, it identifies what’s being asked, then routes it, answers it using approved knowledge, or escalates it as needed.

Many AI tools can review contracts, but first-pass review does this at the front door, or in other words, at the moment work arrives. That timing is what allows routine tasks to be resolved without using any lawyer time at all.

It’s the natural next layer on top of automated legal intake and triage. Legal triage decides where work should go, and AI first-pass review starts doing the work before it even gets there.

The economics of an in-house legal team are really the economics of attention. When a lawyer opens an NDA only to find it’s the same standard NDA as always, the cost is far more than the 90 seconds it takes to read it.

There’s also the context switch away from the acquisition they were working on, the clarification email needed because the request came in half-described, and the queue time the NDA spent waiting for a human to confirm it didn’t actually need a human. If you multiply that by every routine contract, question, and invoice, that “first look” becomes one of the largest unmeasured costs in the department.

Adding more headcount won’t fix the problem because senior lawyers still end up doing the repetitive work. Instead, the structural solution is to shift the initial review to an AI tool that reads everything instantly and applies a consistent standard every time.

What First-Pass Review Needs to Be Trustworthy

Four things separate a first-pass layer you can rely on from one you’ll regret.

1. Your Company Standards

The legal first-pass review must run against something you control such as your internal playbooks, gold-standard template, or billing guidelines. A model’s general sense of what qualifies as ‘market’ is not an objective standard. A risk score without an explicit, documented rubric is merely subjective, so if you cannot identify the specific document the AI evaluated, the process is not a first-pass review but an initial opinion.

2. Calibrated Escalation

The AI needs explicit rules for what it may resolve and what it must hand to a human, set by risk rather than convenience, such as contract value, clause deviations, counterparty type, and data sensitivity. The goal is to have an automated legal assistant that knows what it’s not allowed to decide.

3. A Record of Every Call

Every review, score, and routing decision should leave an audit trail a lawyer can inspect. When someone asks why a contract went through without human review, “the AI cleared it” is only an acceptable answer if you can show what it checked and what it found.

4. A Feedback Loop

Sometimes, lawyers will override the AI’s decisions, and those overrides are valuable data. A first-pass layer that never learns from its escalations will never improve; it will remain exactly as useful as the day you first set it up.

First-pass review lives at the legal intake and triage layer, before work lands on a lawyer’s desk.

For example, Checkbox offers first-pass review through a context-aware legal AI agent that captures requests where they start, files them to matters already open instead of creating duplicates, and assigns them by guidelines the legal team writes in plain language, such as sending the next request to whoever has the lightest workload. For contracts, it runs incoming documents against the team’s playbook or gold-standard template, returning a risk score, summary, and review before the contract reaches a lawyer. For invoices, it checks LEDES files for mathematical and formatting errors, then reviews line items against billing guidelines and returns a corrected invoice and summary report.

Work that clears review resolves or routes onward, while work that doesn’t arrives with the analysis already attached. Matter management still sits downstream, tracking the work that genuinely needs a lawyer, and the AI first pass layer feeds it pre-triaged, deduplicated requests rather than cold submissions.

Dedicated legal intake and triage software with first-pass review is solving a different problem than a drafting assistant a lawyer invokes mid-task. One reduces what reaches your team; the other speeds up what your team already touched.

How to Evaluate a First-Pass Tool

Three questions to ask during an AI first-pass legal tool demo are:

  1. What does it review against, and can we change that ourselves without a services engagement?
  2. What does it do when confidence is low, and can we see an escalation happen live?
  3. What record does it leave, matter by matter, when we need to defend a call six months later?

The vendor should show you how playbooks are configured, how escalation rules work, and what the audit log captures. Before expanding beyond a pilot, test the system on one document type you know well (NDAs are a common choice). Measure the deflection rate and the false-clear rate against a lawyer-reviewed baseline to establish performance.

Key Takeaways

First-pass review shifts the potentially costly ‘first look” upstream: AI reads incoming contracts, requests, and invoices against your playbooks and guidelines, resolves routine items, and passes the rest along with risk scores and summaries.

Trustworthy AI first-pass review solutions share four traits:

  • They check work against standards you control
  • They escalate based on explicit risk rules
  • They log every decision
  • They learn from lawyer overrides

This layer belongs at intake, before work reaches a lawyer, while matter management downstream handles what truly requires human attention.

Book a demo to see how Checkbox AI reviews requests, contracts, and invoices before they consume your team’s time.

Frequently asked questions

AI first-pass review FAQs

What is AI first-pass review in legal?

First-pass review is AI that examines incoming legal work (contracts, requests, invoices) against your team's own playbooks and guidelines before a lawyer sees it, returning risk scores, summaries, and routing decisions. Routine work resolves at the front door while complex work reaches lawyers with analysis attached.

How is first-pass review different from AI contract review tools?

A contract review assistant helps a lawyer who already opened the document, while first-pass review runs at intake, before a lawyer is involved, deciding what needs human attention at all.

Is it safe to let AI review contracts before a lawyer?

It's safe when the review runs against standards you control, escalation rules are set by risk, and every call is logged for inspection. It's risky when the tool applies its own general judgment with no rubric and no audit trail.

What should AI first-pass review check contracts against?

Your playbook or gold-standard template: approved positions, fallback language, and deviation thresholds. The review's value comes from applying your standard consistently, not from the model's general opinion of the market.

Can AI review legal invoices?

Yes. First-pass invoice review checks LEDES invoices for mathematical and formatting errors, then reviews line items against your billing guidelines and returns a corrected invoice and summary report before anything reaches an approver.

How do you measure whether first-pass review is working?

Track the deflection rate (work resolved without lawyer involvement), the false-clear rate against a lawyer-reviewed baseline, and turnaround time from submission to resolution. Pilot on a single high-volume document type before expanding.