Skip to content

Track law firm mentions in AI answers, and the pages behind them

Sample the answers monthly, watch the fee and bio pages weekly, and fix the source rather than the reply.

3 min read

Track law firm mentions in AI answers if what you care about is accuracy, not applause. An assistant that tells a caller the firm handles legal aid when it stopped taking legal aid last year is a problem, and it is a problem nobody inside the firm can see unless someone checks the answers.

The work has two halves: watch the pages an assistant would read, and sample the answers themselves.

The pages that feed the answer

An assistant writing about a firm draws on the firm's own pages and the public profiles that describe it. The list is shorter than a marketing team expects.

  • The fee and process pages, because cost and timeline are the questions that get asked.
  • Attorney bios, because a name, title and admission date are the details a summary repeats.
  • The home page, because that is where the entity description comes from in most summaries.
  • Google Business Profile and the main directory listings, because those are often what the assistant cites instead of the site.
  • Press and announcement pages, because an acquisition or a closure can take months to disappear from answers.

Each of these is a public page, and a public page can be watched. That is the part a monitor does well: check on a schedule, compare with the last copy, and send a short summary when the wording moves.

Set the watch list

On AyeWatch you paste a public URL and describe the change in plain English: "tell me when the fee section changes", "tell me when a new attorney bio appears", "tell me when the legal aid wording changes". Push and the feed come with every plan, and email, Slack, Discord, webhooks and API access need a paid plan. Paid plans start at $9 a month after a 7 day trial, billed in monitoring credits.

For a firm, the useful default is a weekly digest to one inbox rather than a push per change. The exception is a fee page, which is worth knowing about the same day.

Page Watch for Why it matters
Fee page Any price or wording change The question every client asks second
Attorney bio Name, role, admission or departure Summaries repeat bios verbatim
Practice page Service added or removed Prevents a stale offer in answers
Directory listing Hours, address, phone Assistants cite directories over sites
News page Merger, closure, new office Old news lingers in generated summaries

Sample the answers, and write them down

Once a month, ask three assistants the ten questions your clients actually ask. Record the question, the engine, the date and the exact wording of the answer. Do not paraphrase, and do not run it once and call it a finding.

The reason is that these answers vary between runs. A single screenshot proves nothing. A log across three months shows whether the firm is described consistently, whether a fee figure is wrong, and whether a competitor keeps appearing where the firm does not.

Fix the source, not the answer

There is no way to edit an assistant's reply. What can be edited is the page it read. If an answer quotes an old fee, the fee page is the fix. If an answer confuses two firms with similar names, the Organization markup and the profile naming are the fix.

That is why monitoring the page and sampling the answer belong together. The sample tells you what is wrong. The watch list tells you when the underlying page changes again.

What this does not cover

A monitor reads public pages. It cannot see a private client portal, a paid directory behind a login, or the internal knowledge an assistant was trained on. It also cannot tell you whether an answer is good for the firm, only that a page changed. The review stays with the people who know the practice.

Nothing here is legal advice, and no tool can promise a mention in an answer.

FAQ

Can a firm edit an assistant's answer?

No. What can be edited is the page the answer was built from. If a fee figure is wrong in an answer, the fee page is where the fix belongs.

How often should the answers be checked?

Once a month is enough for most firms, using the same ten questions each time and recording the engine, the date and the exact wording.

What does monitoring cost?

AyeWatch gives a 7 day trial on the web, and paid plans start at $9 a month, billed in monitoring credits rather than a flat fee. Push and the feed come with every plan.

Originally published on claudegpt.si