Track law firm mentions in AI answers, and the pages behind them
Sample the answers monthly, watch the fee and bio pages weekly, and fix the source rather than the reply.
3 min read
Track law firm mentions in AI answers if what you care about is accuracy, not applause. An assistant that tells a caller the firm handles legal aid when it stopped taking legal aid last year is a problem, and it is a problem nobody inside the firm can see unless someone checks the answers.
The work has two halves: watch the pages an assistant would read, and sample the answers themselves.
The pages that feed the answer
An assistant writing about a firm draws on the firm's own pages and the public profiles that describe it. The list is shorter than a marketing team expects.
- The fee and process pages, because cost and timeline are the questions that get asked.
- Attorney bios, because a name, title and admission date are the details a summary repeats.
- The home page, because that is where the entity description comes from in most summaries.
- Google Business Profile and the main directory listings, because those are often what the assistant cites instead of the site.
- Press and announcement pages, because an acquisition or a closure can take months to disappear from answers.
Each of these is a public page, and a public page can be watched. That is the part a monitor does well: check on a schedule, compare with the last copy, and send a short summary when the wording moves.
Set the watch list
On AyeWatch you paste a public URL and describe the change in plain English: "tell me when the fee section changes", "tell me when a new attorney bio appears", "tell me when the legal aid wording changes". Push and the feed come with every plan, and email, Slack, Discord, webhooks and API access need a paid plan. Paid plans start at $9 a month after a 7 day trial, billed in monitoring credits.
For a firm, the useful default is a weekly digest to one inbox rather than a push per change. The exception is a fee page, which is worth knowing about the same day.
| Page | Watch for | Why it matters |
|---|---|---|
| Fee page | Any price or wording change | The question every client asks second |
| Attorney bio | Name, role, admission or departure | Summaries repeat bios verbatim |
| Practice page | Service added or removed | Prevents a stale offer in answers |
| Directory listing | Hours, address, phone | Assistants cite directories over sites |
| News page | Merger, closure, new office | Old news lingers in generated summaries |
Sample the answers, and write them down
Once a month, ask three assistants the ten questions your clients actually ask. Record the question, the engine, the date and the exact wording of the answer. Do not paraphrase, and do not run it once and call it a finding.
The reason is that these answers vary between runs. A single screenshot proves nothing. A log across three months shows whether the firm is described consistently, whether a fee figure is wrong, and whether a competitor keeps appearing where the firm does not.
Fix the source, not the answer
There is no way to edit an assistant's reply. What can be edited is the page it read. If an answer quotes an old fee, the fee page is the fix. If an answer confuses two firms with similar names, the Organization markup and the profile naming are the fix.
That is why monitoring the page and sampling the answer belong together. The sample tells you what is wrong. The watch list tells you when the underlying page changes again.
What this does not cover
A monitor reads public pages. It cannot see a private client portal, a paid directory behind a login, or the internal knowledge an assistant was trained on. It also cannot tell you whether an answer is good for the firm, only that a page changed. The review stays with the people who know the practice.
Nothing here is legal advice, and no tool can promise a mention in an answer.
FAQ
Can a firm edit an assistant's answer?
No. What can be edited is the page the answer was built from. If a fee figure is wrong in an answer, the fee page is where the fix belongs.
How often should the answers be checked?
Once a month is enough for most firms, using the same ten questions each time and recording the engine, the date and the exact wording.
What does monitoring cost?
AyeWatch gives a 7 day trial on the web, and paid plans start at $9 a month, billed in monitoring credits rather than a flat fee. Push and the feed come with every plan.
Originally published on claudegpt.si