← The Notebook

October 17, 2026 · 6 min read

AI Visibility Tools: What to Look For Before You Trust a Score

Most tools sell a number. Ask these questions first.

By Jason Wade · Founder of BackTier and host of Lake Wales Startup Night

A new category of software has appeared overnight: tools that promise to score your "AI visibility" out of 100. Some are useful. Many are a dashboard in search of a method. Before you trust any score — including ours — here are the questions worth asking.

A score without a frozen prompt set is a horoscope with a chart.

The questions that matter

  • What prompts were run? A score should come from a documented, frozen set of questions — your category, services, location, and named competitors — not a mystery sample.
  • Which platforms were tested? ChatGPT, Google AI Overviews, Gemini, Claude, and Perplexity behave differently. A single-platform score hides more than it shows.
  • How many times was each prompt run? These systems are non-deterministic. One run is an anecdote; repeated runs in clean sessions are a measurement.
  • Can I see the actual answers? If the tool won't show you the raw responses behind the score, you can't check its work.
  • What does the tool claim it can't do? Honest measurement admits its limits. No tool can guarantee what an independent AI will recommend.

What a useful reading looks like

A trustworthy result reads like a report, not a grade: here is the prompt set, here is what each platform said on these dates, here is where you appear and where you don't, here is what's wrong in the answers, and here is what we can't attribute to anything. Ranges and trends across repeated runs — not a single number that goes up when you pay and down when you don't.

The free version you can run tonight

You don't need software to start. Open three AI assistants, ask the ten questions your customers actually ask, and paste the answers into a document with today's date. Do it again in a month. That humble file — dated, repeatable, honest — is already more rigorous than most dashboards. When you want the full version, that's what our Baseline formalizes: 40 to 60 frozen prompts, three runs each, five platforms, delivered in five business days.

JW

Jason Wade

Founder of BackTier and host of Lake Wales Startup Night. He writes The Notebook and measures how local businesses show up in AI answers at BackTier.

Keep reading