Analysis

Told your ChatGPT visibility is up 50%?

Published on · 2 min read

Before you celebrate, ask a simple question: how is it measured?

Nothing has changed, and yet

On Monday, we ask ChatGPT the same question 10 times: your brand is mentioned 4 times. On Tuesday, we do it again: 6 times. Nothing has changed between the two. Yet in a report, that is written up as “+50%”.

This is not an accident, it is how these tools normally work. Asked several times on the same day, the same question does not return the same brands, to the point that a single measurement is practically unusable, according to a study from the University of St Gallen (2026). After a campaign, a gap like that therefore proves nothing.

It is not the only source of variation

Take a film that comes out next month: it is not yet in the memory of your favourite AI. Ask it for the autumn’s thrillers. It may answer from memory, and not mention it. Or search the web, and then everything depends on which pages are available that day.

Ten answers to a single question is a survey of ten people. Recent studies agree: you have to repeat, vary the questions and watch over time.

Our protocol

At Reflets, a Paris-based AI consultancy, this is what our clients ask of us: to know what really changed between before and after a campaign.

  • Dozens of questions, 10 times each, to each AI assistant. We never conclude on one question, only on the whole set.
  • For every answer, we know whether the AI searched the web.
  • Every measurement is repeated 24 hours later. If the two disagree, we draw no conclusion.
  • And we start again every two weeks.

We set out this method, and what it changed for a film release, in Measuring what AI assistants say about a brand.

The point is not whether to measure visibility in AI assistants. The point is not to pass off noise as a result.

Portrait of Yvan Forestier

Yvan ForestierCo-founder of Reflets

Back to top

Let’s talk about what’s taking up your time.

A 30-minute video call, booked in our calendar.

Contact us