Google Discover unearthed an article which led me to LLM SEO Monitor this morning. Not directly, but via a site I’d not seen before called ProductHunt.com
I originally tested it on my phone and was pleased with the results. Then I tried it ono my laptop, and ChatGPT errored. In fact ChatGPT continues to “time out” so I wonder if a query limit has been exceeded by the tool.
No additional recommendations found.
Sources
No sources found.
ChatGPT may have generated recommendations based on its training data.
Anyway, what LLM SEO Monitor does is, very roughly, take a query then crawl OpenAI’s ChatGPT, Google’s Gemini, and Anthropic’s Claude to glean mentions and sources of your question.
SEO Agency, Surrey
The first test, on mobile, delivered 5x ChatGPT results, 5x Gemini results, and 11x (?) Claude results. It was the same on desktop, apart from the errors from ChatGPT.
Rather than go deep into any prompt engineering, I simply queried SEO agency, Surrey and got my results.
LLM SEO Monitor doesn’t really “rank” the results, rather it simply displays them in an arbitrary order, presumably with an ambiguous rank implied by their order of display.
What was interesting was that a digital marketing agency in Surrey, where I previously dedicated eight years of my SEO life to getting great organic results for, was listed in all the results on the initial mobile test. In the desktop/laptop test, it showed up in both Gemini’s and Claude’s top 5 and 11 respectively.
Amidst the results I also saw “the usual suspects” – other digital marketing agencies that I’d competed against when I was the Digital Marketing Manager at the Hampshire/Surrey digital marketing agency for nearly a decade.
Gemini also listed one of my own digital marketing companies, three other reputable digital agencies, and an outlier individual.
Claude listed five agencies I know and six I’d never heard of.
It’s not a definitive or comparable list, especially with only Gemini and Claude providing reliable output, but it is nonetheless of interest in testing this new SEO tool.
Innovative Digital Marketing Solutions
What was also interesting was the accompanying text describing the results. Each listing had a snippet beside it, labelled “context”.
Gemini had (all lower case) a long sentence. Claude had (Sentence case) more succinct describers.
Gemini used my old language at my previous employer to say they’d been crafting successful SEO campaigns since 1998. That reference is very personal – the agency was formed in 2007 but I was doing SEO as far back as 1998. So now that I’m gone, that’s not correct, and the resource there right now has around ten years experience, so that’s simply a remnant of what was true until I left.
The other Gemini results had companies with the descriptions:
- providing high-impact SEO and online marketing services, specialising in helping websites reach top search engine rankings,
- an award-winning SEO agency with over 40 years of collective industry experience, providing bespoke SEO consultancy,
- my own design and digital studio offering SEO services with 25 years of professional experience, covering on-page, technical, and ongoing SEO consultancy, and
- a leading SEO digital marketing expert/agency known for effective and affordable SEO services.
Knowing two of those listings intimately and the others from local searches, that was an OK result from Google’s Gemini.
Claude’s more numerous but compact descriptors were:
- Surrey-based SEO agency with custom strategies
- Local SEO experts specialising in Surrey businesses
- Full-range SEO services for Surrey companies
- Comprehensive digital marketing and SEO solutions
- Local SEO expertise with customised strategies
- Award-winning SEO agency for service providers
- Tailored SEO strategies for Surrey and South East businesses
- Experienced SEO agency with local focus
- Profit-focused SEO services in Surrey
That almost looks like an AI generated list of title tags for an SEO agency.
Local SEO Queries
I’ve been looking for local SEO terms with mixed results. ChatGPT has been reliably providing “no sources found” whilst Gemini and Claude have regularly output results.
For one test they simply output a cookie-cut
- Company offering SEO services in Aldershot (x5), and
- Tool for SEO performance monitoring (x3)
So there’s a lack of consistency with what these AI tools are generating. The results have been both locally accurate and yet a little broad and ambiguous.
Conclusion
This is an interesting little “SEO tool” and has been fun to test for a lazy bank holiday Monday morning.
It would be better if ChatGPT provided output every time and if there was a more comparable number of results for each of Gemini and Claude.
Other than that, I will test some more complex queries and report back if there’s anything notable. Let me know if you see any advances in LLM SEO Monitor.
For SEO in Farnborough, Hampshire, and the surrounding areas, call me on 01252 692 765 or leave a message via my contact form.