NeuronSearchLab builds product and content recommendations. When someone asks for a preview of how their own site would rank, we read that site’s public pages the way a search engine does, and build a catalogue from the structured data already published on them.

We read your robots.txt first and follow it, including noai and noindex. We use your sitemap where you publish one, and a product or RSS feed in preference to crawling at all. Requests are paced and capped, and we never submit forms, follow links behind a login, or read anything a logged-out visitor could not.

We keep the page title, description, image URL and canonical URL, plus a numerical representation used for ranking. We do not keep full page text.

Add this to your robots.txt and we will stop on the next request:

User-agent: NeuronSearchLab-Ingest
Disallow: /

A site-wide noai or noindex directive has the same effect. We re-read robots.txt at the start of every crawl, so there is nothing to wait for.

If you have been sent a preview of your site and want it gone, open it and use the removal link at the bottom of the page, or paste the link at console.neuronsearchlab.com/try/remove. It is deleted immediately, along with everything we read from your site. You do not need an account, and there is nothing to wait for.

Previews are never indexed by search engines, and unclaimed ones are deleted automatically.