The Seoprama-Audit crawler

Seoprama-Audit is the crawler behind Seoprama's site audits. It only visits a site when a Seoprama user starts an audit of that site. It reads pages to check for SEO issues such as broken links, missing titles and redirect chains. It does not index content or collect training data for AI.

How it identifies itself

Every request sends this user agent:

Seoprama-Audit/1.0

The crawler runs on Cloudflare Workers, so it has no fixed IP addresses. Allow it by its user agent rather than by IP.

Allowing it through a firewall or bot protection

If an audit reports "Crawler was blocked" (usually a 403 or a challenge page), your firewall or bot protection stopped it. Allow requests whose user agent contains Seoprama-Audit, then run the audit again.

• Cloudflare: Security → WAF → Custom rules → Create rule. Set Field to User Agent, Operator to contains, Value to Seoprama-Audit, and the action to Skip (skip the remaining custom rules, Bot Fight Mode and Super Bot Fight Mode where your plan allows). On the free plan, Bot Fight Mode can't be skipped by a rule, so turn it off while you audit.
• Other firewalls (Sucuri, Wordfence, AWS WAF and similar): add an allow rule for the same user agent.
• Shopify: use Crawler access instead. In Shopify go to Online Store → Preferences → Crawler access, copy the signature, and paste it into Seoprama under Settings → Crawler access.

Also check the address you audit is written correctly, for example https://example.com.

robots.txt

An audit starts with one request to the start address, following redirects, to find the site's real address. The crawler then reads robots.txt and skips any page it disallows. Rules for Seoprama-Audit take priority over rules for *. To keep it out of your whole site:

User-agent: Seoprama-Audit
Disallow: /

Crawl rate

The crawler sends about one request per second to a site, and an audit fetches only the number of pages its user chose. When a site answers 429 Too Many Requests, the crawler waits for the Retry-After time, slows down and tries that page once more. If the site keeps refusing pages, the audit stops early. It does not download images, scripts, fonts or other files.

Pages loaded another way

Two optional audit features load pages without the Seoprama-Audit user agent:

• "Render JavaScript" loads pages in a headless browser on Cloudflare.
• Page speed (Lighthouse) checks run from DataForSEO's servers with Lighthouse's own Chrome user agent.

Questions? Email support@seoprama.com.