What does fetchcheck do?

fetchcheck sends one signed GET request from SitedexBot to any URL and shows the exact response: whether it was allowed, blocked, challenged, or returned a page with no content. It respects robots.txt, checks response status and headers, never stores pages, and can retry unsigned or check HTTP if HTTPS fails.

Why would I use fetchcheck?

fetchcheck helps website owners verify whether trusted crawlers and AI agents can access their content. When AI assistants can't retrieve your pages because of bot protection or blank responses, they answer from other sources instead of your published content.

What is Web Bot Auth?

Web Bot Auth is an open standard for identifying trusted crawlers. SitedexBot signs every request using this standard so websites can verify its authenticity. Sitedex's signing keys are public.

SEO tools

fetchcheck

Send one signed crawler request to any site and see exactly how it responds

0 votes. Log in to rate fetchcheck up Follow change log. Log in to follow fetchcheck's change log

A free tool that sends one signed request from SitedexBot to any URL and shows whether the site allows it, blocks it, challenges it, or serves blank content.

Overview

A look at sitedex.dev

fetchcheck is a free crawler testing tool that verifies how any website handles signed requests from SitedexBot. Users paste a URL and the tool sends one signed GET request, then displays the response status, headers, and whether the HTML contains readable content. It respects robots.txt rules and never stores or republishes pages. The tool can send up to four requests per run: checking robots.txt, fetching the page as SitedexBot with a signature, optionally retrying unsigned for comparison, and checking HTTP if HTTPS doesn't respond. This helps website owners determine whether trusted crawlers like those used by AI assistants can access their content.

Feature notes

Sends one signed GET request from SitedexBot
Respects robots.txt rules
Never stores or republishes pages
Shows response status and headers
Supports unsigned retry for comparison
Checks HTTP if HTTPS doesn't respond

Pricing

Pricing model: Free

Follow change log. Log in to follow fetchcheck's change log

Follow fetchcheck to get an email when they post a milestone, ship a new product or add a demo video.

fetchcheck at a glance

Community votes: 0
Followers: 0
HQ: United States

fetchcheck metrics

Inspection sheet for sitedex.dev: Ahrefs Domain Rating and Majestic link metrics, with the delta since the last inspection.
Metric	Value
Domain Rating	4 no change since last check
Trust Flow	1 no change since last check
Citation Flow	36 no change since last check
Referring domains	100 no change since last check
External backlinks	1,173 no change since last check

Domain Rating by Ahrefs inspected 6 Nov 2026, adjusted 1 Nov 2026. Primary topic: Regional/Asia (1). Majestic inspected 1 Nov 2026, adjusted 1 Nov 2026. Link data: Majestic. Trust Flow, Citation Flow and Topical Trust Flow are trademarks of Majestic-12 Ltd.

fetchcheck domain diagnostics

Run through the diagnostics

Public RDAP record, last read 5 Nov 2026, 11:12 UTC.
Domain age	6 months
Registered	23 Apr 2026
Expires	23 Apr 2027
Registrar	CloudFlare, Inc.
DNSSEC	Signed

Run the full check on sitedex.dev

fetchcheck post-launch diagnostics

Measured after fetchcheck went live on Launching Pro on 1 November 2026.

Domain Rating (Ahrefs): 4 no change since launch; 4 at launch (1 Nov 2026), 4 on 6 Nov 2026
Trust Flow (Majestic): 1; First measured 1 Nov 2026
Referring domains (Majestic): 100; First measured 1 Nov 2026

Day 5 since launch. Next receipt: day 30, 1 Dec 2026. The figures report a change; they do not say what caused it, and many things can. No figure here is a guess.

Biggest gains on Launching Pro

Launch tips, free to read

The playbook on Launching Pro lists what to prepare, what to post on launch day and where else to list your product.

Before the day
Launch day
That week
Beyond launch

See the launch playbook

Compare and explore

FAQ

What does fetchcheck do?: fetchcheck sends one signed GET request from SitedexBot to any URL and shows the exact response: whether it was allowed, blocked, challenged, or returned a page with no content. It respects robots.txt, checks response status and headers, never stores pages, and can retry unsigned or check HTTP if HTTPS fails.
Why would I use fetchcheck?: fetchcheck helps website owners verify whether trusted crawlers and AI agents can access their content. When AI assistants can't retrieve your pages because of bot protection or blank responses, they answer from other sources instead of your published content.
How many requests does fetchcheck send?: fetchcheck uses up to four requests per run: checking robots.txt, fetching the page as SitedexBot with a signature, optionally retrying unsigned for comparison if the signed request is blocked, and checking HTTP if HTTPS doesn't respond.
What is Web Bot Auth?: Web Bot Auth is an open standard for identifying trusted crawlers. SitedexBot signs every request using this standard so websites can verify its authenticity. Sitedex's signing keys are public.

Leave a review for fetchcheck

No reviews of fetchcheck yet. Run the first inspection.

Reviews are free and are never paid for. Open the reviews

Reviews and notes · Change log · Share the profile · Maker of this product? Claim the profile · Report a fault

Comparable tools

LocalAuditProDR 19 · 0 community votes
ToBeFoundDR 7 · 0 community votes
ExtractKeywordsDR 9 · 0 community votes
Uplift AIDR 16 · 0 community votes

Feature notes

Pricing

Compare and explore

Leave a review for fetchcheck

More on this profile