Crawl Master

Issues first, not spreadsheets first

See what's wrong with your site. Fix the worst first.

Crawl Master crawls your whole website and hands you a ranked list of problems, with every affected page and the pages linking to it one click away.

  • No card for the trial
  • No URL limit
  • No subscription
https://example-shop.co.uk
2,431URLs crawled
9problems found
+3 / −5new / fixed since last crawl
  1. HighBroken internal links37 URLs
  2. HighPages blocked from search engines12 URLs
  3. MediumRedirect chains18 URLs
  4. MediumMissing meta descriptions214 URLs
  5. LowImages without alt text96 URLs
  6. GoodEvery page served over HTTPS2,431
Example crawl. Pick any problem to see the pages affected and what links to them.

Everything you need to clean up a site

Built for people who fix websites: agencies, freelancers, developers and in-house marketers.

Ranked by what matters

Problems are sorted by priority and how many pages they hit, so you always know what to do next.

Unlimited URLs

Crawl a 50 page brochure site or a huge online shop. There's no cap, and big crawls can pause and resume.

See what changed

Each crawl is compared with the last one, so you can show what's been fixed and catch anything new.

Show it on the page

Open any page with its problems outlined in place: broken links, missing alt text, small tap targets and spelling mistakes.

Sitemap and link audit

Find orphan pages, sitemap entries that shouldn't be there and important pages missing from it.

Command line and CI

Run crawls from a script, export CSVs, and fail a build when high-priority problems appear.

Works with Claude

Connect Crawl Master to Claude in one click and ask it to run crawls, explain problems and suggest fixes.

Fast

Uses every core on your computer. On a fast PC it gets through more than 500 pages a second.

Private by design

Crawls stay on your computer. No tracking, no cloud account, nothing uploaded.

Around 50 checks, out of the box

Each problem comes with the affected URLs and the pages that link to them.

  • Broken links (4xx)
  • Server errors (5xx)
  • Redirect chains and loops
  • Blocked by robots.txt
  • Noindex and nofollow
  • Canonicals
  • Page titles
  • Meta descriptions
  • Headings
  • Thin content
  • Duplicate pages
  • Image size and alt text
  • HTTPS and security
  • Page speed
  • URL structure
  • Sitemaps
  • Internal linking
  • External links
  • Structured data
  • Accessibility
  • Spelling

Up and running in minutes

  1. Download

    Install Crawl Master on Windows. No account and no card needed.

  2. Crawl

    Type in a website address and press Start. Results appear as it goes.

  3. Fix

    Work down the list from the top. Crawl again to prove it's fixed.

One price. Pay once.

Try every feature free for 14 days. If it's for you, buy a licence and keep it.

Crawl Master licence

£100one payment

For one person, on any number of their own computers.

Buy Crawl Master

Secure checkout by Stripe. Any VAT or sales tax for your country is shown before you pay. Your licence key arrives by email straight away.

  • Every feature and every check
  • Unlimited URLs and saved crawls
  • Command line and Claude connection
  • Use it on all your own computers
  • Updates and email support
  • No subscription, no renewal
30-day money-back guarantee. If it's not right for you, email within 30 days and you'll get a full refund.

Questions

How does the free trial work?

Download the app and use every feature for 14 days. You don't need to give card details. When the trial ends, you can still open and export the crawls you saved. Starting new crawls needs a licence.

Is it a subscription?

No. You pay once and the licence is yours. It includes updates and email support.

How many computers can I use it on?

A licence is for one person, and they can use it on any number of computers they own or control. A business buying for several people needs one licence per person.

What if it's not right for me?

Email josh@higginsdevelopment.co.uk within 30 days of buying and you'll get a full refund. See the terms and refund policy.

Which systems does it run on?

Windows 10 and 11 today. A Mac version is on the way.

Can I bring in crawls from another tool?

Yes. You can import a Screaming Frog "Internal: All" CSV export and see it in Crawl Master's issues-first view.

Does it send my data anywhere?

No. Crawls are stored on your computer. The app only checks your licence key about once a week. Optional connections, like Google Search Console, use your own accounts and go straight from your computer to that service. See the privacy policy.

Who makes it?

Crawl Master is made by Josh Higgins at Higgins Development, a small software business in the UK. Questions go straight to him at josh@higginsdevelopment.co.uk, and he usually replies within 2 working days.

Find out what's wrong with your site today

14 days free. No card. No URL limit.