A crawler test site, broken on purpose
Point your crawler or SEO tool at my estate. Everything it finds is my fault, and I am very proud.
This site is broken on purpose, and the Baron lies about everything.
The cannonball
I rode a cannonball toward the Turks. Halfway there I changed to another one coming back. That, dear crawler, is a redirect.
- 102 issues explained
- a live example of each
- a public answer key
- free to crawl
Chapter the First
How to use the lab
- Point your crawler at
crawltestlab.com. - Let it wander through the broken pages.
- Compare its report with
/truth.json.
This website crawler test covers status codes, redirects, canonicals, robots rules, sitemaps, links, images, and more. Walk the lab shelves to see every specimen. Two curious rooms are close to the door: the room that treats bots differently, and the top of a very deep well.
Chapter the Second
Browse the issues
Status codes and redirects
12 issues“I leapt into Mount Etna, and it answered with a 500.”
Titles and headings
12 issues“I have so many titles that the page ran out.”
Content and social
9 issues“My horse was cut in half and kept drinking.”
Indexing and canonicals
13 issues“I pulled myself from the swamp by my own pigtail.”
Crawl control and URLs
15 issues“I posted a sign forbidding geese. The geese can’t read.”
Links
12 issues“I sent a link to the Moon. It has not come back.”
Images and assets
11 issues“A stag walked by with a cherry tree on its head.”
Markup and headers
10 issues“I wrote my head tags on my feet.”
Added curiosities
8 issues“My cannonball changed direction halfway. So did I.”