Indexability, explained
Every URL is classified against a frozen set of non-indexable causes: noindex, X-Robots-Tag, canonical, redirect chains and status errors, with the reason attached.
Native macOS · Swift · Local firstThe SEO crawler that tells you what to fix first
Spider SEO crawls your site from your Mac, checks every URL the way Googlebot reads it and — with Pro — cross-checks it with Search Console, Analytics and PageSpeed. You get a list of fixes in order, not another spreadsheet.
- Your crawls stay on your Mac: no account, no cloud
- Issues ranked by priority, with the affected URLs and an explanation
- Free up to 500 URLs per audit; Pro when you need more
- 500
- URLs per audit, free and with no time limit
- 9 ms
- to count 150,000 crawled URLs in the results table
- 16
- AI clients the MCP server is set up for from Settings
- 0
- bytes of your crawl sent to us
Coming soon to the Mac App Store
Be the first to crawl with Spider SEO
Spider SEO is in the last stretch before the Mac App Store. Leave your email and we will write to you once, on launch day.
The problem
You have the data. Getting from it to the fix is the slow part.
Export the crawl, export Search Console, export Analytics, match the URLs in a spreadsheet — and only then start deciding what to fix. The data exists; the road to it is what wears you out.
Spider SEO puts it in one window: every URL with its status, indexability, titles, headings and structured data, and with Pro its clicks, impressions, sessions and Core Web Vitals beside it. The filters answer the real questions: which indexable pages nobody sees, which pages get traffic but cannot be indexed, which titles are one rewrite from page one.
How it works
From a URL to a list of fixes, in four steps
- 01
Paste a URL and press Start
Spider mode follows every link; List mode checks the URLs you paste. Threads, depth and limits are yours to set, and robots.txt is respected by default.
- 02
It reads each page the way Google does
Titles, canonicals, directives, hreflang, headings, images, links and structured data on every URL. With Pro, WebKit renders the JavaScript first, so you see what Googlebot sees.
- 03
It cross-checks with your own data
With Pro, connect Search Console, Analytics and PageSpeed once and their numbers land next to every URL, fetched straight from your Mac to Google.
- 04
You get what to fix, in order
The Issues panel ranks problems by priority with the URLs behind each one. Export them to CSV (Excel with Pro), or let an AI agent read them through MCP.
Everything an audit needs, in one native app
One engine runs the crawl, renders JavaScript, explains indexability and validates structured data — from the window, the terminal or an agent.
CLI, scheduler and MCP server Free · scheduling in Pro
Run crawls from the terminal or CI, schedule recurring audits, and drive the same engine from an agent over the bundled MCP server.
Multi-threaded crawl with resume
SQLite-backed state lets an interrupted crawl continue where it stopped. robots.txt uses longest-match with wildcards and crawl-delay, and URLs are normalised before they are queued.
JavaScript rendering
Optional off-screen WebKit rendering with DOM and network quiescence detection, a deadline per URL, and 1920×1080 screenshots. Compare raw HTML against the rendered DOM as Googlebot sees it.
On-page and content analysis
Titles, metadata, headings, links, images, hreflang, canonical, word count, readability, language, plus custom extraction with CSS, XPath 1.0 or regex per URL.
Structured data and accessibility
JSON-LD and microdata are validated property by property against the Google rich-result requirements, and accessibility is audited with axe-core.
It reads every page so you do not have to
The spider walks every link and looks closely at each URL — titles, canonicals, directives, headings, structured data — then lists what is broken, where, and what to fix first.
Privacy by design
Powerful on your Mac, quiet everywhere else
The difference from a cloud crawler is where your data lives. The difference from a careless one is how it treats the sites it visits.
Stays on your Mac
- Every crawl, page and screenshot, in a database inside your user account
- Google sign-in tokens, in the macOS Keychain
- Exports, wherever you save them
- The crawl speed, threads and user agent you choose
Leaves it only when you choose
- Requests to Google, if you connect Search Console, Analytics or PageSpeed (Pro)
- A bug report, if you send one — never automatically
- Ordinary HTTP requests to the sites you crawl, which their owners see in their logs
Who it is for
Built for the people who fix sites
SEO consultants and agencies
Crawl a client's site in the morning, line it up with their Search Console and hand over a prioritised list by lunch. With Pro, compare it with last month's crawl to show what got fixed.
In-house marketing teams
Find the indexable pages nobody sees, the titles one rewrite away from page one and the redirects wasting crawl budget — without waiting for a developer to run a script.
Developers
Run spider-cli in CI before a release, or let Claude, Cursor or VS Code drive the crawler through MCP to check what a change broke.
Free or Pro. That is the only decision.
The same choice the app shows you: start free, and upgrade inside the app when you reach the cap.
Free
0 €
500 URLs per audit. No account, no card, nothing to cancel.
Included
- The whole crawler and SEO audit, up to 500 URLs per audit
- Structured data, Rich Results and accessibility checks
- Site audit: robots.txt, sitemaps, llms.txt
- CSV export, CLI and MCP server
Pro
Annual saves 21 %Upgrade to Pro
- No limit on URLs per audit
- JavaScript rendering, as Googlebot sees the page
- Custom extraction with CSS, XPath and regex
- Search Console, Analytics and PageSpeed data in the crawl
- Compare crawls and schedule them
- Excel export
Yearly179 €/year
Save 21 % vs. monthly
Monthly19 €/month
228 € if you keep it for a whole year.
Payment is charged to your Apple ID (card, Apple Pay or PayPal). The subscription renews automatically at the same price unless cancelled at least 24 hours before the period ends. Manage or cancel it in your App Store account.
What each plan includes
The same table the app shows in Settings › Spider SEO Pro. Everything not marked Pro works in Free, with no time limit.
| Feature | Free | Pro |
|---|---|---|
| URLs per audit | 500 | Unlimited |
| Crawl and SEO audit: indexability, titles, canonicals, directives, hreflang, H1–H6, images, links, issues | ✓ | ✓ |
| Structured data, Rich Results and accessibility checks | ✓ | ✓ |
| Site audit: robots.txt, sitemaps, llms.txt, AI crawler access | ✓ | ✓ |
| CSV export | ✓ | ✓ |
| Command line (spider-cli) and MCP server | Up to 500 URLs | ✓ |
| JavaScript rendering, as Googlebot sees the page | — | ✓ |
| Custom extraction with CSS, XPath and regex | — | ✓ |
| Search Console, Analytics and PageSpeed data in the crawl | — | ✓ |
| Compare two crawls | — | ✓ |
| Scheduled crawls | — | ✓ |
| Excel export | — | ✓ |
- You buy Pro inside the app and manage it there: the purchase goes through the Mac App Store with your Apple ID, so there is no web checkout and no account of ours.
- The amounts above are the reference euros. The App Store charges in the currency of your storefront and shows the exact price before you confirm.
- Editions, refunds and what happens to your crawls when Pro lapses are set out in the Terms.
Frequently asked questions
Is Spider SEO free?
Yes. The Free edition is the full crawler with a limit of 500 URLs per audit. It needs no account and no card, and it does not expire.
What does Pro add?
No limit on URLs per audit, JavaScript rendering, custom extraction, Search Console, Analytics and PageSpeed data in the crawl, comparing and scheduling crawls, and Excel export. Everything else — the crawler, the SEO audit, the site audit, CSV export, the CLI and the MCP server — is in Free. Pro costs 19 € a month or 179 € a year.
How do I cancel Pro or ask for a refund?
Pro is an App Store subscription, so Apple handles both. Cancel in your Apple ID subscriptions (in the app: Settings › Manage Subscription…) at least 24 hours before renewal; Pro stays on until the paid period ends. Refunds are requested from Apple at reportaproblem.apple.com.
Does my crawl data leave my Mac?
No. Crawls, screenshots, reports and exports are stored on your Mac. There is no account, no telemetry and no cloud copy. Google data you connect travels straight between your Mac and Google.
Which Macs does it run on?
Any Mac with macOS 13 Ventura or later. How far a Pro crawl can go depends on your RAM and disk, not on a quota of ours.
Does it respect robots.txt?
Yes, by default. It reads robots.txt with longest-match rules, wildcards and crawl-delay, and the Bot Simulator shows how Googlebot, Bingbot and AI crawlers are treated.
Can I use it from the terminal or an AI agent?
Yes. The app bundles spider-cli for scripts and CI and spider-mcp, an MCP server that lets an agent such as Claude run crawls and read the results.
Find out what is holding your site back
Spider SEO is coming to the Mac App Store. Free up to 500 URLs per audit, Pro when you need more.