SiteOne Crawler
A proper desktop crawler with reports and a fix-first queue; no server, no URL tax, no frog.
Technical Profile & Specs
verified 2026-08-11
- Cost
- $0 / forever (Open Source)
- License
- MIT
- Hosting Model
- Local (on your machine)
- Platforms
- desktopclione-click install
- Installation
- Download a prebuilt desktop or CLI binary for Windows, macOS or Linux
- Operational Setup
- None for ordinary crawling; JavaScript rendering needs Chrome or Chromium, or the one-time headless-shell download
- Where Your Data Lives
- Runs locally and writes project results plus HTML, JSON or text reports and exports to the user's disk
- The Catch / Trade-off
- It is a local single-machine crawler with no managed team collaboration, durable cloud history or enterprise operations layer.
Replaces 3 paid apps
up to $41.55/mo ($499/yr) in subscriptions
SiteOne Crawler FAQ
Common questions
Is SiteOne Crawler free and open source?+
SiteOne Crawler is an open-source tool licensed under MIT that runs on local. A proper desktop crawler with reports and a fix-first queue; no server, no URL tax, no frog.
What paid software does SiteOne Crawler replace?+
SiteOne Crawler serves as a free replacement for 3 paid SaaS applications: Lumar, Screaming Frog SEO Spider, Sitebulb, saving up to $41.55/month ($499/year) in subscription bills.
How do you install and set up SiteOne Crawler?+
Installation: Download a prebuilt desktop or CLI binary for Windows, macOS or Linux. Setup notes: None for ordinary crawling; JavaScript rendering needs Chrome or Chromium, or the one-time headless-shell download
What is the catch or trade-off with SiteOne Crawler?+
It is a local single-machine crawler with no managed team collaboration, durable cloud history or enterprise operations layer.