Crawler struggled on our large site
Our shop has about 400,000 URLs and the crawler stalled repeatedly and timed out. Support suggested splitting the crawl, which took days of extra work. For small sites it is fine, but not for us.
Report this review