Help & Troubleshooting
If something isn’t working as expected, here are the most common issues and how to solve them:
I did not receive an email with my results.
- Please check your Spam or Junk Mail folder.
- Make sure you entered the correct email address.
- If the email still has not arrived after a few minutes, you can run the process again.
The crawler did not collect all URLs from my website.
- Your website’s structure may be extremely complex, deeply nested, or may contain URL patterns our crawler cannot reach (JavaScript rendering, dynamic loading, hidden links, etc.). Try using the CSV upload instead. This gives full control over which URLs to include.
The domains cannot be accessed.
- The crawler can only scan websites that are publicly reachable. Ensure your website is accessible from the open internet.
- Remove or temporarily disable:
- Basic Authentication
- IP blocking
- VPN-only access
- Firewall restrictions
- Make sure there is no "Coming Soon" page or construction mode blocking access.
What is the correct CSV format?
- Your CSV must contain one URL per line.
- No header is required. Example:
- https://www.old-website.com/page-1
- https://www.old-website.com/page-2
- https://www.old-website.com/category/shoes
- You can download a ready-to-use CSV template here.