Make Screaming Frog Sing By Integrating Proxies

For the best crawling experience, proxies are a must. Configure your Screaming Frog SEO Spider to route its connection through a proxy server by following the steps below. And if you’re ever lost, contact our 24/7 support team via LiveChat!

Getting Smartproxy proxies

You can integrate any kind of proxy with Screaming Frog SEO Spider. The best type depends on your use case. We recommend residential proxies because they’re so versatile, but you can opt for datacenter, mobile, ISP, or other proxies.

1. Create a Smartproxy account on our dashboard.
2. After that, find residential proxies by choosing Residential under the Residential Proxies column on the left panel, and purchase the plan that best suits your needs.
3. Once equipped with a residential proxy plan, go to the Proxy setup tab, create a user, and copy the authentication credentials for later use: username, password, IP address, and port.

Heading over to the app

1. Download and install the Screaming Frog SEO Spider application.

2. Open the application. You can buy a license or enter your license key by choosing Buy Licence or Enter Licence from the Licence menu at the top. Alternatively, you can use the free version, but it has certain limitations

3. Next, let’s integrate our proxies. On macOS, navigate to Screaming Frog SEO Spider > Settings > Proxy. On Windows and Linux, it’s File > Settings > Proxy.

4. Mark the checkbox Use Proxy Server and enter the address and port of your proxy server. Then, click OK and Restart.

5. Once the application restarts and you try to crawl a URL at the top of the window, you’ll be prompted to enter the proxy authentication details. Type in your username and password, and click OK.

6. Screaming Frog will now crawl the entered URL using proxies, bypassing any hindrances like blocks or delays!