Screaming Frog

What is Screaming Frog?

Screaming Frog SEO Spider is a website crawler designed for technical SEO audits and website analysis. It can crawl websites and collect information about URLs, links, redirects, page titles, meta descriptions, status codes, and many other SEO-related elements.

You can use Screaming Frog to identify technical issues, analyze website structure, check redirects and broken links, and collect data from websites at scale.

For crawls that require a specific IP location or a separate connection, Screaming Frog includes built-in proxy settings. This allows you to route its HTTP/HTTPS traffic through a proxy server configured in the application.

With Screaming Frog proxies, you can combine detailed SEO crawling with NodeMaven's proxy infrastructure and location targeting.

Step 1

Prepare your NodeMaven proxy

Before opening Screaming Frog, create or select a proxy in your NodeMaven dashboard.

Choose the proxy type and location you want to use, then copy the connection details you'll need during setup.

Step 2

Launch Screaming Frog SEO Spider

Open Screaming Frog SEO Spider on your computer.

You'll start from the standard Spider interface, where you can enter the website you want to crawl.

If you're installing Screaming Frog for the first time, download the appropriate version for your operating system before continuing.

Step 3

Find the proxy configuration

Open the proxy configuration from the application's settings.

On Windows and Linux, go to File → Settings → Proxy. On macOS, the same option is available under Screaming Frog SEO Spider → Settings → Proxy.

Step 4

Turn on proxy routing

Inside the Proxy window, enable Use Proxy Server.

Screaming Frog will then use the proxy configured in this section for its HTTP/HTTPS traffic. The application doesn't provide exceptions for individual requests, so the configured proxy applies to the crawler's traffic as a whole.

Step 5

Add your NodeMaven connection details

Enter the NodeMaven proxy address and port in Screaming Frog.

If your NodeMaven setup uses authentication, enable Use Proxy Credentials and enter the username and password associated with your proxy.

Screaming Frog supports proxy credentials directly in its configuration.

Step 6

Save the configuration and restart

Once all connection details are entered, save the configuration and restart Screaming Frog.

A restart is required for changes to the proxy configuration to take effect.

Step 7

Begin your SEO crawl

After the application restarts, enter the website you want to analyze and launch the crawl.

For a new proxy configuration, starting with a smaller crawl is a simple way to confirm that the connection is working before running a larger audit.

Residential Proxies

Access a broad pool of residential IPs with flexible rotation and sticky sessions. Ideal when your SEO research depends on authentic connections and precise geo-targeting

Recommended for:

Amazon

Facebook

Buy now

Mobile Proxies

Use mobile-network IPs with rotating or sticky sessions for research that benefits from mobile connections and location flexibility

Recommended for:

Amazon

Facebook

Buy now

ISP proxies

Get stable ISP-sourced IPs designed for consistent, long-running connections. Option for recurring crawls where maintaining the same IP matters

Recommended for:

Amazon

Facebook

Buy now

Not sure which proxy type to choose?

Chat with us

A unique antidetect phone solution built for managing mobile accounts at scale

«NodeMaven works closely with Geelark to support reliable mobile multi-account workflows, tested and proven in daily use».

Cloud phones & multi-account platform built for social media management

«The only high-quality proxy provider we’ve chosen to integrate with. Nodemaven provides clean, stable traffic to power our workflows».

A leading antidetect browser trusted by users around the world

«We recommend NodeMaven as the #1 proxy service for multi-accounting.  It integrates closely with Dolphin Anty to ensure smooth setup».

The #1 Anti-detect Browser Trusted By 9M+ Users

«NodeMaven delivers reliable, high-quality proxies that integrate seamlessly with AdsPower. Together, we make multi-account management smoother, more stable, and easier to scale».

An all-in-one antid-etect browser built for secure and scalable multi-account management

«NodeMaven provides stable, high-quality proxies that work smoothly, supporting secure and efficient multi-account workflows».

The world's most trusted multi-account management expert

«BitBrowser partners with NodeMaven to create a robust anti-detect environment. Multi-account advertising and social media management can easily mitigate the risk of account locking. Using the NodeMaven security proxy ensures stability and protects local data privacy. Clean, high-quality, and stable. We recommend NodeMaven».

Anti-detect browser and cloud phone platform for secure multi-account management at scale

«NodeMaven is the proxy provider our users recommend most in our community. It delivers high-quality, stable IPs that matter most for multi-account professionals who need reliability at scale».

Yes. Screaming Frog has built-in proxy settings where you can enter a proxy server address, port, and authentication credentials. This allows you to configure a NodeMaven proxy directly in the application.

On Windows and Linux, open File → Settings → Proxy. On macOS, go to Screaming Frog SEO Spider → Settings → Proxy.

Yes. The Proxy configuration includes an option to use proxy credentials, allowing you to enter a username and password.

Screaming Frog allows one proxy server to be configured at a time. If you need to use another proxy, you need to replace the current configuration.

No. Screaming Frog's native proxy configuration is designed around a single configured proxy server rather than a proxy rotation manager.

Yes. Screaming Frog states that the application must be restarted for proxy configuration changes to take effect.

It depends on your workflow. Residential proxies are good for location-focused research, ISP proxies are suited to workflows where a more consistent IP is useful, and mobile proxies can be considered when mobile-network IPs are specifically relevant.

Yes. A geographically targeted proxy can help you access websites through an IP associated with a particular location, which can be useful when comparing regional versions of websites or researching international markets.