\n \n
Sticky sessions keep your Google IP warm. Get 750 MB of traffic for $3.50<\/strong><\/p>\n<\/div>\n <\/div>\n \n \n \u5f00\u59cb\u8bd5\u7528 <\/a>\n <\/div>\n<\/div>\n\n\nUseful CLI options<\/h3>\n\n\n\n –pages N<\/u><\/em> scrapes N result pages per query.<\/p>\n\n\n\n –hl<\/u><\/em> \u548c –gl<\/u><\/em> set the language and country of the results.<\/p>\n\n\n\n –workers N<\/u><\/em> searches on N proxy IPs at once, one browser each.<\/p>\n\n\n\n –format csv<\/u><\/em> writes the organic results as a table.<\/p>\n\n\n\n –price-per-gb<\/u><\/em> adds the cost per 1,000 pages to the run summary.<\/p>\n\n\n\n –save-html<\/u><\/em> DIR keeps every page’s HTML for debugging.<\/p>\n\n\n\nScrape Google search results from Python<\/h2>\n\n\n\n SERP Maven also works as a Python library. This is the basic pattern:<\/p>\n\n\n<\/rect><\/path><\/svg><\/polyline><\/svg><\/button><\/span><\/code><\/pre><\/figure>\n\n\nEach item the scraper yields is one results page. A failed query is a record too, with an \u9519\u8bef<\/u><\/em> field. So you can log failures instead of losing them.<\/p>\n\n\n\nBuild a simple rank checker with CSV export<\/h3>\n\n\n\n This script checks where your domain ranks for a list of keywords. It also saves every result URL to a CSV file, so you can scrape URLs from Google search results in the same pass.<\/p>\n\n\n<\/rect><\/path><\/svg><\/polyline><\/svg><\/button><\/span><\/code><\/pre><\/figure>\n\n\nSchedule it once a day with cron or GitHub Actions. After a month you have a ranking history for your keywords.<\/p>\n\n\n\nWhat’s in the JSON output<\/h2>\n\n\n\n SERP Maven returns one JSON object per results page. The field names match the ones common to SERP APIs, so code written for a paid API often needs only small changes.<\/p>\n\n\n<\/rect><\/path><\/svg><\/polyline><\/svg><\/button><\/span><\/code><\/pre><\/figure>\n\n\nHere is every field you can work with:<\/p>\n\n\n\n
\norganic_results<\/strong> has the position, title, link and snippet of each result.<\/li>\n\n\n\nads<\/strong> holds the sponsored results when Google shows them.<\/li>\n\n\n\nrelated_questions<\/strong> lists the People also ask questions.<\/li>\n\n\n\nrelated_searches<\/strong> and pagination cover the bottom of the page.<\/li>\n\n\n\nai_overview<\/strong> holds the text of Google’s AI Overview on English pages (–hl en, the default).<\/li>\n\n\n\nlocal_results<\/strong> lists the map pack places on local queries, with name, rating, reviews, type, address, phone and opening hours.<\/li>\n\n\n\nexit<\/strong> shows which proxy IP answered and how many bytes the page cost.<\/li>\n\n\n\nsearch_metadata<\/strong> shows the page verdict, whether the page came over HTTP or the browser, and per-step timings.<\/li>\n<\/ul>\n\n\n\nThis makes SERP Maven a practical Google AI Overview scraper and a way to scrape Google local results without extra parsing. Knowledge panels, Shopping and Images are not parsed today.<\/p>\n\n\n\n
How SERP Maven avoids getting blocked<\/h2>\n\n\n\n Most guides say “use proxies and add delays”. That is not enough for Google in 2026. SERP Maven runs five steps for every proxy IP.<\/p>\n\n\n\n
\nNew identity<\/strong>. It opens a sticky proxy session and a fresh browser profile.<\/li>\n\n\n\nWarm-up<\/strong>. The first proxy IP visits a few ordinary pages and stays on each for 20 to 45 seconds. Later IPs start from the Google cookies of an IP that was already served.<\/li>\n\n\n\n\u641c\u7d22<\/strong>. The first query goes through the browser. Once Google serves it, the next pages come over HTTPS with the browser’s cookies. If that stops working, the browser takes over again.<\/li>\n\n\n\nCheck before parsing<\/strong>. A captcha or block is reported as one. It is never parsed as an empty result.<\/li>\n\n\n\nKeep or drop<\/strong>. An IP Google serves is reused for up to 300 queries. One it refuses is dropped and the query is retried on a new one. If IP after IP is refused, the run stops instead of burning traffic.<\/li>\n<\/ul>\n\n\n\nPoisoned results protection<\/h3>\n\n\n\n This is the failure most scrapers never notice. Google does not always block a bot. Sometimes it serves a normal results page for a different query. There is no captcha and no error, just wrong data in your pipeline.<\/p>\n\n\n\n
SERP Maven compares each page with the query it asked. When a proxy IP starts returning unrelated results, it is dropped within a few pages and the query runs again on a fresh IP. The check runs on the page already downloaded, so it costs no extra traffic.<\/p>\n\n\n\n
Real result links<\/h3>\n\n\n\n Google wraps result links in encrypted \/goto<\/u><\/em> redirects. SERP Maven resolves each one with a small request on the same proxy IP, in the background while the next query runs. You get the real URLs, not Google redirects.<\/p>\n\n\n
![\"\"](\"https:\/\/nodemaven.com\/wp-content\/uploads\/2026\/02\/icon-4.svg\"){kind=icon}
<\/div>\n \n