How to Scrape Google Search Results Quickly, Easily and for Free

69 ratings | 21248 views


How to Scrape Google Search Results Quickly, Easily and for Free

More here: *UPDATE - Set your search results to 100 results instead of the default 20. This makes it WAY FASTER. Big thanks to The 5 Dollar Website for letting me know. In this video I cover how to scrape Google search results in a totally safe, non-black hat way. This uses the Google chrome extension called Linkclump and it's totally free. Scraping Google search results doesn't work well with automated web crawlers. If you're not using a proxy to mask your IP, you'll get yourself banned from Google pretty quickly. For that reason I don't mess around trying to scrape Google that way. This method of scraping Google pulls page titles and links. From there you can go on to process that data in interesting ways. I was able to pull 1,000 links in about 5 minutes sitting on my couch, watching TV. That's about 40 links every 5 seconds.

Comments to the video: How to Scrape Google Search Results Quickly, Easily and for Free

Zuber Shaikh 1 month ago
thanks buddy
Michael McGetrick 4 months ago
This is great. Thanks for taking the time to share.
GainTap 4 months ago
Hey thanks Michael! Glad you found this helpful
Kenny McDonald47 9 months ago
Dude THANK YOU. This what I've been looking for. you should change the title to. how to extract the titles in google search. cuz thats what I was looking for
martinfitzgerald1 9 months ago
This is amazing Man. I’ve been busting my behind doing literate searches for my PhD and wasting so much time. You have saved me MONTHS of time. Respect.
S D 1 year ago
can you get the email as well?
internettenparakazan.tv 1 year ago
cool video bitchass. thanks
Carlos Tiscar 2 years ago
Hey! Nice video. Thanks for uploading it. I have a few tricks that will improve your method: 1st: Install Autopagerize 2nd: Install iMacros 3rd: Record a New Macros and stopped recording it. 4th: Edit the Macros and delete everything in it. 5th: Add this line to your iMacros url goto=javascript:window.scrollBy(0,20000) 6th: Save the Macros with a name that you will recognize, such as: Scroll Down 7th: Restart your Chrome Web Browser 8th: Search on Google the way you did it at your video 9th: Click at the Settings buttom 10th: Click on Don't show Google Instant results 11th: Move the Results per page to 100 and click save 12th: Open iMacros and execute Scroll Down Macros with a Loop of 100 times 13th: Use LinkClump to collect all the names and links at only one time! 14th: Paste them to your spreadsheet! I hope you like my way, if you want me to record a video doing this, let me know and I will upload it soon! By the way, is there a way to collect emails from Google Search Results using LinkClump? Cheers, CT
Carlos Tiscar 1 year ago
Ok, I will record a video doing it and share with you once I've got it ready :-)
Pilot Data Productions 1 year ago
I do. Would you please show this? I would like to scrape results from Google Scholar and this sounds like a good way to do it when there are like 8000+ citations. :-(
Zes 2 years ago
not about coox, wrg
Echo Chamber Infiltrator 2 years ago
add &num=100 to the string after the keyword. in the results drag over the first link then press END key. or just get scrapebox + proxies. 100x easier lol.
French Fry 3 years ago
yes there is a better one: ninjaseotools com/google-url-scraper.php, but it gets only the first 100. did you found something better in meantime?
French Fry 3 years ago
yes there is a better one: , but it gets only the first 100. did you found something better in meantime?
GainTap 3 years ago
+The 5 Dollar Website dude you are 100% correct, I'm going to update the video with a comment, great find!
French Fry 3 years ago
+GainTap i installed your recommended extension now. set google search results to 100, thats way faster. btw, check /watch?v=nOne2TCDTXc
GainTap 3 years ago
+The 5 Dollar Website yeah I tried that to but you've got to be good at x-paths (I think that's what it is) so it can be kind of a steep learning curve. The scraper worked for pulling links off a page, but I couldn't really get it to do a full web crawl.
French Fry 3 years ago
jep thats lame. i try now the scraper from google chrome. hope it works well.
GainTap 3 years ago
+The 5 Dollar Website I used that one but it won't help if you're trying to pull duplicate links that Google hides. I haven't found a crawler that can do that yet. The 100 link limit is also pretty lame, considering you can manually copy 100 links in about as much time as it takes to fill the proxy info out, hit Go and download the links.