39.gif

Search (advanced search)
Use this Search form before posting, asking or make a new thread.
Tips: Use Quotation mark to search words (eg. "How To Make Money Online")

07-02-2015, 08:48 PM
Post: #1
How To Prevent My Private Proxies From Dying When Scraping With Scrapebox?
I'm relatively new to using Scrapebox, and lately I've been trying to do some rather large keyword scraping with it. I've purchased 22 private proxies, and I have Scrapebox set to use them when scraping for keywords. I'm doing some pretty heavy keyword scraping (appending all the letters of the alphabet and numbers to my seed keywords, and scraping 4 levels deep). A couple days ago my proxies seemingly all just "died" on me and stopped working, all I was getting from them were timeout errors. I contacted the proxy provider about getting some new ones, but in the meantime, a couple days later they started working again - for now. Is there an ideal number of connections I should have set in Scrapebox to avoid killing my proxies? By default it's set to 50, so I lowered it down to 25. But should I go even lower? Are there some other settings I should be adjusting down as well?
07-04-2015, 03:11 PM
Post: #2
RE: How To Prevent My Private Proxies From Dying When Scraping With Scrapebox?
you're not going to like this, but the ideal connections for scraping google with 22 private proxies is 1.

with 50 proxies it's 3

with 100 it's 7

I know I'm new here... but trust me, I know what I'm talking about... been doing SEO and IM professionally for over 5 years now.

Google temp bans any ip for scraping activity in a heartbeat.

Your best bet these days is to upgrade to the 64bit Scrapebox V2 beta, and use Deeper Web search engine (which is a cache of most google search results) and Bing, set in the custom harvester section. You'll get 80-90% of google results without burning through your proxies and can set your connections at 200.

Try it.... it's like night and day to what you're attempting to do right now.

Thanks.
07-05-2015, 03:01 PM
Post: #3
RE: How To Prevent My Private Proxies From Dying When Scraping With Scrapebox?
Thank you for your help! I am actually running the 64 bit v2 (though I also have the older version installed as well).

Just to clarify, I can only use Deeper Web for harvesting, not keyword scraping?




84.gif