46.gif

Search (advanced search)
Use this Search form before posting, asking or make a new thread.
Tips: Use Quotation mark to search words (eg. "How To Make Money Online")

06-29-2013, 10:27 AM
Post: #1
[GET] 9Gag Title + Image Scrapper (Public Proxy Support + Random Useragents)
Hey,

Looks like gag sites are going to be the trend again. (Recently saw few threads about it.)

So, I thought I would make a scrapper for you guys. Scribbled it the last hour, tested, and works just fine.

What it does :

> You give it 9Gag post Id as start and stop, it scraps all pictures, and then save them with the 9Gag Post title as filename.
> Public Proxy Support
> Random User agents

Unfortunately, no watermark removal is included since they now place watermark randomly. I will need to get a imagedetection script to see where the watermark is.Well, not going to be a 10 min job.

How to :
> Upload and extract the zip.
> Open userdetails.php and fill in the details.
> Optionally fill in the proxies.
> Open worker.php from your browser. Let the tab be there. It will keep scraping, and save the images in the images folder.

I have tried this before as well, made a scraper+poster to 9gagclone script,which made my VPS HDD filled up pretty soon. (~40 GB)

Any bugs, let me know.

Download :
PHP Code:



07-03-2013, 12:07 AM
Post: #2
RE:
I got to ask after i scrap them what can i use this pictures for ?_?
07-03-2013, 05:17 AM
Post: #3
RE:
file not found
08-23-2013, 03:13 AM
Post: #4
RE:
Really need this...

Bump...




47.gif