06-29-2013, 10:27 AM
Hey,
Looks like gag sites are going to be the trend again. (Recently saw few threads about it.)
So, I thought I would make a scrapper for you guys. Scribbled it the last hour, tested, and works just fine.
What it does :
> You give it 9Gag post Id as start and stop, it scraps all pictures, and then save them with the 9Gag Post title as filename.
> Public Proxy Support
> Random User agents
Unfortunately, no watermark removal is included since they now place watermark randomly. I will need to get a imagedetection script to see where the watermark is.Well, not going to be a 10 min job.
How to :
> Upload and extract the zip.
> Open userdetails.php and fill in the details.
> Optionally fill in the proxies.
> Open worker.php from your browser. Let the tab be there. It will keep scraping, and save the images in the images folder.
I have tried this before as well, made a scraper+poster to 9gagclone script,which made my VPS HDD filled up pretty soon. (~40 GB)
Any bugs, let me know.
Download :
PHP Code:
Looks like gag sites are going to be the trend again. (Recently saw few threads about it.)
So, I thought I would make a scrapper for you guys. Scribbled it the last hour, tested, and works just fine.
What it does :
> You give it 9Gag post Id as start and stop, it scraps all pictures, and then save them with the 9Gag Post title as filename.
> Public Proxy Support
> Random User agents
Unfortunately, no watermark removal is included since they now place watermark randomly. I will need to get a imagedetection script to see where the watermark is.Well, not going to be a 10 min job.
How to :
> Upload and extract the zip.
> Open userdetails.php and fill in the details.
> Optionally fill in the proxies.
> Open worker.php from your browser. Let the tab be there. It will keep scraping, and save the images in the images folder.
I have tried this before as well, made a scraper+poster to 9gagclone script,which made my VPS HDD filled up pretty soon. (~40 GB)
Any bugs, let me know.
Download :
PHP Code:
Magic Button :