Best Blackhat Forum

Full Version: [REQ] Website Scraper
You're currently viewing a stripped down version of our content. View the full version with proper formatting.
Perhaps I am posting this in the wrong category... If so, please move it to the according category (or I will make a new thread in the correct category).

Aaaanywho, I am looking for a certain type of software. To be more precise, I am looking for a tool that will crawl a website and allows me to categorize URLs available on the crawled website.

Why? because I want to harvest external links on a certain website. If I would get these external links, I could make a website around these links. The tool would save me lots of time, because I would have to copy paste the external links on the site if there would not be a tool available.
SEO PowerSuite - Spy Glass
I don't know if this will help. I use it to make a site map then I use the list to scrape for comments.
http://www.check-domains.com/sitemap/index.php
you can try ahrefs.
Reference URL's