[Help] Website Scraper Question

[Xecution]

Greetings,

I am wondering if there is a website scraper or some sort of tool that copy the data or even just the email addresses from a website that has the URL structure as follows:

http://www.website.com/users/profile/41
http://www.website.com/users/profile/42
http://www.website.com/users/profile/43

However, there are over 15,000 individual pages that are identical with different information for each profile page that I would like to copy in one swoop, rather than page by page.

Thanks.

[jethroucc]

Kimono Desktop is totally capable. Use it to make the "template" that will copy the data you need from one of the pages. Use any text itteration software to make out a list of your URL's (.../profile/41, /profile/42 etc), and have it hit every link.

If the sites are truely (or mostly even) like content, the data can be scrapped and isolated thousands of times over as much as you need. If you're having trouble with this or have no idea what I'm talking about, hit me up, i can slap it together for ya real quick with Kimono, and failing that, am willing to take about putting together a custom scraper for you with ubot.