| Search (advanced search) | ||||
Use this Search form before posting, asking or make a new thread.
|
|
02-09-2015, 07:52 AM
Post: #1
|
|||
|
|||
|
External Link Spidering
....so I'm crawling pages searching for external links. Mostly to file sharing websites. I'm coming across one that is more and more common now:
wcrypt.com They load the file sharing sites URL within a frame. Currently, I right click the page to view frame source, but that's manual and takes forever when you have 10,000 links to follow. Any idea of a way to automate this a bit faster? Thanks so very much! Alex A. |
|||
|
02-09-2015, 11:18 AM
Post: #2
|
|||
|
|||
|
RE:
Example link: http://wcrypt.com/1xmtGdCL
|
|||
|
02-09-2015, 02:50 PM
Post: #3
|
|||
|
|||
|
RE:
You need to write code to get url in the frame and you can get the frame source url code
|
|||
|
02-10-2015, 07:21 AM
Post: #4
|
|||
|
|||
|
RE:
That's why I use Screaming Frog SEO spider for it. I'm not really a programmer. :) I was hoping there was a way within that program, or an alternative......
|
|||
