spidr

Web spidering library that can spider a site, multiple domains, certain links or infinitely

Category: Web Application Exploitation
Website: -
Source code: https://github.com/postmodern/spidr
Price: Free