Metasploit also allows us to crawl and scrape the web using auxiliaries. Scraping is useful when we want to grab something from the source code of a website via a defined pattern. It could give us information such as directories mentioned in comments, developer emails, and API calls being made in the background:
- For crawling, we can use the crawl keyword to find the module:
- We will use msfcrawler. Clicking on the module will redirect us to the options page where we define our target, port, and depth. Then, click Run Module:
- A new task will be created and we will see the list of pages found in the ...
