Implemented a crawler using crawler4j, to generate the statistics of the site crawled. The statistics included figures about the successful and failed request, cross domain redirection and an analysis of the content type of the sites crawled.
nitishksahu/Crawler
Folders and files
| Name | Name | Last commit date | ||
|---|---|---|---|---|