Reports ....
Text Logs ....
Each time the application crawls a web site it logs the results and also logs any error messages.
-
For each site that is crawled, it creates a logging text file stored where thesitemapper.exe is installed. The text file is named 'logging_x.txt' where x is a numerical value which represents the site id of the site being crawled. The log file consists of each web page that has been found with all the links found on that page. This report is useful when you want to find where a particular page has been referenced from.
The report consists :
* The web page url with the number of characters on the page.
* The list of links found on that page.
* At the end of the report there is a summary which includes the number of web pages. -
For each site that is crawled, it creates an error text file stored where thesitemaapper.exe is installed. The text file is named 'error_x.txt' where x is a numerical value which represents the site id of the site being crawled. The log file will identify errors such as page not found.
-
For each run of the crawler an error.txt file is created, also located in the folder where thesitemapper.exe is installed.
This file lists any general error messages generated by the application which are not applicable to a particular site.
Database logs
Any detected errors are also logged into the database. These may be viewed by clicking on the 'Log listing ...' and 'Log details ...' buttons.
Email reports
If you enter your SMTP details into the Email form, the application will send the logging text file and the error.txt file as attachments. This provides a method to check that the application has run when you are using a scheduler and you will be able to check for errors.
