Add "crawl log" feature

[mehaase]

It occurs to me that it would be very helpful to add a log to each crawl. The log would include events like when the crawl was paused/resume, when it fetched robots.txt, when it logged in, etc. This would be useful for the user to troubleshoot crawls that aren't running correctly.