adjust log level
fix bug in depth adjustment
separate spider class into base class and derived class
add endpoint spider
support crawling repository commits