Added more crawling flexibility. Fixed slow nHibernate queries.