fix meta
remove unwanted log conf
fix log test
function to extract html content from parser element
fix url type check
use response.content in response.body and response.len
add logging for is allowed_urls regex check failed
No of threads in settings
only upload py files in spider
set parser encoding from response object
remove cookie regex from http request class