add log_not_found and robots.txt configuration.

Signed-off-by: Bo-Yi Wu <appleboy.tw@gmail.com>