Merge pull request #5 from rajbot/master

Allow whitespace in WARC response mime type
add proprietary 'P' flag in 'M' field for password-protected captures
add a test for 'P' flag
Merge pull request #6 from kngenie/protected-flag

add 'P' flag to 'M' field for password-protected captures
FIX: WARC-Simple-Form-Province-Status is ignored if HTML does not have
META ROBOTS tag.