Implement adding URLs w/content_type=unknown as a hack. Code seems slow and messy and probably wrong.