Format agnostic crawler