allow num_tokens to be unspecified, as described in the yaml