Fixed the compilation issue when using only one underlying floating type and multiple number types. Reduced the compilation time of ssd and vector_fields.