While fever might be present in some cases of mild UTI infection it is typically associated with moderate to severe infections including kidney involvement.
An infant with unexplained fever needs to be examined by a pediatrician as soon as possible to rule out the possibility of a UTI.