Yes, it is possible that a baby has trouble hearing. Your doctor should check if there is any hearing loss. Hearing loss among children sometimes happens due to genetic reasons or infections. You should assess the condition and discuss the next steps with the paediatrician.