When bacteria are added to milk, they go to work converting natural sugars in the milk (lactose) into lactic acid. That lactic acid is part of what gives cheese its distinctive tang. Other bacteria contribute to the formation of complex flavor proteins.