My birds are literally in view of the skyscrapers of New York City. Even in this most urban of locales, I have to worry about attacks from hawks, falcons, raccoons, and opossums. Keep in mind that these predators are doing what Nature intended them to do. It is up to you to practice proper management so that the lives of your doves will not be at risk. You will also want to minimize the contact between your doves and wild birds and their droppings.
Street pigeons are carriers of hosts of diseases and parasites.
The wire used to construct the outer flights must be small enough to keep out sparrows. The house sparrow may transmit disease, and they will surely break your budget by constantly eating the doves' food. Cats and dogs can be the best friend of the bird keeper. A pet cat can be taught to stay away from the flights and cages. A cat on patrol will eliminate all rodent problems.