Hummingbirds can be frightened by loud noises and sudden movements, causing hummingbirds to fly away. They are typically drawn to red colors but may be deterred by specific bold colors like yellow.  The presence of predators such as cats, dogs, or aggressive bird species can also make hummingbirds feel uneasy and keep hummingbirds from visiting your garden or feeders.