Many phobias develop as a result of having a negative experience or panic attack related to a specific object or situation. Genetics and environment. There may be a link between your own specific phobia and the phobia or anxiety of your parents — this could be due to genetics or learned behavior. Brain function.