You can have fungal infections in the rectum. Often it occurs because you have used a medicine that contains the adrenal gland hormone, to treat itching for example.