Check the use by date on your condoms. Be sure to buy condoms made to Australian standards-check the outside of the pack. Never leave condoms out in the sun, or near any sharp objects that might damage them, or in the glove box of your car for a prolonged period of time. Don't store your condoms near extreme heat or cold. Don't use ultra-thin condoms as these are designed for vaginal sex.
Anal sex puts more stress on condoms.
Use extra strength condoms for anal sex. This can only be safe when you both know for certain that you're both or both . Discuss with your partner how important it is for you to fuck without condoms. If it's not that important, then keep using them. It's your choice to enjoy unprotected fucking with another person if you both want to.