Yes, the phrase "That being said" can be used in formal contexts to transition between ideas and introduce contrasting or qualifying statements.