Without prejudice conversations should be noted and put in writing. Just because they are often called 'off the record', in the sense that they can't be brought up later as part of legal proceedings, they're not classed as informal communication and should still be recorded.