Prepare for the exam in a way you do not get distracted by the noise that people usually make while attempting the speaking section. However, if there is too much noise, there are exam invigilators in the exam centre and you can complain to them.