BPSC exams are about concepts and not about the language. You only have to show your knowledge in the exam, which can be done in both Hindi or English.