Fix redundant CSR/ASR driver loading