Revert "drivers/Makefile: add exFat support"

This reverts commit 89fec80f57a6ed23874f785069ed4a049cdda573.