Revert "drivers/Makefile: add exFat support"

This reverts commit 84c42ab2d96fd99694540f12dd4a0ff3f2b3710f.

Change-Id: I43dbaa5b5c0c68475047442d1bb09775a57487a0