Dont build with optimization
Add lib suffix for arm64
Filter out broken drivers for intel/arm