Clean up avian and add separate neon build