Remove unused unsafe blocks, remove #![allow(unused_unsafe)]