Fix broken tests by just using byte arrays

Like it says on the tin