I was cache aligning my structs, but not my mallocs