Remove unused and dangerous unsigned_to_memory