Increase priority of IPU memory access