Move reply button to the right position