If you want to leave the line then you should just leave; the people behind you will be happy.