Linux wants the flags to be set before the speed.
This seems to be due to the speed being part of the c_cflag field.
Also now explicitly set the c_cc VMIN and VTIME