Add lowest dependencies to build matrix

Composer now supports this, so we can test agains 5.3.3 with the lowest versions of all packages we depend on.
I'm going to leave this, but if it's merged before your other PR perhaps you can include it in your change?