Load installed plugins at appropriate time and adapt tests accordingly