Ensure the rails wrapper binary gets installed and some minor cleanup