Use librarian gem

Add librarian as a dependency instead of vendor it
And move librarian changes to monkey patches so we can use their latest gem