No, it is not possible to consult your library offline. But you can have offline access to any file you have previously downloaded to your computer.