Fix #83

Also avoid directly calling BLAS where we can avoid it. cc @andreasnoackjensen