Yes, computing a 3 by 3 determinant by the "formula" is still fine and doing a LU decomposition overkill.
The question is where to switch the methods and when to prefer which one. If we can fix sensible ranges
when these methods will be used, then it is probably ok.