Use $(LIBDIR) to key off $(JL_LIBDIR)

Addresses #5064 

@nalimilan