Shouldn't this be chai's assert? Also, does this really work? Can you manually test that a failing test really fails. The reason why I think it might not work is that loadAsScript is async so we need to tell chai that we are done somewhere.