Does not require plugins dir to exist.