CB-7745 Don't fail if plugins/ got deleted. Just recreate it.