There are scientific reasons why the woolly worm is more brown than black. Woolly worms shed their skins six times before turning into an adult. With every successive shed, their fur becomes browner in color. So it's possible that the worm you see is at a further stage to mature into an adult.