It’s not good to drive with a damaged speed sensor as it can make the transmission go bad and lead to an expensive repair. There are also safety risks as you won’t be able to shift the transmission properly.