Yes, you should trim stray beard hairs. Doing so regularly is an important part of your beard maintenance routine.