Yes, baby poop has a lot of germs.
Use gloves when you are cleaning the poop and then wash your hands with a proper disinfectant.