If your cats are comfortable sharing a litter box, it is fine for you to use the same litter box. However, you must keep it clean.