You can purchase a Sharps Container, which is a hard plastic container made especially for used syringes and needles, at your local pharmacy.
Call your primary care physician or your local pharmacy to find out what your state or local requirements are for disposing of used syringes and needles.