If you hear a lot of vibrations, or if the sound is bad, you probably need to rebuild the reproducer. Rebuilding an Edison reproducer for a cylinder phonograph is ususally an easy job. Rebuilding a Diamond Disc reproducer is more difficult. The old diaphragms take effort to remove without damage. It can be done.
Kits are available.
But the old diamond may be in good shape. Rebuilding the Victor Orthophonic is very difficult and few people will touch this one. Many were made of pot metal, and they are gradually falling apart. Rebuilding other heads requires buying generic parts and doing the best you can. Ok, I don't know much about mechanical things.