If you do choose to ride in a jacket, you might want to look for one that won't puff to the size of a parasail. They also sound like a luffed sail going down the road. But they stuff nicely into an oversized seat bag or jersey pocket and come in very handy should you find yourself in a situation where your body might be prone to cool down. When it comes to feet, everyone seems to have discovered a combination that works best. A pair of polypro sock liners is a good place to start, providing the same wicking effect as on the upper body.
Some cyclists wear wool or a wool-blend sock.
You need to make sure you don't have so much sock in your shoe that you restrict circulation. A pair of polypro toe covers can help knock off some of the chill. If it's only cold and not wet, full shoe covers can provide a lot of warmth. But in a pinch, plastic produce bags will work fine. And don't forget their distant relative, the large trash bag, which makes a great emergency poncho.