Use a meat thermometer to check for doneness. Insert the thermometer in the thickest part of the drumstick. The internal temperature should read 165°F (74°C). Baked chicken drumsticks have a golden brown color on the outside, crispy chicken skin (if there is any), and opaque, tender meat.