An annealed steel material having a composition consisting of, in mass %: 0.28≤C<0.42, 0.01≤Si≤1.50, 0.20≤Mn≤1.20, 4.80≤Cr≤6.00, 0.80≤Mo≤3.20, 0.40≤V≤1.20, and 0.002≤N≤0.080, and optionally, Cu≤1.00, Ni≤1.50, B≤0.0050, W≤5.00, Co≤4.00, Nb≤0.100, Ta≤0.100, Ti≤0.100, Zr≤0.100, Al≤1.50, S≤0.200, Ca≤0.2000, Se≤0.50, Te≤0.100, Bi≤0.50, and Pb≤0.50, with the balance being Fe and unavoidable impurities, wherein the annealed steel material has: a cross-sectional size of a thickness of 200 mm or more and a width of 250 mm or more, wherein the directions of thickness and width mean directions perpendicular to the length direction, wherein of the two perpendicular directions, the smaller extension is defined as thickness and the larger extension is defined as width, and the length direction is the fiber direction, and a hardness of 100 HRB or less; and wherein when a cross-section of the annealed steel material is polished, corroded with an acid to expose metallic structure, and observed with an optical microscope with a magnification of 50 to 200, a diameter of a largest ferritic grain observed in the metallic structure is 120 μm or less in terms of a perfect circle equivalent, wherein the diameter of the largest ferritic grain is determined as explained in the description, an area ratio of carbides is 3.0% or more and less than 10.5%, in which the area ratio is obtained by an equation of Area ratio (%)=100×s/A from a total area "s" of carbides present in a cumulative area A of 4, 0 0 0 μm 2 to 5,000 μm 2 of plural visual fields observed in 5,000 magnifications, and an average particle diameter of the carbides is 0.18 μm or more and 0.29 μm or less, in which when an average area C=s/n is calculated from the total area "s" of the carbides present in the cumulative area of 4,000 μm 2 to 5,000 μm 2 of plural visual fields observed in 5,000 magnifications and a total number "n" of the carbides, the average particle diameter of the carbides is a diameter of an assumed perfect circle having an area of C. 0.28≤C<0.42, 0.01≤Si≤1.50, 0.20≤Mn≤1.20, 4.80≤Cr≤6.00, 0.80≤Mo≤3.20, 0.40≤V≤1.20, and 0.002≤N≤0.080, and optionally, Cu≤1.00, Ni≤1.50, B≤0.0050, W≤5.00, Co≤4.00, Nb≤0.100, Ta≤0.100, Ti≤0.100, Zr≤0.100, Al≤1.50, S≤0.200, Ca≤0.2000, Se≤0.50, Te≤0.100, Bi≤0.50, and Pb≤0.50, with the balance being Fe and unavoidable impurities, a cross-sectional size of a thickness of 200 mm or more and a width of 250 mm or more, wherein the directions of thickness and width mean directions perpendicular to the length direction, wherein of the two perpendicular directions, the smaller extension is defined as thickness and the larger extension is defined as width, and the length direction is the fiber direction, and a hardness of 100 HRB or less; and wherein when a cross-section of the annealed steel material is polished, corroded with an acid to expose metallic structure, and observed with an optical microscope with a magnification of 50 to 200, a diameter of a largest ferritic grain observed in the metallic structure is 120 μm or less in terms of a perfect circle equivalent, wherein the diameter of the largest ferritic grain is determined as explained in the description, an area ratio of carbides is 3.0% or more and less than 10.5%, in which the area ratio is obtained by an equation of Area ratio (%)=100×s/A from a total area "s" of carbides present in a cumulative area A of 4, 0 0 0 μm 2 to 5,000 μm 2 of plural visual fields observed in 5,000 magnifications, and an average particle diameter of the carbides is 0.18 μm or more and 0.29 μm or less, in which when an average area C=s/n is calculated from the total area "s" of the carbides present in the cumulative area of 4,000 μm 2 to 5,000 μm 2 of plural visual fields observed in 5,000 magnifications and a total number "n" of the carbides, the average particle diameter of the carbides is a diameter of an assumed perfect circle having an area of C.