A document processing apparatus for determining an orientation of the input document, comprising: S) a text line extraction unit configured to extract at least one text line from an input document; T) a language classification unit configured to determine, by performing a graphic feature recognition process, whether or not an optical character recognition process for determining an optical character recognition confidence with respect to each candidate direction for each of at least some of the text lines is necessary for a language of the input document, U) wherein, the language classification unit is further configured to determine that the optical character recognition process is necessary for the language of the input document, in the case that the language of the input document is determined to be Chinese, Japanese, Korean or a language in Latin alphabet, the candidate directions comprise a vertical direction from top to bottom, a vertical direction from bottom to top, a horizontal direction from left to right and a horizontal direction from right to left; V) an optical character recognition unit configured to determine, by performing the optical character recognition process, an optical character recognition confidence with respect to each predetermined candidate direction for each of at least some of the text lines, in the case that it is determined that the optical character recognition process for determining an orientation of a text line is necessary for the language of the input document; W) a graphic feature recognition unit configured to determine, by performing the graphic feature recognition processing, a graphic feature recognition confidence with respect to each candidate direction for each text lines; and X) a determination unit configured to determine, based on at least one of the determined graphic feature recognition confidences and the determined optical character recognition confidences, a combination confidence with respect to each candidate direction for each of the at least some of the text lines, and determine, based on the combination confidences, an orientation of the input document. S) a text line extraction unit configured to extract at least one text line from an input document; T) a language classification unit configured to determine, by performing a graphic feature recognition process, whether or not an optical character recognition process for determining an optical character recognition confidence with respect to each candidate direction for each of at least some of the text lines is necessary for a language of the input document, U) wherein, the language classification unit is further configured to determine that the optical character recognition process is necessary for the language of the input document, in the case that the language of the input document is determined to be Chinese, Japanese, Korean or a language in Latin alphabet, the candidate directions comprise a vertical direction from top to bottom, a vertical direction from bottom to top, a horizontal direction from left to right and a horizontal direction from right to left; V) an optical character recognition unit configured to determine, by performing the optical character recognition process, an optical character recognition confidence with respect to each predetermined candidate direction for each of at least some of the text lines, in the case that it is determined that the optical character recognition process for determining an orientation of a text line is necessary for the language of the input document; W) a graphic feature recognition unit configured to determine, by performing the graphic feature recognition processing, a graphic feature recognition confidence with respect to each candidate direction for each text lines; and X) a determination unit configured to determine, based on at least one of the determined graphic feature recognition confidences and the determined optical character recognition confidences, a combination confidence with respect to each candidate direction for each of the at least some of the text lines, and determine, based on the combination confidences, an orientation of the input document.