An information processing apparatus which is operated by a user who wears an authentication device, comprising: an operation panel configured to accept an operation performed by the user; and an apparatus control unit configured to control the operation panel, wherein the apparatus control unit comprises: a matching processing unit configured to determine whether or not operation history information and operation information match as information about operation of the same operation panel, wherein the operation history information is time series data of a sequence of operations accepted by the operation panel and wherein the operation information is acquired from the authentication device worn by the user and is about an operation of the operation panel performed by the user authenticated as a permitted user who is permitted to use the information processing apparatus; and an operation acceptance processing unit which has the operation panel accept the operation of the operation panel performed by the user if it is determined by the matching processing unit that the operation history information and the operation information match as information about operation of the same operation panel; wherein the apparatus control unit is configured to detect the authentication device and to acquire identification information of the permitted user from the detected authentication device, and wherein if the identification information of the permitted user acquired from the authentication device corresponds to a user wearing an authentication device which is in an authenticated state, the matching processing unit is configured to perform the matching process, wherein the authentication device is in the authenticated state if biometric information of the user wearing the authentication device is of the same user as biometric information of the permitted user. an operation panel configured to accept an operation performed by the user; and an apparatus control unit configured to control the operation panel, wherein the apparatus control unit comprises: a matching processing unit configured to determine whether or not operation history information and operation information match as information about operation of the same operation panel, wherein the operation history information is time series data of a sequence of operations accepted by the operation panel and wherein the operation information is acquired from the authentication device worn by the user and is about an operation of the operation panel performed by the user authenticated as a permitted user who is permitted to use the information processing apparatus; and an operation acceptance processing unit which has the operation panel accept the operation of the operation panel performed by the user if it is determined by the matching processing unit that the operation history information and the operation information match as information about operation of the same operation panel; wherein a matching processing unit configured to determine whether or not operation history information and operation information match as information about operation of the same operation panel, wherein the operation history information is time series data of a sequence of operations accepted by the operation panel and wherein the operation information is acquired from the authentication device worn by the user and is about an operation of the operation panel performed by the user authenticated as a permitted user who is permitted to use the information processing apparatus; and an operation acceptance processing unit which has the operation panel accept the operation of the operation panel performed by the user if it is determined by the matching processing unit that the operation history information and the operation information match as information about operation of the same operation panel; wherein the apparatus control unit is configured to detect the authentication device and to acquire identification information of the permitted user from the detected authentication device, and wherein if the identification information of the permitted user acquired from the authentication device corresponds to a user wearing an authentication device which is in an authenticated state, the matching processing unit is configured to perform the matching process, wherein the authentication device is in the authenticated state if biometric information of the user wearing the authentication device is of the same user as biometric information of the permitted user.