A vehicle control device comprising: a driving source applying positive/negative driving force to a vehicle; a braking mechanism provided separately from the driving source to generate a braking force on the vehicle; and an acceleration/deceleration control unit that controls the driving source or/and braking mechanism based on a target speed or a target acceleration to control an acceleration of the vehicle, wherein the acceleration/deceleration control unit is configured such that, in an automatic driving mode in which the vehicle is automatically driven regardless of an operation of a driver, after the automatic driving mode is temporarily stopped by a predetermined operation of the driver and switched to a normal driving mode in which the vehicle is driven according to an operation of the driver, when the normal driving mode returns to the automatic driving mode, specific control set based on a driving state of the vehicle in the normal driving mode before the returning is executed in the automatic driving mode after the returning, wherein the acceleration/deceleration control unit includes a vehicle acceleration estimation unit that estimates an acceleration of the vehicle in the automatic driving mode after the returning based on a driving state of the vehicle in the normal driving mode before the returning, and, in the specific control, until a differential acceleration, which is a deviation between the vehicle acceleration estimated by the vehicle acceleration estimation unit and the target acceleration, becomes equal to or less than a determination threshold value after a time point of the returning, feedback control related to the speed or acceleration of the vehicle is prohibited, and wherein the acceleration/deceleration control unit includes: a driving source control unit controlling driving force of the driving source based on a target driving force; and a reference target driving force calculation unit calculating reference target driving force serving as a reference of the target driving force based on at least one of the target speed and the target acceleration, and wherein the acceleration/deceleration control unit is characterized by being configured such that the specific control sets the reference target driving force to zero at the time point of returning and changes the target driving force at a predetermined change rate to the reference target driving force while the feedback control is being prohibited. a driving source applying positive/negative driving force to a vehicle; a braking mechanism provided separately from the driving source to generate a braking force on the vehicle; and an acceleration/deceleration control unit that controls the driving source or/and braking mechanism based on a target speed or a target acceleration to control an acceleration of the vehicle, wherein the acceleration/deceleration control unit is configured such that, in an automatic driving mode in which the vehicle is automatically driven regardless of an operation of a driver, after the automatic driving mode is temporarily stopped by a predetermined operation of the driver and switched to a normal driving mode in which the vehicle is driven according to an operation of the driver, when the normal driving mode returns to the automatic driving mode, specific control set based on a driving state of the vehicle in the normal driving mode before the returning is executed in the automatic driving mode after the returning, wherein the acceleration/deceleration control unit includes a vehicle acceleration estimation unit that estimates an acceleration of the vehicle in the automatic driving mode after the returning based on a driving state of the vehicle in the normal driving mode before the returning, and, in the specific control, until a differential acceleration, which is a deviation between the vehicle acceleration estimated by the vehicle acceleration estimation unit and the target acceleration, becomes equal to or less than a determination threshold value after a time point of the returning, feedback control related to the speed or acceleration of the vehicle is prohibited, and wherein the acceleration/deceleration control unit includes: a driving source control unit controlling driving force of the driving source based on a target driving force; and a reference target driving force calculation unit calculating reference target driving force serving as a reference of the target driving force based on at least one of the target speed and the target acceleration, and wherein the acceleration/deceleration control unit is characterized by being configured such that the specific control sets the reference target driving force to zero at the time point of returning and changes the target driving force at a predetermined change rate to the reference target driving force while the feedback control is being prohibited.