A pallet transfer system comprising: a transfer device configured to transfer a pallet to which a workpiece is attachable; a pallet storage that is one of pallet transfer destinations by the transfer device and configured to store a plurality of pallets; a work station that is one of the pallet transfer destinations by the transfer device, where a worker can perform work of attaching the workpiece to the pallet transferred from the pallet storage, wherein the work station comprises an operation terminal with a display configured to display a selection screen allowing the worker to provide a selection for permission or refusal; a machine tool that is one of the pallet transfer destinations by the transfer device and configured to machine the workpiece attached to the pallet at the work station; and a control device configured to control the transfer device, wherein the control device is configured to execute: processing for accepting the selection for permission or refusal of interruption of the attaching work to a second pallet when the machining of the workpiece attached to a first pallet is completed in a state where the first pallet of the plurality of pallets is in the machine tool and the second pallet of the plurality of pallets is in the work station; processing for transferring the second pallet from the work station to the pallet storage based on the acceptance of the selection for the permission; processing for transferring the first pallet from the machine tool to the work station after the completion of transfer of the second pallet from the work station to the pallet storage, or in parallel with the transfer of the second pallet from the work station to the pallet storage; and processing for transferring the first pallet from the machine tool to the pallet storage based on the acceptance of the selection for the refusal. a transfer device configured to transfer a pallet to which a workpiece is attachable; a pallet storage that is one of pallet transfer destinations by the transfer device and configured to store a plurality of pallets; a work station that is one of the pallet transfer destinations by the transfer device, where a worker can perform work of attaching the workpiece to the pallet transferred from the pallet storage, wherein the work station comprises an operation terminal with a display configured to display a selection screen allowing the worker to provide a selection for permission or refusal; a machine tool that is one of the pallet transfer destinations by the transfer device and configured to machine the workpiece attached to the pallet at the work station; and a control device configured to control the transfer device, wherein the control device is configured to execute: processing for accepting the selection for permission or refusal of interruption of the attaching work to a second pallet when the machining of the workpiece attached to a first pallet is completed in a state where the first pallet of the plurality of pallets is in the machine tool and the second pallet of the plurality of pallets is in the work station; processing for transferring the second pallet from the work station to the pallet storage based on the acceptance of the selection for the permission; processing for transferring the first pallet from the machine tool to the work station after the completion of transfer of the second pallet from the work station to the pallet storage, or in parallel with the transfer of the second pallet from the work station to the pallet storage; and processing for transferring the first pallet from the machine tool to the pallet storage based on the acceptance of the selection for the refusal. processing for accepting the selection for permission or refusal of interruption of the attaching work to a second pallet when the machining of the workpiece attached to a first pallet is completed in a state where the first pallet of the plurality of pallets is in the machine tool and the second pallet of the plurality of pallets is in the work station; processing for transferring the second pallet from the work station to the pallet storage based on the acceptance of the selection for the permission; processing for transferring the first pallet from the machine tool to the work station after the completion of transfer of the second pallet from the work station to the pallet storage, or in parallel with the transfer of the second pallet from the work station to the pallet storage; and processing for transferring the first pallet from the machine tool to the pallet storage based on the acceptance of the selection for the refusal.