The main difference is that on-premise payroll software is installed in a local network and the company hosts everything in-house. Access to on-prem software is limited.
The cloud software is hosted by a third-party provider and allows you to work with it anywhere and anytime.