While you're able to change employers and duties while on a work permit that doesn't require an LMIA, you must change to a job that is also LMIA exempt, and you'll need to notify Immigration, Refugee and Citizenship Canada (IRCC) that you've made the change. There are many LMIA-exempt jobs in Canada; you just need to have the right skill or territorial link.