test: Improve test portability

Can't run on CI if everything is tied to my workstation