Refactor the repo

Remove all native swift files
Add tox.ini, README.md and setup.py
We might want/need to keep an AUTHORS file, need to check with others.