Build kernel from source

Also don`t try to build torch