Revert "adjust permission of torch device"

This reverts commit f7deb09e48702380f929e08e2cc9558e2e35fc39.