You certainly can. APK files (Android PacKage) are the "box" in which your software is packaged. You can "throw out the box" once installed (delete the APK). It can save space if it's also quite large.