In order to do that, simply follow the steps below:
Place the APK file in your phone's SDcard or Internal memory (preferably external SDcard).
Browse your phone memory/external memory and tap on the APK file.
Click 'install'
Wait for the APK to install.
Do not run the application yet.