Yeah you put it on a file, say like in downloads.
Then enable the check box fir unknown sources in applications, before you try to install the apk.
I usually have a folder named apk. With all my apps in it fir future use.
Edit, I do have a problem stopping wifi tether. So I just use task manager to close it.