To permanently delete a file in Linux, select the files you want to delete and press the "Shift + Delete" keys together from the keyboard. Another method is by right-clicking on Trash and clicking on the 'empty trash' option from the drop-down menu, you can permanently delete files and free up storage space for use.