Yes, you can recover files you have deleted, even from the Recycle Bin. While that’s a comforting notion if you deleted something by mistake, it’s also a reminder that you need to properly dispose of your drives and devices when you replace them, so others don’t access your private data. For that, you need data erasure software.
In essence, deleted files can be recovered because they are only superficially deleted in the beginning.  If you think of a drive as a big pie, your current data may fill a quarter of it. When you delete a file, it disappears from your accessible quarter but lives for a time, like a ghost, within the other three quarters.  As you continue to use the drive more of the pie is used and eventually your old file will be overwritten permanently. This is why it is recommended to try to recover files as soon as possible.