On Windows Phone 8.1, at least, the version number has been bumped to 4.3. You can access the OneDrive Recycle Bin from the app by displaying the app bar menu (tap the More app bar button, which looks like an ellipsis, or "...") and then scrolling down to the bottom. You'll see a Recycle Bin option there.