Yes, you can permanently delete photos by deleting them and then emptying the Recently Deleted album in the Photos app.