Yes, you can. On your desktop or in the Finder, select the item you want to delete and then hold down the Option key on your keyboard, then click File > Delete Immediately in the menu bar. Alternatively, select the item and press Option+Command+Delete on your keyboard, then click the Delete button when a warning message says: This item will be deleted immediately. You can't undo this action.