Yes, use the Recent Apps button or the Settings icon to close all open windows without using any third-party app.