Clean up application configurations