Your vault will not suffer from fires, raider/deathclaws/molerat/rad roach attacks, or other events while the app is shut down. Events should still queue up for explorers, unless your guys hit the same crazy survival bug that mine did. The safer thing is to recall them.