Always remove SwModelTestBase::m_aTempFile

Change-Id: I3719d1ce64bee055a4a7248361f2d2dccaa75cdc