Change work with fragments. Fragments created as needed. For activity can't recreate fragments setRetainInstance to true.
When main data will be changed (user select another route or stop etc), fragment's loader will be restarted for data update.
Change work with ListView to Adapter with ViewHolder pattern
Make BaseLoader extends AsyncTaskLoader. All used loader extends this loader.
In loader BaseLoader implemented interface Observer for update data in loader after update list.