record logs and process data