updates to support sqlite data format