fix except clause and import twitter
fix types when concatting and fix missing db commit
make db processing its own thing