Use update_index instead of generate_index when possible
Make workers separate from web app
Merge branch 'update_index'