expanded role of templates, changes to crawler options