Adjustments for bert.