Remove slow path for managing bit buffer; various fixes