don't add middleware into map if it is not bind to annotation