Assertion: inference | /r/CapableOf | batch smaller number of inputs
Facets:
value: typically
type: DEGREE
Source sentences:
text: To minimize the network’s end-to-end response time, inference typically batches a smaller number of inputs than training, as services relying on inference to work (for example, a cloud-based image-processing pipeline) are required to be as responsive as possible so users do not have to wait several seconds while the system is accumulating images for a large batch.