BatchServing encapsulates client and server work to perform batched requests.
Creates a batch of tensors (and containers).