Doubling Query Embedding Throughput with Dynamic Batching in Vespa Cloud
Vespa Cloud now supports dynamic batching of concurrent requests for local embedding models. In our benchmarks, this more than doubles the number of queries embedded per second on…
November 18, 2026