# Distributed
3 tools tagged
showing 3 of 3 tools
Microsoft's distributed approximate nearest neighbor search library and billion-scale vector engine
Microsoft's distributed approximate nearest neighbor search library and online vector serving engine, utilizing space-partition trees and relative neighborhood graphs for billion-scale semantic retrieval.
Disaggregated KV cache storage and transfer for LLM serving
Open-source infrastructure for disaggregated LLM serving that pools KV caches across prefill and decode workers, with high-performance transfer, distributed storage and integrations for vLLM and SGLang.
Cloud-native distributed vector search engine built for Kubernetes with automatic indexing and horizontal scaling.
Vald is a highly scalable distributed approximate nearest neighbor (ANN) vector search engine designed for cloud-native, Kubernetes-based architectures. Maintained by LY Corporation and listed in the CNCF Landscape, it uses the NGT algorithm (developed at Yahoo Japan), supports automatic incremental index backup, and handles billion-scale datasets across loosely coupled microservice components that scale horizontally via Helm.