Skip to content
aicoolies logo

# Distributed

3 tools tagged

showing 3 of 3 tools

Microsoft's distributed approximate nearest neighbor search library and billion-scale vector engine

Microsoft's distributed approximate nearest neighbor search library and online vector serving engine, utilizing space-partition trees and relative neighborhood graphs for billion-scale semantic retrieval.

Open Source

Disaggregated KV cache storage and transfer for LLM serving

Open-source infrastructure for disaggregated LLM serving that pools KV caches across prefill and decode workers, with high-performance transfer, distributed storage and integrations for vLLM and SGLang.

Open Source

Cloud-native distributed vector search engine built for Kubernetes with automatic indexing and horizontal scaling.

Vald is a highly scalable distributed approximate nearest neighbor (ANN) vector search engine designed for cloud-native, Kubernetes-based architectures. Maintained by LY Corporation and listed in the CNCF Landscape, it uses the NGT algorithm (developed at Yahoo Japan), supports automatic incremental index backup, and handles billion-scale datasets across loosely coupled microservice components that scale horizontally via Helm.

Open Source