OpenSRE

Open-source observability and self-healing layer for AI agents

TraceRoot is a YC S25-backed open-source observability platform purpose-built for AI agents and LLM apps. It combines OpenTelemetry-compatible tracing with an agentic debugging runtime that reads your source code, correlates failures with recent commits, and proposes fix PRs automatically. BYOK support spans seven LLM providers; the entire stack runs self-hosted via Docker Compose, with TraceRoot Cloud available for managed deployments.

Reusable KV cache infrastructure for scalable LLM inference

Open-source KV cache management layer that persists, offloads and reuses model key-value caches across requests and serving engines to reduce repeated prefill work and improve inference throughput.

Cloud-native control plane for scalable GenAI inference

Open-source Kubernetes-native building blocks for deploying, routing and scaling GenAI inference, including an LLM gateway, autoscaling, LoRA management and KV-cache offloading.

Open-source natural-language browser automation framework for AI agents

An AGPL-3.0 TypeScript framework that drives a real browser from natural-language tasks — the self-hostable OSS framework from Hyperbrowser, distinct from the vendor's paid cloud browser product.

Quantize and compress LLMs for optimized vLLM deployment

Open-source, Hugging Face-compatible library for quantizing and compressing LLMs (W8A8, W4A16, NVFP4/MXFP4, KV-cache and attention quantization, expert pruning) into vLLM-ready `compressed-tensors` checkpoints.

JavaScript framework for building and visualizing multi-agent workflows on a Kanban board

KaibanJS is an MIT-licensed JavaScript framework for defining AI agents, tasks, tools, and teams, then orchestrating their work through a Kanban-inspired runtime and visual board. It can run inside Node.js, React, or Next.js projects, supports custom UIs and headless workflows, and provides real-time task-state visibility for multi-agent applications.

Open-source toolkit for quantizing, deploying, and serving LLMs and vision-language models

LMDeploy is an Apache-2.0 toolkit for self-hosting LLM and vision-language model inference with TurboMind and PyTorch engines. It combines continuous batching, blocked KV cache, tensor parallelism, AWQ and KV-cache quantization with OpenAI-compatible APIs, multi-GPU distribution, offline pipelines, and production metrics.