FastHTML

Build and share ML web apps in Python with a few lines of code

Gradio is a 42K+ star Apache-2.0 Python library for building interactive web interfaces around machine-learning functions and apps. It supports 40+ components for text, images, audio, video, 3D, chat, plots, JSON, and dataframes. Apps can be hosted free on Hugging Face Spaces, shared through public links, or extended with server-side rendering, streaming, API clients, and MCP server support.

Production-ready React Suspense and error handling

TypeScript library extending React Suspense API with declarative components and hooks for production applications. Provides ErrorBoundary with selective error catching via shouldCatch, SSR-safe Suspense with clientOnly prop, Delay component preventing loading flashes, ErrorBoundaryGroup for coordinated resets, and data fetching components including SuspenseQuery and SuspenseInfiniteQuery. MIT licensed by Toss with three years of active development.

Editable UI flows from prompts, screenshots and sketches

AI-assisted product-design platform that turns prompts, screenshots and hand-drawn sketches into editable UI flows for non-designers and early product ideation, complementing rather than duplicating developer-first code generators.

Design-system-aware AI prototyping for code-ready product interfaces

Magic Patterns turns product ideas, prompts, screenshots, and existing UI into editable, code-ready interfaces. Its design-system-aware editor supports collaborative iteration, two-way GitHub sync, and an MCP workflow for moving designs between the canvas and coding agents—positioning it between prompt-to-app builders and design-handoff tools rather than as a single-screen generator.

Heterogeneous CPU-GPU inference and SFT for large MoE models

Open-source framework for running and fine-tuning large Mixture-of-Experts models with heterogeneous CPU-GPU execution, optimized kernels, limited VRAM and SGLang or LLaMA-Factory integrations.

Official Kubernetes and Helm reference stack built on the vLLM inference engine

Official vLLM reference implementation for scaling the existing inference engine on Kubernetes with Helm, request routing, KV-cache offload, autoscaling and Prometheus/Grafana observability.

Distributed inference orchestration above vLLM, SGLang and TensorRT-LLM

Open-source, datacenter-scale orchestration layer that coordinates vLLM, SGLang and TensorRT-LLM across nodes with disaggregated serving, KV-aware routing, multi-tier cache management and automatic scaling.

Open-source GPU control plane for scalable AI model serving

Open-source GPU cluster manager that configures vLLM, SGLang, TensorRT-LLM or custom engines, serves models through compatible APIs, and provisions SSH-accessible GPU instances across on-premises, Kubernetes and cloud environments.