Databases & ORMs

Enterprise RAG framework by Tencent

WeKnora is a Tencent-developed LLM-powered knowledge management and Q&A framework for enterprise document understanding and semantic retrieval. Supports 10+ document formats including PDF, Word, Excel, and images with seamless IM platform integration for WeCom, Feishu, Slack, and Telegram. Offers Quick Q&A mode using RAG pipelines and Intelligent Reasoning mode with ReACT agents for complex multi-step reasoning tasks across organizational knowledge bases.

Serverless database with search and AI built-in

Serverless database platform that combines Postgres, full-text search, analytics, and AI features in a single service. Built-in vector search for AI applications, branching for safe schema changes, and a spreadsheet-like UI for data exploration. Designed for developers who want powerful database capabilities without managing separate services for search, analytics, and embeddings.

In-process vector database — the SQLite of vector DBs

Zvec is an open-source in-process vector database from Alibaba designed as the SQLite of vector search. It runs as an embedded library directly inside applications without requiring external servers, delivering 8,000+ QPS with high recall rates. Zvec supports dense and sparse embeddings, multi-vector queries, and combined semantic plus structured filtering. Built on Alibaba's proven Proxima engine, it provides a lightweight alternative to server-based vector databases for local AI workflows.

SQL-based data transformation framework

dbt (data build tool) is an open-source SQL transformation framework with 10K+ GitHub stars that lets analytics engineers transform data in their warehouse using select statements. Brings software engineering practices to data — version control, testing, documentation, and CI/CD for SQL. Supports Snowflake, BigQuery, Redshift, Databricks, PostgreSQL, and more. Features Jinja templating, incremental models, snapshots, and a package hub of reusable transformations.

Python library for declarative data loading that LLMs can generate

dlt (data load tool) is a Python library for building data pipelines with declarative, schema-aware loading that is simple enough for LLMs to generate correctly. It extracts data from APIs, databases, and files, normalizes nested structures, handles schema evolution, and loads into warehouses and lakes. Supports 30+ destinations including BigQuery, Snowflake, DuckDB, and PostgreSQL. Over 5,200 GitHub stars.

Header-only C++ implementation of HNSW for fast approximate nearest-neighbor search.

hnswlib is a header-only C++ library implementing the Hierarchical Navigable Small World (HNSW) graph algorithm for approximate nearest-neighbor search, with Python bindings and a tiny dependency footprint. Originally developed by the nmslib team, it has become the default HNSW implementation embedded inside many vector databases and search products. Engineers use it directly when they want HNSW retrieval without pulling in a heavyweight vector DB.

Git-like version control for data lakes and object storage

lakeFS is an open-source platform that brings Git-like branching, committing, and merging to data lakes and object storage. It works on top of S3, GCS, Azure Blob, and MinIO, enabling teams to create isolated data branches for experimentation, run CI/CD for data pipelines, and maintain full data lineage. Acquired DVC in 2025, uniting data version control for both small and enterprise-scale workloads.

PostgreSQL administration tool

The most popular open-source administration and management tool for PostgreSQL, used by millions of DBAs and developers worldwide. Features a powerful SQL query editor with auto-completion, visual query builder (graphical EXPLAIN), server dashboard with real-time monitoring, backup/restore wizards, ERD generator for schema visualization, and user/role management. Runs as a web application accessible via browser. Supports PostgreSQL 12+ and is available on Windows, macOS, Linux, and Docker.

BM25 full-text search extension for PostgreSQL

pg_textsearch is a PostgreSQL extension from Timescale that adds BM25 relevance-ranked full-text search directly inside Postgres. Using the same ranking algorithm as Elasticsearch and Lucene, it provides search-engine quality results without requiring a separate search cluster — particularly valuable for developers building RAG pipelines on PostgreSQL who want semantic-quality ranking alongside pgvector.

Vector search extension for SQLite that runs anywhere

sqlite-vec is a lightweight vector search extension for SQLite written in pure C with zero dependencies. It brings nearest-neighbor search capabilities directly into SQLite databases, enabling AI applications to store and query embeddings without running a separate vector database. The extension works everywhere SQLite runs including Linux, macOS, Windows, WebAssembly in browsers, and even Raspberry Pi devices. Sponsored by Mozilla Builders, Fly.io, and Turso.

CI-friendly database documentation generator

tbls is an open-source database documentation tool that automatically generates schema documentation in Markdown, with built-in linting to enforce documentation standards and coverage metrics for tables and columns. It supports 13+ databases including PostgreSQL, MySQL, BigQuery, Snowflake, MongoDB, and ClickHouse. Designed for CI integration with GitHub Actions support, tbls runs schema diff detection and documentation enforcement as part of automated pipelines.