aicoolies logo
DataHub logo

DataHub

Open-source metadata platform for data discovery

Share
freemiumOpen Source
Visit Website →

DataHub is an open-source metadata platform for data discovery, governance, and observability, originally developed at LinkedIn. It provides a centralized catalog with 80+ integrations for data warehouses, lakes, dashboards, and ML platforms. DataHub offers real-time metadata ingestion, column-level lineage tracking, automated quality checks, and fine-grained access policies. Used by 3,000+ organizations in production. Apache 2.0 licensed with 11.8K+ GitHub stars.

DataHub is a modern metadata platform originally built at LinkedIn to solve the challenge of discovering, understanding, and governing data assets across a sprawling data ecosystem. The platform provides a searchable catalog where engineers and analysts can find datasets, dashboards, ML models, and data pipelines along with their ownership, documentation, quality metrics, and upstream and downstream dependencies. With over 80 pre-built integrations covering Snowflake, BigQuery, Redshift, dbt, Airflow, Spark, Tableau, Looker, and many more, DataHub can ingest metadata from virtually any data tool in a modern stack.

Column-level lineage tracking is one of DataHub's standout capabilities, showing exactly how data flows from source tables through transformations into downstream dashboards and reports. This lineage graph enables impact analysis before making schema changes and root cause analysis when data quality issues surface. DataHub also provides automated data quality assertions, glossary-based governance with fine-grained access policies, and a domain-based organizational model that maps to how teams actually own and consume data.

With nearly 12,000 GitHub stars and Apache 2.0 licensing, DataHub is used in production by over 3,000 organizations ranging from startups to enterprises. The project is maintained by Acryl Data, which also offers a managed cloud version for teams that prefer not to self-host. For data teams struggling with tribal knowledge, broken pipelines, and unclear data ownership, DataHub provides a centralized platform that makes the entire data ecosystem discoverable, observable, and governable.

Pricing

Open-source free, Acryl DataHub Cloud paid

Platforms

Self-hosted (Docker/K8s), Acryl DataHub Cloud

Categories

Tags

Use Cases

Alternatives

Related Tools

Marqo logo

Marqo

Embedding-first search and discovery engine for AI-powered product experiences.

Marqo is an open-source tensor search engine that combines embedding generation and vector search in a single API, removing the need to manage separate embedding pipelines and vector databases. Built for product discovery and multi-modal search, it lets teams index text, images, and structured data together, returning ranked results based on semantic similarity rather than keyword overlap.

freemium
Magika logo

Magika

AI-powered file-type detection at Google scale

Open-source AI-powered file-type detection tool from Google that uses a custom deep-learning model under a few megabytes to identify more than 200 binary and textual content types in milliseconds, even on a single CPU. Magika ships as a CLI, Python package, JavaScript/TypeScript library, and an ONNX model, achieves around 99% accuracy on its test set, and is already used at Google scale across Gmail, Drive, and Safe Browsing as well as by VirusTotal and abuse.ch.

freeOpen Source
Zep logo

Zep

Context engineering platform for AI agents with temporal knowledge graphs

Zep is a context engineering platform that assembles relationship-aware context for AI agents from conversations, business data, documents, and events. It maintains a temporal knowledge graph that automatically extracts entities and relationships, tracking how context evolves over time. Zep delivers formatted context blocks optimized for LLMs with sub-200ms latency, integrating with LangChain, LlamaIndex, AutoGen, and Google ADK through Python, TypeScript, and Go SDKs.

freemium
Hindsight logo

Hindsight

Agent memory system that learns, not just remembers

Hindsight is an agent memory system that enables AI agents to learn from experience rather than just store conversations. It organizes memories into three biomimetic categories: World knowledge for facts, Experiences for agent events, and Mental Models for learned understanding. The system provides retain, recall, and reflect operations backed by a temporal knowledge graph with parallel retrieval strategies including semantic, keyword, graph traversal, and temporal search.

freemiumOpen Source
Hopsworks logo

Hopsworks

AI Lakehouse with Feature Store for real-time ML

Hopsworks is a data-intensive AI platform combining a Python-centric Feature Store with MLOps capabilities for production ML systems. Provides sub-millisecond feature retrieval powered by RonDB, dual offline and online storage for batch and real-time inference, experiment tracking, model registry, and deployment pipelines. Available as managed cloud on AWS, Azure, and GCP, self-hosted on Kubernetes, or serverless platform.

freemiumOpen Source
React Native ExecuTorch logo

React Native ExecuTorch

On-device AI inference for React Native apps

Declarative framework for running AI models on-device in React Native applications, powered by Meta ExecuTorch runtime. Supports LLMs including Llama 3.2, computer vision, OCR, embeddings, and vision-language models on iOS 17+ and Android 13+. Developed by Software Mansion with pre-built optimized models, custom model export support, and privacy-first inference without any cloud dependency for mobile AI development.

open-sourceOpen Source