WhyLabs was an AI observability platform created at the Allen Institute for Artificial Intelligence (AI2) by Amazon Machine Learning alumni. WhyLabs, Inc. has discontinued operations, and the AI Control Center became an open-source project on January 23, 2025. Hosted SaaS access for existing customers was available until March 9, 2025, so this page now reflects the self-hosted OSS handoff rather than an active managed SaaS.
The platform monitors ML models, LLM applications, and data pipelines, surfacing data drift, quality issues, performance degradation, and bias. Automated alerting across dozens of data vitals comes with out-of-the-box configurations. Purpose-built agents analyze raw data without moving or duplicating it, ensuring privacy and security.
For LLM applications, WhyLabs extracts telemetry from prompts and responses to detect malicious prompts, toxicity, hallucinations, and jailbreak attempts. The system processes 100% of data without sampling, supporting tabular, image, text, and embedding data types across any platform.
The OSS handoff centers on the whylabs-oss platform plus whylogs for privacy-preserving data logging and LangKit for LLM monitoring. The repositories remain public under Apache-2.0, but WhyLabs docs say the AI Control Center OSS project is not accepting community contributions or new feature requests from the former team.
Historical integrations included Azure, SageMaker, MLflow, Apache Spark, Pandas, Kafka, Ray, Airflow, dbt, and Databricks. Teams evaluating the code now should plan for self-hosting, Highcharts licensing where dashboards require it, and their own maintenance path.
