# data-processing

Lightning-fast DataFrame library in Rust

Polars is an extremely fast DataFrame library written in Rust that provides a powerful query engine for data manipulation in Python, Node.js, and R. Built on Apache Arrow columnar format, Polars delivers performance that outpaces Pandas by 10-100x on common operations through parallel execution and SIMD optimizations. It features lazy evaluation with automatic query optimization, streaming for out-of-core processing, and an expressive API for filtering, joining, and aggregating datasets.

Blazing-fast Rust-based CSV Swiss Army knife for the terminal

xan is a fast command-line tool for working with CSV files, built in Rust by the Sciences Po medialab team. It provides over 50 subcommands for filtering, sorting, joining, aggregating, and transforming CSV data directly in the terminal. With 3,900 GitHub stars and near-instant processing of multi-gigabyte files, xan replaces workflows that previously required loading data into Python or spreadsheets.