vaex.readthedocs.io - What is Vaex? — vaex 4.17.0 documentation

Description: Out-of-Core DataFrames for Python, ML, visualize and explore big tabular data at a billion rows per second 🚀 | Pandas alternative

Example domain paragraphs

Vaex is a python library for lazy Out-of-Core DataFrames (similar to Pandas), to visualize and explore big tabular datasets. It can calculate statistics such as mean, sum, count, standard deviation etc, on an N-dimensional grid up to a billion ( \(10^9\) ) objects/rows per second . Visualization is done using histograms , density plots and 3d volume rendering , allowing interactive exploration of big data. Vaex uses memory mapping, a zero memory copy policy, and lazy computations for best performance (no me

Performance: works with huge tabular data, processes \(\gt 10^9\) rows/second

Lazy / Virtual columns: compute on the fly, without wasting ram

Links to vaex.readthedocs.io (1)