Description: Out-of-Core DataFrames for Python, ML, visualize and explore big tabular data at a billion rows per second 🚀 | Pandas alternative
Vaex is a python library for lazy Out-of-Core DataFrames (similar to Pandas), to visualize and explore big tabular datasets. It can calculate statistics such as mean, sum, count, standard deviation etc, on an N-dimensional grid up to a billion ( \(10^9\) ) objects/rows per second . Visualization is done using histograms , density plots and 3d volume rendering , allowing interactive exploration of big data. Vaex uses memory mapping, a zero memory copy policy, and lazy computations for best performance (no me
Performance: works with huge tabular data, processes \(\gt 10^9\) rows/second
Lazy / Virtual columns: compute on the fly, without wasting ram