A scalable, fast, ACID-compliant Data Catalog powered by Ray.
Project description
DeltaCAT
DeltaCAT is a Pythonic Data Catalog powered by Ray.
Its data storage model allows you to define and manage fast, scalable, ACID-compliant data catalogs through git-like stage/commit APIs, and has been used to successfully host exabyte-scale enterprise data lakes.
DeltaCAT uses the Ray distributed compute framework together with Apache Arrow for common table management tasks, including petabyte-scale change-data-capture, data consistency checks, and table repair.
Getting Started
Install
pip install deltacat
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
deltacat-0.1.18b9.tar.gz
(113.4 kB
view hashes)
Built Distribution
deltacat-0.1.18b9-py3-none-any.whl
(172.7 kB
view hashes)
Close
Hashes for deltacat-0.1.18b9-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | f4690e0f96799d67e1e1c0226901ae1f55a7996a4faa8adb17334a6e8f250e58 |
|
MD5 | e4f0f427e0eed9be20c092fcb61379af |
|
BLAKE2b-256 | e34592f018503ff9dc56d634bd44518a5c24aa09f9463e6e7f6966ee96c14575 |