Using Machine Learning to learn how to Compress
Project description
Try it live at https://shrynk.ai
Usage
Installation:
pip install shrynk
Then in Python:
from shrynk.pandas import save, load
file_path = save(my_df, "mypath")
# e.g. mypath.csv.bz2
loaded_df = load(file_path)
Add your own data
If you want more control you can do the following:
import pandas as pd
from shrynk.pandas import PandasCompressor
df = pd.DataFrame({"a": [1, 2, 3]})
pdc = PandasCompressor("default")
pdc.run_benchmarks([df], save=False) # adds data to the default
pdc.train_model(size=3, write=1, read=1)
pdc.infer(df)
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
shrynk-0.0.9.tar.gz
(1.2 MB
view details)
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file shrynk-0.0.9.tar.gz.
File metadata
- Download URL: shrynk-0.0.9.tar.gz
- Upload date:
- Size: 1.2 MB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/1.11.0 pkginfo/1.4.2 requests/2.18.4 setuptools/39.0.1 requests-toolbelt/0.8.0 tqdm/4.24.0 CPython/3.7.0a0
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
3ce5f45cb523dc069b25262d2093ef82e7d747c69c0c9fb4462fe65e18cbaafe
|
|
| MD5 |
61fd2e10e5eaf09c0b20493b64a25886
|
|
| BLAKE2b-256 |
8f8817e081e36a73db1128236b598a0a6638389c0600ace105c3889d9159dc45
|
File details
Details for the file shrynk-0.0.9-py2.py3-none-any.whl.
File metadata
- Download URL: shrynk-0.0.9-py2.py3-none-any.whl
- Upload date:
- Size: 1.7 MB
- Tags: Python 2, Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/1.11.0 pkginfo/1.4.2 requests/2.18.4 setuptools/39.0.1 requests-toolbelt/0.8.0 tqdm/4.24.0 CPython/3.7.0a0
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
75a59418faffed4c71d633a9785c135ef3059a99a06f0366c86a3f11491bdd83
|
|
| MD5 |
fbe4ba440b1f54aa87c73e27f31d297b
|
|
| BLAKE2b-256 |
73944c49975bf2c09473bd66f9c7eaab4c32a28e8d0ee1bb0726186c68734a23
|