Fast random access to zstd files
Project description
indexed_zstd
This module provides an IndexedZstdFile class, which can be used to seek inside zstd files without having to decompress them first.
It's shamelessy based on indexed_bzip2, which was refactored to support zstd instead of bzip2 using libzstd-seek.
Kudos to the author for its work.
Seeking inside a block is only emulated, so IndexedZstdFile will only speed up seeking when there are more than one block, which sadly requires a bit of care in zstd.
Usage
Example 1
from indexed_zstd import IndexedZstdFile
file = IndexedZstdFile( "example.zst" )
# You can now use it like a normal file
file.seek( 123 )
data = file.read( 100 )
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
indexed_zstd-1.2.2.tar.gz
(60.3 kB
view hashes)
Built Distributions
Close
Hashes for indexed_zstd-1.2.2-cp39-cp39-manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 8ef884c2f3c0c8b642a1b34303464265d07f2b3fbc05b87122c5d9606bb09623 |
|
MD5 | 0ffa8d929249cdbcc6fc9363bccc4103 |
|
BLAKE2b-256 | 1cd47a74e918ea0c310d9b298442297b6c36b7a9a93189b3fc0c54141390f904 |
Close
Hashes for indexed_zstd-1.2.2-cp39-cp39-manylinux2010_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 9f3eb91058e1b47dbfc2cbaa3c949c93f42f17d36cc913a2bae560da8336a2fb |
|
MD5 | a22d5db4fc3d9bf32ffaeaf991150b6f |
|
BLAKE2b-256 | d31cfe8d762052b3816a4657c3305046f6181120ab7b5b8abfbe48198b4cdf50 |
Close
Hashes for indexed_zstd-1.2.2-cp39-cp39-manylinux1_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 8876b62f5e0fbc4b8e554f09bd90f0e5ff084c63f584005e4ef92903fa79dc03 |
|
MD5 | 9de10a3ce945226d4c80c9ff6747ed12 |
|
BLAKE2b-256 | 848ed91d80ccd96035bfcedde138444a00517115265597293d1b90c676bf7ce6 |
Close
Hashes for indexed_zstd-1.2.2-cp38-cp38-manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 03e7d7cb1f740f2158b2f83db82f162f397052d8a5dc7822e0f6f76102879a16 |
|
MD5 | 147fa6b90b3b57f256fb036377d1e880 |
|
BLAKE2b-256 | 8cef275b6f1bcfbb5682f557935cf674b2a91d96add9e3e64a01f6b85242afee |
Close
Hashes for indexed_zstd-1.2.2-cp38-cp38-manylinux2010_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | adff373fd2630653271f17fe00421a1d225bc21ea5843fff5ba6dd37cb1aadfe |
|
MD5 | d014961bd941ca4a2972e59d30307d1a |
|
BLAKE2b-256 | 2471a3fb27e59c20bcdbb4cc55508085686c1134d7fb872d59f717259c464574 |
Close
Hashes for indexed_zstd-1.2.2-cp38-cp38-manylinux1_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 95ea6aa75d4c8be5eca6913ef1f14722e67b7a14acf9660d9b25e888322b0fa6 |
|
MD5 | c61f2f931cb5dc1fb1774d1fb1d02912 |
|
BLAKE2b-256 | 793f34a62d74c8666617869f57dd6a47722b8fac4737d95419cd4876cd833e61 |
Close
Hashes for indexed_zstd-1.2.2-cp37-cp37m-manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | a66695cfdc4b6167a9d9f94c59843a89bdabdc59731a4dc707e8677371c7461b |
|
MD5 | 1f2797cbdccf996c0ce1d74912ba86c4 |
|
BLAKE2b-256 | 9ffef72ca846905e62baebd9846872789e2b333d55da4a516237f23cf4731ea6 |
Close
Hashes for indexed_zstd-1.2.2-cp37-cp37m-manylinux2010_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 1596564e02c0d702ad02b0773d516dc509c830dab388a48b69672e68d186284f |
|
MD5 | 86c950016b4e300681c0a56be675a86a |
|
BLAKE2b-256 | 32b271c919fb9fbfdff473e2e946d62629ded27335e2c720cc52fb6735afc18d |
Close
Hashes for indexed_zstd-1.2.2-cp37-cp37m-manylinux1_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 4143befd5f14346880df3020d57875c8c3a2857150b2e8613f4e11721a0b62fc |
|
MD5 | a22a6b4ed1785219fb93708b7d7dd774 |
|
BLAKE2b-256 | e1045b214629e1a5a7a4721ed0dadfdf2fe74fbd1d9081ce092d9b5e83098557 |
Close
Hashes for indexed_zstd-1.2.2-cp36-cp36m-manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 8d5e67ed0b33a944913ad08d3f2c7501be48a16440bb3090a13b08fef2637928 |
|
MD5 | 9548b229780c6cfd463edd2a0d03d06c |
|
BLAKE2b-256 | 818cdee9a3cf6bc7c5a34502c92b23d1895eacf3f9e114dde0c53a513394d24c |
Close
Hashes for indexed_zstd-1.2.2-cp36-cp36m-manylinux2010_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 05ca293fe36f17dc757a0b6f6dec8c35669a0155ed3d4a8348001b9ac8680ea5 |
|
MD5 | 811218dd08134be698e068d3fca7bbc4 |
|
BLAKE2b-256 | 277010145ce4593fcf76b90a4c39b49287fd4a0bf2498f30567a33e46c27abe3 |
Close
Hashes for indexed_zstd-1.2.2-cp36-cp36m-manylinux1_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 19e4174327045f9acfba361887c2b784c5135e922a5371d52fb27d10979c458a |
|
MD5 | a1064b52804cea979d9cb47cc1536d0e |
|
BLAKE2b-256 | eafc692a75547f19de50f839f1c3ffb5c89faf0c15d6e7665435b2b664fec396 |
Close
Hashes for indexed_zstd-1.2.2-cp35-cp35m-manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 697a6a61e1fe5b933e1fec316a4c5cd8d1215c4cb04616a0bf4672486e4a3bea |
|
MD5 | 34ec6d087df4594d0da96cadefb02f5d |
|
BLAKE2b-256 | fbb1c8c78cb99bee888c0febdb701e35e9fb357e5754363e822c11ea2d875a53 |
Close
Hashes for indexed_zstd-1.2.2-cp35-cp35m-manylinux2010_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 44ab96a4668ed2b568f906b0010e45283367ebc54eeca6a4f983ca6642e27e67 |
|
MD5 | b4f3cf58b3f8c527898a3d4eb0c15eb0 |
|
BLAKE2b-256 | b54948fcc10defae1a0cb3ddd315d3518e57e27f526bde1fa8ed32edc8bd7021 |
Close
Hashes for indexed_zstd-1.2.2-cp35-cp35m-manylinux1_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 77c44cdfa89e70d647e8dfc1f85ca142965d581c06a105a027443a019ccfb3cb |
|
MD5 | c4b0208105dface4233561824de69c91 |
|
BLAKE2b-256 | d8037a6ed10e499a6e223eb8ced9a17cfc3a1d77635b6710b5e148c360561626 |