Fast random access to zstd files
Project description
indexed_zstd
This module provides an IndexedZstdFile class, which can be used to seek inside zstd files without having to decompress them first.
It's shamelessy based on indexed_bzip2, which was refactored to support zstd instead of bzip2 using libzstd-seek.
Kudos to the author for its work.
Seeking inside a block is only emulated, so IndexedZstdFile will only speed up seeking when there are more than one block, which sadly requires a bit of care in zstd.
Usage
Example 1
from indexed_zstd import IndexedZstdFile
file = IndexedZstdFile( "example.zst" )
# You can now use it like a normal file
file.seek( 123 )
data = file.read( 100 )
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
indexed_zstd-1.3.4.tar.gz
(61.9 kB
view hashes)
Built Distributions
Close
Hashes for indexed_zstd-1.3.4-pp38-pypy38_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | ee9d0ba1be0f0028bd4e8a38a3a31d9be88307dbc893272e9804f093e1340e54 |
|
MD5 | 5e7f88e1040add352658ec276190914f |
|
BLAKE2b-256 | 5572a880cae838cea76079f8cf9691b68ed79e0b947e58ec568f45ea99649e91 |
Close
Hashes for indexed_zstd-1.3.4-pp38-pypy38_pp73-macosx_10_9_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | bcd42a01682a174db80ad876f3647d1d1c5533ca2ba73483c9c37610ad962ac3 |
|
MD5 | 82865016c1844d105eb45a351ba8f438 |
|
BLAKE2b-256 | 6df1cace04edcc52085f8a18917408d5661beee9ea1059883e8f02d73a3ca830 |
Close
Hashes for indexed_zstd-1.3.4-pp37-pypy37_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 82ccea925ebd2ecf060e2d494f4d71db6935e673af399b2b45b304a99bc1b8a3 |
|
MD5 | 25c66676ac921f3058ea9bf88581b714 |
|
BLAKE2b-256 | c7736e9bea32320edb9d4d4a17de2c10f3b552be9571131b15b61881f5538dd4 |
Close
Hashes for indexed_zstd-1.3.4-pp37-pypy37_pp73-macosx_10_9_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | bf961dd91f28e637f744f69b0b79890ee35392581ec3aafeac5525d26b3426ad |
|
MD5 | f0e5c8a7670bc177345feb715eb3d300 |
|
BLAKE2b-256 | 60e10b0f9508f36c053a73227fac296396abea74bd9c61ec3a96d5174da65596 |
Close
Hashes for indexed_zstd-1.3.4-cp310-cp310-musllinux_1_1_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 7c56cbbc56b9e471c5ad25815e9dd5fc4ec8b4f9d8ace53f4dc5a8dc224923e9 |
|
MD5 | 5df39e6c6b0f993e80a06dc5ac3557c0 |
|
BLAKE2b-256 | 3bcced37d607ae5745f2fb7d25d638e4618827bec5b8f984cf69c3c398ca972d |
Close
Hashes for indexed_zstd-1.3.4-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 46bd50aa2ee6c1879a14d5c97569d7e22ea84bb680d0bf6f7c7fdd6db6a82da6 |
|
MD5 | 3eda01a280653aa10c4fbe394365b938 |
|
BLAKE2b-256 | 48a84c012e733ef7c218e42ffc23ace6f8d0cd6b1cafb43b317dcc5f2cb3c440 |
Close
Hashes for indexed_zstd-1.3.4-cp310-cp310-macosx_10_9_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 214dd879474a462a57264848c3e86b2e68f33615087686c03ea8b5bb085a2913 |
|
MD5 | 48576e00d02ae46a9c016c43d8cde548 |
|
BLAKE2b-256 | 8f79ae550c1f50440db21e47c82192e719beb4a475de6974300603ee263c74a2 |
Close
Hashes for indexed_zstd-1.3.4-cp39-cp39-musllinux_1_1_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | c91334287dfa6d1025c512dff78a37452fc9c6e490ee7aad4bc93b97f6c87d09 |
|
MD5 | 21be63b1aad976968d4f51560cae20ee |
|
BLAKE2b-256 | 225b4c064cdf766cbbd75018522448588bf54abd2aa1ced95f4d76a20c0708c2 |
Close
Hashes for indexed_zstd-1.3.4-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 1c25c9e7f3c6a865458d185bcdc313a0c7a5574b49931a57f9bc1750d4691d8d |
|
MD5 | fdf72081e751f6618b498caa031208ac |
|
BLAKE2b-256 | 534e40b9018e94ad8f23068d6ad69191278f3ce34fd101bea70f9fae256ce4af |
Close
Hashes for indexed_zstd-1.3.4-cp39-cp39-macosx_10_9_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 9ae50bc85622a7b9b4a4caa5f63783a9f390e054c7ffde82703998ce963e17e4 |
|
MD5 | d94dc942b7800d5a170daaff4cb75fa4 |
|
BLAKE2b-256 | 58705f32cf8b4e522980316842d9b1066f583d3659c1623ec78add9dd54b515e |
Close
Hashes for indexed_zstd-1.3.4-cp38-cp38-musllinux_1_1_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | ac2f334cd06bf8360be71c8e1571e1379c2006a253699ff43f7f7e7efd697322 |
|
MD5 | ef9efe6f10be8160ddaaf45827c59cf0 |
|
BLAKE2b-256 | e472e1d655545dbb76fc8af7228be4e48d8a660df88c811993dd5471dc8afcf4 |
Close
Hashes for indexed_zstd-1.3.4-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 8496cc81b96af0276711cf293d1748ba6e9e7fe9967a4d0f19ab67219b3da894 |
|
MD5 | cffdf3db1bc7b2d2634d1e7d280c8154 |
|
BLAKE2b-256 | fb33657f9669408004e034a857fd5cce56002e64d878f4204a403982aaa402bf |
Close
Hashes for indexed_zstd-1.3.4-cp38-cp38-macosx_10_9_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 386b222cf075ad46125ade7c8ba47173e2f30bd939f5b170ef3d7c13dd967b7d |
|
MD5 | d1826153661e75a1223f8d52bfa1e542 |
|
BLAKE2b-256 | 11c1ecf9b96862ac2a58b46de6607baf220612d2192b8f24844e5c079f9431ec |
Close
Hashes for indexed_zstd-1.3.4-cp37-cp37m-musllinux_1_1_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 06476e99fca70726a5606e1d64589f4423a4f266b209cab245e20d4b0ad7a8ff |
|
MD5 | e6432b4e923b4f33323c13dfbfe3fdf8 |
|
BLAKE2b-256 | 9c31e9b8ae285d06e703310553bb4d307b852c355dcea576bf14273e8b97d41f |
Close
Hashes for indexed_zstd-1.3.4-cp37-cp37m-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 4131cbd71f49615f39e46b5fddf4452e2dfb0eb90d9a0ba8f5e609eae29d7630 |
|
MD5 | 3a41e010dea13d5e39ba38d4e3a30402 |
|
BLAKE2b-256 | f1c3a387f1a1eec26736f340fbe01550abbe308e8666191cd599426eddd6d163 |
Close
Hashes for indexed_zstd-1.3.4-cp37-cp37m-macosx_10_9_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 6bd0b907e2fde9ecb20c7ec7313f7d006f7c8df90c3fb73421533f70c87e03ba |
|
MD5 | ef7094b840ce37d5717409b9d45f62a9 |
|
BLAKE2b-256 | 6aa4f2c0c3472c5a7a3d555eaeb22e3724f944c4bebc5cdddc5b5f384f7c56c9 |
Close
Hashes for indexed_zstd-1.3.4-cp36-cp36m-musllinux_1_1_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | c71578fdabc77f5b81c2f50d41d184b76c4f9ab4b7cf56985f66accbf8a0ca55 |
|
MD5 | 3f15d8be97bb137171c066738b735678 |
|
BLAKE2b-256 | dbb133e8ddcb5563198a93e34e84b97543ddc43d301f460b469e3840e5e8bad9 |
Close
Hashes for indexed_zstd-1.3.4-cp36-cp36m-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | a366cafc705e3499898f74380ef6bbe157ccff744252409d76a688e5d6ce5c49 |
|
MD5 | 77103118e2cd106db8ae04fe99016e48 |
|
BLAKE2b-256 | 7fb3c4f3058eb1487a783d0d799d4f3223d09fa65d126257a5d8d8e759fe694a |
Close
Hashes for indexed_zstd-1.3.4-cp36-cp36m-macosx_10_9_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 1da8c3b5d9e3b6f7dd34a9b5197ab85d40484b3da0bd15bb54f61484baa6bfd4 |
|
MD5 | f6800663da7e366db80447bff79bf825 |
|
BLAKE2b-256 | 2efccafbe0fd594362851324c761fd2f319242d7f7be91e3fa2a241bbc4eba20 |