Fast random access to zstd files
Project description
indexed_zstd
This module provides an IndexedZstdFile class, which can be used to seek inside zstd files without having to decompress them first.
It's shamelessy based on indexed_bzip2, which was refactored to support zstd instead of bzip2 using libzstd-seek.
Kudos to the author for its work.
Seeking inside a block is only emulated, so IndexedZstdFile will only speed up seeking when there are more than one block, which sadly requires a bit of care in zstd.
Usage
Example 1
from indexed_zstd import IndexedZstdFile
file = IndexedZstdFile( "example.zst" )
# You can now use it like a normal file
file.seek( 123 )
data = file.read( 100 )
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
indexed_zstd-1.4.0.tar.gz
(63.1 kB
view hashes)
Built Distributions
Close
Hashes for indexed_zstd-1.4.0-pp38-pypy38_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 08dfb3857c1b1a0537b4a50952d61e084b22001e0240726337b63ef225eccf9d |
|
MD5 | 8f2f07c7cccc44760da213a0b2bde194 |
|
BLAKE2b-256 | 2ee546bf3b5207b8153a6d24fbab954eda8e143bb71ba4626ef0b497a8b2f24b |
Close
Hashes for indexed_zstd-1.4.0-pp38-pypy38_pp73-macosx_10_9_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | fd2a0b1667d27fe344fbf0d0d53f2ca5168b89a0216f6742a30d4d3c945f77c6 |
|
MD5 | 558b580d221640ee8206ff7ca48b960f |
|
BLAKE2b-256 | 0a3ddd84ef7450d244279dde8b42f4ac49f47a4a9f8edc12180ed732e50e8155 |
Close
Hashes for indexed_zstd-1.4.0-pp37-pypy37_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | d05c5bd737b918993bfe5348491b70c33ebf9f87a92279b00cd5dce1b51b0337 |
|
MD5 | 84c2e2528cbf4f5d1fe955fa108ec3c7 |
|
BLAKE2b-256 | ca905ef0ca393c87f2144b38d3b006403f9428e5a1b2f9bf3817c51855fc5794 |
Close
Hashes for indexed_zstd-1.4.0-pp37-pypy37_pp73-macosx_10_9_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 7a26f2eb7be9d9c6e0eb46866399f7f49be0ae8f270074a6c24f2b10bf93b187 |
|
MD5 | cd9df06c9c0fb7de8dedbdf47f71a842 |
|
BLAKE2b-256 | b9ae4ee16377f5cc0cfa742c185ef4b82edb40c0fca68c465b5250c4beba3ccf |
Close
Hashes for indexed_zstd-1.4.0-cp310-cp310-musllinux_1_1_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | a56edf9aa10af5408ab71c4f6f637d4fd9e1b7893279e70049557ae5f3d85c76 |
|
MD5 | a7d59755c2526e1492b59a47ff8b9548 |
|
BLAKE2b-256 | e0493a5673b1f6fb143aad5295d41f0a58234501100b998da99c6c38942e88f1 |
Close
Hashes for indexed_zstd-1.4.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | e74d6b3a6befbf49193a670a64bf48d3e265b577d90080be71e99bca71d1a4d2 |
|
MD5 | e6dcba59e8232836eb979157803c1d5d |
|
BLAKE2b-256 | 0c5f4e8b3fc37b60dfc85a401f83d1c848f90868e177a772ae982fc47f4604b1 |
Close
Hashes for indexed_zstd-1.4.0-cp310-cp310-macosx_10_9_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | b8d71257e3e52423b13715dbff821f39be1cbf39c8e70dd18e9f78d9ab177447 |
|
MD5 | 9f878c3e0a72a38a680c6900e587b1ba |
|
BLAKE2b-256 | eadf369e1df862f3713c1a9b01a0b30c6c03b8b5054a3ab301cb628386950aa7 |
Close
Hashes for indexed_zstd-1.4.0-cp39-cp39-musllinux_1_1_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | e829b69e16613eefda2d174d89ad4bd9fbb6d3e04ed2966393301e5b41cbe18d |
|
MD5 | 29f9cc0099ece7ffb19bacf282e4dbcd |
|
BLAKE2b-256 | 22b68e3f859adfcf8e92d20e2f622dfa697896121f211d5b1e112f3f0cbbbe48 |
Close
Hashes for indexed_zstd-1.4.0-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | c69e6f9f026b74bcb4ef7905da6664f46e885d2922e151dc31edd11d5e64fe69 |
|
MD5 | efda854a5f60df9a5fa1fc16378d2598 |
|
BLAKE2b-256 | 356847aaf29bef523c14d52df10db967322c927a3022c1bbeb4ce499317bbb6d |
Close
Hashes for indexed_zstd-1.4.0-cp39-cp39-macosx_10_9_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | c24507438eba0002122adc7be091e8e9502e7e3291aac5e2caeb4b98140fee9a |
|
MD5 | c00a8b7675e40a0cb2b958d83b16df01 |
|
BLAKE2b-256 | 2b4ca61d6f867d2d2582a29c192754120e888ed15a13c41675eac32977ee6dc5 |
Close
Hashes for indexed_zstd-1.4.0-cp38-cp38-musllinux_1_1_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 4ae1def87b118c4879e1a6dfb4ae99ac88fa2c01a2a442d09c43f155d9cf5275 |
|
MD5 | 309608f9827536638a16e25c0aa8e994 |
|
BLAKE2b-256 | 397ac6ff5bcc6ccf09cdb157053d70c39ef9625554385b00f851d57fc82413bd |
Close
Hashes for indexed_zstd-1.4.0-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 9533bd3610acd6551dad28981d68580b15ceed06c54cba73f5f78e70ff4bdc99 |
|
MD5 | 40d7f228924db29ddb62bf38f1ce295a |
|
BLAKE2b-256 | 2aa70a038562cc53f7a45492aaf319ccecf8a27b6619602fdb0633bcd1a432ac |
Close
Hashes for indexed_zstd-1.4.0-cp38-cp38-macosx_10_9_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | cd58a950d995cd3e4ea64998e12a9035fb60687cc482ae46344f1dbfce66af69 |
|
MD5 | f1569298bc6a41281124495bab5f2752 |
|
BLAKE2b-256 | cc3d3453ddd14181adb490f81f0af206b96517e1e83524815027fa8b92db758f |
Close
Hashes for indexed_zstd-1.4.0-cp37-cp37m-musllinux_1_1_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | d853feb02f88a599c1f37ff8ae86037e8e28f135a1f7f1fe6a65e92b3ed6c8ec |
|
MD5 | 810ce51c40fd91f15fe2e561e63a6336 |
|
BLAKE2b-256 | 110e9b3eb9ae3f424b23a0e7fab14fa3c93c47e1e3a060d8809c3c1c104c26bb |
Close
Hashes for indexed_zstd-1.4.0-cp37-cp37m-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 81d9bdbab896f39e0531a6910041d371b6e22da9e2a3f6380b43ffb789c6c1c8 |
|
MD5 | 8b400ea7909934c1c5f3fb6c92220739 |
|
BLAKE2b-256 | 941855ff341e8ac5bb49b8acdd74b5cd600735535e7c910082190cfa0e7a3291 |
Close
Hashes for indexed_zstd-1.4.0-cp37-cp37m-macosx_10_9_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | a1630868172b4e1a2d0639e753c1344c0a46d4fbc216244142a250d21d2520ca |
|
MD5 | 89dd97d4a068ae77cdb4e9b4142f2893 |
|
BLAKE2b-256 | c3d16e88980461b5d15fd24b16e227244ee14ea8c4f9fb90a6ef60ceb211b52d |
Close
Hashes for indexed_zstd-1.4.0-cp36-cp36m-musllinux_1_1_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 3c20066d5985fd01ae76011c06693b629264df4bd8adf1cb5ee83cd23ea94e54 |
|
MD5 | ac549c39362c1710cd52e2d4f24d1645 |
|
BLAKE2b-256 | cef01fb332b6565571897f295ea62c53c89cd8c7d903ef1d2e36abe80d8f1117 |
Close
Hashes for indexed_zstd-1.4.0-cp36-cp36m-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | d5e0c955b45b0beec1d31ae06f671b6a370e04096f6f8eca41840f114b45277d |
|
MD5 | cbdc7333f03205ead9785af928a981a0 |
|
BLAKE2b-256 | 4fb3d9e6edb2445e3a7fab1563083fd5b495ec68dfc2f0aa5ac6e998af5c35cd |
Close
Hashes for indexed_zstd-1.4.0-cp36-cp36m-macosx_10_9_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | ba309a62e326a1ea23f7d99ce220695c70df36546d5935be7dd2bcb74ddce82e |
|
MD5 | ab84beeb4cd4175075bb79b90bd29cdb |
|
BLAKE2b-256 | 2af2d71d5b30a251a0d72c4f7669dbdf499aad938e2706dfe2dddd6e52637cfa |