Skip to main content

Fast random access to zstd files

Project description

PyPI version Conda (channel only) Python Version PyPI Platforms Downloads License Build Status C++17 AUR version

indexed_zstd

This module provides an IndexedZstdFile class, which can be used to seek inside zstd files without having to decompress them first.

It's shamelessy based on indexed_bzip2, which was refactored to support zstd instead of bzip2 using libzstd-seek.

Kudos to the author for its work.

Seeking inside a block is only emulated, so IndexedZstdFile will only speed up seeking when there are more than one block.

To create multi-block archives you may use t2sz.

Usage

Example 1

from indexed_zstd import IndexedZstdFile

file = IndexedZstdFile( "example.zst" )

# You can now use it like a normal file
file.seek( 123 )
data = file.read( 100 )

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

indexed_zstd-1.6.0.tar.gz (66.6 kB view hashes)

Uploaded Source

Built Distributions

indexed_zstd-1.6.0-pp39-pypy39_pp73-win_amd64.whl (731.2 kB view hashes)

Uploaded PyPy Windows x86-64

indexed_zstd-1.6.0-pp39-pypy39_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (395.3 kB view hashes)

Uploaded PyPy manylinux: glibc 2.17+ x86-64

indexed_zstd-1.6.0-pp39-pypy39_pp73-macosx_10_9_x86_64.whl (384.7 kB view hashes)

Uploaded PyPy macOS 10.9+ x86-64

indexed_zstd-1.6.0-pp38-pypy38_pp73-win_amd64.whl (731.6 kB view hashes)

Uploaded PyPy Windows x86-64

indexed_zstd-1.6.0-pp38-pypy38_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (395.2 kB view hashes)

Uploaded PyPy manylinux: glibc 2.17+ x86-64

indexed_zstd-1.6.0-pp38-pypy38_pp73-macosx_10_9_x86_64.whl (384.7 kB view hashes)

Uploaded PyPy macOS 10.9+ x86-64

indexed_zstd-1.6.0-pp37-pypy37_pp73-win_amd64.whl (731.6 kB view hashes)

Uploaded PyPy Windows x86-64

indexed_zstd-1.6.0-pp37-pypy37_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (396.3 kB view hashes)

Uploaded PyPy manylinux: glibc 2.17+ x86-64

indexed_zstd-1.6.0-pp37-pypy37_pp73-macosx_10_9_x86_64.whl (384.7 kB view hashes)

Uploaded PyPy macOS 10.9+ x86-64

indexed_zstd-1.6.0-cp311-cp311-win_amd64.whl (708.0 kB view hashes)

Uploaded CPython 3.11 Windows x86-64

indexed_zstd-1.6.0-cp311-cp311-musllinux_1_1_x86_64.whl (1.2 MB view hashes)

Uploaded CPython 3.11 musllinux: musl 1.1+ x86-64

indexed_zstd-1.6.0-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (607.0 kB view hashes)

Uploaded CPython 3.11 manylinux: glibc 2.17+ x86-64

indexed_zstd-1.6.0-cp311-cp311-macosx_10_9_x86_64.whl (392.3 kB view hashes)

Uploaded CPython 3.11 macOS 10.9+ x86-64

indexed_zstd-1.6.0-cp310-cp310-win_amd64.whl (708.6 kB view hashes)

Uploaded CPython 3.10 Windows x86-64

indexed_zstd-1.6.0-cp310-cp310-musllinux_1_1_x86_64.whl (1.1 MB view hashes)

Uploaded CPython 3.10 musllinux: musl 1.1+ x86-64

indexed_zstd-1.6.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (599.9 kB view hashes)

Uploaded CPython 3.10 manylinux: glibc 2.17+ x86-64

indexed_zstd-1.6.0-cp310-cp310-macosx_10_9_x86_64.whl (392.1 kB view hashes)

Uploaded CPython 3.10 macOS 10.9+ x86-64

indexed_zstd-1.6.0-cp39-cp39-win_amd64.whl (709.6 kB view hashes)

Uploaded CPython 3.9 Windows x86-64

indexed_zstd-1.6.0-cp39-cp39-musllinux_1_1_x86_64.whl (1.2 MB view hashes)

Uploaded CPython 3.9 musllinux: musl 1.1+ x86-64

indexed_zstd-1.6.0-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (604.5 kB view hashes)

Uploaded CPython 3.9 manylinux: glibc 2.17+ x86-64

indexed_zstd-1.6.0-cp39-cp39-macosx_10_9_x86_64.whl (392.9 kB view hashes)

Uploaded CPython 3.9 macOS 10.9+ x86-64

indexed_zstd-1.6.0-cp38-cp38-win_amd64.whl (734.5 kB view hashes)

Uploaded CPython 3.8 Windows x86-64

indexed_zstd-1.6.0-cp38-cp38-musllinux_1_1_x86_64.whl (1.2 MB view hashes)

Uploaded CPython 3.8 musllinux: musl 1.1+ x86-64

indexed_zstd-1.6.0-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (607.0 kB view hashes)

Uploaded CPython 3.8 manylinux: glibc 2.17+ x86-64

indexed_zstd-1.6.0-cp38-cp38-macosx_10_9_x86_64.whl (392.6 kB view hashes)

Uploaded CPython 3.8 macOS 10.9+ x86-64

indexed_zstd-1.6.0-cp37-cp37m-win_amd64.whl (734.3 kB view hashes)

Uploaded CPython 3.7m Windows x86-64

indexed_zstd-1.6.0-cp37-cp37m-musllinux_1_1_x86_64.whl (1.1 MB view hashes)

Uploaded CPython 3.7m musllinux: musl 1.1+ x86-64

indexed_zstd-1.6.0-cp37-cp37m-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (597.0 kB view hashes)

Uploaded CPython 3.7m manylinux: glibc 2.17+ x86-64

indexed_zstd-1.6.0-cp37-cp37m-macosx_10_9_x86_64.whl (392.1 kB view hashes)

Uploaded CPython 3.7m macOS 10.9+ x86-64

indexed_zstd-1.6.0-cp36-cp36m-win_amd64.whl (749.9 kB view hashes)

Uploaded CPython 3.6m Windows x86-64

indexed_zstd-1.6.0-cp36-cp36m-musllinux_1_1_x86_64.whl (1.1 MB view hashes)

Uploaded CPython 3.6m musllinux: musl 1.1+ x86-64

indexed_zstd-1.6.0-cp36-cp36m-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (596.2 kB view hashes)

Uploaded CPython 3.6m manylinux: glibc 2.17+ x86-64

indexed_zstd-1.6.0-cp36-cp36m-macosx_10_9_x86_64.whl (392.2 kB view hashes)

Uploaded CPython 3.6m macOS 10.9+ x86-64

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page