v3iofs 0.1.0a1

fsspec driver for v3io

v3iofs

An fsspec driver for v3io.

THIS IS ALPHA QUALITY WORK IN PROGRESS, DO NOT USE

Example

>>> from v3iofs import V3ioFS
>>> fs = V3ioFS('api.app.yh48.iguazio-cd2.com', v3io_access_key='s3cr3t')
>>> fs.ls('/container/path')

Dask Example

>>> from v3iofs import V3ioFS
>>> from dask import bag
>>> url = 'v3io://api.app.yh48.iguazio-cd2.com/container/path'

# Use V3IO_ACCESS_KEY from environment
>>> file = bag.read_text(url)
>>> data, _ = file.compute()

# Pass key in storage_options
>>> file = bag.read_text(url, storage_options={'v3io_access_key': 's3cr3t'})
>>> data, _ = file.compute()

# Pass key in URL
>>> url = 'v3io://api_key:[e-mail]/container/path'
>>> file = bag.read_text(url)
>>> data, _ = file.compute()