The distributed parallel computing library hooks for xonsh
Project description
The distributed parallel computing library hooks for xonsh
If you like the idea click ⭐ on the repo and tweet.
Importantly this provides a substitute 'dworker' command which enables distributed workers to have access to xonsh builtins.
Furthermore, this xontrib adds a 'DSubmitter' context manager for executing a block remotely. Moreover, this also adds a convenience function 'dsubmit()' for creating DSubmitter and Executor instances at the same time.
Thus users may submit distributed jobs with::
with dsubmit('127.0.0.1:8786', rtn='x') as dsub:
x = $(echo I am elsewhere)
res = dsub.future.result()
print(res)
This is useful for long running or non-blocking jobs.
Installation
To install use pip:
xpip install xontrib-distributed
# or: xpip install -U git+https://github.com/xonsh/xontrib-distributed
Usage
xontrib load distributed
# TODO: what's next?
Releasing your package
- Bump the version of your package.
- Create a GitHub release (The release notes are automatically generated as a draft release after each push).
- And publish with
poetry publish --buildortwine
Credits
This package was created with xontrib cookiecutter template.
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file xontrib-distributed-0.0.4.tar.gz.
File metadata
- Download URL: xontrib-distributed-0.0.4.tar.gz
- Upload date:
- Size: 4.0 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: poetry/1.1.13 CPython/3.10.2 Darwin/21.4.0
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
a1e8543b5cc18d661ba32c25a1296048a8dbff8cb1a9b61c888304e359d3ee4e
|
|
| MD5 |
ea46f835ed1bd41dda1f9886ba6aff49
|
|
| BLAKE2b-256 |
d11fc6f7a597c66a96e3eb94a2db3640492b5a58ccec45a9aa04fa40718974df
|
File details
Details for the file xontrib_distributed-0.0.4-py3-none-any.whl.
File metadata
- Download URL: xontrib_distributed-0.0.4-py3-none-any.whl
- Upload date:
- Size: 4.1 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: poetry/1.1.13 CPython/3.10.2 Darwin/21.4.0
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
e1ee19a521d64f1c425edf3f0245cecb15cd0dae6bccd17433c9cbe352c52f0f
|
|
| MD5 |
7f68ade645d8cb545d172389b7a9bd6e
|
|
| BLAKE2b-256 |
6c5a20d0cd6ec53ac4513fc9db64fb213aafb153a9125268a9aade547d3e138c
|