HuggingFace/Datasets is an open library of NLP datasets.
Project description
Note:
VERSION needs to be formatted following the MAJOR.MINOR.PATCH convention (we need to follow this convention to be able to retrieve versioned scripts)
Simple check list for release from AllenNLP repo: https://github.com/allenai/allennlp/blob/master/setup.py
To create the package for pypi.
-
Prerequisites:
- Dependencies:
- twine: "pip install twine"
- Create an account in (and join the 'datasets' project):
- PyPI: https://pypi.org/
- Test PyPI: https://test.pypi.org/
- Dependencies:
-
Change the version in:
- init.py
- setup.py
- docs/source/conf.py
-
Commit these changes: "git commit -m 'Release: VERSION'"
-
Add a tag in git to mark the release: "git tag VERSION -m 'Add tag VERSION for pypi'" Push the tag to remote: git push --tags origin master
-
Build both the sources and the wheel. Do not change anything in setup.py between creating the wheel and the source distribution (obviously).
For the wheel, run: "python setup.py bdist_wheel" in the top level directory. (this will build a wheel for the python version you use to build it).
For the sources, run: "python setup.py sdist" You should now have a /dist directory with both .whl and .tar.gz source versions.
-
Check that everything looks correct by uploading the package to the pypi test server:
twine upload dist/* -r pypitest --repository-url=https://test.pypi.org/legacy/
Check that you can install it in a virtualenv/notebook by running: pip install huggingface_hub fsspec aiohttp pip install -U tqdm pip install -i https://testpypi.python.org/pypi datasets
-
Upload the final version to actual pypi: twine upload dist/* -r pypi
-
Fill release notes in the tag in github once everything is looking hunky-dory.
-
Update the documentation commit in .circleci/deploy.sh for the accurate documentation to be displayed. Update the version mapping in docs/source/_static/js/custom.js with: "python utils/release.py --version VERSION" Set version to X.X.X+1.dev0 (e.g. 1.8.0 -> 1.8.1.dev0) in:
- setup.py
- init.py
-
Commit these changes: "git commit -m 'Release docs'" Push the commit to remote: "git push origin master"
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Hashes for datasets-1.12.0-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | a45bd6c2835df0a8175a422ff057da252776b9027cd74611a9c04c71db2bbbd3 |
|
MD5 | 21d6764d6d9416f101aaffb370d246f0 |
|
BLAKE2b-256 | 149f03d2c449c8590e3dc27f24538b6dd6b0f2b48652b6e0f58d2edcf7c87d3a |