Skip to main content

Domain Adaptation for Memory-Efficient Dense Retrieval

Project description

:dollar: What is it?

Index Compression Methods (INCOME) repository helps you easily train and evaluate memory-compressed binary retrievers on any custom dataset. We provide recent state-of-the-art techniques for training and unsupervised (without requiring custom training data) for domain-adaptation of NLP-based binary retrieval models across any dataset.

For more information, checkout our publication:

:dollar: Installation

One can either install income via pip

pip install income

or via source using git clone

$ git clone https://github.com/Nthakur20/income.git
$ cd income
$ pip install -e .

:dollar: Models Supported

Uploaded Public Models

:dollar: Quick Example

:dollar: Why should we do domain adaptation?

:dollar: Inference

:dollar: Training

:dollar: Citing & Authors

If you find this repository helpful, feel free to cite our recent publication: Domain Adaptation for Memory-Efficient Dense Retrieval:

@article{thakur2022domain,
  title={Domain Adaptation for Memory-Efficient Dense Retrieval},
  author={Thakur, Nandan and Reimers, Nils and Lin, Jimmy},
  journal={arXiv preprint arXiv:2205.11498},
  year={2022},
  url={https://arxiv.org/abs/2205.11498/}
}

The main contributors of this repository are:

Contact person: Nandan Thakur, nandant@gmail.com

Don't hesitate to send us an e-mail or report an issue, if something is broken (and it shouldn't be) or if you have further questions.

This repository contains experimental software and is published for the sole purpose of giving additional background details on the respective publication.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

income-0.0.1.tar.gz (24.5 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

income-0.0.1-py3-none-any.whl (31.6 kB view details)

Uploaded Python 3

File details

Details for the file income-0.0.1.tar.gz.

File metadata

  • Download URL: income-0.0.1.tar.gz
  • Upload date:
  • Size: 24.5 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.8.0 pkginfo/1.8.2 readme-renderer/32.0 requests/2.26.0 requests-toolbelt/0.9.1 urllib3/1.26.7 tqdm/4.62.3 importlib-metadata/4.8.3 keyring/23.4.0 rfc3986/1.5.0 colorama/0.4.4 CPython/3.6.12

File hashes

Hashes for income-0.0.1.tar.gz
Algorithm Hash digest
SHA256 27a833e2303742e8f096fc814c9455aaaf60d38d488ab55c34cbd76e5072f58e
MD5 48bfac4076cd6467619c57b82d239468
BLAKE2b-256 8a5277cf301389c98ad1df5214011747b2e50a99ba98e3ddcfdf5c9a118fd5d2

See more details on using hashes here.

File details

Details for the file income-0.0.1-py3-none-any.whl.

File metadata

  • Download URL: income-0.0.1-py3-none-any.whl
  • Upload date:
  • Size: 31.6 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.8.0 pkginfo/1.8.2 readme-renderer/32.0 requests/2.26.0 requests-toolbelt/0.9.1 urllib3/1.26.7 tqdm/4.62.3 importlib-metadata/4.8.3 keyring/23.4.0 rfc3986/1.5.0 colorama/0.4.4 CPython/3.6.12

File hashes

Hashes for income-0.0.1-py3-none-any.whl
Algorithm Hash digest
SHA256 4adb6685391e15bf8d47851166781e7ceda746d1fee140c81ee7a8f855202991
MD5 6b0c1e6e15c57ee772c7030d6fa2d514
BLAKE2b-256 d7f3ad1ded4831603e36ff7c26066c356cd2b4d065caceca4ca48186020b1ff2

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page