Skip to main content

SQLite based queryable python indexes for dicts and lists

Project description

LiteIndex

Embedded, thread and process safe, disk backed, easy to use, query-able, fast Index implementations

pip install --upgrade liteindex

DefinedIndex

  • Documentation | Detailed example | Benchmarks
  • fixed schema index i.e: schema has to be defined before hand
  • number, boolean, datetime, string, compressed_string, blob, json, normalized_embedding, and other types are supported and can be queried upon
  • can store any python objects with varying levels of query-ability
  • Query language is subset of mongodb's. All queries are documented
  • seamless, very fast nearest neighbor search with filtering. a practical wrapper of faiss + sqlite. Approximate nearest neighbor search is not supported. Intended for few million vector search
  • works across threads, processes seamlessly
  • handy features like search and update in single query, batch operation support for update, search, del, pop etc ..
  • in-place math operations support wherever applicable i.e: += etc can be done in single query optimally
  • compression is supported natively and optional custom compression dictionaries can be built automatically

KVIndex

  • Documentation | Detailed example | Benchmarks
  • simple key value store, can store any python objects, can be queried for equality, sorting, max, min etc wherever applicable
  • in-place math operations support wherever applicable i.e: += etc can be done in single query optimally
  • has a python dict like interface
  • batch operation support for update, search, del, pop etc ..
  • ultra fast, works across threads, processes seamlessly
  • Eviction policies supported: LRU, LFU, any and age based invalidation and size, count based eviction

function_cache

Project details


Release history Release notifications | RSS feed

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

liteindex-0.0.2.dev61.tar.gz (23.8 kB view hashes)

Uploaded Source

Built Distribution

liteindex-0.0.2.dev61-py3-none-any.whl (22.6 kB view hashes)

Uploaded Python 3

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page