Skip to main content

Data platform for LLMs - Load, index, retrieve and sync any unstructured data

Project description

embedchain

ROSS Index - Fastest Growing Open-Source Startups in Q3 2023 | Runa Capital

PyPI Slack Discord Twitter Substack Open in Colab codecov

Embedchain is a Data Platform for LLMs - load, index, retrieve, and sync any unstructured data. Using embedchain, you can easily create LLM powered apps over any data. If you want a javascript version, check out embedchain-js

Community

  • Join embedchain community on slack by accepting this invite

🤝 Schedule a 1-on-1 Session

Book a 1-on-1 Session with Taranjeet, the founder, to discuss any issues, provide feedback, or explore how we can improve Embedchain for you.

🔧 Quick install

pip install --upgrade embedchain

🔍 Demo

Try out embedchain in your browser:

Open in Colab

📖 Documentation

The documentation for embedchain can be found at docs.embedchain.ai.

💻 Usage

Embedchain empowers you to create ChatGPT like apps, on your own dynamic dataset.

Data types supported

  • Youtube video
  • PDF file
  • CSV file
  • Web page
  • MDX file
  • XML file
  • Sitemap
  • Doc file
  • Notion
  • JSON file
  • OpenAPI specs
  • Code docs website
  • Unstructured file loader and many more

You can find the full list of data types on our documentation.

Queries

For example, you can use Embedchain to create an Elon Musk bot using the following code:

import os
from embedchain import App

# Create a bot instance
os.environ["OPENAI_API_KEY"] = "YOUR API KEY"
elon_bot = App()

# Embed online resources
elon_bot.add("https://en.wikipedia.org/wiki/Elon_Musk")
elon_bot.add("https://www.forbes.com/profile/elon-musk")
elon_bot.add("https://www.youtube.com/watch?v=RcYjXbSJBN8")

# Query the bot
elon_bot.query("How many companies does Elon Musk run and name those?")
# Answer: Elon Musk currently runs several companies. As of my knowledge, he is the CEO and lead designer of SpaceX, the CEO and product architect of Tesla, Inc., the CEO and founder of Neuralink, and the CEO and founder of The Boring Company. However, please note that this information may change over time, so it's always good to verify the latest updates.

Examples

LLM Google Colab Replit
OpenAI Open In Colab Try with Replit Badge
Anthropic Open In Colab Try with Replit Badge
Azure OpenAI Open In Colab Try with Replit Badge
VertexAI Open In Colab Try with Replit Badge
Cohere Open In Colab Try with Replit Badge
Hugging Face Open In Colab Try with Replit Badge
JinaChat Open In Colab Try with Replit Badge
GPT4All Open In Colab Try with Replit Badge
Llama2 Open In Colab Try with Replit Badge
Embedding model Google Colab Replit
OpenAI Open In Colab Try with Replit Badge
VertexAI Open In Colab Try with Replit Badge
GPT4All Open In Colab Try with Replit Badge
Hugging Face Open In Colab Try with Replit Badge
Vector DB Google Colab Replit
ChromaDB Open In Colab Try with Replit Badge
Elasticsearch Open In Colab Try with Replit Badge
Opensearch Open In Colab Try with Replit Badge
Pinecone Open In Colab Try with Replit Badge

🤝 Contributing

Contributions are welcome! Please check out the issues on the repository, and feel free to open a pull request. For more information, please see the contributing guidelines.

For more reference, please go through Development Guide and Documentation Guide.

Telemetry

We collect anonymous usage metrics to enhance our package's quality and user experience. This includes data like feature usage frequency and system info, but never personal details. The data helps us prioritize improvements and ensure compatibility. If you wish to opt-out, set the app.config.collect_metrics = False in the code. We prioritize data security and don't share this data externally.

Citation

If you utilize this repository, please consider citing it with:

@misc{embedchain,
  author = {Taranjeet Singh, Deshraj Yadav},
  title = {Embedchain: Data platform for LLMs - load, index, retrieve, and sync any unstructured data},
  year = {2023},
  publisher = {GitHub},
  journal = {GitHub repository},
  howpublished = {\url{https://github.com/embedchain/embedchain}},
}

Project details


Release history Release notifications | RSS feed

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

embedchain-0.0.78.tar.gz (67.0 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

embedchain-0.0.78-py3-none-any.whl (110.8 kB view details)

Uploaded Python 3

File details

Details for the file embedchain-0.0.78.tar.gz.

File metadata

  • Download URL: embedchain-0.0.78.tar.gz
  • Upload date:
  • Size: 67.0 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/4.0.2 CPython/3.11.6

File hashes

Hashes for embedchain-0.0.78.tar.gz
Algorithm Hash digest
SHA256 af5ce9a0671f460da643f08b70cf07ea070e34adc08f82b8e4b36964508e2118
MD5 95363412bf0b6bd85bc3bc5c97df8e8e
BLAKE2b-256 344f4ef9cba66eccd13acef7a337a5a6bd39896aa4c603e888026a23839a92a7

See more details on using hashes here.

File details

Details for the file embedchain-0.0.78-py3-none-any.whl.

File metadata

  • Download URL: embedchain-0.0.78-py3-none-any.whl
  • Upload date:
  • Size: 110.8 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/4.0.2 CPython/3.11.6

File hashes

Hashes for embedchain-0.0.78-py3-none-any.whl
Algorithm Hash digest
SHA256 5cbe35be924b130d6e0160bf0cf80f248163820e8f251aa2381bcafba032b154
MD5 a164b6d9a8bc487598bf2adbaf1e4a74
BLAKE2b-256 022ce4617880060d79a8faf4487307c990506852f58b1766747ea194d60c1f61

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page