Skip to main content

Daipe framework development environment initializer

Project description

Development environment initialization

for the Daipe stack

What it does

Local Computer

  • Extends the Pyfony dev environment initialization
  • Downloads Hadoop's winutils.exe and puts it into the project's .venv directory (Windows only)
  • Downloads Java 1.8 binaries and puts them into the ~/.databricks-connect-java dir
  • Creates the empty ~/.databricks-connect file

Databricks Repos Environment

  • Download and install poetry package manager
  • Install dependencies from poetry.lock
  • Set current working directory to project root
  • Append src folder to sys path
  • Set proper environment variables

Usage

%sh
pip install benvy==1.2.0
from benvy.databricks.repos import bootstrap  # noqa
from benvy.databricks.detector import is_databricks_repo  # noqa

if is_databricks_repo():
    bootstrap.install()
from benvy.databricks.repos import bootstrap  # noqa
from benvy.databricks.detector import is_databricks_repo  # noqa

if is_databricks_repo():
    bootstrap.setup_env()
# %install_master_package_whl

Project details


Release history Release notifications | RSS feed

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

benvy-1.2.2.dev1.tar.gz (10.1 kB view hashes)

Uploaded Source

Built Distribution

benvy-1.2.2.dev1-py3-none-any.whl (18.7 kB view hashes)

Uploaded Python 3

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page