Skip to main content

Databricks bundle for the Bricksflow framework

Project description

Databricks bundle

This bundle allows you to write beautiful function-based notebooks.

alt text

Compared to bare notebooks, the function-based approach brings the following advantages:

  1. create and publish auto-generated documentation and lineage of notebooks and pipelines (Bricksflow PRO)
  2. write much cleaner notebooks with properly named code blocks
  3. (unit)test specific notebook functions with ease
  4. use YAML to configure your notebooks for given environment (dev/test/prod/...)
  5. utilize pre-configured objects to automate repetitive tasks

Function-based notebooks have been designed to provide the same user-experience as bare notebooks. Just write the function, annotate it with the @notebookFunction decorator and run the cell.

This bundle is the main part of the Bricksflow framework.

Installation

Install the bundle via Poetry:

$ poetry add databricks-bundle && poetry add databricks-connect --dev

Usage

  1. Writing function-based notebooks
  2. Using pre-configured objects
  3. Configuring notebook functions
  4. Databricks Connect setup

Project details


Release history Release notifications | RSS feed

This version

0.7.0

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distributions

No source distribution files available for this release.See tutorial on generating distribution archives.

Built Distribution

databricks_bundle-0.7.0-py3-none-any.whl (28.0 kB view hashes)

Uploaded Python 3

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page