unfurl 0.0.1.dev144

use Git to record and deploy changes to your DevOps infrastructure

WARNING: Under heavy construction!

What is Unfurl?

At its most ambitious, Unfurl aims to be a decentralized package manager for the Internet, enabling you to easily deploy and integrate live services.

More simply, it is a tool that works with Git to record and deploy changes to your DevOps infrastructure. Unfurl transforms a Git repo into a reproducible history of deployed services.

Goals

• Next-level GitOps: both configuration and operational status stored in git
• Hermetic: tracks exact version of environment and deployment artifacts
• Reproducible: hermetic builds + git + locked-down, immutable infrastructure = full reproducibility
• Incremental: only applies necessary changes
• Fast: the above three features combined enable lightening-fast updates
• Configuration tool agnostic and includes built-in support for Ansible and Terraform
• Secrets: key manager integration; keeps secrets out of git so repos can be safely made public
• No server, no agent: simple, stand-alone CLI that can be used both as development tool on client or for automated production deployment on a server
• Dependency management: Easily track dependencies and changes across infrastructure layers and boundaries.
• Zero installation: Uses client-side container support to bootstrap and automate installation requirements.

Features

• Specifications, instance status, and change history authored and recorded in a simple YAML vocabulary.
• Or use TOSCA's (Topology and Orchestration Specification for Cloud Applications) YAML vocabulary for more carefully typed specifications.
• Editor friendly config files:
  • Comments, order, and whitespace are preserved.
  • Syntactic macros for YAML provide generic facility for re-use and avoiding verbose, boiler-plate
• Path-based query DSL to express dynamic relationships between resources and configurations
• Ansible-compatible Jinja2 templates
• Records history of changes and commits them to a Git repository.
• API for dynamic configuration allows scripted specifications to be recorded alongside declarative ones.

Concepts

• Topology templates specify how resources should be configured using the TOSCA standard. Templates live in their own git repos.
• Resource manifests describe the current state of resources and maintain a history of changes applied to those resources. Each manifest lives in its own git repo, which corresponds to the lifespan of the resources represented in the manifest.
• Configurators apply changes to resources using the spec. Configurators are themselves first-class resources, so client-side installations can be hermetically bootstrapped too.

Usage:

unfurl init [project]

Creates a new Unfurl project including new git repositories for the specification and the instances. It will have the following directory structure:

project/ spec/ # Git repository containing the specification and related artifacts instances/current/ # Git repository containing manifest.yaml unfurl.yaml # local configuration file for the project

unfurl clone [path to project or specific instance repository]

Clones the project or repository into a new project

unfurl newinstance [path to project] [manifest-template.yaml]

Create new instance repo using "manifest-template.yaml" (defaults to the project's spec/manifest-template.yaml)

Installation

Requirements

Python (2.7, 3.5, or 3.6); git; docker 13 or later

From source

Developing

Clone https://github.com/onecommons/unfurl

To build documentation: Run tox -e docs.

Running unit tests

You can use tox to run the unit tests inside the supported python environments with the latest source installed. Install tox pip install tox and then run tox in source root. To install the dependencies you may need header files installed by the following OS packages: python-dev, libcrypt-dev, openssl-dev. (Note: if installation of a dependency fails, reinvoke tox with -r to recreate the test environment.)

Arguments after -- are passed to the test runner, e.g. to run an individual test: tox -- -p test_runtime.py.

Getting Started

1. create a repo
2. configure unfurl
   1. kms setup: add credentials
   2. create manifest with root resource: configure using kms
   3. (optional) run bootstrap to create a secure root resource
3. start creating your manifest