Skip to main content

Train and build models for Argo / Kubernetes

Project description

Gordo


Building thousands of models with timeseries data to monitor systems.


Table of content

About

Gordo fulfills the role of inhaling config files and supplying components to the pipeline of:

  1. Fetching data
  2. Training model
  3. Serving model

Examples

See our example notebooks for how to develop with gordo locally.


Install

pip install --upgrade gordo

With additional extras: pip install gordo[postgres,mlflow]

Bleeding edge:
pip install git+https://github.com/equinor/gordo.git

Uninstall

pip uninstall gordo

Developer manual

This section will explain how to start development of Gordo.

How to prepare working environment

  • Install pip-tools
pip install --upgrade pip
pip install --upgrade pip-tools
  • Install requirements
pip install -r requirements/full_requirements.txt
pip install -r requirements/test_requirements.txt

How to update packages

Note: you have to install pip-tools version higher then 6 for requirements to have same multi-line output format.

To update some package in full_requirements.txt:

  • Change its version in requirements.in file;
  • Compile and upgrade requirements:
pip-compile --upgrade --output-file=full_requirements.txt mlflow_requirements.in postgres_requirements.in requirements.in  

How to run tests locally

Tests system requirements

To run tests it's required for your system to has (note: commands might differ from your OS):

  • Running docker process;
  • Available 5432 port for postgres container (postgresql container is used, so better to stop your local instance for tests running).

Run tests

List of commands to run tests can be found here. Running of tests takes some time, so it's faster to run tests in parallel:

python3 setup.py test

NOTE: this example is for Pycharm IDE to use breakpoints in the code of the tests.
On the configuration setup for test running add to Additional arguments: in pytest section following string: --ignore benchmarks --cov-report= --no-cov or TEMPORARY remove --cov-report=xml and --cov=gordo from pytest.ini file.

Project details


Release history Release notifications | RSS feed

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

gordo-4.0.0.tar.gz (360.0 kB view hashes)

Uploaded Source

Built Distribution

gordo-4.0.0-py3-none-any.whl (216.4 kB view hashes)

Uploaded Python 3

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page