Skip to main content

Train and build models for Argo / Kubernetes

Project description

Gordo


Building thousands of models with timeseries data to monitor systems.


About

Gordo fulfills the role of inhaling config files and supplying components to the pipeline of:

  1. Fetching data
  2. Training model
  3. Serving model

Components


Install

gordo-helm - you can use gordo helm chart from this repository to deploy gordo infrastructure to your Kubernetes cluster.

Python package

pip install --upgrade gordo

With additional extras: pip install gordo[postgres,mlflow]

Bleeding edge:
pip install git+https://github.com/equinor/gordo.git

Developer manual

This section will explain how to start development of Gordo.

Setup

Create and activate a virtual environment first. As a default option, it can be venv module.

Install pip-tools

pip install --upgrade pip
pip install --upgrade pip-tools

Install requirements

pip install -r requirements/full_requirements.txt
pip install -r requirements/test_requirements.txt

Install package:

python3 setup.py install

How to update packages

Note: you have to install pip-tools version higher then 6 for requirements to have same multi-line output format.

To update some package in full_requirements.txt:

  • Change its version in requirements.in file;
  • Compile and upgrade requirements:
pip-compile --upgrade --output-file=full_requirements.txt mlflow_requirements.in postgres_requirements.in requirements.in  

Examples

See our example notebooks for how to develop with gordo locally.

How to run tests locally

List of commands to run tests can be found here. Running of tests takes some time, so it's faster to run tests in parallel:

pytest -n auto -m 'not dockertest' --ignore benchmarks

Run docker-related tests:

pytest -m 'dockertest'

NOTE: To run tests it's required for your system to has (note: commands might differ from your OS):

  • Running docker daemon.
  • Available 5432 port for postgres container.

NOTE: this example is for Pycharm IDE to use breakpoints in the code of the tests.
On the configuration setup for test running add to Additional arguments: in pytest section following string: --ignore benchmarks --cov-report= --no-cov

Project details


Release history Release notifications | RSS feed

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

gordo-5.0.2.tar.gz (360.5 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

gordo-5.0.2-py3-none-any.whl (217.7 kB view details)

Uploaded Python 3

File details

Details for the file gordo-5.0.2.tar.gz.

File metadata

  • Download URL: gordo-5.0.2.tar.gz
  • Upload date:
  • Size: 360.5 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/4.0.2 CPython/3.10.11

File hashes

Hashes for gordo-5.0.2.tar.gz
Algorithm Hash digest
SHA256 c9d2cfaf407bd5bd4b92ecebab2c8d5f99da6e8adae2c112b1510b67337da2b6
MD5 a886de32351d42f85915ace7a3a4cdb7
BLAKE2b-256 ea4b2ec49d4295a7e86348ae93de5fd4f1082f56efb411914ff365c9c46f91a9

See more details on using hashes here.

File details

Details for the file gordo-5.0.2-py3-none-any.whl.

File metadata

  • Download URL: gordo-5.0.2-py3-none-any.whl
  • Upload date:
  • Size: 217.7 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/4.0.2 CPython/3.10.11

File hashes

Hashes for gordo-5.0.2-py3-none-any.whl
Algorithm Hash digest
SHA256 f8569b62a568aa5ef63e6249b61fdd5d2f1bb1f209340dc50dc3944ff47354a0
MD5 2ab11e2c5c267538cdc5c4b286c26505
BLAKE2b-256 3ae7076b1c1686b0353c0a4874425296f13b0af3246c848a7b564601907243b4

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page