Skip to main content

Utility for moving data between CKAN instances using the API

Project description

Overview

Utility to migrate data between two CKAN instances using the CKAN api.

Getting Started

config/transformationConfig.json

This file currently contains the configuration that is being used at DataBC for the transformation between prod and test. A detailed description of this file is available here

Running

Env vars:

Configure the following env vars:

  • export CKAN_API_KEY_TST=2jl4jslBoston_Bruins_Suck23kl4k
  • export CKAN_URL_TST=https://destination.ckan.instance.com
  • export CKAN_API_KEY_PRD=2liiow89jg0HAbSg0lsxnvzxvbw89sl
  • export CKAN_URL_PRD=https://source.ckan.instance.com
  • export CKAN_DO_NOT_WRITE_URL=<optional: source instance, adds checks to make sure not being written to>
  • export CKAN_NEW_USER_PSWD=
  • export CKAN_TRANSFORMATION_CONFIG=

environment variables and how they get consumed is configured in the constants.py file.

Running

python main.py

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

bcdc2bcdc-0.0.2.tar.gz (71.6 kB view hashes)

Uploaded Source

Built Distribution

bcdc2bcdc-0.0.2-py3-none-any.whl (82.0 kB view hashes)

Uploaded Python 3

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page