Skip to main content

Manage and sync multiple git, mercurial, and svn repos

Project description

$ vcspull · Python Package License Code Coverage

Manage and sync multiple git, svn, and mercurial repos via JSON or YAML file. Compare to myrepos, mu-repo. Built on libvcs.

Great if you use the same repos at the same locations across multiple machines or want to clone / update a pattern of repos without having to cd into each one.

  • clone / update to the latest repos with $ vcspull
  • use filters to specify a location, repo url or pattern in the manifest to clone / update
  • supports svn, git, hg version control systems
  • automatically checkout fresh repositories
  • supports pip-style URL's (RFC3986-based url scheme)

See the documentation, configuration examples, and config generators.

How to

Install

$ pip install --user vcspull

Or using uv:

$ uv tool install vcspull

For one-time use without installation:

$ uvx vcspull

Developmental releases

You can test the unpublished version of vcspull before its released.

  • pip:

    $ pip install --user --upgrade --pre vcspull
    
  • pipx:

    $ pipx install --suffix=@next 'vcspull' --pip-args '\--pre' --force
    

    Then use vcspull@next sync [config]....

  • uv:

    $ uv tool install --prerelease=allow vcspull
    

Configuration

Add your repos to ~/.vcspull.yaml. You can edit the file by hand or let vcspull add, vcspull discover, or vcspull import create entries for you.

~/code/:
  flask: "git+https://github.com/mitsuhiko/flask.git"
~/study/c:
  awesome: "git+git://git.naquadah.org/awesome.git"
~/study/data-structures-algorithms/c:
  libds: "git+https://github.com/zhemao/libds.git"
  algoxy:
    repo: "git+https://github.com/liuxinyu95/AlgoXY.git"
    remotes:
      tony: "git+ssh://git@github.com/tony/AlgoXY.git"

(see the author's .vcspull.yaml, more configuration)

$HOME/.vcspull.yaml and $XDG_CONFIG_HOME/vcspull/ (~/.config/vcspull) can be used as a declarative manifest to clone your repos consistently across machines. Subsequent syncs of initialized repos will fetch the latest commits.

Add repositories from the CLI

Register a single repository by pointing at the checkout:

$ vcspull add ~/projects/libs/my-lib
  • vcspull infers the name from the directory and detects the origin remote. Pass --url when you need to record a different remote.
  • Override the derived name with --name and the workspace root with -w/--workspace.
  • --dry-run previews the update, while --yes skips the confirmation prompt.
  • -f/--file selects an alternate configuration file.
  • Append --no-merge if you prefer to review duplicate workspace roots yourself instead of having vcspull merge them automatically.
  • Follow with vcspull sync my-lib to clone or update the working tree after registration.

Discover local checkouts and add en masse

Have a directory tree full of cloned Git repositories? Scan and append them to your configuration:

$ vcspull discover ~/code --recursive

The scan shows each repository before import unless you opt into --yes. Add --workspace ~/code/ to pin the resulting workspace root or -f/--file to write somewhere other than the default ~/.vcspull.yaml. Duplicate workspace roots are merged by default; include --no-merge to keep them separate while you review the log.

Import from remote services

Pull repository lists from GitHub, GitLab, Codeberg, Gitea, Forgejo, or AWS CodeCommit directly into your configuration:

$ vcspull import github myuser \
    --workspace ~/code/ \
    --mode user
$ vcspull import gitlab my-group \
    --workspace ~/work/ \
    --mode org

Use --dry-run to preview changes, --https for HTTPS clone URLs, and --language/--topics/--min-stars to filter results. See the import documentation for all supported services and options.

Inspect configured repositories

List what vcspull already knows about without mutating anything:

$ vcspull list
$ vcspull list --tree
$ vcspull list --json | jq '.[].name'

--json emits a single JSON array, while --ndjson streams newline-delimited objects that are easy to consume from shell pipelines.

Search across repositories with an rg-like query syntax:

$ vcspull search django
$ vcspull search name:django url:github
$ vcspull search --fixed-strings 'git+https://github.com/org/repo.git'

Check repository status

Get a quick health check for all configured workspaces:

$ vcspull status
$ vcspull status --detailed
$ vcspull status --ndjson | jq --slurp 'map(select(.reason == "summary"))'

The status command respects --workspace/-w filters and the global --color {auto,always,never} flag. JSON and NDJSON output mirrors the list command for automation workflows.

Normalize configuration files

After importing or editing by hand, run the formatter to tidy up keys, merge duplicate workspace sections, and keep entries sorted:

$ vcspull fmt \
    --file ~/.vcspull.yaml \
    --write

Use vcspull fmt --all --write to format every YAML file that vcspull can discover under the standard config locations. Add --no-merge if you only want duplicate roots reported, not rewritten.

Sync your repos

$ vcspull sync --all

Preview planned work with Terraform-style plan output or emit structured data for CI/CD:

$ vcspull sync --dry-run "*"
$ vcspull sync --dry-run --show-unchanged "workspace-*"
$ vcspull sync --dry-run --json "*" | jq '.summary'
$ vcspull sync --dry-run --ndjson "*" | jq --slurp 'map(select(.type == "summary"))'

Dry runs stream a progress line when stdout is a TTY, then print a concise plan summary (+/~/✓/⚠/✗) grouped by workspace. Use --summary-only, --relative-paths, --long, or -v/-vv for alternate views, and --fetch/--offline to control how remote metadata is refreshed.

Keep nested VCS repositories updated too, lets say you have a mercurial or svn project with a git dependency:

external_deps.yaml in your project root (any filename will do):

./vendor/:
  sdl2pp: "git+https://github.com/libSDL2pp/libSDL2pp.git"

Clone / update repos via config file:

$ vcspull sync --file external_deps.yaml '*'

See the Quickstart for more.

Pulling specific repos

Have a lot of repos?

you can choose to update only select repos through fnmatch patterns. remember to add the repos to your ~/.vcspull.{json,yaml} first.

The patterns can be filtered by by directory, repo name or vcs url.

Any repo starting with "fla":

$ vcspull sync "fla*"

Any repo with django in the name:

$ vcspull sync "*django*"

Search by vcs + url, since urls are in this format +://:

$ vcspull sync "git+*"

Any git repo with python in the vcspull:

$ vcspull sync "git+*python*

Any git repo with django in the vcs url:

$ vcspull sync "git+*django*"

All repositories in your ~/code directory:

$ vcspull sync "$HOME/code/*"
image

Donations

Your donations fund development of new features, testing and support. Your money will go directly to maintenance and development of the project. If you are an individual, feel free to give whatever feels right for the value you get out of the project.

See donation options at https://tony.sh/support.html.

More information

Docs Build Status

Project details


Release history Release notifications | RSS feed

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

vcspull-1.57.0.tar.gz (2.5 MB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

vcspull-1.57.0-py3-none-any.whl (110.0 kB view details)

Uploaded Python 3

File details

Details for the file vcspull-1.57.0.tar.gz.

File metadata

  • Download URL: vcspull-1.57.0.tar.gz
  • Upload date:
  • Size: 2.5 MB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.7

File hashes

Hashes for vcspull-1.57.0.tar.gz
Algorithm Hash digest
SHA256 d18264c37ca78e95afbcd355acff28280ba0f667dab5f915d3a143c231bfb091
MD5 5902678175c0c15553ff7920bf606195
BLAKE2b-256 4a32eda9e249dd37fddfe3560da39bd08ec9172b7ff1608d7df6b6ce2d1d27d3

See more details on using hashes here.

Provenance

The following attestation bundles were made for vcspull-1.57.0.tar.gz:

Publisher: tests.yml on vcs-python/vcspull

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file vcspull-1.57.0-py3-none-any.whl.

File metadata

  • Download URL: vcspull-1.57.0-py3-none-any.whl
  • Upload date:
  • Size: 110.0 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.7

File hashes

Hashes for vcspull-1.57.0-py3-none-any.whl
Algorithm Hash digest
SHA256 cd97aee9cc2cf3ff01455550f50dc33fab1f027778c9bdf21e6afa7bded50bb0
MD5 85543738492a60e75e25e4a3343328ec
BLAKE2b-256 7c724c7a8b2b9b77d5b55bb3599c8df6237a1e6fdd80e22e024b9be35c4d9014

See more details on using hashes here.

Provenance

The following attestation bundles were made for vcspull-1.57.0-py3-none-any.whl:

Publisher: tests.yml on vcs-python/vcspull

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page