wandb-core 0.16.0b1

W&B Core Library

W&B Nexus: the New "Bones" for the W&B SDK

What is Nexus

Greetings, developers!

What is W&B Nexus? At the highest level, Nexus is the new "bones" for the W&B SDK.

Why would anyone care and want to use it? There are numerous reasons, but here are just two:

• It's faster. A lot faster. We're talking 10x faster for some operations.
• It enables clean multi-language support.

For those technical folks out there, nexus is a Golang reimplementation of the W&B SDK internal process, wandb service, based on the lessons learned from the original implementation(s), but starting from a clean slate.

Installation

To install Nexus, you will need to run the following commands:

pip install "wandb[nexus]==0.16.0b1"

Supported Platforms

Nexus is currently supported on the following platforms:

• Linux:x86_64, aarch64
• macOS: x86_64, arm64
• Windows amd64

If you are using a different platform, you can build Nexus from source by following the instructions in the contributing guide. Please also open a GitHub issue to let us know that you are interested in using Nexus on your platform, and we will prioritize adding support for it.

Usage example

While Nexus is still in development, you need to explicitly opt in to use it.

import wandb

wandb.require("nexus")

# Your code here using the W&B SDK

Contributing

Please read our contributing guide to learn to set up your development environment and how to contribute to the codebase.

Feedback

Please give Nexus a try and let us know what you think, we believe it is worth it!

We are very much looking forward for your feedback, especially bug reports. Please open a GitHub issue if you encounter an error and mention that you are using Nexus.

Feature Parity Status

The following table shows the status of feature parity between the current W&B SDK and Nexus for version 0.16.0b1.

Status legend:

• ✅: Available: The feature is relatively stable and ready for use.
• 🚧: In Development: The feature is available, but may be unstable or incomplete.
• ❌: Not Available: The feature is not yet available.

Category	Feature	Status
Experiments
	init	✅[^E.1][^E.10][^E.11]
	log	✅[^E.2]
	log_artifact	❌[^E.3]
	log_code	❌[^E.4]
	config	✅
	summary	✅
	define_metric	🚧[^E.5]
	tags	✅
	notes	✅
	name	✅
	alert	✅
	save	🚧[^E.6]
	restore	✅
	mark_preempting	✅
	resume	✅
	reinit	✅
	Media	🚧[^E.7]
	Grouping	✅
	anonymous mode	✅
	offline mode	✅
	disabled mode	✅
	multiprocessing	✅
	TensorBoard sync	❌
	console logging	🚧[^E.8]
	system metrics	🚧[^E.9]
	system info	✅
	code saving	🚧[^E.11]
	Settings	🚧[^E.12]
Login
	default entity	✅
	team entity	✅
	service account	✅
CLI		🚧[^CLI.1]
Artifacts		❌[^A.1]
Launch		❌[^L.1]
Sweeps		🚧[^S.1]

[^E.1]: sync_tensorboard requires TensorBoard support. [^E.2]: wandb.Table is not supported. Requires Artifacts support. [^E.3]: log_artifact is not yet supported. Requires Artifacts support. [^E.4]: log_code is not yet supported. Requires Artifacts support. [^E.5]: define_metric only supports default summary. [^E.6]: save only support now and end policy. live policy will be treated as end. [^E.7]: wandb.Table is not supported. Requires Artifacts support. [^E.8]: Only raw console logging is supported. [^E.9]: Supported system metrics: CPU, Memory, Disk, Network, NVIDIA GPU. [^E.10]: The "live" policy is not yet supported, it will be treated as "end". [^E.11]: Automatic code saving in Notebooks is not yet supported. Requires Artifacts support. [^E.12]: TODO: list unsupported settings. (anonymous, _flow_control*, _stats_open_metrics_endpoints, ...) [^CLI.1]: The CLI works, but uses the current Python backend under the hood for some commands. Expect the CLI to be rewritten to use the new backend. [^A.1]: Artifacts support is not yet available. Expect Artifacts to be supported soon. [^L.1]: Launch is not yet supported. Requires Artifacts support. [^S.1]: Requires verification.