Skip to main content

Parser tools for Mozilla's Glean telemetry

Project description

Glean Parser

Parser tools for Mozilla’s Glean telemetry.

Features

Parses the metrics.yaml files for the Glean telemetry SDK and produces output for various integrations.

Documentation

The full documentation is available here.

Requirements

  • Python 3.5 (or later)

The following library requirements are installed automatically when glean_parser is installed by pip.

  • appdirs

  • Click

  • diskcache

  • inflection

  • Jinja2

  • jsonschema

  • PyYAML

Additionally on Python 3.6 and 3.5:

  • backports-datetime-fromisoformat

And on Python 3.5:

  • pep487

Usage

$ glean_parser --help

Read in metrics.yaml, translate to kotlin format, and output to output_dir:

$ glean_parser translate -o output_dir -f kotlin metrics.yaml

Check a Glean ping against the ping schema:

$ glean_parser check < ping.json

History

Unreleased

1.14.0 (2019-12-06)

  • glean_parser now supports Python versions 3.5, 3.6, 3.7 and 3.8.

1.13.0 (2019-12-04)

  • The translate command will no longer clear extra files in the output directory.

  • BUGFIX: Ensure all newlines in comments are prefixed with comment markers

  • BUGFIX: Escape Swift keywords in variable names in generated code

  • Generate documentation for pings that are sent if empty

1.12.0 (2019-11-27)

  • Reserve the deletion_request ping name

  • Added a new flag send_if_empty for pings

1.11.0 (2019-11-13)

  • The glinter command now performs yamllint validation on registry files.

1.10.0 (2019-11-11)

  • The Kotlin linter detekt is now run during CI, and for local testing if installed.

  • Python 3.8 is now tested in CI (in addition to Python 3.7). Using tox for this doesn’t work in modern versions of CircleCI, so the tox configuration has been removed.

  • yamllint has been added to test the YAML files on CI.

  • ⚠ Metric types that don’t yet have implementations in glean-core have been removed. This includes enumeration, rate, usage, and use_counter, as well as many labeled metrics that don’t exist.

1.9.5 (2019-10-22)

  • Allow a Swift lint for generated code

  • New lint: Restrict what metric can go into the ‘baseline’ ping

  • New lint: Warn for slight misspellings in ping names

  • BUGFIX: change Labeled types labels from lists to sets.

1.9.4 (2019-10-16)

  • Use lists instead of sets in Labeled types labels to ensure that the order of the labels passed to the metrics.yaml is kept.

  • glinter will now check for duplicate labels and error if there are any.

1.9.3 (2019-10-09)

  • Add labels from Labeled types to the Extra column in the Markdown template.

1.9.2 (2019-10-08)

  • BUGFIX: Don’t call is_internal_metric on Ping objects.

1.9.1 (2019-10-07)

  • Don’t include Glean internal metrics in the generated markdown.

1.9.0 (2019-10-04)

  • Glinter now warns when bug numbers (rather than URLs) are used.

  • BUGFIX: add HistogramType and MemoryUnit imports in Kotlin generated code.

1.8.4 (2019-10-02)

  • Removed unsupported labeled metric types.

1.8.3 (2019-10-02)

  • Fix indentation for generated Swift code

1.8.2 (2019-10-01)

  • Created labeled metrics and events in Swift code and wrap it in a configured namespace

1.8.1 (2019-09-27)

  • BUGFIX: memory_unit is now passed to the Kotlin generator.

1.8.0 (2019-09-26)

  • A new parser config, do_not_disable_expired, was added to turn off the feature that expired metrics are automatically disabled. This is useful if you want to retain the disabled value that is explicitly in the metrics.yaml file.

  • glinter will now report about superfluous no_lint entries.

1.7.0 (2019-09-24)

  • A “glinter” tool is now included to find common mistakes in metric naming and setup. This check is run during translate and warnings will be displayed. ⚠ These warnings will be treated as errors in a future revision.

1.6.1 (2019-09-17)

  • BUGFIX: GleanGeckoMetricsMapping must include LabeledMetricType and CounterMetricType.

1.6.0 (2019-09-17)

  • NEW: Support for outputting metrics in Swift.

  • BUGFIX: Provides a helpful error message when geckoview_datapoint is used on an metric type that doesn’t support GeckoView exfiltration.

  • Generate a lookup table for Gecko categorical histograms in GleanGeckoMetricsMapping.

  • Introduce a ‘Swift’ output generator.

1.4.1 (2019-08-28)

  • Documentation only.

1.4.0 (2019-08-27)

  • Added support for generating markdown documentation from metrics.yaml files.

1.3.0 (2019-08-22)

  • quantity metric type has been added.

1.2.1 (2019-08-13)

  • BUGFIX: includeClientId was not being output for PingType.

1.2.0 (2019-08-13)

  • memory_distribution metric type has been added.

  • custom_distribution metric type has been added.

  • labeled_timespan is no longer an allowed metric type.

1.1.0 (2019-08-05)

  • Add a special all_pings value to send_in_pings.

1.0.0 (2019-07-29)

  • First release to start following strict semver.

0.1.0 (2018-10-15)

  • First release on PyPI.

Project details


Release history Release notifications | RSS feed

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

glean_parser-1.14.0.tar.gz (162.8 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

glean_parser-1.14.0-py3-none-any.whl (45.1 kB view details)

Uploaded Python 3

File details

Details for the file glean_parser-1.14.0.tar.gz.

File metadata

  • Download URL: glean_parser-1.14.0.tar.gz
  • Upload date:
  • Size: 162.8 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/1.13.0 pkginfo/1.5.0.1 requests/2.22.0 setuptools/41.6.0 requests-toolbelt/0.8.0 tqdm/4.40.1 CPython/3.7.5

File hashes

Hashes for glean_parser-1.14.0.tar.gz
Algorithm Hash digest
SHA256 9aed2412c876d8030d679a71a9b084f66b6e1d32c1cf920bb8a9968de69f13d1
MD5 cf7adbae84d40ab313427d2b0bb665c9
BLAKE2b-256 77b0304afef5c9638e9331239a8d2d22704ffede96863d8fe2cccee8e62404f6

See more details on using hashes here.

File details

Details for the file glean_parser-1.14.0-py3-none-any.whl.

File metadata

  • Download URL: glean_parser-1.14.0-py3-none-any.whl
  • Upload date:
  • Size: 45.1 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/1.13.0 pkginfo/1.5.0.1 requests/2.22.0 setuptools/41.6.0 requests-toolbelt/0.8.0 tqdm/4.40.1 CPython/3.7.5

File hashes

Hashes for glean_parser-1.14.0-py3-none-any.whl
Algorithm Hash digest
SHA256 35e5abc628815c48473ac259a6107a37c23e6762d1640a878fd940e01c350477
MD5 337ac67370241f9bcf243c5269a877f1
BLAKE2b-256 cd369dd63824437b422865635a62ac92bba05672900e48c699b75cb6451fe7c4

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page