Parsing SQL Dumps to JSON Objects
Project description
README
Parsing SQL dumps into JSON objects. A tool for administrators, data scientists and hackers. The dump is not read entirely into RAM, so this utility can be used to process files of any size. And it can even parse corrupted dumps. Use jq to process JSON (sort, filter and etc).
Supported DBMS: MySQL, SQL Server, PotsgreSQL and some other (not all formats).
Installation for normal Arch-based ditros:
# install pipx
yay -S python-pipx
# install package from pypi
pipx install sqldump2json
# install lastet version from github
pipx install git+https://github.com/s3rgeym/sqldump2json.git
For crappy distros like Ubuntu you need to do more steps:
- Install pyenv or asdf-vm.
- Install latest python version and make it global via pyenv or asdf-vm.
- Install sqldump2json.
- OR use Docker.
Insert statements are converted to JSON objects on each new line (JSONL):
$ sqldump2json -i tests/dump.sql
{"table_name": "actor", "values": [1, "PENELOPE", "GUINESS", "2006-02-15 04:34:33"]}
{"table_name": "actor", "values": [2, "NICK", "WAHLBERG", "2006-02-15 04:34:33"]}
{"table_name": "actor", "values": [3, "ED", "CHASE", "2006-02-15 04:34:33"]}
...
Filter and convert to TSV:
$ sqldump2json -i tests/dump.sql | jq -r 'select(.table_name == "actor").values | @tsv'
1 PENELOPE GUINESS 2006-02-15 04:34:33
2 NICK WAHLBERG 2006-02-15 04:34:33
3 ED CHASE 2006-02-15 04:34:33
...
Hex strings are converted to base64:
sqldump2json -i tests/dump.sql | tail -4 | head -1 | jq -r '.values[4]' | base64 -d > image.png
Supports basic arifmetic and boolean operations (i know it's useless):
$ echo 'insert into test (result) values (-2 + 2 * 2);' | sqldump2json
{"table_name": "test", "values": {"result": 2}}
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Hashes for sqldump2json-0.2.3-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 4514863c98fc046dde476e47e0648a85078b818ea9c39aa5ffbaa3a38a834bda |
|
MD5 | 3af1b1926a2d6b2b618586d56699d036 |
|
BLAKE2b-256 | f5e3b7fc6b527c90a693ed156ea6ae5d0a6c1eb56b86fda3cbae5f7a091b86f8 |