pytablereader 0.21.1

A Python library to load structured table data from files/strings/URL with various data format: CSV / Excel / Google-Sheets / HTML / JSON / LDJSON / LTSV / Markdown / SQLite / TSV.

pytablereader

Table of Contents

• Summary

  • Features

• Examples

  • Load a CSV table

  • Get loaded table data as pandas.DataFrame instance

  • For more information

• Installation

• Dependencies

  • Mandatory Python packages

  • Optional Python packages

  • Optional packages (other than Python packages)

  • Test dependencies

• Documentation

• Related Project

Summary

A Python library to load structured table data from files/strings/URL with various data format: CSV / Excel / Google-Sheets / HTML / JSON / LDJSON / LTSV / Markdown / SQLite / TSV.

Features

• Extract structured tabular data from various data format:

  • CSV

  • Microsoft Excel ^TM file

  • Google Sheets

  • HTML

  • JSON

  • Labeled Tab-separated Values (LTSV)

  • Line-delimited JSON(LDJSON)/NDJSON/JSON Lines

  • Markdown

  • MediaWiki

  • Space separated values (SSV)

  • SQLite database file

  • Tab separated values (TSV)

• Supported data sources are:

  • Files on a local file system

  • Accessible URLs

  • str instances

• Loaded table data can be used as:

  • pandas.DataFrame instance

  • dict instance

Examples

Load a CSV table

Sample Code:

import pytablereader as ptr
import pytablewriter as ptw


# prepare data ---
file_path = "sample_data.csv"
csv_text = "\n".join([
    '"attr_a","attr_b","attr_c"',
    '1,4,"a"',
    '2,2.1,"bb"',
    '3,120.9,"ccc"',
])

with open(file_path, "w") as f:
    f.write(csv_text)

# load from a csv file ---
loader = ptr.CsvTableFileLoader(file_path)
for table_data in loader.load():
    print("\n".join([
        "load from file",
        "==============",
        "{:s}".format(ptw.dump_tabledata(table_data)),
    ]))

# load from a csv text ---
loader = ptr.CsvTableTextLoader(csv_text)
for table_data in loader.load():
    print("\n".join([
        "load from text",
        "==============",
        "{:s}".format(ptw.dump_tabledata(table_data)),
    ]))

Output:

load from file
==============
.. table:: sample_data

    ======  ======  ======
    attr_a  attr_b  attr_c
    ======  ======  ======
         1     4.0  a
         2     2.1  bb
         3   120.9  ccc
    ======  ======  ======

load from text
==============
.. table:: csv2

    ======  ======  ======
    attr_a  attr_b  attr_c
    ======  ======  ======
         1     4.0  a
         2     2.1  bb
         3   120.9  ccc
    ======  ======  ======

Get loaded table data as pandas.DataFrame instance

Sample Code:

import pytablereader as ptr

loader = ptr.CsvTableTextLoader(
    "\n".join([
        "a,b",
        "1,2",
        "3.3,4.4",
    ]))
for table_data in loader.load():
    print(table_data.as_dataframe())

Output:

     a    b
0    1    2
1  3.3  4.4

For more information

More examples are available at https://pytablereader.rtfd.io/en/latest/pages/examples/index.html

Installation

pip install pytablereader

Dependencies

Python 2.7+ or 3.4+

Mandatory Python packages

• beautifulsoup4

• DataPropery (Used to extract data types)

• jsonschema

• logbook

• markdown2

• mbstrdecoder

• pathvalidate

• path.py

• requests

• six

• tabledata

• typepy

• xlrd

Optional Python packages

• pypandoc

  • required when loading MediaWiki file

• pandas

  • required to get table data as a pandas data frame

• simplejson

• lxml

Optional packages (other than Python packages)

• libxml2 (faster HTML conversion)

• pandoc (required when loading MediaWiki file)

Test dependencies

• pytablewriter

• pytest

• pytest-runner

• responses

• SimpleSQLite

• tox

Documentation

https://pytablereader.rtfd.io/

Related Project

• pytablewriter

  • Tabular data loaded by pytablereader can be written another tabular data format with pytablewriter.