pytablereader 0.6.8

pytablereader is a python library to load structured table data from files/URL with various data format: CSV/HTML/JSON/Markdown/MediaWiki/MediaWiki/Excel.

pytablereader

Summary

pytablereader is a python library to load structured table data from files/URL with various data format: CSV/HTML/JSON/Markdown/MediaWiki/MediaWiki/Excel.

Feature

• Extract structured table data from various data format:

  • CSV file/text

  • Microsoft Excel ^TM file

  • HTML file/text

  • JSON file/text

  • Markdown file/text

  • MediaWiki file/text

• Supported data sources to read:

  • Files

  • URL

Examples

Load a CSV table

from __future__ import print_function
import pytablereader

# prepare data ---
file_path = "sample_data.csv"
csv_text = "\n".join([
    '"attr_a","attr_b","attr_c"',
    '1,4,"a"',
    '2,2.1,"bb"',
    '3,120.9,"ccc"',
])

with open(file_path, "w") as f:
    f.write(csv_text)

# load from a csv file ---
loader = pytablereader.CsvTableFileLoader(file_path)
for table_data in loader.load():
    print("\n".join([
        "load from file",
        "==============",
        "{:s}".format(table_data.dumps()),
    ]))

# load from a csv text ---
loader = pytablereader.CsvTableTextLoader(csv_text)
for table_data in loader.load():
    print("\n".join([
        "load from text",
        "==============",
        "{:s}".format(table_data.dumps()),
    ]))

load from file
==============
.. table:: sample_data

    ======  ======  ======
    attr_a  attr_b  attr_c
    ======  ======  ======
         1     4.0  a
         2     2.1  bb
         3   120.9  ccc
    ======  ======  ======

load from text
==============
.. table:: csv2

    ======  ======  ======
    attr_a  attr_b  attr_c
    ======  ======  ======
         1     4.0  a
         2     2.1  bb
         3   120.9  ccc
    ======  ======  ======

For more information

More examples are available at http://pytablereader.readthedocs.org/en/latest/pages/examples/index.html

Installation

pip install pytablereader

Dependencies

Python 2.7+ or 3.3+

Mandatory Python packages

• beautifulsoup4

• DataPropery (Used to extract data types)

• jsonschema

• pathvalidate

• path.py

• requests

• six

• xlrd

Optional Python packages

• pypandoc

  • required when loading MediaWiki file

• pandas

  • required to get table data as a pandas data frame

Optional packages (other than Python packages)

• lxml (faster HTML convert if installed)

• pandoc (required when loading MediaWiki file)

Test dependencies

• pytest

• pytest-runner

• tox

• XlsxWriter

Documentation

http://pytablereader.readthedocs.org/en/latest/

Related Project

• pytablewriter

  • Loaded table data with pytablereader can write another table format by pytablewriter.