fakeme 0.0.3

Relative Data Generator: generate tables with data, that depend on each other

Fakeme

Data Generator for Chained and Relative Data

Documentation in process: https://fakeme.readthedocs.io/en/latest/

Use under the hood at current time:

• Mimesis (like one of the generators for fields values)

• Pandas (like main instrument to combain data in tables (frames)

• Standart Python Library

Support Python 3.7

What it does not do?

This is not random value generated library - for this exist pretty cool lib Mimesis and another.

For what it

Fakeme oriented on generation data that depend on values in another tables/datasets. Data, that knitted together as real.

Fakeme can help you if you want to generate several tables, that must contains in columns values, that you will use like key for join.

For example, user_data table has field user_id and users table contains list of users with column id. You want join it on user_id = id.

Fakeme will generate for you 2 tables with same values in those 2 columns.

It does not matter to have columns with same name you can define dependencies between tables with alias names.

What you can to do

1. Define that fields in your datasets must contain similar values

2. You can set up how much values must intersect, for example, you want to emulate data for email validation pipeline - you have one dataset with incoming messages and you need to find all emails that was not added previously in your contacts table.

So you will have incoming messages table, that contains, for example only 70% of emails that exist in contacts table.

3. You can use multiply columns as a key (dependency) in another column, for example, player_final_report must contains for each player same values as in other tables, for example, you have player table with players details and in_game_player_activity with all player activities for some test reasons it’s critical to you generate player_final_report with 1-to-1 data from other 2 tables.

4. Union tables. You can generate tables that contains all rows from another tables.

5. You can define your own generator for fields on Python.

6. You can define your own output format

Examples

You can find usage examples in ‘fakeme/examples/’ folder.

Example from fakeme/examples/generate_data_related_to_existed_files:

from fakeme import Fakeme

# to use some existed data you should provide with_data argument -
# and put inside list with the paths to the file with data

# data file must be in same format as .json or csv output of fakeme.
# so it must be [{"column_name": value, "column_name2": value2 ..},
#   {"column_name" : value, "column_name2": value2 ..}..]
# Please check example in countries.json

cities_schema = [{"name": "name"},
                 {"name": "country_id"},
                 {"name": "id"}]

# all fields are strings - so I don't define type, because String will be used as default type for the column

tables_list = [('cities', cities_schema)]

Fakeme(
    tables=tables_list,
    with_data=['countries.json'],
    rls={'cities': {  # this mean: for table 'cities'
        'country_id': {  # and column 'country_id' in table 'cities'
            'table': 'countries.json',   # please take data from data  in countries.json
            'alias': 'id',  # with alias name 'id'
            'matches': 1  # and I want all values in country_id must be from countries.id column, all.
        }
    }},
    settings={'row_numbers': 1300}  # we want to have several cities for each country,
                                    # so we need to have more rows,
).run()

# run and you will see a list of cities, that generated with same ids as in countries.json

Docs: https://fakeme.readthedocs.io/en/latest/