Skip to main content

Core module for Fishnet compute-over-data (CoD) network on Aleph.im

Project description

Fishnet

Fishnet stands for Financial time Series Hosting NETwork.

It is a Compute-over-Data (CoD) system that uses the distributed Aleph.im network as a substrate for computation. It is a decentralized, peer-to-peer, and serverless system that allows users to run statistical computations on their timeseries data without having to upload it to a centralized server.

This python module contains a common data model, built on the Aleph Active Record SDK (AARS), that is being used by the Fishnet API and executor VMs. The data model is used to store and query:

  • Timeseries & Datasets
  • Algorithms
  • Permissions
  • Executions
  • Results

Also contains the executor code for the Fishnet Executor VM. Right now it supports Pandas, but in the future it will support other execution environments (e.g. PyTorch, Tensorflow).

Roadmap

  • Basic message model
  • API for communicating with Fishnet system
    • Basic CRUD operations
    • Permission management
    • Timeslice distribution across executor nodes
    • Signature verification of requests
    • Local VM caching
  • Executor VM
    • Listens for Aleph "Execution" messages and executes them
    • Uploads results to Aleph
    • Pandas support
    • Distributed execution & aggregation
    • Different execution environments (e.g. PyTorch, Tensorflow)
    • GPU support

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

fishnet_cod-0.0.6.tar.gz (3.7 kB view hashes)

Uploaded Source

Built Distribution

fishnet_cod-0.0.6-py3-none-any.whl (4.4 kB view hashes)

Uploaded Python 3

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page