DataStreams a Subgraph query utility package that allows users to execute complex Subgraph queries. It provides extended functionality on top of The Graph data access python package Subgrounds. The main benefit is that now anyone can query Subgraph data, save it to their local storage as csv files, and perform data analytics immediately. DataStreams creates a reproducible data pipeline creation process in a transparent, lightweight manner. No database needed!
The main package in DataStreams is the Streamer
class. Streamer
streamlines the Subgraph query process in Python, exposing key information such as the queryable Subgraph schemas and filter clauses. In v1.0.0, functionality includes:
DRY Subgraph Query Code - reuse code to reduce complexity of Subgraph queries
Parallelized Subgraph Queries - Leverage the standard Python package concurrent
to unlock concurrency at the Subgraph query level
Query the Chainlink Subgraph node for multiple token prices over a customized ranged period. Example notebook found here
Query the Cowswap Subgraph node for four specific schemas with parallelization support. Example notebook found here