Streamline Subgraph Pipeline Creation With DataStreams

DataStreams a Subgraph query utility package that allows users to execute complex Subgraph queries. It provides extended functionality on top of The Graph data access python package Subgrounds. The main benefit is that now anyone can query Subgraph data, save it to their local storage as csv files, and perform data analytics immediately. DataStreams creates a reproducible data pipeline creation process in a transparent, lightweight manner. No database needed!

The main package in DataStreams is the Streamer class. Streamer streamlines the Subgraph query process in Python, exposing key information such as the queryable Subgraph schemas and filter clauses. In v1.0.0, functionality includes:

  • DRY Subgraph Query Code - reuse code to reduce complexity of Subgraph queries

  • Parallelized Subgraph Queries - Leverage the standard Python package concurrent to unlock concurrency at the Subgraph query level

Query the Chainlink Subgraph node for multiple token prices over a customized ranged period. Example notebook found here

Example #2 - Parallelized Multi Schema Query

Query the Cowswap Subgraph node for four specific schemas with parallelization support. Example notebook found here

Subscribe to 0xEvan
Receive the latest updates directly to your inbox.
Mint this entry as an NFT to add it to your collection.
Verification
This entry has been permanently stored onchain and signed by its creator.