Substreams sink sql. Choose one of the following methods depending on your needs: Using Rela...

Substreams sink sql. Choose one of the following methods depending on your needs: Using Relational Mappings "from-proto" Enables foreign key relationships in your SQL schema. g. The Substreams SQL sink can be configured in multiple ways. Sinks The Substreams:SQL Sink allows you to consume the data extracted from the blockchain through a SQL database. Added handle_block_duration to postgres sink stats periodic logger to show how long from start to finish handling a block takes (this make more sense once live Oct 25, 2024 · Substreams Tutorial — Sink events from an Ethereum smart contract to an SQL database Ed from StreamingFast gives a quick tutorial on how to use Substreams to easily sink events from an Ethereum smart contract to an SQL database. Note Or install from source directly go install github. DatabaseChanges mode improvements Fixed Clickhouse table fetching to ignore materialized columns when inserting data. Quick Start Install and configure substreams-sink-sql in a project, define a manifest with a DSN for your database, run the setup to initialize the schema, and execute the sink to start streaming data into your SQL store. If a column is materialized from another one, the column is skipped for data insertion coming from the Substreams. How-To Guides Consuming Substreams Once you find a package that fits your needs, you can choose how you want to consume the data. Sinks are integrations that allow you to send the extracted data to different destinations, such as a SQL database, or a file. Install substreams-sink-sql by using the pre-built binary release available in the releases page. The Substreams:SQL sink helps you quickly and easily sync Substreams modules to a PostgreSQL or Clickhouse database. com Sep 19, 2025 · The substreams-sink-sql contains a fast injection mechanism for cases where big data needs to be dump into the database. Sink your Substreams Choose a sink that meets your project’s needs. Overview Once you find a package that fits your needs, you can choose how you want to consume the data. . Feb 16, 2026 · Delta update support in Substreams Sink SQL is a meaningful improvement for onchain data pipelines. , primary and foreign keys). substreams-sink-clickhouse is a tool to pipe in data from the blockchain into a ClickHouse database The core function of the SQL sink is to translate your Substreams output (Protobuf data) into SQL tables. While the sink configuration in the substreams. It supports two different Substreams output formats, each with distinct advantages: The Substreams:SQL Sink allows you to consume the data extracted from the blockchain through a SQL database. Sinks are integrations that allow you to send the extracted data to different destinations, such as a SQL database or a file. Extract substreams-sink-sql binary into a folder and ensure this folder is referenced globally via your PATH environment variable. In those cases, it may be preferable to dump every files to CSV and then use COPYFROM to transfer data super quick to Postgres. Pushing aggregation logic to Postgres keeps Substreams lighter and faster, while enabling native, incremental SQL aggregations (counts, sums, volumes). Requires adding annotations to your Protobuf messages (e. yaml file is optional, it can be useful for setting default parameters and advanced configurations. oqqj ifbf htplgbtpo ttaj kxtzb