GCS / S3

Set up a fully managed data pipeline to export data to a GCS / S3 bucket in a one-off or recurring fashion.

The GCS / S3 integration is included on paid Shadow Fork plans.

The GCS / S3 integration is available for One-off Exports and Recurring Exports. It's ideal for teams who need historical blockchain data for analytics or research use cases that don’t require real-time data freshness. Data exports to GCS / S3 offer the highest flexibility, allowing you to upload data into tools that you already use such as Snowflake, Metabase, etc.

When you set up a data export to GCS / S3, you’ll be able to specify:

1. Which contracts and events to export

2. The file format (CSV or Parquet)

3. How often you want the data delivered to your bucket (daily, hourly, every 15 min)

4. How to partition the data (daily, hourly, or no partitioning)

See the One-off Exports or Recurring Exports pages for additional information.