Skip to the page
Get started – free

AirbyteComing soon

Sync the live web data SpecStream finds into any Airbyte destination. Every record lands with each value next to the page it was read from and the time it was read. New data from a schedule arrives on the next sync.

SpecStream for AirbyteData & warehouses
SpecStream for Airbyte is coming soon

Airbyte's catalog doesn't list the SpecStream source yet; it is in review. It works today as a custom connector: import manifest.yaml from the source-specstream folder (opens in a new tab) into Airbyte's Connector Builder, name it SpecStream, publish it to your workspace, and start at step 2.

What you need

  • A SpecStream account. New accounts get $10 of work free, no card.
  • Airbyte Cloud or open source Airbyte, with a destination already set up.
  • A SpecStream API key with read permission. Step 1 makes one.

  1. 1. Create an API key

    In the SpecStream workspace, open Agents & API, choose API keys, then choose Create API key.

    The source only reads, so give the key read permission and a spending limit of $0. To sync a single project, limit the key to that project. Copy the key when it appears: SpecStream doesn't show it again. More on API keys.

  2. 2. Add SpecStream as a source

    In Airbyte, add a new source and choose SpecStream. Fill in the form:

    API key: paste the key from step 1.

    Start date: optional. Use the form 2026-01-01T00:00:00Z to sync only lists created on or after that time. Leave it empty to sync every list.

    Airbyte tests the source by reading your lists. If SpecStream refuses the key, Airbyte reports a configuration error that tells you to create a new key under Agents & API.

  3. 3. Connect it to a destination

    Create a connection from the SpecStream source to your destination and select the lists and records streams. Each one supports full refresh and incremental sync.

    Pick an incremental mode so later syncs read only the lists created since the previous sync.

  4. 4. Run the first sync

    Start a sync from the connection. The first sync reads every list the key can open, with each list's records.

What arrives

The table shows each stream's primary key and the field its incremental sync follows.

StreamOne row perPrimary keyIncremental on
listsListidcreated_at
recordsRecord in a listlist_id and record_idlist_created_at

List rows

A lists row has the list's ID and name, its kind (find, snapshot, import, or combined), whether you imported it, when it was created, and how many rows it has.

Record rows and sources

A records row carries these fields:

  • list_id, record_id, and list_created_at place the record in its list.
  • entity_id marks one company, place, person, or posting in every list it appears in, so you can join records across lists.
  • cells holds one entry per column with label, display, value, and provenance. Inside provenance, source_url is the page the value was read from and observed_at is when.
  • A value SpecStream couldn't read has an absence and no value.
  • provided holds the columns you supplied, for records of a list you imported.
  • field_values and also_in hold each column's values and the other lists a record appears in, for records of a combined list.

Keep it current

Give the Airbyte connection its own sync frequency. A schedule in SpecStream repeats a request on a cadence you set, and each run's new and changed records arrive as a new list. In incremental mode, lists Airbyte already synced aren't read again.

Limits and cost

Syncing costs nothing. The source reads your lists and records, and it never starts a request or spends from your SpecStream balance.

The source retries rate limits (429) and server errors up to five times with exponential backoff, and it waits as long as a Retry-After header asks.

The requests that find your data are paid from your balance, only for the results that match. See balance, quotes, and billing.

Disconnect

Delete the source in Airbyte to stop syncing, or revoke the key under Agents & API to cut access at once. Data already in your destination stays there. More tools are in Connect your tools. For help, email [email protected].

More

SpecStream for Airbyte covers what it does in Airbyte on one page. Every other tool has its guide in Connect your tools. You see the most a request can cost before it starts, and only the matches come out of your balance. Billing has the details. For help, email [email protected].