Integrations / Data & warehouses
SpecStream for Meltano
tap-specstream is a Singer tap on PyPI that loads live web data into any target your Meltano project runs.
What you get
- A values map and cellsEach record carries values, a label-to-value object for plain SQL. Its cells array keeps the source_url and observed_at behind every value.
- State on created_atThe tap saves state on created_at, so each meltano run reads only lists made since the last. A SpecStream schedule delivers new and changed records as a fresh list, so the next run picks them up.
- entity_id joins every runA company, place, person, or posting keeps the same entity_id in every list, so last month's records join this week's on that one column. Each row in the lists stream links to its list in SpecStream.
Set it up
- In meltano.yml, add tap-specstream as an extractor with pip_url tap-specstream and the catalog, discover, and state capabilities, then run meltano install.
- Set your key with meltano config tap-specstream set api_key. A key capped at $0 works, since the tap only reads.
- Run meltano run tap-specstream target-duckdb, or swap in whichever Singer target you load into.
The full setup guide has every step, with what to do if something doesn’t arrive.
Related integrations
See allLive web data, in Meltano
Ask in your own words for companies, places, people, filings or anything else the web lists. You see the price before anything runs and pay only for the matches.