Data / Repositories / Data engineering
Data engineering repositories on GitHub: 9 ranked by stars
9 public repositories tagged Data engineering are on GitHub, with 75,900 stars between them; 7 had a push in the last 30 days. Most are written in Python (4), Rust (2), Java (1). The most starred: kestra-io/kestra (29,583), PrefectHQ/prefect (24,019), semantica-agi/semantica (14,039).
SpecStream is the live web data engine for teams and agents. It reads open-source repositories on GitHub and keeps what it reads, and this page groups that reading by topic. Ask for the repositories you track by topic, language, license or activity, and new ones and changes arrive in your sheet, CRM, Slack or agent.
Every repository, most starred first
| Repository | What it is | Language | Stars | Forks | License | Last push | Read |
|---|---|---|---|---|---|---|---|
| kestra-io/kestra | Event Driven Orchestration & Scheduling Platform for Mission Critical Applications | Java | 29,583 | 3,381 | Apache-2.0 | Oct 14 | Oct 14 |
| PrefectHQ/prefect | Prefect is a workflow orchestration framework for building resilient data pipelines in Python. | Python | 24,019 | 2,577 | Apache-2.0 | Oct 13 | Oct 14 |
| semantica-agi/semantica | Graph-Native Infrastructure for Context and Accountable AI Systems | Python | 14,039 | 1,630 | MIT | Oct 14 | Oct 14 |
| dathere/qsv | Blazing-fast Data-Wrangling toolkit | Rust | 3,808 | 113 | Oct 10 | Oct 11 | |
| Hiflylabs/awesome-dbt | A curated list of awesome dbt resources | 1,736 | 185 | GPL-3.0 | Sep 5 | Oct 11 | |
| slothflowlabs/duckle | Open-source ETL/ELT you deploy on your own servers or cloud. Built on DuckDB: no-code/low-code visual pipelines or SQL, 385 components, dbt, CDC, data quality, reverse ETL… | Rust | 1,503 | 120 | Apache-2.0 | Oct 14 | Oct 14 |
| dbt-labs/dbt-mcp | A MCP (Model Context Protocol) server for interacting with dbt. | Python | 608 | 138 | Apache-2.0 | Oct 14 | Oct 14 |
| sderosiaux/every-single-day-i-tldr | A daily digest of the articles or videos I've found interesting, that I want to share with you. | 328 | 19 | Sep 2 | Oct 14 | ||
| jddevtime/open-lakehouse-compute-fabric | Open Lakehouse Compute Fabric: an open-source lakehouse platform with Microsoft Fabric Compute Extension. | Python | 276 | 275 | Apache-2.0 | Oct 19 | Oct 21 |
By language
- Python 4
Related topics
- Python 3
- MCP 3
- Automation 2
- Java 2
- Low code 2
- Orchestration 2
- Workflow 2
- AI 2
- LLM 2
- Kubernetes 2
- AI agents 1
- DEVOPS 1
Read from GitHub by SpecStream between October 11, 2026 and October 21, 2026; each row shows the day its repository was read. Stars and pushes change every day, and the GitHub page is the current one. Forks and archived repositories are left out.