gitforagebeta

Patches

data-engineering

Everything found in the data-engineering patch, on every walk so far.

  1. Specimen No. 001Habitat: PythonFound

    Tree ring: under a year old, growing this week, gaining stars fast

    hugues31/duckpad

    Score 11.4

    Seedlings

    A young Python specimen, spotted in the self-hosted patch. Barely out of the soil.

    In the maintainer's words The data transformation tool the open-source community deserves.

    • ~348 stars a month (new, 26d ago, top 2% in data-engineering)
    • pushed 2d ago
    • MIT licensed
    • self-hosted, matches your patch
    • data-engineering
    • duckdb
    • 302 stars
    • last growth
  2. Specimen No. 002Habitat: TypeScriptFound

    Tree ring: under a year old, growing this week, gaining stars fast

    ArteVisualenVivo/fabric-pipeline-express-7

    Score 11.1

    Seedlings

    A young find from in the data-engineering patch, rooted in TypeScript. Barely out of the soil.

    In the maintainer's words Event-driven OneLake pipeline with automated Upsert merge and Python reporting

    • ~319 stars a month (new, 14d ago, top 6% in data-engineering)
    • pushed today
    • MIT licensed
    • data-engineering
    • 149 stars
    • last growth
  3. Specimen No. 003Habitat: RustFound

    Tree ring: under a year old, growing this week, gaining stars fast

    slothflowlabs/duckle

    Score 10.8

    Seedlings

    Found in the duckdb patch: a young Rust specimen. Fresh from the seed bed.

    In the maintainer's words Open-source ETL/ELT you deploy on your own servers or cloud. Built on DuckDB: no-code/low-code visual pipelines or SQL, 446 components, dbt, CDC, data quality, reverse ETL, lineage, MCP for AI agents…

    • ~255 stars a month (new, 6 months ago, top 10% in data-engineering)
    • pushed today
    • Apache-2.0 licensed
    • mcp, matches your patch
    • self-hosted, matches your patch
    • data-engineering
    • duckdb
    • kubernetes
    • 1,557 stars
    • last growth
  4. Specimen No. 004Habitat: TypeScriptFound

    Tree ring: under a year old, growing this week, gaining stars fast

    Kaelio/ktx

    Score 10.5

    Seedlings

    A young TypeScript specimen, spotted in the ai-agents patch. Barely out of the soil.

    In the maintainer's words ktx is an executable context layer for data and analytics agents 🐙 Allow Claude Code, Codex, or other AI agents to query analytical databases accurately and with full context of your company

    • ~253 stars a month (new, 6 months ago, top 14% in data-engineering)
    • pushed 2d ago
    • Apache-2.0 licensed
    • ai-agents, matches your patch
    • llm, matches your patch
    • mcp, matches your patch
    • claude-code
    • data-engineering
    • 1,633 stars
    • last growth
  5. Specimen No. 005Habitat: TypeScriptFound

    Tree ring: under a year old, growing this week, gaining stars fast

    AltimateAI/altimate-code

    Score 10

    Seedlings

    Found in the cli patch: a young TypeScript specimen. Barely out of the soil.

    In the maintainer's words Open-source agentic data engineering harness for dbt, SQL, and cloud warehouses. 100+ tools, 10 warehouses, AI-powered.

    • ~92 stars a month (new, 9 months ago, top 33% in data-engineering)
    • pushed today
    • MIT licensed
    • like your stars: cli
    • cli, matches your patch
    • llm, matches your patch
    • postgresql, matches your patch
    • data-engineering
    • 822 stars
    • last growth
  6. Specimen No. 006Habitat: TypeScriptFound

    Tree ring: under a year old, growing this week, gaining stars fast

    getnao/nao

    Score 9.9

    Seedlings

    Found in the data-engineering patch: a young TypeScript specimen. Fresh from the seed bed.

    In the maintainer's words 👾 nao is the #1 open source agentic BI. (1) Create context with nao-core cli, (2) deploy nao chat interface for everyone

    • ~188 stars a month (new, 11 months ago, top 22% in data-engineering)
    • pushed today
    • a license licensed
    • postgresql, matches your patch
    • self-hosted, matches your patch
    • data-engineering
    • 2,034 stars
    • last growth
  7. Specimen No. 007Habitat: PythonFound

    Tree ring: under a year old, growing this week, gaining stars fast

    Hebbian-Robotics/hflow

    Score 9.6

    Seedlings

    Young Python growth, turned up in the duckdb patch. Barely out of the soil.

    In the maintainer's words SDK for robotics teams to verify the quality of their data used for AI model training.

    • ~99 stars a month (new, 3 months ago, top 25% in data-engineering)
    • pushed today
    • Apache-2.0 licensed
    • data-engineering
    • duckdb
    • 311 stars
    • last growth
  8. Specimen No. 008Habitat: PythonFound

    Tree ring: under a year old, growing this week, gaining stars fast

    ashishsinha1602/schemagate

    Score 8.8

    Seedlings

    A young find from in the security patch, rooted in Python. Barely out of the soil.

    In the maintainer's words Text-to-SQL access control: schema selection that gives the LLM only the tables the caller is allowed to read. Row-level-security-aware table pruning for LangChain, MCP and any SQL agent. Postgres, O…

    • ~51 stars a month (new, 3 months ago, top 37% in data-engineering)
    • pushed 2d ago
    • Apache-2.0 licensed
    • ai-agents, matches your patch
    • database, matches your patch
    • llm, matches your patch
    • mcp, matches your patch
    • postgresql, matches your patch
    • security, matches your patch
    • data-engineering
    • mcp-server
    • 127 stars
    • last growth
  9. Specimen No. 009Habitat: PythonFound

    Tree ring: under a year old, growing this month, gaining stars fast

    BlueRingsLabs/no-shortcuts

    Score 8.3

    Seedlings

    Young Python growth, turned up in the rag patch. Fresh from the seed bed.

    In the maintainer's words Free Course : Data, Machine Learning, Deep Learning and AI Engineering, the long way round: the math, the code, the systems and the security. 173 lessons, 166 runnable labs, no shortcuts. Free under …

    • ~97 stars a month (new, 55d ago, top 29% in data-engineering)
    • pushed 23d ago
    • a license licensed
    • llm, matches your patch
    • machine-learning, matches your patch
    • security, matches your patch
    • data-engineering
    • deep-learning
    • pytorch
    • rag
    • 177 stars
    • last growth
  10. Specimen No. 010Habitat: PythonFound

    Tree ring: under a year old, quiet for a month or more, gaining stars fast

    jddevtime/open-lakehouse-compute-fabric

    Score 8.2

    Seedlings

    A young Python specimen, spotted in the data-engineering patch. Barely out of the soil.

    In the maintainer's words Open Lakehouse Compute Fabric: an open-source lakehouse platform with Microsoft Fabric Compute Extension.

    • ~211 stars a month (new, 39d ago, top 18% in data-engineering)
    • pushed 32d ago
    • Apache-2.0 licensed
    • mcp, matches your patch
    • data-engineering
    • 274 stars
    • last growth
  11. Specimen No. 011Habitat: PythonFound

    Tree ring: under a year old, growing this week, gaining stars fast

    astronomer/agents

    Score 7.9

    Seedlings

    A young find from in the ai-agents patch, rooted in Python. A seedling, new this season.

    In the maintainer's words AI agent tooling for data engineering workflows.

    • ~45 stars a month (new, 10 months ago, top 49% in data-engineering)
    • pushed 1d ago
    • Apache-2.0 licensed
    • ai-agents, matches your patch
    • llm, matches your patch
    • mcp, matches your patch
    • data-engineering
    • 462 stars
    • last growth
  12. Specimen No. 012Habitat: RustFound

    Tree ring: under a year old, growing this week, gaining stars fast

    rocky-data/rocky

    Score 7.6

    Seedlings

    Found in the rust patch: a young Rust specimen. Barely out of the soil.

    In the maintainer's words A SQL transformation engine that type-checks your whole pipeline and catches breaking changes before they run — branches, replay, column-level lineage, compile-time contracts, per-model cost. Adapter…

    • ~42 stars a month (new, 7 months ago, top 52% in data-engineering)
    • pushed today
    • Apache-2.0 licensed
    • rust, matches your patch
    • data-engineering
    • duckdb
    • 311 stars
    • last growth
  13. Specimen No. 013Habitat: Jupyter NotebookFound

    Tree ring: under a year old, growing this month, gaining stars fast

    DataWithBaraa/databricks_bootcamp_2026

    Score 7.2

    Seedlings

    A young Jupyter Notebook specimen, spotted in the data-engineering patch. Barely out of the soil.

    In the maintainer's words A data lakehouse on Databricks with the medallion architecture: PySpark, Spark SQL, Delta Lake and Unity Catalog. The project of the free Databricks bootcamp.

    • ~45 stars a month (new, 10 months ago, top 45% in data-engineering)
    • pushed 14d ago
    • MIT licensed
    • data-engineering
    • 466 stars
    • last growth
  14. Specimen No. 014Habitat: PythonFound

    Tree ring: under a year old, growing this week, gaining stars fast

    exmergo/dex

    Score 7

    Seedlings

    Found in the claude-code patch: a young Python specimen. Barely out of the soil.

    In the maintainer's words Dex lets your agent build your analytics.

    • ~28 stars a month (new, 5 months ago, top 60% in data-engineering)
    • pushed today
    • Apache-2.0 licensed
    • claude-code
    • data-engineering
    • duckdb
    • 140 stars
    • last growth
  15. Specimen No. 015Habitat: TypeScriptFound

    Tree ring: under a year old, growing this week, gaining stars

    hadziqmtqn/erd-builder-pro

    Score 6.5

    Seedlings

    Young TypeScript growth, turned up in the developer-tools patch. Fresh from the seed bed.

    In the maintainer's words ERD Builder Pro is a database design and documentation tool for developers. Build ERDs, flowcharts, notes, and drawings — all in one workspace

    • pushed today
    • ~27 stars a month (new, 8 months ago, top 68% in data-engineering)
    • a license licensed
    • database, matches your patch
    • devtools, matches your patch
    • data-engineering
    • developer-tools
    • 209 stars
    • last growth
  16. Specimen No. 016Habitat: PythonFound

    Tree ring: under a year old, growing this week, gaining stars

    dagster-io/skills

    Score 5.9

    Seedlings

    A young Python specimen, spotted in the data-engineering patch. Fresh from the seed bed.

    In the maintainer's words A collection of AI skills for working with Dagster

    • pushed 1d ago
    • ~21 stars a month (new, 10 months ago, top 75% in data-engineering)
    • Apache-2.0 licensed
    • claude-code
    • data-engineering
    • 219 stars
    • last growth
  17. Specimen No. 017Habitat: PythonFound

    Tree ring: under a year old, growing this month, gaining stars

    sealandseacat/dbmask

    Score 5.7

    Seedlings

    Young Python growth, turned up in the security patch. A seedling, new this season.

    In the maintainer's words Discover, mask, and verify sensitive data in SQL databases — an auditable scan → mask → validate workflow for safe database copies.

    • ~28 stars a month (new, 5 months ago, top 64% in data-engineering)
    • pushed 13d ago
    • MIT licensed
    • database, matches your patch
    • privacy, matches your patch
    • security, matches your patch
    • data-engineering
    • 152 stars
    • last growth
  18. Specimen No. 018Habitat: PythonFound

    Tree ring: under a year old, growing this month, gaining stars

    docglow/docglow

    Score 5.6

    Seedlings

    Young Python growth, turned up in the data-engineering patch. Barely out of the soil.

    In the maintainer's words Modern documentation site generator for dbt Core — lineage explorer, health scoring, full-text search. Live demo: https://demo.docglow.com

    • pushed 7d ago
    • ~18 stars a month (new, 9 months ago, top 79% in data-engineering)
    • MIT licensed
    • data-engineering
    • 153 stars
    • last growth
  19. Specimen No. 019Habitat: PythonFound

    Tree ring: under a year old, quiet for a month or more, gaining stars fast

    jrlasak/databricks-code-practice

    Score 5.3

    Seedlings

    Found in the data-engineering patch: a young Python specimen. Fresh from the seed bed.

    In the maintainer's words Practice Databricks coding skills with hands-on exercises. Import into Databricks Free Edition, write code, run assertions, check pass/fail. Covers Delta Lake, Spark SQL, PySpark, Auto Loader, medall…

    • ~39 stars a month (new, 8 months ago, top 56% in data-engineering)
    • pushed 32d ago
    • CC-BY-SA-4.0 licensed
    • data-engineering
    • 298 stars
    • last growth
  20. Specimen No. 020Habitat: PythonFound

    Tree ring: under a year old, growing this week, a few new stars

    Riley-Dorrington/job-board-aggregator

    Score 5.3

    Seedlings

    A young find from in the data-engineering patch, rooted in Python. A seedling, new this season.

    In the maintainer's words Job board aggregator indexing 1,000,000+ active positions from 20,000+ companies across Greenhouse, Lever, Ashby, Workday, and other major ATS platforms. Multithreaded Python ETL pipeline, daily auto…

    • pushed today
    • ~18 stars a month (new, 11 months ago, top 83% in data-engineering)
    • MIT licensed
    • data-engineering
    • 187 stars
    • last growth
  21. Specimen No. 021Habitat: PythonFound

    Tree ring: under a year old, growing this week, a few new stars

    benseverndev-oss/goldenmatch

    Score 5.2

    Seedlings

    Spotted in the rust patch, a young specimen rooted in Python. Fresh from the seed bed.

    In the maintainer's words Zero-config entity resolution feeding a durable identity layer: messy records from any source become stable golden entities, a Customer 360 with provenance, merge/split and audit. Fellegi-Sunter beat…

    • pushed today
    • ~17 stars a month (new, 8 months ago, top 85% in typescript)
    • MIT licensed
    • llm, matches your patch
    • rust, matches your patch
    • data-engineering
    • mcp-server
    • typescript
    • 139 stars
    • last growth
  22. Specimen No. 022Habitat: PythonFound

    Tree ring: under a year old, dormant for three months or more, gaining stars fast

    schumannx/full-stack-data-engineering

    Score 4.5

    Seedlings

    Found in the data-engineering patch: a young Python specimen. A seedling, new this season.

    In the maintainer's words End-to-end streaming data platform on AWS: Kafka → Iceberg lake → Kimball model → Athena, orchestrated with Airflow 3. Terraform, Glue PySpark, dbt.

    • ~49 stars a month (new, 3 months ago, top 41% in data-engineering)
    • data-engineering
    • 155 stars
    • last growth
  23. Specimen No. 023Habitat: GoFound

    Tree ring: under a year old, growing this month, a few new stars

    aleksandarskrbic/khaos

    Score 3.7

    Seedlings

    A young Go specimen, spotted in the data-engineering patch. Fresh from the seed bed.

    In the maintainer's words Kafka data generator and load testing tool - generate fake messages, simulate producers and consumers, test broker failures, and run chaos engineering scenarios

    • pushed 16d ago
    • Apache-2.0 licensed
    • ~15 stars a month (new, 11 months ago, top 91% in data-engineering)
    • data-engineering
    • 165 stars
    • last growth
  24. Specimen No. 024Habitat: ShellFound

    Tree ring: under a year old, growing this month, a few new stars

    AltimateAI/data-engineering-skills

    Score 3.4

    Seedlings

    Young Shell growth, turned up in the claude-code patch. Barely out of the soil.

    In the maintainer's words Skills related to Data Engineering Work for Claude Code

    • pushed 24d ago
    • MIT licensed
    • ~13 stars a month (new, 10 months ago, top 95% in data-engineering)
    • claude-code
    • data-engineering
    • 135 stars
    • last growth
  25. Specimen No. 025Habitat: TypeScriptFound

    Tree ring: under a year old, growing this month, a few new stars

    data-diving/dbt-ui

    Score 3.1

    Seedlings

    A young TypeScript specimen, spotted in the data-engineering patch. A seedling, new this season.

    In the maintainer's words A modern web-based user interface for dbt-core projects

    • pushed 14d ago
    • MIT licensed
    • ~13 stars a month (new, 10 months ago, top 99% in data-engineering)
    • data-engineering
    • 130 stars
    • last growth
  26. Specimen No. 026Habitat: TypeScriptFound

    Tree ring: under a year old, dormant for three months or more, gaining stars

    OpenRaiser/ProDa

    Score 2.2

    Seedlings

    A young find from in the data-engineering patch, rooted in TypeScript. Barely out of the soil.

    In the maintainer's words 📖 Data Engineering from Raw Corpora

    • ~22 stars a month (new, 7 months ago, top 72% in data-engineering)
    • data-engineering
    • data-science
    • 150 stars
    • last growth