Get the latest tech news
Show HN: I built an open-source data pipeline tool in Go
Build data pipelines with SQL and Python, ingest data from different sources, add quality checks, and build end-to-end flows. - bruin-data/bruin
It works with all the major data platforms and runs on your local machine, an EC2 instance, or GitHub Actions. 📥 ingest data with ingestr/ Python ✨ run SQL & Python transformations on many platforms 📐 table/view materializations, incremental tables 🐍 run Python in isolated environments using uv 💅 built-in data quality checks 🚀 Jinja templating to avoid repetition ✅ validate pipelines end-to-end via dry-run 👷 run on your local machine, an EC2 instance, or GitHub Actions 🔒 secrets injection via environment variables VS Code extension for a better developer experience ⚡ written in Golang 📦 easy to install and use If you have defined your credentials, bruin will automatically detect them and validate all of your queries using dry-run.
Or read this on Hacker News