DataFlow CLI terminal interface screenshot

DataFlow CLI

Python command-line tool for orchestrating ETL pipelines with composable task graphs, retry logic, and PostgreSQL state tracking. Over 800 stars on GitHub.

PythonClickPostgreSQL
GitHub 800+ Stars

DataFlow CLI turns a folder of small Python functions into a dependency graph that runs in the right order, retries what fails and remembers what already succeeded. It grew out of a nightly reporting job that kept failing halfway through and starting again from the top.

Each task records its state in PostgreSQL, so a rerun resumes from the first failed step. The Click interface keeps everyday commands short (run, retry, status) and the graph can be printed as a tree to explain a pipeline to a new teammate.

The project is open source and maintained with a handful of regular contributors; it has passed 800 stars on GitHub.

Other Projects

PulseBoard

Real-time analytics dashboard delivering live event streams and KPI visualisations via a React front-end and WebSocket-powered Node.js backend.

ReactNode.jsWebSockets

OpenCart Optimizer

Open source Shopify app that reduces cart abandonment through smart checkout flow improvements powered by the GraphQL Storefront API.

ReactGraphQLShopify API