ETL & Data Integration software automates the movement and transformation of information between disparate sources. These tools extract data from APIs, databases, and files to load it into warehouses or lakes for analysis. This type of software manages the scheduling and orchestration of complex pipelines using scripts or declarative interfaces. Data engineers use these apps to ensure consistent synchronization of event streams and metadata. Self-hosting these tools prevents reliance on external vendors for the management of sensitive database credentials and internal pipeline logic.
This page lists 8 open source tools in the ETL & Data Integration category. The most popular are Apache Airflow, CyberChef and Kestra. Most use the Apache-2.0 or Elastic-2.0 license, and 8 offer an official Docker image.
Programmatically author, schedule, and monitor workflows using directed acyclic graphs to orchestrate complex data pipelines.
A web application for performing data manipulation tasks including encoding, encryption, compression, and parsing in a browser.
Orchestrate data, AI, and infrastructure workflows using a declarative YAML interface and a large plugin ecosystem.
Moves data from APIs, databases, and files into warehouses, lakes, and AI applications using ELT pipelines.
Build and orchestrate data pipelines using a notebook style interface with support for Python, SQL, and R.
An open source ELT platform that syncs cloud infrastructure metadata from various SaaS sources into data warehouses.
Collect event data from websites and applications to stream into data warehouses and other external services.
Collect customer data from applications and websites to activate it in warehouses and business tools.
Join our newsletter to get shiny new open source software delivered to your inbox. Unsubscribe anytime.