An end-to-end LLM reference implementation providing a Q&A interface for Airflow and Astronomer

A self-contained, ready to run Airflow ELT project. Can be run locally or within codespaces.

An ETL Orchestration using Apache Airflow to extract CSV files from a Google Drive, validate, transform, and load into a PostgreSQL database.

This project demonstrates how to build and automate an ETL pipeline using DAGs in Airflow and load the transformed data to Bigquery. There are different tools that have been used in this project such as Astro, DBT, GCP, Airflow, Metabase.

An example project of how to use local devcontainers with the Astronomer Astro platform

Reference implementations for orchestration project using Astronomer/Airflow

Sentiment Analysis using DistlBERT Transformer from HuggingFace. Also integrated Airflow for end-to-end pipeline

Este projeto tem como objetivo extrair dados da API FIPE utilizando um ambiente Astronomer com Airflow para orquestração das tarefas que facilita o gerenciamento e implantação de fluxos de trabalho.

Airflow DAGs project with DBT hosted by Astronomer.

Chess Data Harmony is an ETL data engineering project using different tools like Python with pandas, AWS S3, Snowflake, all orchestrated by Airflow (Astronomer)

This project demonstrates how to use Terraform to provision data infrastructure on GCP to facilitate ETL pipeline.

ETL PIPELINE AIRFLOW

This DBT (Data Build Tool) project leverages GCP (Google Cloud Platform) services, specifically Google BigQuery, and Metabase for data transformation, visualization, and Sales Dashboard creation, while also utilizing Soda (Streaming Data Build Tool) for real-time data processing

Setting up the dev environment with the Docker compose , Astro and Airflow

Hello, Astronomer! - The Enterprise Framework for Apache Airflow

astro plugin for asdf version manager

Repo for Datafest Datathon 2024