👋🏾 Hey NYC! We're hosting a Rooftop Happy Hour followed by presentations at Astronomer's HQ next Wednesday, July 17th! Come by for delicious drinks and bites, followed by 2 awesome presentations: ✅ Mastering dbt Projects with Cosmos: Streamlining Orchestration and Boosting Productivity with George Yates ✅ And XComs x Google Sheets (Toast’s Version) with James Roselle! Register here if you can make it! https://lnkd.in/gA49uwXR
Apache Airflow
Non-profit Organizations
Apache Airflow is a Open Source platform to programmatically author, schedule & monitor workflows.
About us
Apache Airflow is an open-source platform for developing, scheduling, and monitoring batch-oriented workflows. Airflow's extensible Python framework enables you to build workflows connecting with virtually any technology. A web interface helps manage the state of your workflows. Airflow is deployable in many ways, varying from a single process on your laptop to a distributed setup to support even the biggest workflows. It is a de-facto standard for Data Engineering & ETL pipelines
- Website
-
https://airflow.apache.org/
External link for Apache Airflow
- Industry
- Non-profit Organizations
- Company size
- 1,001-5,000 employees
- Type
- Nonprofit
- Founded
- 2015
- Specialties
- data engineering, etl, data science, workflow, python, dag, airflow, and Apache Airflow
Employees at Apache Airflow
-
Mathew Wicks
Founder of deployKF | MLOps Consultant | Kubeflow Lead | Airflow Helm Chart Maintainer | Open Source Advocate
-
Albert Okiri
Driving Sustainable Waste Management @NuruData | Empowering Decision Makers @Acies Crest | Contributor @Apache Airflow
-
Harshit Mohan
Manager - Digital and Data Services at PwC
Updates
-
Who doesn't love savings? 🤑 Learn how Adam Bayrami and his team at NerdWallet halved their Snowflake costs at Airflow Summit! Join Adam and fellow data enthusiasts in San Francisco on September 10th-12th by registering below! #airflowsummit2024 #dataconference #costoptimization
-
-
Want to get up-to-date on the latest in the Airflow Community? Join this month's Town Hall as we dig into; 💡 The current state of the OpenLineage project with Michael Robinson, Ph.D. 💻 PR Demos ft. Jarek Potiuk & Hyung Gook Yoo 📈 A presentation on migrating away from Control-M by Arjun Anandkumar 🎟 A walkthrough of the program for Airflow Summit with Briana Okyere! Register here! https://lnkd.in/gmj78Edn
-
-
🔊 New post by Mihir Samant is LIVE on our Medium Learn how Mihir built an ETL pipeline with Apache Airflow, using Spotify's API! The article dives into how to automate data extraction, transformation, and loading processes efficiently with Airflow's DAGs. A must-read for anyone looking to enhance their data engineering workflows 🌊 Check it out below! #DataEngineering #ApacheAirflow #ETL #Spotify #Automation
-
🚀 Exciting News! The Airflow Summit 2024 program is now live! 🎉 Check out the amazing lineup of speakers and sessions we have in store. Don't miss out on the latest insights and innovations in Airflow. 💫 See you there! https://lnkd.in/eqHFm3k
Program
airflowsummit.org
-
Apache Airflow reposted this
Join Jed Cunningham to explore the current status of AIP-63: DAG Versioning. We'll discuss motivations, challenges in managing DAG history, UI improvements, and future steps from AIP-66. Don't miss it! Register at: https://airflowsummit.org/ Apache Airflow #Airflow #DAGVersioning #TechTalk #AirflowSummit #ApacheAirflow #AirflowSummit2024 #dataorchestration #batchprocessing #dataprocessing #datapipelines #data #datasience #opensource
-
-
Apache Airflow reposted this
🚀 Tackling #MachineLearning challenges! Learn how Phillies are using Airflow to deploy, retrain, and monitor ML models, empowering teams to focus on baseball research. ⚾ Join Mike Hirsch & Sophie Keith at #AirflowSummit Register at: https://airflowsummit.org/ Apache Airflow #AirflowSummit #Airflow #ApacheAirflow #AirflowSummit2024 #dataorchestration #batchprocessing #dataprocessing #datapipelines #data #datasience #opensource
-
-
With all the new sessions being announced, we're getting excited for Airflow Summit 2024! Secure your spot to join us this September in San Francisco! https://airflowsummit.org/
With #Airflow managing itself, you can focus on the data rather than the operational overhead. As proof of that Marion Azoulai and Maggie Stark will share their favorite statistics and revealing insights around how the world’s data teams use Airflow. Join us for #AirflowSummit 2024! Register here: https://airflowsummit.org/ Apache Airflow Astronomer #AirflowSummit #Airflow #ApacheAirflow #AirflowSummit2024 #dataorchestration #batchprocessing #dataprocessing #datapipelines #data #datasience #opensource
-
-
Exciting news! We're launching our Los Angeles Chapter! 🌅 With the help of System1 and Astronomer, we will be hosting our first Chapter Event on August 7th. Talks Include: ✅ Curbing Chaos: Scaling to 100s of Thousands of Data Ingestions Per Day with Gregory Baker from System1 ✅ What's Coming in Airflow 3.0 with Daniel Standish from Astronomer Register below to enjoy an evening of delicious bites 🍔 and drinks 🍷 and meet fellow Airflow enthusiasts! https://lnkd.in/gBRVm9pw #meetup #dataevent #losangelestech
-
-
Apache Airflow reposted this
⚾ Join Alexander Booth & Oliver Dykstra at Airflow Summit as they discuss how they utilized Apache Airflow to power a world series victory for the Texas Rangers Baseball Club! Learn more about their talk and register for Airflow Summit 2024 below ⬇ https://airflowsummit.org #AirflowSummit #Airflow #ApacheAirflow #AirflowSummit2024 #dataorchestration #batchprocessing #dataprocessing #datapipelines #data #datasience #opensource
-