Astronomer on LinkedIn: If you’re already using one of the big name cloud solutions to run Apache… (2024)

With 165+ million downloads in 2023, Apache Airflow is the gold standard for data orchestration. See why it's trusted by data pros worldwide 🌏.Dive into our #Airflow101 learning path—your perfect guide to mastering core concepts, the #Airflow UI, and best practices for creating your first data pipeline. 🌟 🎓 Start learning 👉 https://lnkd.in/gQfAf3nE#dataengineering #dataorchestration #datapipelines

41

Explore how Astronomer transforms #Airflow management with our interactive product tour!From orchestrating tasks and data workflows to ensuring secure 🔒 connections and complete pipeline #observability, we simplify every step and help you understand performance metrics, manage costs, and ensure deployment health.Start the tour now 💻 https://bit.ly/4eHPyYD#DataWorkflows #DataPipelines #DataOps #DataEngineering #Astro

16

🛠️ Struggling with failed tasks or scheduling issues in #Airflow?Learn best practices for configuring automatic task retries, manually rerunning tasks or #DAGs, triggering historical DAG runs, and mastering catchup and backfill.Check out our detailed guide 👉 https://bit.ly/3VInHi2#DataEngineering #Automation #DataPipeline

13

🏆⚾ Step up to the major leagues of data orchestration at Airflow Summit! Don't miss the keynote featuring the 2023 World Series Champions, Texas Rangers Baseball Club. Discover firsthand how they clinched victory with Apache Airflow powering their strategic plays.🎤 Hear from industry leaders Alexander Booth and Oliver Dykstra as they share their winning data pipeline playbook that drove agile, data-driven decisions both on and off the field.Don’t let this opportunity slide by! Register with code 30DISC_ASTRONOMER and save 30% on your tickets. https://bit.ly/3VV487I #AirflowSummit2024 #dataconference #Airflow #DataOrchestration #DataPipelines #TexasRangers

19

Tackling complex data processing challenges requires innovative solutions.In this episode, Cyrus Dukart of Vibrant Planet shares how they developed a self-healing approach to resource allocation. By leveraging Kubernetes executor within Airflow, they overcame limitations and optimized their workflow.Discover how this innovative method transforms their operations and ensures efficient handling of large datasets. This is a must-watch for anyone dealing with resource management in data engineering.The full episode is linked in the comments below.#AI #Automation #Airflow #MachineLearning

12

1 Comment

Discover how Vibrant Planet revolutionizes geospatial data processing and resource management.In the latest episode of The Data Flowcast: Mastering Airflow for Data Engineering & AI, we sit down with Vibrant Planet’s Engineering Lead, Cyrus Dukart, and Staff Software Engineer, David Sacerdote. They share their innovative approaches to optimizing large datasets and ensuring efficient resource allocation using Airflow.From discussing the inefficiencies in resource allocation to the creation of a custom task decorator for better management, this episode is packed with insights and practical solutions.To hear the episode, follow the link in the comments.#AI #Automation #Airflow #MachineLearning

13

1 Comment

Today, we could not be more thrilled to announce Cohort 3 of The Astronomer Champions Program for Apache Airflow! 🏆 With a 50% acceptance rate, Cohort 3 brings a breadth and depth of experience into the program, from folks who teach Airflow courses in their spare time, to others who draft regular documentation to educate others on the project. 📚 👏🏾 So without further ado, please welcome Cohort 3!🌟Abhiram Yenugadhati, AI/ML Engineer at ServiceNow🌟Abhishek Sharma, Lead Engineer at airtel x Labs🌟Ayoade Adegbite, Data Analyst Engineer at WIREPICK🌟Alejandro Almaraz, Senior Data Engineer at EPAM Systems🌟Arjun Anandkumar, Data Engineer at Telia Denmark🌟Guilherme Vargas, Data Engineer at Oto CRM🌟Kewal Krishan, Sr. Software Developer Jet2 Travel Technologies Pvt Ltd.🌟Kristina Sharaeva, Data Engineer at Quantori🌟Loo C., Lead Data Engineer🌟Marcus Guidoti, Data Platform Architect at Grupo Boticário🌟Mihir Samant, Senior Data Analyst at Etraveli Group🌟Nelson Alfonso CITP, Lead Software Architect at Circadia Health🌟Prakhar Srivastava, Data Engineer at EyeVi Technologies🌟Priyansh Gupta, Lead Software Engineer at Gartner🌟Rahul Pateriya, Manager at Capgemini🌟Raviteja Tholupunoori, Engineer 2 at Deloitte Digital🌟Samyak Jain, Senior Data Engineer at 99acres.com🌟Siddhartha Kumar, Sr. Softwre Engineer at Tiger Analytics🌟Snir Israeli, Senior Data Engineer at Next Insurance🌟Sumit Kanoje, Lead Data Engineer at Mangtas🌟Supriya Badgujar, Manager at Blue Altair🌟Volker Janz, Expert Data Engineer at InnoGames🌟Wael Ben Msaad, Data Cloud Engineer at Carrefour Links🌟Yiming Peng, PhD, Senior Software Engineer at Weta FXLearn more about our Champions and their Airflow experience below!

47

2 Comments

🌟 Feeling grateful and proud to be recognized by Chronosphere with the "Cost Savings Award" in their first Observability Innovation Awards! 🏆A big thank you for acknowledging our efforts in saving customers money while boosting developer productivity. Honored to be in great company with other winners DoorDash, Robinhood, and Rubrik. #Observability #Innovation #GameRecognizesGame

11

🌟 Don’t miss tomorrow's webinar featuring Marc Lamberti and Kenten Danas, with special guest Luan Moreno Medeiros Maciel!Save your spot 👉 https://lnkd.in/gK6k5gdD

19

🎓 Get Apache Airflow Certified for Free! Hurry! ⏰ Only a few days left to take advantage of this special offer. Sign up for a trial of #Astro using your business email and get a FREE #Airflow Fundamentals Certification exam (valued at $150)! ✅ After you sign up, check your inbox for a code to redeem your exam. Offer ends June 30th! ⏳Don’t wait—sign up today! 👉 Start your trial: https://bit.ly/4aMF8nr#ApacheAirflow #Certification #AirflowCertification #DataEngineering

42

3 Comments