webinar register page

Data Orchestration | How Astronomer Scaled Up Their BI with Airflow

The Astronomer data team developed a data pipeline process, based on a combination of Airflow, Snowflake, and Sigma. This enabled the team to scale up from a handful of sources and 400 tasks per day, to more than 25 sources and over 20,000 tasks per day in under twelve months. The team can now move from prototype to production BI dashboards in a day if needed. We plan on sharing a tour of the infrastructure, data architecture, governance processes, tools, conventions, and standards that helped the team address the manual, ad hoc, disorganized environment many organizations face, including what worked and what challenges remain.

Presenters:
Maggie Stark
Maggie is a Senior Data Scientist at Astronomer. She has a bachelor's degree in Physics and a master's in Data Science, both from the University of Washington. She joined Astronomer in February 2021 and is one of the founding members of the data team. In her role, Maggie is responsible for orchestrating and scaling the internal data infrastructure.

Morgan Lewis
Morgan is a Business Analyst at Astronomer. She has an undergraduate degree in Economics from Ball State University and an MBA from Indiana University. Morgan joined Astronomer in September 2020 and is responsible for managing and instrumenting cross-company BI projects.

This event series is sponsored by Astronomer!

Note:
All sessions of this event series are open to all genders. All participants must abide by the Women in Analytics Code of Conduct.

Mar 15, 2023 12:00 PM in Eastern Time (US and Canada)