Data Engineer

Job Description:

• Develop and maintain data pipelines using Python and Airflow
• Design and build ETL workflows for large-scale data processing
• Create reusable and scalable Python modules and packages
• Work with Snowflake / Snowpark for data transformation and storage
• Write and optimize complex SQL queries (joins, CTEs, subqueries)
• Schedule and monitor pipelines using Airflow DAGs
• Handle pipeline failures and reprocess error data
• Orchestrate workflows to run sequentially and in parallel
• Import/export data in formats like CSV, JSON, XML
• Work with cloud storage (AWS S3 preferred)