Job Description
Senior Data Engineer role to design and maintain scalable data pipelines for accounting, finance, payments, and tax functions within a large-scale financial systems platform. The role involves creating ETL/ELT workflows using Python, dbt, Airflow across Snowflake, Redshift, Kafka, Spark, and Hive, ensuring critical business data availability and reliability. Cross-functional Agile environment with direct stakeholder engagement.
Responsibilities
- Design, develop, and maintain scalable and reliable ETL/ELT pipelines.
- Build and optimize data workflows using dbt and Airflow.
- Develop and maintain data solutions leveraging Snowflake, Redshift, Kafka, Spark, and Hive.
- Work with both SQL and NoSQL databases to support data ingestion, transformation, and analytics needs.
- Monitor, troubleshoot, and improve data pipeline performance, scalability, and reliability.
- Collaborate closely with cross-function...