Job Requirements:
Design, develop, and optimize scalable ETL/ELT pipelines and data workflows using Python and SQL.
Build and maintain batch and real-time data processing systems using tools such as Apache Airflow, Apache Kafka, and DBT.
Develop robust data integration solutions to ingest data from multiple sources into data warehouses.
Collaborate with stakeholders and cross-functional teams to gather business requirements and translate them into scalable data models and technical solutions.
Perform data modeling and schema design for analytical and operational reporting systems.
Work with relational databases such as Oracle, PostgreSQL, and MySQL for querying, optimization, and data warehousing.
Implement and maintain real-time streaming solutions using Apache Kafka and related technologies.
Monitor data pipelines and ensure data quality, consistency, integrity, reliability, and performance across systems.
Troubleshoot and resolve issues related to...