Big Data Developer / Data Engineer

Job Summary

We are seeking a highly skilled Big Data Developer / Data Engineer with strong expertise in Spark, PySpark, DataProc, and Airflow to design, build, and optimize scalable data processing pipelines on Google Cloud Platform (GCP). The ideal candidate should have hands-on experience with big data technologies, cloud-native architectures, and distributed data processing frameworks.

Key Responsibilities

• Design, develop, and maintain scalable big data solutions using Spark and PySpark .
• Build and optimize ETL/ELT pipelines for large-scale data processing.
• Work with Google Cloud Platform (GCP) services including DataProc, BigQuery, Cloud Storage, Compute Engine, and Cloud Functions .
• Develop workflow orchestration pipelines using Apache Airflow .
• Create and optimize complex SQL queries for data transformation and analytics. ...