Skill: Big Data Engineer
Exp: 5 to 8 years
Loc: Pune preferred, Mumbai ,Chennai, Bangalore, Hyderabad
Job Description
Big Data Engineer Spark Java Apache Iceberg
We are seeking a skilled Big Data Engineer with handson experience in Apache Spark Java and Apache Iceberg to design and develop scalable data processing solutions The ideal candidate will build high performance ETL pipelines optimize data lake architectures and ensure reliability quality and efficiency across largescale datasets
Key Responsibilities
Develop and optimize distributed data processing pipelines using Apache Spark Java
Design build and maintain Iceberg based data lake tables with strong focus on ACID transactions schema evolution and timet ravel capabilities
Implement efficient data ingestion transformation and storage strategies using Parquet ORC
Collaborate with data architects product teams and DevOps to deliver scalable production grade data solutions
Troubleshoot p...