We are seeking an experienced Data Engineer with aminimum of 8 years of hands-on expertise in Big Data technologies, specifically Hadoop, Python, and Spark. The ideal candidate will play a critical role in designing, building, and maintaining scalable data processing systems that enable advanced analytics and business intelligence across the organization.
Responsibilities - Design, implement, and optimize large-scale data pipelines using Hadoop, Spark, and related Big Data frameworks.
- Develop robust ETL processes to ingest, transform, and store structured and unstructured data from multiple sources.
- Write efficient, reusable, and well-documented code in Python for data processing and automation tasks.
- Collaborate with data scientists, analysts, and business stakeholders to understand data requirements and deliver actionable solutions.
- Monitor, troubleshoot, and enhance the performance of data systems to ensure reliability and scal...