Expand your career with BeachHead as a Senior Data Engineer specializing in Databricks and Data Platform Migration strategies. Engage in a large-scale project transforming legacy data systems in Capital Markets.
In this impactful position, you will leverage your expertise in Databricks to design and implement efficient data pipelines. Responsibilities include optimizing Spark/Scala workflows and ensuring top-notch data quality through validation and reconciliation efforts. You will also work collaboratively with technical teams to meet business needs.
Key Responsibilities:
• Design and implement data ingestion pipelines on Databricks
• Optimize data processing workflows using Spark/Scala
• Develop solutions for real-time data ingestion
• Create medallion architecture for data access
• Contribute to data quality and validation processes
Requirements:
• Extensive experience with Databricks
• Advanced knowledge of Apache Spark and Scala
• Proven success in...