Our client is seeking an experienced Senior Data Engineer to play a critical role in advancing a modern cloud-based data platform. This opportunity is ideal for a highly skilled engineer with deep Spark and Python expertise who enjoys solving complex data challenges, modernising legacy systems, and contributing to scalable, high-performance data solutions within a collaborative engineering environment.
Requirements Bachelor's degree in Computer Science, Information Systems, Engineering, or a related field 6+ years of experience working with Spark and Py Spark in production environments Strong Python development experience, including reusable library development and testing Solid T‑SQL skills and experience translating complex business logic into scalable solutions Experience with Azure Synapse Analytics, Dedicated SQL Pools, and Azure Data Factory Hands‑on experience with Delta Lake and Parquet within high-volume environments Strong understanding of Spark internals, performanc...