Job Overview
Hybrid schedule: every Thursday and the third Friday of each month. Office location: 81 Bay Street, 19th Floor. Line of Business: Capital Markets.
Working on CMDA (Capital Markets Data Architecture) to centralize capital markets data on Databricks; typical work includes data ingestion, building data pipelines, enrichment, and modeling to retrieve/serve data from Databricks.
Responsibilities
- Design, build, and maintain data pipelines on Databricks/Spark for ingestion, curation, and retrieval of capital markets data.
- Perform data enrichment and data modeling aligned to business needs and platform standards.
- Write clean, efficient SQL and Python for transformations, validation, and automation.
- Collaborate with the team lead (assigns JIRAs/work items) and senior developers; participate in code reviews and delivery ceremonies.
- Operate within Azure (preferred) and adapt concepts from other clouds as n...