4+ years of experience in Azure Databricks with PySpark
4+ years of experience in Azure Cloud platform
3+ years of experience in ADF (Azure Data Factory), ADLS Gen 2 and Azure SQL
2+ years of experience in Databricks workflow & Unity catalog
2+ years of experience in Python programming & package builds
Experience in data ingestion, cleansing, and transformation processes from various structured and unstructured data sources like Cassandra & Mark Logic and on-prem Mainframe sources using Databricks/PySpark supporting batch and near-real-time ingestion, transformation, and processing.
Manage job scheduling, orchestration, and monitoring (e.g., using Azure Data Factory, Airflow, or Databricks Workflows).
Ability to design modular, reusable workflows usin...