Join an exciting journey as a Senior Databricks Engineer in the heart of East Toronto. Focus on creating and optimizing advanced AI and ML data platforms.
We are on the lookout for a high-caliber Databricks Engineer who brings strong expertise in AI/ML. You will be pivotal in designing end-to-end data pipelines and enhancing production AI systems. Collaborate closely with data scientists and business teams, applying your skills in Databricks, Spark, and Python to build impactful solutions.
Key Responsibilities:
• Develop and deploy ML models utilizing MLflow
• Implement MLOps pipelines for model training and serving
• Optimize cluster performance to lower compute costs
• Build solutions using RAG and LLM with Mosaic AI
• Ensure compliance and data security throughout processes
Requirements:
• Minimum 5 years in Databricks & Apache Spark
• Proficient in Python & PySpark programming
• Familiarity with ...