Databricks Engineer

Bethesda, MD - Onsite

Duration: + months

Day-to-day Responsibilities:

Design, build, and maintain scalable data pipelines using Databricks on Microsoft Azure.

Integrate, transform, and manage large volumes of structured data for advanced analytics.

Collaborate with data engineers, Finance SMEs, clients, and stakeholders to deliver secure and reliable data solutions.

Ensure solutions are performance-optimized and compliant with data governance and security practices.

Key Responsibilities:

Design and develop robust ETL pipelines using Databricks.

Integrate and ingest data from multiple sources into Databricks.

Implement data validation, quality checks, and transformation processes.

Monitor and troubleshoot data pipeline performance, resolving bottlenecks and issues.

Document data engineering processes and workflows for transparency and maintainability.

Ensure dat...