🍁 SearchCanadaJobs.com

Lead Data Engineer

Company

Mercedes-Benz

Location

Bengaluru, Karnataka

Type

Full-time

Tätigkeitsbereich:Forschung & Entwicklung incl. DesignFachabteilung:Cloud, Data & Connected ServicesGesellschaft:Mercedes-Benz Research and Development India Private LimitedStandort:Mercedes-Benz Research and Development India Private Limited, BangaloreStartdatum:sofortVeröffentlichungsdatum:..6Stellennummer:MER3Z8BArbeitszeit:Vollzeit BewerbenAufgaben

Key Responsibilities

Data Engineering & Platform Architecture

  • Architect, design, and govern scalable batch and streaming data platforms using Python (strong OOP design), Apache Spark (PySpark, Spark SQL), and Azure Databricks.
  • Define end-to-end reference architectures for real-time and near-real-time streaming solutions using Apache Kafka or Apache Flink, with Spark Structured Streaming or Apache Flink, ensuring:Event-time correctnessExactly-once processing guaranteesStateful stream processing and checkpointingHigh availability and fault tolerance
  • Own the architectural design of Medallion architecture (Bron...
  • 🍁 Ready to Apply?

    Take the next step in your Canadian career

    Apply Now