Fx Innovation vous offre une belle opportunité pour un i ngénieur de données-Intermédiaire
Faites partie d'un projet innovateur! au sein de l'équipe plateforme de données, vous allez participer à une variété de projets intéressants!On cherche un candidat billingue!Bilingual (French & English) with excellent verbal and written communication skillsOur Partner in the finance sector wants to hire onedata engineer azure data lake specialist .
This consultant is going to be part of the Data platform team to help in multiple projects to transform data and serve multiple needs.The bulk of the work will be in data exploration, data ingestion, data transformation, data preparation, designing, building, and developing pipelines consolidating streaming and batch data sources into the Enterprise Data Lake. The engineer will also participate in the elaboration of a validation tool for the quality of data in the data lake.Duration : 12 monthPossibility of renewal : YesPossibility to convert to a permanent position : YesResponsibilities / Accountabilities:Use ofDatabricksfor transformation and loading of the data in the different layers
Use ofSpark/Pythonfor the development of the libraries
Use ofAzure DevOpspipelines to automate the CI/CD
Participate in the development of the dataset and incorporate new sources from the data lake
Develop best practices on the data quality validationRequirements:Professional Experience
4 years in the development in spark/python
4 years on databricks
2 years on Azure DevOps
1 year Powershell
Experience on azure data lake
Experience on data factorySoft Skills
Strong interpersonal, teamwork, coordination and consensus building skills
Strong communication, documentation, storytelling, creativity, and presentation skills
Strong organizational skills, the ability to perform under pressure and to manage multiple priorities with competing demandsBilingual (French & English) with excellent verbal and written communication skills