Job Description:

The Data Engineer will perform the following tasks:

• Design, build, and maintain ETL/ELT pipelines.

• Automate data ingestion from various sources (databases, APIs, streaming services).

• Implement data validation and quality checks.

• Use platforms like Azure for cloud-based data solutions.

• Work with Data Scientists and Full stack Web Developers to provide clean, reliable data.

• Create and maintain comprehensive technical documentation, including user manuals, training materials, and product specifications, also developing functional specifications.

• Provide ongoing support for deployed pipelines including version control, data recovery processes, and deployment strategies.

• Research emerging technologies and industry trends, staying up to date with developments in the field, and actively assisting in testing and evaluating new products, tools, and technologies.

The ...