Position Description:
Your future duties and responsibilities:
• Develop and execute ETL test cases to validate data extraction, transformation, and loading processes.
• Perform ETL pipeline testing in Azure Databricks (ADB) environments.
• Write complex SQL queries to verify data integrity, consistency, and correctness across source and target systems.
• Automate ETL testing workflows using Python, PyTest, or similar frameworks.
• Conduct data reconciliation, schema validation, and comprehensive data quality checks.
• Identify and report data anomalies, performance issues, ...