5-10 Years Focused on manipulating data in a software engineering capacity. Some of that data might live in relational systems, but it is increasingly moving towards NoSQL systems and data lakes. Normalize databases and ascertain the structure of the data meets the requirements of the applications that are accessing the information. Construct datasets that are easy to analyze and support company requirements. Combine raw information from different sources to create consistent and machine-readable formats. This IT role requires a significant set of technical skills, including a deep knowledge of SQL, data modeling, and tools like Spark/Hive/Airflow. Must have skills and experience required for creating Databricks pipelines for multiple types of sources. * Working experience with batch and real-time data processing frameworks. * Working experience with data modelling, data access, schemas, and data storage techniques. * Working experience with data quality tools. * Experience in creati...